Posted 3/12/2024, 3:05:08 PM
Anthropic Announces Major AI Infrastructure Expansion with 350,000 H100 GPUs to Power Next-Generation Models
- Announcing details on two new 24k GPU clusters to power current and next-gen AI models like Llama 3
- Clusters feature NVIDIA H100 GPUs, high-speed RoCE and InfiniBand networking, optimized storage for fast iteration
- Continued commitment to open computing and open source through contributions to OCP and PyTorch
- By end of 2024, aiming for 350k H100 GPUs equivalent to nearly 600k H100s total
- Constantly evaluating and improving infrastructure to support fast-evolving AI models and research