Posted 4/13/2024, 11:12:11 AM
Intel Unveils Gaudi 3 AI Chip, Claiming 50% Speed Edge Over Nvidia's Flagship
- Intel launched Gaudi 3 AI accelerator, claiming 50% faster training and inference than Nvidia's H100
- Gaudi 3 boasts 4x AI compute, 1.5x more memory bandwidth, and 2x networking bandwidth over previous gen
- Built on 5nm, Gaudi 3 has 64 AI cores and 128GB memory, outpacing H100 on models like Llama 7B/13B and GPT-3
- Intel claims Gaudi 3 beats even next-gen H200 on some models, with 30% faster inference on Llama and Falcon
- Gaudi 3 available to OEMs in Q2 2024 and general availability in Q3, positioning as cheaper but competitive alternative to Nvidia