Posted 3/27/2024, 3:03:11 PM
New Benchmarks Show Nvidia and Qualcomm Chips Excel in AI Speed and Efficiency
- New AI benchmarks from MLCommons measure speed of responses from AI models like ChatGPT
- Tests show Nvidia H100 servers fastest, with designs from Google, Supermicro, Nvidia winning
- New image generation benchmark won by Krai server with Qualcomm AI chip, using less power
- Intel submitted design with Gaudi2 chips, described performance as "solid"
- Separate MLCommons benchmark measures power consumption, important for deploying AI