Posted 12/26/2023, 1:15:07 PM
Nvidia's New Data Center GPUs Use Staggering Amounts of Power, Raising Sustainability Questions
- Nvidia's new H100 GPUs consume up to 700W each, more than the average US household
- 3.5 million H100 GPUs expected to be sold by end of 2024, consuming over 13 billion kWh annually
- That's more annual power than some small countries like Lithuania or Guatemala
- However, AI/HPC efficiency is improving - B100 will do more work per unit of power
- Total power used by data centers for AI is already comparable to Cyprus' national power usage