AI Power Demand Soaring Towards Nation-State Levels

AI workloads are predicted to consume 4.3 GW of power in 2023, approaching the consumption of Cyprus in 2021 (4.7 GW). This is projected to rise to 13.5-20 GW by 2028.

In 2023, AI workloads will account for 8% of total data center power consumption. This is expected to rise to 15-20% by 2028.

More powerful AI GPUs like Nvidia's A100 and H100 are driving increased power consumption. H100 consumes up to 700W compared to 400W for A100.

Larger AI models require more GPUs, resulting in higher power needs. A 22,000 GPU cluster requires 700 racks and 31 MW of power.

Cooling and network infrastructure add to the high power demands of AI workloads. Recommendations include shifting to liquid cooling and higher voltage power distribution.