Musk Warns Massive Compute Needs for AI Models Becoming Unsustainable
• Elon Musk says next-gen AI models will need power equivalent of a small city, citing 100,000 Nvidia H100 GPUs needed for xAI's Grok 3
• 700W per H100 GPU means over 70MW just for GPUs, let alone full infrastructure to support massive model
• Entire city of Paris in 2022 had 500MW of data center power, so one AI model using 2x that is unsustainable
• Musk also predicts AGI will surpass human intelligence in 1-2 years, though his predictions historically optimistic
• 5x increase in GPUs from xAI's Grok 2 to Grok 3 signals difficult-to-sustain scaling in resources needed for next-gen AI