Elon Musk announced that he wants to build a training cluster for #AI with 200,000 graphics cards from #Nvidia #H100 GPUs. Let's assume 500 watts for a single #GPU. That means 500 watts * 24 hours * 365 days per year * 200,000 (GPUs) = 876 GWh or 876,000,000 kWh.
#Musk #Grok #ChatGPT #o1 #energyConsumption #climateCrisis
https://www.tomshardware.com/tech-industry/nvidias-h100-gpus-will-consume-more-power-than-some-countries-each-gpu-consumes-700w-of-power-35-million-are-expected-to-be-sold-in-the-coming-year
Currently, #xAI seems to have 100,000 GPUs for that cluster.