The cloud uses massive amounts of energy. Generative AI will be way worse. A Microsoft data center veteran warns big changes are coming.
For instance, the power consumption of Nvidia's new GH200 server cluster is about two to four times more than a regular cluster of the same physical size, he estimated. Tom Keane, who oversaw Microsoft's cloud data centers for about two decades, recently warned about this.
The surge in AI demand, and the changes coming, present an opportunity for investors like Ganzi."Massive would be the understatement," he said. One key difference between traditional data centers and new AI facilities is how power is consumed. Regular cloud data centers are designed to handle variable demand. When everyone in the US is working and streaming videos, these facilities are busy. When night falls and most people sleep, usage falls. In contrast, AI data centers run constantly, especially when training big models. That requires increased access to power and the ability to sustain it consistently.
Proximity to smaller urban areas means better power density, which means a faster connection. Smaller cities also mean lower power costs for the data center operator. Ideal locations for future data centers will be in low-cost areas, according Cowen.
Argentina Últimas Noticias, Argentina Titulares
Similar News:También puedes leer noticias similares a ésta que hemos recopilado de otras fuentes de noticias.
China finalizes first-of-its-kind rules governing generative A.I. services like ChatGPTChinese regulators on Thursday said it finalized first-of-its-kind rules governing generative artificial intelligence which will come into effect on Aug. 15.
Leer más »
Which generative AI companies could be on the fast-track to IPO?Generative AI solutions are flooding the market because of Microsoft, Google and OpenAI building up an emerging supply line of artificial intelligence companies on the way to IPO.
Leer más »
'Undeniably vast' opportunity: Bank of America names generative A.I. global 'winners'Bank of America described the AI opportunity within the software industry as 'undeniably vast' and ranked European companies in the sector.
Leer más »
Amazon created a new generative AI org, email showsAmazon Web Services has launched a new AI team as it scrambles to compete with rivals like OpenAI, leaked email and transcript shows
Leer más »
China takes major step in regulating generative AI services like ChatGPT | CNN BusinessChina has published new rules for generative artificial intelligence (AI), becoming one of the first countries in the world to regulate the technology that powers popular services like ChatGPT.
Leer más »
China Issues Rules on Generative AI, But Only For Products Used by its CitizensChina has announced new rules on generative AI, mandating that the technology must follow “core values of socialism.”
Leer más »