Connect with us

xAI

xAI Colossus 2 will be the first-ever Gigawatt+ AI supercomputer

Published

11 months ago

on

xAI brand logo

xAI CEO, Elon Musk, said that Colossus 2 will be the world’s first Gigawatt+ AI training supercomputer, which will be a groundbreaking advancement in AI infrastructure focused on the acceleration of AGI.

Colossus is the first AI supercomputer built in 122 days and started training in 19 days, while officially announced in late 2024. It initially had 100,000 Nvidia GPUs and took only 92 days to complete to add another 100,000 GPUs. According to the most recent data, Colossus is currently serving more than 230,000 GPUs.

This setup approximately consumes 300 megawatts (MW) of power. However, Colossus 2 will go beyond this consumption with its increased GPU count. Based on Musk’s previous statement, Colossus 2 will add 270,000 GB200 and GB300 GPUs to the existing cluster. This will take the total GPU count to 500,000 to train the next generation of Grok models.

These GPUs will require a lot of power, and a Gigawatt+ could be the solution. A Gigawatt equals 1,000 megawatts (MW) or 1 billion watts. The energy consumption doesn’t only account for GPUs, but additional structures like CPUs, memory, networking, and cooling systems.

For now, no AI company has reached a gigawatt of power consumption. For example, OpenAI’s data center currently takes 300MW and plans to expand to 1 GW by mid-2026. If Colossus 2 goes live by this year, it will be the first to achieve this milestone.

A gigawatt-scale data center will require reliable power solutions; therefore, xAI could employ Tesla Megapacks and a dedicated power plant.

xAI Colossus 2 gigawatt+ supercomputer cluster

Elon Musk, xAI CEO, says Colossus 2 will be the world’s first Gigawatt+ AI training cluster

A 2024 air quality report from Memphis shows that xAI’s supercomputer cluster has no significant pollution nearby, which cools down environmental concerns and paves the way for Colossus 2 expansion.

Earlier, Michael Dell met with xAI executive Brent Mayo to discuss the operational development of Colossus 2 at the facility. More updates on Colossus 2 are yet to come.

Related Topics:

Mannoo specializes in Generative AI, Large Language Model (LLM), and Aerospace Science. Prior to delving into these fields, he was a Python programmer, a game designer, and an Android and iOS app developer with over 5 years of experience. He has prior writing experience in creative writing about smartphones and technology before working at Eonmsk.com. You can explore his X/TWitter and LinkedIn pages or contact him through his email.

Continue Reading