xAI CEO visits Colossus 2 site to get an update

xAI CEO Elon Musk visited the Colossus 2 site to check the AI supercomputer’s development progress and meet the xAI team to get an update on further preparations.

Colossus 2 is an expansion to the Colossus 1 Supercomputer, launched late last year. Located in an industrial park in South Memphis, Tennessee, xAI built the first version in just 122 days with 100,000 Nvidia GPUs, which expanded to 200,000 units within the next 100 days.

With the second version, the GPU capacity will cross 550,000 units, including Nvidia GB200 and GB300. The company has set a long-term roadmap to reach 1 million GPUs, bringing the Grok model’s AI capability to the next level.

It is predicted that scaling compute by 10x could roughly double AI intelligence, with Colossus 2 enabling models like Grok 5, which could launch by the end of the year, will top competitors on all benchmarks.

xAI CEO, Elon Musk, visited the Colossus 2 site and met the team

Once completed, Colossus 2 will be the world’s first gigawatt-scale AI training supercomputer, fetching more than 1 gigawatt of power for a full million-GPU setup. This energy demand will also be supported by Tesla’s Megapacks for storage capacity.

The purpose of this new facility expansion is to improve the reasoning and output threshold of the Grok chatbot to do more than just generate AI text and images. The company has revealed a goal to solve technological problems, make new innovations, and generate hour-long videos with AI.

Such complex tasks will require immense computing power, which cannot be done with the current infrastructure. So, Colossus 2 is just a part of the bigger picture that will unfold in the near future when xAI will increase the GPU count and take it above 1 million units.

(source)