xAI CEO reveals a special feature of Colossus 2 cluster

xAI CEO, Elon Musk, has revealed that Colossus 2 supercomputer cluster will have “MACROHARD” painted on the roof, and it will be as large as you can see it from space.

Colossus is the world’s largest supercomputer cluster, located in Memphis, and built in 122 days. The company hosted 100,000 GPUs in the initial run and then doubled this count in the next phase of 92 days.

The current cluster with more than 200k GPUs serves 194 petabytes/s memory bandwidth, 3.6 terabits/s network bandwidth per server, and more than 1 exabyte of storage capacity.

The company has a plan to expand the GPU count to 1 million to gain compute power and advance its AI system. In this direction, Colossus 2 has become a stepping stone, which will take the GPU count to more than 550,000 units installed in an expanded facility. This new capacity will contribute to a more powerful training ecosystem for the Grok AI bot and future models.

The term “Marcohard” was coined by Elon Musk under the xAI venture, designed to compete against Microsoft by creating pure AI software and agents that could simulate or replace traditional software ecosystems. The name is a humorous take on Microsoft, emphasizing xAI’s goal to bring new agentic capabilities to the software world.

Painting the word MACROHARD on top of the Colossus 2 facility will be a big feature for the cluster, but we’ll have to see how it actually looks when the cluster comes online.

(source)