For those who don't understand what Colossus is and why it's a big deal: Colossus is xAI's supercomputer cluster, the physical infrastructure that trains Grok. Hundreds of thousands of Nvidia GPUs wired together to train one model. An H100 is a chip built to do the math behind training AI models. Thousands of these chips wired together act like a supercomputer. Colossus 1 has 150k H100s, plus 50k H200s (same chip, faster memory, so more efficient per chip), plus 30k GB200s (a full generation…

elonmusk@elonmusk20h ago

@minchoi Colossus 1 is 150k H100, 50k H200 and 30k GB200. Colossus 2 is 110k GB200 and 440k GB300. Another 220k GB300 will be fully operational next week and another 220k in November. If we get lucky, yet another 220k GB300 by late December.