Elon Musk’s xAI Unveils ‘Colossus’ AI Training System with 100,000 Nvidia Chips
TMTPOST--Elon Musk's AI startup, xAI Corp., has successfully assembled its highly anticipated AI training system, known as "Colossus," powered by 100,000 Nvidia graphics cards.
Musk announced the achievement in a post on X (formerly Twitter) on Monday, revealing that the Colossus system went live over the weekend.
Launched last year to rival OpenAI, which Musk is currently suing over alleged contract breaches, xAI focuses on developing advanced large language models, branded as Grok. In May, the startup secured $6 billion in funding at a valuation of $24 billion to drive its AI initiatives.
In his recent post, Musk described Colossus as the “most powerful AI training system in the world,” hinting that it may outperform the U.S. Department of Energy's Aurora system, currently the world’s fastest AI supercomputer. Aurora recently achieved a peak speed of 10.6 exaflops, utilizing 87% of its capacity during a benchmark test in May.
Musk also disclosed that Colossus is equipped with 100,000 of Nvidia's H100 GPUs, which debuted in 2022. These H100 chips are Nvidia's most powerful AI processors to date, capable of running large language models up to 30 times faster than the previous generation.
More News