Musk to Build Gigafactory of Compute
Elon Musk is planning to build a supercomputer, dubbed as “gigafactory of compute” with the aim to support its xAI startup.
The information revealed that this project is designed to move further in the development of xAI’s next generation chatbot, Grok, expected to be operational by the fall of 2025. To this end, Musk is committed to ensuring by himself the timely completion of this project, as mentioned in the report.
The report also cited that during a presentation to investors, the US businessman xAI startup may collaborate with Oracle for the development of this vast computing infrastructure. It would benefit from the company’s expertise to build the huge computational network required for xAI’s goals.
This supercomputer will contain 100,000 Nvidia chips, aiming to establish a system that is at least four times larger than the GPU clusters used by tech companies, such as Meta for AI model training.
Nvidia’s H100 are very well known for their efficiency and power in data centers, highly demanded, and hard to procure. Earlier this year, Elon Musk unveiled that the training of the Grok 2 model needed around 20.000 Nvidia H100 GPUs. While the Grok 3 is expected to require 100.000 of these powerful chips.
Since the launch of ChatGPT in 2022, the AI field has become very competitive. Major tech companies, such as Microsoft, Google, and Meta, along with emerging startups such as Anthropic and Stability AI, are working hard to take the lead position in AI technology. Due to his significant financial resources, Musk is one of the few who can deal with giants like OpenAI, Google, and Meta.
Despite unveiling such ambitious plans, neither xAI startup nor Oracle responded to requests for comments from Reuters.
The AI race is continuously growing; therefore, Musk’s latest supercomputer is considered a major step forward, as it could potentially reshape the competitive landscape and set new standards for AI development capabilities.
Inside Telecom provides you with an extensive list of content covering all aspects of the tech industry. Keep an eye on our Intelligent Tech sections to stay informed and up-to-date with our daily articles.