TL; DR
- OpenAI’s GPT-4.5 video highlights its capabilities but also shows us a part where we can see “Num GPUs for GPT-6 Training.”
- GPT-6 may require over 100,000 GPUs, suggesting a massive scale-up.
OpenAI recently released a video on its YouTube channel, “Introduction to GPT 4.5,” highlighting the capabilities of its latest model, GPT 4.5. The presentation detailed the model’s better, more natural responses and less hallucinations.
At 2:26, the video started showcasing the capabilities of GPT 4.5, where we could see the chat history too. Within this chat history, one entry stood out: “Num GPUs for GPT 6 Training.” No word was spoken on this, though.
“Num” could indicate an unprecedented number—possibly 100,000 GPUs. An old tweet from Kyle Corbitt also confirms this.
ALSO READ: OpenAI Unveils GPT 4.5: Smarter, More Intuitive, but Not for Free Users Yet
Historical context supports this hypothesis. GPT 3’s training used 10,000 GPUs in 2020, while subsequent models demanded greater resources, bolstered by OpenAI’s partnership with Microsoft. Reports from late 2024 indicate preparatory work for a next-generation system, possibly GPT 6.
GPT 4.5, internally designated “Orion,” is a major upgrade in natural responses and less hallucinations, likely comprising over 3 to 4 trillion parameters. Its training, presumably conducted on NVIDIA’s H100 GPUs, may have utilized 30,000 to 50,000 units—a monumental investment estimated at $750 million to $1.5 billion.
ALSO READ: Grok 3 available for free
This aligns with the U.S. AI Safety Institute’s evaluation of an undisclosed OpenAI model. The ambiguous “Num” might stand for something like “Numerous,” signaling that GPT 6’s training scale is so vast it dwarfs everything before it.
Or maybe it’s just misdirection. OpenAI loves a good tease—remember the “Strawberry” codename for the o1 series? Dropping “Num GPUs” could be a way to keep us guessing while they quietly pivot to something unexpected, like a hybrid reasoning model or an AGI prototype.
You can follow Smartprix on Twitter, Facebook, Instagram, and Google News. Visit smartprix.com for the latest tech and auto news, reviews, and guides.
