Wait
2020 May 19
https://news.microsoft.com/source/features/ai/openai-azure-supercomputer/
The supercomputer developed for OpenAI is a single system with more than
285,000 CPU cores, 10,000 GPUs and 400 gigabits per second of network
connectivity for each GPU server.
GPT-4:
As of my
https://twitter.com/jabowery/status/1774506113569812892
On Sun, Mar 31, 2024 at 8:38 AM Matt Mahoney
wrote:
> The supercomputer called Stargate will have millions of GPUs and use
> gigawatts of electricity. It is scheduled for 2028 with smaller version to
> be completed in 2026.
>
>
The supercomputer called Stargate will have millions of GPUs and use
gigawatts of electricity. It is scheduled for 2028 with smaller version to
be completed in 2026.
https://www.reuters.com/technology/microsoft-openai-planning-100-billion-data-center-project-information-reports-2024-03-29/