Nvidia Just Unveiled Its New Supercomputer For AI Training -

Nvidia made waves at the Supercomputing 2023 trade show with the unveiling of Eos, a revolutionary data center-scale supercomputer hailed as an “AI factory.” Named after the Greek goddess of dawn, Eos represents a paradigm shift in artificial intelligence (AI) development, aiming to redefine the boundaries of AI acceleration.

Eos, powered by a formidable infrastructure comprising 576 Nvidia DGX H100 systems and Quantum-2 InfiniBand networking, boasts 18.4 exaflops of FP8 AI performance. This leap in performance, surpassing previous supercomputing endeavors like SaturnV and Selene, showcases Nvidia’s advanced DGX SuperPOD architecture, enabling seamless scalability to meet the demands of high-performance AI solutions.

At the core of Eos lie 4,608 H100 GPUs, strategically distributed across the DGX H100 systems’ eight H100 Tensor Core APUs. This configuration is finely tuned to tackle extensive AI workloads, including training large language models, executing AI recommenders, conducting expansive analytics, and simulating quantum scenarios.

Nvidia underscores Eos’s architecture as finely optimized for AI tasks necessitating ultra-low latency and high throughput in expansive computing clusters. The supercomputer’s networking prowess, achieving speeds of up to 400GB/s, is pivotal for managing vast datasets crucial for AI model training.

Moreover, Eos integrates specialized software to augment AI development and deployment. Base Command streamlines AI workflows manages clusters and provides acceleration libraries for computing storage and networking. AI Enterprise, a cloud-native platform, accelerates AI application development, positioning itself as the go-to “operating system” for enterprise-level AI endeavors.

Eos’s remarkable capabilities earned it the ninth spot on the prestigious TOP500 list of the world’s fastest supercomputers.