GPU SuperServer SYS-421GE-TNRT Switch Dual-Root 12xPCIe 5.0 x16 LP slot(s) AIOM/OCP 3.0 Support

Key Applications
High Performance Computing
VDI
AI/Deep Learning Training
Media/Video Streaming
Cloud Gaming
Animation and Modeling
Design & Visualization
3D Rendering
Diagnostic Imaging
Key Features
32 DIMM slots Up to 8TB: 32x 256 GB DRAM Memory Type: 4800MHz ECC DDR5
13 PCIe Gen 5.0 X16 FHFL Slots
AIOM/OCP 3.0 Support
8x 2.5" Hot-swap  SATA drive bays
8x HOT SWAP 2.5” SATA/SAS (AOC required)
8x2.5" Hot-swap  NVMe drive bays
8 Hot-Swap Heavy Duty Fans with Optimal Fan Speed Control
4x 2700W (2+2) Redundant Power Supplies, Titanium Level

Unmatched End-to-End Accelerated Computing Platform

NVIDIA HGX combines NVIDIA A100 Tensor Core GPUs with high-speed interconnects to form the world’s most powerful servers. With 16 A100 GPUs, HGX  has up to 1.3 terabytes (TB) of GPU memory and over 2 terabytes per second (TB/s) of memory bandwidth for unprecedented acceleration. 

Compared to previous generations, HGX provides up to a 20X AI speedup out of the box with Tensor Float 32 (TF32) and a 2.5X HPC speedup with FP64. NVIDIA HGX delivers a staggering 10 petaFLOPS, forming the world’s most powerful accelerated scale-up server platform for AI and HPC.

Purpose-Built for the Convergence of Simulation, Data Analytics, and AI

Massive datasets, exploding model sizes, and complex simulations require multiple GPUs with extremely fast interconnections and a fully accelerated software stack. The NVIDIA HGX™ AI supercomputing platform brings together the full power of NVIDIA GPUs, NVIDIA® NVLink®, NVIDIA InfiniBand networking, and a fully optimized NVIDIA AI and HPC software stack from the NVIDIA NGC™ catalog to provide the highest application performance. With its end-to-end performance and flexibility, NVIDIA HGX enables researchers and scientists to combine simulation, data analytics, and AI to drive scientific progress.

Up to 3X Higher AI Training on Largest Models
DLRM Training

Deep Learning Performance

Deep learning models are exploding in size and complexity, requiring a system with large amounts of memory, massive computing power, and fast interconnects for scalability. With NVIDIA NVSwitch™ providing high-speed, all-to-all GPU communications, HGX can handle the most advanced AI models. With A100 80GB GPUs, GPU memory is doubled, delivering up to 1.3TB of memory in a single HGX. Emerging workloads on the very largest models like deep learning recommendation models (DLRM), which have massive data tables, are accelerated up to 3X over HGX powered by A100 40GB GPUs.