NVIDIA GB200 NVL72, 36 Grace™ CPUs and 72 Blackwell GPUs, NVIDIA NVLink™ Switch Tray, for Real-Time Trillion-Parameter Inference and Training
⦁ Per Rack: – 18 x GB200 compute trays + 9 x NVLink™ switch trays – Liquid cooling
⦁ Per Tray: – 4 x NVIDIA Blackwell GPU + 2 x Grace™ CPU – 960GB LPDDR5X + 744GB HBM3e – 4 x NVIDIA NVLink™ Connectors (1.8TB/s) – 4 x NVIDIA ConnectX®-7 OSFP Ports (400Gb/s) – 2 x NVIDIA BlueField®-3 DPUs (400Gb/s)
