NVIDIA DGX H100 
Specification NVIDIA DGX H100
Product Name NVIDIA DGX H100
System Type AI / HPC Data Center Server
GPU 8 × NVIDIA H100 Tensor Core GPU
GPU Memory 640GB HBM3 total
GPU Memory per GPU 80GB HBM3
GPU Memory Bandwidth 3.35 TB/s per GPU
GPU Architecture NVIDIA Hopper
CPU 2 × Intel Xeon Platinum 8480C
CPU Cores 112 cores total
System Memory 2TB DDR5 ECC
NVSwitch 4 × NVIDIA NVSwitch
NVLink 4th Generation NVLink
NVLink Bandwidth 900 GB/s per GPU
Network 8 × NVIDIA ConnectX-7 400Gb/s
Network Bandwidth 3.2 Tb/s
Storage 30.72TB NVMe SSD
Form Factor 8U Rackmount
Power Supply 10.2 kW maximum
Cooling Air Cooling
Operating System NVIDIA DGX OS
Management NVIDIA Base Command Manager
Target Market AI / Machine Learning / HPC
Main Applications LLM Training, AI Inference, Generative AI, HPC