NVIDIA HGX H200 8-GPU 
Specification NVIDIA HGX H200 8-GPU
Product Name NVIDIA HGX H200 8-GPU
Platform Type Accelerated Computing Platform
GPU 8 × NVIDIA H200 Tensor Core GPU
GPU Architecture NVIDIA Hopper
GPU Form Factor SXM5
GPU Memory per GPU 141GB HBM3e
Total GPU Memory 1,128GB HBM3e
Memory Bandwidth per GPU 4.8 TB/s
Total Memory Bandwidth 38.4 TB/s
GPU Interconnect NVIDIA NVLink + NVSwitch
NVLink Generation 4th Generation NVLink
NVLink Bandwidth per GPU 900 GB/s
NVSwitch 4 × 3rd Generation NVIDIA NVSwitch
GPU Topology Fully Connected
PCIe PCIe Gen5
Target Server OEM / ODM Data Center Servers
Target Market AI / HPC / Data Center
Cooling Server-dependent
Form Factor HGX GPU Baseboard
Typical Configuration 8-GPU