NVIDIA H200 NVL 
Item Specification
Product Name NVIDIA H200 NVL
GPU Architecture NVIDIA Hopper
GPU NVIDIA H200
GPU Memory 141GB HBM3e
Memory Type HBM3e
Memory Interface 6,144-bit
Memory Bandwidth 4.8 TB/s
CUDA Cores 16,896
Tensor Cores 528, 4th Generation
RT Cores 132, 3rd Generation
FP64 Performance Up to 30 TFLOPS
FP32 Performance Up to 60 TFLOPS
TF32 Tensor Performance Up to 1,979 TFLOPS
BF16 Tensor Performance Up to 1,979 TFLOPS
FP16 Tensor Performance Up to 1,979 TFLOPS
FP8 Tensor Performance Up to 3,341 TFLOPS
INT8 Tensor Performance Up to 3,341 TOPS
PCIe Interface PCIe 5.0 x16
NVLink Up to 900 GB/s
Form Factor PCIe, Dual-Slot
Cooling Passive / Server Air Cooling
Maximum TDP 600W
ECC Supported
MIG Up to 7 MIG instances
MIG Memory Up to 16GB per instance
Target Applications Generative AI / LLM / HPC / Deep Learning / Scientific Computing
Platform Enterprise AI Servers / Data Centers