NVIDIA H200 SXM5 
Item Specification
Product Name NVIDIA H200 SXM5
GPU Architecture NVIDIA Hopper
GPU NVIDIA H200
GPU Memory 141GB HBM3e
Memory Interface 6,144-bit
Memory Bandwidth 4.8 TB/s
CUDA Cores 16,896
Tensor Cores 528, 4th Generation
RT Cores 132, 3rd Generation
FP64 Performance Up to 34 TFLOPS
FP32 Performance Up to 67 TFLOPS
TF32 Tensor Performance Up to 1,979 TFLOPS
BF16 Tensor Performance Up to 1,979 TFLOPS
FP16 Tensor Performance Up to 1,979 TFLOPS
FP8 Tensor Performance Up to 3,958 TFLOPS
INT8 Tensor Performance Up to 3,958 TOPS
NVLink 900 GB/s
Form Factor SXM5
TDP Up to 700W
Memory Type HBM3e
ECC Supported
Multi-GPU Interconnect NVIDIA NVLink
Target Applications Generative AI / LLM / HPC / Scientific Computing / Deep Learning
Platform NVIDIA HGX / DGX / Enterprise AI Servers