NVIDIA H100 SXM 80GB


Specification NVIDIA H100 SXM 80GB
Brand NVIDIA
Product NVIDIA H100 Tensor Core GPU
Form Factor SXM5
Architecture NVIDIA Hopper
GPU GH100
CUDA Cores 16,896
Tensor Cores 528, 4th Generation
GPU Memory 80GB HBM3
Memory Interface 5,120-bit
Memory Bandwidth 3.35 TB/s
FP64 Performance 34 TFLOPS
FP64 Tensor Core 67 TFLOPS
FP32 Performance 67 TFLOPS
TF32 Tensor Core 989 TFLOPS
BF16 Tensor Core 1,979 TFLOPS
FP16 Tensor Core 1,979 TFLOPS
FP8 Tensor Core 3,958 TFLOPS
INT8 Tensor Core 3,958 TOPS
L2 Cache 50MB
NVLink 900 GB/s
System Interface SXM5
MIG Up to 7 MIG Instances
TDP Up to 700W
Cooling Passive / System-Level Cooling
Display Outputs None
ECC Yes
Primary Applications AI Training / AI Inference / HPC / Scientific Computing