NVIDIA A100 40GB PCIe
Specification A100 40GB PCIe
GPU Architecture NVIDIA Ampere
GPU NVIDIA A100 Tensor Core GPU
GPU Memory 40GB HBM2
Memory Interface 5120-bit
Memory Bandwidth 1.6 TB/s
CUDA Cores 6,912
Tensor Cores 432, 3rd Generation
RT Cores N/A
FP64 Performance 9.7 TFLOPS
FP32 Performance 19.5 TFLOPS
TF32 Tensor Performance 156 TFLOPS
BF16 Tensor Performance 312 TFLOPS
FP16 Tensor Performance 312 TFLOPS
INT8 Tensor Performance 624 TOPS
INT4 Tensor Performance 1,248 TOPS
System Interface PCIe 4.0 x16
NVLink 600 GB/s
TDP 250W
Cooling Passive
Form Factor Dual-slot, Full Height, Full Length (FHFL)
Display Outputs None
ECC Yes
Memory Type HBM2
Multi-Instance GPU (MIG) Up to 7 instances
Target Market Data Center / AI / HPC
Main Applications AI Training, AI Inference, HPC, Scientific Computing