NVIDIA A100 80GB SXM 
Specification A100 80GB SXM
GPU Architecture NVIDIA Ampere
GPU NVIDIA A100 Tensor Core GPU
GPU Memory 80GB HBM2e
Memory Interface 5120-bit
Memory Bandwidth 2,039 GB/s
CUDA Cores 6,912
Tensor Cores 432, 3rd Generation
RT Cores N/A
FP64 Performance 9.7 TFLOPS
FP32 Performance 19.5 TFLOPS
TF32 Tensor Performance 312 TFLOPS
BF16 Tensor Performance 624 TFLOPS
FP16 Tensor Performance 624 TFLOPS
INT8 Tensor Performance 1,248 TOPS
INT4 Tensor Performance 2,496 TOPS
GPU Interconnect NVLink
NVLink Bandwidth 600 GB/s
Form Factor SXM4
TDP 400W
Cooling Passive / Server Cooling
Display Outputs None
ECC Yes
Memory Type HBM2e
MIG Up to 7 GPU Instances
Target Market Data Center / AI / HPC
Main Applications AI Training, AI Inference, HPC, Scientific Computing