NVIDIA L40 
Item Specification
Product Name NVIDIA L40
GPU Architecture NVIDIA Ada Lovelace
CUDA Cores 18,176
RT Cores 142, 3rd Generation
Tensor Cores 568, 4th Generation
GPU Memory 48GB GDDR6 with ECC
Memory Interface 384-bit
Memory Bandwidth 864 GB/s
Interface PCI Express 4.0 x16
Display Connectors 4 × DisplayPort 1.4a
FP64 Performance 1.4 TFLOPS
FP32 Performance 90.5 TFLOPS
TF32 Tensor Performance 362 TFLOPS
FP16 Tensor Performance 733 TFLOPS
BF16 Tensor Performance 733 TFLOPS
FP8 Tensor Performance 1,466 TFLOPS
INT8 Performance 1,466 TOPS
Maximum Power Consumption 300W
Form Factor Full-Height, Full-Length, Dual-Slot
Cooling Passive Cooling
Card Length 10.5 in / 267 mm
Card Height 4.4 in / 112 mm
Power Connector 1 × 16-pin
ECC Supported
MIG Not Supported
Target Applications AI / Inference / 3D Rendering / Professional Visualization / Virtual Workstations / HPC
Platform Data Center / Enterprise Server