NVIDIA L4  24G
Item Specification
Product Name NVIDIA L4
GPU Architecture NVIDIA Ada Lovelace
CUDA Cores 7,424
RT Cores 60, 3rd Generation
Tensor Cores 240, 4th Generation
GPU Memory 24GB GDDR6 with ECC
Memory Interface 192-bit
Memory Bandwidth 300 GB/s
Interface PCI Express 4.0 x16
Display Connectors 1 × DisplayPort 1.4
FP64 Performance 0.3 TFLOPS
FP32 Performance 30.3 TFLOPS
TF32 Tensor Performance 60.9 TFLOPS
FP16 Tensor Performance 121.0 TFLOPS
BF16 Tensor Performance 121.0 TFLOPS
FP8 Tensor Performance 242.0 TFLOPS
INT8 Performance 242 TOPS
Maximum Power Consumption 72W
Form Factor Low Profile, Single-Slot
Cooling Passive Cooling
Card Length Approx. 168 mm
Card Height Approx. 69 mm
Power Connector No external power connector
ECC Supported
MIG Supported
Target Applications AI Inference / Generative AI / Video Processing / Virtual Workstations / Cloud Gaming / Professional Visualization
Platform Data Center / Enterprise Server