NVIDIA L40S  48G

Item Specification
Product Name NVIDIA L40S
GPU Architecture NVIDIA Ada Lovelace
CUDA Cores 18,176
RT Cores 142, 3rd Generation
Tensor Cores 568, 4th Generation
GPU Memory 48GB GDDR6 with ECC
Memory Interface 384-bit
Memory Bandwidth 864 GB/s
Interface PCI Express 4.0 x16
Display Connectors 4 × DisplayPort 1.4a
FP64 Performance 1.4 TFLOPS
FP32 Performance 91.6 TFLOPS
TF32 Tensor Performance 366.4 TFLOPS
FP16 Tensor Performance 733 TFLOPS
BF16 Tensor Performance 733 TFLOPS
FP8 Tensor Performance 1,466 TFLOPS
INT8 Performance 1,466 TOPS
Maximum Power Consumption 350W
Form Factor Full-Height, Full-Length, Dual-Slot
Cooling Passive Cooling
Card Length 10.5 in / 267 mm
Card Height 4.4 in / 112 mm
Power Connector 1 × 16-pin
ECC Supported
MIG Not Supported
Target Applications Generative AI / LLM / Inference / 3D Rendering / Professional Visualization / HPC
Platform Data Center / Enterprise Server