Breakthrough Universal Accelerator for Efficient Video, AI, and Graphics
With NVIDIA’s AI platform and full-stack approach, L4 is optimized for video and inference at scale for a broad range of AI applications, including recommendations, voice-based AI avatar assistants, generative AI, visual search, and contact center automation to deliver the best personalized experiences.
As the most efficient NVIDIA accelerator for mainstream, servers equipped with L4 enable up to 120X higher AI Video performance over CPU solutions, while providing 2.7X more generative AI performance, and over 4X more graphics performance versus the previous generation.
NVIDIA L4’s versatility and energy-efficient, single-slot, low-profile form factor make it ideal for global deployments, including edge locations.
As the most efficient NVIDIA accelerator for mainstream, servers equipped with L4 enable up to 120X higher AI Video performance over CPU solutions, while providing 2.7X more generative AI performance, and over 4X more graphics performance versus the previous generation.
NVIDIA L4’s versatility and energy-efficient, single-slot, low-profile form factor make it ideal for global deployments, including edge locations.
Architecture
NVIDIA Ada Lovelace
Use Case
Universal Deep Learning and Video AI Accelerator
GPU Clocks
795 MHz Base | 2040 MHz Boost
FP32
30.3 TFLOPS
TF32 Tensor Core
120 TFLOPS | Sparsity
FP16 Tensor Core
242 TFLOPS | Sparsity
BFLOAT16 Tensor Core
242 TFLOPS | Sparsity
FP8Tensor Core
485 TFLOPS | Sparsity
INT8 Tensor Core
485 TOPS | Sparsity
GPU Memory
24GB
ECC
On by Default
Memory Interface
192-bit
Memory Clock
6251 MHz
GPU Memory Bandwidth
300 GB/s
Display Connectors
None | vGPU Only
NVENC | NVDEC
2 | 4 | 4| JPEG Decoders | AV1 Encode and Decode
Thermal Solution
Passive
Ambient Operating Temperature
0 to 50 Degrees Centigrade
Operating Humidity
5% to 85% Relative Humidity
Maximum Power Consumption
72 W | 40 W Minimum
System Interface
PCIe Gen4 x16 | 64GB/s
Form Factor
6.61” L x 2.71” H | Single Slot | Low-Profile
Server Options
Partner and NVIDIA-Certified Systems with 1-8 GPUs
Hardware Root of Trust
Yes
NEBS Ready
Yes | Level 3