GPU comparison
L4 24GB vs A100 SXM 40GB: specs and rental cost comparison
Direct answer
L4 24GB vs A100 SXM 40GB: L4 24GB is cheaper on the lowest tracked rental row at $0.39 per GPU-hour, versus $0.67 for A100 SXM 40GB. That makes A100 SXM 40GB about 71% more expensive per GPU-hour on the cheapest rows in the ByteCosts GPU catalog. L4 24GB has 24 GB VRAM and A100 SXM 40GB has 40 GB VRAM. The tables compare source-backed specs and value metrics only where both GPUs have a real spec field and a tracked rental rate. Rental prices are list rates per GPU-hour, before committed-use discounts, capacity limits, or region constraints.
Compare GPU rental across providers - Cheapest per-GPU-hour by accelerator →
L4 24GB vs A100 SXM 40GB: rental value
Cheapest tracked on-demand rental rows and normalized value metrics.
| Metric | L4 24GB | A100 SXM 40GB |
|---|---|---|
| Cheapest rental / GPU-hour | $0.39 | $0.67 |
| $ / GB VRAM | $0.016 | $0.017 |
| $ / FP16 TFLOP-hour | $0.0032 | $0.0021 |
L4 24GB vs A100 SXM 40GB: specs
Hardware specs from the committed GPU spec catalog. Rows with missing source fields on either GPU are omitted.
| Spec | L4 24GB | A100 SXM 40GB |
|---|---|---|
| Architecture | ada | ampere |
| VRAM | 24 GB | 40 GB |
| Memory bandwidth | 300 GB/s | 1555 GB/s |
| FP16 tensor compute | 121.0 TFLOPS | 312.0 TFLOPS |
| TDP | 72 W | 400 W |
Cheapest tracked rental rows
| GPU | Provider | Instance | Region | GPUs | Instance/hr | Per-GPU/hr |
|---|---|---|---|---|---|---|
| L4 24GB | RunPod | 10x_L4_SECURE | CA | 10 | $3.90 | $0.39 |
| A100 SXM 40GB | Vast.ai | 2x-A100_PCIE-32-65536 | South Korea, KR, AS | 2 | $1.33 | $0.67 |
Frequently asked questions
Is L4 24GB or A100 SXM 40GB cheaper to rent?
L4 24GB is cheaper on the lowest tracked row at $0.39 per GPU-hour, compared with $0.67 for A100 SXM 40GB. Region, capacity, spot interruption, and discounts can change a production bill.
Which is better value, L4 24GB or A100 SXM 40GB?
Use the value table above: $/GB-VRAM is always shown from real VRAM and rental rate, while $/TFLOP rows are shown only when both GPUs have the relevant sourced compute spec. Do not compare a missing field as zero.
Where do these GPU comparison numbers come from?
Rental rates come from the ByteCosts GPU rental catalog normalized from the SkyPilot catalog. Hardware specs come from the committed GPU spec catalog and its per-GPU source URLs.
Cite this page
L4 24GB vs A100 SXM 40GB GPU comparison. ByteCosts. Updated June 15, 2026. https://bytecosts.com/gpu/compare/l4-24gb-vs-a100-sxm-40gb/