GPU comparison
A100 SXM 40GB vs H100 NVL 94GB: specs and rental cost comparison
Direct answer
A100 SXM 40GB vs H100 NVL 94GB: A100 SXM 40GB is cheaper on the lowest tracked rental row at $0.67 per GPU-hour, versus $3.19 for H100 NVL 94GB. That makes H100 NVL 94GB about 380% more expensive per GPU-hour on the cheapest rows in the ByteCosts GPU catalog. A100 SXM 40GB has 40 GB VRAM and H100 NVL 94GB has 94 GB VRAM. The tables compare source-backed specs and value metrics only where both GPUs have a real spec field and a tracked rental rate. Rental prices are list rates per GPU-hour, before committed-use discounts, capacity limits, or region constraints.
Compare GPU rental across providers - Cheapest per-GPU-hour by accelerator →
A100 SXM 40GB vs H100 NVL 94GB: rental value
Cheapest tracked on-demand rental rows and normalized value metrics.
| Metric | A100 SXM 40GB | H100 NVL 94GB |
|---|---|---|
| Cheapest rental / GPU-hour | $0.67 | $3.19 |
| $ / GB VRAM | $0.017 | $0.034 |
| $ / FP16 TFLOP-hour | $0.0021 | $0.0038 |
A100 SXM 40GB vs H100 NVL 94GB: specs
Hardware specs from the committed GPU spec catalog. Rows with missing source fields on either GPU are omitted.
| Spec | A100 SXM 40GB | H100 NVL 94GB |
|---|---|---|
| Architecture | ampere | hopper |
| VRAM | 40 GB | 94 GB |
| Memory bandwidth | 1555 GB/s | 3900 GB/s |
| FP16 tensor compute | 312.0 TFLOPS | 835.5 TFLOPS |
| NVLink bandwidth | 600 GB/s | 600 GB/s |
| TDP | 400 W | 400 W |
Cheapest tracked rental rows
| GPU | Provider | Instance | Region | GPUs | Instance/hr | Per-GPU/hr |
|---|---|---|---|---|---|---|
| A100 SXM 40GB | Vast.ai | 2x-A100_PCIE-32-65536 | South Korea, KR, AS | 2 | $1.33 | $0.67 |
| H100 NVL 94GB | RunPod | 10x_H100-NVL_SECURE | CA | 10 | $31.90 | $3.19 |
Frequently asked questions
Is A100 SXM 40GB or H100 NVL 94GB cheaper to rent?
A100 SXM 40GB is cheaper on the lowest tracked row at $0.67 per GPU-hour, compared with $3.19 for H100 NVL 94GB. Region, capacity, spot interruption, and discounts can change a production bill.
Which is better value, A100 SXM 40GB or H100 NVL 94GB?
Use the value table above: $/GB-VRAM is always shown from real VRAM and rental rate, while $/TFLOP rows are shown only when both GPUs have the relevant sourced compute spec. Do not compare a missing field as zero.
Where do these GPU comparison numbers come from?
Rental rates come from the ByteCosts GPU rental catalog normalized from the SkyPilot catalog. Hardware specs come from the committed GPU spec catalog and its per-GPU source URLs.
Cite this page
A100 SXM 40GB vs H100 NVL 94GB GPU comparison. ByteCosts. Updated June 15, 2026. https://bytecosts.com/gpu/compare/a100-sxm-40gb-vs-h100-nvl-94gb/