GPU comparison
H100 SXM 80GB vs A100 SXM 40GB: specs and rental cost comparison
Direct answer
H100 SXM 80GB vs A100 SXM 40GB: A100 SXM 40GB is cheaper on the lowest tracked rental row at $0.67 per GPU-hour, versus $1.80 for H100 SXM 80GB. That makes H100 SXM 80GB about 171% more expensive per GPU-hour on the cheapest rows in the ByteCosts GPU catalog. H100 SXM 80GB has 80 GB VRAM and A100 SXM 40GB has 40 GB VRAM. The tables compare source-backed specs and value metrics only where both GPUs have a real spec field and a tracked rental rate. Rental prices are list rates per GPU-hour, before committed-use discounts, capacity limits, or region constraints.
Compare GPU rental across providers - Cheapest per-GPU-hour by accelerator →
H100 SXM 80GB vs A100 SXM 40GB: rental value
Cheapest tracked on-demand rental rows and normalized value metrics.
| Metric | H100 SXM 80GB | A100 SXM 40GB |
|---|---|---|
| Cheapest rental / GPU-hour | $1.80 | $0.67 |
| $ / GB VRAM | $0.022 | $0.017 |
| $ / FP16 TFLOP-hour | $0.0018 | $0.0021 |
H100 SXM 80GB vs A100 SXM 40GB: specs
Hardware specs from the committed GPU spec catalog. Rows with missing source fields on either GPU are omitted.
| Spec | H100 SXM 80GB | A100 SXM 40GB |
|---|---|---|
| Architecture | hopper | ampere |
| VRAM | 80 GB | 40 GB |
| Memory bandwidth | 3350 GB/s | 1555 GB/s |
| FP16 tensor compute | 989.5 TFLOPS | 312.0 TFLOPS |
| NVLink bandwidth | 900 GB/s | 600 GB/s |
| TDP | 700 W | 400 W |
Cheapest tracked rental rows
| GPU | Provider | Instance | Region | GPUs | Instance/hr | Per-GPU/hr |
|---|---|---|---|---|---|---|
| H100 SXM 80GB | Vast.ai | 1x-H100_SXM-32-65536 | Florida, US, NA | 1 | $1.80 | $1.80 |
| A100 SXM 40GB | Vast.ai | 2x-A100_PCIE-32-65536 | South Korea, KR, AS | 2 | $1.33 | $0.67 |
Frequently asked questions
Is H100 SXM 80GB or A100 SXM 40GB cheaper to rent?
A100 SXM 40GB is cheaper on the lowest tracked row at $0.67 per GPU-hour, compared with $1.80 for H100 SXM 80GB. Region, capacity, spot interruption, and discounts can change a production bill.
Which is better value, H100 SXM 80GB or A100 SXM 40GB?
Use the value table above: $/GB-VRAM is always shown from real VRAM and rental rate, while $/TFLOP rows are shown only when both GPUs have the relevant sourced compute spec. Do not compare a missing field as zero.
Where do these GPU comparison numbers come from?
Rental rates come from the ByteCosts GPU rental catalog normalized from the SkyPilot catalog. Hardware specs come from the committed GPU spec catalog and its per-GPU source URLs.
Cite this page
H100 SXM 80GB vs A100 SXM 40GB GPU comparison. ByteCosts. Updated June 15, 2026. https://bytecosts.com/gpu/compare/h100-sxm-80gb-vs-a100-sxm-40gb/