GPU comparison
A100 SXM 40GB vs H200 SXM 141GB: specs and rental cost comparison
Direct answer
A100 SXM 40GB vs H200 SXM 141GB: A100 SXM 40GB is cheaper on the lowest tracked rental row at $0.67 per GPU-hour, versus $2.35 for H200 SXM 141GB. That makes H200 SXM 141GB about 253% more expensive per GPU-hour on the cheapest rows in the ByteCosts GPU catalog. A100 SXM 40GB has 40 GB VRAM and H200 SXM 141GB has 141 GB VRAM. The tables compare source-backed specs and value metrics only where both GPUs have a real spec field and a tracked rental rate. Rental prices are list rates per GPU-hour, before committed-use discounts, capacity limits, or region constraints.
Compare GPU rental across providers - Cheapest per-GPU-hour by accelerator →
A100 SXM 40GB vs H200 SXM 141GB: rental value
Cheapest tracked on-demand rental rows and normalized value metrics.
| Metric | A100 SXM 40GB | H200 SXM 141GB |
|---|---|---|
| Cheapest rental / GPU-hour | $0.67 | $2.35 |
| $ / GB VRAM | $0.017 | $0.017 |
| $ / FP16 TFLOP-hour | $0.0021 | $0.0024 |
A100 SXM 40GB vs H200 SXM 141GB: specs
Hardware specs from the committed GPU spec catalog. Rows with missing source fields on either GPU are omitted.
| Spec | A100 SXM 40GB | H200 SXM 141GB |
|---|---|---|
| Architecture | ampere | hopper |
| VRAM | 40 GB | 141 GB |
| Memory bandwidth | 1555 GB/s | 4800 GB/s |
| FP16 tensor compute | 312.0 TFLOPS | 989.5 TFLOPS |
| NVLink bandwidth | 600 GB/s | 900 GB/s |
| TDP | 400 W | 700 W |
Cheapest tracked rental rows
| GPU | Provider | Instance | Region | GPUs | Instance/hr | Per-GPU/hr |
|---|---|---|---|---|---|---|
| A100 SXM 40GB | Vast.ai | 2x-A100_PCIE-32-65536 | South Korea, KR, AS | 2 | $1.33 | $0.67 |
| H200 SXM 141GB | Vast.ai | 1x-H200-32-65536 | France, FR, EU | 1 | $2.35 | $2.35 |
Frequently asked questions
Is A100 SXM 40GB or H200 SXM 141GB cheaper to rent?
A100 SXM 40GB is cheaper on the lowest tracked row at $0.67 per GPU-hour, compared with $2.35 for H200 SXM 141GB. Region, capacity, spot interruption, and discounts can change a production bill.
Which is better value, A100 SXM 40GB or H200 SXM 141GB?
Use the value table above: $/GB-VRAM is always shown from real VRAM and rental rate, while $/TFLOP rows are shown only when both GPUs have the relevant sourced compute spec. Do not compare a missing field as zero.
Where do these GPU comparison numbers come from?
Rental rates come from the ByteCosts GPU rental catalog normalized from the SkyPilot catalog. Hardware specs come from the committed GPU spec catalog and its per-GPU source URLs.
Cite this page
A100 SXM 40GB vs H200 SXM 141GB GPU comparison. ByteCosts. Updated June 15, 2026. https://bytecosts.com/gpu/compare/a100-sxm-40gb-vs-h200-sxm-141gb/