GPU comparison

V100 SXM2 16GB vs A100 SXM 40GB: specs and rental cost comparison

Direct answer

V100 SXM2 16GB vs A100 SXM 40GB: V100 SXM2 16GB is cheaper on the lowest tracked rental row at $0.17 per GPU-hour, versus $0.67 for A100 SXM 40GB. That makes A100 SXM 40GB about 280% more expensive per GPU-hour on the cheapest rows in the ByteCosts GPU catalog. V100 SXM2 16GB has 16 GB VRAM and A100 SXM 40GB has 40 GB VRAM. The tables compare source-backed specs and value metrics only where both GPUs have a real spec field and a tracked rental rate. Rental prices are list rates per GPU-hour, before committed-use discounts, capacity limits, or region constraints.

Compare GPU rental across providers - Cheapest per-GPU-hour by accelerator →

V100 SXM2 16GB vs A100 SXM 40GB: rental value

Cheapest tracked on-demand rental rows and normalized value metrics.

V100 SXM2 16GB vs A100 SXM 40GB rental value comparison
MetricV100 SXM2 16GBA100 SXM 40GB
Cheapest rental / GPU-hour$0.17$0.67
$ / GB VRAM$0.011$0.017
$ / FP16 TFLOP-hour$0.0014$0.0021

V100 SXM2 16GB vs A100 SXM 40GB: specs

Hardware specs from the committed GPU spec catalog. Rows with missing source fields on either GPU are omitted.

V100 SXM2 16GB vs A100 SXM 40GB source-backed GPU specs
SpecV100 SXM2 16GBA100 SXM 40GB
Architecturevoltaampere
VRAM16 GB40 GB
Memory bandwidth900 GB/s1555 GB/s
FP16 tensor compute125.0 TFLOPS312.0 TFLOPS
NVLink bandwidth300 GB/s600 GB/s
TDP300 W400 W

Cheapest tracked rental rows

V100 SXM2 16GB vs A100 SXM 40GB cheapest tracked rows
GPUProviderInstanceRegionGPUsInstance/hrPer-GPU/hr
V100 SXM2 16GBVast.ai2x-Tesla_V100-32-65536North Carolina, US, NA2$0.35$0.17
A100 SXM 40GBVast.ai2x-A100_PCIE-32-65536South Korea, KR, AS2$1.33$0.67

Frequently asked questions

Is V100 SXM2 16GB or A100 SXM 40GB cheaper to rent?

V100 SXM2 16GB is cheaper on the lowest tracked row at $0.17 per GPU-hour, compared with $0.67 for A100 SXM 40GB. Region, capacity, spot interruption, and discounts can change a production bill.

Which is better value, V100 SXM2 16GB or A100 SXM 40GB?

Use the value table above: $/GB-VRAM is always shown from real VRAM and rental rate, while $/TFLOP rows are shown only when both GPUs have the relevant sourced compute spec. Do not compare a missing field as zero.

Where do these GPU comparison numbers come from?

Rental rates come from the ByteCosts GPU rental catalog normalized from the SkyPilot catalog. Hardware specs come from the committed GPU spec catalog and its per-GPU source URLs.

Cite this page

V100 SXM2 16GB vs A100 SXM 40GB GPU comparison. ByteCosts. Updated June 15, 2026. https://bytecosts.com/gpu/compare/v100-sxm2-16gb-vs-a100-sxm-40gb/

Sources