ByteCosts

GPU rental pricing

Azure GPU pricing: rental cost per hour by GPU and region

Last updated June 15, 2026 · ByteCosts

Direct answer

Azure rents GPU instances from about $0.53 per GPU-hour on-demand (T4 in eastus), or roughly $0.06 per GPU-hour on spot. This page tracks 122 instance rows across 7 GPU models (V100, T4, A100-80GB, H100, V100-32GB, A100, and more) and 8 regions, from the ByteCosts GPU catalog. Per-GPU rate is the instance hourly price divided by GPU count, so multi-GPU boxes can look cheaper per card. Spot and preemptible capacity is not guaranteed and can be reclaimed, so size on-demand for steady jobs and treat spot as a discount for interruptible work.

Compare GPU rental across providers - Cheapest per-GPU-hour by accelerator →

Azure GPU rental at a glance

  • Cheapest on-demand: $0.53 per GPU-hour (T4, Standard_NC4as_T4_v3, eastus)
  • Cheapest spot: $0.06 per GPU-hour (T4)
  • 7 GPU models and 8 regions tracked
  • 122 instance rows, updated June 15, 2026

Cheapest Azure rate by GPU model

Lowest on-demand per-GPU-hour rate for each GPU model Azure offers, from the ByteCosts catalog. Per-GPU rate is the instance hourly price divided by GPU count.

Azure cheapest on-demand rate per GPU model
GPU modelPer-GPU/hrInstanceGPUsRegionInstance/hr
T4$0.53Standard_NC4as_T4_v31eastus$0.53
V100-32GB$2.75Standard_ND40rs_v28eastus$22.03
V100$3.06Standard_NC12s_v32eastus$6.12
A10$3.20Standard_NV36ads_A10_v51eastus$3.20
A100$3.40Standard_ND96asr_v48eastus$27.20
A100-80GB$3.67Standard_NC24ads_A100_v41eastus$3.67
H100$6.98Standard_NC40ads_H100_v51eastus$6.98

When Azure GPUs are cost-effective

Headline per-hour price is only half the story for GPU rental. The variables that move a training or inference bill are GPU utilization (idle reserved capacity is pure waste), whether your job tolerates spot interruption, region and egress fees, and the storage and networking attached to the instance.

Azure tends to win when you can keep the GPU busy, batch interruptible work onto spot, and pick a region close to your data. It tends to lose when capacity sits idle between jobs, when egress moves large datasets out repeatedly, or when a smaller or older GPU would clear your throughput target at a lower rate.

Hidden costs to watch with Azure GPUs

The instance hourly rate rarely equals your invoice. Budget for these before committing:

  • Idle time: a reserved GPU bills whether or not a job is running, so low utilization multiplies effective cost per useful hour.
  • Spot reclaim: interruptible capacity can be taken back mid-job, forcing checkpoints and restarts that add wall-clock and waste.
  • Storage and networking: attached disks, snapshots, and inter-node bandwidth for multi-GPU training are billed on top of the GPU.
  • Egress: moving model weights or datasets out of the region adds per-GB transfer fees.
  • Region spread: the same GPU can cost noticeably more in scarce regions, so the cheapest row may not be where your data lives.

Frequently asked questions

How much does a Azure GPU cost per hour?

Azure rents GPUs from about $0.53 per GPU-hour on-demand for T4 (the Standard_NC4as_T4_v3 instance in eastus), up to higher rates for newer accelerators. See the table above for the cheapest rate per GPU model. Rates are list rental prices before committed-use discounts.

Is spot or on-demand cheaper on Azure?

Spot (interruptible) capacity on Azure can drop to about $0.06 per GPU-hour, well below on-demand, but it can be reclaimed at any time. Use spot for checkpointed, restartable jobs and on-demand for steady serving where an interruption would be costly.

Where does ByteCosts get Azure GPU prices?

Rates come from the SkyPilot open GPU catalog, which mirrors provider pricing, normalized into the ByteCosts GPU index and dated. The provider's own pricing API is the ground truth; the catalog is used for discovery and cross-checking, not re-export. Verify the provider source before production commitments.

Cite this page

Azure GPU rental pricing. ByteCosts. Updated June 15, 2026. https://bytecosts.com/gpu/azure/

Sources