GPU price check · updated 2026-09-10
A100-SXM rental prices
A100-SXM rents for $0.91–$2.79 per GPU-hour on demand across 5 sellers this week. The spread is not noise — it is mostly the network fabric, which determines what the chip can actually do.
Committed pricing (3 published rates tracked): from $1.30 per GPU-hour (DataCrunch (rebranded to Verda, verda.com), 2 years). Most committed pricing is quote-gated — the published rates below are the exception, and their spread against on-demand is the basis the futures market can't see. All terms in the table.
What fits on A100-SXM (80 GB)
| Model | FP16 | FP8/INT8 | 4-bit |
|---|---|---|---|
| 8B class (Llama 3.1 8B) | 1 GPU | 1 GPU | 1 GPU |
| 32B class (Qwen 32B) | 1 GPU | 1 GPU | 1 GPU |
| 70B class (Llama 3.3 70B) | 3 GPUs | 2 GPUs | 1 GPU |
| 123B class (Mistral Large) | 4 GPUs | 2 GPUs | 1 GPU |
| 405B class (Llama 3.1 405B) | 13 GPUs (multi-node) | 7 GPUs | 4 GPUs |
| 671B MoE class (DeepSeek-R1) | 21 GPUs (multi-node) | 11 GPUs (multi-node) | 6 GPUs |
Method: VRAM ≈ parameters × bytes/parameter × 1.2 (20% headroom for KV cache and activations at ~8K context). Longer context or high concurrency needs more; training needs far more (optimizer states: ~4–8× weights). GPU counts assume even sharding. Above one 8-GPU node, the interconnect becomes the constraint — restrict to Grade A/B listings. Find the cheapest fit across all GPUs: Model Fit.
Every listing we track
| Provider | SKU | $/GPU-hr | Terms | Grade | Conf | Fabric (as published) | Src |
|---|---|---|---|---|---|---|---|
| Vast.ai (live API) | A100 SXM4 8x (marketplace, cheapest of 2) Mississippi, US | $0.91 | on-demand | C | mark | not published | ↗mkt API |
| DataCrunch (rebranded to Verda, verda.com) | Long-term A100 SXM4 80GB, 2yr (2 years) | $1.30 | committed · min: 2 years | C | publ | not published | ↗vendor |
| Hyperstack | Reserved A100 SXM 80GB (reservation (min term not stated on page; invoiced monthly)) | $1.36 | reserved · min: reservation (min term not stated on page; invoiced monthly) | C | unkn | not published | ↗vendor |
| RunPod | A100 SXM Pod (Secure Cloud) | $1.59 | on-demand | C | publ | not published | ↗vendor |
| DataCrunch (rebranded to Verda, verda.com) | Long-term A100 SXM4 80GB, 1yr (1 year) | $1.59 | committed · min: 1 year | C | publ | not published | ↗vendor |
| TensorDock | A100 SXM4 80GB | from $1.65* | on-demand | C | mark | not published | ↗vendor |
| DataCrunch (rebranded to Verda, verda.com) | A100 SXM4 80GB | $1.79 | on-demand | C | publ | not published | ↗vendor |
| Crusoe | a100-80gb-sxm-ib.8x us-east1-a | $2.30 | on-demand | B | publ | InfiniBand, 1600 Gbps per 8-GPU instance (per docs VM overview) | ↗vendor |
| Lambda | 8x NVIDIA A100 SXM 80GB (on-demand instance) | $2.79 | on-demand | C | publ | not published | ↗vendor |
Grades summarize deliverability from the seller's own published specs — methodology. Grades measure what sellers publish — deliverability of the written claim, not measured performance. No fleet holds a measured (Verified) badge yet; that tier arrives with the verification harness. A missing fabric field is recorded as unknown, never guessed. Weekly context in the Delivered Compute Report.
Source classes: API = provider's live pricing API · vendor = provider's published page · mkt API = marketplace API · 3rd-party = aggregator (provider publishes no price on its own pages) · quote = quote-gated or "starting at", not a walk-up price. Quote-class prices are shown in tables but excluded from headline ranges, spreads, and fair-price bands.
Method notes
Fair-price band = lowest to median price among Grade A/B on-demand listings — capacity whose published specs support training-class work. Marketplace listings (Vast.ai and similar) are pooled with on-demand in headline stats because both are walk-up prices; they carry confidence "mark" and usually cannot state their fabric. History: weekly snapshots begin September 2026; price-over-time charts appear as the series accumulates. Prices exclude storage, egress, and bundled vCPU/RAM differences — check the source link for the all-in picture before renting.
Prices move weekly. Get the report.
Headline prices, deliverability grades, and one teardown a week — free.
Subscribe free