GPU price check · updated 2026-09-10
H100 rental prices
H100 rents for $3.99–$3.99 per GPU-hour on demand across 1 sellers this week. The spread is not noise — it is mostly the network fabric, which determines what the chip can actually do.
Committed pricing (1 published rate tracked): from $3.19 per GPU-hour (Together AI (GPU Clusters), reserved). Most committed pricing is quote-gated — the published rates below are the exception, and their spread against on-demand is the basis the futures market can't see. All terms in the table.
What fits on H100 (80 GB)
| Model | FP16 | FP8/INT8 | 4-bit |
|---|---|---|---|
| 8B class (Llama 3.1 8B) | 1 GPU | 1 GPU | 1 GPU |
| 32B class (Qwen 32B) | 1 GPU | 1 GPU | 1 GPU |
| 70B class (Llama 3.3 70B) | 3 GPUs | 2 GPUs | 1 GPU |
| 123B class (Mistral Large) | 4 GPUs | 2 GPUs | 1 GPU |
| 405B class (Llama 3.1 405B) | 13 GPUs (multi-node) | 7 GPUs | 4 GPUs |
| 671B MoE class (DeepSeek-R1) | 21 GPUs (multi-node) | 11 GPUs (multi-node) | 6 GPUs |
Method: VRAM ≈ parameters × bytes/parameter × 1.2 (20% headroom for KV cache and activations at ~8K context). Longer context or high concurrency needs more; training needs far more (optimizer states: ~4–8× weights). GPU counts assume even sharding. Above one 8-GPU node, the interconnect becomes the constraint — restrict to Grade A/B listings. Find the cheapest fit across all GPUs: Model Fit.
Every listing we track
| Provider | SKU | $/GPU-hr | Terms | Grade | Conf | Fabric (as published) | Src |
|---|---|---|---|---|---|---|---|
| Prime Intellect | H100 80GB spot (aggregated) | $0.94 (illus.) | spot | U | mark | not published | ↗vendor |
| Prime Intellect | H100 80GB on-demand (aggregated) | $2.43 (illus.) | on-demand | U | mark | not published | ↗vendor |
| Together AI (GPU Clusters) | H100 (reserved) US, EU, Asia +1 more | $3.19 | reserved | D | publ | High-speed InfiniBand | ↗vendor |
| Together AI (GPU Clusters) | H100 US, EU, Asia +1 more | $3.99 | on-demand | D | publ | High-speed InfiniBand | ↗vendor |
Grades summarize deliverability from the seller's own published specs — methodology. Grades measure what sellers publish — deliverability of the written claim, not measured performance. No fleet holds a measured (Verified) badge yet; that tier arrives with the verification harness. A missing fabric field is recorded as unknown, never guessed. Weekly context in the Delivered Compute Report.
Source classes: API = provider's live pricing API · vendor = provider's published page · mkt API = marketplace API · 3rd-party = aggregator (provider publishes no price on its own pages) · quote = quote-gated or "starting at", not a walk-up price. Quote-class prices are shown in tables but excluded from headline ranges, spreads, and fair-price bands.
Method notes
Fair-price band = lowest to median price among Grade A/B on-demand listings — capacity whose published specs support training-class work. Marketplace listings (Vast.ai and similar) are pooled with on-demand in headline stats because both are walk-up prices; they carry confidence "mark" and usually cannot state their fabric. History: weekly snapshots begin September 2026; price-over-time charts appear as the series accumulates. Prices exclude storage, egress, and bundled vCPU/RAM differences — check the source link for the all-in picture before renting.
Prices move weekly. Get the report.
Headline prices, deliverability grades, and one teardown a week — free.
Subscribe free