GPU price check · updated 2026-09-10

H200-SXM rental prices

H200-SXM rents for $3.99–$10.60 per GPU-hour on demand across 9 sellers this week. The spread is not noise — it is mostly the network fabric, which determines what the chip can actually do.

Fair-price band (disclosed training-class, Grade A/B): $4.29–$7.11 per GPU-hour on demand. Below that band, ask what the seller is not telling you about the fabric; above it, you are paying for something the rate card should be able to name.

Committed pricing (13 published rates tracked): from $2.79 per GPU-hour (Hyperstack, reservation (min term not stated on page; invoiced monthly)). Most committed pricing is quote-gated — the published rates below are the exception, and their spread against on-demand is the basis the futures market can't see. All terms in the table.

Is a H200-SXM quote a good deal? Read it in ten seconds

Check a specific quote against your workload, utilization, and committed alternatives on the deal check. Procurement guidance from published prices — not investment advice, and not a view on any futures contract.

What fits on H200-SXM (141 GB)

Method: VRAM ≈ parameters × bytes/parameter × 1.2 (20% headroom for KV cache and activations at ~8K context). Longer context or high concurrency needs more; training needs far more (optimizer states: ~4–8× weights). GPU counts assume even sharding. Above one 8-GPU node, the interconnect becomes the constraint — restrict to Grade A/B listings. Find the cheapest fit across all GPUs: Model Fit.

Every listing we track

Grades summarize deliverability from the seller's own published specs — methodology. Grades measure what sellers publish — deliverability of the written claim, not measured performance. No fleet holds a measured (Verified) badge yet; that tier arrives with the verification harness. A missing fabric field is recorded as unknown, never guessed. Weekly context in the Delivered Compute Report.

Source classes: API = provider's live pricing API · vendor = provider's published page · mkt API = marketplace API · 3rd-party = aggregator (provider publishes no price on its own pages) · quote = quote-gated or "starting at", not a walk-up price. Quote-class prices are shown in tables but excluded from headline ranges, spreads, and fair-price bands.

Method notes

Fair-price band = lowest to median price among Grade A/B on-demand listings — capacity whose published specs support training-class work. Marketplace listings (Vast.ai and similar) are pooled with on-demand in headline stats because both are walk-up prices; they carry confidence "mark" and usually cannot state their fabric. History: weekly snapshots begin September 2026; price-over-time charts appear as the series accumulates. Prices exclude storage, egress, and bundled vCPU/RAM differences — check the source link for the all-in picture before renting.