GPU price check · updated 2026-09-10
L4 rental prices
L4 rents for $0.87–$1.00 per GPU-hour on demand across 2 sellers this week. The spread is not noise — it is mostly the network fabric, which determines what the chip can actually do.
What fits on L4 (24 GB)
| Model | FP16 | FP8/INT8 | 4-bit |
|---|---|---|---|
| 8B class (Llama 3.1 8B) | 1 GPU | 1 GPU | 1 GPU |
| 32B class (Qwen 32B) | 4 GPUs | 2 GPUs | 1 GPU |
| 70B class (Llama 3.3 70B) | 7 GPUs | 4 GPUs | 2 GPUs |
| 123B class (Mistral Large) | 13 GPUs (multi-node) | 7 GPUs | 4 GPUs |
| 405B class (Llama 3.1 405B) | 41 GPUs (multi-node) | 21 GPUs (multi-node) | 11 GPUs (multi-node) |
| 671B MoE class (DeepSeek-R1) | 68 GPUs (multi-node) | 34 GPUs (multi-node) | 17 GPUs (multi-node) |
Method: VRAM ≈ parameters × bytes/parameter × 1.2 (20% headroom for KV cache and activations at ~8K context). Longer context or high concurrency needs more; training needs far more (optimizer states: ~4–8× weights). GPU counts assume even sharding. Above one 8-GPU node, the interconnect becomes the constraint — restrict to Grade A/B listings. Find the cheapest fit across all GPUs: Model Fit.
Every listing we track
| Provider | SKU | $/GPU-hr | Terms | Grade | Conf | Fabric (as published) | Src |
|---|---|---|---|---|---|---|---|
| Scaleway | L4-1-24G EU (Paris PAR-1) | $0.87 | on-demand | D | publ | 2.5-20 Gbps Ethernet | ↗vendor |
| OVHcloud | Nvidia L4 (24 GB GDDR6, PCIe 4.0) GRA11 (Gravelines, FR) | $1.00 | on-demand | D | publ | Up to 25 Gbps Ethernet (public/private network) | ↗vendor |
Grades summarize deliverability from the seller's own published specs — methodology. Grades measure what sellers publish — deliverability of the written claim, not measured performance. No fleet holds a measured (Verified) badge yet; that tier arrives with the verification harness. A missing fabric field is recorded as unknown, never guessed. Weekly context in the Delivered Compute Report.
Source classes: API = provider's live pricing API · vendor = provider's published page · mkt API = marketplace API · 3rd-party = aggregator (provider publishes no price on its own pages) · quote = quote-gated or "starting at", not a walk-up price. Quote-class prices are shown in tables but excluded from headline ranges, spreads, and fair-price bands.
Method notes
Fair-price band = lowest to median price among Grade A/B on-demand listings — capacity whose published specs support training-class work. Marketplace listings (Vast.ai and similar) are pooled with on-demand in headline stats because both are walk-up prices; they carry confidence "mark" and usually cannot state their fabric. History: weekly snapshots begin September 2026; price-over-time charts appear as the series accumulates. Prices exclude storage, egress, and bundled vCPU/RAM differences — check the source link for the all-in picture before renting.
Prices move weekly. Get the report.
Headline prices, deliverability grades, and one teardown a week — free.
Subscribe free