GPU price check · updated 2026-09-10
L40S rental prices
L40S rents for $1.37–$1.80 per GPU-hour on demand across 3 sellers this week. The spread is not noise — it is mostly the network fabric, which determines what the chip can actually do.
What fits on L40S (48 GB)
| Model | FP16 | FP8/INT8 | 4-bit |
|---|---|---|---|
| 8B class (Llama 3.1 8B) | 1 GPU | 1 GPU | 1 GPU |
| 32B class (Qwen 32B) | 2 GPUs | 1 GPU | 1 GPU |
| 70B class (Llama 3.3 70B) | 4 GPUs | 2 GPUs | 1 GPU |
| 123B class (Mistral Large) | 7 GPUs | 4 GPUs | 2 GPUs |
| 405B class (Llama 3.1 405B) | 21 GPUs (multi-node) | 11 GPUs (multi-node) | 6 GPUs |
| 671B MoE class (DeepSeek-R1) | 34 GPUs (multi-node) | 17 GPUs (multi-node) | 9 GPUs (multi-node) |
Method: VRAM ≈ parameters × bytes/parameter × 1.2 (20% headroom for KV cache and activations at ~8K context). Longer context or high concurrency needs more; training needs far more (optimizer states: ~4–8× weights). GPU counts assume even sharding. Above one 8-GPU node, the interconnect becomes the constraint — restrict to Grade A/B listings. Find the cheapest fit across all GPUs: Model Fit.
Every listing we track
| Provider | SKU | $/GPU-hr | Terms | Grade | Conf | Fabric (as published) | Src |
|---|---|---|---|---|---|---|---|
| DataCrunch (rebranded to Verda, verda.com) | L40S | $1.37 | on-demand | U | publ | not published | ↗vendor |
| Scaleway | L40S (L40S-*-48G) EU (Paris PAR-2) | $1.68 | on-demand | U | seco | not published | ↗3rd-party |
| OVHcloud | Nvidia L40S (48 GB GDDR6, PCIe 4.0) GRA11 (Gravelines, FR) | $1.80 | on-demand | D | publ | Up to 25 Gbps Ethernet (public/private network) | ↗vendor |
Grades summarize deliverability from the seller's own published specs — methodology. Grades measure what sellers publish — deliverability of the written claim, not measured performance. No fleet holds a measured (Verified) badge yet; that tier arrives with the verification harness. A missing fabric field is recorded as unknown, never guessed. Weekly context in the Delivered Compute Report.
Source classes: API = provider's live pricing API · vendor = provider's published page · mkt API = marketplace API · 3rd-party = aggregator (provider publishes no price on its own pages) · quote = quote-gated or "starting at", not a walk-up price. Quote-class prices are shown in tables but excluded from headline ranges, spreads, and fair-price bands.
Method notes
Fair-price band = lowest to median price among Grade A/B on-demand listings — capacity whose published specs support training-class work. Marketplace listings (Vast.ai and similar) are pooled with on-demand in headline stats because both are walk-up prices; they carry confidence "mark" and usually cannot state their fabric. History: weekly snapshots begin September 2026; price-over-time charts appear as the series accumulates. Prices exclude storage, egress, and bundled vCPU/RAM differences — check the source link for the all-in picture before renting.
Prices move weekly. Get the report.
Headline prices, deliverability grades, and one teardown a week — free.
Subscribe free