ComputeAssay
Prices on this page are from the 2026-09-10 survey. The registry was re-surveyed on 2026-11-03 (6 prices changed, 1 delisted, 50 confirmed) — current rows in the open data, what moved in the 2026-11-03 report.

Model guide · prices from 2026-09-10 · API prices daily, full survey weekly

Cheapest way to run Phi-4 (14B)

Phi-4 (14B) needs ≈8 GB of VRAM at 4-bit — this week that starts at $0.37/hour (1× RTX4090, cheapest tracked walk-up price). FP8 and FP16 below. VRAM calculators stop at the memory number; this connects it to live, graded prices across 20 providers.

FP16 — ≈34 GB needed

GPUVRAMGPUs neededCheapest trackedVerifiable A/B
RTX409024 GB2$0.75/hr—
RTX509032 GB2$0.80/hr—
A100-SXM80 GB1$0.91/hr$2.30/hr
A100-PCIe80 GB1$1.35/hr—
L40S48 GB1$1.37/hr—
L424 GB2$1.74/hr—
H100-PCIe80 GB1$1.99/hr—
A10080 GB1$2.70/hr—

FP8/INT8 — ≈17 GB needed

GPUVRAMGPUs neededCheapest trackedVerifiable A/B
RTX409024 GB1$0.37/hr—
RTX509032 GB1$0.40/hr—
L424 GB1$0.87/hr—
A100-SXM80 GB1$0.91/hr$2.30/hr
A100-PCIe80 GB1$1.35/hr—
L40S48 GB1$1.37/hr—
H100-PCIe80 GB1$1.99/hr—
A10080 GB1$2.70/hr—

4-bit — ≈8 GB needed

GPUVRAMGPUs neededCheapest trackedVerifiable A/B
RTX409024 GB1$0.37/hr—
RTX509032 GB1$0.40/hr—
L424 GB1$0.87/hr—
A100-SXM80 GB1$0.91/hr$2.30/hr
A100-PCIe80 GB1$1.35/hr—
L40S48 GB1$1.37/hr—
H100-PCIe80 GB1$1.99/hr—
A10080 GB1$2.70/hr—

Method: VRAM ≈ parameters × bytes/parameter × 1.2 (20% headroom for KV cache and activations at ~8K context). Longer context or high concurrency needs more; training needs far more (optimizer states: ~4–8× weights). GPU counts assume even sharding. Above one 8-GPU node, the interconnect becomes the constraint — restrict to Grade A/B listings. Grades measure what sellers publish — deliverability of the written claim, not measured performance. No fleet holds a measured (Verified) badge yet; that tier arrives with the verification harness. Prices are this week's cheapest tracked walk-up listings (teaser prices excluded); every listing with grades and sources on the GPU pages. Interactive version for any model size: Model Fit.

These prices move weekly

The Delivered Compute Report tracks them — free, every row sourced.

Subscribe free