Best GPU clouds for fine-tuning LLMs (2026)
Fine-tuning sits between training and inference: short bursts of GPU work interleaved with eval, dataset shuffling, and human review. Billing granularity (per-second vs per-hour), persistent storage, and dataset egress hit harder than the headline $/hr. Three picks across the axes.
The cost pick, pricing and availability refresh hourly. Our performance and operations picks are curated.
Hyperstack · 1× A100-80GB
LoRA / QLoRA on a 70B model fits a single A100 80GB. Region-aware availability across 3 DCs (CANADA-1, NORWAY-1, US-1), 100% data coverage in our 30-day window. Free egress.
Lambda · 4× H100
Per-minute billing, persistent filesystems on 1-Click Clusters, snapshot workflow that doesn't require a manual EBS dance. You can stop a 4×H100 box overnight without losing your dataset cache.
Cheapest in-stock 1× H100 with per-second billing
Vast · South Africa, ZA
$2.44/hr on demand · 1× H100
Limited stock when checked
How we choose
For short fine-tuning runs, we require a provider with documented per-second billing. The rate covers compute. Storage and data transfer are separate. We compare self-serve on-demand listings for 1× H100 with per-second billing. Each listing needs a stock report of available or limited within the past 6 hours. The lowest hourly price wins. Ties are ordered by provider, then region.
Compare H100 listings →Avoid: Vast (RTX 4090)
Consumer cards (24 GB VRAM) for anything past 7B QLoRA force aggressive memory offload that 5×'s wall-clock time vs an A100 80GB at 2× the hourly rate. Net loss on TCO every time.
The caveat we wish more pages mentioned
Dataset egress is the silent killer. If your dataset lives in S3 and you fine-tune on Lambda, AWS charges egress every time you re-pull. A 2 TB dataset = $180 one-time exit fee at $0.09/GB. Co-locate compute with storage, OR park your dataset in Cloudflare R2 ($0 egress) as a hub.
Data we don't yet show — and how it might change the call
- Snapshot/checkpoint create + restore time for a 70B image — nobody publishes this
- Persistent storage $/GB-mo per provider
Honesty about gaps beats false confidence. We add data as it becomes structurally available.