NVIDIA H200 (141GB HBM3e)
- 141GB HBM3e
- Memory
- 4,800GB/s
- Memory bandwidth
- Q4 2024
- Released
Price history
What it costs to rent an NVIDIA H200
The NVIDIA H200 is a Hopper-architecture fine-tuning NVIDIA GPU with 141GB of HBM3e memory and 4,800 GB/s of memory bandwidth, released Q4 2024. It is built for large-model training and high-throughput inference.
Renting one currently costs between $1.47 and $10.67 per GPU-hour across the 19 cloud providers we track, with a median of $4.35. The cheapest live rate is $1.47/hr from Vast.ai (Spot), and hosting one pays about $3.11/hr on RunPod while it is running. All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.
Where to rent the H200
How we rank
The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.
Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.
Scroll horizontally to compare all columns →
| Provider | Tier | Config | Total VRAM | Billing | Availability | Go to provider | ||
|---|---|---|---|---|---|---|---|---|
 Vast.ai | GPU cloud | 7× H200 NVL | 987GB | Spot | $1.47 | $10.27 | Rent | |
 EnvergeBest | Marketplace | 1× H200 | 141GB | On-demand | $2.50 | $2.50 | Rent | |
 Verda | Marketplace | 1× H200 | 141GB | Spot | $2.61 | $2.61 | Rent | |
 Together | Enterprise | 1× H200 | 141GB | On-demand | $2.99 | $2.99 | Rent | |
| Vast.ai | GPU cloud | 1× H200 NVL | 141GB | Spot | $2.52 | $2.52 | Rent | |
 DigitalOcean | Enterprise | 1× H200 | 141GB | On-demand | $3.40 | $3.40 | Rent | |
| Vast.ai | GPU cloud | 2× H200 NVL | 282GB | Spot | $2.52 | $5.04 | Rent | |
 Civo | GPU cloud | 1× H200 | 141GB | On-demand | $3.49 | $3.49 | Rent | |
 Oblivus | Marketplace | 1× H200 SXM | 141GB | Reserved | $2.99 | $2.99 | Rent | |
 Massed Compute | GPU cloud | 1× H200 NVL | 141GB | On-demand | $3.62 | $3.62 | Rent | |
| Vast.ai | GPU cloud | 4× H200 NVL | 564GB | Spot | $2.40 | $9.60 | Rent | |
 RunPod | GPU cloud | 1× H200 SXM | 141GB | Community | $3.59 | $3.59 | Rent | |
 Hyperstack | GPU cloud | 1× H200 SXM | 141GB | On-demand | $3.99 | $3.99 | Rent | |
| Massed Compute | GPU cloud | 2× H200 NVL | 282GB | On-demand | $3.62 | $7.24 | Rent | |
 Cerebrium | GPU cloud | 1× H200 | 141GB | On-demand | $4.20 | $4.20 | Rent | |
 Nebius | Enterprise | 1× H200 | 141GB | On-demand | $4.50 | $4.50 | Rent | |
 Crusoe | Enterprise | 1× H200 | 141GB | On-demand | $4.29 | $4.29 | Rent | |
 Runcrate | Marketplace | from H200 | — | On-demand | $4.24 | — | Rent | |
| Vast.ai | GPU cloud | 8× H200 NVL | 1128GB | Spot | $2.27 | $18.13 | Rent | |
| Oblivus | Marketplace | 1× H200 SXM | 141GB | On-demand | $3.99 | $3.99 | Rent | |
 Lyceum | Marketplace | 1× H200 | 141GB | On-demand | $4.49 | $4.49 | Rent | |
| Civo | GPU cloud | 8× H200 | 1128GB | On-demand | $3.49 | $27.92 | Rent | |
| Massed Compute | GPU cloud | 4× H200 NVL | 564GB | On-demand | $3.62 | $14.48 | Rent | |
| Verda | Marketplace | 2× H200 | 282GB | Spot | $2.61 | $5.23 | Rent | |
| Vast.ai | GPU cloud | 3× H200 NVL | 423GB | Spot | $2.67 | $8.00 | Rent | |
| RunPod | GPU cloud | 1× H200 SXM | 141GB | On-demand | $5.29 | $5.29 | Rent | |
| Massed Compute | GPU cloud | 4× H200 NVL | 564GB | On-demand | $3.82 | $15.28 | Rent | |
| Nebius | Enterprise | 1× H200 | 141GB | Reserved | $4.50 | $4.50 | Rent | |
| Verda | Marketplace | 4× H200 | 564GB | Spot | $2.61 | $10.45 | Rent | |
 Fal.ai | GPU cloud | 1× H200 | 141GB | On-demand | $6.00 | $6.00 | Rent | |
 AWS | Hyperscaler | 8× H200 | 1128GB | Spot | $4.81 | $38.51 | Rent | |
| Nebius | Enterprise | 1× H200 | 141GB | On-demand | $5.40 | $5.40 | Rent | |
| Massed Compute | GPU cloud | 8× H200 NVL | 1128GB | On-demand | $3.62 | $28.96 | Rent | |
| Verda | Marketplace | 1× H200 | 141GB | Reserved | $3.92 | $3.92 | Rent | |
| Vast.ai | GPU cloud | 2× H200 | 282GB | Spot | $3.40 | $6.79 | Rent | |
| Verda | Marketplace | 1× H200 | 141GB | On-demand | $5.23 | $5.23 | Rent | |
| AWS | Hyperscaler | 8× H200 | 1128GB | Spot | $5.18 | $41.41 | Rent | |
| Massed Compute | GPU cloud | 8× H200 NVL | 1128GB | On-demand | $3.82 | $30.56 | Rent | |
 CoreWeave | Enterprise | 8× H200 | 1128GB | On-demand | $6.31 | $50.44 | Rent | |
| Vast.ai | GPU cloud | 1× H200 NVL | 141GB | On-demand | $4.14 | $4.14 | Rent | |
| Verda | Marketplace | 8× H200 | 1128GB | Spot | $2.61 | $20.90 | Rent | |
| Vast.ai | GPU cloud | 3× H200 NVL | 423GB | On-demand | $4.00 | $12.00 | Rent | |
 Oracle Cloud | Hyperscaler | 1× H200 | 141GB | On-demand | $10.00 | $10.00 | Rent | |
| Vast.ai | GPU cloud | 2× H200 NVL | 282GB | On-demand | $4.20 | $8.40 | Rent | |
| Verda | Marketplace | 1× H200 | 141GB | Reserved | $4.81 | $4.81 | Rent | |
| Vast.ai | GPU cloud | 2× H200 | 282GB | On-demand | $4.37 | $8.74 | Rent | |
| Verda | Marketplace | 1× H200 | 141GB | Reserved | $5.07 | $5.07 | Rent | |
| AWS | Hyperscaler | 8× H200 | 1128GB | On-demand | $7.91 | $63.30 | Rent | |
| Vast.ai | GPU cloud | 1× H200 | 141GB | Spot | $4.08 | $4.08 | Rent | |
| Verda | Marketplace | 1× H200 | 141GB | Reserved | $5.12 | $5.12 | Rent | |
| Verda | Marketplace | 1× H200 | 141GB | Reserved | $5.02 | $5.02 | Rent | |
| Vast.ai | GPU cloud | 1× H200 | 141GB | On-demand | $4.61 | $4.61 | Rent | |
| Vast.ai | GPU cloud | 6× H200 | 846GB | On-demand | $4.00 | $24.00 | Rent | |
| Vast.ai | GPU cloud | 4× H200 NVL | 564GB | On-demand | $4.40 | $17.60 | Rent | |
| Vast.ai | GPU cloud | 4× H200 | 564GB | Spot | $3.95 | $15.79 | Rent | |
| Verda | Marketplace | 2× H200 | 282GB | Reserved | $3.92 | $7.84 | Rent | |
| Vast.ai | GPU cloud | 7× H200 NVL | 987GB | On-demand | $4.08 | $28.56 | Rent | |
| Verda | Marketplace | 2× H200 | 282GB | On-demand | $5.23 | $10.45 | Rent | |
| Vast.ai | GPU cloud | 4× H200 | 564GB | On-demand | $4.61 | $18.42 | Rent | |
| Verda | Marketplace | 4× H200 | 564GB | Reserved | $3.92 | $15.67 | Rent | |
| Verda | Marketplace | 4× H200 | 564GB | On-demand | $5.23 | $20.90 | Rent | |
| Vast.ai | GPU cloud | 8× H200 | 1128GB | Spot | $4.08 | $32.63 | Rent | |
| Vast.ai | GPU cloud | 8× H200 | 1128GB | On-demand | $4.61 | $36.84 | Rent | |
| Verda | Marketplace | 2× H200 | 282GB | Reserved | $4.81 | $9.61 | Rent | |
| Verda | Marketplace | 2× H200 | 282GB | Reserved | $5.07 | $10.14 | Rent | |
| Verda | Marketplace | 2× H200 | 282GB | Reserved | $5.12 | $10.24 | Rent | |
| Vast.ai | GPU cloud | 6× H200 NVL | 846GB | Spot | $5.33 | $32.00 | Rent | |
| Verda | Marketplace | 2× H200 | 282GB | Reserved | $5.02 | $10.03 | Rent | |
| Verda | Marketplace | 8× H200 | 1128GB | Reserved | $3.92 | $31.36 | Rent | |
| Vast.ai | GPU cloud | 10× H200 NVL | 1410GB | Spot | $5.33 | $53.33 | Rent | |
| Verda | Marketplace | 8× H200 | 1128GB | On-demand | $5.23 | $41.81 | Rent | |
| Verda | Marketplace | 4× H200 | 564GB | Reserved | $4.81 | $19.23 | Rent | |
| Verda | Marketplace | 4× H200 | 564GB | Reserved | $5.07 | $20.27 | Rent | |
| Vast.ai | GPU cloud | 8× H200 NVL | 1128GB | On-demand | $8.00 | $64.01 | Rent | |
| Verda | Marketplace | 4× H200 | 564GB | Reserved | $5.12 | $20.48 | Rent | |
| Verda | Marketplace | 4× H200 | 564GB | Reserved | $5.02 | $20.06 | Rent | |
| Vast.ai | GPU cloud | 6× H200 NVL | 846GB | On-demand | $10.40 | $62.40 | Rent | |
| Verda | Marketplace | 8× H200 | 1128GB | Reserved | $4.81 | $38.47 | Rent | |
| Verda | Marketplace | 8× H200 | 1128GB | Reserved | $5.07 | $40.56 | Rent | |
| Verda | Marketplace | 8× H200 | 1128GB | Reserved | $5.12 | $40.97 | Rent | |
| Vast.ai | GPU cloud | 10× H200 NVL | 1410GB | On-demand | $10.67 | $106.67 | Rent | |
| Verda | Marketplace | 8× H200 | 1128GB | Reserved | $5.02 | $40.14 | Rent |
Earn by hosting the H200
How this is worked out
“Renters pay” is the median live rate for this GPU on that marketplace — the median, not the floor, because the cheapest listing is one host undercutting everyone. “You earn” is that figure less the platform’s cut.
“Per day” is a ceiling: 24 hours, every hour rented, which no host achieves — scale it by the utilisation you expect. A card sitting idle earns nothing.Fees marked as published come from the platform’s terms; the rest are our estimates, labelled on each row.
Technical specifications
| FP64 | 34 TFLOPS |
|---|---|
| FP32 | 67 TFLOPS |
| TF32 | 495 TFLOPS |
| FP16/BF16 | 990 TFLOPS |
| FP8 | 1,979 TFLOPS |
- Memory
- 141 GB
- Memory bandwidth
- 4,800 GB/s
- TDP
- 700 W
- INT8
- 1,979 TOPS
- Process
- 5 nm
- Foundry
- TSMC
- Released
- 18 Nov 2024
- Launch price
- $30,000
| Architecture | Hopper |
|---|---|
| Memory | 141 GB HBM3e |
| Bandwidth | 4.8 TB/s |
| FP8 Tensor | 3,958 TFLOPS (sparse) |
| NVLink | 900 GB/s |
| MIG | up to 7 instances |
| Power | up to 700 W (SXM) |
- Class
- Fine-tuning
- Cloud providers
- 19 tracked
- Price range
- $1.47 – $10.67 / GPU / hr
Other fine-tuning cards
The Compute
NVIDIA A100
AMD MI300XSNAPSHOT 2026-10-12T05:40:41.151564+00:00 · BACK TO THE FULL INDEX