POWERING THE NEXT AGE OF INTELLIGENCE-RTX PRO 6000 BLACKWELL 96GB

NVIDIA H200 (141GB HBM3e)

141GB HBM3e
Memory
4,800GB/s
Memory bandwidth
Q4 2024
Released

Price history

On-demandReservedSpot
USD / GPU / HR

What it costs to rent a NVIDIA H200

The NVIDIA H200 is a Hopper-architecture fine-tuning NVIDIA GPU with 141GB of HBM3e memory and 4,800 GB/s of memory bandwidth, released Q4 2024. It is built for large-model training and high-throughput inference.

Renting one currently costs between $1.33 and $10.00 per GPU-hour across the 21 cloud providers we track, with a median of $4.29. The cheapest live rate is $1.33/hr from Vast.ai (Spot), and hosting one pays about $3.56/hr on Akash while it is running. All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.

Where to rent the H200

How we rank

The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.

Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.

ProviderTierConfigTotal VRAMBilling$ / GPU / hrTotal / hrAvailabilityGo to provider
Vast.aiGPU cloud1× H200 NVL141GBSpot$1.47$1.47In stockRent
Vast.aiGPU cloud4× H200 NVL564GBSpot$1.47$5.87In stockRent
Vast.aiGPU cloud8× H200 NVL1128GBSpot$1.33$10.67In stockRent
VerdaMarketplace1× H200141GBSpot$2.00$2.00In stockRent
VerdaMarketplace2× H200282GBSpot$2.00$4.00In stockRent
Vast.aiGPU cloud7× H200 NVL987GBSpot$1.47$10.27In stockRent
NebiusEnterprise1× H200141GBReserved$2.45$2.45UnknownRent
VerdaMarketplace4× H200564GBSpot$2.00$8.00In stockRent

Earn by hosting the H200

How this is worked out

“Renters pay” is the median live rate for this GPU on that marketplace — the median, not the floor, because the cheapest listing is one host undercutting everyone. “You earn” is that figure less the platform’s cut.

“Per day” is a ceiling: 24 hours, every hour rented, which no host achieves — scale it by the utilisation you expect. A card sitting idle earns nothing.Fees marked as published come from the platform’s terms; the rest are our estimates, labelled on each row.

PlatformRenters payFeeYou earnPer dayAvailabilityGo to platform
Akash$4.45/hr120%ⓘ$3.56/hr$85/dayUnknownHost
RunPod$4.59/hr430%ⓘ$3.21/hr$77/dayUnknownHost
Vast.ai$3.54/hr2025%ⓘ$2.66/hr$64/dayUnknownHost

Technical specifications

Throughput
FP6434 TFLOPS
FP3267 TFLOPS
TF32495 TFLOPS
FP16/BF16990 TFLOPS
FP81,979 TFLOPS
Silicon & memory
Memory
141 GB
Memory bandwidth
4,800 GB/s
TDP
700 W
INT8
1,979 TOPS
Process
5 nm
Foundry
TSMC
Released
18 Nov 2024
Launch price
$30,000
TrainingInference
Datasheet
ArchitectureHopper
Memory141 GB HBM3e
Bandwidth4.8 TB/s
FP8 Tensor3,958 TFLOPS (sparse)
NVLink900 GB/s
MIGup to 7 instances
Powerup to 700 W (SXM)
Class
Fine-tuning
Cloud providers
21 tracked
Price range
$1.33 – $10.00 / GPU / hr

Other fine-tuning cards

NVIDIA A10080GB · 28 PROVIDERS$0.40/hrIntel Gaudi 296GB · 2 PROVIDERS$1.21/hrNVIDIA GH20096GB · 2 PROVIDERS$1.99/hrNVIDIA H10080GB · 37 PROVIDERS$1.00/hr

SNAPSHOT 2026-08-23T22:42:15.889486+00:00 · BACK TO THE FULL INDEX