NVIDIA GB200 (186GB HBM3e)
- 186GB HBM3e
- Memory
- 8,000GB/s
- Memory bandwidth
- Q4 2024
- Released
Price history
What it costs to rent an NVIDIA GB200
The NVIDIA GB200 is a Blackwell-architecture training NVIDIA GPU with 186GB of HBM3e memory and 8,000 GB/s of memory bandwidth, released Q4 2024. It is built for training frontier-scale models and high-throughput production inference.
Renting one currently costs between $4.99 and $16.00 per GPU-hour across the 3 cloud providers we track, with a median of $9.99. The cheapest live rate is $4.99/hr from Together (On-demand). All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.
Where to rent the GB200
How we rank
The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.
Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.
Scroll horizontally to compare all columns →
Technical specifications
| FP64 | 45 TFLOPS |
|---|---|
| FP32 | 90 TFLOPS |
| TF32 | 1,250 TFLOPS |
| FP16/BF16 | 2,500 TFLOPS |
| FP8 | 5,000 TFLOPS |
| FP4 | 10,000 TFLOPS |
- Memory
- 13,824 GB
- Memory bandwidth
- 8,000 GB/s
- TDP
- 120,000 W
- INT8
- 5,000 TOPS
- Foundry
- TSMC
- Released
- 15 Feb 2025
| GPUs | 72x NVIDIA B200 (Blackwell) |
|---|---|
| CPUs | 36x NVIDIA Grace |
| FP4 compute | 1.44 EFLOPS (sparse) |
| HBM3e | about 13.5 TB |
| NVLink domain | 130 TB/s |
| Cooling | liquid, full rack |
| Deployment | 120 kW class per rack |
- Class
- Training
- Cloud providers
- 3 tracked
- Price range
- $4.99 – $16.00 / GPU / hr
Other training cards
The Compute
NVIDIA B200
AMD MI325XSNAPSHOT 2026-10-12T05:40:41.151564+00:00 · BACK TO THE FULL INDEX