NVIDIA GH200 (96GB HBM3)
- 96GB HBM3
- Memory
- 4,900GB/s
- Memory bandwidth
- Q2 2024
- Released
Price history
What it costs to rent a NVIDIA GH200
The NVIDIA GH200 is a Hopper-architecture fine-tuning NVIDIA GPU with 96GB of HBM3 memory and 4,900 GB/s of memory bandwidth, released Q2 2024. It is built for large-model training and high-throughput inference.
Renting one currently costs between $1.99 and $6.50 per GPU-hour across the 2 cloud providers we track, with a median of $4.25. The cheapest live rate is $1.99/hr from Vultr (On-demand). All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.
Where to rent the GH200
How we rank
The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.
Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.
Technical specifications
| FP64 | 34 TFLOPS |
|---|---|
| FP32 | 67 TFLOPS |
| TF32 | 495 TFLOPS |
| FP16/BF16 | 990 TFLOPS |
- Memory
- 96 GB
- Memory bandwidth
- 4,900 GB/s
- TDP
- 1,000 W
- INT8
- 1,979 TOPS
- Process
- 5 nm
- Foundry
- TSMC
- Released
- 8 Aug 2023
| Superchip | Grace CPU + Hopper GPU |
|---|---|
| GPU memory | 96 GB HBM3 or 144 GB HBM3e |
| CPU memory | up to 480 GB LPDDR5X |
| Link | 900 GB/s NVLink-C2C |
| Use | AI training, inference and HPC |
| Power | platform dependent |
- Class
- Fine-tuning
- Cloud providers
- 2 tracked
- Price range
- $1.99 – $6.50 / GPU / hr
Other fine-tuning cards
NVIDIA A100
Intel Gaudi 2SNAPSHOT 2026-08-23T21:42:41.424627+00:00 · BACK TO THE FULL INDEX