NVIDIA GH200 (96GB HBM3)
- 96GB HBM3
- Memory
- 4,900GB/s
- Memory bandwidth
- Q2 2024
- Released
Price history
PLACEHOLDERWhat it costs to rent a NVIDIA GH200
The NVIDIA GH200 is a Hopper-architecture high performance NVIDIA GPU with 96GB of HBM3 memory and 4,900 GB/s of memory bandwidth, released Q2 2024. It is built for large-model training and high-throughput inference.
Renting one currently costs between $1.99 and $6.50 per GPU-hour across the 2 cloud providers we track. The cheapest live rate is $1.99/hr from Vultr (on-demand). All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.
Where to rent the GH200
2 offers · 2 providers| Provider | Tier | Config | Total VRAM | Billing | $ / GPU / hr | Total / hr | Availability |
|---|---|---|---|---|---|---|---|
CoreWeave
|
Enterprise | 1× GH200 | 96GB | On-demand | $6.50 | $6.50 | — |
Vultr
|
Enterprise | 1× GH200 | 96GB | On-demand | $1.99 BEST | $1.99 | — |
The five most established providers first, then the rest. Each row is a provider’s cheapest current offer, normalised to a single GPU per hour. Tier reflects company type, not a quality score. We do not collect vCPU or RAM per instance yet, so those columns are omitted rather than estimated.
Technical specifications
| FP64 | 34 TFLOPS |
|---|---|
| FP32 | 67 TFLOPS |
| TF32 | 495 TFLOPS |
| FP16/BF16 | 990 TFLOPS |
| FP8 | 1,979 TFLOPS |
- Memory
- 141 GB
- Memory bandwidth
- 4,800 GB/s
- TDP
- 700 W
- INT8
- 1,979 TOPS
- Process
- 5 nm
- Foundry
- TSMC
- Released
- 18 Nov 2024
- Launch price
- $30,000
| Architecture | Hopper |
|---|---|
| Memory | 141 GB HBM3e |
| Bandwidth | 4.8 TB/s |
| FP8 Tensor | 3,958 TFLOPS (sparse) |
| NVLink | 900 GB/s |
| MIG | up to 7 instances |
| Power | up to 700 W (SXM) |
- Class
- High performance
- Cloud providers
- 2 tracked
- Price range
- $1.99 – $6.50 / GPU / hr
Other high performance cards
NVIDIA H100
SNAPSHOT 2026-07-29 19:42:49 UTC · BACK TO THE FULL INDEX