Intel Gaudi 2 (96GB HBM2e)
- 96GB HBM2e
- Memory
- 2,450GB/s
- Memory bandwidth
- Q2 2022
- Released
Price history
What it costs to rent a Intel Gaudi 2
The Intel Gaudi 2 is a Gaudi-architecture fine-tuning Intel GPU with 96GB of HBM2e memory and 2,450 GB/s of memory bandwidth, released Q2 2022. It is built for large-model training and high-throughput inference.
Renting one currently costs between $1.21 and $1.21 per GPU-hour across the 2 cloud providers we track. The cheapest live rate is $1.21/hr from Runcrate (On-demand). All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.
Where to rent the Gaudi 2
How we rank
The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.
Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.
Technical specifications
| FP16/BF16 | 450 TFLOPS |
|---|---|
| FP8 | 865 TFLOPS |
- Memory
- 96 GB
- Memory bandwidth
- 2,450 GB/s
- TDP
- 600 W
- Process
- 7 nm
- Die size
- 826 mm²
- Foundry
- TSMC
- Released
- 10 May 2022
| Architecture | Gaudi |
|---|---|
| Memory | 96 GB HBM2e |
| Bandwidth | 2.45 TB/s |
| Networking | 24x 100 GbE on package |
| Form factor | OAM |
| Power | up to 600 W |
- Class
- Fine-tuning
- Cloud providers
- 2 tracked
- Price range
- $1.21 – $1.21 / GPU / hr
Other fine-tuning cards
NVIDIA A100SNAPSHOT 2026-08-23T21:42:41.424627+00:00 · BACK TO THE FULL INDEX