POWERING THE NEXT AGE OF INTELLIGENCE-RTX PRO 6000 BLACKWELL 96GB

AMD MI300X (192GB HBM3)

192GB HBM3
Memory
5,300GB/s
Memory bandwidth
Q4 2023
Released

Price history

On-demandReservedSpot
USD / GPU / HR

What it costs to rent a AMD MI300X

The AMD MI300X is a CDNA 3-architecture fine-tuning AMD GPU with 192GB of HBM3 memory and 5,300 GB/s of memory bandwidth, released Q4 2023. It is built for large-model training and high-throughput inference.

Renting one currently costs between $1.71 and $6.00 per GPU-hour across the 5 cloud providers we track, with a median of $3.72. The cheapest live rate is $1.71/hr from TensorWave (Reserved). All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.

Where to rent the MI300X

How we rank

The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.

Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.

ProviderTierConfigTotal VRAMBilling$ / GPU / hrTotal / hrAvailabilityGo to provider
DigitalOceanEnterprise1× MI300X192GBOn-demand$1.91$1.91UnknownRent
TensorWaveGPU cloud8× MI300X1536GBReserved$1.71$13.68UnknownRent
CrusoeEnterprise1× MI300X192GBOn-demand$3.45$3.45UnknownRent
VultrEnterprise8× MI300X1536GBOn-demand$3.99$31.92UnknownRent
Oracle CloudHyperscaler1× MI300X192GBOn-demand$6.00$6.00UnknownRent

Technical specifications

Throughput
FP6482 TFLOPS
FP32163 TFLOPS
TF32654 TFLOPS
FP16/BF161,307 TFLOPS
Silicon & memory
Memory
192 GB
Memory bandwidth
5,300 GB/s
TDP
750 W
INT8
2,615 TOPS
Process
5 nm
Die size
1,017 mm²
Foundry
TSMC
Released
6 Dec 2023
Launch price
$15,000
InferenceTraining
Datasheet
ArchitectureCDNA 3
Memory192 GB HBM3
Bandwidth5.3 TB/s
FP82.6 PFLOPS (sparse)
InterconnectInfinity Fabric
Power750 W (OAM)
Class
Fine-tuning
Cloud providers
5 tracked
Price range
$1.71 – $6.00 / GPU / hr

SNAPSHOT 2026-08-23T22:42:15.889486+00:00 · BACK TO THE FULL INDEX