POWERING THE NEXT AGE OF INTELLIGENCE-RTX PRO 6000 BLACKWELL 96GB

AMD MI325X (256GB HBM3e)

256GB HBM3e
Memory
6,000GB/s
Memory bandwidth
Q4 2024
Released

Price history

On-demandReservedSpot
USD / GPU / HR

What it costs to rent a AMD MI325X

The AMD MI325X is a CDNA 3-architecture training AMD GPU with 256GB of HBM3e memory and 6,000 GB/s of memory bandwidth, released Q4 2024. It is built for training frontier-scale models and high-throughput production inference.

Renting one currently costs between $2.25 and $2.88 per GPU-hour across the 2 cloud providers we track. The cheapest live rate is $2.25/hr from TensorWave (Reserved). All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.

Where to rent the MI325X

How we rank

The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.

Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.

ProviderTierConfigTotal VRAMBilling$ / GPU / hrTotal / hrAvailabilityGo to provider
DigitalOceanEnterprise1× MI325X256GBOn-demand$2.88$2.88UnknownRent
TensorWaveGPU cloud8× MI325X2048GBReserved$2.25$18.00UnknownRent

Technical specifications

Throughput
FP6482 TFLOPS
FP32163 TFLOPS
TF32654 TFLOPS
FP16/BF161,307 TFLOPS
Silicon & memory
Memory
256 GB
Memory bandwidth
6,000 GB/s
TDP
1,000 W
INT8
2,600 TOPS
Process
5 nm
Transistors
153.0 B
Foundry
TSMC
Released
10 Oct 2024
InferenceTraining
Datasheet
ArchitectureCDNA 3
Memory256 GB HBM3e
Bandwidth6 TB/s
FP82.6 PFLOPS (sparse)
FP161.3 PFLOPS
InterconnectInfinity Fabric
Powerup to 1,000 W (OAM)
Class
Training
Cloud providers
2 tracked
Price range
$2.25 – $2.88 / GPU / hr

SNAPSHOT 2026-08-23T22:42:15.889486+00:00 · BACK TO THE FULL INDEX