POWERING THE NEXT AGE OF INTELLIGENCE-RTX PRO 6000 BLACKWELL 96GB

AMD Instinct MI300X Accelerator 192GB

AMD Instinct MI300X Accelerator 192GB is a curated accelerator for local inference, fine-tuning, visualization, or production AI compute. Its key configuration includes Instinct MI300X and 192GB HBM3.

Request a quote Engineer replies, not a bot.
REPLY WITHIN 24H AUTHORIZED SOURCING ENGINEER SUPPORT
BULK ORDER OR CUSTOM BUILD?TALK TO AN ENGINEER
DATASHEET

Technical
specifications

ACCELERATOR
ArchitectureAMD CDNA 3
Compute units304
Stream processors19,456
Form factorOAM accelerator module
MEMORY
Capacity192 GB HBM3
Memory bandwidthup to 5.3 TB/s
Memory stackseight HBM3 stacks
PERFORMANCE
Workload precisionFP64 through FP8 and INT8
Matrix accelerationAMD Matrix Cores
INTERCONNECT
Scale-up fabricAMD Infinity Fabric
Host platformvalidated eight-GPU platforms
POWER
Module powerup to 750 W
Workload classlarge-model training and inference
Throughput
FP6482 TFLOPS
FP32163 TFLOPS
TF32654 TFLOPS
FP16/BF161,307 TFLOPS
Silicon & memory
Memory
192 GB
Memory bandwidth
5,300 GB/s
TDP
750 W
INT8
2,615 TOPS
Process
5 nm
Die size
1,017 mm²
Foundry
TSMC
Released
6 Dec 2023
Launch price
$15,000
InferenceTraining

Every order, covered.

[ 01 ]Sealed & genuineFactory-sealed, authorized stock. Warranty valid.
[ 02 ]Insured, tracked dispatchLead time is confirmed on your order, not guessed at.
[ 03 ]Real engineer supportTalk to people who run this hardware.
[ 04 ]Returns without drama30 days. DOA? Replacement ships first.

Pairs well with

QUOTEPBA-0501
NVIDIA GeForce RTX 5090
GPUNVIDIA GeForce RTX 509032GB GDDR721,760 CUDA575WPrice on requestQUOTE
QUOTEPBA-0506
NVIDIA RTX PRO 6000 Blackwell 96GB
GPUNVIDIA RTX PRO 6000 Blackwell 96GB96GB GDDR7 ECC600W / 300W editionsPCIe 5.0Price on requestQUOTE
QUOTEPBA-0511
NVIDIA H100 80GB PCIe
GPUNVIDIA H100 80GB PCIe80GB HBM2e2 TB/sPCIe Gen5Price on requestQUOTE
QUOTEPBA-0512
NVIDIA H200 NVL 141GB
GPUNVIDIA H200 NVL 141GB141GB HBM3e4.8 TB/sNVLink bridgePrice on requestQUOTE