NVIDIA A100 (80GB HBM2e)
- 80GB HBM2e
- Memory
- 2,039GB/s
- Memory bandwidth
- Q4 2020
- Released
Price history
What it costs to rent a NVIDIA A100
The NVIDIA A100 is an Ampere-architecture fine-tuning NVIDIA GPU with 80GB of HBM2e memory and 2,039 GB/s of memory bandwidth, released Q4 2020. It is built for large-model training and high-throughput inference.
Renting one currently costs between $0.40 and $5.04 per GPU-hour across the 28 cloud providers we track, with a median of $1.83. The cheapest live rate is $0.40/hr from Vast.ai (On-demand), and hosting one pays about $1.46/hr on Akash while it is running. All rates below are normalised to a single GPU per hour so providers with multi-GPU nodes compare like-for-like.
Where to rent the A100
How we rank
The median is one provider, one vote: each provider contributes the median of its own on-demand listings, then the headline is the median across providers — so no single marketplace or hyperscaler sets the price alone. Below two providers we show the range instead.
Default order is relevance, weighed the way a buyer would: price per GPU first, lightly blended with total node cost; on-demand preferred over spot and reserved when prices are close; established clouds edged above marketplaces; in-stock, recently-checked offers above stale ones; and no single provider is allowed to crowd the top. Click a column to sort by the raw numbers. No paid placements — ranking is never sold.
| Provider | Tier | Config | Total VRAM | Billing | $ / GPU / hr | Total / hr | Availability | Go to provider |
|---|---|---|---|---|---|---|---|---|
 Vast.ai | GPU cloud | 6× A100 PCIE | 480GB | On-demand | $0.40 | $2.40 | In stock | Rent |
 Google Cloud | Hyperscaler | 1× A100 | 80GB | Spot | $0.54 | $0.54 | Unknown | Rent |
 Nosana | GPU cloud | 1× A100 | 80GB | Community | $0.61 | $0.61 | Unknown | Rent |
 Azure | Hyperscaler | 1× A100 | 80GB | Spot | $0.68 | $0.68 | Unknown | Rent |
| Azure | Hyperscaler | 2× A100 | 160GB | Spot | $0.68 | $1.36 | Unknown | Rent |
| Vast.ai | GPU cloud | 2× A100 SXM | 160GB | On-demand | $0.80 | $1.60 | In stock | Rent |
| Nosana | GPU cloud | 1× A100 | 80GB | On-demand | $0.82 | $0.82 | Unknown | Rent |
| Vast.ai | GPU cloud | 1× A100 PCIE | 80GB | On-demand | $0.83 | $0.83 | In stock | Rent |
| Azure | Hyperscaler | 4× A100 | 320GB | Spot | $0.68 | $2.72 | Unknown | Rent |
 Verda | Marketplace | 1× A100 | 80GB | Spot | $0.90 | $0.90 | In stock | Rent |
| Vast.ai | GPU cloud | 1× A100 SXM | 80GB | On-demand | $0.83 | $0.83 | In stock | Rent |
 GPU.ai | Marketplace | 1× A100 | 80GB | Community | $0.96 | $0.96 | In stock | Rent |
 Oblivus | Marketplace | 1× A100 PCIE | 80GB | Reserved | $0.95 | $0.95 | In stock | Rent |
 Civo | GPU cloud | 1× A100 | 80GB | On-demand | $1.09 | $1.09 | Unknown | Rent |
 Thunder Compute | Marketplace | 1× A100 | 80GB | On-demand | $1.09 | $1.09 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Spot | $0.65 | $0.65 | Out of stock | Rent |
 Massed Compute | GPU cloud | 1× A100 | 80GB | On-demand | $1.23 | $1.23 | In stock | Rent |
| Vast.ai | GPU cloud | 2× A100 PCIE | 160GB | On-demand | $0.83 | $1.65 | In stock | Rent |
| Azure | Hyperscaler | 8× A100 | 640GB | Spot | $0.68 | $5.44 | Unknown | Rent |
 Hyperstack | GPU cloud | 1× A100 PCIE | 80GB | Spot | $1.08 | $1.08 | Unknown | Rent |
| Oblivus | Marketplace | 2× A100 PCIE | 160GB | Reserved | $0.95 | $1.90 | In stock | Rent |
| Civo | GPU cloud | 2× A100 | 160GB | On-demand | $1.09 | $2.18 | Unknown | Rent |
| Thunder Compute | Marketplace | 2× A100 | 160GB | On-demand | $1.09 | $2.18 | Unknown | Rent |
 RunPod | GPU cloud | 1× A100 PCIE | 80GB | Community | $1.19 | $1.19 | In stock | Rent |
 Paperspace | Enterprise | 1× A100 | 80GB | Reserved | $1.15 | $1.15 | Unknown | Rent |
| GPU.ai | Marketplace | 1× A100 | 80GB | On-demand | $1.25 | $1.25 | In stock | Rent |
 Sesterce | GPU cloud | 1× A100 | 80GB | On-demand | $1.49 | $1.49 | In stock | Rent |
| Oblivus | Marketplace | 4× A100 PCIE | 320GB | Reserved | $0.95 | $3.80 | In stock | Rent |
 CUDO | GPU cloud | 1× A100 PCIE | 80GB | On-demand | $1.50 | $1.50 | In stock | Rent |
| Civo | GPU cloud | 4× A100 | 320GB | On-demand | $1.09 | $4.36 | Unknown | Rent |
| RunPod | GPU cloud | 2× A100 PCIE | 160GB | Community | $1.19 | $2.38 | In stock | Rent |
| Vast.ai | GPU cloud | 8× A100 SXM | 640GB | Spot | $0.70 | $5.57 | In stock | Rent |
| Hyperstack | GPU cloud | 1× A100 PCIE | 80GB | On-demand | $1.35 | $1.35 | Unknown | Rent |
| Massed Compute | GPU cloud | 1× A100 | 80GB | On-demand | $1.35 | $1.35 | Unknown | Rent |
 Runcrate | Marketplace | from A100 | — | On-demand | $1.49 | — | Unknown | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Spot | $0.65 | $5.16 | Out of stock | Rent |
 AWS | Hyperscaler | 8× A100 | 640GB | Spot | $1.19 | $9.48 | Unknown | Rent |
| Azure | Hyperscaler | 8× A100 | 640GB | Spot | $0.82 | $6.55 | Unknown | Rent |
 Koyeb | GPU cloud | 1× A100 | 80GB | On-demand | $1.60 | $1.60 | Unknown | Rent |
| Sesterce | GPU cloud | 2× A100 | 160GB | On-demand | $1.49 | $2.97 | In stock | Rent |
 Lyceum | Marketplace | 1× A100 | 80GB | On-demand | $1.59 | $1.59 | Unknown | Rent |
| Massed Compute | GPU cloud | 1× A100 SXM | 80GB | On-demand | $1.38 | $1.38 | Unknown | Rent |
| Hyperstack | GPU cloud | 1× A100 PCIE | 80GB | On-demand | $1.40 | $1.40 | Unknown | Rent |
| Vast.ai | GPU cloud | 8× A100 PCIE | 640GB | On-demand | $0.82 | $6.54 | In stock | Rent |
 Akash | GPU cloud | 1× A100 SXM | 80GB | On-demand | $1.83 | $1.83 | In stock | Rent |
| Oblivus | Marketplace | 8× A100 PCIE | 640GB | Reserved | $0.95 | $7.60 | In stock | Rent |
| Sesterce | GPU cloud | 1× A100 | 80GB | On-demand | $1.54 | $1.54 | In stock | Rent |
| Civo | GPU cloud | 8× A100 | 640GB | On-demand | $1.09 | $8.72 | Unknown | Rent |
| Koyeb | GPU cloud | 2× A100 | 160GB | On-demand | $1.60 | $3.20 | Unknown | Rent |
| RunPod | GPU cloud | 1× A100 SXM | 80GB | On-demand | $1.59 | $1.59 | In stock | Rent |
| Massed Compute | GPU cloud | 1× A100 | 80GB | On-demand | $1.38 | $1.38 | Unknown | Rent |
| LLeafcloud | GPU cloud | 1× A100 | 80GB | On-demand | $1.88 | $1.88 | Unknown | Rent |
| Hyperstack | GPU cloud | 1× A100 SXM | 80GB | Spot | $1.28 | $1.28 | Unknown | Rent |
 Crusoe | Enterprise | 1× A100 PCIE | 80GB | On-demand | $2.00 | $2.00 | Unknown | Rent |
| Verda | Marketplace | 2× A100 | 160GB | Spot | $0.90 | $1.79 | Out of stock | Rent |
| Thunder Compute | Marketplace | 4× A100 | 320GB | On-demand | $1.49 | $5.96 | Unknown | Rent |
| Massed Compute | GPU cloud | 2× A100 | 160GB | On-demand | $1.35 | $2.70 | Unknown | Rent |
| Sesterce | GPU cloud | 4× A100 | 320GB | On-demand | $1.49 | $5.94 | In stock | Rent |
| RunPod | GPU cloud | 2× A100 SXM | 160GB | On-demand | $1.59 | $3.18 | In stock | Rent |
| Oblivus | Marketplace | 1× A100 PCIE | 80GB | On-demand | $1.47 | $1.47 | In stock | Rent |
 Cerebrium | GPU cloud | 1× A100 | 80GB | On-demand | $2.10 | $2.10 | Unknown | Rent |
| Koyeb | GPU cloud | 4× A100 | 320GB | On-demand | $1.60 | $6.40 | Unknown | Rent |
| LLeafcloud | GPU cloud | 2× A100 | 160GB | On-demand | $1.87 | $3.74 | Unknown | Rent |
| Vast.ai | GPU cloud | 8× A100 SXM | 640GB | On-demand | $0.98 | $7.87 | In stock | Rent |
| Verda | Marketplace | 4× A100 | 320GB | Spot | $0.90 | $3.58 | Out of stock | Rent |
| Oblivus | Marketplace | 8× A100 | 640GB | Reserved | $1.05 | $8.40 | In stock | Rent |
| Hyperstack | GPU cloud | 1× A100 SXM | 80GB | On-demand | $1.60 | $1.60 | Unknown | Rent |
| Massed Compute | GPU cloud | 4× A100 | 320GB | On-demand | $1.35 | $5.40 | Unknown | Rent |
| RunPod | GPU cloud | 4× A100 SXM | 320GB | On-demand | $1.59 | $6.36 | In stock | Rent |
| Crusoe | Enterprise | 1× A100 SXM | 80GB | On-demand | $2.30 | $2.30 | Unknown | Rent |
| LLeafcloud | GPU cloud | 4× A100 | 320GB | On-demand | $1.88 | $7.51 | Unknown | Rent |
| Thunder Compute | Marketplace | 8× A100 | 640GB | On-demand | $1.49 | $11.92 | Unknown | Rent |
 Vultr | Enterprise | 4× A100 | 320GB | On-demand | $2.40 | $9.59 | Unknown | Rent |
| Oblivus | Marketplace | 2× A100 PCIE | 160GB | On-demand | $1.47 | $2.94 | In stock | Rent |
| Koyeb | GPU cloud | 8× A100 | 640GB | On-demand | $1.60 | $12.80 | Unknown | Rent |
| Civo | GPU cloud | 1× A100 | 80GB | On-demand | $1.79 | $1.79 | Unknown | Rent |
| Sesterce | GPU cloud | 8× A100 | 640GB | On-demand | $1.54 | $12.32 | In stock | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.34 | $1.34 | In stock | Rent |
| GPU.ai | Marketplace | 2× A100 | 160GB | Community | $2.01 | $4.02 | In stock | Rent |
| Massed Compute | GPU cloud | 8× A100 | 640GB | On-demand | $1.35 | $10.80 | Unknown | Rent |
| Civo | GPU cloud | 2× A100 | 160GB | On-demand | $1.79 | $3.58 | Unknown | Rent |
| RunPod | GPU cloud | 8× A100 SXM | 640GB | On-demand | $1.59 | $12.72 | In stock | Rent |
| Oblivus | Marketplace | 4× A100 PCIE | 320GB | On-demand | $1.47 | $5.88 | In stock | Rent |
| LLeafcloud | GPU cloud | 8× A100 | 640GB | On-demand | $1.88 | $15.02 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | On-demand | $1.79 | $1.79 | In stock | Rent |
| Koyeb | GPU cloud | 1× A100 SXM | 80GB | On-demand | $2.15 | $2.15 | Unknown | Rent |
 Lambda Labs | Enterprise | 8× A100 | 640GB | On-demand | $2.79 | $22.32 | In stock | Rent |
 CoreWeave | Enterprise | 8× A100 | 640GB | On-demand | $2.70 | $21.60 | Unknown | Rent |
| Massed Compute | GPU cloud | 8× A100 SXM | 640GB | On-demand | $1.38 | $11.04 | Unknown | Rent |
| Paperspace | Enterprise | 1× A100 | 80GB | On-demand | $3.18 | $3.18 | Unknown | Rent |
| Civo | GPU cloud | 4× A100 | 320GB | On-demand | $1.79 | $7.16 | Unknown | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Spot | $0.90 | $7.16 | Out of stock | Rent |
| Vultr | Enterprise | 8× A100 | 640GB | On-demand | $2.80 | $22.40 | In stock | Rent |
| Koyeb | GPU cloud | 2× A100 SXM | 160GB | On-demand | $2.15 | $4.30 | Unknown | Rent |
| AWS | Hyperscaler | 8× A100 | 640GB | On-demand | $2.74 | $21.96 | Unknown | Rent |
| Massed Compute | GPU cloud | 8× A100 | 640GB | On-demand | $1.38 | $11.04 | Unknown | Rent |
| Oblivus | Marketplace | 8× A100 PCIE | 640GB | On-demand | $1.47 | $11.76 | In stock | Rent |
 Oracle Cloud | Hyperscaler | 1× A100 | 80GB | On-demand | $4.00 | $4.00 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $0.97 | $0.97 | Out of stock | Rent |
| AWS | Hyperscaler | 8× A100 | 640GB | Spot | $2.47 | $19.74 | Unknown | Rent |
| Koyeb | GPU cloud | 4× A100 SXM | 320GB | On-demand | $2.15 | $8.60 | Unknown | Rent |
| Civo | GPU cloud | 8× A100 | 640GB | On-demand | $1.79 | $14.32 | Unknown | Rent |
| Oblivus | Marketplace | 8× A100 | 640GB | On-demand | $1.57 | $12.56 | In stock | Rent |
| Verda | Marketplace | 1× A100 | 80GB | On-demand | $1.29 | $1.29 | Out of stock | Rent |
| Paperspace | Enterprise | 8× A100 | 640GB | On-demand | $3.18 | $25.44 | Unknown | Rent |
 Replicate | GPU cloud | 1× A100 | 80GB | On-demand | $5.04 | $5.04 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.65 | $1.65 | In stock | Rent |
| Koyeb | GPU cloud | 8× A100 SXM | 640GB | On-demand | $2.15 | $17.20 | Unknown | Rent |
| Google Cloud | Hyperscaler | 1× A100 | 80GB | On-demand | $5.03 | $5.03 | Unknown | Rent |
| AWS | Hyperscaler | 8× A100 | 640GB | On-demand | $3.43 | $27.45 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.74 | $1.74 | In stock | Rent |
| Replicate | GPU cloud | 2× A100 | 160GB | On-demand | $5.04 | $10.08 | Unknown | Rent |
| Sesterce | GPU cloud | 8× A100 | 640GB | On-demand | $3.07 | $24.55 | In stock | Rent |
| Azure | Hyperscaler | 2× A100 | 160GB | On-demand | $3.67 | $7.35 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.75 | $1.75 | In stock | Rent |
| Replicate | GPU cloud | 4× A100 | 320GB | On-demand | $5.04 | $20.16 | Unknown | Rent |
| Azure | Hyperscaler | 4× A100 | 320GB | On-demand | $3.67 | $14.69 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.72 | $1.72 | In stock | Rent |
| Azure | Hyperscaler | 8× A100 | 640GB | On-demand | $3.40 | $27.20 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.19 | $1.19 | Out of stock | Rent |
| Replicate | GPU cloud | 8× A100 | 640GB | On-demand | $5.04 | $40.32 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.25 | $1.25 | Out of stock | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.26 | $1.26 | Out of stock | Rent |
| Azure | Hyperscaler | 8× A100 | 640GB | On-demand | $4.10 | $32.77 | Unknown | Rent |
| Verda | Marketplace | 1× A100 | 80GB | Reserved | $1.24 | $1.24 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $0.97 | $7.74 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | On-demand | $1.29 | $10.32 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.19 | $9.49 | Out of stock | Rent |
| Verda | Marketplace | 2× A100 | 160GB | Reserved | $1.34 | $2.69 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.25 | $10.01 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.26 | $10.11 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.24 | $9.91 | Out of stock | Rent |
| Verda | Marketplace | 2× A100 | 160GB | On-demand | $1.79 | $3.58 | Out of stock | Rent |
| Verda | Marketplace | 4× A100 | 320GB | Reserved | $1.34 | $5.37 | Out of stock | Rent |
| Verda | Marketplace | 4× A100 | 320GB | On-demand | $1.79 | $7.16 | Out of stock | Rent |
| Verda | Marketplace | 2× A100 | 160GB | Reserved | $1.65 | $3.29 | Out of stock | Rent |
| Verda | Marketplace | 2× A100 | 160GB | Reserved | $1.74 | $3.47 | Out of stock | Rent |
| Verda | Marketplace | 2× A100 | 160GB | Reserved | $1.75 | $3.51 | Out of stock | Rent |
| Verda | Marketplace | 2× A100 | 160GB | Reserved | $1.72 | $3.44 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.34 | $10.74 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | On-demand | $1.79 | $14.32 | Out of stock | Rent |
| Verda | Marketplace | 4× A100 | 320GB | Reserved | $1.65 | $6.59 | Out of stock | Rent |
| Verda | Marketplace | 4× A100 | 320GB | Reserved | $1.74 | $6.95 | Out of stock | Rent |
| Verda | Marketplace | 4× A100 | 320GB | Reserved | $1.75 | $7.02 | Out of stock | Rent |
| Verda | Marketplace | 4× A100 | 320GB | Reserved | $1.72 | $6.87 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.65 | $13.17 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.74 | $13.89 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.75 | $14.03 | Out of stock | Rent |
| Verda | Marketplace | 8× A100 | 640GB | Reserved | $1.72 | $13.75 | Out of stock | Rent |
Earn by hosting the A100
How this is worked out
“Renters pay” is the median live rate for this GPU on that marketplace — the median, not the floor, because the cheapest listing is one host undercutting everyone. “You earn” is that figure less the platform’s cut.
“Per day” is a ceiling: 24 hours, every hour rented, which no host achieves — scale it by the utilisation you expect. A card sitting idle earns nothing.Fees marked as published come from the platform’s terms; the rest are our estimates, labelled on each row.
Technical specifications
Throughput
| FP64 | 9.7 TFLOPS |
|---|---|
| FP32 | 20 TFLOPS |
| TF32 | 156 TFLOPS |
| FP16/BF16 | 312 TFLOPS |
Silicon & memory
- Memory
- 80 GB
- Memory bandwidth
- 1,560 GB/s
- TDP
- 400 W
- INT8
- 624 TOPS
- Process
- 7 nm
- Die size
- 826 mm²
- Transistors
- 54.2 B
- Foundry
- TSMC
- Released
- 1 Mar 2020
Datasheet
| Architecture | Ampere |
|---|---|
| Memory | 80 GB HBM2e |
| Bandwidth | 2.0 TB/s |
| Tensor compute | 312 TFLOPS FP16 (sparse) |
| MIG | up to 7 instances |
| Power | 300 W PCIe, 400 W SXM |
- Class
- Fine-tuning
- Cloud providers
- 28 tracked
- Price range
- $0.40 – $5.04 / GPU / hr
Other fine-tuning cards
Intel Gaudi 2
NVIDIA GH200SNAPSHOT 2026-08-23T22:42:15.889486+00:00 · BACK TO THE FULL INDEX