GPU MODELS / A100 80GB SXM
A100 80GB SXM cloud GPU pricing
65 listings across 7 providers. Cheapest published rate: $0.290/GPU/hr at SpotGPUs. Sorted by per-GPU hourly price. Every row links to the provider's own published price.
WHAT IS THE A100 80GB SXM
The A100 80GB was the standard large-model training chip of 2021-2023 and still anchors an enormous installed base. Its 80 GB of HBM2e fits most models up to 70B parameters for fine-tuning, and NVLink makes 8-way nodes behave like one big GPU. Hopper has replaced it at the frontier, but the A100 remains the price-performance reference the whole market is quoted against.
MAKER
NVIDIA
ARCHITECTURE
Ampere
LAUNCHED
2020
MEMORY
80 GB HBM2e
MEMORY BANDWIDTH
2.0 TB/s
TENSOR COMPUTE
312 TFLOPS FP16/BF16 tensor dense (624 sparse)
POWER DRAW
400 W
INTERCONNECT
NVLink 3.0 600 GB/s
WHAT IT IS GOOD AT
Fine-tuning up to 70B
The sweet spot. 80 GB holds a 70B model's weights at BF16 with room for LoRA/QLoRA optimizer state, and 2 TB/s keeps the workload memory-bound rather than stuck.
Multi-GPU training
NVLink 3.0 at 600 GB/s is still a real interconnect; 8xA100 nodes train LLMs credibly.
Large-model inference
A single card serves a quantized 70B; MIG slices it into seven isolated 10 GB instances for small-model fleets.
WHO SHOULD NOT RENT THE A100 80GB SXM
Small-model inference fleets - an L40S or RTX 4090 serves 7B-13B models far cheaper per token.
Frontier pre-training, where H100/B200 nodes win on FP8 throughput and interconnect.
| Provider | Config | VRAM | Location | $/hr | $/GPU/hr | Source |
|---|---|---|---|---|---|---|
 SpotGPUs | A100 SXM 80GB × 1 | 80 GB | Not published | $0.290 | $0.290 | receipt |
 Oblivus | A100 80GB NVLink × 1 | 80 GB | Not published | $1.570 | $1.570 | receipt |
 TensorDock | A100 80GB SXM × 1 | 80 GB | Multiple regions | $1.650 | $1.650 | receipt |
 Suanjia Cloud | A100 80GB SXM × 1 | 80 GB | China | $1.783 | $1.783 | receipt |
 ACC | A100 80GB NVLink × 1 | 80 GB | Singapore | $2.100 | $2.100 | receipt |
 Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | US East | $32.770 | $4.096 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | US East 2 | $32.770 | $4.096 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | US West 3 | $32.770 | $4.096 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | US West 3 | $32.770 | $4.096 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | US East 2 | $32.770 | $4.096 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | US West 2 | $32.770 | $4.096 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | US East | $32.770 | $4.096 | receipt |
| A100 80GB SXM × 1 | 80 GB | China | $4.485 | $4.485 | receipt | |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | US Central | $37.030 | $4.629 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | CA Central | $39.324 | $4.915 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | US South Central | $39.324 | $4.915 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | CA East | $39.324 | $4.915 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | CA East | $39.324 | $4.915 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | US South Central | $39.324 | $4.915 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | CA Central | $39.324 | $4.915 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | IT North | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | EU West | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | US Gov AZ | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | US Gov Virginia | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | FR Central | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | EU West | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | IT North | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | SE Central | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | SE Central | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | UK South | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | ES Central | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | ES Central | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | FR Central | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | UK South | $40.962 | $5.120 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | US West | $42.601 | $5.325 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | US West | $42.601 | $5.325 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | UK West | $42.929 | $5.366 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | UK West | $42.929 | $5.366 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | NO East | $46.861 | $5.858 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | CH North | $46.861 | $5.858 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | CH North | $46.861 | $5.858 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | NO East | $46.861 | $5.858 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | AE North | $46.861 | $5.858 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | AE North | $46.861 | $5.858 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | PL Central | $46.890 | $5.861 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | PL Central | $46.890 | $5.861 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | AU East | $47.516 | $5.939 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | AU East | $47.516 | $5.939 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | JA East | $47.517 | $5.940 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | JA East | $47.517 | $5.940 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | ZA North | $47.844 | $5.981 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | ZA North | $47.844 | $5.981 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | IN South | $49.483 | $6.185 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | IN South | $49.483 | $6.185 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | JA West | $50.794 | $6.349 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | JA West | $50.794 | $6.349 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | FR South | $53.248 | $6.656 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | DE North | $55.381 | $6.923 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | DE North | $55.381 | $6.923 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | CH West | $60.919 | $7.615 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | AE Central | $60.919 | $7.615 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | CH West | $60.919 | $7.615 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | AE Central | $60.919 | $7.615 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96ams_A100_v4] × 8 | 80 GB | BR South | $65.540 | $8.193 | receipt |
| Microsoft Azure | A100 80GB NVLink [ND96amsr_A100_v4] × 8 | 80 GB | BR South | $65.540 | $8.193 | receipt |
THE A100 80GB SXM MARKET, BY THE NUMBERS
PROVIDERS
7
CONFIGURATIONS
65
MEDIAN $/GPU/HR
$5.12
SPREAD
28.3x
7 providers publish 65 A100 80GB SXM configurations on the panel today. Published per-GPU hourly rates run from $0.290 (SpotGPUs) to $8.19 (Microsoft Azure), a 28x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $5.12/GPU/hr. 62 rows were reported in stock by the provider at last observation; the rest are published catalog rates. All rates are on-demand - committed-use and reserved pricing is excluded.
CHEAPEST A100 80GB SXM BY GEOGRAPHY
chinaSuanjia Cloud$1.783/hrsingaporeACC$2.100/hrunited statesMicrosoft Azure$4.096/hrcanadaMicrosoft Azure$4.915/hritalyMicrosoft Azure$5.120/hrfranceMicrosoft Azure$5.120/hrswedenMicrosoft Azure$5.120/hrunited kingdomMicrosoft Azure$5.120/hrA100 80GB SXM PRICE TREND, DAILY PANEL SNAPSHOTS
Across every A100 80GB SXM row on the panel, the daily floor moved from $1.570 to $0.290/GPU/hr over 10 days of tracking (-81.5%). The median continuously-tracked listing held flat at $5.33. Snapshots run daily; the full history is public in the repo.
A100 80GB SXM PROVIDER NOTES
from $0.290/hr
from $1.570/hr
from $1.650/hr
from $1.783/hr
from $2.100/hr
from $4.096/hr
from $4.485/hr
BUYING A100 80GB SXM: WHAT THE PANEL SAYS
At the current floor, one A100 80GB SXM running around the clock costs about $212 a month (730 hours of on-demand arithmetic). Node shape matters: the single-GPU floor is $0.290/GPU/hr against $4.096/GPU/hr on an 8-GPU node (+1312.5%). Per-GPU floors by config size: 1x $0.29 · 8x $4.10. Compare the alternatives below before committing - the same budget often buys more than one chip class.
A100 80GB SXM VS THE ALTERNATIVES
A100 80GB SXM vs H100 SXM
The H100 roughly triples dense FP16 throughput, adds FP8 and raises bandwidth to 3.35 TB/s - but typically lists at 2-3x the A100's hourly rate. For fine-tuning jobs that fit in 80 GB, the A100 is often the better value; for pre-training, the H100 pays for itself.
A100 80GB SXM vs MI300X
AMD's MI300X carries 192 GB and 5.3 TB/s - far more headroom for large-model inference - at often comparable panel prices. The trade is CUDA maturity versus raw memory.
A100 80GB SXM vs L40S
The L40S is cheaper per hour and faster at FP16 on paper, but 48 GB of GDDR6 and no NVLink cap it at smaller models. For anything 70B-class, the A100's HBM and interconnect win.
Compare live rates: A100 80GB SXM vs V100 · A100 80GB SXM vs H100 SXM · A100 80GB SXM vs MI300X · A100 80GB SXM vs L40S · A100 80GB SXM vs A100 80GB PCIe · A100 80GB SXM vs A100 SXM · A100 80GB SXM vs V100 32GB NVLink · A100 80GB SXM vs A100 PCIe · A100 80GB SXM vs H200 SXM
A100 80GB SXM PRICING FAQ
What is the cheapest A100 80GB SXM cloud GPU right now?
The cheapest published A100 80GB SXM rate on the panel is $0.290 per GPU-hour at SpotGPUs (A100 SXM 80GB x 1, Not published). Every price links to the provider's own published rate.
How much does a A100 80GB SXM cost per hour?
Across 7 providers tracked today, published per-GPU hourly rates for A100 80GB SXM run from $0.29 to $8.19, with a median of $5.12. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent A100 80GB SXM GPUs?
7 providers publish 65 distinct A100 80GB SXM configurations on Compute Cafe. 62 of those rows were reported in stock by the provider's live endpoint at last observation.
Where is A100 80GB SXM cheapest?
By published per-GPU hourly rate, the cheapest geography for A100 80GB SXM today is china at $1.78/hr (Suanjia Cloud). The spread across 19 tracked geographies runs to $8.19/hr in brazil.
Are A100 80GB SXM prices going up or down?
Over the 10 days Compute Cafe has tracked the panel, the A100 80GB SXM floor is falling: $1.570 to $0.290/GPU/hr (-81.5%). The median continuously-tracked listing moved from $5.33 to $5.33 (+0.0%). Daily snapshots are public in the repo, so the trend is auditable.
What does a A100 80GB SXM cost per month?
At the current floor of $0.290/GPU/hr, a A100 80GB SXM running 24/7 costs about $212 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
Is a full 8-GPU A100 80GB SXM node cheaper than a single card?
On today's panel: the single-GPU floor is $0.290/GPU/hr and the 8-GPU node floor is $4.096/GPU/hr - more expensive per GPU on a full node (+1312.5%). Check the table for the exact configs behind each floor.
Is the A100 still good for training in 2026?
Yes, for everything except frontier pre-training. BF16 support, 80 GB of HBM2e and real NVLink keep it credible, and its hourly rate has fallen well below Hopper. It is the default value pick for serious fine-tuning.
How many A100s do I need to fine-tune a 70B model?
A single 80 GB A100 handles QLoRA on a 70B; full fine-tuning wants 4-8 cards with NVLink depending on sequence length and optimizer. The panel lists both single-card and 8-way node pricing.
See also alternatives to the A100 80GB SXM · cheapest GPU-hour per model · inference chips · training chips · by location