COMPARE / A100 80GB SXM VS H200 SXM
A100 80GB SXM vs H200 SXM
Specs from the chip makers' datasheets; prices from the live Compute Cafe panel, refreshed hourly. Every rate is an on-demand published price with a source receipt.
CHEAPEST A100 80GB SXM
$0.290/hr
SpotGPUs · median $5.12 · 7 providers
CHEAPEST H200 SXM
$0.774/hr
OVHcloud · median $4.59 · 58 providers
CHEAPER RIGHT NOW
A100 80GB SXM
live panel, 2026-09-27
| A100 80GB SXM | H200 SXM | |
|---|---|---|
| MAKER | NVIDIA | NVIDIA |
| ARCHITECTURE | Ampere | Hopper |
| LAUNCHED | 2020 | 2024 |
| MEMORY | 80 GB HBM2e | 141 GB HBM3e |
| MEMORY BANDWIDTH | 2.0 TB/s | 4.8 TB/s |
| TENSOR COMPUTE | 312 TFLOPS FP16/BF16 tensor dense (624 sparse) | 989 TFLOPS FP16/BF16 tensor dense (1,979 sparse); 1,979 TFLOPS FP8 dense |
| POWER DRAW | 400 W | 700 W |
| INTERCONNECT | NVLink 3.0 600 GB/s | NVLink 4.0 900 GB/s |
HOW TO CHOOSE
A100 80GB SXM vs H200 SXM
On paper - A100 80GB SXM (Ampere): 80 GB HBM2e, 2.0 TB/s bandwidth, 400 W. H200 SXM (Hopper): 141 GB HBM3e, 4.8 TB/s bandwidth, 700 W. The discount question: a previous-generation flagship at a steep panel discount versus the current one - how much is the H200's extra memory and bandwidth worth per hour.
H200 SXM vs A100 80GB SXM
On paper - A100 80GB SXM (Ampere): 80 GB HBM2e, 2.0 TB/s bandwidth, 400 W. H200 SXM (Hopper): 141 GB HBM3e, 4.8 TB/s bandwidth, 700 W. The discount question: a previous-generation flagship at a steep panel discount versus the current one - how much is the H200's extra memory and bandwidth worth per hour.
Workload fit
A100 80GB SXM: fine-tuning up to 70b, multi-gpu training, large-model inference. H200 SXM: large-model inference, memory-bound training, moe serving.
A100 80GB SXM VS H200 SXM - FAQ
Which is cheaper to rent, A100 80GB SXM or H200 SXM?
By today's published on-demand rates: A100 80GB SXM starts at $0.290/GPU/hr (median $5.12, 7 providers) and H200 SXM starts at $0.774/GPU/hr (median $4.59, 58 providers). The cheapest live listing is the A100 80GB SXM at SpotGPUs. Figures recompute from the panel on every refresh.
A100 80GB SXM or H200 SXM - which should I rent?
A100 80GB SXM: The A100 80GB was the standard large-model training chip of 2021-2023 and still anchors an enormous installed base. H200 SXM: The H200 is an H100 with the memory subsystem rebuilt: 141 GB of HBM3e at 4.8 TB/s versus 80 GB at 3.35. The side-by-side spec table and live price rows above give the full picture.
Where can I rent A100 80GB SXM and H200 SXM?
7 providers publish A100 80GB SXM rates and 58 publish H200 SXM rates on Compute Cafe. Every row links to the provider's own published price - committed-use and reserved rates are excluded.
Full pricing: A100 80GB SXM · H200 SXM · all comparisons