COMPARE / H100 SXM VS H20
H100 SXM vs H20
Specs from the chip makers' datasheets; prices from the live Compute Cafe panel, refreshed hourly. Every rate is an on-demand published price with a source receipt.
CHEAPEST H100 SXM
$0.890/hr
SpotGPUs · median $5.49 · 77 providers
CHEAPEST H20
$1.010/hr
PPIO · median $1.29 · 3 providers
CHEAPER RIGHT NOW
H100 SXM
live panel, 2026-09-27
| H100 SXM | H20 | |
|---|---|---|
| MAKER | NVIDIA | NVIDIA |
| ARCHITECTURE | Hopper | Hopper |
| LAUNCHED | 2022 | 2024 |
| MEMORY | 80 GB HBM3 | 96 GB HBM3 |
| MEMORY BANDWIDTH | 3.35 TB/s | 4.0 TB/s |
| TENSOR COMPUTE | 989 TFLOPS FP16/BF16 tensor dense (1,979 sparse); 1,979 TFLOPS FP8 dense | 148 TFLOPS FP16/BF16 tensor (296 TFLOPS FP8, 44 TFLOPS FP32) |
| POWER DRAW | 700 W | 400 W |
| INTERCONNECT | NVLink 4.0 900 GB/s | SXM5 (HGX H20, NVLink) |
HOW TO CHOOSE
H20 vs H100 SXM
Same Hopper die family and similar memory system (96 GB vs 80 GB, 4.0 vs 3.35 TB/s), but the H20's FP16 tensor throughput is about 7% of the H100's. For inference holding a big model, compare the panel prices; for training, there is no comparison.
Workload fit
H100 SXM: llm pre-training, 70b+ fine-tuning, high-throughput inference. H20: large-model inference, memory-bound hpc and analytics, llm training.
H100 SXM VS H20 - FAQ
Which is cheaper to rent, H100 SXM or H20?
By today's published on-demand rates: H100 SXM starts at $0.890/GPU/hr (median $5.49, 77 providers) and H20 starts at $1.010/GPU/hr (median $1.29, 3 providers). The cheapest live listing is the H100 SXM at SpotGPUs. Figures recompute from the panel on every refresh.
H100 SXM or H20 - which should I rent?
H100 SXM: The H100 SXM is the chip the current generation of frontier models was trained on, and the benchmark every other datacenter GPU is priced against. H20: The H20 is the China-market Hopper: full 96 GB of HBM3 and 4.0 TB/s of memory bandwidth, but tensor compute capped at 148 TFLOPS of FP16 - a fraction of the H100's. The side-by-side spec table and live price rows above give the full picture.
Where can I rent H100 SXM and H20?
77 providers publish H100 SXM rates and 3 publish H20 rates on Compute Cafe. Every row links to the provider's own published price - committed-use and reserved rates are excluded.
Full pricing: H100 SXM · H20 · all comparisons