COMPARE / H100 NVL VS H200 NVL
H100 NVL vs H200 NVL
Specs from the chip makers' datasheets; prices from the live Compute Cafe panel, refreshed hourly. Every rate is an on-demand published price with a source receipt.
CHEAPEST H100 NVL
$0.790/hr
SpotGPUs · median $8.72 · 7 providers
CHEAPEST H200 NVL
$0.500/hr
RunPod · median $3.82 · 9 providers
CHEAPER RIGHT NOW
H200 NVL
live panel, 2026-09-27
| H100 NVL | H200 NVL | |
|---|---|---|
| MAKER | NVIDIA | NVIDIA |
| ARCHITECTURE | Hopper | Hopper |
| LAUNCHED | 2023 | 2024 |
| MEMORY | 94 GB HBM3 per GPU | 141 GB HBM3e per GPU |
| MEMORY BANDWIDTH | 3.9 TB/s | 4.8 TB/s |
| TENSOR COMPUTE | 835 TFLOPS FP16/BF16 tensor dense (1,671 sparse); FP8 1,671 dense | 835 TFLOPS FP16/BF16 tensor dense; FP8 1,671 dense |
| POWER DRAW | 350-400 W | up to 600 W |
| INTERCONNECT | NVLink bridge 600 GB/s between the pair | NVLink bridge 600 GB/s |
HOW TO CHOOSE
H100 NVL vs H200 NVL
The H200 NVL bumps to 141 GB and 4.8 TB/s per card. Same shape, more headroom - pick on panel price.
H200 NVL vs H100 NVL
Same shape, 50% more memory and 23% more bandwidth per card. For serving, the H200 NVL is the better part; the H100 NVL is often the better price.
Workload fit
H100 NVL: 70b-class serving, long-context inference, fine-tuning. H200 NVL: 70b+ serving, moe and long-context inference.
H100 NVL VS H200 NVL - FAQ
Which is cheaper to rent, H100 NVL or H200 NVL?
By today's published on-demand rates: H100 NVL starts at $0.790/GPU/hr (median $8.72, 7 providers) and H200 NVL starts at $0.500/GPU/hr (median $3.82, 9 providers). The cheapest live listing is the H200 NVL at RunPod. Figures recompute from the panel on every refresh.
H100 NVL or H200 NVL - which should I rent?
H100 NVL: The H100 NVL is Hopper tuned for inference: 94 GB of fast HBM3 per card - the most memory of any H100 variant - sold as a bridge-linked PCIe pair. H200 NVL: The H200 NVL pairs two 141 GB HBM3e cards over an NVLink bridge - 282 GB per pair, the most inference-friendly memory footprint in the Hopper line. The side-by-side spec table and live price rows above give the full picture.
Where can I rent H100 NVL and H200 NVL?
7 providers publish H100 NVL rates and 9 publish H200 NVL rates on Compute Cafe. Every row links to the provider's own published price - committed-use and reserved rates are excluded.
Full pricing: H100 NVL · H200 NVL · all comparisons