COMPARE / H100 NVL VS H200 NVL
H100 NVL vs H200 NVL
Specs from the chip makers' datasheets; prices from the live Compute Cafe panel, refreshed daily. Every rate is an on-demand published price with a source receipt.
CHEAPEST H100 NVL
$2.470/hr
gpu.ai · median $8.73 · 6 providers
CHEAPEST H200 NVL
$3.620/hr
Massed Compute · median $4.76 · 7 providers
CHEAPER RIGHT NOW
H100 NVL
live panel, 2026-11-12
| H100 NVL | H200 NVL | |
|---|---|---|
| MAKER | NVIDIA | NVIDIA |
| ARCHITECTURE | Hopper | Hopper |
| LAUNCHED | 2023 | 2024 |
| MEMORY | 94 GB HBM3 per GPU | 141 GB HBM3e per GPU |
| MEMORY BANDWIDTH | 3.9 TB/s | 4.8 TB/s |
| TENSOR COMPUTE | 835 TFLOPS FP16/BF16 tensor dense (1,671 sparse); FP8 1,671 dense | 835 TFLOPS FP16/BF16 tensor dense; FP8 1,671 dense |
| POWER DRAW | 350-400 W | up to 600 W |
| INTERCONNECT | NVLink bridge 600 GB/s between the pair | NVLink bridge 600 GB/s |
HOW TO CHOOSE
H100 NVL vs H200 NVL
The H200 NVL bumps to 141 GB and 4.8 TB/s per card. Same shape, more headroom - pick on panel price.
H200 NVL vs H100 NVL
Same shape, 50% more memory and 23% more bandwidth per card. For serving, the H200 NVL is the better part; the H100 NVL is often the better price.
Workload fit
H100 NVL: 70b-class serving, long-context inference, fine-tuning. H200 NVL: 70b+ serving, moe and long-context inference.
H100 NVL VS H200 NVL - FAQ
Which is cheaper to rent, H100 NVL or H200 NVL?
By today's published on-demand rates: H100 NVL starts at $2.470/GPU/hr (median $8.73, 6 providers) and H200 NVL starts at $3.620/GPU/hr (median $4.76, 7 providers). The cheapest live listing is the H100 NVL at gpu.ai. Figures recompute from the panel on every refresh.
H100 NVL or H200 NVL - which should I rent?
H100 NVL: The H100 NVL is Hopper tuned for inference: 94 GB of fast HBM3 per card - the most memory of any H100 variant - sold as a bridge-linked PCIe pair. H200 NVL: The H200 NVL pairs two 141 GB HBM3e cards over an NVLink bridge - 282 GB per pair, the most inference-friendly memory footprint in the Hopper line. The side-by-side spec table and live price rows above give the full picture.
Where can I rent H100 NVL and H200 NVL?
6 providers publish H100 NVL rates and 7 publish H200 NVL rates on Compute Cafe. Every row links to the provider's own published price - committed-use and reserved rates are excluded.
Full pricing: H100 NVL · H200 NVL · all comparisons