COMPARE / GH200 VS H100 SXM
GH200 vs H100 SXM
Specs from the chip makers' datasheets; prices from the live Compute Cafe panel, refreshed hourly. Every rate is an on-demand published price with a source receipt.
CHEAPEST GH200
$0.790/hr
SpotGPUs · median $2.75 · 7 providers
CHEAPEST H100 SXM
$0.890/hr
SpotGPUs · median $5.49 · 77 providers
CHEAPER RIGHT NOW
GH200
live panel, 2026-09-27
| GH200 | H100 SXM | |
|---|---|---|
| MAKER | NVIDIA | NVIDIA |
| ARCHITECTURE | Grace Hopper | Hopper |
| LAUNCHED | 2023 | 2022 |
| MEMORY | 96-141 GB HBM3/HBM3e + up to 480 GB LPDDR5X (Grace CPU) | 80 GB HBM3 |
| MEMORY BANDWIDTH | 4.0-4.9 TB/s (HBM) | 3.35 TB/s |
| TENSOR COMPUTE | H100-class tensor throughput (989 TFLOPS FP16 dense) | 989 TFLOPS FP16/BF16 tensor dense (1,979 sparse); 1,979 TFLOPS FP8 dense |
| POWER DRAW | up to 1,000 W (module) | 700 W |
| INTERCONNECT | NVLink-C2C 900 GB/s CPU-GPU | NVLink 4.0 900 GB/s |
HOW TO CHOOSE
GH200 vs H100 SXM
Same GPU compute; GH200 adds the Grace CPU and coherent memory fabric. Standard training and serving are cheaper on plain H100; memory-giant workloads need the GH200.
Workload fit
GH200: giant-memory inference, hpc + ai hybrids. H100 SXM: llm pre-training, 70b+ fine-tuning, high-throughput inference.
GH200 VS H100 SXM - FAQ
Which is cheaper to rent, GH200 or H100 SXM?
By today's published on-demand rates: GH200 starts at $0.790/GPU/hr (median $2.75, 7 providers) and H100 SXM starts at $0.890/GPU/hr (median $5.49, 77 providers). The cheapest live listing is the GH200 at SpotGPUs. Figures recompute from the panel on every refresh.
GH200 or H100 SXM - which should I rent?
GH200: The GH200 couples an H100-class GPU with a 72-core Grace ARM CPU over a 900 GB/s coherent link, exposing the CPU's large LPDDR memory to the GPU. H100 SXM: The H100 SXM is the chip the current generation of frontier models was trained on, and the benchmark every other datacenter GPU is priced against. The side-by-side spec table and live price rows above give the full picture.
Where can I rent GH200 and H100 SXM?
7 providers publish GH200 rates and 77 publish H100 SXM rates on Compute Cafe. Every row links to the provider's own published price - committed-use and reserved rates are excluded.
Full pricing: GH200 · H100 SXM · all comparisons