COMPARE / H100 SXM VS MI300X
H100 SXM vs MI300X
Specs from the chip makers' datasheets; prices from the live Compute Cafe panel, refreshed hourly. Every rate is an on-demand published price with a source receipt.
CHEAPEST H100 SXM
$0.890/hr
SpotGPUs · median $5.49 · 77 providers
CHEAPEST MI300X
$0.500/hr
RunPod · median $7.20 · 13 providers
CHEAPER RIGHT NOW
MI300X
live panel, 2026-09-27
| H100 SXM | MI300X | |
|---|---|---|
| MAKER | NVIDIA | AMD |
| ARCHITECTURE | Hopper | CDNA 3 |
| LAUNCHED | 2022 | 2023 |
| MEMORY | 80 GB HBM3 | 192 GB HBM3 |
| MEMORY BANDWIDTH | 3.35 TB/s | 5.3 TB/s |
| TENSOR COMPUTE | 989 TFLOPS FP16/BF16 tensor dense (1,979 sparse); 1,979 TFLOPS FP8 dense | 1,307 TFLOPS FP16/BF16 dense (2,614 sparse); 2,614 TFLOPS FP8 dense |
| POWER DRAW | 700 W | 750 W |
| INTERCONNECT | NVLink 4.0 900 GB/s | Infinity Fabric 896 GB/s |
HOW TO CHOOSE
MI300X vs H100 SXM
MI300X has 2.4x the memory and 1.6x the bandwidth; H100 has CUDA, NVLink and broader software support. For inference on mainstream stacks the AMD part often wins on cost; for training at scale, NVIDIA's fabric still leads.
Workload fit
H100 SXM: llm pre-training, 70b+ fine-tuning, high-throughput inference. MI300X: large-model inference, memory-bound training, cost-optimized clusters.
H100 SXM VS MI300X - FAQ
Which is cheaper to rent, H100 SXM or MI300X?
By today's published on-demand rates: H100 SXM starts at $0.890/GPU/hr (median $5.49, 77 providers) and MI300X starts at $0.500/GPU/hr (median $7.20, 13 providers). The cheapest live listing is the MI300X at RunPod. Figures recompute from the panel on every refresh.
H100 SXM or MI300X - which should I rent?
H100 SXM: The H100 SXM is the chip the current generation of frontier models was trained on, and the benchmark every other datacenter GPU is priced against. MI300X: The MI300X is AMD's serious answer to Hopper: more memory (192 GB) and more bandwidth (5.3 TB/s) than any NVIDIA part before Blackwell, at panel prices that frequently undercut H100. The side-by-side spec table and live price rows above give the full picture.
Where can I rent H100 SXM and MI300X?
77 providers publish H100 SXM rates and 13 publish MI300X rates on Compute Cafe. Every row links to the provider's own published price - committed-use and reserved rates are excluded.
Full pricing: H100 SXM · MI300X · all comparisons