COMPARE / A100 PCIE VS H100 PCIE
A100 PCIe vs H100 PCIe
Specs from the chip makers' datasheets; prices from the live Compute Cafe panel, refreshed hourly. Every rate is an on-demand published price with a source receipt.
CHEAPEST A100 PCIE
$1.150/hr
Denvr Dataworks · median $1.99 · 5 providers
CHEAPEST H100 PCIE
$0.690/hr
SpotGPUs · median $2.73 · 13 providers
CHEAPER RIGHT NOW
H100 PCIe
live panel, 2026-09-27
| A100 PCIE | H100 PCIE | |
|---|---|---|
| MAKER | NVIDIA | NVIDIA |
| ARCHITECTURE | Ampere | Hopper |
| LAUNCHED | 2021 | 2022 |
| MEMORY | 40 or 80 GB HBM2e (providers often list without the variant) | 80 GB HBM2e |
| MEMORY BANDWIDTH | 1,555-1,935 GB/s depending on variant | 2.0 TB/s |
| TENSOR COMPUTE | 312 TFLOPS FP16/BF16 tensor dense (624 sparse) | 756 TFLOPS FP16/BF16 tensor dense (1,513 sparse); 1,513 TFLOPS FP8 dense |
| POWER DRAW | 250 W | 350 W |
| INTERCONNECT | PCIe 4.0 x16 (optional NVLink bridge) | PCIe 5.0 x16 (NVLink bridge up to 600 GB/s) |
HOW TO CHOOSE
A100 PCIe vs H100 PCIe
The H100 PCIe roughly doubles dense FP16 throughput at a higher hourly rate and the same interconnect limits. For single-GPU work it is the faster option; neither links well.
Workload fit
A100 PCIe: single-gpu fine-tuning, inference serving, multi-gpu training. H100 PCIe: inference, fine-tuning.
A100 PCIE VS H100 PCIE - FAQ
Which is cheaper to rent, A100 PCIe or H100 PCIe?
By today's published on-demand rates: A100 PCIe starts at $1.150/GPU/hr (median $1.99, 5 providers) and H100 PCIe starts at $0.690/GPU/hr (median $2.73, 13 providers). The cheapest live listing is the H100 PCIe at SpotGPUs. Figures recompute from the panel on every refresh.
A100 PCIe or H100 PCIe - which should I rent?
A100 PCIe: The PCIe A100 brings Ampere tensor cores to standard servers at 250 W. H100 PCIe: The H100 PCIe puts Hopper's Transformer Engine into standard servers at half the SXM power budget. The side-by-side spec table and live price rows above give the full picture.
Where can I rent A100 PCIe and H100 PCIe?
5 providers publish A100 PCIe rates and 13 publish H100 PCIe rates on Compute Cafe. Every row links to the provider's own published price - committed-use and reserved rates are excluded.
Full pricing: A100 PCIe · H100 PCIe · all comparisons