GPU MODELS / H100 NVL
H100 NVL cloud GPU pricing
72 listings across 7 providers. Cheapest published rate: $0.790/GPU/hr at SpotGPUs. Sorted by per-GPU hourly price. Every row links to the provider's own published price.
WHAT IS THE H100 NVL
The H100 NVL is Hopper tuned for inference: 94 GB of fast HBM3 per card - the most memory of any H100 variant - sold as a bridge-linked PCIe pair. Two cards present 188 GB coherent enough to serve a 70B model at BF16 or long-context 34B with KV cache to spare. It exists to win serving economics, not training.
MAKER
NVIDIA
ARCHITECTURE
Hopper
LAUNCHED
2023
MEMORY
94 GB HBM3 per GPU
MEMORY BANDWIDTH
3.9 TB/s
TENSOR COMPUTE
835 TFLOPS FP16/BF16 tensor dense (1,671 sparse); FP8 1,671 dense
POWER DRAW
350-400 W
INTERCONNECT
NVLink bridge 600 GB/s between the pair
WHAT IT IS GOOD AT
70B-class serving
The design case: one NVL pair serves a 70B at BF16 with context headroom.
Long-context inference
3.9 TB/s of HBM3 bandwidth is what KV-cache-heavy decoding is hungry for.
Fine-tuning
Workable, but SXM nodes scale better beyond two GPUs.
WHO SHOULD NOT RENT THE H100 NVL
Training at scale - it is an inference part; SXM nodes win.
Models under ~30B, where L40S/4090-class cards serve at a fraction of the price.
| Provider | Config | VRAM | Location | $/hr | $/GPU/hr | Source |
|---|---|---|---|---|---|---|
 SpotGPUs | H100 NVL × 1 | 94 GB | Not published | $0.790 | $0.790 | receipt |
 RunPod | H100 NVL × 1 | 94 GB | Global | $2.590 | $2.590 | receipt |
 Massed Compute | H100 NVL NVLink × 8 | 94 GB | Not published | $23.360 | $2.920 | receipt |
 gpu.ai | H100 NVL × 1 | 94 GB | Not published | $3.190 | $3.190 | receipt |
 Hostnot GPU | H100 NVL × 1 | 94 GB | US Central | $3.510 | $3.510 | receipt |
| Hostnot GPU | H100 NVL × 1 | 94 GB | US East | $3.510 | $3.510 | receipt |
 GPUBrazil | H100 NVL × 1 | 94 GB | Asia-Pacific | $3.566 | $3.566 | receipt |
| GPUBrazil | H100 NVL × 1 | 94 GB | Europe | $3.675 | $3.675 | receipt |
| GPUBrazil | H100 NVL × 1 | 94 GB | North America | $3.815 | $3.815 | receipt |
| GPUBrazil | H100 NVL × 1 | 94 GB | Global | $4.227 | $4.227 | receipt |
 Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US East | $6.980 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US West 3 | $6.980 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US East 2 | $6.980 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US West 2 | $6.980 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US West 3 | $13.960 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US West 2 | $13.960 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US East | $13.960 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US East 2 | $13.960 | $6.980 | receipt |
| Microsoft Azure | H100 NVL [NCC40ads_H100_v5] × 1 | 94 GB | US South Central | $7.890 | $7.890 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | MY West | $16.333 | $8.166 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | ID Central | $16.333 | $8.166 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | MY West | $8.167 | $8.167 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | ID Central | $8.167 | $8.167 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US North Central | $8.376 | $8.376 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | EU North | $8.376 | $8.376 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US North Central | $16.752 | $8.376 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | EU North | $16.752 | $8.376 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US South Central | $8.380 | $8.380 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US South Central | $16.760 | $8.380 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US Central | $8.585 | $8.585 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US Central | $17.170 | $8.585 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | CA Central | $8.590 | $8.590 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | CA Central | $17.180 | $8.590 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | KR South | $8.725 | $8.725 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | UK South | $8.725 | $8.725 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | UK South | $17.450 | $8.725 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | KR South | $17.450 | $8.725 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US Gov AZ | $8.730 | $8.730 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US Gov AZ | $17.460 | $8.730 | receipt |
| Microsoft Azure | H100 NVL [NCC40ads_H100_v5] × 1 | 94 GB | US East 2 | $8.820 | $8.820 | receipt |
| Microsoft Azure | H100 NVL [NCC40ads_H100_v5] × 1 | 94 GB | EU West | $8.900 | $8.900 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | ES Central | $9.074 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | US West | $9.074 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | SE Central | $9.074 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | AP Southeast | $9.074 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | DE West Central | $9.074 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | US West | $18.148 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | AP Southeast | $18.148 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | ES Central | $18.148 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | SE Central | $18.148 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | DE West Central | $18.148 | $9.074 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | EU West | $9.080 | $9.080 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | EU West | $18.160 | $9.080 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | UK West | $9.140 | $9.140 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | UK West | $18.280 | $9.140 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | KR Central | $9.423 | $9.423 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | KR Central | $18.846 | $9.423 | receipt |
| Microsoft Azure | H100 NVL [NCC40ads_H100_v5] × 1 | 94 GB | US Central | $9.730 | $9.730 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | IN West Jio | $9.772 | $9.772 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | IN Central Jio | $9.772 | $9.772 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | IN Central | $9.772 | $9.772 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | IN Central | $19.544 | $9.772 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | IN Central Jio | $19.544 | $9.772 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | IN West Jio | $19.544 | $9.772 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | AE North | $9.980 | $9.980 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | AE North | $19.960 | $9.980 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | CH North | $9.981 | $9.981 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | CH North | $19.963 | $9.982 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | AU East | $10.121 | $10.121 | receipt |
| Microsoft Azure | H100 NVL [NC40ads_H100_v5] × 1 | 94 GB | JA East | $10.121 | $10.121 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | AU East | $20.242 | $10.121 | receipt |
| Microsoft Azure | H100 NVL [NC80adis_H100_v5] × 2 | 94 GB | JA East | $20.242 | $10.121 | receipt |
THE H100 NVL MARKET, BY THE NUMBERS
PROVIDERS
7
CONFIGURATIONS
72
MEDIAN $/GPU/HR
$8.72
SPREAD
12.8x
7 providers publish 72 H100 NVL configurations on the panel today. Published per-GPU hourly rates run from $0.790 (SpotGPUs) to $10.12 (Microsoft Azure), a 13x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $8.72/GPU/hr. 71 rows were reported in stock by the provider at last observation; the rest are published catalog rates. All rates are on-demand - committed-use and reserved pricing is excluded.
CHEAPEST H100 NVL BY GEOGRAPHY
united statesHostnot GPU$3.510/hrmalaysiaMicrosoft Azure$8.166/hrindonesiaMicrosoft Azure$8.166/hrcanadaMicrosoft Azure$8.590/hrsouth koreaMicrosoft Azure$8.725/hrunited kingdomMicrosoft Azure$8.725/hrspainMicrosoft Azure$9.074/hrswedenMicrosoft Azure$9.074/hrH100 NVL PRICE TREND, DAILY PANEL SNAPSHOTS
Across every H100 NVL row on the panel, the daily floor moved from $2.590 to $0.790/GPU/hr over 11 days of tracking (-69.5%). Snapshots run daily; the full history is public in the repo.
H100 NVL PROVIDER NOTES
from $0.790/hr
from $2.590/hr
from $2.920/hr
from $3.190/hr
from $3.510/hr
from $3.566/hr
from $6.980/hr
BUYING H100 NVL: WHAT THE PANEL SAYS
At the current floor, one H100 NVL running around the clock costs about $577 a month (730 hours of on-demand arithmetic). Node shape matters: the single-GPU floor is $0.790/GPU/hr against $2.920/GPU/hr on an 8-GPU node (+269.6%). Per-GPU floors by config size: 1x $0.79 · 2x $6.98 · 8x $2.92. Compare the alternatives below before committing - the same budget often buys more than one chip class.
H100 NVL VS THE ALTERNATIVES
H100 NVL vs H100 PCIe
NVL adds memory (94 vs 80 GB), bandwidth (3.9 vs 2.0 TB/s) and a real bridge. For inference the NVL wins; it costs more.
H100 NVL vs H200 NVL
The H200 NVL bumps to 141 GB and 4.8 TB/s per card. Same shape, more headroom - pick on panel price.
Compare live rates: H100 NVL vs H100 PCIe · H100 NVL vs H200 NVL · H100 NVL vs RTX PRO 6000
H100 NVL PRICING FAQ
What is the cheapest H100 NVL cloud GPU right now?
The cheapest published H100 NVL rate on the panel is $0.790 per GPU-hour at SpotGPUs (H100 NVL x 1, Not published). Every price links to the provider's own published rate.
How much does a H100 NVL cost per hour?
Across 7 providers tracked today, published per-GPU hourly rates for H100 NVL run from $0.79 to $10.12, with a median of $8.72. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent H100 NVL GPUs?
7 providers publish 72 distinct H100 NVL configurations on Compute Cafe. 71 of those rows were reported in stock by the provider's live endpoint at last observation.
Where is H100 NVL cheapest?
By published per-GPU hourly rate, the cheapest geography for H100 NVL today is united states at $3.51/hr (Hostnot GPU). The spread across 14 tracked geographies runs to $10.12/hr in japan.
Are H100 NVL prices going up or down?
Over the 11 days Compute Cafe has tracked the panel, the H100 NVL floor is falling: $2.590 to $0.790/GPU/hr (-69.5%). Daily snapshots are public in the repo, so the trend is auditable.
What does a H100 NVL cost per month?
At the current floor of $0.790/GPU/hr, a H100 NVL running 24/7 costs about $577 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
Is a full 8-GPU H100 NVL node cheaper than a single card?
On today's panel: the single-GPU floor is $0.790/GPU/hr and the 8-GPU node floor is $2.920/GPU/hr - more expensive per GPU on a full node (+269.6%). Check the table for the exact configs behind each floor.
Why does the H100 NVL have 94 GB?
It is built for inference: more memory per card means bigger models and longer contexts without splitting across more GPUs. The odd number is the HBM3 stack configuration NVIDIA chose for this SKU.
See also alternatives to the H100 NVL · cheapest GPU-hour per model · inference chips · training chips · by location