GPU MODELS / H100 SXM

H100 SXM cloud GPU pricing

179 listings across 67 providers. Cheapest published rate: $1.190/GPU/hr at IO.NET. Sorted by per-GPU hourly price. Every row links to the provider's own published price.

WHAT IS THE H100 SXM

The H100 SXM is the chip the current generation of frontier models was trained on, and the benchmark every other datacenter GPU is priced against. Its Transformer Engine with FP8 roughly doubles effective LLM throughput over Ampere, and 900 GB/s NVLink keeps 8-way and larger clusters coherent. Two generations old now, but still the default answer for serious training.

MAKER
NVIDIA
ARCHITECTURE
Hopper
LAUNCHED
2022
MEMORY
80 GB HBM3
MEMORY BANDWIDTH
3.35 TB/s
TENSOR COMPUTE
989 TFLOPS FP16/BF16 tensor dense (1,979 sparse); 1,979 TFLOPS FP8 dense
POWER DRAW
700 W
INTERCONNECT
NVLink 4.0 900 GB/s

WHAT IT IS GOOD AT

LLM pre-training
The reference chip. FP8 plus 3.35 TB/s plus NVLink is the combination large training runs are sized on.
70B+ fine-tuning
Full fine-tunes of 70B-class models fit comfortably across an 8-GPU node; FP8 cuts the wall-clock further.
High-throughput inference
FP8 serving on H100 remains the industry baseline; NVL and H200 variants stretch context and memory further.

WHO SHOULD NOT RENT THE H100 SXM

Inference of models that fit on one 48 GB card - the premium over L40S buys nothing there.
Tight budgets for fine-tuning: an A100 80GB often delivers the job at half the rate.
ProviderConfigVRAMLocation$/hr$/GPU/hrSource
SpotGPUsSpotGPUsH100 SXM × 180 GBNot published$0.890$0.890STALEreceipt
IO.NETIO.NETH100 SXM × 180 GBNot published$1.190$1.190receipt
Applications.kzApplications.kzH100 (from) × 180 GBKazakhstan$1.490$1.490receipt
CloudRiftCloudRiftH100 × 180 GBNot published$1.700$1.700receipt
Baku ComputeBaku ComputeH100 SXM (from) × 880 GBAzerbaijan (Baku)$14.800$1.850receipt
AIC CloudAIC CloudH100 × 180 GBMumbai$1.918$1.918receipt
UpCloudUpCloudH100 × 180 GBNot published$1.989$1.989STALEreceipt
Voltage ParkVoltage ParkH100 SXM × 180 GBUS$1.990$1.990receipt
NeevCloudNeevCloudH100 × 480 GBIndia$8.203$2.051STALEreceipt
NeevCloudNeevCloudH100 × 180 GBIndia$2.051$2.051STALEreceipt
NeevCloudNeevCloudH100 × 880 GBIndia$16.407$2.051STALEreceipt
NeevCloudNeevCloudH100 × 280 GBIndia$4.102$2.051STALEreceipt
SeewebSeewebH100 × 180 GBItaly$2.100$2.100STALEreceipt
TensorDockTensorDockH100 SXM × 180 GBMultiple regions$2.120$2.120receipt
VultrVultrH100 × 880 GBNot published$18.400$2.300STALEreceipt
VultrVultrH100 (bare metal) × 880 GBNot published$18.400$2.300STALEreceipt
VD
VR Datacentrum
H100 × 480 GBCzechia$9.545$2.386receipt
Denvr DataworksDenvr DataworksH100 SXM × 880 GBCanada$19.600$2.450receipt
VD
VR Datacentrum
H100 × 280 GBCzechia$4.941$2.471receipt
HyperstackHyperstackH100 × 180 GBUS / EU / CA$2.500$2.500receipt
LiumLiumH100 80GB HBM3 × 180 GBNot published$2.500$2.500receipt
KoyebKoyebH100 × 180 GBNot published$2.500$2.500receipt
QuickPodQuickPodH100 SXM × 180 GBNot published$2.500$2.500STALEreceipt
Core42Core42H100 (from) × 180 GBUAE$2.500$2.500receipt
Stratos LabStratos LabH100 × 280 GBSouth Africa$5.110$2.555receipt
Stratos LabStratos LabH100 × 480 GBSouth Africa$10.220$2.555receipt
Stratos LabStratos LabH100 × 880 GBSouth Africa$20.460$2.558receipt
Yotta LabsYotta LabsH100 × 180 GBNot published$2.560$2.560receipt
Stratos LabStratos LabH100 × 180 GBSouth Africa$2.560$2.560receipt
HyperstackHyperstackH100 NVLink × 180 GBUS / EU / CA$2.600$2.600receipt
GMI CloudGMI CloudH100 (from) × 180 GBNot published$2.600$2.600receipt
SpheronSpheronH100 × 180 GBNot published$2.650$2.650receipt
InHostedInHostedH100 × 180 GBIndia$2.654$2.654receipt
RunPodRunPodH100 SXM × 180 GBGlobal$2.690$2.690receipt
AkashAkashH100 × 180 GBGlobal$2.710$2.710STALEreceipt
Massed ComputeMassed ComputeH100 × 180 GBNot published$2.730$2.730receipt
Massed ComputeMassed ComputeH100 × 480 GBNot published$10.920$2.730receipt
Deep InfraDeep InfraH100 × 180 GBNot published$2.900$2.900receipt
Atlas CloudAtlas CloudH100 SXM × 180 GBNot published$2.950$2.950receipt
CivoCivoH100 SXM × 180 GBNot published$2.990$2.990receipt
SynexaSynexaH100 × 180 GBGlobal$2.990$2.990receipt
CivoCivoH100 SXM × 880 GBNot published$23.920$2.990receipt
GcoreGcoreH100 (from) × 180 GBNot published$3.034$3.034receipt
Massed ComputeMassed ComputeH100 SXM5 × 180 GBNot published$3.140$3.140receipt
Massed ComputeMassed ComputeH100 SXM5 × 880 GBNot published$25.120$3.140receipt
HyperbolicHyperbolicH100 SXM (from) × 180 GBNot published$3.190$3.190receipt
HyperstackHyperstackH100 SXM × 180 GBUS / EU / CA$3.200$3.200receipt
Taiga Cloud (Northern Data)Taiga Cloud (Northern Data)H100 (from) × 880 GBEurope$25.600$3.200receipt
TurboscaleTurboscaleH100 × 180 GBNot published$3.240$3.240receipt
Novita AINovita AIH100 SXM × 180 GBNot published$3.390$3.390receipt
CerebriumCerebriumH100 × 180 GBNot published$3.398$3.398receipt
JarvisLabsJarvisLabsH100 SXM × 180 GBIndia$3.490$3.490receipt
CyfutureCyfutureH100 SXM × 180 GBIndia$3.506$3.506STALEreceipt
PPIOPPIOH100 SXM × 180 GBChina$3.554$3.554receipt
OblivusOblivusH100 NVLink × 180 GBNot published$3.640$3.640receipt
ZettabyteZettabyteH100 (from) × 180 GBNot published$3.720$3.720receipt
DaytonaDaytonaH100 × 180 GBNot published$3.950$3.950receipt
RunwareRunwareH100 × 180 GBGlobal$3.950$3.950receipt
E2E NetworksE2E NetworksH100 × 180 GBIndia$4.039$4.039receipt
GPUBrazilGPUBrazilH100 × 180 GBGlobal$4.094$4.094receipt
GPUBrazilGPUBrazilH100 SXM × 180 GBNorth America$4.240$4.240receipt
OblivusOblivusH100 SXM × 180 GBNot published$4.310$4.310receipt
NeysaNeysaH100 SXM (from) × 180 GBIndia$4.390$4.390receipt
DigitalOceanDigitalOceanH100 × 180 GBNot published$4.410$4.410receipt
Lightning AILightning AIH100 × 180 GBUS$4.500$4.500STALEreceipt
Shakti CloudShakti CloudH100 SXM (bare metal) × 8640 GBIndia (Navi Mumbai)$36.483$4.560receipt
DCPDCPH100 (from) × 180 GBSaudi Arabia$4.605$4.605receipt
gpu.aigpu.aiH100 SXM × 180 GBNot published$4.790$4.790receipt
Machine0Machine0H100 × 180 GBNot published$4.851$4.851receipt
Lambda LabsLambda LabsH100 SXM × 180 GBUS$4.890$4.890receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)H100 SXM5 × 280 GBEurope (Finland / Iceland)$10.170$5.085receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)H100 SXM5 × 180 GBEurope (Finland / Iceland)$5.087$5.087receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)H100 SXM5 × 480 GBEurope (Finland / Iceland)$20.350$5.088receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)H100 SXM5 × 880 GBEurope (Finland / Iceland)$40.700$5.088receipt
Hostnot GPUHostnot GPUH100 × 180 GBAsia-Pacific$5.270$5.270receipt
Hostnot GPUHostnot GPUH100 × 180 GBCanada Central$5.270$5.270receipt
Hostnot GPUHostnot GPUH100 × 180 GBEU West$5.270$5.270receipt
Hostnot GPUHostnot GPUH100 × 180 GBUS East$5.270$5.270receipt
GPUBrazilGPUBrazilH100 SXM × 180 GBGlobal$5.287$5.287receipt
ReplicateReplicateH100 × 180 GBGlobal$5.490$5.490receipt
ReplicateReplicateH100 × 280 GBGlobal$10.980$5.490receipt
ReplicateReplicateH100 × 480 GBGlobal$21.960$5.490receipt
ReplicateReplicateH100 × 880 GBGlobal$43.920$5.490receipt
SelectelSelectelH100 × 180 GBRussia$5.508$5.508receipt
CoreWeaveCoreWeaveH100 SXM × 880 GBNorth America / Europe$49.240$6.155receipt
Sakura InternetSakura InternetH100 × 180 GBIshikari, Japan$6.206$6.206receipt
Shakti CloudShakti CloudH100 SXM × 4320 GBIndia (Navi Mumbai)$24.933$6.233receipt
Shakti CloudShakti CloudH100 SXM × 2160 GBIndia (Navi Mumbai)$12.520$6.260receipt
Shakti CloudShakti CloudH100 SXM × 180 GBIndia (Navi Mumbai)$6.351$6.351receipt
BasetenBasetenH100 × 180 GBNot published$6.500$6.500receipt
AWSAWSH100 SXM × 180 GBUS East (N. Virginia)$6.880$6.880receipt
VoltageGPUVoltageGPUH100 × 180 GBNot published$6.950$6.950STALEreceipt
GPUBrazilGPUBrazilH100 SXM × 180 GBEurope$8.788$8.788receipt
Hostnot GPUHostnot GPUH100 × 180 GBEU East$8.820$8.820receipt
Safari CloudSafari CloudH100 × 180 GBAfrica$8.890$8.890receipt
Oracle OCIOracle OCIH100 × 180 GBNot published (global list)$10.000$10.000receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS East$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS West 3$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS East 2$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS West 3$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS East$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS West 3$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS West 2$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS East 2$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS West 2$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS East 2$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS West 2$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96isf_H100_v5] × 880 GBUS East 2$88.488$11.061receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS East$88.488$11.061receipt
Google CloudGoogle CloudH100 SXM × 880 GBIowa (us-central1)$88.490$11.061STALEreceipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS West 3$98.320$12.290receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS East$98.320$12.290receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBUS East 2$98.320$12.290receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS West 2$98.320$12.290receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS East 2$98.320$12.290receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBUS East$98.320$12.290receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS South Central$106.171$13.271receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS South Central$106.171$13.271receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS North Central$106.171$13.271receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS South Central$106.186$13.273receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS North Central$106.186$13.273receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS North Central$106.186$13.273receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS West Central$106.186$13.273receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS Central$108.840$13.605receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS Central$108.840$13.605receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS Central$108.840$13.605receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUK South$110.610$13.826receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS Gov AZ$110.610$13.826receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBPL Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBUS West$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS West$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBES Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBEU West$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBPL Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBEU West$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBSE Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS Southeast$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBSE Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96isf_H100_v5] × 880 GBUS Southeast$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBEU West$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBES Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBSE Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_flex_H100_v5] × 880 GBUS West$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBPL Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_noIB_H100_v5] × 880 GBUS Southeast$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96isf_H100_v5] × 880 GBSE Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96isf_H100_v5] × 880 GBES Central$115.034$14.379receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS South Central$117.968$14.746receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBUS North Central$117.984$14.748receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS West Central$117.984$14.748receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS North Central$117.984$14.748receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBCA Central$117.984$14.748receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBKR Central$119.459$14.932receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS Central$120.934$15.117receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBUS Central$120.934$15.117receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUK South$122.900$15.363receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS Gov AZ$122.900$15.363receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBAE North$126.538$15.817receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBCH North$126.538$15.817receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBSE Central$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBES Central$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBUS West Central$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBPL Central$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBEU West$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBUS West$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBUS Southeast$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBSE Central$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isrf_H100_v5] × 880 GBPL Central$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBES Central$127.816$15.977receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBJA East$128.308$16.038receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBKR Central$132.732$16.591receipt
Microsoft AzureMicrosoft AzureH100 [ND96is_H100_v5] × 880 GBJA West$137.156$17.145receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBCH North$140.598$17.575receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBAE North$140.598$17.575receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBJA East$142.564$17.820receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBAU East$142.600$17.825receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBJA West$152.396$19.049receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBZA North$168.672$21.084receipt
Microsoft AzureMicrosoft AzureH100 [ND96isr_H100_v5] × 880 GBZA West$186.608$23.326receipt

THE H100 SXM MARKET, BY THE NUMBERS

PROVIDERS
67
CONFIGURATIONS
179
MEDIAN $/GPU/HR
$11.06
SPREAD
19.6x

67 providers publish 179 H100 SXM configurations on the panel today. Published per-GPU hourly rates run from $1.190 (IO.NET) to $23.33 (Microsoft Azure), a 20x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $11.06/GPU/hr. 9 rows were reported in stock by the provider at last observation; the rest are published catalog rates. All rates are on-demand - committed-use and reserved pricing is excluded.

CHEAPEST H100 SXM BY GEOGRAPHY
indiaAIC Cloud$1.918/hrunited statesVoltage Park$1.990/hrczechiaVR Datacentrum$2.386/hrcanadaDenvr Dataworks$2.450/hruaeCore42$2.500/hrsouth africaStratos Lab$2.555/hrchinaPPIO$3.554/hrfinlandVerda (formerly DataCrunch)$5.085/hr
H100 SXM PRICE TREND, DAILY PANEL SNAPSHOTS

Across every H100 SXM row on the panel, the daily floor moved from $1.300 to $1.190/GPU/hr over 53 days of tracking (-8.5%). The median continuously-tracked listing moved from $2.73 to $3.03 (+11.1%). Snapshots run daily; the full history is public in the repo.

H100 SXM PROVIDER NOTES
IO.NET · 1 config
Sets the panel floor for this model.
from $1.190/hr
Applications.kz · 1 config · 1 region
Published catalog rates.
from $1.490/hr
CloudRift · 1 config
Published catalog rates.
from $1.700/hr
Baku Compute · 1 config · 1 region
Published catalog rates.
from $1.850/hr
AIC Cloud · 1 config · 1 region
Published catalog rates.
from $1.918/hr
Voltage Park · 1 config · 1 region
Published catalog rates.
from $1.990/hr
TensorDock · 1 config · 1 region
Published catalog rates.
from $2.120/hr
VR Datacentrum · 2 configs · 1 region
Published catalog rates.
from $2.386/hr
BUYING H100 SXM: WHAT THE PANEL SAYS

At the current floor, one H100 SXM running around the clock costs about $869 a month (730 hours of on-demand arithmetic). Node shape matters: the single-GPU floor is $1.190/GPU/hr against $1.850/GPU/hr on an 8-GPU node (+55.5%). Per-GPU floors by config size: 1x $1.19 · 2x $2.47 · 4x $2.39 · 8x $1.85. Compare the alternatives below before committing - the same budget often buys more than one chip class.

H100 SXM VS THE ALTERNATIVES

H100 SXM vs A100 80GB SXM
H100 delivers ~3x the dense FP16 and 6x with FP8, at typically 2-3x the hourly rate. Pre-training pays for the premium; fine-tuning often does not.
H100 SXM vs H200 SXM
Same compute, 76% more memory (141 GB) and 43% more bandwidth. For inference of large or long-context models the H200 is strictly better; for training, whichever is cheaper per hour on the panel.
H100 SXM vs B200
Blackwell roughly doubles dense FP16 and adds FP4, with 192 GB at 8 TB/s. Scarce and priced accordingly - the H100 remains the value pick for most training.

Compare live rates: H100 SXM vs A100 80GB SXM · H100 SXM vs A100 80GB · H100 SXM vs A100 · H100 SXM vs H200 SXM · H100 SXM vs B200 · H100 SXM vs H100 PCIe · H100 SXM vs MI300X · H100 SXM vs GH200 · H100 SXM vs A100 40GB SXM · H100 SXM vs GB300 · H100 SXM vs H20 · H100 SXM vs H800 · H100 SXM vs L40S

H100 SXM PRICING FAQ

What is the cheapest H100 SXM cloud GPU right now?
The cheapest published H100 SXM rate on the panel is $1.190 per GPU-hour at IO.NET (H100 SXM x 1, Not published). Every price links to the provider's own published rate.
How much does a H100 SXM cost per hour?
Across 67 providers tracked today, published per-GPU hourly rates for H100 SXM run from $1.19 to $23.33, with a median of $11.06. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent H100 SXM GPUs?
67 providers publish 179 distinct H100 SXM configurations on Compute Cafe. 9 of those rows were reported in stock by the provider's live endpoint at last observation.
Where is H100 SXM cheapest?
By published per-GPU hourly rate, the cheapest geography for H100 SXM today is india at $1.92/hr (AIC Cloud). The spread across 17 tracked geographies runs to $17.82/hr in australia.
Are H100 SXM prices going up or down?
Over the 53 days Compute Cafe has tracked the panel, the H100 SXM floor is falling: $1.300 to $1.190/GPU/hr (-8.5%). The median continuously-tracked listing moved from $2.73 to $3.03 (+11.1%). Daily snapshots are public in the repo, so the trend is auditable.
What does a H100 SXM cost per month?
At the current floor of $1.190/GPU/hr, a H100 SXM running 24/7 costs about $869 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
Is a full 8-GPU H100 SXM node cheaper than a single card?
On today's panel: the single-GPU floor is $1.190/GPU/hr and the 8-GPU node floor is $1.850/GPU/hr - more expensive per GPU on a full node (+55.5%). Check the table for the exact configs behind each floor.
Is the H100 still worth it with B200 out?
Usually yes. Blackwell's per-hour premium is larger than its throughput edge for many jobs, and H100 capacity is far easier to find. The panel's spread between the two is the number to watch.
How many H100s to train a 70B model?
Full fine-tuning runs on a single 8-GPU node (640 GB aggregate HBM). Pre-training from scratch is a cluster job - hundreds to thousands of GPUs depending on the data budget.
H100 SXM vs PCIe vs NVL?
SXM is the training form: 700 W, full clocks, 900 GB/s NVLink. PCIe halves power and compute for standard servers. NVL is a 94 GB PCIe pair aimed at inference. The panel tracks all three separately.

See also alternatives to the H100 SXM · cheapest GPU-hour per model · inference chips · training chips · by location