GPU MODELS / GH200

GH200 cloud GPU pricing

8 listings across 7 providers. Cheapest published rate: $2.590/GPU/hr at Lambda Labs. Sorted by per-GPU hourly price. Every row links to the provider's own published price.

WHAT IS THE GH200

The GH200 couples an H100-class GPU with a 72-core Grace ARM CPU over a 900 GB/s coherent link, exposing the CPU's large LPDDR memory to the GPU. It is built for workloads that need giant coherent memory - huge embedding tables, data prep plus training on one node - rather than raw multi-GPU scale.

MAKER
NVIDIA
ARCHITECTURE
Grace Hopper
LAUNCHED
2023
MEMORY
96-141 GB HBM3/HBM3e + up to 480 GB LPDDR5X (Grace CPU)
MEMORY BANDWIDTH
4.0-4.9 TB/s (HBM)
TENSOR COMPUTE
H100-class tensor throughput (989 TFLOPS FP16 dense)
POWER DRAW
up to 1,000 W (module)
INTERCONNECT
NVLink-C2C 900 GB/s CPU-GPU

WHAT IT IS GOOD AT

Giant-memory inference
GPU + 480 GB CPU memory coherent at 900 GB/s.
HPC + AI hybrids
Its design target at supercomputing sites.

WHO SHOULD NOT RENT THE GH200

Standard training or serving - a plain H100 node does it cheaper.
x86-locked software stacks - Grace is ARM.
ProviderConfigVRAMLocation$/hr$/GPU/hrSource
SpotGPUsSpotGPUsGH200 × 196 GBNot published$0.790$0.790STALEreceipt
VultrVultrGH200 × 196 GBNot published$1.990$1.990STALEreceipt
VultrVultrGH200 (bare metal) × 196 GBNot published$1.990$1.990STALEreceipt
Lambda LabsLambda LabsGH200 × 196 GBUS$2.590$2.590receipt
SpheronSpheronGH200 × 196 GBNot published$2.750$2.750receipt
HydraHostHydraHostGH200 × 196 GBNot published$2.750$2.750receipt
Denvr DataworksDenvr DataworksGH200 × 196 GBCanada$3.870$3.870receipt
CoreWeaveCoreWeaveGH200 × 196 GBNorth America / Europe$6.500$6.500receipt

THE GH200 MARKET, BY THE NUMBERS

PROVIDERS
7
CONFIGURATIONS
8
MEDIAN $/GPU/HR
$2.75
SPREAD
2.5x

7 providers publish 8 GH200 configurations on the panel today. Published per-GPU hourly rates run from $2.590 (Lambda Labs) to $6.50 (CoreWeave), a 3x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $2.75/GPU/hr. Rows are published catalog rates; stock flags appear per row where the provider reports them. All rates are on-demand - committed-use and reserved pricing is excluded.

CHEAPEST GH200 BY GEOGRAPHY
united statesLambda Labs$2.590/hrcanadaDenvr Dataworks$3.870/hr
GH200 PRICE TREND, DAILY PANEL SNAPSHOTS

Across every GH200 row on the panel, the daily floor moved from $2.290 to $2.590/GPU/hr over 53 days of tracking (+13.1%). Snapshots run daily; the full history is public in the repo.

GH200 PROVIDER NOTES
Lambda Labs · 1 config · 1 region
Sets the panel floor for this model.
from $2.590/hr
Spheron · 1 config
Within 15% of the panel floor.
from $2.750/hr
HydraHost · 1 config
Within 15% of the panel floor.
from $2.750/hr
Denvr Dataworks · 1 config · 1 region
Published catalog rates.
from $3.870/hr
CoreWeave · 1 config · 1 region
Published catalog rates.
from $6.500/hr
BUYING GH200: WHAT THE PANEL SAYS

At the current floor, one GH200 running around the clock costs about $1,891 a month (730 hours of on-demand arithmetic). Compare the alternatives below before committing - the same budget often buys more than one chip class.

GH200 VS THE ALTERNATIVES

GH200 vs H100 SXM
Same GPU compute; GH200 adds the Grace CPU and coherent memory fabric. Standard training and serving are cheaper on plain H100; memory-giant workloads need the GH200.

Compare live rates: GH200 vs H100 SXM

GH200 PRICING FAQ

What is the cheapest GH200 cloud GPU right now?
The cheapest published GH200 rate on the panel is $2.590 per GPU-hour at Lambda Labs (GH200 x 1, US). Every price links to the provider's own published rate.
How much does a GH200 cost per hour?
Across 7 providers tracked today, published per-GPU hourly rates for GH200 run from $2.59 to $6.50, with a median of $2.75. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent GH200 GPUs?
7 providers publish 8 distinct GH200 configurations on Compute Cafe. The panel shows published rates; stock flags appear per row where the provider reports them.
Where is GH200 cheapest?
By published per-GPU hourly rate, the cheapest geography for GH200 today is united states at $2.59/hr (Lambda Labs). The spread across 2 tracked geographies runs to $3.87/hr in canada.
Are GH200 prices going up or down?
Over the 53 days Compute Cafe has tracked the panel, the GH200 floor is rising: $2.290 to $2.590/GPU/hr (+13.1%). Daily snapshots are public in the repo, so the trend is auditable.
What does a GH200 cost per month?
At the current floor of $2.590/GPU/hr, a GH200 running 24/7 costs about $1,891 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
What is the GH200 for?
Workloads where the model or data does not fit in GPU HBM alone: the Grace CPU's memory is directly addressable by the GPU at 900 GB/s. If that sentence does not describe your job, a standard H100 node is the better rental.

See also alternatives to the GH200 · cheapest GPU-hour per model · inference chips · training chips · by location