GPU MODELS / A100 SXM

A100 SXM cloud GPU pricing

23 listings across 13 providers. Cheapest published rate: $1.050/GPU/hr at CloudRift. Sorted by per-GPU hourly price. Every row links to the provider's own published price.

WHAT IS THE A100 SXM

The original 40 GB A100 SXM: same tensor throughput as the 80 GB part, roughly 1.6 TB/s of HBM2 bandwidth, half the memory. For training jobs that fit, it is usually the cheapest way onto NVLink-equipped Ampere nodes; for 70B-class work the 80 GB variant is the one you want.

MAKER
NVIDIA
ARCHITECTURE
Ampere
LAUNCHED
2020
MEMORY
40 GB HBM2 (80 GB variant separate)
MEMORY BANDWIDTH
1.6 TB/s
TENSOR COMPUTE
312 TFLOPS FP16/BF16 tensor dense (624 sparse)
POWER DRAW
400 W
INTERCONNECT
NVLink 3.0 600 GB/s

WHAT IT IS GOOD AT

Mid-size model training
7B-13B full fine-tunes fit well in 40 GB with NVLink for scale-out.
Multi-GPU nodes
8-way SXM nodes with 600 GB/s NVLink - the classic DGX A100 shape.

WHO SHOULD NOT RENT THE A100 SXM

70B-class fine-tuning or inference - 40 GB forces model parallelism for what the 80 GB part does on one card.
Single-card inference where GDDR6 cards are cheaper per token.
ProviderConfigVRAMLocation$/hr$/GPU/hrSource
CloudRiftCloudRiftA100 SXM4 × 180 GBNot published$1.050$1.050receipt
Baku ComputeBaku ComputeA100 SXM (from) × 880 GBAzerbaijan (Baku)$8.800$1.100receipt
Denvr DataworksDenvr DataworksA100 SXM × 840 GBCanada$9.200$1.150receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 140 GBEurope (Finland / Iceland)$1.282$1.282receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 840 GBEurope (Finland / Iceland)$10.260$1.282receipt
BeamBeamA100 SXM (from) × 180 GBNot published$1.360$1.360receipt
Massed ComputeMassed ComputeA100 SXM4 × 180 GBNot published$1.380$1.380receipt
Massed ComputeMassed ComputeA100 SXM4 × 880 GBNot published$11.040$1.380receipt
RunPodRunPodA100 SXM × 180 GBGlobal$1.390$1.390receipt
HyperstackHyperstackA100 NVLink × 180 GBUS / EU / CA$1.400$1.400receipt
Denvr DataworksDenvr DataworksA100 SXM × 880 GBCanada$11.600$1.450receipt
VultrVultrA100 SXM (bare metal) × 880 GBNot published$11.920$1.490receipt
HyperstackHyperstackA100 SXM × 180 GBUS / EU / CA$1.600$1.600receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 180 GBEurope (Finland / Iceland)$1.797$1.797receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 280 GBEurope (Finland / Iceland)$3.594$1.797receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 480 GBEurope (Finland / Iceland)$7.188$1.797receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 880 GBEurope (Finland / Iceland)$14.380$1.798receipt
Lambda LabsLambda LabsA100 SXM × 140 GBUS$1.990$1.990receipt
KoyebKoyebA100 SXM × 180 GBNot published$2.150$2.150receipt
CrusoeCrusoeA100 SXM × 180 GBUS / Iceland$2.300$2.300receipt
CoreWeaveCoreWeaveA100 SXM × 880 GBNorth America / Europe$21.600$2.700receipt
Lambda LabsLambda LabsA100 SXM × 880 GBUS$22.320$2.790receipt
VultrVultrA100 SXM × 880 GBNot published$22.400$2.800receipt

THE A100 SXM MARKET, BY THE NUMBERS

PROVIDERS
13
CONFIGURATIONS
23
MEDIAN $/GPU/HR
$1.49
SPREAD
2.7x

13 providers publish 23 A100 SXM configurations on the panel today. Published per-GPU hourly rates run from $1.050 (CloudRift) to $2.80 (Vultr), a 3x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $1.49/GPU/hr. 4 rows were reported in stock by the provider at last observation; the rest are published catalog rates. All rates are on-demand - committed-use and reserved pricing is excluded.

CHEAPEST A100 SXM BY GEOGRAPHY
canadaDenvr Dataworks$1.150/hrfinlandVerda (formerly DataCrunch)$1.282/hricelandVerda (formerly DataCrunch)$1.282/hrunited statesHyperstack$1.400/hr
A100 SXM PRICE TREND, DAILY PANEL SNAPSHOTS

Across every A100 SXM row on the panel, the daily floor moved from $1.150 to $1.050/GPU/hr over 11 days of tracking (-8.7%). The median continuously-tracked listing held flat at $1.60. Snapshots run daily; the full history is public in the repo.

A100 SXM PROVIDER NOTES
CloudRift · 1 config
Sets the panel floor for this model.
from $1.050/hr
Baku Compute · 1 config · 1 region
Within 15% of the panel floor.
from $1.100/hr
Denvr Dataworks · 2 configs · 1 region
Within 15% of the panel floor.
from $1.150/hr
Verda (formerly DataCrunch) · 6 configs · 1 region
Published catalog rates.
from $1.282/hr
Beam · 1 config
Published catalog rates.
from $1.360/hr
Massed Compute · 2 configs
Published catalog rates.
from $1.380/hr
RunPod · 1 config · 1 region · 1 in stock
1 of 1 configs reported in stock at last check.
from $1.390/hr
Hyperstack · 2 configs · 1 region
Published catalog rates.
from $1.400/hr
BUYING A100 SXM: WHAT THE PANEL SAYS

At the current floor, one A100 SXM running around the clock costs about $767 a month (730 hours of on-demand arithmetic). Node shape matters: the single-GPU floor is $1.050/GPU/hr against $1.100/GPU/hr on an 8-GPU node (+4.8%). Per-GPU floors by config size: 1x $1.05 · 2x $1.80 · 4x $1.80 · 8x $1.10. Compare the alternatives below before committing - the same budget often buys more than one chip class.

A100 SXM VS THE ALTERNATIVES

A100 SXM vs A100 80GB SXM
Same silicon, double the memory and 25% more bandwidth. If your job fits in 40 GB, the cheaper 40 GB card is the same speed; if it does not, no amount of savings helps.

Compare live rates: A100 SXM vs A100 80GB SXM

A100 SXM PRICING FAQ

What is the cheapest A100 SXM cloud GPU right now?
The cheapest published A100 SXM rate on the panel is $1.050 per GPU-hour at CloudRift (A100 SXM4 x 1, Not published). Every price links to the provider's own published rate.
How much does a A100 SXM cost per hour?
Across 13 providers tracked today, published per-GPU hourly rates for A100 SXM run from $1.05 to $2.80, with a median of $1.49. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent A100 SXM GPUs?
13 providers publish 23 distinct A100 SXM configurations on Compute Cafe. 4 of those rows were reported in stock by the provider's live endpoint at last observation.
Where is A100 SXM cheapest?
By published per-GPU hourly rate, the cheapest geography for A100 SXM today is canada at $1.15/hr (Denvr Dataworks). The spread across 4 tracked geographies runs to $1.40/hr in united states.
Are A100 SXM prices going up or down?
Over the 11 days Compute Cafe has tracked the panel, the A100 SXM floor is falling: $1.150 to $1.050/GPU/hr (-8.7%). The median continuously-tracked listing moved from $1.60 to $1.60 (+0.0%). Daily snapshots are public in the repo, so the trend is auditable.
What does a A100 SXM cost per month?
At the current floor of $1.050/GPU/hr, a A100 SXM running 24/7 costs about $767 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
Is a full 8-GPU A100 SXM node cheaper than a single card?
On today's panel: the single-GPU floor is $1.050/GPU/hr and the 8-GPU node floor is $1.100/GPU/hr - more expensive per GPU on a full node (+4.8%). Check the table for the exact configs behind each floor.
40 GB or 80 GB A100?
Models up to roughly 13B fine-tune comfortably in 40 GB; 30B and 70B-class work needs the 80 GB part. The price gap on the panel is often smaller than the capability gap, so check both.

See also alternatives to the A100 SXM · cheapest GPU-hour per model · inference chips · training chips · by location