GPU MODELS / A100 SXM

A100 SXM cloud GPU pricing

20 listings across 11 providers. Cheapest published rate: $1.100/GPU/hr at Baku Compute. Sorted by per-GPU hourly price. Every row links to the provider's own published price.

WHAT IS THE A100 SXM

The original 40 GB A100 SXM: same tensor throughput as the 80 GB part, roughly 1.6 TB/s of HBM2 bandwidth, half the memory. For training jobs that fit, it is usually the cheapest way onto NVLink-equipped Ampere nodes; for 70B-class work the 80 GB variant is the one you want.

MAKER
NVIDIA
ARCHITECTURE
Ampere
LAUNCHED
2020
MEMORY
40 GB HBM2 (80 GB variant separate)
MEMORY BANDWIDTH
1.6 TB/s
TENSOR COMPUTE
312 TFLOPS FP16/BF16 tensor dense (624 sparse)
POWER DRAW
400 W
INTERCONNECT
NVLink 3.0 600 GB/s

WHAT IT IS GOOD AT

Mid-size model training
7B-13B full fine-tunes fit well in 40 GB with NVLink for scale-out.
Multi-GPU nodes
8-way SXM nodes with 600 GB/s NVLink - the classic DGX A100 shape.

WHO SHOULD NOT RENT THE A100 SXM

70B-class fine-tuning or inference - 40 GB forces model parallelism for what the 80 GB part does on one card.
Single-card inference where GDDR6 cards are cheaper per token.
ProviderConfigVRAMLocation$/hr$/GPU/hrSource
Baku ComputeBaku ComputeA100 SXM (from) × 880 GBAzerbaijan (Baku)$8.800$1.100receipt
Denvr DataworksDenvr DataworksA100 SXM × 840 GBCanada$9.200$1.150receipt
BeamBeamA100 SXM (from) × 180 GBNot published$1.360$1.360receipt
Massed ComputeMassed ComputeA100 SXM4 × 180 GBNot published$1.380$1.380receipt
Massed ComputeMassed ComputeA100 SXM4 × 880 GBNot published$11.040$1.380receipt
RunPodRunPodA100 SXM × 180 GBGlobal$1.390$1.390receipt
HyperstackHyperstackA100 NVLink × 180 GBUS / EU / CA$1.400$1.400receipt
Denvr DataworksDenvr DataworksA100 SXM × 880 GBCanada$11.600$1.450receipt
VultrVultrA100 SXM (bare metal) × 880 GBNot published$11.920$1.490STALEreceipt
HyperstackHyperstackA100 SXM × 180 GBUS / EU / CA$1.600$1.600receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 840 GBEurope (Finland / Iceland)$13.390$1.674receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 140 GBEurope (Finland / Iceland)$1.674$1.674receipt
Lambda LabsLambda LabsA100 SXM × 140 GBUS$1.990$1.990receipt
KoyebKoyebA100 SXM × 180 GBNot published$2.150$2.150receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 880 GBEurope (Finland / Iceland)$18.710$2.339receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 180 GBEurope (Finland / Iceland)$2.339$2.339receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 280 GBEurope (Finland / Iceland)$4.678$2.339receipt
Verda (formerly DataCrunch)Verda (formerly DataCrunch)A100 SXM4 × 480 GBEurope (Finland / Iceland)$9.356$2.339receipt
CoreWeaveCoreWeaveA100 SXM × 880 GBNorth America / Europe$21.600$2.700receipt
VultrVultrA100 SXM × 880 GBNot published$22.400$2.800STALEreceipt

THE A100 SXM MARKET, BY THE NUMBERS

PROVIDERS
11
CONFIGURATIONS
20
MEDIAN $/GPU/HR
$1.67
SPREAD
2.5x

11 providers publish 20 A100 SXM configurations on the panel today. Published per-GPU hourly rates run from $1.100 (Baku Compute) to $2.70 (CoreWeave), a 2x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $1.67/GPU/hr. 1 rows were reported in stock by the provider at last observation; the rest are published catalog rates. All rates are on-demand - committed-use and reserved pricing is excluded.

CHEAPEST A100 SXM BY GEOGRAPHY
canadaDenvr Dataworks$1.150/hrunited statesHyperstack$1.400/hrfinlandVerda (formerly DataCrunch)$1.674/hricelandVerda (formerly DataCrunch)$1.674/hr
A100 SXM PRICE TREND, DAILY PANEL SNAPSHOTS

Across every A100 SXM row on the panel, the daily floor moved from $1.150 to $1.100/GPU/hr over 53 days of tracking (-4.3%). The median continuously-tracked listing moved from $1.45 to $1.67 (+15.4%). Snapshots run daily; the full history is public in the repo.

A100 SXM PROVIDER NOTES
Baku Compute · 1 config · 1 region
Sets the panel floor for this model.
from $1.100/hr
Denvr Dataworks · 2 configs · 1 region
Within 15% of the panel floor.
from $1.150/hr
Beam · 1 config
Published catalog rates.
from $1.360/hr
Massed Compute · 2 configs
Published catalog rates.
from $1.380/hr
RunPod · 1 config · 1 region · 1 in stock
1 of 1 configs reported in stock at last check.
from $1.390/hr
Hyperstack · 2 configs · 1 region
Published catalog rates.
from $1.400/hr
Verda (formerly DataCrunch) · 6 configs · 1 region
Published catalog rates.
from $1.674/hr
Lambda Labs · 1 config · 1 region
Published catalog rates.
from $1.990/hr
BUYING A100 SXM: WHAT THE PANEL SAYS

At the current floor, one A100 SXM running around the clock costs about $803 a month (730 hours of on-demand arithmetic). Node shape matters: the single-GPU floor is $1.360/GPU/hr against $1.100/GPU/hr on an 8-GPU node (-19.1%). Per-GPU floors by config size: 1x $1.36 · 2x $2.34 · 4x $2.34 · 8x $1.10. Compare the alternatives below before committing - the same budget often buys more than one chip class.

A100 SXM VS THE ALTERNATIVES

A100 SXM vs A100 80GB SXM
Same silicon, double the memory and 25% more bandwidth. If your job fits in 40 GB, the cheaper 40 GB card is the same speed; if it does not, no amount of savings helps.

Compare live rates: A100 SXM vs A100 80GB SXM

A100 SXM PRICING FAQ

What is the cheapest A100 SXM cloud GPU right now?
The cheapest published A100 SXM rate on the panel is $1.100 per GPU-hour at Baku Compute (A100 SXM (from) x 8, Azerbaijan (Baku)). Every price links to the provider's own published rate.
How much does a A100 SXM cost per hour?
Across 11 providers tracked today, published per-GPU hourly rates for A100 SXM run from $1.10 to $2.70, with a median of $1.67. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent A100 SXM GPUs?
11 providers publish 20 distinct A100 SXM configurations on Compute Cafe. 1 of those rows were reported in stock by the provider's live endpoint at last observation.
Where is A100 SXM cheapest?
By published per-GPU hourly rate, the cheapest geography for A100 SXM today is canada at $1.15/hr (Denvr Dataworks). The spread across 4 tracked geographies runs to $1.67/hr in iceland.
Are A100 SXM prices going up or down?
Over the 53 days Compute Cafe has tracked the panel, the A100 SXM floor is falling: $1.150 to $1.100/GPU/hr (-4.3%). The median continuously-tracked listing moved from $1.45 to $1.67 (+15.4%). Daily snapshots are public in the repo, so the trend is auditable.
What does a A100 SXM cost per month?
At the current floor of $1.100/GPU/hr, a A100 SXM running 24/7 costs about $803 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
Is a full 8-GPU A100 SXM node cheaper than a single card?
On today's panel: the single-GPU floor is $1.360/GPU/hr and the 8-GPU node floor is $1.100/GPU/hr - cheaper per GPU on a full node (-19.1%). Check the table for the exact configs behind each floor.
40 GB or 80 GB A100?
Models up to roughly 13B fine-tune comfortably in 40 GB; 30B and 70B-class work needs the 80 GB part. The price gap on the panel is often smaller than the capability gap, so check both.

See also alternatives to the A100 SXM · cheapest GPU-hour per model · inference chips · training chips · by location