GPU MODELS / A100 40GB

A100 40GB cloud GPU pricing

30 listings across 20 providers. Cheapest published rate: $0.170/GPU/hr at SpotGPUs. Sorted by per-GPU hourly price. Every row links to the provider's own published price.

WHAT IS THE A100 40GB

The launch-spec A100: full Ampere tensor throughput with 40 GB of HBM2. It trains and serves anything that fits, and rents for meaningfully less than the 80 GB variant on most of the panel.

MAKER
NVIDIA
ARCHITECTURE
Ampere
LAUNCHED
2020
MEMORY
40 GB HBM2
MEMORY BANDWIDTH
1.6 TB/s
TENSOR COMPUTE
312 TFLOPS FP16/BF16 tensor dense (624 sparse)
POWER DRAW
250-400 W by form factor
INTERCONNECT
NVLink (SXM) or PCIe 4.0

WHAT IT IS GOOD AT

7B-13B training
Full fine-tunes fit in 40 GB.
Mid-size inference
Serves up to ~34B quantized per card.

WHO SHOULD NOT RENT THE A100 40GB

Anything 30B+ - 40 GB is the hard wall.
Buyers who can use the 80 GB variant at a small premium - the headroom is worth more than the saving.
ProviderConfigVRAMLocation$/hr$/GPU/hrSource
SpotGPUsSpotGPUsA100 40GB × 140 GBNot published$0.170$0.170receipt
CloudGPUCloudGPUA100 40GB × 140 GBNot published$0.630$0.630receipt
centroncentronA100 40GB × 140 GBGermany$0.774$0.774receipt
JarvisLabsJarvisLabsA100 40GB × 140 GBIndia$0.890$0.890receipt
gpu.aigpu.aiA100 40GB × 140 GBNot published$0.890$0.890receipt
Hostnot GPUHostnot GPUA100 40GB × 140 GBIndia South$0.980$0.980receipt
ParateraParateraA100 40GB × 140 GBChina$1.010$1.010receipt
CivoCivoA100 40GB × 140 GBNot published$1.090$1.090receipt
CivoCivoA100 40GB × 240 GBNot published$2.180$1.090receipt
CivoCivoA100 40GB × 440 GBNot published$4.360$1.090receipt
CivoCivoA100 40GB × 840 GBNot published$8.720$1.090receipt
Stratos LabStratos LabA100 40GB × 140 GBSouth Africa$1.120$1.120receipt
Stratos LabStratos LabA100 40GB × 240 GBSouth Africa$2.240$1.120receipt
Stratos LabStratos LabA100 40GB × 440 GBSouth Africa$4.480$1.120receipt
Stratos LabStratos LabA100 40GB × 840 GBSouth Africa$8.960$1.120receipt
GPUBrazilGPUBrazilA100 40GB × 140 GBEurope$1.193$1.193receipt
GPUBrazilGPUBrazilA100 40GB × 139 GBNorth America$1.193$1.193receipt
GPUBrazilGPUBrazilA100 40GB × 140 GBAsia-Pacific$1.193$1.193receipt
GPUBrazilGPUBrazilA100 40GB × 140 GBGlobal$1.325$1.325receipt
InHostedInHostedA100 (40GB) × 140 GBIndia$1.773$1.773receipt
E2E NetworksE2E NetworksA100 40GB × 140 GBIndia$1.867$1.867receipt
CerebriumCerebriumA100 40GB × 140 GBNot published$1.998$1.998receipt
ModalModalA100 40GB × 140 GBNot published$2.099$2.099receipt
Lightning AILightning AIA100 40GB × 140 GBUS$2.190$2.190receipt
AWSAWSA100 40GB × 840 GBUS East (N. Virginia)$21.958$2.745receipt
CTYunCTYunA100 40GB × 140 GBChina$3.165$3.165receipt
Safari CloudSafari CloudA100 40GB × 140 GBAfrica$3.387$3.387receipt
Google CloudGoogle CloudA100 40GB × 1640 GBIowa (us-central1)$55.739$3.484receipt
Google CloudGoogle CloudA100 40GB × 140 GBIowa (us-central1)$3.673$3.673receipt
Alibaba CloudAlibaba CloudA100 40GB × 840 GBChina (Beijing)$39.107$4.888receipt

THE A100 40GB MARKET, BY THE NUMBERS

PROVIDERS
20
CONFIGURATIONS
30
MEDIAN $/GPU/HR
$1.19
SPREAD
28.8x

20 providers publish 30 A100 40GB configurations on the panel today. Published per-GPU hourly rates run from $0.170 (SpotGPUs) to $4.89 (Alibaba Cloud), a 29x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $1.19/GPU/hr. 14 rows were reported in stock by the provider at last observation; the rest are published catalog rates. All rates are on-demand - committed-use and reserved pricing is excluded.

CHEAPEST A100 40GB BY GEOGRAPHY
germanycentron$0.774/hrindiaJarvisLabs$0.890/hrchinaParatera$1.010/hrsouth africaStratos Lab$1.120/hrunited statesGPUBrazil$1.193/hr
A100 40GB PRICE TREND, DAILY PANEL SNAPSHOTS

Across every A100 40GB row on the panel, the daily floor moved from $0.890 to $0.170/GPU/hr over 11 days of tracking (-80.9%). The median continuously-tracked listing held flat at $1.09. Snapshots run daily; the full history is public in the repo.

A100 40GB PROVIDER NOTES
SpotGPUs · 1 config · 1 in stock
Sets the panel floor for this model.
from $0.170/hr
CloudGPU · 1 config · 1 in stock
1 of 1 configs reported in stock at last check.
from $0.630/hr
centron · 1 config · 1 region
Published catalog rates.
from $0.774/hr
JarvisLabs · 1 config · 1 region
Published catalog rates.
from $0.890/hr
gpu.ai · 1 config · 1 in stock
1 of 1 configs reported in stock at last check.
from $0.890/hr
Hostnot GPU · 1 config · 1 region · 1 in stock
1 of 1 configs reported in stock at last check.
from $0.980/hr
Paratera · 1 config · 1 region
Published catalog rates.
from $1.010/hr
Civo · 4 configs
Published catalog rates.
from $1.090/hr
BUYING A100 40GB: WHAT THE PANEL SAYS

At the current floor, one A100 40GB running around the clock costs about $124 a month (730 hours of on-demand arithmetic). Node shape matters: the single-GPU floor is $0.170/GPU/hr against $3.484/GPU/hr on an 8-GPU node (+1949.2%). Per-GPU floors by config size: 1x $0.17 · 2x $1.09 · 4x $1.09 · 8x $1.09 · 16x $3.48. Compare the alternatives below before committing - the same budget often buys more than one chip class.

A100 40GB VS THE ALTERNATIVES

A100 40GB vs A100 80GB
Double the memory for 70B-class work. If you fit in 40 GB, take the cheaper card.

Compare live rates: A100 40GB vs A100 80GB

A100 40GB PRICING FAQ

What is the cheapest A100 40GB cloud GPU right now?
The cheapest published A100 40GB rate on the panel is $0.170 per GPU-hour at SpotGPUs (A100 40GB x 1, Not published). Every price links to the provider's own published rate.
How much does a A100 40GB cost per hour?
Across 20 providers tracked today, published per-GPU hourly rates for A100 40GB run from $0.17 to $4.89, with a median of $1.19. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent A100 40GB GPUs?
20 providers publish 30 distinct A100 40GB configurations on Compute Cafe. 14 of those rows were reported in stock by the provider's live endpoint at last observation.
Where is A100 40GB cheapest?
By published per-GPU hourly rate, the cheapest geography for A100 40GB today is germany at $0.77/hr (centron). The spread across 5 tracked geographies runs to $1.19/hr in united states.
Are A100 40GB prices going up or down?
Over the 11 days Compute Cafe has tracked the panel, the A100 40GB floor is falling: $0.890 to $0.170/GPU/hr (-80.9%). The median continuously-tracked listing moved from $1.09 to $1.09 (+0.0%). Daily snapshots are public in the repo, so the trend is auditable.
What does a A100 40GB cost per month?
At the current floor of $0.170/GPU/hr, a A100 40GB running 24/7 costs about $124 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
Is a full 8-GPU A100 40GB node cheaper than a single card?
On today's panel: the single-GPU floor is $0.170/GPU/hr and the 8-GPU node floor is $3.484/GPU/hr - more expensive per GPU on a full node (+1949.2%). Check the table for the exact configs behind each floor.
Is 40 GB enough for fine-tuning?
For models up to about 13B with standard optimizers, yes. QLoRA stretches it further. 70B-class models need the 80 GB A100 or newer.

See also alternatives to the A100 40GB · cheapest GPU-hour per model · inference chips · training chips · by location