GPU MODELS / A40

A40 cloud GPU pricing

24 listings across 14 providers. Cheapest published rate: $0.330/GPU/hr at AI Galaxy. Sorted by per-GPU hourly price. Every row links to the provider's own published price.

WHAT IS THE A40

The A40 is Ampere's big-memory visualization card: 48 GB of GDDR6, RT cores, and vGPU support. Predating the L40/L40S, it still serves and renders competently, and often rents at a discount that makes it interesting for 13B-34B inference.

MAKER
NVIDIA
ARCHITECTURE
Ampere
LAUNCHED
2020
MEMORY
48 GB GDDR6
MEMORY BANDWIDTH
696 GB/s
TENSOR COMPUTE
150 TFLOPS FP16 tensor dense (300 sparse)
POWER DRAW
300 W
INTERCONNECT
PCIe 4.0 x16 (NVLink bridge on pairs)

WHAT IT IS GOOD AT

Mid-size inference
48 GB serves 34B quantized.
Rendering and VDI
Its design role.

WHO SHOULD NOT RENT THE A40

AI serving where the L40S rents close on price - 2.4x tensor throughput gap.
Memory-bandwidth-bound LLM decoding - GDDR6 caps it.
ProviderConfigVRAMLocation$/hr$/GPU/hrSource
SpotGPUsSpotGPUsA40 × 148 GBNot published$0.090$0.090STALEreceipt
AI GalaxyAI GalaxyA40 × 148 GBChina$0.330$0.330receipt
RunPodRunPodA40 × 148 GBGlobal$0.350$0.350receipt
MatPoolMatPoolA40 × 147.5 GBChina$0.426$0.426receipt
AutoDLAutoDLA40 × 148 GBChina$0.470$0.470receipt
gpu.aigpu.aiA40 × 148 GBNot published$0.580$0.580receipt
Hostnot GPUHostnot GPUA40 × 148 GBUS East$0.640$0.640receipt
Denvr DataworksDenvr DataworksA40 × 448 GBCanada$2.600$0.650receipt
GPUBrazilGPUBrazilA40 × 145 GBNorth America$0.703$0.703receipt
GPUBrazilGPUBrazilA40 × 148 GBGlobal$0.782$0.782receipt
Hostnot GPUHostnot GPUA40 × 148 GBCanada Central$0.790$0.790receipt
Hostnot GPUHostnot GPUA40 × 148 GBEU West$0.790$0.790receipt
Hostnot GPUHostnot GPUA40 × 248 GBEU West$1.730$0.865receipt
Hostnot GPUHostnot GPUA40 × 148 GBEU West$0.870$0.870receipt
GPUBrazilGPUBrazilA40 × 145 GBEurope$0.884$0.884receipt
InHostedInHostedA40 × 148 GBIndia$1.022$1.022receipt
E2E NetworksE2E NetworksA40 × 148 GBIndia$1.023$1.023receipt
ExoscaleExoscaleA40 × 148 GBEU$1.045$1.045receipt
ExoscaleExoscaleA40 × 448 GBEU$4.181$1.045receipt
ExoscaleExoscaleA40 × 848 GBEU$8.363$1.045receipt
ExoscaleExoscaleA40 × 248 GBEU$2.091$1.045receipt
ACCACCA40 × 148 GBSingapore$1.220$1.220receipt
VultrVultrA40 × 148 GBNot published$1.712$1.712STALEreceipt
Hostnot GPUHostnot GPUA40 × 148 GBUS West$2.260$2.260receipt

THE A40 MARKET, BY THE NUMBERS

PROVIDERS
14
CONFIGURATIONS
24
MEDIAN $/GPU/HR
$0.86
SPREAD
6.9x

14 providers publish 24 A40 configurations on the panel today. Published per-GPU hourly rates run from $0.330 (AI Galaxy) to $2.26 (Hostnot GPU), a 7x spread between the cheapest and the most expensive published rate for the same chip. The median listing sits at $0.86/GPU/hr. 10 rows were reported in stock by the provider at last observation; the rest are published catalog rates. All rates are on-demand - committed-use and reserved pricing is excluded.

CHEAPEST A40 BY GEOGRAPHY
chinaAI Galaxy$0.330/hrunited statesHostnot GPU$0.640/hrcanadaDenvr Dataworks$0.650/hrindiaInHosted$1.022/hrsingaporeACC$1.220/hr
A40 PRICE TREND, DAILY PANEL SNAPSHOTS

Across every A40 row on the panel, the daily floor moved from $0.350 to $0.330/GPU/hr over 53 days of tracking (-5.9%). The median continuously-tracked listing held flat at $0.65. Snapshots run daily; the full history is public in the repo.

A40 PROVIDER NOTES
AI Galaxy · 1 config · 1 region
Sets the panel floor for this model.
from $0.330/hr
RunPod · 1 config · 1 region · 1 in stock
Within 15% of the panel floor.
from $0.350/hr
MatPool · 1 config · 1 region
Published catalog rates.
from $0.426/hr
AutoDL · 1 config · 1 region
Published catalog rates.
from $0.470/hr
gpu.ai · 1 config
Published catalog rates.
from $0.580/hr
Hostnot GPU · 6 configs · 4 regions · 6 in stock
Widest regional footprint here - 4 regions.
from $0.640/hr
Denvr Dataworks · 1 config · 1 region
Published catalog rates.
from $0.650/hr
GPUBrazil · 3 configs · 3 regions · 3 in stock
3 of 3 configs reported in stock at last check.
from $0.703/hr
BUYING A40: WHAT THE PANEL SAYS

At the current floor, one A40 running around the clock costs about $241 a month (730 hours of on-demand arithmetic). Node shape matters: the single-GPU floor is $0.330/GPU/hr against $1.045/GPU/hr on an 8-GPU node (+217.2%). Per-GPU floors by config size: 1x $0.33 · 2x $0.86 · 4x $0.65 · 8x $1.05. Compare the alternatives below before committing - the same budget often buys more than one chip class.

A40 VS THE ALTERNATIVES

A40 vs L40S
The L40S has 2.4x the tensor compute and FP8. The A40 only wins when the panel prices it well below - check the spread.

Compare live rates: A40 vs L40S

A40 PRICING FAQ

What is the cheapest A40 cloud GPU right now?
The cheapest published A40 rate on the panel is $0.330 per GPU-hour at AI Galaxy (A40 x 1, China). Every price links to the provider's own published rate.
How much does a A40 cost per hour?
Across 14 providers tracked today, published per-GPU hourly rates for A40 run from $0.33 to $2.26, with a median of $0.86. Committed-use and reserved rates are excluded; everything shown is on-demand.
How many providers rent A40 GPUs?
14 providers publish 24 distinct A40 configurations on Compute Cafe. 10 of those rows were reported in stock by the provider's live endpoint at last observation.
Where is A40 cheapest?
By published per-GPU hourly rate, the cheapest geography for A40 today is china at $0.33/hr (AI Galaxy). The spread across 5 tracked geographies runs to $1.22/hr in singapore.
Are A40 prices going up or down?
Over the 53 days Compute Cafe has tracked the panel, the A40 floor is falling: $0.350 to $0.330/GPU/hr (-5.9%). The median continuously-tracked listing moved from $0.65 to $0.65 (+0.0%). Daily snapshots are public in the repo, so the trend is auditable.
What does a A40 cost per month?
At the current floor of $0.330/GPU/hr, a A40 running 24/7 costs about $241 per month (730 hours of on-demand arithmetic on the cheapest published rate). Committed-use contracts can price lower; the panel tracks on-demand rates only.
Is a full 8-GPU A40 node cheaper than a single card?
On today's panel: the single-GPU floor is $0.330/GPU/hr and the 8-GPU node floor is $1.045/GPU/hr - more expensive per GPU on a full node (+217.2%). Check the table for the exact configs behind each floor.
Is the A40 good for AI?
Adequate, not fast: it lacks FP8 and Ada's tensor throughput. At the right hourly rate it serves 13B-34B models economically.

See also alternatives to the A40 · cheapest GPU-hour per model · inference chips · training chips · by location