New B200 spot capacity is live in US East from $1.69 per GPU-hour. See availability
Comparison

RTX 3080 vs RTX 3070

Both run on the same nodes, the same templates and the same tiers here — so the choice comes down to memory, bandwidth and price. Every figure below is from the catalogue or the vendor datasheet.

RTX 3080
$0.03/h10 GB · Ampere · 64 available
RTX 3070
$0.03/h8 GB · Ampere · 64 available
Price gap
NoneOn spot, per GPU-hour
Over 100 h
$0.00Difference for the same GPU-hours
In short

What actually separates them.

Four differences that change a decision, computed from the numbers rather than asserted.

Bigger models fit on the RTX 3080

10 GB against 8 GB. At FP16 that is about 4B parameters on one GPU, against 3B.

Token generation is faster on the RTX 3080

760 GB/s against 448 GB/s. Inference reads the whole model from memory for every token, so bandwidth, not FLOPS, usually sets the ceiling.

More memory per dollar on the RTX 3080

333 GB per dollar per hour against 267 GB. The usual tie-breaker when both cards fit the job.

Side by side

Every figure we hold on both cards.

A row is marked only when both values exist and one is genuinely better. RTX 3080 leads on 4 rows, RTX 3070 on 2.

  RTX 3080 RTX 3070
GPU memoryDecides which models fit at all 10 GB GDDR6X 8 GB GDDR6
Memory bandwidthSets token throughput on inference 760 GB/s 448 GB/s
FP32 30 TFLOPS 20 TFLOPS
8-bit float (FP8)Halves the memory a model needs, where the stack supports it Not supported Not supported
Architecture Ampere (2020) Ampere (2020)
Board powerLower is cheaper to run at scale — for us, not for your bill 320 W 220 W
GPU-to-GPU linkOnly matters for multi-GPU training PCIe only PCIe only
Node sizes 1×, 2×, 4× 1×, 2×
Spot price $0.03/h $0.03/h
On-demand price $0.06/h $0.05/h
Memory per dollarGPU memory per $1 of spot time, per hour 333 GB 267 GB
30-day reclaim rateShare of spot instances reclaimed 15–20% 15–20%
Available now 64 GPUs 64 GPUs

Specifications come from each vendor's datasheet — linked on the RTX 3080 page and the RTX 3070 page. Prices are ours, per GPU-hour, billed per minute.

What fits

The same models, on one GPU of each.

Weights only, with 20% of the memory kept free for activations and the KV cache. A cross means one GPU is not enough — the model page has the multi-GPU arithmetic.

Model Precision RTX 3080 10 GB RTX 3070 8 GB
Llama 3.1 8B8B parameters FP16 · 16 GB Needs 2× node Needs more than one node
INT4 · 4 GB Fits Fits
Qwen2.5 32B32B parameters FP16 · 64 GB Needs more than one node Needs more than one node
INT4 · 16 GB Needs 2× node Needs more than one node
Llama 3.3 70B70B parameters FP16 · 140 GB Needs more than one node Needs more than one node
INT4 · 35 GB Needs more than one node Needs more than one node
Mixtral 8x22B141B parameters FP16 · 282 GB Needs more than one node Needs more than one node
INT4 · 71 GB Needs more than one node Needs more than one node
Cost

The same 100 GPU-hours on each.

Compute only, billed per minute. Storage is $0.08 per GB-month on either card.

 RTX 3080RTX 3070
One hour, spot$0.03$0.03
One day, spot$0.72$0.72
100 GPU-hours, spot$3.00$3.00
100 GPU-hours, on-demand$6.00$5.00
A month, reserved$29.20$21.90

Take the RTX 3080 when…

  • Quantised inference — Small and medium models in 4-bit or 8-bit form, with the whole model resident in memory.
  • Computer vision and batch jobs — Detection, classification, embeddings and transcoding at a very low hourly rate.
  • Anything that can checkpoint — On the spot tier this model is 50% below its own on-demand price, with a 2-minute notice before a reclaim.

Full RTX 3080 page

Take the RTX 3070 when…

  • Quantised inference — Small and medium models in 4-bit or 8-bit form, with the whole model resident in memory.
  • Computer vision and batch jobs — Detection, classification, embeddings and transcoding at a very low hourly rate.
  • Anything that can checkpoint — On the spot tier this model is 40% below its own on-demand price, with a 2-minute notice before a reclaim.

Full RTX 3070 page

FAQ

RTX 3080 or RTX 3070?

Which is cheaper, the RTX 3080 or the RTX 3070?

The RTX 3070, at $0.03 per GPU-hour on spot against $0.03 — 0% less. On-demand: $0.05 against $0.06.

Which one should I take for inference?

Take the one that holds the model with room for the KV cache, then the one with more memory bandwidth. Here that is the RTX 3080 on capacity (10 GB) and the RTX 3080 on bandwidth.

Can I run both on the same job?

Not inside one instance — a node holds GPUs of a single model. You can run two instances in parallel, on the same persistent volume in turn, or split the work: a big card for the model that needs capacity, a cheap one for the parts that do not.

Other comparisons: the full list · all 47 models

Get started

Try both for less than the price of deciding.

An hour on each costs $0.06 on spot. Nothing renews, and your disk moves between them.

Billed per minute from the moment the instance is reachable. Minimum credit $40, no subscription.