Skip to content
Voltarum Local LLM Hardware Guide

RTX 3090 vs RTX 5090

Our verdict

Editorial opinionOur verdict

The RTX 5090 is about twice as fast (1.8 vs 0.94 TB/s) and has 32 GB instead of 24, but in 2026 it costs roughly three times as much as a used 3090. Two RTX 3090s give you 48 GB for less than one 5090, enough for 70B models. Buy the 5090 for speed in one card; the 3090 for value.

Factual dataRTX 3090RTX 5090
Memory (largest)24 GB32 GBMore
Usable for models24 GB32 GBMore
Bandwidth936 GB/s1.79 TB/sMore
Largest popular model at 4-bitQwen3.6 27BQwen3.6 35B A3B
Price from$1,340Advantage$4,329
Price per GB$56Advantage$135
Power350 W575 W
Compute stackCUDACUDA

Which models each one runs

Popular models at Q4_K_M with a 32K-token context. Memory needed from real model files; speed is the theoretical ceiling.

ModelRTX 3090RTX 5090
Qwen3 1.7BRuns≤ 843 tok/sRuns≤ 1,614 tok/s
Qwen3.5 9BRuns≤ 165 tok/sRuns≤ 315 tok/s
Gemma 4 12BRuns≤ 131 tok/sRuns≤ 252 tok/s
gpt-oss-20bRuns≤ 468 tok/sRuns≤ 895 tok/s
Qwen3.6 27BRuns≤ 56 tok/sRuns≤ 107 tok/s
Qwen3.6 35B A3BPartly in system RAMRuns≤ 972 tok/s
Llama 3.3 70BNot enough memoryNot enough memory
gpt-oss-120bPartly in system RAMPartly in system RAM
Qwen3.5 122B A10BPartly in system RAMPartly in system RAM
Qwen3.5 397B A17BPartly in system RAMPartly in system RAM

Speed ceilings are theoretical; see each page for measured results.