What GPU do I need for Qwen3 models?

At Q4 / 8K context, the 15 Qwen3 models in our catalog need about 1.6–272.11 GB of VRAM (weights + KV cache + 1 GB overhead). 14 of 15 fully fit at least one retail GPU we track; the most common best-value pick on this page is the RTX 5090 32GB (MSRP $1,999 — list price, not live retail).

Can a 24 GB card like the RTX 4090 24GB run Qwen3 models?

Yes for 9 of 15 at Q4/8K: Qwen3-0.6B, Qwen3-1.7B, Qwen3-4B-Instruct-2507, Qwen3-4B-Thinking-2507 and 5 more. The rest need more than 24 GB at 8K context — the per-model minimum is in the table.

Should I run Qwen3 models at Q4 or FP16?

Q4. FP16 weights are about 3.6x larger than Q4 (2.0 vs 0.55 bytes per parameter), so FP16 needs a much bigger card for the same model. This page ranks GPUs at Q4 / 8K context, the typical local setup; each linked fit check also shows the FP16 verdict.

Best GPUs for Qwen3 Models — Q4/8K fit & tok/s

Our catalog tracks 15 Qwen3 models (0.8B–480.2 parameters). For each, the table shows the cheapest retail GPU that fully fits it at Q4 / 8K context and the fastest retail GPU, with decode tok/s. Fit means weights + KV cache + 1 GB runtime overhead within 95% of VRAM — not weights alone. 1 of them exceed every retail GPU we track and are marked accordingly. Methodology.

#	Model	Params	Q4/8K needs (GB)	Best value GPU (fits)	Fastest retail GPU	Buy
1	Qwen3-0.6B	0.8B	1.6	Arc B570 10GB ≈302.3 tok/s est.	RTX 5090 32GB ≈1425.5 tok/s est.	Search Amazon (affiliate)
2	Qwen3-1.7B	2.0B	2.5	Arc B570 10GB ≈120.9 tok/s est.	RTX 5090 32GB ≈570.2 tok/s est.	Search Amazon (affiliate)
3	Qwen3-4B-Instruct-2507	4.0B	4.0	Arc B570 10GB ≈60.5 tok/s est.	RTX 5090 32GB ≈285.1 tok/s est.	Search Amazon (affiliate)
4	Qwen3-4B-Thinking-2507	4.0B	4.0	Arc B570 10GB ≈60.5 tok/s est.	RTX 5090 32GB ≈285.1 tok/s est.	Search Amazon (affiliate)
5	Qwen3-8B	8.2B	7.15	Arc B570 10GB ≈29.5 tok/s est.	RTX 5090 32GB ≈139.1 tok/s est.	Search Amazon (affiliate)
6	Qwen3-14B	14.8B	12.1	RX 7600 XT 16GB ≈12.4 tok/s est.	RTX 5090 32GB ≈77.1 tok/s est.	Search Amazon (affiliate)
7	Qwen3-30B-A3B	30.5B MoE 3B act.	18.38	RX 7900 XT 20GB ≈169.7 tok/s est.	RTX 5090 32GB ≈380.1 tok/s est.	Search Amazon (affiliate)
8	Qwen3-30B-A3B-Instruct-2507	30.5B MoE 3B act.	18.38	RX 7900 XT 20GB ≈169.7 tok/s est.	RTX 5090 32GB ≈380.1 tok/s est.	Search Amazon (affiliate)
9	Qwen3-Coder-30B-A3B-Instruct	30.5B MoE 3B act.	18.38	RX 7900 XT 20GB ≈169.7 tok/s est.	RTX 5090 32GB ≈380.1 tok/s est.	Search Amazon (affiliate)
10	Qwen3-32B	32.8B	25.6	Mac mini M4 32GB ≈2.3 tok/s est.	RTX 5090 32GB ≈34.8 tok/s est.	Search Amazon (affiliate)
11	Qwen3-Coder-Next	79.7B MoE 3B act.	45.44	Mac mini M4 Pro 64GB ≈57.9 tok/s est.	RTX 6000 Ada 48GB ≈203.6 tok/s est.	Search Amazon (affiliate)
12	Qwen3-Next-80B-A3B-Instruct	81.3B MoE 3B act.	46.32	Mac mini M4 Pro 64GB ≈57.9 tok/s est.	Mac Studio M3 Ultra 96GB ≈173.7 tok/s est.	Search Amazon (affiliate)
13	Qwen3-235B-A22B	235.1B MoE 22B act.	134.71	Mac Studio M2 Ultra 192GB ≈23.1 tok/s est.	Mac Studio M2 Ultra 192GB ≈23.1 tok/s est.	Search Amazon (affiliate)
14	Qwen3-235B-A22B-Instruct-2507	235.1B MoE 22B act.	134.71	Mac Studio M2 Ultra 192GB ≈23.1 tok/s est.	Mac Studio M2 Ultra 192GB ≈23.1 tok/s est.	Search Amazon (affiliate)
15	Qwen3-Coder-480B-A35B-Instruct	480.2B MoE 35B act.	272.11	No retail GPU fits	—	—

est. = bandwidth-based estimate; measured = curated real benchmark that overrides the estimate. GPU names link to the full fit check (4K/8K/32K fit table + VRAM breakdown). MSRP is the launch list price, not live retail — Amazon prices change; click a Buy link for the current price. Models marked 'No retail GPU fits' need more VRAM than any retail card in our catalog (up to 192 GB) — see the model page for datacenter-class options.

Popular fit checks

Qwen3-0.6B on the Arc B570 10GB — ≈302.3 tok/s Q4 est.
Qwen3-8B on the Arc B570 10GB — ≈29.5 tok/s Q4 est.
Qwen3-32B on the Mac mini M4 32GB — ≈2.3 tok/s Q4 est.
Qwen3-1.7B on the Arc B570 10GB — ≈120.9 tok/s Q4 est.

Compare the picks

Arc B570 10GB vs RTX 5090 32GB · Mac Studio M2 Ultra 192GB vs RTX 5090 32GB · RTX 5090 32GB vs RX 7900 XT 20GB · Arc B570 10GB vs Mac Studio M2 Ultra 192GB · Arc B570 10GB vs RX 7900 XT 20GB · Mac Studio M2 Ultra 192GB vs RX 7900 XT 20GB

More lists: 7B-class models · 13B-class models · 30B-class models · 70B+ models · Under $500 · Under $1,000 · Under $2,000 · 8 GB VRAM · 12 GB VRAM · 16 GB VRAM · 24 GB VRAM · For DeepSeek · For Llama · For Gemma · For GLM · For coding · For reasoning · MoE picks