RX 7700 XT 12GB

AMD · 12 GB GDDR6 · 432 GB/s · 245 W · MSRP $449 · Search Amazon (affiliate)

The RX 7700 XT 12GB is a AMD accelerator with 12 GB GDDR6 and about 432 GB/s peak memory bandwidth. AI Hashrate estimates local LLM decode (batch 1) at 8K context: fit counts weights + KV cache + 1 GB runtime overhead — not weights alone. At Q4, about 18 curated models fit fully on this card; at FP16, about 10 fit. Top Q4 speeds: Qwen3-0.6B ≈ 343.6 tok/s (estimated, fits); gemma-3-1b-it ≈ 274.9 tok/s (estimated, fits); Llama-3.2-1B-Instruct ≈ 229.1 tok/s (estimated, fits); Qwen3-1.7B ≈ 137.5 tok/s (estimated, fits); Llama-3.2-3B-Instruct ≈ 85.9 tok/s (estimated, fits). Relative ranking is more reliable than absolute tok/s. See methodology for the bandwidth formula and measured-anchor policy. Methodology.

Table: decode speed estimates (Q4 / FP16). Measured rows override estimates. MSRP is list price, not live retail. Context default 8K.

Model	Params (B)	Quant	tok/s	Fits?
Qwen3-0.6B	0.8	Q4	343.6 est.	Yes
gemma-3-1b-it	1.0	Q4	274.9 est.	Yes
Llama-3.2-1B-Instruct	1.2	Q4	229.1 est.	Yes
gpt-oss-20b	21.5	Q4	171.1 est.	No
Qwen3-1.7B	2.0	Q4	137.5 est.	Yes
Qwen3-30B-A3B	30.5	Q4	111.6 est.	No
Qwen3-Coder-30B-A3B-Instruct	30.5	Q4	111.6 est.	No
Qwen3-30B-A3B-Instruct-2507	30.5	Q4	111.6 est.	No
GLM-4.7-Flash	31.2	Q4	107.1 est.	No
Qwen3-0.6B	0.8	FP16	94.5 est.	Yes
Llama-3.2-3B-Instruct	3.2	Q4	85.9 est.	Yes
gemma-3-1b-it	1.0	FP16	75.6 est.	Yes
Phi-4-mini-instruct	3.8	Q4	72.3 est.	Yes
Phi-4-mini-reasoning	3.8	Q4	72.3 est.	Yes
gemma-3-4b-it	4.3	Q4	70.5 est.	Yes
Qwen3-4B-Instruct-2507	4.0	Q4	68.7 est.	Yes
Qwen3-4B-Thinking-2507	4.0	Q4	68.7 est.	Yes
Llama-3.2-1B-Instruct	1.2	FP16	63.0 est.	Yes
Phi-4	14.7	Q4	53.2 est.	No
Phi-4-reasoning	14.7	Q4	53.2 est.	No
Qwen3-14B	14.8	Q4	52.2 est.	No
Qwen2.5-14B-Instruct	14.8	Q4	52.2 est.	No
Qwen2.5-Coder-14B-Instruct	14.8	Q4	52.2 est.	No
DeepSeek-R1-Distill-Qwen-14B	14.8	Q4	52.2 est.	No
Mistral-7B-Instruct-v0.3	7.2	Q4	38.2 est.	Yes
Qwen3-1.7B	2.0	FP16	37.8 est.	Yes
Qwen2.5-7B-Instruct	7.6	Q4	36.2 est.	Yes
Qwen2.5-Coder-7B-Instruct	7.6	Q4	36.2 est.	Yes
DeepSeek-R1-Distill-Qwen-7B	7.6	Q4	36.2 est.	Yes
Llama-3.1-8B-Instruct	8.0	Q4	34.4 est.	Yes
Qwen3-8B	8.2	Q4	33.5 est.	Yes
DeepSeek-R1-0528-Qwen3-8B	8.2	Q4	33.5 est.	Yes
Llama-3.2-3B-Instruct	3.2	FP16	23.6 est.	Yes
gemma-3-12b-it	12.2	Q4	22.9 est.	Yes
Phi-4-mini-instruct	3.8	FP16	19.9 est.	Yes
Phi-4-mini-reasoning	3.8	FP16	19.9 est.	Yes
gemma-3-4b-it	4.3	FP16	19.4 est.	Yes
Qwen3-4B-Instruct-2507	4.0	FP16	18.9 est.	Yes
Qwen3-4B-Thinking-2507	4.0	FP16	18.9 est.	Yes
Qwen3-Coder-Next	79.7	Q4	18.3 est.	No
Qwen3-Next-80B-A3B-Instruct	81.3	Q4	17.6 est.	No
Mistral-7B-Instruct-v0.3	7.2	FP16	15.2 est.	No
Devstral-Small-2507	23.6	Q4	13.7 est.	No
Mistral-Small-3.2-24B-Instruct-2506	24.0	Q4	13.1 est.	No
Magistral-Small-2509	24.0	Q4	13.1 est.	No
Qwen2.5-7B-Instruct	7.6	FP16	13.0 est.	No
Qwen2.5-Coder-7B-Instruct	7.6	FP16	13.0 est.	No
DeepSeek-R1-Distill-Qwen-7B	7.6	FP16	13.0 est.	No
Llama-3.1-8B-Instruct	8.0	FP16	11.2 est.	No
Qwen3-8B	8.2	FP16	10.5 est.	No
DeepSeek-R1-0528-Qwen3-8B	8.2	FP16	10.5 est.	No
Mixtral-8x7B-Instruct-v0.1	46.7	Q4	10.2 est.	No
gemma-3-27b-it	27.4	Q4	9.0 est.	No
Qwen3-32B	32.8	Q4	5.3 est.	No
Qwen2.5-32B-Instruct	32.8	Q4	5.3 est.	No
Qwen2.5-Coder-32B-Instruct	32.8	Q4	5.3 est.	No
DeepSeek-R1-Distill-Qwen-32B	32.8	Q4	5.3 est.	No
gpt-oss-20b	21.5	FP16	4.3 est.	No
gemma-3-12b-it	12.2	FP16	3.4 est.	No
Qwen3-14B	14.8	FP16	1.9 est.	No
Qwen2.5-14B-Instruct	14.8	FP16	1.9 est.	No
Qwen2.5-Coder-14B-Instruct	14.8	FP16	1.9 est.	No
DeepSeek-R1-Distill-Qwen-14B	14.8	FP16	1.9 est.	No
Phi-4	14.7	FP16	1.9 est.	No
Phi-4-reasoning	14.7	FP16	1.9 est.	No

Fit checks

• Qwen3-0.6B — fits · ≈343.6 tok/s Q4 est.
• Qwen3-8B — fits · ≈33.5 tok/s Q4 est.
• Qwen2.5-7B-Instruct — fits · ≈36.2 tok/s Q4 est.
• Llama-3.2-1B-Instruct — fits · ≈229.1 tok/s Q4 est.
• Llama-3.1-8B-Instruct — fits · ≈34.4 tok/s Q4 est.
• gpt-oss-20b — does not fit · ≈171.1 tok/s Q4 est.
• Qwen3-32B — does not fit · ≈5.3 tok/s Q4 est.
• Qwen3-1.7B — fits · ≈137.5 tok/s Q4 est.
• Mistral-7B-Instruct-v0.3 — fits · ≈38.2 tok/s Q4 est.
• Qwen3-14B — does not fit · ≈52.2 tok/s Q4 est.
• Qwen3-4B-Instruct-2507 — fits · ≈68.7 tok/s Q4 est.

All 61 model fit checks — see the linked Fits? column in the table above