← AI Hashrate

RTX 3060 12GB

NVIDIA · 12 GB GDDR6 · 360 GB/s · 170 W · MSRP $329 · MSI GeForce RTX 3060 Ventus 2X 12G OC (affiliate) · More listings

The RTX 3060 12GB is a NVIDIA accelerator with 12 GB GDDR6 and about 360 GB/s peak memory bandwidth. AI Hashrate estimates local LLM decode (batch 1) at 8K context: fit counts weights + KV cache + 1 GB runtime overhead — not weights alone. At Q4, about 18 curated models fit fully on this card; at FP16, about 10 fit. Top Q4 speeds: Qwen3-0.6B ≈ 286.4 tok/s (estimated, fits); gemma-3-1b-it ≈ 229.1 tok/s (estimated, fits); Llama-3.2-1B-Instruct ≈ 190.9 tok/s (estimated, fits); Qwen3-1.7B ≈ 114.5 tok/s (estimated, fits); Llama-3.2-3B-Instruct ≈ 71.6 tok/s (estimated, fits). Relative ranking is more reliable than absolute tok/s. See methodology for the bandwidth formula and measured-anchor policy. Methodology.

Table: decode speed estimates (Q4 / FP16). Measured rows override estimates. MSRP is list price, not live retail. Context default 8K.

ModelParams (B)Quanttok/sFits?
Qwen3-0.6B0.8Q4286.4 est.Yes
gemma-3-1b-it1.0Q4229.1 est.Yes
Llama-3.2-1B-Instruct1.2Q4190.9 est.Yes
gpt-oss-20b21.5Q4142.6 est.No
Qwen3-1.7B2.0Q4114.5 est.Yes
Qwen3-30B-A3B30.5Q493.0 est.No
Qwen3-Coder-30B-A3B-Instruct30.5Q493.0 est.No
Qwen3-30B-A3B-Instruct-250730.5Q493.0 est.No
Qwen3-0.6B0.8FP1678.8 est.Yes
Llama-3.2-3B-Instruct3.2Q471.6 est.Yes
gemma-3-1b-it1.0FP1663.0 est.Yes
Phi-4-mini-instruct3.8Q460.3 est.Yes
Phi-4-mini-reasoning3.8Q460.3 est.Yes
gemma-3-4b-it4.3Q458.7 est.Yes
Qwen3-4B-Instruct-25074.0Q457.3 est.Yes
Qwen3-4B-Thinking-25074.0Q457.3 est.Yes
Llama-3.2-1B-Instruct1.2FP1652.5 est.Yes
Phi-414.7Q444.3 est.No
Phi-4-reasoning14.7Q444.3 est.No
Qwen3-14B14.8Q443.5 est.No
Qwen2.5-14B-Instruct14.8Q443.5 est.No
Qwen2.5-Coder-14B-Instruct14.8Q443.5 est.No
DeepSeek-R1-Distill-Qwen-14B14.8Q443.5 est.No
Llama-3.1-8B-Instruct8.0Q442.0 measured (singhajit-hwcorner)Yes
Mistral-7B-Instruct-v0.37.2Q431.8 est.Yes
Qwen3-1.7B2.0FP1631.5 est.Yes
Qwen2.5-7B-Instruct7.6Q430.1 est.Yes
Qwen2.5-Coder-7B-Instruct7.6Q430.1 est.Yes
DeepSeek-R1-Distill-Qwen-7B7.6Q430.1 est.Yes
Qwen3-8B8.2Q427.9 est.Yes
DeepSeek-R1-0528-Qwen3-8B8.2Q427.9 est.Yes
Llama-3.2-3B-Instruct3.2FP1619.7 est.Yes
gemma-3-12b-it12.2Q419.1 est.Yes
GLM-4.7-Flash31.2Q418.6 est.No
Phi-4-mini-instruct3.8FP1616.6 est.Yes
Phi-4-mini-reasoning3.8FP1616.6 est.Yes
gemma-3-4b-it4.3FP1616.2 est.Yes
Qwen3-4B-Instruct-25074.0FP1615.7 est.Yes
Qwen3-4B-Thinking-25074.0FP1615.7 est.Yes
Qwen3-Coder-Next79.7Q415.2 est.No
Qwen3-Next-80B-A3B-Instruct81.3Q414.6 est.No
Mistral-7B-Instruct-v0.37.2FP1612.7 est.No
Devstral-Small-250723.6Q411.4 est.No
Qwen2.5-7B-Instruct7.6FP1610.9 est.No
Qwen2.5-Coder-7B-Instruct7.6FP1610.9 est.No
DeepSeek-R1-Distill-Qwen-7B7.6FP1610.9 est.No
Mistral-Small-3.2-24B-Instruct-250624.0Q410.9 est.No
Magistral-Small-250924.0Q410.9 est.No
Llama-3.1-8B-Instruct8.0FP169.4 est.No
Qwen3-8B8.2FP168.7 est.No
DeepSeek-R1-0528-Qwen3-8B8.2FP168.7 est.No
Mixtral-8x7B-Instruct-v0.146.7Q48.5 est.No
gemma-3-27b-it27.4Q47.5 est.No
Qwen3-32B32.8Q44.4 est.No
Qwen2.5-32B-Instruct32.8Q44.4 est.No
Qwen2.5-Coder-32B-Instruct32.8Q44.4 est.No
DeepSeek-R1-Distill-Qwen-32B32.8Q44.4 est.No
gpt-oss-20b21.5FP163.6 est.No
gemma-3-12b-it12.2FP162.8 est.No
Qwen3-14B14.8FP161.6 est.No
Qwen2.5-14B-Instruct14.8FP161.6 est.No
Qwen2.5-Coder-14B-Instruct14.8FP161.6 est.No
DeepSeek-R1-Distill-Qwen-14B14.8FP161.6 est.No
Phi-414.7FP161.6 est.No
Phi-4-reasoning14.7FP161.6 est.No