← AI Hashrate

RTX 4060 8GB

NVIDIA · 8 GB GDDR6 · 272 GB/s · 115 W · MSRP $299 · Search Amazon (affiliate)

The RTX 4060 8GB is a NVIDIA accelerator with 8 GB GDDR6 and about 272 GB/s peak memory bandwidth. AI Hashrate estimates local LLM decode (batch 1) at 8K context: fit counts weights + KV cache + 1 GB runtime overhead — not weights alone. At Q4, about 17 curated models fit fully on this card; at FP16, about 4 fit. Top Q4 speeds: Qwen3-0.6B ≈ 216.4 tok/s (estimated, fits); gemma-3-1b-it ≈ 173.1 tok/s (estimated, fits); Llama-3.2-1B-Instruct ≈ 144.2 tok/s (estimated, fits); Qwen3-1.7B ≈ 86.5 tok/s (estimated, fits); Llama-3.2-3B-Instruct ≈ 54.1 tok/s (estimated, fits). Relative ranking is more reliable than absolute tok/s. See methodology for the bandwidth formula and measured-anchor policy. Methodology.

Table: decode speed estimates (Q4 / FP16). Measured rows override estimates. MSRP is list price, not live retail. Context default 8K.

ModelParams (B)Quanttok/sFits?
Qwen3-0.6B0.8Q4216.4 est.Yes
gemma-3-1b-it1.0Q4173.1 est.Yes
Llama-3.2-1B-Instruct1.2Q4144.2 est.Yes
Qwen3-1.7B2.0Q486.5 est.Yes
Qwen3-0.6B0.8FP1659.5 est.Yes
Llama-3.2-3B-Instruct3.2Q454.1 est.Yes
gpt-oss-20b21.5Q447.9 est.No
gemma-3-1b-it1.0FP1647.6 est.Yes
Phi-4-mini-instruct3.8Q445.6 est.Yes
Phi-4-mini-reasoning3.8Q445.6 est.Yes
gemma-3-4b-it4.3Q444.4 est.Yes
Qwen3-4B-Instruct-25074.0Q443.3 est.Yes
Qwen3-4B-Thinking-25074.0Q443.3 est.Yes
Llama-3.2-3B-Instruct3.2FP1642.1 est.No
Llama-3.2-1B-Instruct1.2FP1639.7 est.Yes
Qwen3-30B-A3B30.5Q431.2 est.No
Qwen3-Coder-30B-A3B-Instruct30.5Q431.2 est.No
Qwen3-30B-A3B-Instruct-250730.5Q431.2 est.No
Phi-4-mini-instruct3.8FP1626.1 est.No
Phi-4-mini-reasoning3.8FP1626.1 est.No
gemma-3-12b-it12.2Q425.8 est.No
Mistral-7B-Instruct-v0.37.2Q424.0 est.Yes
Qwen3-1.7B2.0FP1623.8 est.Yes
Qwen2.5-7B-Instruct7.6Q422.8 est.Yes
Qwen2.5-Coder-7B-Instruct7.6Q422.8 est.Yes
DeepSeek-R1-Distill-Qwen-7B7.6Q422.8 est.Yes
Qwen3-4B-Instruct-25074.0FP1622.7 est.No
Qwen3-4B-Thinking-25074.0FP1622.7 est.No
Llama-3.1-8B-Instruct8.0Q421.6 est.Yes
Qwen3-8B8.2Q421.1 est.Yes
DeepSeek-R1-0528-Qwen3-8B8.2Q421.1 est.Yes
gemma-3-4b-it4.3FP1620.7 est.No
Phi-414.7Q414.9 est.No
Phi-4-reasoning14.7Q414.9 est.No
Qwen3-14B14.8Q414.6 est.No
Qwen2.5-14B-Instruct14.8Q414.6 est.No
Qwen2.5-Coder-14B-Instruct14.8Q414.6 est.No
DeepSeek-R1-Distill-Qwen-14B14.8Q414.6 est.No
GLM-4.7-Flash31.2Q46.2 est.No
Mistral-7B-Instruct-v0.37.2FP164.3 est.No
Devstral-Small-250723.6Q43.8 est.No
Mistral-Small-3.2-24B-Instruct-250624.0Q43.7 est.No
Magistral-Small-250924.0Q43.7 est.No
Qwen2.5-7B-Instruct7.6FP163.6 est.No
Qwen2.5-Coder-7B-Instruct7.6FP163.6 est.No
DeepSeek-R1-Distill-Qwen-7B7.6FP163.6 est.No
Llama-3.1-8B-Instruct8.0FP163.1 est.No
Qwen3-8B8.2FP162.9 est.No
DeepSeek-R1-0528-Qwen3-8B8.2FP162.9 est.No
Mixtral-8x7B-Instruct-v0.146.7Q42.9 est.No
gemma-3-27b-it27.4Q42.5 est.No
Qwen3-32B32.8Q41.5 est.No
Qwen2.5-32B-Instruct32.8Q41.5 est.No
Qwen2.5-Coder-32B-Instruct32.8Q41.5 est.No
DeepSeek-R1-Distill-Qwen-32B32.8Q41.5 est.No
gemma-3-12b-it12.2FP160.9 est.No