← AI Hashrate

RTX 3070 8GB

NVIDIA · 8 GB GDDR6 · 448 GB/s · 220 W · MSRP $499 · Search Amazon (affiliate)

The RTX 3070 8GB is a NVIDIA accelerator with 8 GB GDDR6 and about 448 GB/s peak memory bandwidth. AI Hashrate estimates local LLM decode (batch 1) at 8K context: fit counts weights + KV cache + 1 GB runtime overhead — not weights alone. At Q4, about 17 curated models fit fully on this card; at FP16, about 4 fit. Top Q4 speeds: Qwen3-0.6B ≈ 356.4 tok/s (estimated, fits); gemma-3-1b-it ≈ 285.1 tok/s (estimated, fits); Llama-3.2-1B-Instruct ≈ 237.6 tok/s (estimated, fits); Qwen3-1.7B ≈ 142.5 tok/s (estimated, fits); Llama-3.2-3B-Instruct ≈ 89.1 tok/s (estimated, fits). Relative ranking is more reliable than absolute tok/s. See methodology for the bandwidth formula and measured-anchor policy. Methodology.

Table: decode speed estimates (Q4 / FP16). Measured rows override estimates. MSRP is list price, not live retail. Context default 8K.

ModelParams (B)Quanttok/sFits?
Qwen3-0.6B0.8Q4356.4 est.Yes
gemma-3-1b-it1.0Q4285.1 est.Yes
Llama-3.2-1B-Instruct1.2Q4237.6 est.Yes
Qwen3-1.7B2.0Q4142.5 est.Yes
Qwen3-0.6B0.8FP1698.0 est.Yes
Llama-3.2-3B-Instruct3.2Q489.1 est.Yes
gpt-oss-20b21.5Q478.9 est.No
gemma-3-1b-it1.0FP1678.4 est.Yes
Phi-4-mini-instruct3.8Q475.0 est.Yes
Phi-4-mini-reasoning3.8Q475.0 est.Yes
gemma-3-4b-it4.3Q473.1 est.Yes
Qwen3-4B-Instruct-25074.0Q471.3 est.Yes
Qwen3-4B-Thinking-25074.0Q471.3 est.Yes
Llama-3.2-3B-Instruct3.2FP1669.3 est.No
Llama-3.2-1B-Instruct1.2FP1665.3 est.Yes
Qwen3-30B-A3B30.5Q451.4 est.No
Qwen3-Coder-30B-A3B-Instruct30.5Q451.4 est.No
Qwen3-30B-A3B-Instruct-250730.5Q451.4 est.No
Phi-4-mini-instruct3.8FP1643.1 est.No
Phi-4-mini-reasoning3.8FP1643.1 est.No
gemma-3-12b-it12.2Q442.5 est.No
Mistral-7B-Instruct-v0.37.2Q439.6 est.Yes
Qwen3-1.7B2.0FP1639.2 est.Yes
Qwen2.5-7B-Instruct7.6Q437.5 est.Yes
Qwen2.5-Coder-7B-Instruct7.6Q437.5 est.Yes
DeepSeek-R1-Distill-Qwen-7B7.6Q437.5 est.Yes
Qwen3-4B-Instruct-25074.0FP1637.3 est.No
Qwen3-4B-Thinking-25074.0FP1637.3 est.No
Llama-3.1-8B-Instruct8.0Q435.6 est.Yes
Qwen3-8B8.2Q434.8 est.Yes
DeepSeek-R1-0528-Qwen3-8B8.2Q434.8 est.Yes
gemma-3-4b-it4.3FP1634.1 est.No
Phi-414.7Q424.5 est.No
Phi-4-reasoning14.7Q424.5 est.No
Qwen3-14B14.8Q424.1 est.No
Qwen2.5-14B-Instruct14.8Q424.1 est.No
Qwen2.5-Coder-14B-Instruct14.8Q424.1 est.No
DeepSeek-R1-Distill-Qwen-14B14.8Q424.1 est.No
GLM-4.7-Flash31.2Q410.3 est.No
Mistral-7B-Instruct-v0.37.2FP167.0 est.No
Devstral-Small-250723.6Q46.3 est.No
Qwen2.5-7B-Instruct7.6FP166.0 est.No
Qwen2.5-Coder-7B-Instruct7.6FP166.0 est.No
DeepSeek-R1-Distill-Qwen-7B7.6FP166.0 est.No
Mistral-Small-3.2-24B-Instruct-250624.0Q46.0 est.No
Magistral-Small-250924.0Q46.0 est.No
Llama-3.1-8B-Instruct8.0FP165.2 est.No
Qwen3-8B8.2FP164.8 est.No
DeepSeek-R1-0528-Qwen3-8B8.2FP164.8 est.No
Mixtral-8x7B-Instruct-v0.146.7Q44.7 est.No
gemma-3-27b-it27.4Q44.1 est.No
Qwen3-32B32.8Q42.4 est.No
Qwen2.5-32B-Instruct32.8Q42.4 est.No
Qwen2.5-Coder-32B-Instruct32.8Q42.4 est.No
DeepSeek-R1-Distill-Qwen-32B32.8Q42.4 est.No
gemma-3-12b-it12.2FP161.5 est.No