← AI Hashrate

RTX 4070 Ti 12GB

NVIDIA · 12 GB GDDR6X · 554 GB/s · 285 W · MSRP $799 · Search Amazon (affiliate)

The RTX 4070 Ti 12GB is a NVIDIA accelerator with 12 GB GDDR6X and about 554 GB/s peak memory bandwidth. AI Hashrate estimates local LLM decode (batch 1) at 8K context: fit counts weights + KV cache + 1 GB runtime overhead — not weights alone. At Q4, about 18 curated models fit fully on this card; at FP16, about 10 fit. Top Q4 speeds: Qwen3-0.6B ≈ 440.7 tok/s (estimated, fits); gemma-3-1b-it ≈ 352.5 tok/s (estimated, fits); Llama-3.2-1B-Instruct ≈ 293.8 tok/s (estimated, fits); Qwen3-1.7B ≈ 176.3 tok/s (estimated, fits); Llama-3.2-3B-Instruct ≈ 110.2 tok/s (estimated, fits). Relative ranking is more reliable than absolute tok/s. See methodology for the bandwidth formula and measured-anchor policy. Methodology.

Table: decode speed estimates (Q4 / FP16). Measured rows override estimates. MSRP is list price, not live retail. Context default 8K.

ModelParams (B)Quanttok/sFits?
Qwen3-0.6B0.8Q4440.7 est.Yes
gemma-3-1b-it1.0Q4352.5 est.Yes
Llama-3.2-1B-Instruct1.2Q4293.8 est.Yes
gpt-oss-20b21.5Q4219.4 est.No
Qwen3-1.7B2.0Q4176.3 est.Yes
Qwen3-30B-A3B30.5Q4143.1 est.No
Qwen3-Coder-30B-A3B-Instruct30.5Q4143.1 est.No
Qwen3-30B-A3B-Instruct-250730.5Q4143.1 est.No
Qwen3-0.6B0.8FP16121.2 est.Yes
Llama-3.2-3B-Instruct3.2Q4110.2 est.Yes
gemma-3-1b-it1.0FP1696.9 est.Yes
Phi-4-mini-instruct3.8Q492.8 est.Yes
Phi-4-mini-reasoning3.8Q492.8 est.Yes
gemma-3-4b-it4.3Q490.4 est.Yes
Qwen3-4B-Instruct-25074.0Q488.1 est.Yes
Qwen3-4B-Thinking-25074.0Q488.1 est.Yes
Llama-3.2-1B-Instruct1.2FP1680.8 est.Yes
Phi-414.7Q468.2 est.No
Phi-4-reasoning14.7Q468.2 est.No
Qwen3-14B14.8Q466.9 est.No
Qwen2.5-14B-Instruct14.8Q466.9 est.No
Qwen2.5-Coder-14B-Instruct14.8Q466.9 est.No
DeepSeek-R1-Distill-Qwen-14B14.8Q466.9 est.No
Mistral-7B-Instruct-v0.37.2Q449.0 est.Yes
Qwen3-1.7B2.0FP1648.5 est.Yes
Qwen2.5-7B-Instruct7.6Q446.4 est.Yes
Qwen2.5-Coder-7B-Instruct7.6Q446.4 est.Yes
DeepSeek-R1-Distill-Qwen-7B7.6Q446.4 est.Yes
Llama-3.1-8B-Instruct8.0Q444.1 est.Yes
Qwen3-8B8.2Q443.0 est.Yes
DeepSeek-R1-0528-Qwen3-8B8.2Q443.0 est.Yes
Llama-3.2-3B-Instruct3.2FP1630.3 est.Yes
gemma-3-12b-it12.2Q429.4 est.Yes
GLM-4.7-Flash31.2Q428.6 est.No
Phi-4-mini-instruct3.8FP1625.5 est.Yes
Phi-4-mini-reasoning3.8FP1625.5 est.Yes
gemma-3-4b-it4.3FP1624.9 est.Yes
Qwen3-4B-Instruct-25074.0FP1624.2 est.Yes
Qwen3-4B-Thinking-25074.0FP1624.2 est.Yes
Qwen3-Coder-Next79.7Q423.4 est.No
Qwen3-Next-80B-A3B-Instruct81.3Q422.5 est.No
Mistral-7B-Instruct-v0.37.2FP1619.5 est.No
Devstral-Small-250723.6Q417.6 est.No
Qwen2.5-7B-Instruct7.6FP1616.7 est.No
Qwen2.5-Coder-7B-Instruct7.6FP1616.7 est.No
DeepSeek-R1-Distill-Qwen-7B7.6FP1616.7 est.No
Mistral-Small-3.2-24B-Instruct-250624.0Q416.7 est.No
Magistral-Small-250924.0Q416.7 est.No
Llama-3.1-8B-Instruct8.0FP1614.4 est.No
Qwen3-8B8.2FP1613.4 est.No
DeepSeek-R1-0528-Qwen3-8B8.2FP1613.4 est.No
Mixtral-8x7B-Instruct-v0.146.7Q413.1 est.No
gemma-3-27b-it27.4Q411.5 est.No
Qwen3-32B32.8Q46.7 est.No
Qwen2.5-32B-Instruct32.8Q46.7 est.No
Qwen2.5-Coder-32B-Instruct32.8Q46.7 est.No
DeepSeek-R1-Distill-Qwen-32B32.8Q46.7 est.No
gpt-oss-20b21.5FP165.5 est.No
gemma-3-12b-it12.2FP164.3 est.No
Qwen3-14B14.8FP162.4 est.No
Qwen2.5-14B-Instruct14.8FP162.4 est.No
Qwen2.5-Coder-14B-Instruct14.8FP162.4 est.No
DeepSeek-R1-Distill-Qwen-14B14.8FP162.4 est.No
Phi-414.7FP162.4 est.No
Phi-4-reasoning14.7FP162.4 est.No