MacBook Pro M4 Max 128GB — local LLM fit & speed

Apple · 128 GB LPDDR5X · 546 GB/s · 160 W · MSRP $4,399 · Search Amazon (affiliate)

The MacBook Pro M4 Max 128GB is a Apple accelerator with 128 GB LPDDR5X and about 546 GB/s peak memory bandwidth. AI Hashrate estimates local LLM decode (batch 1) at 8K context: fit counts weights + KV cache + 1 GB runtime overhead — not weights alone. At Q4, about 47 curated models fit fully on this card; at FP16, about 38 fit. Top Q4 speeds: Qwen3-0.6B ≈ 434.3 tok/s (estimated, fits); gemma-3-1b-it ≈ 347.5 tok/s (estimated, fits); Llama-3.2-1B-Instruct ≈ 289.5 tok/s (estimated, fits); Qwen3-1.7B ≈ 173.7 tok/s (estimated, fits); Qwen3-30B-A3B ≈ 115.8 tok/s (estimated, fits). Relative ranking is more reliable than absolute tok/s. See methodology for the bandwidth formula and measured-anchor policy. Methodology.

Table: decode speed estimates (Q4 / FP16). Measured rows override estimates. MSRP is list price, not live retail. Context default 8K.

Model	Params (B)	Quant	tok/s	Fits?
Qwen3-0.6B	0.8	Q4	434.3 est.	Yes
gemma-3-1b-it	1.0	Q4	347.5 est.	Yes
Llama-3.2-1B-Instruct	1.2	Q4	289.5 est.	Yes
Qwen3-1.7B	2.0	Q4	173.7 est.	Yes
Qwen3-0.6B	0.8	FP16	119.4 est.	Yes
Qwen3-30B-A3B	30.5	Q4	115.8 est.	Yes
Qwen3-Coder-30B-A3B-Instruct	30.5	Q4	115.8 est.	Yes
Qwen3-30B-A3B-Instruct-2507	30.5	Q4	115.8 est.	Yes
Qwen3-Next-80B-A3B-Instruct	81.3	Q4	115.8 est.	Yes
Qwen3-Coder-Next	79.7	Q4	115.8 est.	Yes
Llama-3.2-3B-Instruct	3.2	Q4	108.6 est.	Yes
MiniMax-M2.7	228.7	Q4	98.1 est.	No
gpt-oss-20b	21.5	Q4	96.5 est.	Yes
gemma-3-1b-it	1.0	FP16	95.5 est.	Yes
Phi-4-mini-instruct	3.8	Q4	91.4 est.	Yes
Phi-4-mini-reasoning	3.8	Q4	91.4 est.	Yes
gemma-3-4b-it	4.3	Q4	89.1 est.	Yes
Qwen3-4B-Instruct-2507	4.0	Q4	86.9 est.	Yes
Qwen3-4B-Thinking-2507	4.0	Q4	86.9 est.	Yes
Llama-3.2-1B-Instruct	1.2	FP16	79.6 est.	Yes
Qwen3-Coder-Next	79.7	FP16	57.5 est.	No
Qwen3-Next-80B-A3B-Instruct	81.3	FP16	55.3 est.	No
Mistral-7B-Instruct-v0.3	7.2	Q4	48.3 est.	Yes
Qwen3-1.7B	2.0	FP16	47.8 est.	Yes
Qwen2.5-7B-Instruct	7.6	Q4	45.7 est.	Yes
Qwen2.5-Coder-7B-Instruct	7.6	Q4	45.7 est.	Yes
DeepSeek-R1-Distill-Qwen-7B	7.6	Q4	45.7 est.	Yes
Llama-3.1-8B-Instruct	8.0	Q4	43.4 est.	Yes
gpt-oss-120b	120.4	Q4	43.4 est.	Yes
Qwen3-8B	8.2	Q4	42.4 est.	Yes
DeepSeek-R1-0528-Qwen3-8B	8.2	Q4	42.4 est.	Yes
Qwen3-235B-A22B	235.1	Q4	40.7 est.	No
Qwen3-235B-A22B-Instruct-2507	235.1	Q4	40.7 est.	No
Qwen3-30B-A3B	30.5	FP16	31.8 est.	Yes
Qwen3-Coder-30B-A3B-Instruct	30.5	FP16	31.8 est.	Yes
Qwen3-30B-A3B-Instruct-2507	30.5	FP16	31.8 est.	Yes
Llama-3.2-3B-Instruct	3.2	FP16	29.9 est.	Yes
gemma-3-12b-it	12.2	Q4	29.0 est.	Yes
GLM-4.7-Flash	31.2	Q4	29.0 est.	Yes
GLM-4.5-Air	110.5	Q4	29.0 est.	Yes
Mixtral-8x7B-Instruct-v0.1	46.7	Q4	26.9 est.	Yes
DeepSeek-V4-Flash	158.1	Q4	26.7 est.	Yes
gpt-oss-20b	21.5	FP16	26.5 est.	Yes
Phi-4-mini-instruct	3.8	FP16	25.1 est.	Yes
Phi-4-mini-reasoning	3.8	FP16	25.1 est.	Yes
gemma-3-4b-it	4.3	FP16	24.5 est.	Yes
Qwen3-4B-Instruct-2507	4.0	FP16	23.9 est.	Yes
Qwen3-4B-Thinking-2507	4.0	FP16	23.9 est.	Yes
Phi-4	14.7	Q4	23.6 est.	Yes
Phi-4-reasoning	14.7	Q4	23.6 est.	Yes
Qwen3-14B	14.8	Q4	23.5 est.	Yes
Qwen2.5-14B-Instruct	14.8	Q4	23.5 est.	Yes
Qwen2.5-Coder-14B-Instruct	14.8	Q4	23.5 est.	Yes
DeepSeek-R1-Distill-Qwen-14B	14.8	Q4	23.5 est.	Yes
Devstral-Small-2507	23.6	Q4	14.7 est.	Yes
Mistral-Small-3.2-24B-Instruct-2506	24.0	Q4	14.5 est.	Yes
Magistral-Small-2509	24.0	Q4	14.5 est.	Yes
Mistral-7B-Instruct-v0.3	7.2	FP16	13.3 est.	Yes
gemma-3-27b-it	27.4	Q4	12.8 est.	Yes
Qwen2.5-7B-Instruct	7.6	FP16	12.6 est.	Yes
Qwen2.5-Coder-7B-Instruct	7.6	FP16	12.6 est.	Yes
DeepSeek-R1-Distill-Qwen-7B	7.6	FP16	12.6 est.	Yes
GLM-4.5	358.3	Q4	12.2 est.	No
Llama-3.1-8B-Instruct	8.0	FP16	11.9 est.	Yes
Qwen3-8B	8.2	FP16	11.7 est.	Yes
DeepSeek-R1-0528-Qwen3-8B	8.2	FP16	11.7 est.	Yes
Qwen3-32B	32.8	Q4	10.6 est.	Yes
Qwen2.5-32B-Instruct	32.8	Q4	10.6 est.	Yes
Qwen2.5-Coder-32B-Instruct	32.8	Q4	10.6 est.	Yes
DeepSeek-R1-Distill-Qwen-32B	32.8	Q4	10.6 est.	Yes
gpt-oss-120b	120.4	FP16	9.4 est.	No
gemma-3-12b-it	12.2	FP16	8.0 est.	Yes
GLM-4.7-Flash	31.2	FP16	8.0 est.	Yes
Mixtral-8x7B-Instruct-v0.1	46.7	FP16	7.4 est.	Yes
GLM-4.5-Air	110.5	FP16	7.4 est.	No
Qwen3-14B	14.8	FP16	6.5 est.	Yes
Qwen2.5-14B-Instruct	14.8	FP16	6.5 est.	Yes
Qwen2.5-Coder-14B-Instruct	14.8	FP16	6.5 est.	Yes
DeepSeek-R1-Distill-Qwen-14B	14.8	FP16	6.5 est.	Yes
Phi-4	14.7	FP16	6.5 est.	Yes
Phi-4-reasoning	14.7	FP16	6.5 est.	Yes
Qwen3-Coder-480B-A35B-Instruct	480.2	Q4	6.3 est.	No
MiniMax-M1	456.1	Q4	5.2 est.	No
Llama-3.1-70B-Instruct	70.6	Q4	5.0 est.	Yes
Llama-3.3-70B-Instruct	70.6	Q4	5.0 est.	Yes
DeepSeek-R1-Distill-Llama-70B	70.6	Q4	4.9 est.	Yes
Qwen2.5-72B-Instruct	72.7	Q4	4.8 est.	Yes
Mistral-Small-3.2-24B-Instruct-2506	24.0	FP16	4.0 est.	Yes
Magistral-Small-2509	24.0	FP16	4.0 est.	Yes
Devstral-Small-2507	23.6	FP16	4.0 est.	Yes
gemma-3-27b-it	27.4	FP16	3.5 est.	Yes
DeepSeek-V4-Flash	158.1	FP16	3.4 est.	No
DeepSeek-R1	684.5	Q4	3.0 est.	No
DeepSeek-V3.2	685.4	Q4	3.0 est.	No
Qwen3-32B	32.8	FP16	2.9 est.	Yes
Qwen2.5-32B-Instruct	32.8	FP16	2.9 est.	Yes
Qwen2.5-Coder-32B-Instruct	32.8	FP16	2.9 est.	Yes
DeepSeek-R1-Distill-Qwen-32B	32.8	FP16	2.9 est.	Yes
Llama-3.1-70B-Instruct	70.6	FP16	2.6 est.	No
Llama-3.3-70B-Instruct	70.6	FP16	2.6 est.	No
DeepSeek-R1-Distill-Llama-70B	70.6	FP16	2.6 est.	No
Qwen2.5-72B-Instruct	72.7	FP16	2.4 est.	No
GLM-5.1	753.9	Q4	2.3 est.	No
GLM-5.2	753.3	Q4	2.3 est.	No
MiniMax-M2.7	228.7	FP16	2.1 est.	No
DeepSeek-V4-Pro	861.6	Q4	1.4 est.	No
Qwen3-235B-A22B	235.1	FP16	0.9 est.	No
Qwen3-235B-A22B-Instruct-2507	235.1	FP16	0.9 est.	No
Llama-3.1-405B-Instruct	405.9	Q4	0.4 est.	No