Can MacBook Pro M4 Max 128GB run Qwen3-235B-A22B-Instruct-2507?
Apple · 128 GB LPDDR5X · 546 GB/s bandwidth ·
Alibaba · 235.1B (active 22B) · MoE · model ctx up to 256K
No — Qwen3-235B-A22B-Instruct-2507 at Q4 needs ≈ 132.5 GB even at 4K context, beyond the MacBook Pro M4 Max 128GB's 128 GB LPDDR5X. It would only run with heavy CPU/disk offload. Decode at Q4/8K: ≈ 40.7 tok/s (estimated, batch 1). FP16 needs ≈ 475.6 GB — does not fit on this card. Estimates come from memory-bandwidth math; rows tagged measured override estimates. Relative ranking is more reliable than absolute tok/s. Methodology.
Fit & speed by quant and context
Quant
Context
VRAM needed
Fits?
tok/s (decode)
Q4
4K
132.5 GB
No
42.1est.
Q4
8K default
134.71 GB
No
40.7est.
Q4
32K
147.91 GB
No
33.8est.
FP16
4K
473.4 GB
No
0.9est.
FP16
8K default
475.6 GB
No
0.9est.
FP16
32K
488.8 GB
No
0.9est.
Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured
anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s
means the model is far beyond this card (offload-only territory).