← AI Hashrate 中文

Can MacBook Pro M1 Max 32GB run Nanbeige4.2-3B?

Apple · 32 GB LPDDR5 · 400 GB/s bandwidth · Nanbeige · 4.0B · model ctx up to 128K

✅ Yes — MacBook Pro M1 Max 32GB (32 GB) can run Nanbeige4.2-3B at Q4 (8K)
VRAM: 4.08 GB needed of 32 GB
Speed: ~141.0 tok/s (estimated)
SS · ExcellentComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
METAL
Excellent for 💬 chatExcellent for ⌨️ codingExcellent for 📋 general
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K3.64 GBYes141.0 ± est.
Q48K default4.08 GBYes141.0 ± est.
Q432K6.7 GBYes141.0 ± est.
FP164K9.44 GBYes38.8 ± est.
FP168K default9.88 GBYes38.8 ± est.
FP1632K12.5 GBYes38.8 ± est.

Fits = weights + KV(ctx) + 0.5 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededMacBook Pro M1 Max 32GB VRAM
Q42.2 GB0.88 GB0.5 GB4.08 GB32 GB
FP168.0 GB0.88 GB0.5 GB9.88 GB32 GB

Other GPUs that run Nanbeige4.2-3B

All GPUs for Nanbeige4.2-3B →

Other models for the MacBook Pro M1 Max 32GB

All models on the MacBook Pro M1 Max 32GB →