← AI Hashrate 中文

Can Mac mini M4 32GB run Qwen3.6-35B-A3B-NVFP4?

Apple · 32 GB LPDDR5X · 120 GB/s bandwidth · nvidia · 21.6B (active 21.6B) · MoE · model ctx up to NoneK

✅ Yes — Mac mini M4 32GB (32 GB) can run Qwen3.6-35B-A3B-NVFP4 at Q4 (8K)
VRAM: 17.2 GB needed of 32 GB
Speed: ~7.1 tok/s (estimated)
CC · WorkableComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
METAL
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K15.04 GBYes7.1 ± est.
Q48K default17.2 GBYes7.1 ± est.
Q432K30.16 GBYes7.1 ± est.
FP164K46.36 GBNo1.3 ± est.
FP168K default48.52 GBNo1.2 ± est.
FP1632K61.48 GBNo0.8 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededMac mini M4 32GB VRAM
Q411.88 GB4.32 GB1 GB17.2 GB32 GB
FP1643.2 GB4.32 GB1 GB48.52 GB32 GB

Other GPUs that run Qwen3.6-35B-A3B-NVFP4

All GPUs for Qwen3.6-35B-A3B-NVFP4 →

Other models for the Mac mini M4 32GB

All models on the Mac mini M4 32GB →