← AI Hashrate 中文

Can Ryzen AI Max+ 395 128GB run gemma-3-27b-it?

AMD · 96 GB LPDDR5X · 215 GB/s bandwidth · Google · 27.4B · model ctx up to 128K

✅ Yes — Ryzen AI Max+ 395 128GB (96 GB) can run gemma-3-27b-it at Q4 (8K)
VRAM: 21.82 GB needed of 96 GB
Speed: ~7.9 tok/s (estimated)
BB · GoodComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
ROCM
Slow for 💬 chatSlow for ⌨️ codingWorkable for 📋 general
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K19.08 GBYes7.9 ± est.
Q48K default21.82 GBYes7.9 ± est.
Q432K38.26 GBYes7.9 ± est.
FP164K58.54 GBYes2.2 ± est.
FP168K default61.28 GBYes2.2 ± est.
FP1632K77.72 GBNo3.4 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededRyzen AI Max+ 395 128GB VRAM
Q415.34 GB5.48 GB1 GB21.82 GB96 GB
FP1654.8 GB5.48 GB1 GB61.28 GB96 GB

Other GPUs that run gemma-3-27b-it

All GPUs for gemma-3-27b-it →

Other models for the Ryzen AI Max+ 395 128GB

All models on the Ryzen AI Max+ 395 128GB →