← AI Hashrate 中文

Can RX 7900 GRE 16GB run Nanbeige4.2-3B?

AMD · 16 GB GDDR6 · 576 GB/s bandwidth · Nanbeige · 4.0B · model ctx up to 128K

✅ Yes — RX 7900 GRE 16GB (16 GB) can run Nanbeige4.2-3B at Q4 (8K)
VRAM: 4.08 GB needed of 16 GB
Speed: ~159.0 tok/s (estimated)
SS · ExcellentComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
ROCM
Excellent for 💬 chatExcellent for ⌨️ codingExcellent for 📋 general
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K3.64 GBYes159.0 ± est.
Q48K default4.08 GBYes159.0 ± est.
Q432K6.7 GBYes159.0 ± est.
FP164K9.44 GBYes43.7 ± est.
FP168K default9.88 GBYes43.7 ± est.
FP1632K12.5 GBYes43.7 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededRX 7900 GRE 16GB VRAM
Q42.2 GB0.88 GB1 GB4.08 GB16 GB
FP168.0 GB0.88 GB1 GB9.88 GB16 GB

Other GPUs that run Nanbeige4.2-3B

All GPUs for Nanbeige4.2-3B →

Other models for the RX 7900 GRE 16GB

All models on the RX 7900 GRE 16GB →