← AI Hashrate 中文

Can MI300X 192GB run Solar Open 2?

AMD · 192 GB HBM3 · 5300 GB/s bandwidth · Upstage · 250.0B (active 15.0B) · MoE · model ctx up to 1024K

✅ Yes — MI300X 192GB (192 GB) can run Solar Open 2 at Q4 (8K)
VRAM: 138.88 GB needed of 192 GB
Speed: ~333.6 tok/s (estimated)
BB · GoodComposite score: VRAM headroom × 0.5 + tok/s speed × 0.5. Q4 @ 8K context.
ROCM
Excellent for 💬 chatExcellent for ⌨️ codingExcellent for 📋 general
Estimates from memory-bandwidth formula; rows marked "measured" override. Methodology.

Fit & speed by quant and context

QuantContextVRAM neededFits?tok/s (decode)
Q44K138.69 GBYes333.6 ± est.
Q48K default138.88 GBYes333.6 ± est.
Q432K140.0 GBYes333.6 ± est.
FP164K501.19 GBNo25.9 ± est.
FP168K default501.38 GBNo25.9 ± est.
FP1632K502.5 GBNo25.8 ± est.

Fits = weights + KV(ctx) + 1 GB overhead ≤ 95% of VRAM. Measured anchors are context-agnostic; the fit verdict is recomputed per context. A missing tok/s means the model is far beyond this card (offload-only territory).

VRAM breakdown at 8K context

QuantWeightsKV cacheOverheadTotal neededMI300X 192GB VRAM
Q4137.5 GB0.38 GB1 GB138.88 GB192 GB
FP16500.0 GB0.38 GB1 GB501.38 GB192 GB

Other GPUs that run Solar Open 2

All GPUs for Solar Open 2 →

Other models for the MI300X 192GB

All models on the MI300X 192GB →