MiMo-V2.5 (Xiaomi) is a 310.0B parameters MoE (15.0B active per token) open-weight model tracked on AI Hashrate. At 8K context we estimate roughly 174.5 GB VRAM for Q4 (weights 170.5 GB + KV 3.0 GB + 1 GB overhead) and 624.0 GB for FP16. About 3 GPUs/accelerators in our catalog fully fit this model at Q4 under that context assumption. Fastest Q4 configs: B200 192GB SXM ≈ 339.4 tok/s (estimated); MI300X 192GB ≈ 224.8 tok/s (estimated); Mac Studio M2 Ultra 192GB ≈ 33.9 tok/s (estimated). Use the table below for VRAM fit and tok/s per dollar (list MSRP). Estimates follow memory-bandwidth math; measured rows override when present. See methodology for details. Methodology.
| Hardware | VRAM | Quant | tok/s | Fits? | tok/s/$ |
|---|---|---|---|---|---|
| H200 141GB SXM5 | 141 | Q4 | 379.9 est. | No | 0.011 |
| B200 192GB SXM | 192 | Q4 | 339.4 est. | Yes | 0.008 |
| MI300X 192GB | 192 | Q4 | 224.8 est. | Yes | 0.015 |
| Gaudi 3 128GB | 128 | Q4 | 213.7 est. | No | 0.017 |
| H100 80GB SXM5 | 80 | Q4 | 85.3 est. | No | 0.003 |
| A100 80GB SXM4 | 80 | Q4 | 51.9 est. | No | 0.003 |
| MacBook Pro M4 Max 128GB | 128 | Q4 | 35.6 est. | No | 0.008 |
| Mac Studio M2 Ultra 192GB | 192 | Q4 | 33.9 est. | Yes | 0.005 |
| Mac Studio M3 Ultra 96GB | 96 | Q4 | 30.0 est. | No | 0.008 |
| MacBook Pro M3 Max 128GB | 128 | Q4 | 26.1 est. | No | 0.006 |
| B200 192GB SXM | 192 | FP16 | 25.2 est. | No | 0.001 |
| MI300X 192GB | 192 | FP16 | 16.7 est. | No | 0.001 |
| RTX 6000 Ada 48GB | 48 | Q4 | 8.8 est. | No | 0.001 |
| L40S 48GB | 48 | Q4 | 7.9 est. | No | 0.001 |
| RTX A6000 48GB | 48 | Q4 | 7.0 est. | No | 0.002 |
| Mac mini M4 Pro 64GB | 64 | Q4 | 4.5 est. | No | 0.002 |
| Mac Studio M2 Ultra 192GB | 192 | FP16 | 2.5 est. | No | 0.0 |