We treat '13B-class' as open-weight models with 12–20B parameters — 7 in our catalog. The table ranks every catalog GPU that fully fits at least one of them at Q4 / 8K context, by average estimated decode tok/s across the models it fits. Fit means weights + KV cache + 1 GB runtime overhead within 95% of VRAM — not weights alone. Methodology.
| # | GPU | VRAM (GB) | Bandwidth (GB/s) | MSRP | Fits | Avg Q4 tok/s | Buy |
|---|---|---|---|---|---|---|---|
| 1 | B200 192GB SXM | 192 | 8,000 | $40,000 | 7/7 | 356.1 est. | — |
| 2 | MI300X 192GB | 192 | 5,300 | $15,000 | 7/7 | 235.9 est. | — |
| 3 | H200 141GB SXM5 | 141 | 4,800 | $35,000 | 7/7 | 213.7 est. | — |
| 4 | H100 80GB SXM5 | 80 | 3,350 | $30,000 | 7/7 | 149.1 est. | — |
| 5 | Gaudi 3 128GB | 128 | 3,276 | $12,500 | 7/7 | 145.8 est. | — |
| 6 | A100 80GB SXM4 | 80 | 2,039 | $15,000 | 7/7 | 92.3 incl. measured | — |
| 7 | RTX 5090 32GB | 32 | 1,792 | $1,999 | 7/7 | 89.5 incl. measured | Search Amazon (affiliate) |
| 8 | RTX 4090 24GB | 24 | 1,008 | $1,599 | 7/7 | 62.5 incl. measured | GIGABYTE GeForce RTX 4090 Gaming OC 24GB (affiliate) · More listings |
| 9 | RX 7900 XTX 24GB | 24 | 960 | $999 | 7/7 | 45.7 incl. measured | ASRock Radeon RX 7900 XTX Phantom Gaming 24GB OC (affiliate) · More listings |
| 10 | RTX 3090 Ti 24GB | 24 | 1,008 | $1,999 | 7/7 | 44.8 est. | Search Amazon (affiliate) |
| 11 | RTX 4090D 24GB (China) | 24 | 1,008 | $1,599 | 7/7 | 44.8 est. | — |
| 12 | RTX 3090 24GB | 24 | 936 | $1,499 | 7/7 | 43.7 incl. measured | MSI GeForce RTX 3090 Ventus 3X 24G OC (affiliate) · More listings |
| 13 | RTX 5080 16GB | 16 | 960 | $999 | 7/7 | 42.8 est. | NVIDIA GeForce RTX 5080 Founders Edition (affiliate) · More listings |
| 14 | RTX 6000 Ada 48GB | 48 | 960 | $6,800 | 7/7 | 42.8 est. | Search Amazon (affiliate) |
| 15 | RTX 5070 Ti 16GB | 16 | 896 | $749 | 7/7 | 39.9 est. | Search Amazon (affiliate) |
| 16 | Mac Studio M3 Ultra 96GB | 96 | 819 | $3,999 | 7/7 | 38.8 incl. measured | Search Amazon (affiliate) |
| 17 | L40S 48GB | 48 | 864 | $8,000 | 7/7 | 38.4 est. | Search Amazon (affiliate) |
| 18 | Mac Studio M2 Ultra 192GB | 192 | 800 | $6,999 | 7/7 | 35.6 est. | Search Amazon (affiliate) |
| 19 | RTX 5070 12GB | 12 | 672 | $549 | 1/7 | 35.6 est. | Search Amazon (affiliate) |
| 20 | RX 7900 XT 20GB | 20 | 800 | $899 | 7/7 | 35.6 est. | Search Amazon (affiliate) |
| 21 | RTX A6000 48GB | 48 | 768 | $4,500 | 7/7 | 34.2 est. | Search Amazon (affiliate) |
| 22 | RTX 4070 Ti Super 16GB | 16 | 672 | $799 | 7/7 | 33.5 incl. measured | Search Amazon (affiliate) |
| 23 | RTX 4080 Super 16GB | 16 | 736 | $999 | 7/7 | 32.7 est. | ASUS ProArt GeForce RTX 4080 Super OC (affiliate) · More listings |
| 24 | RTX 4070 Ti 12GB | 12 | 554 | $799 | 1/7 | 29.4 est. | Search Amazon (affiliate) |
| 25 | RX 9070 16GB | 16 | 640 | $549 | 7/7 | 28.5 est. | Search Amazon (affiliate) |
| 26 | RX 9070 XT 16GB | 16 | 640 | $599 | 7/7 | 28.5 est. | Search Amazon (affiliate) |
| 27 | RX 7800 XT 16GB | 16 | 624 | $499 | 7/7 | 27.8 est. | Search Amazon (affiliate) |
| 28 | RTX 4070 12GB | 12 | 504 | $599 | 1/7 | 26.7 est. | ASUS Dual GeForce RTX 4070 OC 12GB (affiliate) · More listings |
| 29 | RTX 4070 Super 12GB | 12 | 504 | $599 | 1/7 | 26.7 est. | Search Amazon (affiliate) |
| 30 | RX 7900 GRE 16GB | 16 | 576 | $549 | 7/7 | 25.6 est. | Search Amazon (affiliate) |
| 31 | Arc A770 16GB | 16 | 560 | $349 | 7/7 | 24.9 est. | Search Amazon (affiliate) |
| 32 | MacBook Pro M4 Max 128GB | 128 | 546 | $4,399 | 7/7 | 24.3 est. | Search Amazon (affiliate) |
| 33 | Arc B580 12GB | 12 | 456 | $249 | 1/7 | 24.2 est. | Search Amazon (affiliate) |
| 34 | RX 7700 XT 12GB | 12 | 432 | $449 | 1/7 | 22.9 est. | Search Amazon (affiliate) |
| 35 | RTX 5060 Ti 16GB | 16 | 448 | $429 | 7/7 | 20.0 est. | Search Amazon (affiliate) |
| 36 | RTX 3060 12GB | 12 | 360 | $329 | 1/7 | 19.1 est. | MSI GeForce RTX 3060 Ventus 2X 12G OC (affiliate) · More listings |
| 37 | MacBook Pro M3 Max 128GB | 128 | 400 | $4,199 | 7/7 | 17.8 est. | Search Amazon (affiliate) |
| 38 | RTX 4060 Ti 16GB | 16 | 288 | $499 | 7/7 | 14.8 incl. measured | Search Amazon (affiliate) |
| 39 | T4 16GB | 16 | 320 | $2,000 | 7/7 | 14.3 est. | Search Amazon (affiliate) |
| 40 | RX 7600 XT 16GB | 16 | 288 | $329 | 7/7 | 12.8 est. | Search Amazon (affiliate) |
| 41 | Mac mini M4 Pro 64GB | 64 | 273 | $2,199 | 7/7 | 12.1 est. | Search Amazon (affiliate) |
| 42 | Mac mini M4 32GB | 32 | 120 | $999 | 7/7 | 5.4 est. | Search Amazon (affiliate) |