Ranked by $/tok/s — cost per token per second running Qwen3-8B (Q4, 8K). Lower is better value. Used price estimated at 55-65% of original MSRP. This is a hardware-only comparison; real-world value depends on your use case. Methodology.
| # | GPU | VRAM | Bandwidth | tok/s | Fit | New $ | Used $ | $/tok/s (new) | $/tok/s (used) |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Tesla P4 8GB | 8GB | 192 GB/s | 14.9 | fits | $80 | $44 | $5.4 | $3.0 |
| 2 | Arc B580 12GB | 12GB | 456 GB/s | 35.4 | fits | $249 | $137 | $7.0 | $3.9 |
| 3 | Arc B570 10GB | 10GB | 380 GB/s | 29.5 | fits | $219 | $142 | $7.4 | $4.8 |
| 4 | Arc A770 16GB | 16GB | 560 GB/s | 43.5 | fits | $349 | $192 | $8.0 | $4.4 |
| 5 | RTX 5060 8GB | 8GB | 448 GB/s | 34.8 | fits | $299 | $194 | $8.6 | $5.6 |
| 6 | RX 7800 XT 16GB | 16GB | 624 GB/s | 48.4 | fits | $499 | $274 | $10.3 | $5.7 |
| 7 | RTX 5070 12GB | 12GB | 672 GB/s | 52.2 | fits | $549 | $357 | $10.5 | $6.8 |
| 8 | RTX 5070 Ti 16GB | 16GB | 896 GB/s | 69.5 | fits | $749 | $487 | $10.8 | $7.0 |
| 9 | RTX 5060 Ti 8GB | 8GB | 448 GB/s | 34.8 | fits | $379 | $246 | $10.9 | $7.1 |
| 10 | RX 9070 16GB | 16GB | 640 GB/s | 49.7 | fits | $549 | $357 | $11.0 | $7.2 |
| 11 | RTX 3080 10GB | 10GB | 760 GB/s | 59.0 | fits | $699 | $384 | $11.8 | $6.5 |
| 12 | RTX 3060 12GB Buy | 12GB | 360 GB/s | 27.9 | fits | $329 | $181 | $11.8 | $6.5 |
| 13 | RX 7600 8GB | 8GB | 288 GB/s | 22.4 | fits | $269 | $148 | $12.0 | $6.6 |
| 14 | RX 9070 XT 16GB | 16GB | 640 GB/s | 49.7 | fits | $599 | $389 | $12.1 | $7.8 |
| 15 | RTX 5060 Ti 16GB | 16GB | 448 GB/s | 34.8 | fits | $429 | $279 | $12.3 | $8.0 |
| 16 | RX 7900 GRE 16GB | 16GB | 576 GB/s | 44.7 | fits | $549 | $302 | $12.3 | $6.8 |
| 17 | RTX 5080 16GB Buy | 16GB | 960 GB/s | 74.5 | fits | $999 | $649 | $13.4 | $8.7 |
| 18 | RX 7900 XTX 24GB Buy | 24GB | 960 GB/s | 74.5 | fits | $999 | $549 | $13.4 | $7.4 |
| 19 | RX 7700 XT 12GB | 12GB | 432 GB/s | 33.5 | fits | $449 | $247 | $13.4 | $7.4 |
| 20 | RTX 4060 8GB | 8GB | 272 GB/s | 21.1 | fits | $299 | $164 | $14.2 | $7.8 |
| 21 | RTX 3070 8GB | 8GB | 448 GB/s | 34.8 | fits | $499 | $274 | $14.3 | $7.9 |
| 22 | RTX 5090 32GB | 32GB | 1792 GB/s | 139.1 | fits | $1,999 | $1,299 | $14.4 | $9.3 |
| 23 | RX 7900 XT 20GB | 20GB | 800 GB/s | 62.1 | fits | $899 | $494 | $14.5 | $8.0 |
| 24 | RX 7600 XT 16GB | 16GB | 288 GB/s | 22.4 | fits | $329 | $181 | $14.7 | $8.1 |
| 25 | RTX 4070 12GB Buy | 12GB | 504 GB/s | 39.1 | fits | $599 | $329 | $15.3 | $8.4 |
| 26 | RTX 4070 Super 12GB | 12GB | 504 GB/s | 39.1 | fits | $599 | $329 | $15.3 | $8.4 |
| 27 | RTX 4070 Ti Super 16GB | 16GB | 672 GB/s | 52.2 | fits | $799 | $439 | $15.3 | $8.4 |
| 28 | RTX 4080 Super 16GB Buy | 16GB | 736 GB/s | 57.1 | fits | $999 | $549 | $17.5 | $9.6 |
| 29 | RTX 4060 Ti 8GB | 8GB | 288 GB/s | 22.4 | fits | $399 | $219 | $17.8 | $9.8 |
| 30 | RTX 4070 Ti 12GB | 12GB | 554 GB/s | 43.0 | fits | $799 | $439 | $18.6 | $10.2 |
| 31 | RTX 4090 24GB Buy | 24GB | 1008 GB/s | 78.2 | fits | $1,599 | $879 | $20.4 | $11.2 |
| 32 | RTX 4090D 24GB (China) | 24GB | 1008 GB/s | 78.2 | fits | $1,599 | $879 | $20.4 | $11.2 |
| 33 | RTX 3090 24GB Buy | 24GB | 936 GB/s | 72.6 | fits | $1,499 | $824 | $20.6 | $11.3 |
| 34 | Arc Pro B70 32GB | 32GB | 608 GB/s | 47.2 | fits | $999 | $649 | $21.2 | $13.8 |
| 35 | RTX 4060 Ti 16GB | 16GB | 288 GB/s | 22.4 | fits | $499 | $274 | $22.3 | $12.2 |
| 36 | RTX 3090 Ti 24GB | 24GB | 1008 GB/s | 78.2 | fits | $1,999 | $1,099 | $25.6 | $14.1 |
| 37 | Titan Xp 12GB | 12GB | 548 GB/s | 42.5 | fits | $1,200 | $660 | $28.2 | $15.5 |
| 38 | Titan X Pascal 12GB | 12GB | 480 GB/s | 37.3 | fits | $1,200 | $660 | $32.2 | $17.7 |
| 39 | MI300X 192GB | 192GB | 5300 GB/s | 411.3 | fits | $15,000 | $8,250 | $36.5 | $20.1 |
| 40 | Gaudi 3 128GB | 128GB | 3276 GB/s | 254.2 | fits | $12,500 | $6,875 | $49.2 | $27.0 |
| 41 | Titan V 12GB | 12GB | 653 GB/s | 50.7 | fits | $2,999 | $1,649 | $59.2 | $32.5 |
| 42 | Mac Studio M3 Ultra 96GB | 96GB | 819 GB/s | 63.6 | fits | $3,999 | $2,599 | $62.9 | $40.9 |
| 43 | B200 192GB SXM | 192GB | 8000 GB/s | 620.8 | fits | $40,000 | $26,000 | $64.4 | $41.9 |
| 44 | RTX A6000 48GB | 48GB | 768 GB/s | 59.6 | fits | $4,500 | $2,475 | $75.5 | $41.5 |
| 45 | DGX Spark (GH200 480GB) | 480GB | 500 GB/s | 38.8 | fits | $3,000 | $1,950 | $77.3 | $50.3 |
| 46 | Ryzen AI Max 390 64GB | 48GB | 215 GB/s | 16.7 | fits | $1,300 | $845 | $77.8 | $50.6 |
| 47 | T4 16GB | 16GB | 320 GB/s | 24.8 | fits | $2,000 | $1,100 | $80.6 | $44.4 |
| 48 | Ryzen AI Max+ 395 64GB | 48GB | 215 GB/s | 16.7 | fits | $1,500 | $975 | $89.8 | $58.4 |
| 49 | RTX 6000 Ada 48GB | 48GB | 960 GB/s | 74.5 | fits | $6,800 | $3,740 | $91.3 | $50.2 |
| 50 | H200 141GB SXM5 | 141GB | 4800 GB/s | 372.5 | fits | $35,000 | $19,250 | $94.0 | $51.7 |
| 51 | A100 80GB SXM4 | 80GB | 2039 GB/s | 158.2 | fits | $15,000 | $8,250 | $94.8 | $52.1 |
| 52 | Mac mini M4 Pro 64GB | 64GB | 273 GB/s | 21.2 | fits | $2,199 | $1,209 | $103.7 | $57.0 |
| 53 | MacBook Pro M4 Max 128GB | 128GB | 546 GB/s | 42.4 | fits | $4,399 | $2,419 | $103.8 | $57.1 |
| 54 | MacBook Pro M1 Max 32GB | 32GB | 400 GB/s | 31.0 | fits | $3,299 | $1,814 | $106.4 | $58.5 |
| 55 | Mac mini M4 32GB | 32GB | 120 GB/s | 9.3 | fits | $999 | $549 | $107.4 | $59.0 |
| 56 | Mac Studio M2 Ultra 192GB | 192GB | 800 GB/s | 62.1 | fits | $6,999 | $3,849 | $112.7 | $62.0 |
| 57 | H100 80GB SXM5 | 80GB | 3350 GB/s | 260.0 | fits | $30,000 | $16,500 | $115.4 | $63.5 |
| 58 | L40S 48GB | 48GB | 864 GB/s | 67.1 | fits | $8,000 | $4,400 | $119.2 | $65.6 |
| 59 | Ryzen AI Max+ 395 128GB | 96GB | 215 GB/s | 16.7 | fits | $2,000 | $1,300 | $119.8 | $77.8 |
| 60 | MacBook Pro M1 Max 64GB | 64GB | 400 GB/s | 31.0 | fits | $3,899 | $2,144 | $125.8 | $69.2 |
| 61 | MacBook Pro M3 Max 128GB | 128GB | 400 GB/s | 31.0 | fits | $4,199 | $2,309 | $135.5 | $74.5 |