MI300X 192GB vs Titan X Pascal 12GB for Local LLMs
The MI300X 192GB has about 1004% more memory bandwidth (5,300 vs 480 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 1004% faster on the MI300X 192GB. The MI300X 192GB fits more of the catalog at Q4/8K — 57 vs 18 of 69 models (192 vs 12 GB VRAM). Largest model that fits the MI300X 192GB but not the Titan X Pascal 12GB: MiMo-V2.5 (310.0B). MSRP is $15,000 for the MI300X 192GB vs $1,200 for the Titan X Pascal 12GB. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. Not retail-shoppable: MI300X 192GB (datacenter-class; cloud rental is the realistic way to use it). In the Q4/8K head-to-head below (41 shared models), the MI300X 192GB posts the higher tok/s in 41 rows vs 0. Methodology.