Mac Studio M2 Ultra 192GB vs MI300X 192GB for Local LLMs
The MI300X 192GB has about 562% more memory bandwidth (5,300 vs 800 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 562% faster on the MI300X 192GB. Both fit the same number of catalog models at Q4/8K (50 of 61; 192 vs 192 GB VRAM). MSRP is $6,999 for the Mac Studio M2 Ultra 192GB vs $15,000 for the MI300X 192GB. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. Not retail-shoppable: MI300X 192GB (datacenter-class; cloud rental is the realistic way to use it). In the Q4/8K head-to-head below (61 shared models), the MI300X 192GB posts the higher tok/s in 61 rows vs 0. Methodology.