RTX 3090 Ti 24GB vs RTX 4070 Super 12GB for Local LLMs
The RTX 3090 Ti 24GB has about 100% more memory bandwidth (1,008 vs 504 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 100% faster on the RTX 3090 Ti 24GB. The RTX 3090 Ti 24GB fits more of the catalog at Q4/8K — 33 vs 18 of 61 models (24 vs 12 GB VRAM). Largest model that fits the RTX 3090 Ti 24GB but not the RTX 4070 Super 12GB: GLM-4.7-Flash (31.2B). MSRP is $1,999 for the RTX 3090 Ti 24GB vs $599 for the RTX 4070 Super 12GB. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. In the Q4/8K head-to-head below (40 shared models), the RTX 3090 Ti 24GB posts the higher tok/s in 33 rows vs 7. Methodology.