RTX 4090D 24GB (China) vs RX 7900 GRE 16GB for Local LLMs
The RTX 4090D 24GB (China) has about 75% more memory bandwidth (1,008 vs 576 GB/s). Batch-1 decode tracks bandwidth closely, so a model that fits both cards should decode roughly 75% faster on the RTX 4090D 24GB (China). The RTX 4090D 24GB (China) fits more of the catalog at Q4/8K — 33 vs 25 of 61 models (24 vs 16 GB VRAM). Largest model that fits the RTX 4090D 24GB (China) but not the RX 7900 GRE 16GB: GLM-4.7-Flash (31.2B). MSRP is $1,599 for the RTX 4090D 24GB (China) vs $549 for the RX 7900 GRE 16GB. MSRP is a launch list price, not live retail — Amazon prices move; click through for the current price. Not retail-shoppable: RTX 4090D 24GB (China) (datacenter-class; cloud rental is the realistic way to use it). In the Q4/8K head-to-head below (44 shared models), the RTX 4090D 24GB (China) posts the higher tok/s in 37 rows vs 7. Methodology.