RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can Kimi K3 run on the RTX 4070 Ti?

No. Even at 2-bit with 8K context, Kimi K3 needs about 972 GB, more than the 11.4 GB usable on the RTX 4070 Ti.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K)972 GB No972 GB No975 GB No985 GB No—
3-bit (Q3_K_M)1267 GB No1267 GB No1269 GB No1279 GB No—
4-bit (Q4_K_M)1584 GB No1584 GB No1587 GB No1596 GB No—
5-bit (Q5_K_M)1846 GB No1846 GB No1849 GB No1858 GB No—
6-bit (Q6_K)2124 GB No2125 GB No2127 GB No2137 GB No—
8-bit (Q8_0)2752 GB No2752 GB No2755 GB No2765 GB No—
16-bit (F16/BF16)5179 GB No5180 GB No5182 GB No5192 GB No—

• real GGUF file size. Speed is a bandwidth ceiling (504 GB/s), not a benchmark. Methodology.

More

Kimi K3 on every GPU and Mac · Every model that runs on the RTX 4070 Ti · Other models that fit 12 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (moonshotai/Kimi-K3), NVIDIA specs. Data as of 2026-11-17.