RunsOnMy ModelsGPUs & MacsBy VRAMBest GPUCan I run…?API pricesVRAM calculatorNew

Can Kimi K3.1 Pro run on the Mac M4 Pro 24GB?

No. Even at 2-bit with 8K context, Kimi K3.1 Pro needs about 972 GB, more than the 16.1 GB usable on the Mac M4 Pro 24GB.

On this machine the GPU and CPU share one memory pool, so CPU offload does not add room. A smaller quant, a shorter context or more memory are the options.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K)972 GB No972 GB No975 GB No985 GB No—
3-bit (Q3_K_M)1267 GB No1267 GB No1269 GB No1279 GB No—
4-bit (Q4_K_M)1584 GB No1584 GB No1587 GB No1596 GB No—
5-bit (Q5_K_M)1846 GB No1846 GB No1849 GB No1859 GB No—
6-bit (Q6_K)2124 GB No2125 GB No2127 GB No2137 GB No—
8-bit (Q8_0)2752 GB No2753 GB No2755 GB No2765 GB No—
16-bit (F16/BF16)5179 GB No5180 GB No5182 GB No5192 GB No—

• real GGUF file size. Speed is a bandwidth ceiling (273 GB/s), not a benchmark. Methodology.

What fits instead

"Runs" and "fits" mean the whole model in GPU memory at 8K context (4-bit or better for the model pick). Prices are US launch MSRPs, not today's street prices. "Popular" means the 60 most-downloaded models we track.

More

Kimi K3.1 Pro on every GPU and Mac · Every model that runs on the Mac M4 Pro 24GB · Apple Silicon guide · Try other settings in the calculator

Guides: Best GPU for local LLMs by budget · Can I run gpt-oss, Llama 70B or Qwen3? · Mac vs PC for local LLMs

Data: Hugging Face Hub (moonshotai/Kimi-K3.1-Pro), Apple specs. Model data last checked 2026-11-17; refreshed hourly.