RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can GLM 5.3 run on the RTX 3060 12GB?

No. Even at 2-bit with 8K context, GLM 5.3 needs about 265 GB, more than the 11.4 GB usable on the RTX 3060 12GB.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K)264 GB No265 GB No267 GB No277 GB No—
3-bit (Q3_K_M)344 GB No344 GB No347 GB No357 GB No—
4-bit (Q4_K_M)430 GB No430 GB No433 GB No443 GB No—
5-bit (Q5_K_M)501 GB No501 GB No504 GB No514 GB No—
6-bit (Q6_K)576 GB No577 GB No579 GB No589 GB No—
8-bit (Q8_0) •747 GB No748 GB No750 GB No760 GB No—
16-bit (F16/BF16) •1406 GB No1406 GB No1408 GB No1419 GB No—

• real GGUF file size from unsloth/GLM-5.3-GGUF. Speed is a bandwidth ceiling (360 GB/s), not a benchmark. Methodology.

Hardware that does fit it

Mac M3 Ultra 512GB

More

GLM 5.3 on every GPU and Mac · Every model that runs on the RTX 3060 12GB · Other models that fit 12 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (zai-org/GLM-5.3), NVIDIA specs. Data as of 2026-11-17.