RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can GLM 5.1 run on the Arc A770 16GB?

No. Even at 2-bit with 8K context, GLM 5.1 needs about 265 GB, more than the 15.2 GB usable on the Arc A770 16GB.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K)264 GB No265 GB No267 GB No277 GB No—
3-bit (Q3_K_M) •316 GB No317 GB No319 GB No329 GB No—
4-bit (Q4_K_M) •434 GB No434 GB No437 GB No447 GB No—
5-bit (Q5_K_M) •521 GB No522 GB No524 GB No534 GB No—
6-bit (Q6_K) •580 GB No580 GB No583 GB No593 GB No—
8-bit (Q8_0) •747 GB No748 GB No750 GB No760 GB No—
16-bit (F16/BF16) •1406 GB No1406 GB No1408 GB No1419 GB No—

• real GGUF file size from unsloth/GLM-5.1-GGUF. Speed is a bandwidth ceiling (560 GB/s), not a benchmark. Methodology.

Hardware that does fit it

Mac M3 Ultra 512GB

More

GLM 5.1 on every GPU and Mac · Every model that runs on the Arc A770 16GB · Other models that fit 16 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (zai-org/GLM-5.1), Intel specs. Data as of 2026-11-17.