RunsOnMy ModelsGPUs & MacsBy VRAMBest GPUCan I run…?OllamaStart hereAPI pricesVRAM calculatorNew

Can I run Hy4 Flash on my PC?

New release: Hy4 Flash was published on Hugging Face on Nov 17, 2026 by tencent. Numbers update hourly as GGUF files appear. See everything new this week.

Hy4 Flash (220B, 4.4B active) needs about 126 GB of GPU memory at 4-bit with an 8K context. No single consumer GPU we track runs it fully in VRAM at 4-bit. With llama.cpp offload, the smallest card that can run it is the RX 7600 with 128 GB of system RAM. The smallest Mac that runs it is the Mac M2 Ultra 192GB.

126 GBneeded at 4-bit, 8K
3GPUs/Macs: fully in memory
33GPUs: with CPU offload
M2 Ultra 192GBsmallest Mac

Hy4 Flash system requirements

GPU memory at 4-bit, 8K contextAbout 126 GB
Cheapest GPU that runs it fully in VRAMNo single consumer GPU
Smallest Mac that runs itMac M2 Ultra 192GB
Smallest GPU with CPU offloadThe RX 7600 with a 128 GB RAM system (command)

Hy4 Flash on every GPU and Mac

Best quant that fits fully in memory at 8K context with a speed ceiling; otherwise the llama.cpp offload plan (system RAM needed, estimated speed from DDR4-3200 to DDR5-6000). Macs and unified-memory PCs share one pool, so offload adds nothing there. How offload is estimated.

HardwareMemoryVerdictDetails
RX 76008 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 40608 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 50608 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 3060 Ti8 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 4060 Ti 8GB8 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 30708 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 3080 10GB10 GBOffload Q4_K_M, 128 GB RAMdetails
Arc B58012 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 3060 12GB12 GBOffload Q4_K_M, 128 GB RAMdetails
RX 7700 XT12 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 507012 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 407012 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 4070 Super12 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 4070 Ti12 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 3080 12GB12 GBOffload Q4_K_M, 128 GB RAMdetails
Arc A770 16GB16 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 5060 Ti 16GB16 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 4060 Ti 16GB16 GBOffload Q4_K_M, 128 GB RAMdetails
RX 7800 XT16 GBOffload Q4_K_M, 128 GB RAMdetails
RX 7900 GRE16 GBOffload Q4_K_M, 128 GB RAMdetails
RX 907016 GBOffload Q4_K_M, 128 GB RAMdetails
RX 9070 XT16 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 5070 Ti16 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 4070 Ti Super16 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 4080 Super16 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 508016 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 408016 GBOffload Q4_K_M, 128 GB RAMdetails
RX 7900 XT20 GBOffload Q4_K_M, 128 GB RAMdetails
RX 7900 XTX24 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 309024 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 409024 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 3090 Ti24 GBOffload Q4_K_M, 128 GB RAMdetails
RTX 509032 GBOffload Q4_K_M, 128 GB RAMdetails
DGX Spark128 GBQ2_K only (below 4-bit)details
Ryzen AI Max+ 395 128GB128 GBQ2_K only (below 4-bit)details
Mac M1 16GB16 GBNodetails
Mac M4 16GB16 GBNodetails
Mac M2 24GB24 GBNodetails
Mac M3 24GB24 GBNodetails
Mac M4 Pro 24GB24 GBNodetails
Mac M4 32GB32 GBNodetails
Mac M1 Pro 32GB32 GBNodetails
Mac M3 Pro 36GB36 GBNodetails
Mac M4 Pro 48GB48 GBNodetails
Mac M4 Pro 64GB64 GBNodetails
Mac M1 Max 64GB64 GBNodetails
Mac M4 Max 64GB64 GBNodetails
Mac M2 Max 96GB96 GBNodetails
Mac M3 Max 128GB128 GBQ2_K only (below 4-bit)details
Mac M4 Max 128GB128 GBQ2_K only (below 4-bit)details
Mac M2 Ultra 192GB192 GBQ4_K_Mdetails
Mac M3 Ultra 256GB256 GBQ6_Kdetails
Mac M3 Ultra 512GB512 GBQ8_0details

Questions

How much VRAM do I need for Hy4 Flash?

About 126 GB at 4-bit (Q4_K_M) with an 8K context, including KV cache and runtime overhead. Longer contexts need more; the model page has the full table by quant and context.

Why can a mixture-of-experts model run on a smaller card?

Only 4.4B of its 220B parameters are used per token. llama.cpp's --n-cpu-moe keeps the expert weights of some layers in system RAM while attention and the KV cache stay on the GPU, so each token reads far less from slow RAM than a dense model of the same size would.

Other popular checks: Can I run gpt-oss-120b?Can I run gpt-oss-20b?Can I run Llama 70B?Can I run Qwen3?Can I run DeepSeek R1? · Best GPU by budget · Mac vs PC

Model data: Hugging Face Hub API and GGUF file sizes. GPU specs: vendor pages. Speeds are estimates, not benchmarks. Methodology · Report an error.