RunsOnMy ModelsGPUs & MacsBy VRAMBest GPUCan I run…?API pricesVRAM calculatorNew

Can I run Nex N2.6 on my PC?

New release: Nex N2.6 was published on Hugging Face on Nov 10, 2026 by nex-agi. Numbers update hourly as GGUF files appear. See everything new this week.

Nex N2.6 (321B, 18B active) needs about 188 GB of GPU memory at 4-bit with an 8K context. No single consumer GPU we track runs it fully in VRAM at 4-bit. With llama.cpp offload, the smallest card that can run it is the RX 7600 with 128 GB of system RAM, at an estimated 6.1–11.4 tokens/sec (slow but usable). The smallest Mac that runs it is the Mac M3 Ultra 512GB.

188 GBneeded at 4-bit, 8K
1GPUs/Macs: fully in memory
33GPUs: with CPU offload
M3 Ultra 512GBsmallest Mac

Nex N2.6 on every GPU and Mac

Best quant that fits fully in memory at 8K context with a speed ceiling; otherwise the llama.cpp offload plan (system RAM needed, estimated speed from DDR4-3200 to DDR5-6000). Macs and unified-memory PCs share one pool, so offload adds nothing there. How offload is estimated.

HardwareMemoryVerdictDetails
RX 76008 GBOffload Q2_K, 128 GB RAM · ~6.1–11 tok/sdetails
RTX 40608 GBOffload Q2_K, 128 GB RAM · ~6.1–11 tok/sdetails
RTX 50608 GBOffload Q2_K, 128 GB RAM · ~6.4–12 tok/sdetails
RTX 3060 Ti8 GBOffload Q2_K, 128 GB RAM · ~6.4–12 tok/sdetails
RTX 4060 Ti 8GB8 GBOffload Q2_K, 128 GB RAM · ~6.1–11 tok/sdetails
RTX 30708 GBOffload Q2_K, 128 GB RAM · ~6.4–12 tok/sdetails
RTX 3080 10GB10 GBOffload Q2_K, 128 GB RAM · ~6.6–13 tok/sdetails
Arc B58012 GBOffload Q2_K, 128 GB RAM · ~6.6–13 tok/sdetails
RTX 3060 12GB12 GBOffload Q2_K, 128 GB RAM · ~6.4–12 tok/sdetails
RX 7700 XT12 GBOffload Q2_K, 128 GB RAM · ~6.5–12 tok/sdetails
RTX 507012 GBOffload Q2_K, 128 GB RAM · ~6.7–13 tok/sdetails
RTX 407012 GBOffload Q2_K, 128 GB RAM · ~6.6–13 tok/sdetails
RTX 4070 Super12 GBOffload Q2_K, 128 GB RAM · ~6.6–13 tok/sdetails
RTX 4070 Ti12 GBOffload Q2_K, 128 GB RAM · ~6.6–13 tok/sdetails
RTX 3080 12GB12 GBOffload Q2_K, 128 GB RAM · ~6.8–14 tok/sdetails
Arc A770 16GB16 GBOffload Q2_K, 128 GB RAM · ~6.8–13 tok/sdetails
RTX 5060 Ti 16GB16 GBOffload Q2_K, 128 GB RAM · ~6.7–13 tok/sdetails
RTX 4060 Ti 16GB16 GBOffload Q2_K, 128 GB RAM · ~6.4–12 tok/sdetails
RX 7800 XT16 GBOffload Q2_K, 128 GB RAM · ~6.9–13 tok/sdetails
RX 7900 GRE16 GBOffload Q2_K, 128 GB RAM · ~6.8–13 tok/sdetails
RX 907016 GBOffload Q2_K, 128 GB RAM · ~6.9–13 tok/sdetails
RX 9070 XT16 GBOffload Q2_K, 128 GB RAM · ~6.9–13 tok/sdetails
RTX 5070 Ti16 GBOffload Q2_K, 128 GB RAM · ~7.0–14 tok/sdetails
RTX 4070 Ti Super16 GBOffload Q2_K, 128 GB RAM · ~6.9–13 tok/sdetails
RTX 4080 Super16 GBOffload Q2_K, 128 GB RAM · ~6.9–14 tok/sdetails
RTX 508016 GBOffload Q2_K, 128 GB RAM · ~7.0–14 tok/sdetails
RTX 408016 GBOffload Q2_K, 128 GB RAM · ~6.9–14 tok/sdetails
RX 7900 XT20 GBOffload Q2_K, 128 GB RAM · ~7.3–14 tok/sdetails
RX 7900 XTX24 GBOffload Q2_K, 128 GB RAM · ~7.5–15 tok/sdetails
RTX 309024 GBOffload Q2_K, 128 GB RAM · ~7.5–15 tok/sdetails
RTX 409024 GBOffload Q2_K, 128 GB RAM · ~7.5–15 tok/sdetails
RTX 3090 Ti24 GBOffload Q2_K, 128 GB RAM · ~7.5–15 tok/sdetails
RTX 509032 GBOffload Q3_K_M, 128 GB RAM · ~6.4–13 tok/sdetails
DGX Spark128 GBNodetails
Ryzen AI Max+ 395 128GB128 GBNodetails
Mac M1 16GB16 GBNodetails
Mac M4 16GB16 GBNodetails
Mac M2 24GB24 GBNodetails
Mac M3 24GB24 GBNodetails
Mac M4 Pro 24GB24 GBNodetails
Mac M4 32GB32 GBNodetails
Mac M1 Pro 32GB32 GBNodetails
Mac M3 Pro 36GB36 GBNodetails
Mac M4 Pro 48GB48 GBNodetails
Mac M4 Pro 64GB64 GBNodetails
Mac M1 Max 64GB64 GBNodetails
Mac M4 Max 64GB64 GBNodetails
Mac M2 Max 96GB96 GBNodetails
Mac M3 Max 128GB128 GBNodetails
Mac M4 Max 128GB128 GBNodetails
Mac M2 Ultra 192GB192 GBQ2_K only (below 4-bit)details
Mac M3 Ultra 256GB256 GBQ3_K_M only (below 4-bit)details
Mac M3 Ultra 512GB512 GBQ8_0 · ~42 tok/sdetails

Questions

How much VRAM do I need for Nex N2.6?

About 188 GB at 4-bit (Q4_K_M) with an 8K context, including KV cache and runtime overhead. Longer contexts need more; the model page has the full table by quant and context.

Why can a mixture-of-experts model run on a smaller card?

Only 18B of its 321B parameters are used per token. llama.cpp's --n-cpu-moe keeps the expert weights of some layers in system RAM while attention and the KV cache stay on the GPU, so each token reads far less from slow RAM than a dense model of the same size would.

Other popular checks: Can I run gpt-oss-120b?Can I run gpt-oss-20b?Can I run Llama 70B?Can I run Qwen3?Can I run DeepSeek R1? · Best GPU by budget · Mac vs PC

Model data: Hugging Face Hub API and GGUF file sizes. GPU specs: vendor pages. Speeds are estimates, not benchmarks. Methodology · Report an error.