RunsOnMy ModelsGPUs & MacsBy VRAMAPI pricesVRAM calculatorNew

Can Qwen3.8 Flash Next run on the RTX 3080 12GB?

No. Even at 2-bit with 8K context, Qwen3.8 Flash Next needs about 63.9 GB, more than the 11.4 GB usable on the RTX 3080 12GB.

Memory by quant and context

Quant4K ctx8K ctx32K ctx128K ctxMax tok/s (est., 8K)
2-bit (Q2_K)63.8 GB No63.9 GB No64.5 GB No66.7 GB No—
3-bit (Q3_K_M)82.9 GB No83.0 GB No83.6 GB No85.8 GB No—
4-bit (Q4_K_M)103 GB No104 GB No104 GB No106 GB No—
5-bit (Q5_K_M)120 GB No121 GB No121 GB No123 GB No—
6-bit (Q6_K)138 GB No139 GB No139 GB No141 GB No—
8-bit (Q8_0) •176 GB No176 GB No177 GB No179 GB No—
16-bit (F16/BF16) •331 GB No331 GB No331 GB No334 GB No—

• real GGUF file size from unsloth/Qwen3.8-Flash-Next-GGUF. Speed is a bandwidth ceiling (912 GB/s), not a benchmark. Methodology.

Hardware that does fit it

A100 80GBH100 PCIeH100 SXMRTX PRO 6000 BlackwellMac M2 Max 96GBDGX Spark

More

Qwen3.8 Flash Next on every GPU and Mac · Every model that runs on the RTX 3080 12GB · Other models that fit 12 GB VRAM · Try other settings in the calculator

Data: Hugging Face Hub (Qwen/Qwen3.8-Flash-Next), NVIDIA specs. Data as of 2026-11-17.