Qwen 3.8 Flash Next (180B-A6B, IQ3_XXS)

Qwen's experimental preview of the architecture behind Qwen4: a 125B-parameter MoE with 6B active per token, plus a 51B n-gram embedding table designed for cheap offload. This Unsloth UD-IQ3_XXS build is an 82 GB split GGUF whose 26.8 GiB n-gram table can be demand-paged; it is the practical variant for 64 GB system RAM plus a 32 GB-class discrete GPU. Gezel starts it conservatively at 64K context and one slot, then chooses the expert GPU/CPU split from the machine's measured VRAM.

Gezel downloads this model the first time a gezel needs it, checks the file against its published hash, and applies tuned settings for it.

The model’s own page · Every model · Model scorecard