GLM 5.2 (IQ2_XXS)

antirez's routed 2-bit community GGUF of Z.ai's GLM 5.2 — a 754B-parameter Mixture-of-Experts (256 experts, 8 active per token, ~40B active) with a 1M-token context and DeepSeek-style sparse attention. The routed experts are crushed to IQ2_XXS (block 78 in Q2_K) while attention, the shared expert, embeddings, and the output head stay at Q8-class precision, landing the file at ~197 GB. Only ~20 GB of that is non-routed weight that must stay resident: DwarfStar streams the remaining ~177 GB of experts from SSD, so it runs on a 128 GB machine — but it is a very large download and a slow first turn. Built for antirez's ds4 engine; these quants do not load on stock llama.cpp.

Gezel downloads this model the first time a gezel needs it, checks the file against its published hash, and applies tuned settings for it.

The model’s own page · Every model · Model scorecard