DeepSeek V4 Flash (mixed 2/4-bit)

antirez's mixed-precision community GGUF of DeepSeek V4 Flash 0731 — the July 2026 re-post-trained 284B-parameter Mixture-of-Experts (~13B active per token) with 1M-token context and Compressed Sparse Attention. Layers 37-42 keep Q4_K routed experts while the remaining expert layers drop to IQ2_XXS gate/up + Q2_K down, landing at ~98 GB. This is the quality/size sweet spot antirez recommends for 128 GB MacBooks: noticeably better than the straight 2-bit build without the ~156 GB footprint of the full Q4_K one. Produced for antirez's ds4 inference engine; whether it loads on stock llama depends on its DeepSeek-V4 support.

Gezel downloads this model the first time a gezel needs it, checks the file against its published hash, and applies tuned settings for it.

The model’s own page · Every model · Model scorecard