2026-08-26 · Mac · Apple M4 Max
A model scorecard round on M4 Max · 64 GB: 4 models across 2 task sets. Every round is listed in the model scorecard, with its results side by side in one table.
M4 Max · 64 GB · llama-cpp + mlx · 3 trials per task · 2026-08-26 · gezel d1d5e5c0 · catalog 0.1.42
General capability
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.8-27b-q2 (kv: q8_0) | 27B | 32/33 (97%) | 7.9/10 (9 pieces) | 24.1 tok/s output 241 tok/s prefill | 256K | 21.1 GB |
| qwen3.8-27b-q3 (kv: q8_0) | 27B | 32/33 (97%) | 8/10 (9 pieces) | 22.7 tok/s output 239 tok/s prefill | 256K | 24.5 GB |
| qwen3.8-27b-q4 (kv: q8_0) | 27B | 31/33 (94%) | 7.8/10 (17 pieces) | 21.9 tok/s output 232 tok/s prefill | 256K | 28.4 GB |
| qwen3.8-27b-q4 | 27B | 31/33 (94%) | 7.8/10 (17 pieces) | 68.4 tok/s output 232 tok/s prefill | — | — |
| qwen3.8-27b-iq1-s (kv: q8_0) | 27B | 14/33 (42%) | — | 11.1 tok/s output 190 tok/s prefill | 256K | 21.1 GB |
Tasks in this set: 11.
Office and knowledge work
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.8-27b-q4 (kv: q8_0) | 27B | 36/39 (92%) | 7.3/10 (53 pieces) | 21.9 tok/s output 232 tok/s prefill | 256K | 26.2 GB |
| qwen3.8-27b-q4 | 27B | 36/39 (92%) | 7.3/10 (53 pieces) | 68.4 tok/s output 232 tok/s prefill | — | — |
| qwen3.8-27b-q2 (kv: q8_0) | 27B | 35/39 (90%) | 7.3/10 (25 pieces) | 24.1 tok/s output 241 tok/s prefill | 256K | 19.8 GB |
| qwen3.8-27b-q3 (kv: q8_0) | 27B | 34/39 (87%) | 7.1/10 (27 pieces) | 22.7 tok/s output 239 tok/s prefill | 256K | 24.4 GB |
| qwen3.8-27b-iq1-s (kv: q8_0) | 27B | 14/39 (36%) | 3.9/10 (25 pieces) | 11.1 tok/s output 190 tok/s prefill | 256K | 20.2 GB |
Tasks in this set: 13.