2026-08-14 · Mac · Apple M4 Max
A model scorecard round on M4 Max · 64 GB: 3 models across 2 task sets. Every round is listed in the model scorecard, with its results side by side in one table.
M4 Max · 64 GB · llama-cpp · 3 trials per task · 2026-08-14 · gezel e367f442 · catalog 0.1.29
General capability
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.8-27b-q4 | 27B | 33/33 (100%) | 8.2/10 (9 pieces) | 22.4 tok/s output 233 tok/s prefill | 256K | 27.6 GB |
| qwen3.6-27b-q4 | 27B | 32/33 (97%) | 7.9/10 (9 pieces) | 22.9 tok/s output 230 tok/s prefill | 256K | 29.0 GB |
| qwen3.6-35b-a3b-q4 | 35B | 31/33 (94%) | 8/10 (9 pieces) | 78.5 tok/s output 1,182 tok/s prefill | 256K | 26.0 GB |
Tasks in this set: 11.
Office and knowledge work
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.8-27b-q4 | 27B | 35/39 (90%) | 7.1/10 (26 pieces) | 22.4 tok/s output 233 tok/s prefill | 256K | 27.3 GB |
| qwen3.6-35b-a3b-q4 | 35B | 34/39 (87%) | 7/10 (27 pieces) | 78.5 tok/s output 1,182 tok/s prefill | 256K | 25.5 GB |
Not published — some tasks could not be measured on this round: qwen3.6-27b-q4 (1 task(s) unmeasured)
Tasks in this set: 13.