2026-08-20 · Mac · Apple M4 Max
A model scorecard round on M4 Max · 64 GB: 6 models across 2 task sets. Every round is listed in the model scorecard, with its results side by side in one table.
M4 Max · 64 GB · llama-cpp + mlx · 3 trials per task · 2026-08-20 · gezel 3bccbb5d · catalog 0.1.36+local.8c5b93111.qwen3.8-ud
General capability
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.8-27b-q3 (kv: q8_0) | 27B | 33/33 (100%) | 8.5/10 (6 pieces) | 22.9 tok/s output 227 tok/s prefill | 256K | 24.1 GB |
| qwen3.8-27b-q4 (kv: q8_0) | 27B | 33/33 (100%) | 8.2/10 (9 pieces) | 22.9 tok/s output 227 tok/s prefill | 256K | 26.9 GB |
| gemma4-31b-q4 (kv: f16) | 30.7B | 32/33 (97%) | 6.2/10 (9 pieces) | 22.1 tok/s output 196 tok/s prefill | 256K | 45.8 GB |
| qwen3.8-27b-q6 (kv: q8_0) | 27B | 32/33 (97%) | 8/10 (7 pieces) | 18.8 tok/s output 227 tok/s prefill | 256K | 33.2 GB |
| qwen3.8-27b-q8 (kv: q8_0) | 27B | 32/33 (97%) | 8.3/10 (6 pieces) | 13.4 tok/s output 219 tok/s prefill | 256K | 38.5 GB |
| qwen3.6-35b-a3b-q4 (kv: q8_0) | 35B | 31/33 (94%) | 8/10 (9 pieces) | 75.6 tok/s output 1,156 tok/s prefill | 256K | 25.4 GB |
Tasks in this set: 11.
Office and knowledge work
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.8-27b-q3 (kv: q8_0) | 27B | 35/39 (90%) | 7.5/10 (24 pieces) | 22.9 tok/s output 227 tok/s prefill | 256K | 22.9 GB |
| qwen3.8-27b-q4 (kv: q8_0) | 27B | 35/39 (90%) | 6.9/10 (25 pieces) | 22.9 tok/s output 227 tok/s prefill | 256K | 27.1 GB |
| qwen3.8-27b-q6 (kv: q8_0) | 27B | 35/39 (90%) | 7.1/10 (25 pieces) | 18.8 tok/s output 227 tok/s prefill | 256K | 32.6 GB |
| qwen3.6-35b-a3b-q4 (kv: q8_0) | 35B | 33/39 (85%) | 6.9/10 (24 pieces) | 75.6 tok/s output 1,156 tok/s prefill | 256K | 25.1 GB |
| qwen3.8-27b-q8 (kv: q8_0) | 27B | 33/39 (85%) | 7.3/10 (24 pieces) | 13.4 tok/s output 219 tok/s prefill | 256K | 37.6 GB |
| gemma4-31b-q4 (kv: f16) | 30.7B | 28/39 (72%) | 6.4/10 (19 pieces) | 22.1 tok/s output 196 tok/s prefill | 256K | 45.7 GB |
Tasks in this set: 13.