2026-08-11 · Mac · Apple M4 Max
A model scorecard round on M4 Max · 64 GB: 5 models across 2 task sets. Every round is listed in the model scorecard, with its results side by side in one table.
M4 Max · 64 GB · llama-cpp · 3 trials per task · 2026-08-11 · gezel b2ea2819 · catalog 0.1.20
General capability
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| gemma4-26b-q4 | 25.2B | 33/33 (100%) | 6.4/10 (9 pieces) | 89.6 tok/s output 1,093 tok/s prefill | 118K | 40.9 GB |
| qwen3.6-27b-q4 | 27B | 33/33 (100%) | 8/10 (9 pieces) | 18.5 tok/s output 198 tok/s prefill | 256K | 26.4 GB |
| qwen3.6-35b-a3b-q4 | 35B | 32/33 (97%) | 8.2/10 (9 pieces) | 76.4 tok/s output 1,125 tok/s prefill | 256K | 26.5 GB |
| gemma4-31b-q4 | 30.7B | 31/33 (94%) | 6.7/10 (9 pieces) | 23.3 tok/s output 202 tok/s prefill | 256K | 43.1 GB |
| gemma4-e4b-q4 | 8B | 31/33 (94%) | 4.7/10 (9 pieces) | 94.7 tok/s output 1,398 tok/s prefill | 128K | 13.5 GB |
Tasks in this set: 11.
Office and knowledge work
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.6-35b-a3b-q4 | 35B | 33/39 (85%) | 6.6/10 (26 pieces) | 76.4 tok/s output 1,125 tok/s prefill | 256K | 25.6 GB |
| gemma4-26b-q4 | 25.2B | 30/39 (77%) | 6.1/10 (20 pieces) | 89.6 tok/s output 1,093 tok/s prefill | 118K | 40.2 GB |
| gemma4-e4b-q4 | 8B | 29/39 (74%) | 5.4/10 (25 pieces) | 94.7 tok/s output 1,398 tok/s prefill | 128K | 12.4 GB |
| qwen3.6-27b-q4 | 27B | 29/39 (74%) | 5.6/10 (24 pieces) | 18.5 tok/s output 198 tok/s prefill | 256K | 27.0 GB |
| gemma4-31b-q4 | 30.7B | 28/39 (72%) | 6.1/10 (20 pieces) | 23.3 tok/s output 202 tok/s prefill | 256K | 45.1 GB |
Tasks in this set: 13.