2026-08-09 · Mac · Apple M4 Max
A model scorecard round on M4 Max · 64 GB: 4 models across 2 task sets. Every round is listed in the model scorecard, with its results side by side in one table.
M4 Max · 64 GB · llama-cpp · 3 trials per task · 2026-08-09 · gezel e2859602 · catalog 0.1.17
General capability
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| gemma4-31b-q4 | 30.7B | 33/33 (100%) | 6.8/10 (9 pieces) | 22.3 tok/s output 195 tok/s prefill | 64K | 31.0 GB |
| gemma4-12b-q4 | 12B | 28/33 (85%) | 6.9/10 (9 pieces) | 50.9 tok/s output 543 tok/s prefill | 64K | 30.6 GB |
| gemma4-e4b-q4 | 8B | 24/33 (73%) | 4.6/10 (9 pieces) | 97.8 tok/s output 1,411 tok/s prefill | 64K | 10.4 GB |
| ornith-9b-q4 | 9B | 24/33 (73%) | 6.7/10 (9 pieces) | 64.9 tok/s output 657 tok/s prefill | 64K | 9.8 GB |
Tasks in this set: 11.
Office and knowledge work
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| ornith-9b-q4 | 9B | 34/39 (87%) | 6.5/10 (26 pieces) | 64.9 tok/s output 657 tok/s prefill | 64K | 8.9 GB |
| gemma4-12b-q4 | 12B | 29/39 (74%) | 4.8/10 (26 pieces) | 50.9 tok/s output 543 tok/s prefill | 64K | 29.7 GB |
| gemma4-e4b-q4 | 8B | 28/39 (72%) | 5.2/10 (22 pieces) | 97.8 tok/s output 1,411 tok/s prefill | 64K | 8.9 GB |
| gemma4-31b-q4 | 30.7B | 25/39 (64%) | 6.5/10 (18 pieces) | 22.3 tok/s output 195 tok/s prefill | 64K | 30.1 GB |
Tasks in this set: 13.