2026-08-13 · Mac · Apple M4 Max
A model scorecard round on M4 Max · 64 GB: 4 models across 2 task sets. Every round is listed in the model scorecard, with its results side by side in one table.
M4 Max · 64 GB · llama-cpp · 3 trials per task · 2026-08-13 · gezel c5904085 · catalog 0.1.23
General capability
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| gemma4-26b-q4 | 25.2B | 33/33 (100%) | 5.7/10 (9 pieces) | 107.5 tok/s output 1,264 tok/s prefill | 118K | 41.7 GB |
| muse-glimmer-30b-q4 | 30B | 30/33 (91%) | 6.5/10 (9 pieces) | 26 tok/s output 226 tok/s prefill | 128K | 19.2 GB |
| qwen3.6-35b-a3b-q4 | 35B | 30/33 (91%) | 8.1/10 (9 pieces) | 71.3 tok/s output 1,104 tok/s prefill | 256K | 25.9 GB |
| nemotron3.5-lightning-30b-q4 | 30B | 26/33 (79%) | 5.6/10 (9 pieces) | 93.2 tok/s output 1,030 tok/s prefill | 1024K | 29.4 GB |
Tasks in this set: 11.
Office and knowledge work
| Model | Size | Tasks passed | Quality | Performance | Context | Memory used |
|---|---|---|---|---|---|---|
| qwen3.6-35b-a3b-q4 | 35B | 33/39 (85%) | 6.6/10 (27 pieces) | 71.3 tok/s output 1,104 tok/s prefill | 256K | 25.1 GB |
| gemma4-26b-q4 | 25.2B | 28/39 (72%) | 6/10 (19 pieces) | 107.5 tok/s output 1,264 tok/s prefill | 118K | 40.8 GB |
| muse-glimmer-30b-q4 | 30B | 25/39 (64%) | 5.5/10 (25 pieces) | 26 tok/s output 228 tok/s prefill | 128K | 19.2 GB |
| nemotron3.5-lightning-30b-q4 | 30B | 23/39 (59%) | 5.6/10 (27 pieces) | 93.2 tok/s output 1,030 tok/s prefill | 1024K | 28.8 GB |
Tasks in this set: 13.