Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPad Air 11 inch 6th Gen
iOSRank
#7
Rating
1,992
±20 RD
Win Rate
97.6%
Conservative Rating
1,952
TG Rating
1,994
PP Rating
1,985
Matches
658
Record
642W – 16L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| DeepSeek-R1-Distill-Llama-8B-Q4_K_M | 116.76 | 1050.32 | 116.76 | 1050.32 | 1 |
| DeepSeek-R1-0528-Qwen3-8B-UD-Q4_K_XL | 108.37 | 1328.93 | 108.37 | 1328.93 | 1 |
| gemma-3-1B-it-QAT-Q4_0 | 75.37 | 965.72 | 86.05 | 1441.03 | 3 |
| Qwen3-0.6B.Q6_K | 63.86 | 669.73 | 63.86 | 669.73 | 1 |
| Qwen3-1.7B.Q4_K_M | 52.95 | 207.73 | 52.95 | 207.73 | 1 |
| tinyswallow-1.5b-instruct-q8_0 | 47.42 | 813.83 | 47.42 | 813.83 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q8_0 | 34.13 | 83.26 | 34.13 | 83.26 | 1 |
| Qwen2.5-1.5B-Instruct.Q8_0 | 34.04 | 89.71 | 34.04 | 89.71 | 1 |
| Llama-3.2-1B-Instruct.IQ1_M | 27.81 | 40.10 | 27.81 | 40.10 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 27.31 | 330.68 | 30.76 | 344.60 | 4 |
| gemma-3-4B-it-QAT-Q4_0 | 22.81 | 52.95 | 22.81 | 52.95 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 21.11 | 192.82 | 30.79 | 254.45 | 2 |
| Gemmasutra-Mini-2B-v1-Q6_K | 18.96 | 33.33 | 18.96 | 33.33 | 1 |
| gemma-2-2b-it-Q6_K | 18.76 | 36.60 | 34.14 | 509.35 | 3 |
| DeepSeek-R1-Distill-Llama-8B-Q2_K | 18.62 | 151.34 | 18.62 | 151.34 | 1 |
| Hermes-3-Llama-3.2-3B.Q6_K | 13.58 | 22.59 | 13.58 | 22.59 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-IQ3_M | 13.18 | 132.20 | 13.18 | 132.20 | 1 |
| oh-dcft-v3.1-claude-3-5-haiku-20241022.Q3_K_S | 12.70 | 138.50 | 12.70 | 138.50 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-Q4_K_M | 12.40 | 157.96 | 12.40 | 157.96 | 1 |
Head-to-Head Record
1–50 of 212 rows
1 / 5
Performance by App Version
ImprovedRegressed