Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPad Pro 11 inch 6th Gen
iOSRank
#1
Rating
2,018
±17 RD
Win Rate
100.0%
Conservative Rating
1,984
TG Rating
2,018
PP Rating
2,018
Matches
928
Record
928W – 0L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| llama-3.2-1b-instruct-q8_0 | 79.19 | 167.65 | 79.19 | 167.65 | 1 |
| qwen2.5-1.5b-instruct-q8_0 | 74.84 | 1197.23 | 74.84 | 1197.23 | 1 |
| gemma-2-2b-it-Q6_K | 54.74 | 778.36 | 55.03 | 783.05 | 4 |
| Llama-3.2-3B-Instruct-Q6_K | 46.16 | 567.87 | 46.16 | 567.87 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 42.40 | 416.50 | 53.39 | 537.09 | 2 |
| Phi-3.5-mini-instruct.Q4_K_M | 39.37 | 424.70 | 39.37 | 424.70 | 1 |
| Qwen3-4B.Q6_K | 36.13 | 428.07 | 36.46 | 431.69 | 3 |
| L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B-D_AU-Q3_k_m | 29.88 | 230.05 | 29.88 | 230.05 | 1 |
| Qwen2.5-7B-Instruct.Q4_K_S | 28.70 | 240.58 | 28.70 | 240.58 | 1 |
| meta-llama-Llama-3.1-8B-Instruct-Q4_K_S | 28.41 | 237.83 | 28.41 | 237.83 | 1 |
| Qwen3.5-4B.Q4_K_M | 26.30 | 341.14 | 26.30 | 341.14 | 1 |
| Qwen3-8B-bf16-Q4_K_M | 24.02 | 216.23 | 25.56 | 240.34 | 4 |
| Qwen3.5-4B-Q6_K | 21.60 | 319.52 | 21.60 | 319.52 | 1 |
Head-to-Head Record
1–50 of 286 rows
1 / 6
Performance by App Version
ImprovedRegressed