Leaderboard
On-device LLM performance rankings powered by Glicko-2
Pixel 9 Pro
AndroidRank
#144
Rating
1,462
±14 RD
Win Rate
46.3%
Conservative Rating
1,433
TG Rating
1,432
PP Rating
1,644
Matches
1,286
Record
596W – 690L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| google_gemma-3-270m-it-Q8_0 | 15.25 | 321.87 | 15.25 | 321.87 | 1 |
| gemma-3-1b-it.Q8_0 | 9.53 | 100.79 | 9.53 | 100.79 | 1 |
| Qwen3-1.7B-IQ4_XS | 7.77 | 33.93 | 7.77 | 33.93 | 1 |
| llama-3.2-1b-instruct-q8_0 | 7.44 | 79.18 | 8.07 | 79.21 | 2 |
| qwen2.5-1.5b-instruct-q8_0 | 7.21 | 60.95 | 7.21 | 60.95 | 1 |
| Llama-3.2-3B-Instruct-Q4_K_M | 7.16 | 31.17 | 7.16 | 31.17 | 1 |
| tinyswallow-1.5b-instruct-q5_k_m | 7.14 | 33.29 | 7.99 | 33.80 | 2 |
| Qwen3.5-0.8B-Unredacted-MAX.i1-Q6_K | 6.96 | 77.93 | 6.96 | 77.93 | 1 |
| Qwen3-0.6B.Q2_K | 5.55 | 37.52 | 5.55 | 37.52 | 1 |
| medgemma-1.5-4b-it-Q4_K_M | 5.41 | 26.76 | 5.41 | 26.76 | 1 |
| medgemma-4b-it-Q2_K | 5.37 | 13.66 | 5.37 | 13.66 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 5.34 | 16.65 | 6.08 | 16.96 | 3 |
| Qwen3.5-2B.Q5_K_M | 5.20 | 45.22 | 5.20 | 45.22 | 1 |
| Qwen3.5-2B-Q8_0 | 4.89 | 62.46 | 4.89 | 62.46 | 1 |
| Llama-3.2-3B-Instruct.Q8_0 | 4.52 | 27.69 | 4.52 | 27.69 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 4.47 | 12.06 | 4.94 | 15.74 | 3 |
| Llama-3.2-3B-Instruct-Q6_K | 4.25 | 12.02 | 4.88 | 19.12 | 3 |
| Gemmasutra-Mini-2B-v1-Q6_K | 4.20 | 19.85 | 4.80 | 23.57 | 6 |
| DeepSeek-R1-Distill-Llama-3B.Q6_K | 4.15 | 12.30 | 4.15 | 12.30 | 1 |
| gemma-2-2b-it-Q6_K | 3.85 | 19.36 | 5.12 | 21.36 | 5 |
| gemma-3-4b-it.Q8_0 | 3.36 | 20.80 | 3.36 | 20.80 | 1 |
| DeepSeek-R1-Distill-Qwen-7B-Q4_0 | 2.71 | 14.73 | 2.71 | 14.73 | 1 |
| Llama-3.1-8B-Lexi-Uncensored-V2-Q4_0 | 2.68 | 14.17 | 2.68 | 14.17 | 1 |
| Qwen3.5-0.8B-BF16 | 2.64 | 12.40 | 2.64 | 12.40 | 1 |
| DeepSeek-R1-0528-Qwen3-8B.Q2_K | 2.50 | 4.19 | 2.50 | 4.19 | 1 |
| huihui-ai_Huihui-gemma-3n-E4B-it-abliterated-Q4_K_M | 1.86 | 9.55 | 1.86 | 9.55 | 1 |
| ARM-DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-Q4_0-imat | 1.32 | 10.59 | 1.32 | 10.59 | 1 |
Head-to-Head Record
1–50 of 310 rows
1 / 7
Performance by App Version
ImprovedRegressed