Leaderboard
On-device LLM performance rankings powered by Glicko-2
Pixel 7a
AndroidRank
#206
Rating
1,275
±19 RD
Win Rate
28.3%
Conservative Rating
1,238
TG Rating
1,282
PP Rating
1,297
Matches
763
Record
216W – 547L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| tinygemma3-Q8_0 | 138.85 | 1101.27 | 138.85 | 1101.27 | 1 |
| SmolLM2-135M-Instruct-f16 | 18.68 | 89.81 | 18.68 | 89.81 | 1 |
| Qwen3-0.6B-Q4_K_M | 17.20 | 89.07 | 17.20 | 89.07 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M | 11.14 | 29.98 | 11.14 | 29.98 | 1 |
| SmolLM2-360M-Instruct-f16 | 9.53 | 30.51 | 9.53 | 30.51 | 1 |
| SmolLM2-1.7B-Instruct-Q4_K_M | 7.45 | 21.21 | 7.45 | 21.21 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-IQ2_M | 6.65 | 11.46 | 6.65 | 11.46 | 1 |
| granite-3.2-2b-instruct-abliterated.Q4_K_M | 6.54 | 18.09 | 7.03 | 21.36 | 2 |
| Qwen3.5-0.8B-IQ4_NL | 6.30 | 66.34 | 6.30 | 66.34 | 1 |
| Qwen2.5-3B-Instruct-Abliterated.Q4_K_M | 5.48 | 12.91 | 6.26 | 14.58 | 2 |
| SmolLM2-1.7B-Instruct-Q8_0 | 5.45 | 20.61 | 5.45 | 20.61 | 1 |
| gemma-2-2b-it-abliterated-Q4_K_M | 5.30 | 21.08 | 5.67 | 25.45 | 2 |
| Llama-3.2-3B-Instruct-abliterated.Q4_K_M | 5.07 | 14.90 | 5.73 | 18.49 | 2 |
| Phi-3.5-mini-instruct.Q4_K_M | 4.79 | 10.36 | 4.79 | 10.36 | 1 |
| DeepSeek-R1-Distill-Qwen-1.5B-f16 | 4.00 | 7.81 | 4.00 | 7.81 | 1 |
| gemma-2-2b-it-Q6_K | 3.99 | 11.49 | 3.99 | 11.49 | 1 |
| gemma-3-4b-it-Q4_K_M | 3.73 | 10.24 | 3.73 | 10.24 | 1 |
| TheDrummer_Gemmasutra-Small-4B-v1-Q4_K_M | 3.58 | 12.28 | 3.58 | 12.28 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 2.85 | 9.46 | 2.85 | 9.46 | 1 |
| FrenchLlama-3.2-3B-Instruct.IQ4_XS | 2.80 | 10.09 | 2.80 | 10.09 | 1 |
| MythoMax-L2-13b.Q2_K | 2.48 | 4.11 | 2.48 | 4.11 | 1 |
| gemma-3-4b-it-Q4_K_M | 1.18 | 22.50 | 1.18 | 22.50 | 1 |
| DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored.Q2_K | 0.18 | 1.87 | 0.18 | 1.87 | 1 |
Head-to-Head Record
1–50 of 202 rows
1 / 5