Leaderboard
On-device LLM performance rankings powered by Glicko-2
Galaxy S21 Ultra 5G
AndroidRank
#128
Rating
1,541
±21 RD
Win Rate
53.9%
Conservative Rating
1,498
TG Rating
1,557
PP Rating
1,438
Matches
595
Record
321W – 274L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| smollm2-360m-instruct-q8_0 | 25.72 | 114.49 | 25.72 | 114.49 | 1 |
| gemma-3-270m-it-Q6_K | 25.42 | 210.89 | 27.60 | 221.15 | 2 |
| Vintern-1B-v3_5-Q8_0 | 22.43 | 97.14 | 22.43 | 97.14 | 1 |
| gemma-3-270m-it-F16 | 19.68 | 108.88 | 19.68 | 108.88 | 1 |
| smollm-360M-instruct-add-basics.Q8_0 | 17.90 | 67.75 | 17.90 | 67.75 | 1 |
| chatgpt-5-q8_0 | 17.67 | 92.57 | 17.67 | 92.57 | 1 |
| llama-3.2-1b-instruct-q8_0 | 11.73 | 43.58 | 11.73 | 43.58 | 1 |
| qwen2.5-1.5b-instruct-q8_0 | 9.26 | 30.28 | 10.08 | 30.35 | 2 |
| LFM2.5-1.2B-Instruct-Q8_0 | 9.06 | 66.57 | 9.06 | 66.57 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 6.64 | 11.51 | 6.64 | 11.51 | 1 |
| Llama-3.2-3B-Instruct-Q6_K | 5.08 | 10.52 | 5.08 | 10.52 | 1 |
| granite-3.3-2b-instruct-Q4_K_M | 4.66 | 13.44 | 4.66 | 13.44 | 1 |
| gemma-3-4b-it.Q6_K | 2.57 | 7.61 | 2.57 | 7.61 | 1 |
| gemma-2-9b-it-abliterated-Q4_0 | 2.06 | 3.95 | 2.06 | 3.95 | 1 |
Head-to-Head Record
1–50 of 203 rows
1 / 5
Performance by App Version
ImprovedRegressed