Leaderboard
On-device LLM performance rankings powered by Glicko-2
iPad 11th Gen
iOSRank
#39
Rating
1,879
±34 RD
Win Rate
86.8%
Conservative Rating
1,811
TG Rating
1,829
PP Rating
1,883
Matches
228
Record
198W – 30L
Models Tested
| Model | TG Median (tok/s) | PP Median (tok/s) | TG Best | PP Best | Runs |
|---|---|---|---|---|---|
| gemma-3-1b-it-Q4_0 | 48.14 | 636.58 | 48.24 | 656.56 | 2 |
| gemma-3-1b-it-Q4_1 | 47.50 | 638.44 | 47.72 | 659.45 | 2 |
| gemma-3-1b-it-IQ4_NL | 43.74 | 607.97 | 43.80 | 627.43 | 2 |
| gemma-3-1b-it-IQ4_XS | 43.06 | 603.77 | 43.21 | 614.11 | 2 |
| gemma-3-1b-it-Q6_K | 38.32 | 626.55 | 38.72 | 626.77 | 3 |
| gemma-3-1b-it-UD-Q6_K_XL | 38.11 | 608.68 | 38.20 | 634.17 | 2 |
| gemma-3-1b-it-Q8_0 | 37.19 | 634.02 | 37.80 | 663.42 | 2 |
| gemma-3-1b-it-UD-Q4_K_XL | 36.63 | 564.36 | 36.77 | 575.78 | 2 |
| gemma-3-1b-it-Q4_K_S | 36.29 | 561.53 | 36.43 | 577.26 | 2 |
| gemma-3-1b-it-Q4_K_M | 36.22 | 546.14 | 36.25 | 571.58 | 3 |
| gemma-3-1b-it-UD-Q5_K_XL | 36.02 | 551.46 | 36.05 | 569.29 | 2 |
| gemma-3-1b-it-Q5_K_S | 35.46 | 538.54 | 35.63 | 556.83 | 2 |
| gemma-3-1b-it-Q5_K_M | 35.35 | 539.09 | 35.38 | 555.48 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q2_K_L | 31.53 | 323.04 | 31.95 | 324.52 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q2_K | 31.47 | 323.12 | 32.30 | 340.20 | 8 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-IQ4_XS | 30.52 | 312.04 | 30.88 | 312.50 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-Q2_K_XL | 30.40 | 326.17 | 30.47 | 330.12 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M | 30.38 | 319.20 | 30.52 | 321.89 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-Q4_K_XL | 29.84 | 315.99 | 29.93 | 320.50 | 2 |
| gemma-3-1b-it-UD-Q8_K_XL | 28.40 | 606.99 | 28.72 | 639.78 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-IQ3_XXS | 27.64 | 313.28 | 27.69 | 315.82 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_M | 27.38 | 311.70 | 27.42 | 315.17 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-IQ2_XXS | 27.33 | 315.81 | 27.55 | 317.63 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-IQ1_S | 26.70 | 318.24 | 26.76 | 320.84 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-IQ1_M | 26.67 | 310.01 | 27.25 | 317.85 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-Q3_K_XL | 26.47 | 307.50 | 26.87 | 309.25 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q8_0 | 25.75 | 344.05 | 25.93 | 353.27 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q5_K_M | 25.03 | 294.16 | 25.38 | 296.32 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-Q6_K | 24.50 | 304.94 | 25.11 | 308.26 | 2 |
| DeepSeek-R1-Distill-Qwen-1.5B-UD-IQ2_M | 23.67 | 284.87 | 25.31 | 303.53 | 2 |
| gemma-3-1b-it-BF16 | 21.92 | 567.06 | 21.99 | 596.82 | 2 |
| qwen2.5-1.5b-instruct-q8_0 | 18.33 | 376.53 | 18.33 | 376.53 | 1 |
| Llama-3.2-3B-Instruct-heretic-ablitered-uncensored.Q5_K_S | 13.79 | 143.29 | 13.79 | 143.29 | 1 |
| gemma-3n-E2B-it-IQ4_NL | 12.31 | 18.90 | 12.31 | 18.90 | 1 |
| qwen2.5-3b-instruct-q5_k_m | 9.26 | 13.10 | 9.26 | 13.10 | 1 |
| Phi-3.5-mini-instruct.Q4_K_M | 7.51 | 10.75 | 7.51 | 10.75 | 1 |
| ibm-granite_granite-3.2-8b-instruct-IQ3_XXS | 6.78 | 52.94 | 6.78 | 52.94 | 1 |
| Llama-3.2-3B-Instruct-Q4_K_L | 6.52 | 19.87 | 6.52 | 19.87 | 1 |
| Llama-3.2-3B-Instruct-Q4_0 | 6.39 | 21.02 | 6.39 | 21.02 | 1 |
| Llama-3.2-3B-Instruct-IQ3_M | 5.90 | 6.91 | 5.90 | 6.91 | 1 |
| Llama-3.2-3B-Instruct-IQ4_XS | 5.83 | 22.26 | 5.83 | 22.26 | 1 |
Head-to-Head Record
1–50 of 163 rows
1 / 4