Leaderboard

On-device LLM performance rankings powered by Glicko-2

iPad mini 7th Gen

iOS

Rank

#34

Rating

1,892

±31 RD

Win Rate

88.0%

Conservative Rating

1,830

TG Rating

1,892

PP Rating

1,892

Matches

276

Record

243W – 33L

Models Tested

ModelTG Median (tok/s)PP Median (tok/s)TG BestPP BestRuns
ERNIE-4.5-0.3B-PT-Q4_K_M107.871661.18107.871661.181
gemma-3n-E4B-it-Q4_K_M93.632269.0697.462285.172
Qwen3-0.6B.Q4_K_M61.1099.6861.1099.681
LFM2.5-1.2B-Instruct-Q4_K_M56.87580.5956.87580.591
ERNIE-4.5-0.3B-PT-F1652.181718.4752.181718.471
gemma-3n-E2B-it-Q4_K_M21.53202.9321.84206.974
gemma-3n-E2B-it-UD-Q4_K_XL20.90202.5020.91204.463
LFM2.5-1.2B-Instruct-BF1619.47645.2519.47645.251
LFM2.5-1.2B-Thinking-BF1619.42643.6419.42643.641
Llama-3.2-3B-Instruct-uncensored-Q4_K_M19.23177.1319.23177.131
gemma-2-2b-it-Q6_K18.11247.0919.56269.652
GeumokGPT-Lite.f1618.1046.6818.1046.681
SmolLM3-Q4_K_M16.35150.7016.35150.701
gemma-3-4b-it-UD-Q4_K_XL12.62130.4512.62130.451
ggml-model-Q4_010.7214.1610.7214.161
qwen2.5-3b-instruct-q5_k_m9.6914.799.6914.791
Llama-3.2-3B-Instruct-Q6_K8.7813.948.7813.941
gemma-3n-E4B-it-Q4_08.2412.198.2412.191
SecGPT-7B.IQ4_XS5.698.165.698.161
EVA-Qwen2.5-7B-v0.1-Q4_K_L3.717.303.717.301

Head-to-Head Record

Performance by App Version

ImprovedRegressed

Compare With