| Claude Opus 5 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run) claude-opus-5-max | Claude Opus 5 | 66.2% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Claude Opus 5 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Qwen3.8-Flash-Next (Artificial Analysis independent run) qwen-3-8-flash-next-aa-unspecified | Qwen3.8-Flash-Next | 62.1% | v2Artificial Analysis GDPval-AA v2 | Public reference · not scored independently-verified | Qwen3.8-Flash-Next individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| GLM-5.2 (max) (Artificial Analysis independent run) glm-5-2-max | GLM-5.2 | 49.9% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | GLM-5.2 (max) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Claude Opus 4.7 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run) claude-opus-4-7-max | Claude Opus 4.7 | 49.1% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Claude Opus 4.7 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Qwen3.6 35B A3B (Reasoning) (Artificial Analysis completed independent run) qwen3-6-35b-a3b-aa-reasoning-default | Qwen3.6-35B-A3B | 27.8% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Qwen3.6 35B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| LongCat 2.0 (Artificial Analysis independent run) longcat-2-0-default | LongCat-2.0 | 26.6% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | LongCat 2.0 individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Kimi K2.5 (Reasoning) (Artificial Analysis completed independent run) kimi-k2-5-thinking | Kimi K2.5 | 25.3% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Kimi K2.5 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Qwen3.5 122B A10B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-122b-a10b-aa-reasoning-default | Qwen3.5-122B-A10B | 24.4% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Qwen3.5 122B A10B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Qwen3.5 397B A17B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-397b-thinking | Qwen3.5 397B A17B | 23.3% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Qwen3.5 397B A17B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Mistral Medium 3.5 (Artificial Analysis completed independent run) mistral-medium-3-5-128b-aa-reasoning-default | Mistral Medium 3.5 128B | 21.8% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Mistral Medium 3.5 current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Gemma 4 26B A4B (Reasoning) (Artificial Analysis completed independent run) gemma-4-26b-a4b-aa-reasoning-default | Gemma 4 26B A4B | 13.5% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Gemma 4 26B A4B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Mistral Small 4 (Reasoning) (Artificial Analysis completed independent run) mistral-small-4-reasoning | Mistral Small 4 | 4.5% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Mistral Small 4 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Trinity Large Thinking (Artificial Analysis completed independent run) trinity-large-thinking-aa-reasoning-default | Trinity-Large-Thinking | 3.3% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Trinity Large Thinking current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| GPT-4.1 mini (Artificial Analysis completed independent run) gpt-4-1-mini-epoch-gpt-4-1-mini-2025-04-14 | GPT-4.1 mini | 0.3% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | GPT-4.1 mini current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Gemma 3 27B Instruct (Artificial Analysis completed independent run) gemma-3-27b-aa-non-reasoning-default | Gemma 3 27B | 0% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Gemma 3 27B Instruct current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| GPT-4.1 nano (Artificial Analysis completed independent run) gpt-4-1-nano-epoch-gpt-4-1-nano-2025-04-14 | GPT-4.1 nano | 0% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | GPT-4.1 nano current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Llama 4 Maverick (Artificial Analysis completed independent run) llama-4-maverick-aa-non-reasoning-default | Llama 4 Maverick | 0% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Llama 4 Maverick current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Llama 4 Scout (Artificial Analysis completed independent run) llama-4-scout-aa-non-reasoning-default | Llama 4 Scout | 0% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Llama 4 Scout current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) (Artificial Analysis completed independent run) nemotron-3-nano-30b-aa-reasoning-default | Nemotron 3 Nano 30B | 0% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29 |
|---|
| Claude Opus 5 (max; Artificial Analysis independent run) claude-opus-5-max | Claude Opus 5 | 66.1% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Claude Opus 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| GLM-5.3-Flash (max; Artificial Analysis independent run) glm-5-3-flash-max | GLM-5.3-Flash | 63.2% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | GLM-5.3-Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| GLM-5.3 (max; Artificial Analysis independent run) glm-5-3-max | GLM-5.3 | 63.1% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | GLM-5.3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Grok 4.6 (high; Artificial Analysis independent run) grok-4-6-high | Grok 4.6 | 61.4% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Grok 4.6 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Claude Fable 5 (max; Artificial Analysis independent run) claude-fable-5-max | Claude Fable 5 | 61.1% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Claude Fable 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| GPT-5.6 Sol (max; Artificial Analysis independent run) gpt-5-6-sol-max | GPT-5.6 Sol | 60.6% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | GPT-5.6 Sol individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Kimi K3 (max; Artificial Analysis independent run) kimi-k3-max | Kimi K3 | 58.5% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Kimi K3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| DeepSeek V4 Flash Vision Exp (max; Artificial Analysis independent run) deepseek-v4-flash-vision-exp-max-harness | DeepSeek V4 Flash Vision Exp | 58.1% | v2Artificial Analysis GDPval-AA v2 | Public reference · not scored independently-verified | DeepSeek V4 Flash Vision Exp individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Muse Spark 1.2 (xhigh; Artificial Analysis independent run) muse-spark-1-2-xhigh | Muse Spark 1.2 | 55.6% | v2Artificial Analysis GDPval-AA v2 | Score input independently-verified | Muse Spark 1.2 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Claude Sonnet 5 (max; Artificial Analysis independent run) claude-sonnet-5-max | Claude Sonnet 5 | 54.3% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Claude Sonnet 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Claude Opus 4.8 (max; Artificial Analysis independent run) claude-opus-4-8-max | Claude Opus 4.8 | 53.9% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Claude Opus 4.8 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| DeepSeek V4 Pro 0813 (max; Artificial Analysis independent run) deepseek-v4-pro-0813-max | DeepSeek V4 Pro 0813 | 53.9% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Public reference · not scored independently-verified | DeepSeek V4 Pro 0813 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| GPT-5.6 Luna (max; Artificial Analysis independent run) gpt-5-6-luna-max | GPT-5.6 Luna | 53.7% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | GPT-5.6 Luna individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| GPT-5.6 Terra (max; Artificial Analysis independent run) gpt-5-6-terra-max | GPT-5.6 Terra | 53.3% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | GPT-5.6 Terra individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Grok 4.5 (high; Artificial Analysis independent run) grok-4-5-aa-2-high | Grok 4.5 | 50.9% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Grok 4.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Gemini 3.7 Flash (medium; Artificial Analysis independent run) gemini-3-7-flash-medium | Gemini 3.7 Flash | 49.6% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Gemini 3.7 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| GPT-5.5 (xhigh; Artificial Analysis independent run) gpt-5-5-xhigh | GPT-5.5 | 49.2% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | GPT-5.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Gemini 3.6 Flash (high; Artificial Analysis independent run) gemini-3-6-flash-high | Gemini 3.6 Flash | 45.9% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Gemini 3.6 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| GPT-5.4 (xhigh; Artificial Analysis independent run) gpt-5-4-xhigh | GPT-5.4 | 44.4% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | GPT-5.4 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Muse Spark 1.1 (xhigh; Artificial Analysis independent run) muse-spark-1-1-xhigh | Muse Spark 1.1 | 43.7% | v2Artificial Analysis GDPval-AA v2 using Stirrup | Score input independently-verified | Muse Spark 1.1 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27 |
|---|
| Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64 muse-glimmer-30b-high | Muse Glimmer 30B | 953 Elo | v2Artificial Analysis GDPval-AA v2 in Stirrup with E2B | Public reference · not scored provider-reported | Muse Glimmer Evaluation Methodology ↗Observed 2026-08-10 · checked 2026-08-10 |
|---|
| Muse Spark 1.2 (xhigh) muse-spark-1-2-xhigh | Muse Spark 1.2 | 56.5% | v2Artificial Analysis GDPval-AA v2 using Stirrup with shell and web tools | Public reference · not scored independently-verified | GDPval-AA v2 leaderboard — Muse Spark 1.2 ↗Observed 2026-08-05 · checked 2026-08-05 |
|---|
| Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 5 | 1862 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Fable 5 | 1747 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Sol | 1735 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K3 | 1687 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 5 | 1603 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.8 | 1593 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Terra | 1583 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Luna | 1582 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4.5 | 1528 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.2 | 1510 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max | Claude Opus 4.7 | 1493 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.5 | 1491 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.6 Flash | 1423 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 1392 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiniMax M3 | 1391 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark 1.1 | 1375 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash | 1345 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max | DeepSeek V4 Pro | 1306 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high | DeepSeek V4 Pro | 1299 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.7-Max | 1271 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiMo-V2.5-Pro | 1265 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.1 | 1256 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Inkling | 1237 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Hy3 | 1215 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Hy3 Preview | 1215 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max | DeepSeek V4 Flash | 1189 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.6 | 1188 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.7 Code | 1186 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 mini | 1169 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.7 | 1166 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Ultra | 1162 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiniMax M2.7 | 1159 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high | DeepSeek V4 Flash | 1147 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 1143 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash-Lite | 1139 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 Plus | 1139 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 27B | 1138 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 nano | 1101 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4.3 | 1084 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high | GPT-5 | 1079 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6-35B-A3B | 1052 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Step 3.7 Flash | 1017 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.5 | 1003 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking | Kimi K2.5 | 1003 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.1 | 988 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5-122B-A10B | 982 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 397B A17B | 962 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking | Qwen3.5 397B A17B | 962 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.7-Plus | 943 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Medium 3.5 128B | 933 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 31B | 811 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-OSS 120B | 802 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 26B A4B | 770 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Command A+ | 718 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Pro | 672 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 12B Unified | 651 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.1 Flash-Lite | 647 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Large 3 | 640 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | K-Exaone | 598 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Small 4 | 592 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning | Mistral Small 4 | 592 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-OSS 20B | 567 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Trinity-Large-Preview | 564 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Trinity-Large-Thinking | 564 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Ling 2.6 Flash | 550 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 mini | 508 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Nano 30B | 492 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Nano Omni 30B A3B | 465 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4o mini | 241 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3 | 231 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 E4B | 231 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Scout | 111 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 E2B | 88 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 nano | 63 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Maverick | 7 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 3 27B | -119 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 5 | 1861 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Fable 5 | 1747 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Sol | 1736 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K3 | 1686 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 5 | 1603 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.8 | 1593 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Terra | 1583 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Luna | 1582 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4.5 | 1527 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.2 | 1510 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max | Claude Opus 4.7 | 1493 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.5 | 1491 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.6 Flash | 1423 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 1392 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiniMax M3 | 1391 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark 1.1 | 1375 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash | 1344 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max | DeepSeek V4 Pro | 1306 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high | DeepSeek V4 Pro | 1299 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.7-Max | 1271 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiMo-V2.5-Pro | 1265 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.1 | 1256 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Inkling | 1237 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Hy3 | 1215 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Hy3 Preview | 1215 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max | DeepSeek V4 Flash | 1189 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.6 | 1188 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.7 Code | 1186 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 mini | 1169 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.7 | 1166 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Ultra | 1162 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiniMax M2.7 | 1159 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high | DeepSeek V4 Flash | 1147 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 1143 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash-Lite | 1139 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 Plus | 1139 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 27B | 1138 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 nano | 1101 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4.3 | 1084 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high | GPT-5 | 1079 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6-35B-A3B | 1052 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Step 3.7 Flash | 1017 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.5 | 1003 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking | Kimi K2.5 | 1003 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.1 | 988 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5-122B-A10B | 982 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 397B A17B | 962 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking | Qwen3.5 397B A17B | 962 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.7-Plus | 943 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Medium 3.5 128B | 933 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 31B | 811 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-OSS 120B | 802 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 26B A4B | 770 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Command A+ | 718 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Pro | 672 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 12B Unified | 651 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.1 Flash-Lite | 649 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Large 3 | 640 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | K-Exaone | 598 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Small 4 | 592 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning | Mistral Small 4 | 592 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-OSS 20B | 567 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Trinity-Large-Preview | 564 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Trinity-Large-Thinking | 564 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Ling 2.6 Flash | 550 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 mini | 508 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Nano 30B | 492 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Nano Omni 30B A3B | 465 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4o mini | 241 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3 | 231 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 E4B | 231 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Scout | 111 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 E2B | 88 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 nano | 63 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Maverick | 7 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 3 27B | -119 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| GDPval-AA v2 Elo as published in the Anthropic Claude Opus 5 launch table. source label without registered configuration ID | Claude Opus 5 | 1861 elo | v2Anthropic provider evaluation | Public reference · not scored provider-reported | Introducing Claude Opus 5 ↗Observed 2026-07-24 · checked 2026-07-24 |
|---|
| Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Fable 5 | 1748 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Sol | 1736 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K3 | 1679 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 5 | 1607 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.8 | 1594 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Luna | 1584 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Terra | 1581 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4.5 | 1535 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.2 | 1514 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max | Claude Opus 4.7 | 1495 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.5 | 1490 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.6 Flash | 1421 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 1395 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiniMax M3 | 1395 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark 1.1 | 1374 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash | 1349 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max | DeepSeek V4 Pro | 1307 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high | DeepSeek V4 Pro | 1299 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.7-Max | 1273 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiMo-V2.5-Pro | 1265 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.1 | 1257 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Inkling | 1239 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Hy3 | 1214 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Hy3 Preview | 1214 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max | DeepSeek V4 Flash | 1189 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.6 | 1189 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.7 Code | 1187 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 mini | 1171 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.7 | 1165 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Ultra | 1164 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | MiniMax M2.7 | 1158 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high | DeepSeek V4 Flash | 1147 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 1144 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash-Lite | 1140 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 27B | 1140 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 Plus | 1135 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 nano | 1100 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4.3 | 1085 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high | GPT-5 | 1075 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6-35B-A3B | 1049 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Step 3.7 Flash | 1017 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.5 | 1009 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking | Kimi K2.5 | 1009 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.1 | 987 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5-122B-A10B | 978 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 397B A17B | 962 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking | Qwen3.5 397B A17B | 962 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.7-Plus | 936 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Medium 3.5 128B | 929 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 31B | 804 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-OSS 120B | 799 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 4 26B A4B | 761 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Command A+ | 714 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Pro | 665 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.1 Flash-Lite | 642 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Large 3 | 633 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Mistral Small 4 | 588 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning | Mistral Small 4 | 588 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-OSS 20B | 559 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Trinity-Large-Preview | 554 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Trinity-Large-Thinking | 554 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Ling 2.6 Flash | 545 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 mini | 503 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Nano 30B | 484 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Nemotron 3 Nano Omni 30B A3B | 467 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4o mini | 226 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3 | 217 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Scout | 90 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 nano | 41 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Maverick | -16 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemma 3 27B | -144 elo | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| GDPval-AA v2 Elo 1607 as published in Gemini 3.6 evaluation table. source label without registered configuration ID | Claude Sonnet 5 | 55.4% | v2Provider evaluation harness | Public reference · not scored provider-reported | Gemini 3.6 Flash product page with evaluation table ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| GDPval-AA v2 Elo 1584 as published in Gemini 3.6 evaluation table. source label without registered configuration ID | GPT-5.6 Luna | 54.2% | v2Provider evaluation harness | Public reference · not scored provider-reported | Gemini 3.6 Flash product page with evaluation table ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| GDPval-AA v2 Elo 1535 as published in Gemini 3.6 evaluation table. source label without registered configuration ID | Grok 4.5 | 51.8% | v2Provider evaluation harness | Public reference · not scored provider-reported | Gemini 3.6 Flash product page with evaluation table ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Artificial Analysis GDPval-AA v2 normalized score as published on AA model page. source label without registered configuration ID | Gemini 3.6 Flash | 46.1% | v2Artificial Analysis evaluation harness | Score input source-checked | Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| gemini-3.6-flash via Gemini API; default sampling; single-attempt / pass@1 unless noted in Google eval methodology (July 2026). GDPval-AA v2 Elo as published by Google (sourced from AA leaderboard in methodology). source label without registered configuration ID | Gemini 3.6 Flash | 46.0% | v2Provider evaluation harness | Score input provider-reported | Gemini 3.6 Flash product page with evaluation table ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| GDPval-AA v2 Elo 1349 as published in Gemini 3.6 evaluation table for 3.5 Flash. source label without registered configuration ID | Gemini 3.5 Flash | 42.5% | v2Provider evaluation harness | Public reference · not scored provider-reported | Gemini 3.6 Flash product page with evaluation table ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| gemini-3.5-flash-lite via Gemini API; configuration as stated in the July 2026 Google launch materials. GDPval-AA v2 Elo 1140 as published in Google launch blog. source label without registered configuration ID | Gemini 3.5 Flash-Lite | 32% | v2Provider evaluation harness | Public reference · not scored provider-reported | Introducing Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Artificial Analysis GDPval-AA v2 normalized score. source label without registered configuration ID | Gemini 3.5 Flash-Lite | 32% | v2Artificial Analysis evaluation harness | Score input source-checked | Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| GDPval-AA v2 Elo 642 as published for 3.1 Flash-Lite comparison. source label without registered configuration ID | Gemini 3.1 Flash-Lite | 7.1% | v2Provider evaluation harness | Public reference · not scored provider-reported | Introducing Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Kimi K3; Artificial Analysis GDPval-AA v2 normalized score. source label without registered configuration ID | Kimi K3 | 59.2% | v2Artificial Analysis independent evaluation | Score input source-checked | Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21 |
|---|
| Exact model variant as listed on the BenchLM public gdpval-aa leaderboard page (verified 2026-07-21). source label without registered configuration ID | Hy3 | 35.7% | v2BenchLM aggregated public evaluation | Source carrier · no additional scoring weight source-checked | GDPval-AA Normalized Leaderboard & Scores — July 2026 ↗Observed 2026-07-20 · checked 2026-07-21 |
|---|
| Exact model variant as listed on the BenchLM public gdpval-aa leaderboard page (verified 2026-07-21). source label without registered configuration ID | GPT-5 mini | 21.8% | v2BenchLM aggregated public evaluation | Score input source-checked | GDPval-AA Normalized Leaderboard & Scores — July 2026 ↗Observed 2026-07-20 · checked 2026-07-21 |
|---|
| Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published. muse-spark-1-1-xhigh | Muse Spark 1.1 | 43.7% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16 |
|---|
| Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) claude-fable-5-max | Claude Fable 5 | 63.0% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.6 Sol (max) gpt-5-6-sol-max | GPT-5.6 Sol | 62.4% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude 4 Opus (Reasoning) source label without registered configuration ID | Claude Opus 4 | 56.5% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude Sonnet 5 (Adaptive Reasoning, Max Effort) claude-sonnet-5-max | Claude Sonnet 5 | 55.3% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude Opus 4.8 (Adaptive Reasoning, Max Effort) claude-opus-4-8-max | Claude Opus 4.8 | 55.0% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.6 Terra (max) gpt-5-6-terra-max | GPT-5.6 Terra | 54.6% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.6 Luna (max) gpt-5-6-luna-max | GPT-5.6 Luna | 54.6% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Grok 4.5 (high) source label without registered configuration ID | Grok 4.5 | 51.7% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GLM-5.2 (max) glm-5-2-max | GLM-5.2 | 50.7% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude Opus 4.7 (Adaptive Reasoning, Max Effort) claude-opus-4-7-max | Claude Opus 4.7 | 50.0% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.5 (xhigh) gpt-5-5-xhigh | GPT-5.5 | 49.7% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| MiniMax-M3 source label without registered configuration ID | MiniMax M3 | 44.7% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.4 (xhigh) gpt-5-4-xhigh | GPT-5.4 | 44.7% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) claude-sonnet-4-6-max | Claude Sonnet 4.6 | 43.9% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Muse Spark 1.1 (xhigh) muse-spark-1-1-xhigh | Muse Spark 1.1 | 43.7% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Gemini 3.5 Flash (high) gemini-3-5-flash-high | Gemini 3.5 Flash | 42.4% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| DeepSeek V4 Pro (Reasoning, Max Effort) deepseek-v4-pro-max | DeepSeek V4 Pro | 40.4% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Qwen3.7 Max source label without registered configuration ID | Qwen3.7-Max | 38.7% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| MiMo-V2.5-Pro source label without registered configuration ID | MiMo-V2.5-Pro | 38.3% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GLM-5.1 (Reasoning) source label without registered configuration ID | GLM-5.1 | 37.8% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude 3.7 Sonnet (Reasoning) source label without registered configuration ID | Claude Sonnet 3.7 | 35.9% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Kimi K2.6 source label without registered configuration ID | Kimi K2.6 | 34.5% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| DeepSeek V4 Flash (Reasoning, Max Effort) deepseek-v4-flash-max | DeepSeek V4 Flash | 34.4% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Kimi K2.7 Code source label without registered configuration ID | Kimi K2.7 Code | 34.3% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.4 mini (xhigh) gpt-5-4-mini-xhigh | GPT-5.4 mini | 33.5% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GLM-4.7 (Reasoning) source label without registered configuration ID | GLM-4.7 | 33.3% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Nemotron 3 Ultra 550B A55B (Reasoning) source label without registered configuration ID | Nemotron 3 Ultra | 33.2% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| MiniMax-M2.7 source label without registered configuration ID | MiniMax M2.7 | 32.9% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| MiMo-V2.5 source label without registered configuration ID | MiMo-V2.5 | 32.3% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Muse Spark source label without registered configuration ID | Muse Spark | 32.2% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Qwen3.6 27B (Reasoning) source label without registered configuration ID | Qwen3.6 27B | 32.0% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Qwen3.6 Plus source label without registered configuration ID | Qwen3.6 Plus | 31.8% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.4 nano (xhigh) gpt-5-4-nano-xhigh | GPT-5.4 nano | 30.0% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Grok 4.3 (high) source label without registered configuration ID | Grok 4.3 | 29.2% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5 (high) gpt-5-high | GPT-5 | 28.7% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude 4.5 Sonnet (Reasoning) source label without registered configuration ID | Claude Sonnet 4.5 | 27.6% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Kimi K2.5 (Reasoning) source label without registered configuration ID | Kimi K2.5 | 25.4% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GPT-5.1 (high) gpt-5-1-high | GPT-5.1 | 24.4% | v2Artificial Analysis independent evaluation | Public reference · not scored source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Qwen3.5 122B A10B (Reasoning) source label without registered configuration ID | Qwen3.5 122B | 23.9% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Gemini 3.1 Pro Preview source label without registered configuration ID | Gemini 3.1 Pro Preview | 23.1% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Qwen3.5 397B A17B (Reasoning) source label without registered configuration ID | Qwen3.5 397B A17B | 23.1% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Qwen3.7 Plus source label without registered configuration ID | Qwen3.7-Plus | 21.8% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GLM-4.6 (Reasoning) source label without registered configuration ID | GLM-4.6 | 21.7% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Mistral Medium 3.5 source label without registered configuration ID | Mistral Medium 3.5 | 21.4% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude 4.5 Haiku (Reasoning) source label without registered configuration ID | Claude Haiku 4.5 | 20.3% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| DeepSeek V3.1 Terminus (Reasoning) source label without registered configuration ID | DeepSeek V3.1 Terminus | 19.5% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| DeepSeek V3.2 (Reasoning) source label without registered configuration ID | DeepSeek V3.2 | 18.3% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude 4 Sonnet (Reasoning) source label without registered configuration ID | Claude Sonnet 4 | 18.0% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Gemma 4 31B (Reasoning) source label without registered configuration ID | Gemma 4 31B | 15.2% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Claude 4.1 Opus (Reasoning) source label without registered configuration ID | Claude Opus 4.1 | 15.2% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Gemma 4 26B A4B (Reasoning) source label without registered configuration ID | Gemma 4 26B | 13.1% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Command A+ source label without registered configuration ID | Command A+ | 10.7% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| NVIDIA Nemotron 3 Super 120B A12B (Reasoning) source label without registered configuration ID | Nemotron 3 Super | 9.7% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Nova 2.0 Pro Preview (medium) source label without registered configuration ID | Nova 2 Pro | 8.8% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Gemini 2.5 Pro source label without registered configuration ID | Gemini 2.5 Pro | 8.3% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Gemini 3.1 Flash-Lite source label without registered configuration ID | Gemini 3.1 Flash-Lite | 7.1% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Mistral Large 3 source label without registered configuration ID | Mistral Large 3 | 6.6% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| GLM 5V Turbo (Reasoning) source label without registered configuration ID | GLM-5V-Turbo | 4.5% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Mistral Small 4 (Reasoning) source label without registered configuration ID | Mistral Small 4 | 4.4% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Grok Code Fast 1 source label without registered configuration ID | Grok Code Fast 1 | 2.7% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| MiMo-V2-Omni source label without registered configuration ID | MiMo-V2-Omni | 0% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|
| Ling-2.6-1T source label without registered configuration ID | Ling 2.6 1T | 0% | v2Artificial Analysis independent evaluation | Score input source-checked | GDPval-AA v2 Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15 |
|---|