| GLM-5.3 (max) glm-5-3-max | GLM-5.3 | 68.8% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored independently-verified | Epoch AI permanent refresh source ↗Observed 2026-08-25 · checked 2026-09-01 |
|---|
| Gemini 3.7 Flash (high) gemini-3-7-flash-high | Gemini 3.7 Flash | 71.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-14 · checked 2026-08-17 |
|---|
| Grok 4.6 (xhigh) grok-4-6-xhigh | Grok 4.6 | 66.0% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-14 · checked 2026-08-17 |
|---|
| Inkling Small (xhigh) inkling-small-epoch-inkling-small-xhigh | Inkling-Small | 46.3% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-14 · checked 2026-08-18 |
|---|
| Inkling (xhigh) inkling-xhigh | Inkling | 33.3% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-06 · checked 2026-08-18 |
|---|
| Qwen3.8 Max (xhigh) qwen-3-8-max-xhigh | Qwen3.8 Max | 74.7% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-04 · checked 2026-08-17 |
|---|
| Gemini 3.6 Flash (high) gemini-3-6-flash-high | Gemini 3.6 Flash | 58.9% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-02 · checked 2026-08-17 |
|---|
| DeepSeek V4 Flash 0731 (max) deepseek-v4-flash-0731-epoch-deepseek-v4-flash-0731-max | DeepSeek V4 Flash 0731 | 57.5% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-02 · checked 2026-08-17 |
|---|
| Gemini 3.5 Flash-Lite (high) gemini-3-5-flash-lite-livebench-2026-06-25-high | Gemini 3.5 Flash-Lite | 26.0% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-08-02 · checked 2026-08-17 |
|---|
| Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Sol | 89% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Terra | 84.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Luna | 78.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.5 | 51.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.5 Pro; bulk export does not retain a complete upstream harness configuration. gpt-5-5-pro-default-high | GPT-5.5 | 51% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.4 Pro; bulk export does not retain a complete upstream harness configuration. gpt-5-4-pro-default-medium | GPT-5.4 | 50% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 47.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.8 | 47.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.7 | 43.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.6 | 40.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.2 | 40.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 39% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash | 39.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.6 | 39.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3 Flash | 35.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.1 | 33.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 4.6 | 32.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.1 | 31.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 mini | 28.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.5 | 27.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 Plus | 26.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 nano | 25.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration. o4-mini-high | o4-mini | 24.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen 3.6 Max (preview) | 23.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3.2 | 22.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2 | 21.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.5 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 Plus | 21.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.5 | 20.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4 | 19.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | o3 | 18.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5 | 16.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Pro | 14.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Sonnet 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 4.5 | 13.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | o1 | 9.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3 235B 2507 (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3 235B 2507 (Reasoning) | 8.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Qwen3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 Flash | 6.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude Haiku 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Haiku 4.5 | 5.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 | 5.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Flash | 4.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 mini | 4.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.6 | 3.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Grok 3 [Beta]; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 3 [Beta] | 3.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.7 | 2.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Claude 3.5 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude 3.5 Sonnet | 2.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3 | 1.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 nano | 1.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Maverick | 0.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4o | 0.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Scout | 0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Sol | 89% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Terra | 84.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Luna | 78.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.5 | 51.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.5 Pro; bulk export does not retain a complete upstream harness configuration. gpt-5-5-pro-default-high | GPT-5.5 | 51% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4 Pro; bulk export does not retain a complete upstream harness configuration. gpt-5-4-pro-default-medium | GPT-5.4 | 50% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 47.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.8 | 47.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.7 | 43.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.6 | 40.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.2 | 40.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 39% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash | 39.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.6 | 39.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3 Flash | 35.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.1 | 33.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 4.6 | 32.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.1 | 31.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 mini | 28.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.5 | 27.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 Plus | 26.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 nano | 25.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration. o4-mini-high | o4-mini | 24.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen 3.6 Max (preview) | 23.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3.2 | 22.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2 | 21.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.5 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 Plus | 21.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.5 | 20.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4 | 19.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | o3 | 18.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5 | 16.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Pro | 14.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Sonnet 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 4.5 | 13.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | o1 | 9.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3 235B 2507 (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3 235B 2507 (Reasoning) | 8.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Qwen3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 Flash | 6.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude Haiku 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Haiku 4.5 | 5.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 | 5.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Flash | 4.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 mini | 4.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.6 | 3.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Grok 3 [Beta]; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 3 [Beta] | 3.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.7 | 2.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Claude 3.5 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude 3.5 Sonnet | 2.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3 | 1.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 nano | 1.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Maverick | 0.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4o | 0.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Scout | 0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Claude Opus 5 (max) claude-opus-5-max | Claude Opus 5 | 85.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-07-24 · checked 2026-08-17 |
|---|
| Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Sol | 89% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Terra | 84.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.6 Luna | 78.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.5 | 51.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.5 Pro; bulk export does not retain a complete upstream harness configuration. gpt-5-5-pro-default-high | GPT-5.5 | 51% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.4 Pro; bulk export does not retain a complete upstream harness configuration. gpt-5-4-pro-default-medium | GPT-5.4 | 50% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 47.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.8 | 47.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.7 | 43.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.6 | 40.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.2 | 40.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 39% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3.5 Flash | 39.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.6 | 39.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 3 Flash | 35.6% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5.1 | 33.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 4.6 | 32.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.1 | 31.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 mini | 28.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2.5 | 27.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.6 Plus | 26.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 nano | 25.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration. o4-mini-high | o4-mini | 24.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen 3.6 Max (preview) | 23.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3.2 | 22.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K2 | 21.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.5 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 Plus | 21.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Opus 4.5 | 20.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 4 | 19.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | o3 | 18.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-5 | 16.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Pro | 14.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Sonnet 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Sonnet 4.5 | 13.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | o1 | 9.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3 235B 2507 (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3 235B 2507 (Reasoning) | 8.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Qwen3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Qwen3.5 Flash | 6.2% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude Haiku 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude Haiku 4.5 | 5.9% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 | 5.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Gemini 2.5 Flash | 4.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 mini | 4.5% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.6 | 3.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Grok 3 [Beta]; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Grok 3 [Beta] | 3.8% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GLM-4.7 | 2.4% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Claude 3.5 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Claude 3.5 Sonnet | 2.1% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | DeepSeek V3 | 1.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4.1 nano | 1.0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Maverick | 0.7% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-4o | 0.3% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Llama 4 Scout | 0% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Kimi K3 (Max) kimi-k3-max | Kimi K3 | 72.2% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-07-17 · checked 2026-08-17 |
|---|
| grok-4.20-0309-reasoning grok-4-20-epoch-grok-4-20-0309-reasoning | Grok 4.20 | 44.9% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-07-13 · checked 2026-08-17 |
|---|
| GPT-5.6 Sol (max) gpt-5-6-sol-max | GPT-5.6 Sol | 89.1% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-07-09 · checked 2026-08-17 |
|---|
| GPT-5.6 Terra (max) gpt-5-6-terra-max | GPT-5.6 Terra | 86.0% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-07-09 · checked 2026-08-17 |
|---|
| GPT-5.6 Luna (max) gpt-5-6-luna-max | GPT-5.6 Luna | 82.1% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-07-09 · checked 2026-08-17 |
|---|
| Grok 4.5 (high) grok-4-5-aa-2-high | Grok 4.5 | 57.2% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-07-09 · checked 2026-08-17 |
|---|
| Claude Sonnet 5 (max) claude-sonnet-5-max | Claude Sonnet 5 | 65.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-30 · checked 2026-08-17 |
|---|
| GLM-5.2 (max) glm-5-2-max | GLM-5.2 | 59.2% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-19 · checked 2026-08-17 |
|---|
| DeepSeek v4 (max) deepseek-v4-pro-max | DeepSeek V4 Pro | 45.3% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-17 · checked 2026-08-18 |
|---|
| grok-4.3_high grok-4-3-epoch-grok-4-3-high | Grok 4.3 | 42.8% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-17 · checked 2026-08-17 |
|---|
| GPT-5.4 Pro (xhigh) gpt-5-4-pro-xhigh | GPT-5.4 | 82.5% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-13 · checked 2026-08-18 |
|---|
| GPT-5.2 Pro (xhigh) gpt-5-2-pro-epoch-gpt-5-2-pro-2025-12-11-xhigh | GPT-5.2 | 74% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-13 · checked 2026-08-18 |
|---|
| Qwen3.7 Max qwen-3-7-max-epoch-qwen3-7-max | Qwen3.7-Max | 64.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-13 · checked 2026-08-17 |
|---|
| Kimi K2.7 Code kimi-k2-7-code-epoch-kimi-k2-7-code | Kimi K2.7 Code | 54.0% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-13 · checked 2026-08-17 |
|---|
| GPT-5.5 Pro (xhigh) gpt-5-5-pro | GPT-5.5 | 87.7% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-12 · checked 2026-08-17 |
|---|
| GPT-5.4 mini (xhigh) gpt-5-4-mini-xhigh | GPT-5.4 mini | 51.2% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-12 · checked 2026-08-17 |
|---|
| GPT-5 mini (high) gpt-5-mini-high | GPT-5 mini | 46.7% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-12 · checked 2026-08-17 |
|---|
| GPT-5.4 nano (high) gpt-5-4-nano-epoch-gpt-5-4-nano-2026-03-17-high | GPT-5.4 nano | 44.9% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-12 · checked 2026-08-17 |
|---|
| GPT-5 nano (high) gpt-5-nano-high | GPT-5 nano | 20% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-12 · checked 2026-08-18 |
|---|
| GPT-5.5 (xhigh) gpt-5-5-xhigh | GPT-5.5 | 85.3% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| GPT-5.4 (xhigh) gpt-5-4-xhigh | GPT-5.4 | 78.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| GPT-5.2 (xhigh) gpt-5-2-xhigh | GPT-5.2 | 67.4% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| Claude Opus 4.6 (max) claude-opus-4-6-max | Claude Opus 4.6 | 66.0% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| Gemini 3.1 Pro Preview gemini-3-1-pro-preview-epoch-gemini-3-1-pro-preview | Gemini 3.1 Pro Preview | 59.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| Gemini 3 Flash Preview gemini-3-flash-epoch-gemini-3-flash-preview | Gemini 3 Flash | 51.2% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| o4-mini (high) o4-mini-high | o4-mini | 36.1% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| Claude Opus 4.5 (32k thinking) claude-opus-4-5-epoch-claude-opus-4-5-20251101-32k | Claude Opus 4.5 | 34.4% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| Gemini 2.5 Pro gemini-2-5-pro-epoch-gemini-2-5-pro | Gemini 2.5 Pro | 24.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| Claude Sonnet 4.5 (32k thinking) claude-sonnet-4-5-epoch-claude-sonnet-4-5-20250929-32k | Claude Sonnet 4.5 | 23.9% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17 |
|---|
| o3-mini (high) o3-mini-high | o3-mini | 18.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-18 |
|---|
| Claude Opus 4.1 (32k thinking) claude-opus-4-1-epoch-claude-opus-4-1-20250805-32k | Claude Opus 4.1 | 12.6% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-18 |
|---|
| Claude Opus 4.8 (max) claude-opus-4-8-max | Claude Opus 4.8 | 80% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-10 · checked 2026-08-17 |
|---|
| Claude Opus 4.7 (max) claude-opus-4-7-max | Claude Opus 4.7 | 70.2% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-10 · checked 2026-08-17 |
|---|
| Gemini 3.5 Flash (high) gemini-3-5-flash-high | Gemini 3.5 Flash | 62.8% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-10 · checked 2026-08-17 |
|---|
| Kimi K2.6 kimi-k2-6-epoch-kimi-k2-6 | Kimi K2.6 | 57.2% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-10 · checked 2026-08-17 |
|---|
| GPT-5 (high) gpt-5-high | GPT-5 | 55.4% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-10 · checked 2026-08-17 |
|---|
| Claude Fable 5 (max) claude-fable-5-max | Claude Fable 5 | 87.0% | v2 / task implementation 2.0.0Epoch AI benchmark runner | Public reference · not scored source-checked | Epoch AI permanent refresh source ↗Observed 2026-06-09 · checked 2026-08-17 |
|---|
