| Provider chart specifies Pass@5 but not sampling or tool settings source label without registered configuration ID | DeepSeek V4 Flash Vision Exp | 35% | August 2026Source-native system | Public reference · not scored provider-reported | DeepSeek-V4-Flash-Vision-Exp release and provider evaluation ↗Observed 2026-08-21 · checked 2026-08-24 |
|---|
| GPT-5.6 Sol (max) as published in Meta's comparison table gpt-5-6-sol-max | GPT-5.6 Sol | 54.6% | rollingMeta evaluation container | Relative comparison · not standard direct provider-reported | Multimodal Intelligence of Muse Spark 1.2 ↗Observed 2026-08-20 · checked 2026-08-27 |
|---|
| Muse Spark 1.2 (xhigh) muse-spark-1-2-xhigh | Muse Spark 1.2 | 54% | rollingMeta evaluation container | Public reference · not scored source-checked | Muse Spark 1.2 individual evaluations ↗Observed 2026-08-20 · checked 2026-08-27 |
|---|
| Claude Opus 5 (max) as published in Meta's comparison table claude-opus-5-max | Claude Opus 5 | 47.5% | rollingMeta evaluation container | Relative comparison · not standard direct provider-reported | Multimodal Intelligence of Muse Spark 1.2 ↗Observed 2026-08-20 · checked 2026-08-27 |
|---|
| Muse Spark 1.1 (xhigh) as published in Meta's comparison table muse-spark-1-1-xhigh | Muse Spark 1.1 | 46% | rollingMeta evaluation container | Relative comparison · not standard direct provider-reported | Multimodal Intelligence of Muse Spark 1.2 ↗Observed 2026-08-20 · checked 2026-08-27 |
|---|
| Gemini 3.7 Flash (high) as published in Meta's comparison table gemini-3-7-flash-high | Gemini 3.7 Flash | 30% | rollingMeta evaluation container | Relative comparison · not standard direct provider-reported | Multimodal Intelligence of Muse Spark 1.2 ↗Observed 2026-08-20 · checked 2026-08-27 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 41% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 33% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01 |
|---|
| Kimi K3 public default configuration (reasoning_effort=max; temperature=1.0) kimi-k3-max | Kimi K3 | 23% | ZeroBench pass@5 without toolsOfficial ZeroBench setting, five runs | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-29 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 41% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 33% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K3 | 23% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27 |
|---|
| Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | GPT-5.4 | 41% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Muse Spark | 33% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
| Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID | Kimi K3 | 23% | 2026Source-native system | Source carrier · no additional scoring weight source-checked | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21 |
|---|
