AA-Omniscience

muse-spark-1-1

Meta

closed

Public reference

40.6%

claude-fable-5

Anthropic

closed

Public reference

40.2 index

Gemini 3.1 Pro Preview

gemini-3.1-pro-preview

Google

closed

Public reference

32.9 index

Claude Opus 5

claude-opus-5

Anthropic

closed

Public reference

31.3 index

claude-opus-4-8

Anthropic

closed

Public reference

27.4 index

grok-4.5

xAI

closed

Public reference

26.4 index

claude-opus-4-7

Anthropic

closed

Public reference

26.2 index

gemini-3.6-flash

Google

closed

Public reference

23.5 index

gemini-3.5-flash

Google

closed

Public reference

22.7 index

#10

gpt-5.6-sol

OpenAI

closed

Public reference

21.7 index

#11

gpt-5.5

OpenAI

closed

Public reference

20.1 index

#12

kimi-k3

Moonshot AI

open

Public reference

18.4 index

#13

NVIDIA Nemotron 3.5 Lightning 30B-A3B

grok-4.3

xAI

closed

Public reference

18.3 index

#14

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

NVIDIA

open

Public reference

17.5 index

#15

Grok 4.20

grok-4.20

xAI

closed

Public reference

15.3 index

#16

claude-sonnet-5

Anthropic

closed

Public reference

15.3 index

#17

qwen3.7-max

Alibaba Cloud

closed

Public reference

14.1 index

#18

claude-opus-4-6

Anthropic

closed

Public reference

13.5 index

#19

claude-opus-4-5-thinking

Anthropic

closed

Public reference

13.3 index

#20

claude-opus-4-5

Anthropic

closed

Public reference

13.3 index

#21

claude-sonnet-4-6

Anthropic

closed

Public reference

12.4 index

#22

gemini-3-flash

Google

closed

Public reference

11.6 index

#23

qwen3-6-max-preview

Alibaba Cloud

closed

Public reference

10.2 index

#24

Qwen3.6 Max

qwen3.6-max

Alibaba Cloud

closed

Public reference

10.2 index

#25

gpt-5.3-codex

OpenAI

closed

Public reference

9.9 index

#26

gemini-3.5-flash-lite

Google

closed

Public reference

6.9 index

#27

kimi-k2.6

Moonshot AI

open

Public reference

6.4 index

#28

gpt-5.4

OpenAI

closed

Public reference

5.7 index

#29

gpt-5.1

OpenAI

closed

Public reference

5.6 index

#30

mimo-v2-pro

Xiaomi

closed

Public reference

4.9 index

#31

muse-spark

Meta

closed

Public reference

4.1 index

#32

glm-5-2

Z.AI

open

Public reference

4 index

#33

grok-4

xAI

closed

Public reference

3.8 index

#34

mimo-v2-5-pro

Xiaomi

open

Public reference

3.6 index

#35

qwen3-6-plus

Alibaba Cloud

closed

Public reference

2.7 index

#36

qwen3.7-plus

Alibaba Cloud

closed

Public reference

2.4 index

#37

inkling

Thinking Machines Lab

open

Public reference

2.1 index

#38

glm-5

Z.AI

open

Public reference

2 index

#39

glm-5-1

Z.AI

open

Public reference

1.9 index

#40

MiniMax-M3

MiniMax

open

Public reference

1.4 index

#41

minimax-m2-7

MiniMax

open

Public reference

0.7 index

#42

Claude Sonnet 4.5

claude-sonnet-4-5

Anthropic

closed

Public reference

0.3 index

#43

Claude Sonnet 3.7

claude-3-7-sonnet

Anthropic

closed

Public reference

0.3 index

#44

Claude Sonnet 4

claude-sonnet-4

Anthropic

closed

Public reference

0.2 index

#45

gpt-5.6-terra

OpenAI

closed

Public reference

-0.2 index

#46

nemotron-3-ultra-550b

NVIDIA

open

Public reference

-0.8 index

#47

gpt-5.2

OpenAI

closed

Public reference

-1 index

#48

gpt-5.2-codex

OpenAI

closed

Public reference

-2.5 index

#49

command-a-plus

Cohere

open

Public reference

-4.0 index

#50

Claude Haiku 4.5

claude-haiku-4-5-20251001

Anthropic

closed

Public reference

-4.2 index

#51

gpt-5-1-codex

OpenAI

closed

Public reference

-6 index

#52

gpt-5-1-codex-max

OpenAI

closed

Public reference

-6 index

#53

Grok 3 mini

grok-3-mini

xAI

closed

Public reference

-6.0 index

#54

GPT-5 Codex

gpt-5-codex

OpenAI

closed

Public reference

-6.8 index

#55

gpt-5

OpenAI

closed

Public reference

-8.1 index

#56

kimi-k2.5

Moonshot AI

open

Public reference

-8.1 index

#57

claude-4-sonnet

Anthropic

closed

Public reference

-9.2 index

#58

MiMo-V2.5

mimo-v2.5

Xiaomi

open

Public reference

-9.3 index

#59

deepseek-v4-pro

DeepSeek

open

Public reference

-9.7 index

#60

OpenAI

closed

Public reference

-10.5 index

#61

gpt-4o

OpenAI

closed

Public reference

-10.7 index

#62

kimi-k2.7-code

Moonshot AI

open

Public reference

-10.7 index

#63

GPT-5 mini

gpt-5-mini

OpenAI

closed

Public reference

-10.8 index

#64

gpt-5.6-luna

OpenAI

closed

Public reference

-11.2 index

#65

Qwen3.5 Omni Plus

qwen3.5-omni-plus

Alibaba Cloud

closed

Public reference

-12.3 index

#66

gemini-2.5-pro

Google

closed

Public reference

-14.3 index

#67

glm-5-turbo

Z.AI

closed

Public reference

-15.1 index

#68

OpenAI

closed

Public reference

-15.3 index

#69

gemini-3.1-flash-lite

Google

closed

Public reference

-15.5 index

#70

llama-3-1-405b

Meta

open

Public reference

-17.3 index

#71

mimo-v2-omni

Xiaomi

closed

Public reference

-17.4 index

#72

hy3

Tencent

open

Public reference

-18.5 index

#73

hy3-preview

Tencent

open

Public reference

-18.5 index

#74

gpt-5.4-mini

OpenAI

closed

Public reference

-18.7 index

#75

glm-5v-turbo

Z.AI

closed

Public reference

-19.0 index

#76

qwen3.6-27b

Alibaba Cloud

open

Public reference

-19.8 index

#77

gemma-4-e4b

Google

open

Public reference

-20 index

#78

Kimi K2 Thinking

kimi-k2-thinking

Moonshot AI

open

Public reference

-20.5 index

#79

deepseek-v3.2

DeepSeek

open

Public reference

-20.9 index

#80

Qwen/Qwen3.6-35B-A3B

Alibaba Cloud

open

Public reference

-21.4 index

#81

deepseek-v4-flash

DeepSeek

open

Public reference

-22.3 index

#82

gemma-4-e2b

Google

open

Public reference

-24 index

#83

DeepSeek V3.1 Terminus

deepseek-v3.1-terminus

DeepSeek

open

Public reference

-24.3 index

#84

Kimi K2 0905

kimi-k2-0905

Moonshot AI

open

Public reference

-26.5 index

#85

deepseek-r1

DeepSeek

open

Public reference

-27.1 index

#86

kimi-k2

Moonshot AI

closed

Public reference

-27.5 index

#87

deepseek-v3-1

DeepSeek

open

Public reference

-28.4 index

#88

Grok 4 Fast

grok-4-fast

xAI

closed

Public reference

-28.4 index

#89

grok-4-fast-reasoning

xAI

closed

Public reference

-28.4 index

#90

grok-4-1-fast-reasoning

xAI

closed

Public reference

-28.7 index

#91

gpt-5.4-nano

OpenAI

closed

Public reference

-29.5 index

#92

Qwen/Qwen3.5-397B-A17B

Alibaba Cloud

open

Public reference

-29.8 index

#93

mistral-small-2603

Mistral AI

open

Public reference

-29.9 index

#94

mistral-medium-3

Mistral AI

closed

Public reference

-31.5 index

#95

glm-4.6

Z.AI

open

Public reference

-31.6 index

#96

MiniMax M2.1

minimax-m2.1

MiniMax

open

Public reference

-32.8 index

#97

lfm2-5-8b-a1b

LiquidAI

open

Public reference

-33.3 index

#98

mistral-large-2

Mistral AI

closed

Public reference

-34 index

#99

qwen3-max

Alibaba Cloud

closed

Public reference

-34.4 index

#100

glm-4.7

Z.AI

open

Public reference

-34.6 index

#101

gemini-2.5-flash

Google

closed

Public reference

-34.7 index

#102

o4-mini

OpenAI

closed

Public reference

-35.8 index

#103

grok-code-fast-1

xAI

closed

Public reference

-36 index

#104

gpt-4-1

OpenAI

closed

Public reference

-36.2 index

#105

mistralai/Mistral-Medium-3.5-128B

Mistral AI

open

Public reference

-36.3 index

#106

Mistral Medium 3.5

mistral-medium-3-5

Mistral AI

open

Public reference

-36.3 index

#107

step-3-7-flash

StepFun

open

Public reference

-37.5 index

#108

mistral-large-2512

Mistral AI

open

Public reference

-39.4 index

#109

Qwen3.5 122B

qwen3.5-122b-a10b

Alibaba Cloud

open

Public reference

-39.6 index

#110

Qwen/Qwen3.5-122B-A10B

Alibaba Cloud

open

Public reference

-39.6 index

#111

MiniMax M2.5

minimax-m2.5

MiniMax

open

Public reference

-39.7 index

#112

deepseek-v3

DeepSeek

open

Public reference

-41.3 index

#113

llama-4-maverick

Meta

open

Public reference

-41.8 index

#114

qwen3.5-27b

Alibaba Cloud

open

Public reference

-42 index

#115

Nemotron 3 Super

nemotron-3-super-120b

NVIDIA

open

Public reference

-42.1 index

#116

trinity-large-preview

Arcee AI

open

Public reference

-44.2 index

#117

trinity-large-thinking

Arcee AI

open

Public reference

-44.2 index

#118

gemma-4-31b

Google

open

Public reference

-45.4 index

#119

nemotron-ultra-253b

NVIDIA

open

Public reference

-45.5 index

#120

Qwen3.5 35B

qwen3.5-35b-a3b

Alibaba Cloud

open

Public reference

-46.4 index

#121

qwen3-5-35b-a3b

Alibaba Cloud

open

Public reference

-46.4 index

#122

MiniMax M2

minimax-m2

MiniMax

open

Public reference

-46.9 index

#123

claude-3-haiku

Anthropic

closed

Public reference

-47.6 index

#124

nova-pro

Amazon

closed

Public reference

-47.6 index

#125

Nova 2 Pro

nova-2-pro-preview

Amazon

closed

Public reference

-48.0 index

#126

Gemma 4 26B

gemma-4-26b-a4b

Google

open

Public reference

-48.1 index

#127

google/gemma-4-26b-a4b-it

Google

open

Public reference

-48.1 index

#128

gpt-oss-120b

OpenAI

open

Public reference

-50 index

#129

gpt-4-1-mini

OpenAI

closed

Public reference

-50.1 index

#130

grok-4-1-fast

xAI

closed

Public reference

-50.9 index

#131

Ling 2.6 1T

ling-2.6-1t

InclusionAI

open

Public reference

-51 index

#132

nemotron-3-nano-30b

NVIDIA

open

Public reference

-51.6 index

#133

google/gemma-4-12B

Google

open

Public reference

-51.9 index

#134

llama-4-scout

Meta

open

Public reference

-52.4 index

#135

nemotron-3-nano-omni-30b-a3b

NVIDIA

open

Public reference

-56 index

#136

gpt-4-1-nano

OpenAI

closed

Public reference

-56.4 index

#137

phi-4

Microsoft

open

Public reference

-56.7 index

#138

k-exaone

LG AI Research

closed

Public reference

-57.9 index

#139

sarvam-105b

Sarvam

open

Public reference

-59.5 index

#140

solar-pro-2

Upstage

closed

Public reference

-61.7 index

#141

exaone-4-0-32b

LG AI Research

open

Public reference

-62.3 index

#142

glm-4-5-air

Z.AI

closed

Public reference

-62.5 index

#143

gpt-oss-20b

OpenAI

open

Public reference

-63.9 index

#144

ling-2-6-flash

InclusionAI

open

Public reference

-65.7 index

#145

gemma-3-27b

Google

open

Public reference

-65.9 index

#146

sarvam-30b

Sarvam

open

Public reference

-72 index

#147

granite-4-0-350m

IBM

open

Public reference

-72.1 index

#148

granite-4-0-h-1b

IBM

open

Public reference

-73.6 index

#149

granite-4-0-1b

IBM

open

Public reference

-81.8 index

#150

exaone-4-0-1-2b

LG AI Research

open

Public reference

-82.6 index

#151

lfm2-5-vl-1-6b-extract

LiquidAI

open

Public reference

-83.9 index

#152

NVIDIA Nemotron 3.5 Lightning 30B-A3B

granite-4-0-h-350m

IBM

open

Public reference

-87.2 index

Every distinct dated source-published row for AA-Omniscience, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95 nemotron-3-5-lightning-30b-a3b-default	NVIDIA Nemotron 3.5 Lightning 30B-A3B	17.5 index	CurrentNVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness	Public reference · not scored provider-reported	NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	40.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 5	31.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	27.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	26.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	26.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	23.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	22.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	21.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	20.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	18.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	18.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	18 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	15.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.7	14.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	14.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-6-max	Claude Opus 4.6	13.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5 Thinking	13.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	10.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.3-Codex	9.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	6.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	6.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	5.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	5.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	4.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	4.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4	3.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	3.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	3.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	2.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	2.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	2.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	1.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	1.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	0.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	-0.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	-0.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2	-1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2 Codex	-2.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	-2.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	-3.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	-3.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	-4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex	-6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex-Max	-6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4 Sonnet	-9.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	-9.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	-10 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration. gpt-5-medium	GPT-5	-10.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	-10.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o	-10.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	-10.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	-11.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	-14.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	-15.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o3	-15.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	-15.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 3.1 405B	-17.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	-17.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	-18.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	-18.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	-18.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	-19 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	-19.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	-20 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	-21.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	-22.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	-22.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	-24 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek-R1	-27.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2	-27.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration. deepseek-v3-1-reasoning-default	DeepSeek V3.1	-28.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4 Fast (Reasoning)	-28.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast (Reasoning)	-28.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	-29.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	-29.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	-29.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	-29.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	-29.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3	-31.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.6	-31.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-8B-A1B	-33.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 2	-34 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	-34.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok Code Fast 1	-36 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1	-36.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	-36.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	-37.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	-39.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	-39.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.1	-41.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	-41.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	-41.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Flash	-42 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 27B	-42 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3 Max	-43.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	-44.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	-44.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	-45.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron Ultra 253B	-45.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-35B-A3B	-46.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	-46.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Haiku	-47.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nova Pro	-47.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	-48.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	-50 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	-50.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast	-50.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	-51.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	-51.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	-52.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	-56 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	-56.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Phi-4	-56.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	-57.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 105B	-59.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Solar Pro 2	-61.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 32B	-62.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.5-Air	-62.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	-63.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	-65.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	-65.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 30B	-72 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-350M	-72.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-1B	-73.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-1B	-81.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 1.2B	-82.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-VL-1.6B-Extract	-83.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-350M	-87.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	40.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 5	31.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	27.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	26.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	26.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	23.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	22.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	21.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	20.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	18.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	18.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	18 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	15.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.7	14.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	14.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-6-max	Claude Opus 4.6	13.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5 Thinking	13.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	10.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.3-Codex	9.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	6.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	6.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	5.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	5.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	4.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	4.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4	3.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	3.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	3.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	2.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	2.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	2.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	1.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	1.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	0.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	-0.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	-0.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2	-1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2 Codex	-2.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	-2.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	-3.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	-3.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	-4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex	-6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex-Max	-6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4 Sonnet	-9.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	-9.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	-10 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration. gpt-5-medium	GPT-5	-10.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	-10.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o	-10.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	-10.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	-11.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	-14.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	-15.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o3	-15.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	-15.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 3.1 405B	-17.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	-17.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	-18.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	-18.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	-18.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	-19 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	-19.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	-20 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	-21.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	-22.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	-22.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	-24 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek-R1	-27.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2	-27.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration. deepseek-v3-1-reasoning-default	DeepSeek V3.1	-28.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4 Fast (Reasoning)	-28.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast (Reasoning)	-28.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	-29.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	-29.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	-29.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	-29.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	-29.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3	-31.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.6	-31.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-8B-A1B	-33.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 2	-34 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	-34.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok Code Fast 1	-36 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1	-36.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	-36.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	-37.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	-39.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	-39.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.1	-41.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	-41.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	-41.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Flash	-42 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 27B	-42 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3 Max	-43.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	-44.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	-44.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	-45.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron Ultra 253B	-45.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-35B-A3B	-46.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	-46.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Haiku	-47.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nova Pro	-47.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	-48.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	-50 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	-50.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast	-50.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	-51.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	-51.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	-52.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	-56 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	-56.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Phi-4	-56.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	-57.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 105B	-59.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Solar Pro 2	-61.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 32B	-62.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.5-Air	-62.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	-63.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	-65.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	-65.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 30B	-72 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-350M	-72.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-1B	-73.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-1B	-81.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 1.2B	-82.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-VL-1.6B-Extract	-83.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-350M	-87.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	40.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	27.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	26.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	26.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	23.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Artificial Analysis Omniscience Index independent evaluation. source label without registered configuration ID	Gemini 3.6 Flash	23.5 index	CurrentArtificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	22.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	21.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	20.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	18.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	18.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	18 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	15.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.7	14.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	14.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-6-max	Claude Opus 4.6	13.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5 Thinking	13.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	10.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.3-Codex	9.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	6.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Artificial Analysis Omniscience Index independent evaluation. source label without registered configuration ID	Gemini 3.5 Flash-Lite	6.9 index	CurrentArtificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	6.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	5.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	5.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	4.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	4.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4	3.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	3.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	3.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	2.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	2.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	2.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	1.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	1.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	0.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	-0.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	-0.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2	-1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2 Codex	-2.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	-2.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	-3.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	-3.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	-4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex	-6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex-Max	-6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	-8.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4 Sonnet	-9.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	-9.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	-10 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration. gpt-5-medium	GPT-5	-10.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	-10.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o	-10.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	-10.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	-11.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	-14.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	-15.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o3	-15.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	-15.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 3.1 405B	-17.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	-17.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	-18.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	-18.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	-18.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	-19 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	-19.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	-20 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	-21.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	-22.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	-22.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	-24 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek-R1	-27.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2	-27.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration. deepseek-v3-1-reasoning-default	DeepSeek V3.1	-28.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4 Fast (Reasoning)	-28.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast (Reasoning)	-28.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	-29.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	-29.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	-29.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	-29.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	-29.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3	-31.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.6	-31.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-8B-A1B	-33.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 2	-34 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	-34.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok Code Fast 1	-36 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1	-36.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	-36.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	-37.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	-39.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	-39.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.1	-41.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	-41.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	-41.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Flash	-42 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 27B	-42 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3 Max	-43.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	-44.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	-44.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	-45.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron Ultra 253B	-45.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-35B-A3B	-46.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	-46.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Haiku	-47.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nova Pro	-47.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	-48.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	-50 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	-50.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast	-50.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	-51.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	-51.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	-52.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	-56 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	-56.4 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Phi-4	-56.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	-57.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 105B	-59.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Solar Pro 2	-61.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 32B	-62.3 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.5-Air	-62.5 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	-63.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	-65.7 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	-65.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 30B	-72 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-350M	-72.1 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-1B	-73.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-1B	-81.8 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 1.2B	-82.6 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-VL-1.6B-Extract	-83.9 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-350M	-87.2 index	2026Source-native system	Public reference · not scored source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Kimi K3; Artificial Analysis Omniscience Index. source label without registered configuration ID	Kimi K3	18.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21
Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published. muse-spark-1-1-xhigh	Muse Spark 1.1	40.6%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) claude-fable-5-max	Claude Fable 5	40.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Pro Preview source label without registered configuration ID	Gemini 3.1 Pro Preview	32.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.8 (Adaptive Reasoning, Max Effort) claude-opus-4-8-max	Claude Opus 4.8	27.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.5 (high) source label without registered configuration ID	Grok 4.5	26.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) claude-opus-4-7-max	Claude Opus 4.7	26.2 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.5 Flash (high) gemini-3-5-flash-high	Gemini 3.5 Flash	22.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Sol (max) gpt-5-6-sol-max	GPT-5.6 Sol	21.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.5 (xhigh) gpt-5-5-xhigh	GPT-5.5	20.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.3 (high) source label without registered configuration ID	Grok 4.3	18.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Muse Spark 1.1 (xhigh) muse-spark-1-1-xhigh	Muse Spark 1.1	18 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.20 0309 v2 (Reasoning) source label without registered configuration ID	Grok 4.20	15.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 5 (Adaptive Reasoning, Max Effort) claude-sonnet-5-max	Claude Sonnet 5	15.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Max source label without registered configuration ID	Qwen3.7-Max	14.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.6 (Adaptive Reasoning, Max Effort) claude-opus-4-6-max	Claude Opus 4.6	13.5 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.5 (Reasoning) source label without registered configuration ID	Claude Opus 4.5	13.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) claude-sonnet-4-6-max	Claude Sonnet 4.6	12.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3 Flash Preview (Reasoning) source label without registered configuration ID	Gemini 3 Flash	11.6 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 Max Preview source label without registered configuration ID	Qwen3.6 Max	10.2 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.3 Codex (xhigh) gpt-5-3-codex-xhigh	GPT-5.3-Codex	9.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.6 source label without registered configuration ID	Kimi K2.6	6.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 (xhigh) gpt-5-4-xhigh	GPT-5.4	5.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.1 (high) gpt-5-1-high	GPT-5.1	5.5 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2-Pro source label without registered configuration ID	MiMo-V2-Pro	4.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Muse Spark source label without registered configuration ID	Muse Spark	4.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.2 (max) glm-5-2-max	GLM-5.2	4.0 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4 source label without registered configuration ID	Grok 4	3.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5-Pro source label without registered configuration ID	MiMo-V2.5-Pro	3.6 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 Plus source label without registered configuration ID	Qwen3.6 Plus	2.6 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Plus source label without registered configuration ID	Qwen3.7-Plus	2.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5 (Reasoning) source label without registered configuration ID	GLM-5	2 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.1 (Reasoning) source label without registered configuration ID	GLM-5.1	1.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M3 source label without registered configuration ID	MiniMax M3	1.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2.7 source label without registered configuration ID	MiniMax M2.7	0.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Sonnet (Reasoning) source label without registered configuration ID	Claude Sonnet 4.5	0.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 3.7 Sonnet (Reasoning) source label without registered configuration ID	Claude Sonnet 3.7	0.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4 Sonnet (Reasoning) source label without registered configuration ID	Claude Sonnet 4	0.2 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Terra (max) gpt-5-6-terra-max	GPT-5.6 Terra	-0.2 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Nemotron 3 Ultra 550B A55B (Reasoning) source label without registered configuration ID	Nemotron 3 Ultra	-0.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.2 (xhigh) gpt-5-2-xhigh	GPT-5.2	-1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.2 Codex (xhigh) gpt-5-2-codex-xhigh	GPT-5.2 Codex	-2.5 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Command A+ source label without registered configuration ID	Command A+	-4.0 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Haiku (Reasoning) source label without registered configuration ID	Claude Haiku 4.5	-4.2 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 3 mini Reasoning (high) source label without registered configuration ID	Grok 3 mini	-6.0 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5 Codex (high) gpt-5-codex-high	GPT-5 Codex	-6.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5 (high) gpt-5-high	GPT-5	-8.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.5 (Reasoning) source label without registered configuration ID	Kimi K2.5	-8.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5 source label without registered configuration ID	MiMo-V2.5	-9.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Pro (Reasoning, Max Effort) deepseek-v4-pro-max	DeepSeek V4 Pro	-10.0 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
o1 source label without registered configuration ID	o1	-10.6 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.7 Code source label without registered configuration ID	Kimi K2.7 Code	-10.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5 mini (medium) gpt-5-mini-medium	GPT-5 mini	-10.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Luna (max) gpt-5-6-luna-max	GPT-5.6 Luna	-11.2 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 Omni Plus source label without registered configuration ID	Qwen3.5 Omni Plus	-12.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 2.5 Pro source label without registered configuration ID	Gemini 2.5 Pro	-14.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5-Turbo source label without registered configuration ID	GLM-5-Turbo	-15.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
o3 source label without registered configuration ID	o3	-15.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Flash-Lite source label without registered configuration ID	Gemini 3.1 Flash-Lite	-15.5 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2-Omni source label without registered configuration ID	MiMo-V2-Omni	-17.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 mini (xhigh) gpt-5-4-mini-xhigh	GPT-5.4 mini	-18.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM 5V Turbo (Reasoning) source label without registered configuration ID	GLM-5V-Turbo	-19.0 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 27B (Reasoning) source label without registered configuration ID	Qwen3.6 27B	-19.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2 Thinking source label without registered configuration ID	Kimi K2 Thinking	-20.5 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V3.2 (Reasoning) source label without registered configuration ID	DeepSeek V3.2	-20.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Flash (Reasoning, Max Effort) deepseek-v4-flash-max	DeepSeek V4 Flash	-22.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V3.1 Terminus (Reasoning) source label without registered configuration ID	DeepSeek V3.1 Terminus	-24.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2 0905 source label without registered configuration ID	Kimi K2 0905	-26.5 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4 Fast (Reasoning) source label without registered configuration ID	Grok 4 Fast	-28.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 nano (xhigh) gpt-5-4-nano-xhigh	GPT-5.4 nano	-29.6 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 397B A17B (Reasoning) source label without registered configuration ID	Qwen3.5 397B A17B	-29.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Small 4 (Reasoning) source label without registered configuration ID	Mistral Small 4	-29.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2.1 source label without registered configuration ID	MiniMax M2.1	-32.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3 Max Thinking source label without registered configuration ID	Qwen3 Max	-34.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-4.7 (Reasoning) source label without registered configuration ID	GLM-4.7	-34.6 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 2.5 Flash Preview (Sep '25) (Reasoning) source label without registered configuration ID	Gemini 2.5 Flash	-34.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
o4-mini (high) o4-mini-high	o4-mini	-35.8 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok Code Fast 1 source label without registered configuration ID	Grok Code Fast 1	-36 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Medium 3.5 source label without registered configuration ID	Mistral Medium 3.5	-36.3 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Large 3 source label without registered configuration ID	Mistral Large 3	-39.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 122B A10B (Reasoning) source label without registered configuration ID	Qwen3.5 122B	-39.6 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2.5 source label without registered configuration ID	MiniMax M2.5	-39.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-4.6 (Reasoning) source label without registered configuration ID	GLM-4.6	-41.7 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 27B (Reasoning) source label without registered configuration ID	Qwen3.5 27B	-42.0 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
NVIDIA Nemotron 3 Super 120B A12B (Reasoning) source label without registered configuration ID	Nemotron 3 Super	-42.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 31B (Reasoning) source label without registered configuration ID	Gemma 4 31B	-45.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 35B A3B (Reasoning) source label without registered configuration ID	Qwen3.5 35B	-46.4 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2 source label without registered configuration ID	MiniMax M2	-46.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Nova 2.0 Pro Preview (medium) source label without registered configuration ID	Nova 2 Pro	-48.0 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 26B A4B (Reasoning) source label without registered configuration ID	Gemma 4 26B	-48.1 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Ling-2.6-1T source label without registered configuration ID	Ling 2.6 1T	-51 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 12B (Reasoning) source label without registered configuration ID	Gemma 4 12B Unified	-51.9 index	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Exact published model / configuration

Canonical product

Score

Version / system

Evidence

Source / observed

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95

nemotron-3-5-lightning-30b-a3b-default

17.5 index

CurrentNVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness

Public reference · not scored

provider-reported

NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

40.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Claude Opus 5

31.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

27.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

26.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

22.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

15.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-6-max

13.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

13.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

10.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

9.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

1.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

1.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

0.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-0.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-0.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-2.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-2.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-3.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-3.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-9.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

-9.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

-10 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration.

gpt-5-medium

-10.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-11.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-14.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-17.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-17.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-19 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-19.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-20 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-21.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

-22.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

-22.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-24 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-27.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-27.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration.

deepseek-v3-1-reasoning-default

-28.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-28.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-28.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

-29.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

-29.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-31.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-31.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-33.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-34 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-34.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-37.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-39.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-39.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-42 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-42 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-43.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-44.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-44.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-45.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-45.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-46.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-46.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-47.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-47.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-48.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-51.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-51.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-52.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-57.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-59.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-61.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-62.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-62.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-63.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-65.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-65.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-72 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-72.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-73.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-81.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-82.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-83.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-87.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

40.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Claude Opus 5

31.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

27.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

26.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

22.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

15.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-6-max

13.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

13.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

10.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

9.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

1.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

1.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

0.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-0.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-0.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-2.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-2.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-3.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-3.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-9.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

-9.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

-10 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration.

gpt-5-medium

-10.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-11.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-14.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-17.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-17.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-19 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-19.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-20 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-21.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

-22.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

-22.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-24 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-27.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-27.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration.

deepseek-v3-1-reasoning-default

-28.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-28.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-28.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

-29.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

-29.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-31.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-31.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-33.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-34 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-34.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-37.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-39.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-39.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-42 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-42 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-43.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-44.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-44.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-45.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-45.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-46.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-46.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-47.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-47.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-48.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-51.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-51.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-52.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-57.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-59.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-61.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-62.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-62.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-63.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-65.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-65.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-72 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-72.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-73.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-81.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-82.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-83.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-87.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

40.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

27.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

26.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Artificial Analysis Omniscience Index independent evaluation.

source label without registered configuration ID

23.5 index

CurrentArtificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

22.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

18 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

15.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-6-max

13.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

13.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

10.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

9.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Artificial Analysis Omniscience Index independent evaluation.

source label without registered configuration ID

6.9 index

CurrentArtificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

3.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

1.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

1.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

0.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-0.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-0.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-2.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-2.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-3.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-3.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

-8.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-9.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

-9.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

-10 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration.

gpt-5-medium

-10.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-10.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-11.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-14.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-15.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-17.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-17.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-18.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-19 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-19.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-20 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-21.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

-22.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

-22.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-24 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-27.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-27.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration.

deepseek-v3-1-reasoning-default

-28.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-28.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-28.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

-29.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-29.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

-29.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-31.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-31.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-33.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-34 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-34.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-36.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-37.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-39.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-39.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-41.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-42 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-42 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-43.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-44.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-44.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-45.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-45.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-46.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-46.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-47.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-47.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-48.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-50.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-51.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-51.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-52.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56.4 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-56.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-57.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-59.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-61.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-62.3 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-62.5 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-63.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-65.7 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-65.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-72 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-72.1 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-73.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-81.8 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-82.6 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-83.9 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

-87.2 index

2026Source-native system

Public reference · not scored

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Kimi K3; Artificial Analysis Omniscience Index.

source label without registered configuration ID

18.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21

Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published.

muse-spark-1-1-xhigh

40.6%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16

Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)

claude-fable-5-max

40.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Pro Preview

source label without registered configuration ID

Gemini 3.1 Pro Preview

32.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.8 (Adaptive Reasoning, Max Effort)

claude-opus-4-8-max

27.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.5 (high)

source label without registered configuration ID

26.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.7 (Adaptive Reasoning, Max Effort)

claude-opus-4-7-max

26.2 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.5 Flash (high)

gemini-3-5-flash-high

22.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Sol (max)

gpt-5-6-sol-max

21.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.5 (xhigh)

gpt-5-5-xhigh

20.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.3 (high)

source label without registered configuration ID

18.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark 1.1 (xhigh)

muse-spark-1-1-xhigh

18 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.20 0309 v2 (Reasoning)

source label without registered configuration ID

Grok 4.20

15.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 5 (Adaptive Reasoning, Max Effort)

claude-sonnet-5-max

15.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Max

source label without registered configuration ID

14.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.6 (Adaptive Reasoning, Max Effort)

claude-opus-4-6-max

13.5 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.5 (Reasoning)

source label without registered configuration ID

13.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)

claude-sonnet-4-6-max

12.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3 Flash Preview (Reasoning)

source label without registered configuration ID

11.6 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 Max Preview

source label without registered configuration ID

Qwen3.6 Max

10.2 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.3 Codex (xhigh)

gpt-5-3-codex-xhigh

9.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.6

source label without registered configuration ID

6.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 (xhigh)

gpt-5-4-xhigh

5.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.1 (high)

gpt-5-1-high

5.5 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2-Pro

source label without registered configuration ID

4.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark

source label without registered configuration ID

4.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.2 (max)

glm-5-2-max

4.0 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4

source label without registered configuration ID

3.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5-Pro

source label without registered configuration ID

3.6 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 Plus

source label without registered configuration ID

2.6 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Plus

source label without registered configuration ID

2.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5 (Reasoning)

source label without registered configuration ID

2 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.1 (Reasoning)

source label without registered configuration ID

1.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M3

source label without registered configuration ID

1.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.7

source label without registered configuration ID

0.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Sonnet (Reasoning)

source label without registered configuration ID

Claude Sonnet 4.5

0.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 3.7 Sonnet (Reasoning)

source label without registered configuration ID

Claude Sonnet 3.7

0.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4 Sonnet (Reasoning)

source label without registered configuration ID

Claude Sonnet 4

0.2 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Terra (max)

gpt-5-6-terra-max

-0.2 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nemotron 3 Ultra 550B A55B (Reasoning)

source label without registered configuration ID

-0.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.2 (xhigh)

gpt-5-2-xhigh

-1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.2 Codex (xhigh)

gpt-5-2-codex-xhigh

-2.5 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Command A+

source label without registered configuration ID

-4.0 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Haiku (Reasoning)

source label without registered configuration ID

Claude Haiku 4.5

-4.2 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 3 mini Reasoning (high)

source label without registered configuration ID

Grok 3 mini

-6.0 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 Codex (high)

gpt-5-codex-high

GPT-5 Codex

-6.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 (high)

gpt-5-high

-8.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.5 (Reasoning)

source label without registered configuration ID

-8.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5

source label without registered configuration ID

MiMo-V2.5

-9.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Pro (Reasoning, Max Effort)

deepseek-v4-pro-max

-10.0 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

source label without registered configuration ID

-10.6 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.7 Code

source label without registered configuration ID

-10.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 mini (medium)

gpt-5-mini-medium

GPT-5 mini

-10.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Luna (max)

gpt-5-6-luna-max

-11.2 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 Omni Plus

source label without registered configuration ID

Qwen3.5 Omni Plus

-12.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 2.5 Pro

source label without registered configuration ID

-14.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5-Turbo

source label without registered configuration ID

-15.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

source label without registered configuration ID

-15.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Flash-Lite

source label without registered configuration ID

-15.5 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2-Omni

source label without registered configuration ID

-17.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 mini (xhigh)

gpt-5-4-mini-xhigh

-18.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM 5V Turbo (Reasoning)

source label without registered configuration ID

-19.0 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 27B (Reasoning)

source label without registered configuration ID

-19.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2 Thinking

source label without registered configuration ID

Kimi K2 Thinking

-20.5 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.2 (Reasoning)

source label without registered configuration ID

-20.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Flash (Reasoning, Max Effort)

deepseek-v4-flash-max

-22.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.1 Terminus (Reasoning)

source label without registered configuration ID

DeepSeek V3.1 Terminus

-24.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2 0905

source label without registered configuration ID

Kimi K2 0905

-26.5 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4 Fast (Reasoning)

source label without registered configuration ID

Grok 4 Fast

-28.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 nano (xhigh)

gpt-5-4-nano-xhigh

-29.6 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 397B A17B (Reasoning)

source label without registered configuration ID

-29.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Small 4 (Reasoning)

source label without registered configuration ID

-29.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.1

source label without registered configuration ID

MiniMax M2.1

-32.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3 Max Thinking

source label without registered configuration ID

-34.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.7 (Reasoning)

source label without registered configuration ID

-34.6 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 2.5 Flash Preview (Sep '25) (Reasoning)

source label without registered configuration ID

-34.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

o4-mini (high)

o4-mini-high

o4-mini

-35.8 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok Code Fast 1

source label without registered configuration ID

-36 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Medium 3.5

source label without registered configuration ID

Mistral Medium 3.5

-36.3 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Large 3

source label without registered configuration ID

-39.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 122B A10B (Reasoning)

source label without registered configuration ID

Qwen3.5 122B

-39.6 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.5

source label without registered configuration ID

MiniMax M2.5

-39.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.6 (Reasoning)

source label without registered configuration ID

-41.7 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 27B (Reasoning)

source label without registered configuration ID

-42.0 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

NVIDIA Nemotron 3 Super 120B A12B (Reasoning)

source label without registered configuration ID

Nemotron 3 Super

-42.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 31B (Reasoning)

source label without registered configuration ID

-45.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 35B A3B (Reasoning)

source label without registered configuration ID

Qwen3.5 35B

-46.4 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2

source label without registered configuration ID

MiniMax M2

-46.9 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nova 2.0 Pro Preview (medium)

source label without registered configuration ID

Nova 2 Pro

-48.0 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 26B A4B (Reasoning)

source label without registered configuration ID

Gemma 4 26B

-48.1 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Ling-2.6-1T

source label without registered configuration ID

Ling 2.6 1T

-51 index

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA-Omniscience Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 12B (Reasoning)

source label without registered configuration ID