Artificial Analysis Coding Index

gpt-5.6-sol

OpenAI

closed

Source carrier

77.4 index

gpt-5.6-terra

OpenAI

closed

Source carrier

76.7 index

claude-fable-5

Anthropic

closed

Source carrier

76.5 index

kimi-k3

Moonshot AI

open

Source carrier

76.2 index

gpt-5.5

OpenAI

closed

Source carrier

74.9 index

claude-opus-4-8

Anthropic

closed

Source carrier

74.3 index

claude-opus-4-7

Anthropic

closed

Source carrier

73.6 index

grok-4.5

xAI

closed

Source carrier

72.5 index

#10

claude-sonnet-5

Anthropic

closed

Source carrier

71.5 index

#11

gpt-5.6-luna

OpenAI

closed

Source carrier

71.5 index

#12

muse-spark-1-1

Meta

closed

Source carrier

71.3 index

#13

gpt-5.4

OpenAI

closed

Source carrier

71.0 index

#14

gemini-3.5-flash

Google

closed

Source carrier

70.1 index

#15

gemini-3.6-flash

Google

closed

Source carrier

69.2 index

#16

glm-5-2

Z.AI

open

Source carrier

68.8 index

#17

qwen3.7-max

Alibaba Cloud

closed

Source carrier

66.0 index

#18

kimi-k2.6

Moonshot AI

open

Source carrier

61.8 index

#19

kimi-k2.7-code

Moonshot AI

open

Source carrier

60.8 index

#20

mimo-v2-5-pro

Xiaomi

open

Source carrier

60.2 index

#21

deepseek-v4-pro

DeepSeek

open

Source carrier

59.4 index

#22

hy3

Tencent

open

Source carrier

58.8 index

#23

hy3-preview

Tencent

open

Source carrier

58.8 index

#24

muse-spark

Meta

closed

Source carrier

58.6 index

#25

MiniMax-M3

MiniMax

open

Source carrier

58.6 index

#26

deepseek-v4-flash

DeepSeek

open

Source carrier

56.2 index

#27

gpt-5.4-mini

OpenAI

closed

Source carrier

56.1 index

#28

gpt-5.4-nano

OpenAI

closed

Source carrier

56.1 index

#29

qwen3.7-plus

Alibaba Cloud

closed

Source carrier

55.9 index

#30

glm-5-1

Z.AI

open

Source carrier

55.8 index

#31

qwen3-6-plus

Alibaba Cloud

closed

Source carrier

54.5 index

#32

qwen3.6-27b

Alibaba Cloud

open

Source carrier

53.7 index

#33

minimax-m2-7

MiniMax

open

Source carrier

52.6 index

#34

inkling

Thinking Machines Lab

open

Source carrier

52.1 index

#35

gpt-5.1

OpenAI

closed

Source carrier

49.4 index

#36

gemini-3.5-flash-lite

Google

closed

Source carrier

49.3 index

#37

nemotron-3-ultra-550b

NVIDIA

open

Source carrier

49.3 index

#38

Qwen/Qwen3.5-397B-A17B

Alibaba Cloud

open

Source carrier

48.2 index

#39

mistralai/Mistral-Medium-3.5-128B

Mistral AI

open

Source carrier

46.9 index

#40

kimi-k2.5

Moonshot AI

open

Source carrier

46.8 index

#41

Qwen/Qwen3.5-122B-A10B

Alibaba Cloud

open

Source carrier

45.7 index

#42

glm-4.7

Z.AI

open

Source carrier

45.3 index

#43

gemma-4-31b

Google

open

Source carrier

43.4 index

#44

grok-4.3

xAI

closed

Source carrier

42.3 index

#45

Qwen/Qwen3.6-35B-A3B

Alibaba Cloud

open

Source carrier

41.9 index

#46

OpenAI

closed

Source carrier

39.7 index

#47

step-3-7-flash

StepFun

open

Source carrier

39.6 index

#48

google/gemma-4-26b-a4b-it

Google

open

Source carrier

39.3 index

#49

gpt-5

OpenAI

closed

Source carrier

37.8 index

#50

gemini-3.1-flash-lite

Google

closed

Source carrier

34.7 index

#51

OpenAI

closed

Source carrier

34.0 index

#52

gemini-2.5-pro

Google

closed

Source carrier

33.3 index

#53

K-Exaone

k-exaone

LG AI Research

closed

Source carrier

32.1 index

#54

Gemma 4 12B Unified

google/gemma-4-12B

Google

open

Source carrier

31.0 index

#55

gpt-oss-120b

OpenAI

open

Source carrier

30.4 index

#56

command-a-plus

Cohere

open

Source carrier

27.9 index

#57

mistral-small-2603

Mistral AI

open

Source carrier

26.6 index

#58

Trinity-Large-Preview

trinity-large-preview

Arcee AI

open

Source carrier

25.8 index

#59

Trinity-Large-Thinking

trinity-large-thinking

Arcee AI

open

Source carrier

25.8 index

#60

ling-2-6-flash

InclusionAI

open

Source carrier

25.3 index

#61

gemini-1-5-pro

Google

closed

Source carrier

23.6 index

#62

deepseek-v3

DeepSeek

open

Source carrier

23.0 index

#63

gpt-4-turbo

OpenAI

closed

Source carrier

21.5 index

#64

gpt-oss-20b

OpenAI

open

Source carrier

20.7 index

#65

gpt-4-1-mini

OpenAI

closed

Source carrier

20.2 index

#66

mistral-large-2512

Mistral AI

open

Source carrier

20.1 index

#67

claude-3-opus

Anthropic

closed

Source carrier

19.5 index

#68

llama-4-maverick

Meta

open

Source carrier

16.3 index

#69

nemotron-3-nano-30b

NVIDIA

open

Source carrier

14.4 index

#70

nemotron-3-nano-omni-30b-a3b

NVIDIA

open

Source carrier

13.8 index

#71

gpt-4o-mini

OpenAI

closed

Source carrier

11.4 index

#72

gpt-4-1-nano

OpenAI

closed

Source carrier

11.1 index

#73

gemma-3-27b

Google

open

Source carrier

10.1 index

#74

Gemma 4 E4B

gemma-4-e4b

Google

open

Source carrier

9.4 index

#75

llama-4-scout

Meta

open

Source carrier

8.2 index

#76

Gemma 4 E2B

gemma-4-e2b

Google

open

Source carrier

7.2 index

Every distinct dated source-published row for Artificial Analysis Coding Index, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 5	78.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	77.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	76.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	76.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	76.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	74.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	74.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	73.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	72.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	71.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	71.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	71.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	71.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	70.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	69.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	68.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	66.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	61.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	60.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	60.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	59.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	58.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	58.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	58.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	58.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	58.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	56.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	56.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	56.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	55.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	55.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	54.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	53.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	52.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	52.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	52.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	49.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	49.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	49.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	48.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	48.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	46.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	46.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	46.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	45.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	45.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	43.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	42.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	41.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	39.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	39.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	39.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	37.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	34.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant o1-preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1-preview	34.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	33.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	32.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	31.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	30.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	27.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	26.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	26.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	25.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	25.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	25.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 1.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 1.5 Pro	23.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	23.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4 Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4 Turbo	21.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	20.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	20.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	20.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude 3 Opus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Opus	19.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	16.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	14.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	13.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o mini	11.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	11.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	10.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	9.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	8.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	7.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 5	78.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	77.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	76.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	76.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	76.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	74.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	74.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	73.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	72.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	71.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	71.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	71.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	71.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	70.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	69.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	68.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	66.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	61.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	60.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	60.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	59.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	58.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	58.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	58.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	58.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	58.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	56.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	56.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	56.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	55.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	55.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	54.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	53.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	52.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	52.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	52.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	49.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	49.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	49.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	48.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	48.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	46.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	46.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	46.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	45.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	45.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	43.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	42.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	41.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	39.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	39.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	39.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	37.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	34.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant o1-preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1-preview	34.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	33.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	32.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	31.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	30.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	27.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	26.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	26.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	25.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	25.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	25.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 1.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 1.5 Pro	23.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	23.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4 Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4 Turbo	21.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	20.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	20.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	20.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude 3 Opus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Opus	19.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	16.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	14.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	13.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o mini	11.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	11.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	10.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	9.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	8.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	7.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	77.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	76.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	76.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	76.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	74.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	74.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	73.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	72.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	71.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	71.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	71.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	71.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	70.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	69.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	68.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	66.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	61.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	60.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	60.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	59.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	58.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	58.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	58.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	58.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	58.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	56.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	56.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	56.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	55.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	55.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	54.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	53.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	52.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	52.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	52.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	49.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	49.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	49.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	48.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	48.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	46.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	46.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	46.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	45.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	45.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	43.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	42.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	41.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	39.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	39.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	39.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	37.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	34.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant o1-preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1-preview	34.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	33.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	30.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	27.9 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	26.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	26.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	25.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 1.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 1.5 Pro	23.6 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	23.0 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4 Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4 Turbo	21.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	20.7 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	20.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	20.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude 3 Opus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Opus	19.5 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	16.3 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	14.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	13.8 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o mini	11.4 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	11.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	10.1 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	8.2 index	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact published model / configuration

Canonical product

Score

Version / system

Evidence

Source / observed

Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Claude Opus 5

78.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

77.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

73.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

72.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

59.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

58.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

56.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

56.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

56.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

54.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

53.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

52.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

52.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

52.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

48.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

46.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

43.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

42.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

41.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

37.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant o1-preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

K-Exaone

32.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Gemma 4 12B Unified

31.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

27.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

26.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Trinity-Large-Preview

25.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Trinity-Large-Thinking

25.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 1.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4 Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude 3 Opus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

19.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

16.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

13.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

11.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

11.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

10.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Gemma 4 E4B

9.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

8.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Gemma 4 E2B

7.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Claude Opus 5

78.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

77.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

73.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

72.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

59.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

58.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

56.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

56.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

56.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

54.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

53.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

52.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

52.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

52.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

48.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

46.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

43.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

42.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

41.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

37.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant o1-preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

K-Exaone

32.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Gemma 4 12B Unified

31.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

27.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

26.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Trinity-Large-Preview

25.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Trinity-Large-Thinking

25.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 1.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4 Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude 3 Opus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

19.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

16.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

13.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

11.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

11.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

10.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Gemma 4 E4B

9.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

8.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

Gemma 4 E2B

7.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

77.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

76.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

73.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

72.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

59.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

58.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

56.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

56.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

56.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

54.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

53.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

52.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

52.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

52.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

49.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

48.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

46.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

43.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

42.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

41.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

37.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant o1-preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

27.9 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

26.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 1.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.6 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

23.0 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4 Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.7 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.2 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

20.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude 3 Opus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

19.5 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

16.3 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

14.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

13.8 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4o mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

11.4 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

11.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

10.1 index

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID