AA Long Context Reasoning

kimi-k3

Moonshot AI

open

Score input

82.7%

muse-spark-1-1

Meta

closed

Score input

81.3%

Gemini 3.7 Flash

gemini-3.7-flash

Google

closed

Score input

81%

Muse Glimmer 30B

meta-models/Muse-Glimmer-30B

Meta

open

Score input

80%

gpt-5.6-terra

OpenAI

closed

Score input

79.7%

gemini-3.6-flash

Google

closed

Score input

79%

gpt-5.5

OpenAI

closed

Score input

79%

DeepSeek V4 Flash Vision Exp

gpt-5.6-luna

OpenAI

closed

Score input

78.3%

#10

deepseek-v4-flash-vision-exp

DeepSeek

—

Public reference

78%

#11

GLM-5.3-Flash

glm-5.3-flash

Z.AI

open

Score input

78%

#12

gpt-5.4

OpenAI

closed

Score input

77.7%

#13

gpt-5.6-sol

OpenAI

closed

Score input

77.7%

#14

claude-sonnet-5

Anthropic

closed

Score input

77%

#15

Qwen3.8-Flash-Next

Qwen/Qwen3.8-Flash-Next

Alibaba Cloud

open

Public reference

77%

#16

glm-5-2

Z.AI

open

Score input

76.7%

#17

claude-fable-5

Anthropic

closed

Score input

76.7%

#18

GLM-5.3

glm-5.3

Z.AI

announced-open

Score input

76.3%

#19

gpt-5.2-codex

OpenAI

closed

Source carrier

75.7%

#20

claude-opus-5

Anthropic

closed

Score input

75.7%

#21

gpt-5

OpenAI

closed

Public reference

75.6%

#22

DeepSeek V4 Pro 0813

DeepSeek-V4-Pro-0813

DeepSeek

open

Public reference

75.3%

#23

claude-opus-4-7

Anthropic

closed

Score input

75.3%

#24

gpt-5.1

OpenAI

closed

Public reference

75%

#25

Grok 4.6

grok-4.6

xAI

closed

Score input

75%

#26

claude-opus-4-6

Anthropic

closed

Public reference

74.3%

#27

claude-opus-4-5

Anthropic

closed

Public reference

74%

#28

claude-opus-4-5-thinking

Anthropic

closed

Source carrier

74%

#29

gpt-5.3-codex

OpenAI

closed

Public reference

74%

#30

grok-4.5

xAI

closed

Score input

74%

#31

MiniMax-M3

MiniMax

open

Public reference

74%

#32

mimo-v2-5-pro

Xiaomi

open

Public reference

73.3%

#33

claude-opus-4-8

Anthropic

closed

Score input

73%

#34

kimi-k2.5

Moonshot AI

open

Score input

73%

#35

gpt-5.2

OpenAI

closed

Source carrier

72.7%

#36

Gemini 3.1 Pro Preview

gemini-3.1-pro-preview

Google

closed

Public reference

72.7%

#37

Qwen/Qwen3.5-397B-A17B

Alibaba Cloud

open

Score input

72.7%

#38

claude-sonnet-4-6

Anthropic

closed

Public reference

70.7%

#39

Qwen/Qwen3.5-122B-A10B

Alibaba Cloud

open

Score input

70.3%

#40

Claude Haiku 4.5

claude-haiku-4-5-20251001

Anthropic

closed

Score input

70.3%

#41

kimi-k2.6

Moonshot AI

open

Source carrier

69.7%

#42

muse-spark

Meta

closed

Source carrier

69.7%

#43

qwen3-6-max-preview

Alibaba Cloud

closed

Source carrier

69.7%

#44

qwen3-6-plus

Alibaba Cloud

closed

Source carrier

69.7%

#45

Qwen3.6 Max

qwen3.6-max

Alibaba Cloud

closed

Public reference

69.7%

#46

gemini-3.5-flash

Google

closed

Public reference

69.3%

#47

gpt-5.4-mini

OpenAI

closed

Public reference

69.3%

#48

OpenAI

closed

Public reference

69.3%

#49

GPT-5 Codex

gpt-5-codex

OpenAI

closed

Public reference

69%

#50

qwen3.7-max

Alibaba Cloud

closed

Public reference

69%

#51

minimax-m2-7

MiniMax

open

Source carrier

68.7%

#52

qwen3.6-27b

Alibaba Cloud

open

Source carrier

68.7%

#53

grok-4

xAI

closed

Public reference

68%

#54

grok-4-1-fast-reasoning

xAI

closed

Source carrier

68%

#55

qwen3.5-27b

Alibaba Cloud

open

Public reference

67.3%

#56

gpt-5-1-codex

OpenAI

closed

Source carrier

67.3%

#57

gpt-5-1-codex-max

OpenAI

closed

Source carrier

67.3%

#58

nemotron-3-ultra-550b

NVIDIA

open

Score input

67%

#59

hy3

Tencent

open

Source carrier

66.7%

#60

hy3-preview

Tencent

open

Source carrier

66.7%

#61

mimo-v2-omni

Xiaomi

closed

Source carrier

66.7%

#62

Qwen3.5 122B

qwen3.5-122b-a10b

Alibaba Cloud

open

Score input

66.7%

#63

Qwen/Qwen3.6-35B-A3B

Alibaba Cloud

open

Score input

66.7%

#64

Claude Opus 4.1

claude-opus-4-1

Anthropic

closed

Score input

66.3%

#65

deepseek-v4-pro

DeepSeek

open

Public reference

66.3%

#66

gemini-3-flash

Google

closed

Public reference

66.3%

#67

Kimi K2 Thinking

kimi-k2-thinking

Moonshot AI

open

Public reference

66.3%

#68

kimi-k2.7-code

Moonshot AI

open

Public reference

66.3%

#69

claude-4-1-opus-thinking

Anthropic

closed

Source carrier

66.3%

#70

gemini-2.5-pro

Google

closed

Public reference

66%

#71

GPT-5 mini

gpt-5-mini

OpenAI

closed

Public reference

66%

#72

gpt-5.4-nano

OpenAI

closed

Public reference

66%

#73

MiniMax M2.5

minimax-m2.5

MiniMax

open

Public reference

66%

#74

qwen3-max

Alibaba Cloud

closed

Public reference

66%

#75

Claude Sonnet 4.5

claude-sonnet-4-5

Anthropic

closed

Score input

65.7%

#76

mistralai/Mistral-Medium-3.5-128B

Mistral AI

open

Score input

65.3%

#77

gemini-3.1-flash-lite

Google

closed

Public reference

65.3%

#78

DeepSeek V3.1 Terminus

deepseek-v3.1-terminus

DeepSeek

open

Public reference

65%

#79

deepseek-v3.2

DeepSeek

open

Public reference

65%

#80

qwen3.7-plus

Alibaba Cloud

closed

Public reference

65%

#81

grok-4-fast-reasoning

xAI

closed

Source carrier

64.7%

#82

Claude Sonnet 4

claude-sonnet-4

Anthropic

closed

Score input

64.7%

#83

Grok 4 Fast

grok-4-fast

xAI

closed

Public reference

64.7%

#84

gemini-2.5-flash

Google

closed

Public reference

64.3%

#85

grok-4.3

xAI

closed

Public reference

64.3%

#86

glm-4.7

Z.AI

open

Public reference

64%

#87

step-3-7-flash

StepFun

open

Source carrier

63.7%

#88

glm-5

Z.AI

open

Public reference

63.3%

#89

inkling

Thinking Machines Lab

open

Source carrier

63.3%

#90

deepseek-v4-flash

DeepSeek

open

Public reference

63%

#91

qwen3-5-35b-a3b

Alibaba Cloud

open

Source carrier

62.7%

#92

MiMo-V2.5

mimo-v2.5

Xiaomi

open

Public reference

62.7%

#93

Qwen3.5 35B

qwen3.5-35b-a3b

Alibaba Cloud

open

Score input

62.7%

#94

LongCat-2.0

meituan-longcat/LongCat-2.0

Meituan

open

Score input

62.7%

#95

glm-5-1

Z.AI

open

Public reference

62.3%

#96

Solar Open 2 250B

upstage/Solar-Open2-250B

Upstage

open

Score input

62.3%

#97

gemini-3.5-flash-lite

Google

closed

Public reference

62%

#98

gemma-4-31b

Google

open

Public reference

62%

#99

google/gemma-4-26b-a4b-it

Google

open

Score input

61.7%

#100

glm-5v-turbo

Z.AI

closed

Public reference

61%

#101

gpt-4-1

OpenAI

closed

Source carrier

61%

#102

MiniMax M2

minimax-m2

MiniMax

open

Public reference

61%

#103

Mistral Medium 3.5

mistral-medium-3-5

Mistral AI

open

Public reference

61%

#104

glm-5-turbo

Z.AI

closed

Source carrier

60.7%

#105

mimo-v2-pro

Xiaomi

closed

Source carrier

60.7%

#106

Claude Sonnet 3.7

claude-3-7-sonnet

Anthropic

closed

Score input

60.7%

#107

Nemotron 3 Super

nemotron-3-super-120b

NVIDIA

open

Score input

60%

#108

OpenAI

closed

Public reference

59.3%

#109

MiniMax M2.1

minimax-m2.1

MiniMax

open

Public reference

59%

#110

Grok 4.20

grok-4.20

xAI

closed

Public reference

58%

#111

deepseek-v3-1

DeepSeek

open

Public reference

56.7%

#112

k-exaone

LG AI Research

closed

Source carrier

55.7%

#113

Gemma 4 26B

gemma-4-26b-a4b

Google

open

Score input

55.7%

#114

google/gemma-4-12B

Google

open

Public reference

55.3%

#115

o4-mini

OpenAI

closed

Public reference

55%

#116

deepseek-r1

DeepSeek

open

Source carrier

54.7%

#117

NVIDIA Nemotron 3.5 Lightning 30B-A3B

glm-4.6

Z.AI

open

Public reference

54.3%

#118

Nova 2 Pro

nova-2-pro-preview

Amazon

closed

Score input

54.3%

#119

Qwen3.5 Omni Plus

qwen3.5-omni-plus

Alibaba Cloud

closed

Public reference

52.7%

#120

Kimi K2 0905

kimi-k2-0905

Moonshot AI

open

Public reference

52.3%

#121

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

NVIDIA

open

Score input

52%

#122

kimi-k2

Moonshot AI

closed

Source carrier

51%

#123

gpt-oss-120b

OpenAI

open

Source carrier

50.7%

#124

Grok 3 mini

grok-3-mini

xAI

closed

Score input

50.3%

#125

llama-4-maverick

Meta

open

Score input

50%

#126

grok-code-fast-1

xAI

closed

Public reference

48.3%

#127

mistral-small-2603

Mistral AI

open

Score input

47.3%

#128

command-a-plus

Cohere

open

Public reference

46%

#129

gpt-4-1-mini

OpenAI

closed

Score input

45.3%

#130

claude-4-sonnet

Anthropic

closed

Source carrier

44.3%

#131

glm-4-5-air

Z.AI

closed

Source carrier

43.7%

#132

trinity-large-thinking

Arcee AI

open

Score input

38.3%

#133

nemotron-3-nano-30b

NVIDIA

open

Score input

37.3%

#134

nemotron-3-nano-omni-30b-a3b

NVIDIA

open

Source carrier

35.7%

#135

mistral-large-2512

Mistral AI

open

Source carrier

34.7%

#136

Ling 2.6 1T

ling-2.6-1t

InclusionAI

open

Public reference

34.7%

#137

Claude Opus 4

claude-opus-4

Anthropic

closed

Score input

33.7%

#138

trinity-large-preview

Arcee AI

open

Source carrier

33%

#139

gemma-4-e4b

Google

open

Source carrier

30.7%

#140

gpt-oss-20b

OpenAI

open

Source carrier

30.7%

#141

llama-4-scout

Meta

open

Score input

30.3%

#142

deepseek-v3

DeepSeek

open

Source carrier

29%

#143

mistral-medium-3

Mistral AI

closed

Source carrier

28%

#144

ling-2-6-flash

InclusionAI

open

Source carrier

25%

#145

llama-3-1-405b

Meta

open

Source carrier

24.3%

#146

grok-4-1-fast

xAI

closed

Source carrier

22%

#147

claude-3-haiku

Anthropic

closed

Source carrier

21%

#148

gpt-4-1-nano

OpenAI

closed

Score input

19.3%

#149

nova-pro

Amazon

closed

Source carrier

19%

#150

gemma-4-e2b

Google

open

Source carrier

15%

#151

deepseek-r1-distill-qwen-32b

DeepSeek

open

Source carrier

9.7%

#152

exaone-4-0-32b

LG AI Research

open

Source carrier

#153

nemotron-ultra-253b

NVIDIA

open

Source carrier

7.3%

#154

gemma-3-27b

Google

open

Score input

6.3%

#155

granite-4-0-h-1b

IBM

open

Source carrier

6.3%

#156

mistral-large-2

Mistral AI

closed

Source carrier

5.3%

#157

granite-4-0-1b

IBM

open

Source carrier

#158

exaone-4-0-1-2b

LG AI Research

open

Source carrier

#159

gpt-4o

OpenAI

closed

Source carrier

#160

granite-4-0-350m

IBM

open

Source carrier

#161

granite-4-0-h-350m

IBM

open

Source carrier

#162

lfm2-5-8b-a1b

LiquidAI

open

Source carrier

#163

lfm2-5-vl-1-6b-extract

LiquidAI

open

Source carrier

#164

phi-4

Microsoft

open

Source carrier

#165

sarvam-105b

Sarvam

open

Source carrier

#166

sarvam-30b

Sarvam

open

Source carrier

#167

solar-pro-2

Upstage

closed

Source carrier

Every distinct dated source-published row for AA Long Context Reasoning, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
Qwen3.8-Flash-Next (Artificial Analysis independent run) qwen-3-8-flash-next-aa-unspecified	Qwen3.8-Flash-Next	77%	standardArtificial Analysis AA-LCR evaluation	Public reference · not scored independently-verified	Qwen3.8-Flash-Next individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
GLM-5.2 (max) (Artificial Analysis independent run) glm-5-2-max	GLM-5.2	76.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GLM-5.2 (max) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run) claude-opus-4-7-max	Claude Opus 4.7	75.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Claude Opus 4.7 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Claude Opus 4.6 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run) claude-opus-4-6-max	Claude Opus 4.6	74.3%	standardArtificial Analysis AA-LCR evaluation	Public reference · not scored independently-verified	Claude Opus 4.6 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Kimi K2.5 (Reasoning) (Artificial Analysis completed independent run) kimi-k2-5-thinking	Kimi K2.5	73%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Kimi K2.5 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.5 397B A17B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-397b-thinking	Qwen3.5 397B A17B	72.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Qwen3.5 397B A17B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.5 122B A10B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-122b-a10b-aa-reasoning-default	Qwen3.5-122B-A10B	70.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Qwen3.5 122B A10B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.6 35B A3B (Reasoning) (Artificial Analysis completed independent run) qwen3-6-35b-a3b-aa-reasoning-default	Qwen3.6-35B-A3B	66.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Qwen3.6 35B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Mistral Medium 3.5 (Artificial Analysis completed independent run) mistral-medium-3-5-128b-aa-reasoning-default	Mistral Medium 3.5 128B	65.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Mistral Medium 3.5 current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
LongCat 2.0 (Artificial Analysis independent run) longcat-2-0-default	LongCat-2.0	62.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	LongCat 2.0 individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Gemma 4 26B A4B (Reasoning) (Artificial Analysis completed independent run) gemma-4-26b-a4b-aa-reasoning-default	Gemma 4 26B A4B	61.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Gemma 4 26B A4B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
DeepSeek V3.1 (Reasoning) (Artificial Analysis independent run) deepseek-v3-1-reasoning-default	DeepSeek V3.1	56.7%	standardArtificial Analysis AA-LCR evaluation	Public reference · not scored independently-verified	DeepSeek V3.1 (Reasoning) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Llama 4 Maverick (Artificial Analysis completed independent run) llama-4-maverick-aa-non-reasoning-default	Llama 4 Maverick	50%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Llama 4 Maverick current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Mistral Small 4 (Reasoning) (Artificial Analysis completed independent run) mistral-small-4-reasoning	Mistral Small 4	47.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Mistral Small 4 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
DeepSeek V3.1 (Non-reasoning) (Artificial Analysis independent run) deepseek-v3-1-non-reasoning	DeepSeek V3.1	46.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	DeepSeek V3.1 (Non-reasoning) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
GPT-4.1 mini (Artificial Analysis completed independent run) gpt-4-1-mini-epoch-gpt-4-1-mini-2025-04-14	GPT-4.1 mini	45.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GPT-4.1 mini current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Trinity Large Thinking (Artificial Analysis completed independent run) trinity-large-thinking-aa-reasoning-default	Trinity-Large-Thinking	38.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Trinity Large Thinking current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) (Artificial Analysis completed independent run) nemotron-3-nano-30b-aa-reasoning-default	Nemotron 3 Nano 30B	37.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Llama 4 Scout (Artificial Analysis completed independent run) llama-4-scout-aa-non-reasoning-default	Llama 4 Scout	30.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Llama 4 Scout current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
GPT-4.1 nano (Artificial Analysis completed independent run) gpt-4-1-nano-epoch-gpt-4-1-nano-2025-04-14	GPT-4.1 nano	19.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GPT-4.1 nano current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Gemma 3 27B Instruct (Artificial Analysis completed independent run) gemma-3-27b-aa-non-reasoning-default	Gemma 3 27B	6.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Gemma 3 27B Instruct current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Muse Spark 1.2 (xhigh; Artificial Analysis independent run) muse-spark-1-2-xhigh	Muse Spark 1.2	83.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Muse Spark 1.2 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Kimi K3 (max; Artificial Analysis independent run) kimi-k3-max	Kimi K3	82.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Kimi K3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Muse Spark 1.1 (xhigh; Artificial Analysis independent run) muse-spark-1-1-xhigh	Muse Spark 1.1	81.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Muse Spark 1.1 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Gemini 3.7 Flash (medium; Artificial Analysis independent run) gemini-3-7-flash-medium	Gemini 3.7 Flash	81%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Gemini 3.7 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Terra (max; Artificial Analysis independent run) gpt-5-6-terra-max	GPT-5.6 Terra	79.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GPT-5.6 Terra individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Gemini 3.6 Flash (high; Artificial Analysis independent run) gemini-3-6-flash-high	Gemini 3.6 Flash	79%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Gemini 3.6 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.5 (xhigh; Artificial Analysis independent run) gpt-5-5-xhigh	GPT-5.5	79%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GPT-5.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Luna (max; Artificial Analysis independent run) gpt-5-6-luna-max	GPT-5.6 Luna	78.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GPT-5.6 Luna individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Flash Vision Exp (max; Artificial Analysis independent run) deepseek-v4-flash-vision-exp-max-harness	DeepSeek V4 Flash Vision Exp	78%	standardArtificial Analysis AA-LCR evaluation	Public reference · not scored independently-verified	DeepSeek V4 Flash Vision Exp individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GLM-5.3-Flash (max; Artificial Analysis independent run) glm-5-3-flash-max	GLM-5.3-Flash	78%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GLM-5.3-Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.4 (xhigh; Artificial Analysis independent run) gpt-5-4-xhigh	GPT-5.4	77.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GPT-5.4 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Sol (max; Artificial Analysis independent run) gpt-5-6-sol-max	GPT-5.6 Sol	77.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GPT-5.6 Sol individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Sonnet 5 (max; Artificial Analysis independent run) claude-sonnet-5-max	Claude Sonnet 5	77%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Claude Sonnet 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Fable 5 (max; Artificial Analysis independent run) claude-fable-5-max	Claude Fable 5	76.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Claude Fable 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GLM-5.3 (max; Artificial Analysis independent run) glm-5-3-max	GLM-5.3	76.3%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	GLM-5.3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Opus 5 (max; Artificial Analysis independent run) claude-opus-5-max	Claude Opus 5	75.7%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Claude Opus 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Pro 0813 (max; Artificial Analysis independent run) deepseek-v4-pro-0813-max	DeepSeek V4 Pro 0813	75.3%	standardArtificial Analysis AA-LCR evaluation	Public reference · not scored independently-verified	DeepSeek V4 Pro 0813 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Grok 4.6 (high; Artificial Analysis independent run) grok-4-6-high	Grok 4.6	75%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Grok 4.6 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Grok 4.5 (high; Artificial Analysis independent run) grok-4-5-aa-2-high	Grok 4.5	74%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Grok 4.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Opus 4.8 (max; Artificial Analysis independent run) claude-opus-4-8-max	Claude Opus 4.8	73%	standardArtificial Analysis AA-LCR evaluation	Score input independently-verified	Claude Opus 4.8 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Flash max as published by Upstage deepseek-v4-flash-max	DeepSeek V4 Flash	63.7%	standardSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
MiMo-V2.5 as published by Upstage mimo-v2-5-solar-open2-unspecified	MiMo-V2.5	62.7%	standardSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Solar Open 2 250B (high) solar-open2-250b-high	Solar Open 2 250B	62.3%	standardSolar Open 2 card English table	Score input provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Mistral Medium 3.5 as published by Upstage mistral-medium-3-5-high	Mistral Medium 3.5	61%	standardSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Command A+ as published by Upstage command-a-plus-solar-open2-unspecified	Command A+	46%	standardSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Solar Open 100B as published by Upstage solar-open-100b-reasoning-high	Solar Open 100B (Reasoning)	36%	standardSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95 nemotron-3-5-lightning-30b-a3b-default	NVIDIA Nemotron 3.5 Lightning 30B-A3B	52%	CurrentNVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness	Score input provider-reported	NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12
Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64 muse-glimmer-30b-high	Muse Glimmer 30B	80%	100-question setArtificial Analysis Long Context Reasoning documented evaluation	Public reference · not scored provider-reported	Muse Glimmer Evaluation Methodology ↗Observed 2026-08-10 · checked 2026-08-10
Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2 Codex	75.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	75.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	75%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	74.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	74.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5 Thinking	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.3-Codex	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	73.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	73.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration. gpt-5-medium	GPT-5	72.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2	72.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	71.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-6-max	Claude Opus 4.6	70.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	70.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	70.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	70%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 5	70%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o3	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	69%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast (Reasoning)	68%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4	68%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	67.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	67.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex-Max	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 27B	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.7	67%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	67%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude 4.1 Opus Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4.1 Opus Thinking	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	66%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	66%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	65.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	65.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	65%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	65%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4 Fast (Reasoning)	64.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	64.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	64%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	63.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	63.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	63%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-35B-A3B	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	62%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	62%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	60.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	60.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	59.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	58.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	55.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	55.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	55.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek-R1	54.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration. deepseek-v3-1-reasoning-default	DeepSeek V3.1	53.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2	51%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	50.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok Code Fast 1	48.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	48%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3 Max	46.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	46%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	46%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Flash	45.9%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.1	45%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	44.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	44.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4 Sonnet	44.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.5-Air	43.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	42.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	39%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	35.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	34.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	33.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	33%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	33%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	30.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	30.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	29%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3	28%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.6	26.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	25.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	25%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 3.1 405B	24.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast	22%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Haiku	21%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nova Pro	19%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	17%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	15%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek R1 Distill Qwen 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek R1 Distill Qwen 32B	9.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 32B	8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron Ultra 253B	7.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-1B	6.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	5.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 2	5.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-1B	4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 1.2B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-350M	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-350M	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-8B-A1B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-VL-1.6B-Extract	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Phi-4	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 105B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 30B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Solar Pro 2	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2 Codex	75.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	75.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	75%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	74.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	74.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5 Thinking	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.3-Codex	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	73.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	73.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration. gpt-5-medium	GPT-5	72.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2	72.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	71.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-6-max	Claude Opus 4.6	70.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	70.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	70.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	70%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 5	70%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o3	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	69%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast (Reasoning)	68%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4	68%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	67.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	67.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex-Max	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 27B	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.7	67%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	67%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude 4.1 Opus Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4.1 Opus Thinking	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	66%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	66%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	65.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	65.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	65%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	65%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4 Fast (Reasoning)	64.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	64.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	64%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	63.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	63.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	63%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-35B-A3B	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	62%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	62%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	60.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	60.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	59.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	58.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	55.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	55.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	55.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek-R1	54.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration. deepseek-v3-1-reasoning-default	DeepSeek V3.1	53.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2	51%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	50.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok Code Fast 1	48.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	48%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3 Max	46.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	46%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	46%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Flash	45.9%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.1	45%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	44.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	44.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4 Sonnet	44.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.5-Air	43.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	42.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	39%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	35.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	34.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	33.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	33%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	33%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	30.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	30.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	29%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3	28%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.6	26.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	25.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	25%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 3.1 405B	24.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast	22%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Haiku	21%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nova Pro	19%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	17%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	15%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek R1 Distill Qwen 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek R1 Distill Qwen 32B	9.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 32B	8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron Ultra 253B	7.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-1B	6.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	5.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 2	5.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-1B	4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 1.2B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-350M	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-350M	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-8B-A1B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-VL-1.6B-Extract	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Phi-4	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 105B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 30B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Solar Pro 2	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2 Codex	75.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration. gpt-5-high	GPT-5	75.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1	75%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K3	74.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.5	74.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5 Thinking	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.3-Codex	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Luna	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Terra	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.6 Sol	73.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	73.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration. gpt-5-medium	GPT-5	72.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.2	72.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.2	71.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-6-max	Claude Opus 4.6	70.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 5	70.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration. claude-opus-4-7-max	Claude Opus 4.7	70.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Fable 5	70%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.6 Flash	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	69.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Artificial Analysis Long Context Reasoning independent evaluation. source label without registered configuration ID	Gemini 3.6 Flash	69.7%	CurrentArtificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 mini	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o3	69.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	69%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast (Reasoning)	68%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4	68%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.8	67.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.5	67.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.1-Codex-Max	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 27B	67.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.7	67%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	67%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-122B-A10B	66.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude 4.1 Opus Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4.1 Opus Thinking	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-max	DeepSeek V4 Pro	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.7 Code	66.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Pro	66%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4 nano	66%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	65.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration. qwen3-5-397b-thinking	Qwen3.5 397B A17B	65.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.1 Flash-Lite	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration. kimi-k2-5-thinking	Kimi K2.5	65.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-pro-high	DeepSeek V4 Pro	65%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	65%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4 Fast (Reasoning)	64.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	64.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.7	64%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	63.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	63.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark 1.1	63.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-max	DeepSeek V4 Flash	63%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration. deepseek-v4-flash-high	DeepSeek V4 Flash	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5-35B-A3B	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash-Lite	62%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 31B	62%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Artificial Analysis Long Context Reasoning independent evaluation. source label without registered configuration ID	Gemini 3.5 Flash-Lite	62%	CurrentArtificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3.5 128B	61%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	60.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	60.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	o1	59.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	58.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 26B A4B	55.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	K-Exaone	55.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 12B Unified	55.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek-R1	54.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration. deepseek-v3-1-reasoning-default	DeepSeek V3.1	53.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2	51%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 120B	50.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok Code Fast 1	48.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	48%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3 Max	46.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Command A+	46%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Maverick	46%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 2.5 Flash	45.9%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.1	45%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Small 4	44.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration. mistral-small-4-reasoning	Mistral Small 4	44.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 4 Sonnet	44.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.5-Air	43.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 mini	42.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	39%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	35.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 3	34.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano 30B	33.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Preview	33%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Trinity-Large-Thinking	33%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E4B	30.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-OSS 20B	30.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3	29%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Medium 3	28%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-4.6	26.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 4 Scout	25.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	25%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Llama 3.1 405B	24.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.1 Fast	22%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude 3 Haiku	21%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nova Pro	19%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4.1 nano	17%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 4 E2B	15%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek R1 Distill Qwen 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek R1 Distill Qwen 32B	9.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 32B	8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron Ultra 253B	7.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-1B	6.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemma 3 27B	5.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Mistral Large 2	5.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-1B	4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Exaone 4.0 1.2B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-4o	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-350M	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Granite-4.0-H-350M	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-8B-A1B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	LFM2.5-VL-1.6B-Extract	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Phi-4	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 105B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sarvam 30B	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Solar Pro 2	0%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Kimi K3; Artificial Analysis Long Context Reasoning. source label without registered configuration ID	Kimi K3	74.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21
Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published. muse-spark-1-1-xhigh	Muse Spark 1.1	63.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16
GPT-5.2 Codex (xhigh) gpt-5-2-codex-xhigh	GPT-5.2 Codex	75.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5 (high) gpt-5-high	GPT-5	75.6%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.1 (high) gpt-5-1-high	GPT-5.1	75%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.5 (xhigh) gpt-5-5-xhigh	GPT-5.5	74.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M3 source label without registered configuration ID	MiniMax M3	74%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 (xhigh) gpt-5-4-xhigh	GPT-5.4	74%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.3 Codex (xhigh) gpt-5-3-codex-xhigh	GPT-5.3-Codex	74%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Luna (max) gpt-5-6-luna-max	GPT-5.6 Luna	74%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.5 (Reasoning) source label without registered configuration ID	Claude Opus 4.5	74%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Terra (max) gpt-5-6-terra-max	GPT-5.6 Terra	74%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Sol (max) gpt-5-6-sol-max	GPT-5.6 Sol	73.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5-Pro source label without registered configuration ID	MiMo-V2.5-Pro	73.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Pro Preview source label without registered configuration ID	Gemini 3.1 Pro Preview	72.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.2 (xhigh) gpt-5-2-xhigh	GPT-5.2	72.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.2 (max) glm-5-2-max	GLM-5.2	71.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) claude-sonnet-4-6-max	Claude Sonnet 4.6	70.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.6 (Adaptive Reasoning, Max Effort) claude-opus-4-6-max	Claude Opus 4.6	70.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 5 (Adaptive Reasoning, Max Effort) claude-sonnet-5-max	Claude Sonnet 5	70.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) claude-opus-4-7-max	Claude Opus 4.7	70.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Haiku (Reasoning) source label without registered configuration ID	Claude Haiku 4.5	70.3%	CurrentArtificial Analysis independent evaluation	Score input source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) claude-fable-5-max	Claude Fable 5	70%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Muse Spark source label without registered configuration ID	Muse Spark	69.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 Plus source label without registered configuration ID	Qwen3.6 Plus	69.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.6 source label without registered configuration ID	Kimi K2.6	69.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 Max Preview source label without registered configuration ID	Qwen3.6 Max	69.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 mini (xhigh) gpt-5-4-mini-xhigh	GPT-5.4 mini	69.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
o3 source label without registered configuration ID	o3	69.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.5 Flash (high) gemini-3-5-flash-high	Gemini 3.5 Flash	69.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Max source label without registered configuration ID	Qwen3.7-Max	69%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5 Codex (high) gpt-5-codex-high	GPT-5 Codex	69%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2.7 source label without registered configuration ID	MiniMax M2.7	68.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 27B (Reasoning) source label without registered configuration ID	Qwen3.6 27B	68.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4 source label without registered configuration ID	Grok 4	68%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.5 (high) source label without registered configuration ID	Grok 4.5	67.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.8 (Adaptive Reasoning, Max Effort) claude-opus-4-8-max	Claude Opus 4.8	67.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 27B (Reasoning) source label without registered configuration ID	Qwen3.5 27B	67.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Nemotron 3 Ultra 550B A55B (Reasoning) source label without registered configuration ID	Nemotron 3 Ultra	67%	CurrentArtificial Analysis independent evaluation	Score input source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2-Omni source label without registered configuration ID	MiMo-V2-Omni	66.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 122B A10B (Reasoning) source label without registered configuration ID	Qwen3.5 122B	66.7%	CurrentArtificial Analysis independent evaluation	Score input source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Pro (Reasoning, Max Effort) deepseek-v4-pro-max	DeepSeek V4 Pro	66.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3 Flash Preview (Reasoning) source label without registered configuration ID	Gemini 3 Flash	66.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.1 Opus (Reasoning) source label without registered configuration ID	Claude Opus 4.1	66.3%	CurrentArtificial Analysis independent evaluation	Score input source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.7 Code source label without registered configuration ID	Kimi K2.7 Code	66.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Exact published model / configuration

Canonical product

Score

Version / system

Evidence

Source / observed

Qwen3.8-Flash-Next (Artificial Analysis independent run)

qwen-3-8-flash-next-aa-unspecified

Qwen3.8-Flash-Next

77%

standardArtificial Analysis AA-LCR evaluation

Public reference · not scored

independently-verified

Qwen3.8-Flash-Next individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

GLM-5.2 (max) (Artificial Analysis independent run)

glm-5-2-max

76.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GLM-5.2 (max) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run)

claude-opus-4-7-max

75.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Claude Opus 4.6 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run)

claude-opus-4-6-max

74.3%

standardArtificial Analysis AA-LCR evaluation

Public reference · not scored

independently-verified

Claude Opus 4.6 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Kimi K2.5 (Reasoning) (Artificial Analysis completed independent run)

kimi-k2-5-thinking

73%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Kimi K2.5 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.5 397B A17B (Reasoning) (Artificial Analysis completed independent run)

qwen3-5-397b-thinking

72.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Qwen3.5 397B A17B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.5 122B A10B (Reasoning) (Artificial Analysis completed independent run)

qwen3-5-122b-a10b-aa-reasoning-default

70.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Qwen3.5 122B A10B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.6 35B A3B (Reasoning) (Artificial Analysis completed independent run)

qwen3-6-35b-a3b-aa-reasoning-default

66.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Qwen3.6 35B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Mistral Medium 3.5 (Artificial Analysis completed independent run)

mistral-medium-3-5-128b-aa-reasoning-default

65.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Mistral Medium 3.5 current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

LongCat 2.0 (Artificial Analysis independent run)

longcat-2-0-default

LongCat-2.0

62.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

LongCat 2.0 individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Gemma 4 26B A4B (Reasoning) (Artificial Analysis completed independent run)

gemma-4-26b-a4b-aa-reasoning-default

61.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Gemma 4 26B A4B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

DeepSeek V3.1 (Reasoning) (Artificial Analysis independent run)

deepseek-v3-1-reasoning-default

56.7%

standardArtificial Analysis AA-LCR evaluation

Public reference · not scored

independently-verified

DeepSeek V3.1 (Reasoning) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Llama 4 Maverick (Artificial Analysis completed independent run)

llama-4-maverick-aa-non-reasoning-default

50%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Llama 4 Maverick current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Mistral Small 4 (Reasoning) (Artificial Analysis completed independent run)

mistral-small-4-reasoning

47.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Mistral Small 4 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

DeepSeek V3.1 (Non-reasoning) (Artificial Analysis independent run)

deepseek-v3-1-non-reasoning

46.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

DeepSeek V3.1 (Non-reasoning) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

GPT-4.1 mini (Artificial Analysis completed independent run)

gpt-4-1-mini-epoch-gpt-4-1-mini-2025-04-14

45.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GPT-4.1 mini current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Trinity Large Thinking (Artificial Analysis completed independent run)

trinity-large-thinking-aa-reasoning-default

38.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Trinity Large Thinking current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) (Artificial Analysis completed independent run)

nemotron-3-nano-30b-aa-reasoning-default

37.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Llama 4 Scout (Artificial Analysis completed independent run)

llama-4-scout-aa-non-reasoning-default

30.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Llama 4 Scout current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

GPT-4.1 nano (Artificial Analysis completed independent run)

gpt-4-1-nano-epoch-gpt-4-1-nano-2025-04-14

19.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GPT-4.1 nano current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Gemma 3 27B Instruct (Artificial Analysis completed independent run)

gemma-3-27b-aa-non-reasoning-default

6.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Gemma 3 27B Instruct current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Muse Spark 1.2 (xhigh; Artificial Analysis independent run)

muse-spark-1-2-xhigh

Muse Spark 1.2

83.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Muse Spark 1.2 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Kimi K3 (max; Artificial Analysis independent run)

kimi-k3-max

82.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Kimi K3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Muse Spark 1.1 (xhigh; Artificial Analysis independent run)

muse-spark-1-1-xhigh

81.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Muse Spark 1.1 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Gemini 3.7 Flash (medium; Artificial Analysis independent run)

gemini-3-7-flash-medium

Gemini 3.7 Flash

81%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Gemini 3.7 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Terra (max; Artificial Analysis independent run)

gpt-5-6-terra-max

79.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GPT-5.6 Terra individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Gemini 3.6 Flash (high; Artificial Analysis independent run)

gemini-3-6-flash-high

79%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Gemini 3.6 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.5 (xhigh; Artificial Analysis independent run)

gpt-5-5-xhigh

79%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GPT-5.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Luna (max; Artificial Analysis independent run)

gpt-5-6-luna-max

DeepSeek V4 Flash Vision Exp

78.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GPT-5.6 Luna individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Flash Vision Exp (max; Artificial Analysis independent run)

deepseek-v4-flash-vision-exp-max-harness

78%

standardArtificial Analysis AA-LCR evaluation

Public reference · not scored

independently-verified

DeepSeek V4 Flash Vision Exp individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GLM-5.3-Flash (max; Artificial Analysis independent run)

glm-5-3-flash-max

GLM-5.3-Flash

78%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GLM-5.3-Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.4 (xhigh; Artificial Analysis independent run)

gpt-5-4-xhigh

77.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GPT-5.4 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Sol (max; Artificial Analysis independent run)

gpt-5-6-sol-max

77.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GPT-5.6 Sol individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Sonnet 5 (max; Artificial Analysis independent run)

claude-sonnet-5-max

77%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Claude Sonnet 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Fable 5 (max; Artificial Analysis independent run)

claude-fable-5-max

76.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Claude Fable 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GLM-5.3 (max; Artificial Analysis independent run)

glm-5-3-max

GLM-5.3

76.3%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

GLM-5.3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Opus 5 (max; Artificial Analysis independent run)

claude-opus-5-max

75.7%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Claude Opus 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Pro 0813 (max; Artificial Analysis independent run)

deepseek-v4-pro-0813-max

DeepSeek V4 Pro 0813

75.3%

standardArtificial Analysis AA-LCR evaluation

Public reference · not scored

independently-verified

DeepSeek V4 Pro 0813 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Grok 4.6 (high; Artificial Analysis independent run)

grok-4-6-high

Grok 4.6

75%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Grok 4.6 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Grok 4.5 (high; Artificial Analysis independent run)

grok-4-5-aa-2-high

74%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Grok 4.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Opus 4.8 (max; Artificial Analysis independent run)

claude-opus-4-8-max

73%

standardArtificial Analysis AA-LCR evaluation

Score input

independently-verified

Claude Opus 4.8 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Flash max as published by Upstage

deepseek-v4-flash-max

63.7%

standardSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

MiMo-V2.5 as published by Upstage

mimo-v2-5-solar-open2-unspecified

MiMo-V2.5

62.7%

standardSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Solar Open 2 250B (high)

solar-open2-250b-high

Solar Open 2 250B

62.3%

standardSolar Open 2 card English table

Score input

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Mistral Medium 3.5 as published by Upstage

mistral-medium-3-5-high

Mistral Medium 3.5

61%

standardSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Command A+ as published by Upstage

command-a-plus-solar-open2-unspecified

Solar Open 100B (Reasoning)

46%

standardSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Solar Open 100B as published by Upstage

solar-open-100b-reasoning-high

36%

standardSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95

nemotron-3-5-lightning-30b-a3b-default

NVIDIA Nemotron 3.5 Lightning 30B-A3B

52%

CurrentNVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness

Score input

provider-reported

NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12

Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64

muse-glimmer-30b-high

Muse Glimmer 30B

80%

100-question setArtificial Analysis Long Context Reasoning documented evaluation

Public reference · not scored

provider-reported

Muse Glimmer Evaluation Methodology ↗Observed 2026-08-10 · checked 2026-08-10

Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

75.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

75.6%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

75%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

73.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

73.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration.

gpt-5-medium

72.8%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

72.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-6-max

70.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

70.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude 4.1 Opus Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

65.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

65%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

63%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

62.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

59.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

57.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

54.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration.

deepseek-v3-1-reasoning-default

53.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

51%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

50.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.9%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

44.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

44.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

44.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

43.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

42.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

35.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

29%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

28%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25.8%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

24.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

22%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

19%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

17%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

15%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant DeepSeek R1 Distill Qwen 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

9.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

7.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01

Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

75.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

75.6%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

75%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

73.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

73.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration.

gpt-5-medium

72.8%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

72.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-6-max

70.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

70.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude 4.1 Opus Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

65.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

65%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

63%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

62.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

59.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

57.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

54.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration.

deepseek-v3-1-reasoning-default

53.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

51%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

50.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.9%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

44.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

44.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

44.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

43.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

42.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

35.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

29%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

28%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25.8%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

24.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

22%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

19%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

17%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

15%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant DeepSeek R1 Distill Qwen 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

9.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

7.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27

Exact BenchLM registry variant GPT-5.2-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

75.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5 (high); bulk export does not retain a complete upstream harness configuration.

gpt-5-high

75.6%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

75%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.5 Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.3 Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Luna; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Terra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

74%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.6 Sol; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

73.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

73.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5 (medium); bulk export does not retain a complete upstream harness configuration.

gpt-5-medium

72.8%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

72.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

71.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.6 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-6-max

70.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Sonnet 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.7 (Adaptive); bulk export does not retain a complete upstream harness configuration.

claude-opus-4-7-max

70.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Fable 5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

70%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Artificial Analysis Long Context Reasoning independent evaluation.

source label without registered configuration ID

69.7%

CurrentArtificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant o3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

69%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.1 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

68%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.8; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.1-Codex; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.1-Codex-Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5-27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

67%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Hy3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5-122B-A10B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude 4.1 Opus Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Pro (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-max

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.7 Code; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 2.5 Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-5.4 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

66%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5 397B (Reasoning); bulk export does not retain a complete upstream harness configuration.

qwen3-5-397b-thinking

65.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.1 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2.5 (Reasoning); bulk export does not retain a complete upstream harness configuration.

kimi-k2-5-thinking

65.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Pro (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-pro-high

65%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

65%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4 Fast (Reasoning); bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-4.7; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

64%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Inkling; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Muse Spark 1.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

63.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Flash (Max); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-max

63%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V4 Flash (High); bulk export does not retain a complete upstream harness configuration.

deepseek-v4-flash-high

62.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3.5-35B-A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3.5 Flash-Lite; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 31B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

62%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Artificial Analysis Long Context Reasoning independent evaluation.

source label without registered configuration ID

62%

CurrentArtificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Medium 3.5 128B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

61%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

60.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant o1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

59.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

58.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

57.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 26B A4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant K-Exaone; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 12B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

55.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek-R1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

54.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3.1 (Reasoning); bulk export does not retain a complete upstream harness configuration.

deepseek-v3-1-reasoning-default

53.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Kimi K2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

51%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-OSS 120B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

50.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok Code Fast 1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

48%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Qwen3 Max; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Command A+; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 4 Maverick; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

46%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemini 2.5 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45.9%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3.1; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

45%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Small 4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

44.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Small 4 (Reasoning); bulk export does not retain a complete upstream harness configuration.

mistral-small-4-reasoning

44.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude 4 Sonnet; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

44.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-4.5-Air; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

43.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1 mini; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

42.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

39%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

35.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Large 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

34.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron 3 Nano 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Trinity-Large-Preview; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Trinity-Large-Thinking; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

33%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 E4B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-OSS 20B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

30.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek V3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

29%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Medium 3; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

28%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GLM-4.6; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

26.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 4 Scout; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25.8%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

25%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Llama 3.1 405B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

24.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Grok 4.1 Fast; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

22%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Claude 3 Haiku; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

21%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nova Pro; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

19%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4.1 nano; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

17%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 4 E2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

15%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant DeepSeek R1 Distill Qwen 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

9.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Exaone 4.0 32B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Nemotron Ultra 253B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

7.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-H-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

6.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Gemma 3 27B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.7%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Mistral Large 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

5.3%

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Exaone 4.0 1.2B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant GPT-4o; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Granite-4.0-H-350M; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant LFM2.5-8B-A1B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant LFM2.5-VL-1.6B-Extract; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Phi-4; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Sarvam 105B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Sarvam 30B; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Exact BenchLM registry variant Solar Pro 2; bulk export does not retain a complete upstream harness configuration.

source label without registered configuration ID

2026Source-native system

Source carrier · no additional scoring weight

source-checked

BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Kimi K3; Artificial Analysis Long Context Reasoning.

source label without registered configuration ID

74.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21

Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published.

muse-spark-1-1-xhigh

63.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16

GPT-5.2 Codex (xhigh)

gpt-5-2-codex-xhigh

75.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 (high)

gpt-5-high

75.6%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.1 (high)

gpt-5-1-high

75%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.5 (xhigh)

gpt-5-5-xhigh

74.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M3

source label without registered configuration ID

74%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 (xhigh)

gpt-5-4-xhigh

74%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.3 Codex (xhigh)

gpt-5-3-codex-xhigh

74%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Luna (max)

gpt-5-6-luna-max

74%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.5 (Reasoning)

source label without registered configuration ID

74%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Terra (max)

gpt-5-6-terra-max

74%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Sol (max)

gpt-5-6-sol-max

73.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5-Pro

source label without registered configuration ID

73.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Pro Preview

source label without registered configuration ID

Gemini 3.1 Pro Preview

72.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.2 (xhigh)

gpt-5-2-xhigh

72.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.2 (max)

glm-5-2-max

71.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)

claude-sonnet-4-6-max

70.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.6 (Adaptive Reasoning, Max Effort)

claude-opus-4-6-max

70.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 5 (Adaptive Reasoning, Max Effort)

claude-sonnet-5-max

70.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.7 (Adaptive Reasoning, Max Effort)

claude-opus-4-7-max

70.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Haiku (Reasoning)

source label without registered configuration ID

Claude Haiku 4.5

70.3%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)

claude-fable-5-max

70%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark

source label without registered configuration ID

69.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 Plus

source label without registered configuration ID

69.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.6

source label without registered configuration ID

69.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 Max Preview

source label without registered configuration ID

Qwen3.6 Max

69.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 mini (xhigh)

gpt-5-4-mini-xhigh

69.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

source label without registered configuration ID

69.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.5 Flash (high)

gemini-3-5-flash-high

69.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Max

source label without registered configuration ID

69%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 Codex (high)

gpt-5-codex-high

GPT-5 Codex

69%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.7

source label without registered configuration ID

68.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 27B (Reasoning)

source label without registered configuration ID

68.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4

source label without registered configuration ID

68%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.5 (high)

source label without registered configuration ID

67.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.8 (Adaptive Reasoning, Max Effort)

claude-opus-4-8-max

67.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 27B (Reasoning)

source label without registered configuration ID

67.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nemotron 3 Ultra 550B A55B (Reasoning)

source label without registered configuration ID

67%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2-Omni

source label without registered configuration ID

66.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 122B A10B (Reasoning)

source label without registered configuration ID

Qwen3.5 122B

66.7%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Pro (Reasoning, Max Effort)

deepseek-v4-pro-max

66.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3 Flash Preview (Reasoning)

source label without registered configuration ID

66.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.1 Opus (Reasoning)

source label without registered configuration ID

Claude Opus 4.1

66.3%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.7 Code

source label without registered configuration ID

66.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2 Thinking

source label without registered configuration ID

Kimi K2 Thinking

66.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 nano (xhigh)

gpt-5-4-nano-xhigh

66%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 mini (medium)

gpt-5-mini-medium

GPT-5 mini

66%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.5

source label without registered configuration ID

MiniMax M2.5

66%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3 Max Thinking

source label without registered configuration ID

66%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 2.5 Pro

source label without registered configuration ID

66%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Sonnet (Reasoning)

source label without registered configuration ID

Claude Sonnet 4.5

65.7%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 397B A17B (Reasoning)

source label without registered configuration ID

65.7%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Flash-Lite

source label without registered configuration ID

65.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.5 (Reasoning)

source label without registered configuration ID

65.3%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Plus

source label without registered configuration ID

65%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.2 (Reasoning)

source label without registered configuration ID

65%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.1 Terminus (Reasoning)

source label without registered configuration ID

DeepSeek V3.1 Terminus

65%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4 Sonnet (Reasoning)

source label without registered configuration ID

Claude Sonnet 4

64.7%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4 Fast (Reasoning)

source label without registered configuration ID

Grok 4 Fast

64.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.3 (high)

source label without registered configuration ID

64.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 2.5 Flash Preview (Sep '25) (Reasoning)

source label without registered configuration ID

64.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.7 (Reasoning)

source label without registered configuration ID

64%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5 (Reasoning)

source label without registered configuration ID

63.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark 1.1 (xhigh)

muse-spark-1-1-xhigh

63.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Flash (Reasoning, Max Effort)

deepseek-v4-flash-max

63%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5

source label without registered configuration ID

MiMo-V2.5

62.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 35B A3B (Reasoning)

source label without registered configuration ID

Qwen3.5 35B

62.7%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.1 (Reasoning)

source label without registered configuration ID

62.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 31B (Reasoning)

source label without registered configuration ID

62%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Medium 3.5

source label without registered configuration ID

Mistral Medium 3.5

61%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2

source label without registered configuration ID

MiniMax M2

61%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM 5V Turbo (Reasoning)

source label without registered configuration ID

61%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2-Pro

source label without registered configuration ID

60.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 3.7 Sonnet (Reasoning)

source label without registered configuration ID

Claude Sonnet 3.7

60.7%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5-Turbo

source label without registered configuration ID

60.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

NVIDIA Nemotron 3 Super 120B A12B (Reasoning)

source label without registered configuration ID

Nemotron 3 Super

60%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

source label without registered configuration ID

59.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.1

source label without registered configuration ID

MiniMax M2.1

59%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.20 0309 v2 (Reasoning)

source label without registered configuration ID

Grok 4.20

58%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 26B A4B (Reasoning)

source label without registered configuration ID

Gemma 4 26B

55.7%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 12B (Reasoning)

source label without registered configuration ID

55.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

o4-mini (high)

o4-mini-high

o4-mini

55%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nova 2.0 Pro Preview (medium)

source label without registered configuration ID

Nova 2 Pro

54.3%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.6 (Reasoning)

source label without registered configuration ID

54.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 Omni Plus

source label without registered configuration ID

Qwen3.5 Omni Plus

52.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2 0905

source label without registered configuration ID

Kimi K2 0905

52.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 3 mini Reasoning (high)

source label without registered configuration ID

Grok 3 mini

50.3%

CurrentArtificial Analysis independent evaluation

Score input

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok Code Fast 1

source label without registered configuration ID

48.3%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Command A+

source label without registered configuration ID

46%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Small 4 (Reasoning)

source label without registered configuration ID

44.7%

CurrentArtificial Analysis independent evaluation

Public reference · not scored

source-checked

AA Long Context Reasoning Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Large 3

source label without registered configuration ID