Claw-Eval

Accessible data for Claw-Eval leaderboard
Model	Rank	Model ID	Provider	Score	Unit
Ornith-1.0-397B	#1	ornith-1-0-397b	DeepReinforce AI	77.1	percent
MiniMax M3	#2	minimax-m3	MiniMax	74.5	percent
Qwen3.6 27B	#3	qwen3-6-27b	Alibaba Cloud	72.4	percent
Claude Opus 4.6	#4	claude-opus-4-6	Anthropic	70.4	percent
Ornith-1.0-35B	#5	ornith-1-0-35b	DeepReinforce AI	69.8	percent
Qwen3.6-35B-A3B	#6	qwen3-6-35b-a3b	Alibaba Cloud	68.7	percent
Claude Sonnet 4.6	#7	claude-sonnet-4-6	Anthropic	67.8	percent
Step 3.7 Flash	#8	step-3-7-flash	StepFun	67.1	percent
Qwen3.7-Max	#9	qwen-3-7-max	Alibaba Cloud	65.2	percent
MiMo-V2.5-Pro	#10	mimo-v2-5-pro	Xiaomi	63.8	percent
Muse Spark	#11	muse-spark	Meta	63.8	percent
Ornith-1.0-9B	#12	ornith-1-0-9b	DeepReinforce AI	63.1	percent
Qwen3.7-Plus	#13	qwen-3-7-plus	Alibaba Cloud	62.7	percent
GLM-5.1	#14	glm-5-1	Z.AI	62.3	percent
Kimi K2.6	#15	kimi-k2-6	Moonshot AI	62.3	percent
MiMo-V2.5	#16	mimo-v2-5	Xiaomi	62.3	percent
GPT-5.4	#17	gpt-5-4	OpenAI	60.3	percent
DeepSeek V4 Pro	#18	deepseek-v4-pro	DeepSeek	59.8	percent
Claude Opus 4.5	#19	claude-opus-4-5	Anthropic	59.6	percent
Qwen3.6 Plus	#20	qwen3-6-plus	Alibaba Cloud	58.8	percent
DeepSeek V4 Flash	#21	deepseek-v4-flash	DeepSeek	57.8	percent
MiMo-V2-Pro	#22	mimo-v2-pro	Xiaomi	57.8	percent
GLM-5	#23	glm-5	Z.AI	57.7	percent
Qwen3.8-27B	#24	qwen-3-8-27b	Alibaba Cloud	57.4	percent
Qwen3.5 397B A17B	#25	qwen3-5-397b	Alibaba Cloud	56.8	percent
GLM-5-Turbo	#26	glm-5-turbo	Z.AI	55.8	percent
GLM-5V-Turbo	#27	glm-5v-turbo	Z.AI	53.8	percent
Kimi K2.5	#28	kimi-k2-5	Moonshot AI	52.3	percent
Gemini 3 Flash	#29	gemini-3-flash	Google	49.2	percent
MiniMax M2.7	#30	minimax-m2-7	MiniMax	48.7	percent
MiMo-V2-Omni	#31	mimo-v2-omni	Xiaomi	45.2	percent
DeepSeek V3.2	#32	deepseek-v3-2	DeepSeek	40.2	percent
Nemotron 3 Super 100B	#33	nemotron-3-super-100b	NVIDIA	5.5	percent

Claw-Eval leaderboard ranked by score
Rank	Model	Provider	License	Evidence use	Score
#1	Ornith-1.0-397B ornith-1-0-397b	DeepReinforce AI	open	Source carrier	77.1%
#2	MiniMax M3 MiniMax-M3	MiniMax	open	Source carrier	74.5%
#3	Qwen3.6 27B qwen3.6-27b	Alibaba Cloud	open	Source carrier	72.4%
#4	Claude Opus 4.6 claude-opus-4-6	Anthropic	closed	Source carrier	70.4%
#5	Ornith-1.0-35B ornith-1-0-35b	DeepReinforce AI	open	Source carrier	69.8%
#6	Qwen3.6-35B-A3B Qwen/Qwen3.6-35B-A3B	Alibaba Cloud	open	Source carrier	68.7%
#7	Claude Sonnet 4.6 claude-sonnet-4-6	Anthropic	closed	Source carrier	67.8%
#8	Step 3.7 Flash step-3-7-flash	StepFun	open	Source carrier	67.1%
#9	Qwen3.7-Max qwen3.7-max	Alibaba Cloud	closed	Source carrier	65.2%
#10	MiMo-V2.5-Pro mimo-v2-5-pro	Xiaomi	open	Source carrier	63.8%
#11	Muse Spark muse-spark	Meta	closed	Source carrier	63.8%
#12	Ornith-1.0-9B ornith-1-0-9b	DeepReinforce AI	open	Source carrier	63.1%
#13	Qwen3.7-Plus qwen3.7-plus	Alibaba Cloud	closed	Source carrier	62.7%
#14	GLM-5.1 glm-5-1	Z.AI	open	Source carrier	62.3%
#15	Kimi K2.6 kimi-k2.6	Moonshot AI	open	Source carrier	62.3%
#16	MiMo-V2.5 mimo-v2.5	Xiaomi	open	Source carrier	62.3%
#17	GPT-5.4 gpt-5.4	OpenAI	closed	Source carrier	60.3%
#18	DeepSeek V4 Pro deepseek-v4-pro	DeepSeek	open	Source carrier	59.8%
#19	Claude Opus 4.5 claude-opus-4-5	Anthropic	closed	Source carrier	59.6%
#20	Qwen3.6 Plus qwen3-6-plus	Alibaba Cloud	closed	Source carrier	58.8%
#21	DeepSeek V4 Flash deepseek-v4-flash	DeepSeek	open	Source carrier	57.8%
#22	MiMo-V2-Pro mimo-v2-pro	Xiaomi	closed	Source carrier	57.8%
#23	GLM-5 glm-5	Z.AI	open	Source carrier	57.7%
#24	Qwen3.8-27B Qwen/Qwen3.8-27B	Alibaba Cloud	open	Public reference	57.4%
#25	Qwen3.5 397B A17B Qwen/Qwen3.5-397B-A17B	Alibaba Cloud	open	Source carrier	56.8%
#26	GLM-5-Turbo glm-5-turbo	Z.AI	closed	Source carrier	55.8%
#27	GLM-5V-Turbo glm-5v-turbo	Z.AI	closed	Source carrier	53.8%
#28	Kimi K2.5 kimi-k2.5	Moonshot AI	open	Source carrier	52.3%
#29	Gemini 3 Flash gemini-3-flash	Google	closed	Source carrier	49.2%
#30	MiniMax M2.7 minimax-m2-7	MiniMax	open	Source carrier	48.7%
#31	MiMo-V2-Omni mimo-v2-omni	Xiaomi	closed	Source carrier	45.2%
#32	DeepSeek V3.2 deepseek-v3.2	DeepSeek	open	Source carrier	40.2%
#33	Nemotron 3 Super 100B nemotron-3-super-100b	NVIDIA	open	Source carrier	5.5%

Rank

Model

Provider

License

Evidence use

Score

Ornith-1.0-397B

ornith-1-0-397b

DeepReinforce AI

open

Source carrier

77.1%

MiniMax M3

MiniMax-M3

MiniMax

open

Source carrier

74.5%

Qwen3.6 27B

qwen3.6-27b

Alibaba Cloud

open

Source carrier

72.4%

Claude Opus 4.6

claude-opus-4-6

Anthropic

closed

Source carrier

70.4%

Ornith-1.0-35B

ornith-1-0-35b

DeepReinforce AI

open

Source carrier

69.8%

Qwen3.6-35B-A3B

Qwen/Qwen3.6-35B-A3B

Alibaba Cloud

open

Source carrier

68.7%

Claude Sonnet 4.6

claude-sonnet-4-6

Anthropic

closed

Source carrier

67.8%

Step 3.7 Flash

step-3-7-flash

StepFun

open

Source carrier

67.1%

Qwen3.7-Max

qwen3.7-max

Alibaba Cloud

closed

Source carrier

65.2%

#10

MiMo-V2.5-Pro

mimo-v2-5-pro

Xiaomi

open

Source carrier

63.8%

#11

Muse Spark

muse-spark

Every distinct dated source-published row for Claw-Eval, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
Qwen3.7-Plus (provider-published configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-7-plus-unspecified	Qwen3.7-Plus	60.1%	Averagesystem:qwen3-8-flash-next-comparison:cell:vision:claweval-average:2	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.8-27B (xhigh default thinking configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-8-27b-xhigh	Qwen3.8-27B	57.4%	Pass@3system:qwen3-8-flash-next-comparison:cell:vision:claweval-pass3:1	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.7-Plus (provider-published configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-7-plus-unspecified	Qwen3.7-Plus	57.4%	Pass@3system:qwen3-8-flash-next-comparison:cell:vision:claweval-pass3:2	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.8-27B (xhigh default thinking configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-8-27b-xhigh	Qwen3.8-27B	56.9%	Averagesystem:qwen3-8-flash-next-comparison:cell:vision:claweval-average:1	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Claude Opus 4.6 (Max) as published in Qwen's Qwen3.8-Flash-Next comparison table claude-opus-4-6-max	Claude Opus 4.6	54.7%	Averagesystem:qwen3-8-flash-next-comparison:cell:vision:claweval-average:3	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Claude Opus 4.6 (Max) as published in Qwen's Qwen3.8-Flash-Next comparison table claude-opus-4-6-max	Claude Opus 4.6	52.5%	Pass@3system:qwen3-8-flash-next-comparison:cell:vision:claweval-pass3:3	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.7-Plus as published by Qwen qwen-3-7-plus-unspecified	Qwen3.7-Plus	60.1%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.7-Plus as published by Qwen qwen-3-7-plus-unspecified	Qwen3.7-Plus	57.4%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.8-27B (xhigh) qwen-3-8-27b-xhigh	Qwen3.8-27B	57.4%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.8-27B (xhigh) qwen-3-8-27b-xhigh	Qwen3.8-27B	56.9%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Claude Opus 4.6 Max as published by Qwen claude-opus-4-6-max	Claude Opus 4.6	54.7%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Claude Opus 4.6 Max as published by Qwen claude-opus-4-6-max	Claude Opus 4.6	52.5%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.6-27B as published by Qwen qwen3-6-27b-default	Qwen3.6 27B	50.4%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.6-27B as published by Qwen qwen3-6-27b-default	Qwen3.6 27B	42.6%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Exact BenchLM registry variant Ornith-1.0-397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-397B	77.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	72.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	70.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ornith-1.0-35B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-35B	69.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	67.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	67.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	65.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ornith-1.0-9B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-9B	63.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	60.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Pro	59.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	59.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	58.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Flash	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	56.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	55.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	53.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	52.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	49.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	48.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	45.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	40.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Super 100B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Super 100B	5.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ornith-1.0-397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-397B	77.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	72.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	70.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ornith-1.0-35B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-35B	69.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	67.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	67.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	65.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ornith-1.0-9B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-9B	63.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	60.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Pro	59.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	59.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	58.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Flash	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	56.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	55.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	53.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	52.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	49.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	48.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	45.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	40.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Super 100B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Super 100B	5.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ornith-1.0-397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-397B	77.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	72.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	70.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ornith-1.0-35B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-35B	69.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	67.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	67.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	65.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ornith-1.0-9B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-9B	63.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	60.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Pro	59.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	59.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	58.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Flash	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	56.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	55.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	53.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	52.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	49.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	48.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	45.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	40.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Super 100B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Super 100B	5.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

What does Claw-Eval measure?

A transparent real-world autonomous-agent benchmark with 300 human-verified tasks, 2,159 rubric items, and Pass^3 scoring across general, multi-turn, and native multimodal agent tasks.

Which model scores highest on Claw-Eval?

Ornith-1.0-397B by DeepReinforce AI currently leads with 77.1%.

How many models are evaluated on Claw-Eval?

33 canonical model products have a qualifying score, backed by 110 distinct dated source rows.

Accessible data for Claw-Eval leaderboard
Model	Rank	Model ID	Provider	Score	Unit
Ornith-1.0-397B	#1	ornith-1-0-397b	DeepReinforce AI	77.1	percent
MiniMax M3	#2	minimax-m3	MiniMax	74.5	percent
Qwen3.6 27B	#3	qwen3-6-27b	Alibaba Cloud	72.4	percent
Claude Opus 4.6	#4	claude-opus-4-6	Anthropic	70.4	percent
Ornith-1.0-35B	#5	ornith-1-0-35b	DeepReinforce AI	69.8	percent
Qwen3.6-35B-A3B	#6	qwen3-6-35b-a3b	Alibaba Cloud	68.7	percent
Claude Sonnet 4.6	#7	claude-sonnet-4-6	Anthropic	67.8	percent
Step 3.7 Flash	#8	step-3-7-flash	StepFun	67.1	percent
Qwen3.7-Max	#9	qwen-3-7-max	Alibaba Cloud	65.2	percent
MiMo-V2.5-Pro	#10	mimo-v2-5-pro	Xiaomi	63.8	percent
Muse Spark	#11	muse-spark	Meta	63.8	percent
Ornith-1.0-9B	#12	ornith-1-0-9b	DeepReinforce AI	63.1	percent
Qwen3.7-Plus	#13	qwen-3-7-plus	Alibaba Cloud	62.7	percent
GLM-5.1	#14	glm-5-1	Z.AI	62.3	percent
Kimi K2.6	#15	kimi-k2-6	Moonshot AI	62.3	percent
MiMo-V2.5	#16	mimo-v2-5	Xiaomi	62.3	percent
GPT-5.4	#17	gpt-5-4	OpenAI	60.3	percent
DeepSeek V4 Pro	#18	deepseek-v4-pro	DeepSeek	59.8	percent
Claude Opus 4.5	#19	claude-opus-4-5	Anthropic	59.6	percent
Qwen3.6 Plus	#20	qwen3-6-plus	Alibaba Cloud	58.8	percent
DeepSeek V4 Flash	#21	deepseek-v4-flash	DeepSeek	57.8	percent
MiMo-V2-Pro	#22	mimo-v2-pro	Xiaomi	57.8	percent
GLM-5	#23	glm-5	Z.AI	57.7	percent
Qwen3.8-27B	#24	qwen-3-8-27b	Alibaba Cloud	57.4	percent
Qwen3.5 397B A17B	#25	qwen3-5-397b	Alibaba Cloud	56.8	percent
GLM-5-Turbo	#26	glm-5-turbo	Z.AI	55.8	percent
GLM-5V-Turbo	#27	glm-5v-turbo	Z.AI	53.8	percent
Kimi K2.5	#28	kimi-k2-5	Moonshot AI	52.3	percent
Gemini 3 Flash	#29	gemini-3-flash	Google	49.2	percent
MiniMax M2.7	#30	minimax-m2-7	MiniMax	48.7	percent
MiMo-V2-Omni	#31	mimo-v2-omni	Xiaomi	45.2	percent
DeepSeek V3.2	#32	deepseek-v3-2	DeepSeek	40.2	percent
Nemotron 3 Super 100B	#33	nemotron-3-super-100b	NVIDIA	5.5	percent

Claw-Eval leaderboard ranked by score
Rank	Model	Provider	License	Evidence use	Score
#1	Ornith-1.0-397B ornith-1-0-397b	DeepReinforce AI	open	Source carrier	77.1%
#2	MiniMax M3 MiniMax-M3	MiniMax	open	Source carrier	74.5%
#3	Qwen3.6 27B qwen3.6-27b	Alibaba Cloud	open	Source carrier	72.4%
#4	Claude Opus 4.6 claude-opus-4-6	Anthropic	closed	Source carrier	70.4%
#5	Ornith-1.0-35B ornith-1-0-35b	DeepReinforce AI	open	Source carrier	69.8%
#6	Qwen3.6-35B-A3B Qwen/Qwen3.6-35B-A3B	Alibaba Cloud	open	Source carrier	68.7%
#7	Claude Sonnet 4.6 claude-sonnet-4-6	Anthropic	closed	Source carrier	67.8%
#8	Step 3.7 Flash step-3-7-flash	StepFun	open	Source carrier	67.1%
#9	Qwen3.7-Max qwen3.7-max	Alibaba Cloud	closed	Source carrier	65.2%
#10	MiMo-V2.5-Pro mimo-v2-5-pro	Xiaomi	open	Source carrier	63.8%
#11	Muse Spark muse-spark	Meta	closed	Source carrier	63.8%
#12	Ornith-1.0-9B ornith-1-0-9b	DeepReinforce AI	open	Source carrier	63.1%
#13	Qwen3.7-Plus qwen3.7-plus	Alibaba Cloud	closed	Source carrier	62.7%
#14	GLM-5.1 glm-5-1	Z.AI	open	Source carrier	62.3%
#15	Kimi K2.6 kimi-k2.6	Moonshot AI	open	Source carrier	62.3%
#16	MiMo-V2.5 mimo-v2.5	Xiaomi	open	Source carrier	62.3%
#17	GPT-5.4 gpt-5.4	OpenAI	closed	Source carrier	60.3%
#18	DeepSeek V4 Pro deepseek-v4-pro	DeepSeek	open	Source carrier	59.8%
#19	Claude Opus 4.5 claude-opus-4-5	Anthropic	closed	Source carrier	59.6%
#20	Qwen3.6 Plus qwen3-6-plus	Alibaba Cloud	closed	Source carrier	58.8%
#21	DeepSeek V4 Flash deepseek-v4-flash	DeepSeek	open	Source carrier	57.8%
#22	MiMo-V2-Pro mimo-v2-pro	Xiaomi	closed	Source carrier	57.8%
#23	GLM-5 glm-5	Z.AI	open	Source carrier	57.7%
#24	Qwen3.8-27B Qwen/Qwen3.8-27B	Alibaba Cloud	open	Public reference	57.4%
#25	Qwen3.5 397B A17B Qwen/Qwen3.5-397B-A17B	Alibaba Cloud	open	Source carrier	56.8%
#26	GLM-5-Turbo glm-5-turbo	Z.AI	closed	Source carrier	55.8%
#27	GLM-5V-Turbo glm-5v-turbo	Z.AI	closed	Source carrier	53.8%
#28	Kimi K2.5 kimi-k2.5	Moonshot AI	open	Source carrier	52.3%
#29	Gemini 3 Flash gemini-3-flash	Google	closed	Source carrier	49.2%
#30	MiniMax M2.7 minimax-m2-7	MiniMax	open	Source carrier	48.7%
#31	MiMo-V2-Omni mimo-v2-omni	Xiaomi	closed	Source carrier	45.2%
#32	DeepSeek V3.2 deepseek-v3.2	DeepSeek	open	Source carrier	40.2%
#33	Nemotron 3 Super 100B nemotron-3-super-100b	NVIDIA	open	Source carrier	5.5%

Rank

Model

Provider

License

Evidence use

Score

Ornith-1.0-397B

ornith-1-0-397b

DeepReinforce AI

open

Source carrier

77.1%

MiniMax M3

MiniMax-M3

MiniMax

open

Source carrier

74.5%

Qwen3.6 27B

qwen3.6-27b

Alibaba Cloud

open

Source carrier

72.4%

Claude Opus 4.6

claude-opus-4-6

Anthropic

closed

Source carrier

70.4%

Ornith-1.0-35B

ornith-1-0-35b

DeepReinforce AI

open

Source carrier

69.8%

Qwen3.6-35B-A3B

Qwen/Qwen3.6-35B-A3B

Alibaba Cloud

open

Source carrier

68.7%

Claude Sonnet 4.6

claude-sonnet-4-6

Anthropic

closed

Source carrier

67.8%

Step 3.7 Flash

step-3-7-flash

StepFun

open

Source carrier

67.1%

Qwen3.7-Max

qwen3.7-max

Alibaba Cloud

closed

Source carrier

65.2%

#10

MiMo-V2.5-Pro

mimo-v2-5-pro

Xiaomi

open

Source carrier

63.8%

#11

Muse Spark

muse-spark

Every distinct dated source-published row for Claw-Eval, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
Qwen3.7-Plus (provider-published configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-7-plus-unspecified	Qwen3.7-Plus	60.1%	Averagesystem:qwen3-8-flash-next-comparison:cell:vision:claweval-average:2	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.8-27B (xhigh default thinking configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-8-27b-xhigh	Qwen3.8-27B	57.4%	Pass@3system:qwen3-8-flash-next-comparison:cell:vision:claweval-pass3:1	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.7-Plus (provider-published configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-7-plus-unspecified	Qwen3.7-Plus	57.4%	Pass@3system:qwen3-8-flash-next-comparison:cell:vision:claweval-pass3:2	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.8-27B (xhigh default thinking configuration) as published in Qwen's Qwen3.8-Flash-Next comparison table qwen-3-8-27b-xhigh	Qwen3.8-27B	56.9%	Averagesystem:qwen3-8-flash-next-comparison:cell:vision:claweval-average:1	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Claude Opus 4.6 (Max) as published in Qwen's Qwen3.8-Flash-Next comparison table claude-opus-4-6-max	Claude Opus 4.6	54.7%	Averagesystem:qwen3-8-flash-next-comparison:cell:vision:claweval-average:3	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Claude Opus 4.6 (Max) as published in Qwen's Qwen3.8-Flash-Next comparison table claude-opus-4-6-max	Claude Opus 4.6	52.5%	Pass@3system:qwen3-8-flash-next-comparison:cell:vision:claweval-pass3:3	Public reference · not scored provider-reported	Qwen3.8-Flash-Next launch and official provider evaluations ↗Observed 2026-08-26 · checked 2026-08-26
Qwen3.7-Plus as published by Qwen qwen-3-7-plus-unspecified	Qwen3.7-Plus	60.1%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.7-Plus as published by Qwen qwen-3-7-plus-unspecified	Qwen3.7-Plus	57.4%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.8-27B (xhigh) qwen-3-8-27b-xhigh	Qwen3.8-27B	57.4%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.8-27B (xhigh) qwen-3-8-27b-xhigh	Qwen3.8-27B	56.9%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Claude Opus 4.6 Max as published by Qwen claude-opus-4-6-max	Claude Opus 4.6	54.7%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Claude Opus 4.6 Max as published by Qwen claude-opus-4-6-max	Claude Opus 4.6	52.5%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.6-27B as published by Qwen qwen3-6-27b-default	Qwen3.6 27B	50.4%	AverageQwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Qwen3.6-27B as published by Qwen qwen3-6-27b-default	Qwen3.6 27B	42.6%	Pass@3Qwen3.8-27B official VL table	Public reference · not scored provider-reported	Qwen3.8-27B official model card ↗Observed 2026-08-15 · checked 2026-08-15
Exact BenchLM registry variant Ornith-1.0-397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-397B	77.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	72.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	70.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ornith-1.0-35B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-35B	69.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	67.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	67.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	65.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ornith-1.0-9B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-9B	63.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	60.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Pro	59.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	59.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	58.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V4 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Flash	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	56.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	55.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	53.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	52.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	49.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	48.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	45.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	40.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Super 100B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Super 100B	5.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ornith-1.0-397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-397B	77.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	72.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	70.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ornith-1.0-35B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-35B	69.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	67.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	67.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	65.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ornith-1.0-9B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-9B	63.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	60.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Pro	59.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	59.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	58.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V4 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Flash	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	56.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	55.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	53.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	52.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	49.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	48.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	45.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	40.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Super 100B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Super 100B	5.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ornith-1.0-397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-397B	77.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M3	74.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-27B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 27B	72.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.6	70.4%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ornith-1.0-35B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-35B	69.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6-35B-A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6-35B-A3B	68.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Sonnet 4.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Sonnet 4.6	67.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Step 3.7 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Step 3.7 Flash	67.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	65.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2.5-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5-Pro	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Muse Spark; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Muse Spark	63.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ornith-1.0-9B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ornith-1.0-9B	63.1%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	62.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5.1; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5.1	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2.5	62.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GPT-5.4; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GPT-5.4	60.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Pro	59.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Claude Opus 4.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Claude Opus 4.5	59.6%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.6 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.6 Plus	58.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V4 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V4 Flash	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Pro; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Pro	57.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5	57.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.5 397B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.5 397B A17B	56.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5-Turbo	55.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant GLM-5V-Turbo; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	GLM-5V-Turbo	53.8%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	52.3%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3 Flash	49.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiniMax M2.7; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiniMax M2.7	48.7%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant MiMo-V2-Omni; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	MiMo-V2-Omni	45.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant DeepSeek V3.2; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	DeepSeek V3.2	40.2%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Super 100B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Super 100B	5.5%	2026Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

What does Claw-Eval measure?

A transparent real-world autonomous-agent benchmark with 300 human-verified tasks, 2,159 rubric items, and Pass^3 scoring across general, multi-turn, and native multimodal agent tasks.

Which model scores highest on Claw-Eval?

Ornith-1.0-397B by DeepReinforce AI currently leads with 77.1%.

How many models are evaluated on Claw-Eval?

33 canonical model products have a qualifying score, backed by 110 distinct dated source rows.

Navigation

Claw-Eval

Leaderboard · 33 models

Ornith-1.0-397B

MiniMax M3

Qwen3.6 27B

Claw-Eval leaderboard

Crop Claw-Eval leaderboard

Benchmark score table (33 models)

Crop Claw-Eval benchmark table

Crop Claw-Eval published source rows

Compare top models

Definition and scoring

Quick answers

What does Claw-Eval measure?

Which model scores highest on Claw-Eval?

How many models are evaluated on Claw-Eval?

Claw-Eval

Leaderboard · 33 models

Ornith-1.0-397B

MiniMax M3

Qwen3.6 27B

Claw-Eval leaderboard

Crop Claw-Eval leaderboard

Benchmark score table (33 models)

Crop Claw-Eval benchmark table

Crop Claw-Eval published source rows

Compare top models

Definition and scoring

Quick answers

What does Claw-Eval measure?

Which model scores highest on Claw-Eval?

How many models are evaluated on Claw-Eval?

Leaderboard · 33 models

Ornith-1.0-397B

MiniMax M3

Qwen3.6 27B

Benchmark score table (33 models)

Compare top models

Definition and scoring

Quick answers

What does Claw-Eval measure?

Which model scores highest on Claw-Eval?

How many models are evaluated on Claw-Eval?

More Agents benchmarks

Leaderboard · 33 models

Ornith-1.0-397B

MiniMax M3

Qwen3.6 27B

Benchmark score table (33 models)

Compare top models

Definition and scoring

Quick answers

What does Claw-Eval measure?

Which model scores highest on Claw-Eval?

How many models are evaluated on Claw-Eval?

More Agents benchmarks