Coding · Benchmark profile

Scientific Code Benchmark

Reference2024Active14 models

Data verified 1 Aug 2026 · Methodology 2.3.0

Benchmark score on Scientific Code Benchmark

Leaderboard · 14 models

Sakana Fugu leads at 60.1%, followed by Sakana Fugu-Ultra (58.7%) and Qwen3.7-Max (53.5%).

Display onlyCoding2024

#1Closed

Sakana Fugu

Sakana AI

sakana-fugu

60.1%

Overall — · Context 1M tokens

#2Closed

Sakana Fugu-Ultra

Sakana AI

sakana-fugu-ultra

58.7%

Overall — · Context 1M tokens

#3Closed

Qwen3.7-Max

Alibaba Cloud

qwen3.7-max

53.5%

Overall #18 · Context 1M tokens

ViewModelsColours

Sakana AIAlibaba CloudGoogleMoonshot AIThinking Machines LabxAI

Lumina

Scientific Code Benchmark leaderboard

Accessible data for Scientific Code Benchmark leaderboard
Model	Rank	Model ID	Provider	Score	Unit
Sakana Fugu	#1	sakana-fugu	Sakana AI	60.1	percent
Sakana Fugu-Ultra	#2	sakana-fugu-ultra	Sakana AI	58.7	percent
Qwen3.7-Max	#3	qwen-3-7-max	Alibaba Cloud	53.5	percent
Gemini 3.5 Flash	#4	gemini-3-5-flash	Google	53.1	percent
Kimi K2.6	#5	kimi-k2-6	Moonshot AI	52.2	percent
Qwen3.7-Plus	#6	qwen-3-7-plus	Alibaba Cloud	51.3	percent
Inkling-Small	#7	inkling-small	Thinking Machines Lab	48.7	percent
Kimi K2.5	#8	kimi-k2-5	Moonshot AI	48.7	percent
Grok 4.3	#9	grok-4-3	xAI	47.3	percent
Qwen 3.6 Max (preview)	#10	qwen3-6-max-preview	Alibaba Cloud	47	percent
Nemotron 3 Ultra	#11	nemotron-3-ultra	NVIDIA	44.6	percent
Hy3 Preview	#12	hy3-preview	Tencent	41.2	percent
Nemotron 3 Nano Omni 30B A3B	#13	nemotron-3-nano-omni-30b-a3b	NVIDIA	32	percent
Ling 2.6 Flash	#14	ling-2-6-flash	InclusionAI	27	percent

Benchmark score table (14 models)

One best compatible score per canonical product · higher is better

Scientific Code Benchmark leaderboard ranked by score
Rank	Model	Provider	License	Evidence use	Score
#1	Sakana Fugu sakana-fugu	Sakana AI	closed	Source carrier	60.1%
#2	Sakana Fugu-Ultra sakana-fugu-ultra	Sakana AI	closed	Source carrier	58.7%
#3	Qwen3.7-Max qwen3.7-max	Alibaba Cloud	closed	Source carrier	53.5%
#4	Gemini 3.5 Flash gemini-3.5-flash	Google	closed	Source carrier	53.1%
#5	Kimi K2.6 kimi-k2.6	Moonshot AI	open	Source carrier	52.2%
#6	Qwen3.7-Plus qwen3.7-plus	Alibaba Cloud	closed	Source carrier	51.3%
#7	Inkling-Small thinkingmachines/inkling-small	Thinking Machines Lab	open	Source carrier	48.7%
#8	Kimi K2.5 kimi-k2.5	Moonshot AI	open	Source carrier	48.7%
#9	Grok 4.3 grok-4.3	xAI	closed	Source carrier	47.3%
#10	Qwen 3.6 Max (preview) qwen3-6-max-preview	Alibaba Cloud	closed	Source carrier	47%
#11	Nemotron 3 Ultra nemotron-3-ultra-550b	NVIDIA	open	Source carrier	44.6%
#12	Hy3 Preview hy3-preview	Tencent	open	Source carrier	41.2%
#13	Nemotron 3 Nano Omni 30B A3B nemotron-3-nano-omni-30b-a3b	NVIDIA	open	Source carrier	32%
#14	Ling 2.6 Flash ling-2-6-flash	InclusionAI	open	Source carrier	27%

The top of this snapshot is led by Sakana Fugu at 60.1%; third place is 6.6 points behind. The top-10 spread is 13.1 points.

Configuration-preserving evidencePublished source rows (40)Exact source labels, configurations, versions and dated observations. Same-snapshot canonical/configuration projections are shown once.

Every distinct dated source-published row for Scientific Code Benchmark, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
Exact BenchLM registry variant Sakana Fugu; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sakana Fugu	60.1%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Sakana Fugu-Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sakana Fugu-Ultra	58.7%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	53.5%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	53.1%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	52.2%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	51.3%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Inkling-Small; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Inkling-Small	48.7%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	48.7%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	47.3%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	47%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	44.6%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	41.2%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	32%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	27%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01
Exact BenchLM registry variant Sakana Fugu; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sakana Fugu	60.1%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Sakana Fugu-Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sakana Fugu-Ultra	58.7%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	53.5%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	53.1%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	52.2%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	51.3%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	48.7%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	47.3%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	47%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	44.6%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	41.2%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	32%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	27%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27
Exact BenchLM registry variant Sakana Fugu; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sakana Fugu	60.1%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Sakana Fugu-Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Sakana Fugu-Ultra	58.7%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Max; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Max	53.5%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Gemini 3.5 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Gemini 3.5 Flash	53.1%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.6; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.6	52.2%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen3.7 Plus; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen3.7-Plus	51.3%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Kimi K2.5; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Kimi K2.5	48.7%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Grok 4.3; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Grok 4.3	47.3%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Qwen 3.6 Max (preview); bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Qwen 3.6 Max (preview)	47%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Ultra; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Ultra	44.6%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Hy3 Preview; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Hy3 Preview	41.2%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Nemotron 3 Nano Omni 30B A3B; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Nemotron 3 Nano Omni 30B A3B	32%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21
Exact BenchLM registry variant Ling 2.6 Flash; bulk export does not retain a complete upstream harness configuration. source label without registered configuration ID	Ling 2.6 Flash	27%	2024Source-native system	Source carrier · no additional scoring weight source-checked	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21

Compare top models

Sakana Fugu vs Sakana Fugu-Ultra Sakana Fugu-Ultra vs Qwen3.7-Max Qwen3.7-Max vs Gemini 3.5 Flash Gemini 3.5 Flash vs Kimi K2.6

About Scientific Code Benchmark

Definition and scoring

Organisation: BenchLM registry
Category: Coding
Version: 2024
Direction: higher is better
Ranking use: Reference
Contamination risk: Unknown

SciCode evaluates language models on generating code for realistic scientific research problems across 16 subfields of physics, math, chemistry, biology, and material science. Problems decompose into 338 subproblems requiring domain knowledge recall, scientific reasoning, and precise code synthesis. Based on real scripts from published research. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.

Open benchmark source ↗

FAQ

Quick answers

What does Scientific Code Benchmark measure?

Which model scores highest on Scientific Code Benchmark?

Sakana Fugu by Sakana AI currently leads with 60.1%.

How many models are evaluated on Scientific Code Benchmark?

14 canonical model products have a qualifying score, backed by 40 distinct dated source rows.

Coding · Benchmark profile

Scientific Code Benchmark

Reference2024Active14 models

Data verified 1 Aug 2026 · Methodology 2.3.0

Benchmark score on Scientific Code Benchmark