τ³-Banking

grok-4.6

xAI

closed

Score input

50.7%

glm-5.3

Z.AI

announced-open

Score input

50.3%

glm-5.3-flash

Z.AI

open

Score input

47.2%

kimi-k3

Moonshot AI

open

Score input

46.0%

Qwen/Qwen3.8-Flash-Next

Alibaba Cloud

open

Public reference

45.4%

gpt-5.6-sol

OpenAI

closed

Score input

44.3%

claude-opus-5

Anthropic

closed

Score input

42.1%

grok-4.5

xAI

closed

Score input

42.1%

deepseek-v4-flash-vision-exp

DeepSeek

—

Public reference

41.0%

#10

gpt-5.6-terra

OpenAI

closed

Score input

40.2%

#11

DeepSeek-V4-Pro-0813

DeepSeek

open

Public reference

39.6%

#12

gpt-5.4

OpenAI

closed

Score input

39.6%

#13

gpt-5.5

OpenAI

closed

Score input

39.0%

#14

claude-fable-5

Anthropic

closed

Score input

38.1%

#15

claude-sonnet-5

Anthropic

closed

Score input

37.3%

#16

gemini-3.7-flash

Google

closed

Score input

35.5%

#17

muse-spark-1-2

Meta

announced-open

Score input

34.8%

#18

claude-opus-4-7

Anthropic

closed

Score input

34.6%

#19

glm-5-2

Z.AI

open

Score input

34.6%

#20

claude-opus-4-8

Anthropic

closed

Score input

34.2%

#21

muse-spark-1-1

Meta

closed

Score input

31.8%

#22

gpt-5.6-luna

OpenAI

closed

Score input

31.1%

#23

claude-sonnet-4-6

Anthropic

closed

Score input

30.5%

#24

gemini-3.6-flash

Google

closed

Score input

29.9%

#25

deepseek-v4-pro

DeepSeek

open

Public reference

25.8%

#26

gemini-3.5-flash

Google

closed

Public reference

25.4%

#27

meta-models/Muse-Glimmer-30B

Meta

open

Score input

23.5%

#28

deepseek-v4-flash

DeepSeek

open

Public reference

22.9%

#29

gpt-5.4-mini

OpenAI

closed

Public reference

21.4%

#30

gpt-5.4-nano

OpenAI

closed

Public reference

21.0%

#31

kimi-k2.6

Moonshot AI

open

Public reference

20.6%

#32

upstage/Solar-Open2-250B

Upstage

open

Score input

19.6%

#33

gpt-5

OpenAI

closed

Public reference

19.6%

#34

muse-spark

Meta

closed

Public reference

19.6%

#35

claude-sonnet-4-5

Anthropic

closed

Score input

19.0%

#36

deepseek-v3.2

DeepSeek

open

Score input

18.8%

#37

kimi-k2.7-code

Moonshot AI

open

Public reference

18.1%

#38

qwen3.7-plus

Alibaba Cloud

closed

Public reference

17.9%

#39

gemini-3-flash

Google

closed

Score input

17.5%

#40

gemini-3.5-flash-lite

Google

closed

Public reference

16.5%

#41

gemini-3.1-pro-preview

Google

closed

Public reference

16.5%

#42

qwen3-6-plus

Alibaba Cloud

closed

Public reference

16.5%

#43

deepseek-v3.1-terminus

DeepSeek

open

Score input

15.9%

#44

Qwen/Qwen3.5-122B-A10B

Alibaba Cloud

open

Score input

15.3%

#45

qwen3.6-27b

Alibaba Cloud

open

Public reference

15.3%

#46

mistralai/Mistral-Medium-3.5-128B

Mistral AI

open

Score input

15.1%

#47

gemma-4-31b

Google

open

Public reference

15.1%

#48

mistral-medium-3-5

Mistral AI

open

Public reference

14.4%

#49

kimi-k2.5

Moonshot AI

open

Score input

14.2%

#50

gpt-5.1

OpenAI

closed

Public reference

14.0%

#51

claude-sonnet-4

Anthropic

closed

Score input

13.8%

#52

nemotron-3-ultra-550b

NVIDIA

open

Score input

13.8%

#53

qwen3.5-122b-a10b

Alibaba Cloud

open

Score input

13.6%

#54

Qwen/Qwen3.5-397B-A17B

Alibaba Cloud

open

Score input

13.4%

#55

meituan-longcat/LongCat-2.0

Meituan

open

Score input

13.2%

#56

MiniMax-M3

MiniMax

open

Public reference

13.0%

#57

grok-4.3

xAI

closed

Public reference

12.2%

#58

google/gemma-4-26b-a4b-it

Google

open

Score input

12.0%

#59

gemma-4-26b-a4b

Google

open

Score input

11.8%

#60

glm-5-1

Z.AI

open

Public reference

11.5%

#61

qwen3.7-max

Alibaba Cloud

closed

Public reference

10.9%

#62

glm-4.6

Z.AI

open

Score input

10.5%

#63

nemotron-3-super-120b

NVIDIA

open

Score input

10.1%

#64

glm-4.7

Z.AI

open

Public reference

9.7%

#65

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

NVIDIA

open

Score input

9.3%

#66

gemini-2.5-pro

Google

closed

Public reference

9.3%

#67

Qwen/Qwen3.6-35B-A3B

Alibaba Cloud

open

Score input

9.3%

#68

claude-haiku-4-5-20251001

Anthropic

closed

Score input

9.1%

#69

minimax-m2-7

MiniMax

open

Public reference

8.9%

#70

gemini-3.1-flash-lite

Google

closed

Public reference

8.7%

#71

mimo-v2-5-pro

Xiaomi

open

Public reference

8.7%

#72

nova-2-pro-preview

Amazon

closed

Score input

7.6%

#73

mimo-v2.5

Xiaomi

open

Public reference

6.6%

#74

nemotron-3-nano-30b

NVIDIA

open

Score input

6.0%

#75

command-a-plus

Cohere

open

Public reference

5.8%

#76

mistral-large-2512

Mistral AI

open

Public reference

5.8%

#77

trinity-large-thinking

Arcee AI

open

Score input

5.8%

#78

gpt-4-1-mini

OpenAI

closed

Score input

5.4%

#79

mistral-small-2603

Mistral AI

open

Public reference

5.2%

#80

llama-4-maverick

Meta

open

Score input

3.7%

#81

gpt-4-1-nano

OpenAI

closed

Score input

3.5%

#82

llama-4-scout

Meta

open

Score input

3.3%

#83

gemma-3-27b

Google

open

Score input

0.8%

Every distinct dated source-published row for τ³-Banking, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
Qwen3.8-Flash-Next (Artificial Analysis independent run) qwen-3-8-flash-next-aa-unspecified	Qwen3.8-Flash-Next	45.4%	3Artificial Analysis tau3-Banking evaluation	Public reference · not scored independently-verified	Qwen3.8-Flash-Next individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run) claude-opus-4-7-max	Claude Opus 4.7	34.6%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Opus 4.7 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
GLM-5.2 (max) (Artificial Analysis independent run) glm-5-2-max	GLM-5.2	34.6%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GLM-5.2 (max) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.5 122B A10B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-122b-a10b-aa-reasoning-default	Qwen3.5-122B-A10B	15.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Qwen3.5 122B A10B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Mistral Medium 3.5 (Artificial Analysis completed independent run) mistral-medium-3-5-128b-aa-reasoning-default	Mistral Medium 3.5 128B	15.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Mistral Medium 3.5 current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Kimi K2.5 (Reasoning) (Artificial Analysis completed independent run) kimi-k2-5-thinking	Kimi K2.5	14.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Kimi K2.5 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.5 397B A17B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-397b-thinking	Qwen3.5 397B A17B	13.4%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Qwen3.5 397B A17B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
LongCat 2.0 (Artificial Analysis independent run) longcat-2-0-default	LongCat-2.0	13.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	LongCat 2.0 individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Gemma 4 26B A4B (Reasoning) (Artificial Analysis completed independent run) gemma-4-26b-a4b-aa-reasoning-default	Gemma 4 26B A4B	12.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemma 4 26B A4B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.6 35B A3B (Reasoning) (Artificial Analysis completed independent run) qwen3-6-35b-a3b-aa-reasoning-default	Qwen3.6-35B-A3B	9.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Qwen3.6 35B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) (Artificial Analysis completed independent run) nemotron-3-nano-30b-aa-reasoning-default	Nemotron 3 Nano 30B	6.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Trinity Large Thinking (Artificial Analysis completed independent run) trinity-large-thinking-aa-reasoning-default	Trinity-Large-Thinking	5.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Trinity Large Thinking current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
GPT-4.1 mini (Artificial Analysis completed independent run) gpt-4-1-mini-epoch-gpt-4-1-mini-2025-04-14	GPT-4.1 mini	5.4%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-4.1 mini current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Mistral Small 4 (Reasoning) (Artificial Analysis completed independent run) mistral-small-4-reasoning	Mistral Small 4	4.9%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Mistral Small 4 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Llama 4 Maverick (Artificial Analysis completed independent run) llama-4-maverick-aa-non-reasoning-default	Llama 4 Maverick	3.7%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Llama 4 Maverick current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
GPT-4.1 nano (Artificial Analysis completed independent run) gpt-4-1-nano-epoch-gpt-4-1-nano-2025-04-14	GPT-4.1 nano	3.5%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-4.1 nano current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Llama 4 Scout (Artificial Analysis completed independent run) llama-4-scout-aa-non-reasoning-default	Llama 4 Scout	3.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Llama 4 Scout current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Gemma 3 27B Instruct (Artificial Analysis completed independent run) gemma-3-27b-aa-non-reasoning-default	Gemma 3 27B	0.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemma 3 27B Instruct current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Grok 4.6 (high; Artificial Analysis independent run) grok-4-6-high	Grok 4.6	50.7%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Grok 4.6 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GLM-5.3 (max; Artificial Analysis independent run) glm-5-3-max	GLM-5.3	50.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GLM-5.3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GLM-5.3-Flash (max; Artificial Analysis independent run) glm-5-3-flash-max	GLM-5.3-Flash	47.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GLM-5.3-Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Kimi K3 (max; Artificial Analysis independent run) kimi-k3-max	Kimi K3	46.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Kimi K3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Sol (max; Artificial Analysis independent run) gpt-5-6-sol-max	GPT-5.6 Sol	44.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.6 Sol individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Opus 5 (max; Artificial Analysis independent run) claude-opus-5-max	Claude Opus 5	42.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Opus 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Grok 4.5 (high; Artificial Analysis independent run) grok-4-5-aa-2-high	Grok 4.5	42.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Grok 4.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Flash Vision Exp (max; Artificial Analysis independent run) deepseek-v4-flash-vision-exp-max-harness	DeepSeek V4 Flash Vision Exp	41.0%	3Artificial Analysis tau3-Banking evaluation	Public reference · not scored independently-verified	DeepSeek V4 Flash Vision Exp individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Terra (max; Artificial Analysis independent run) gpt-5-6-terra-max	GPT-5.6 Terra	40.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.6 Terra individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Pro 0813 (max; Artificial Analysis independent run) deepseek-v4-pro-0813-max	DeepSeek V4 Pro 0813	39.6%	3Artificial Analysis tau3-Banking evaluation	Public reference · not scored independently-verified	DeepSeek V4 Pro 0813 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.4 (xhigh; Artificial Analysis independent run) gpt-5-4-xhigh	GPT-5.4	39.6%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.4 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.5 (xhigh; Artificial Analysis independent run) gpt-5-5-xhigh	GPT-5.5	39.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Fable 5 (max; Artificial Analysis independent run) claude-fable-5-max	Claude Fable 5	38.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Fable 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Sonnet 5 (max; Artificial Analysis independent run) claude-sonnet-5-max	Claude Sonnet 5	37.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Sonnet 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Gemini 3.7 Flash (medium; Artificial Analysis independent run) gemini-3-7-flash-medium	Gemini 3.7 Flash	35.5%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemini 3.7 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Muse Spark 1.2 (xhigh; Artificial Analysis independent run) muse-spark-1-2-xhigh	Muse Spark 1.2	34.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Muse Spark 1.2 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Opus 4.8 (max; Artificial Analysis independent run) claude-opus-4-8-max	Claude Opus 4.8	34.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Opus 4.8 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Muse Spark 1.1 (xhigh; Artificial Analysis independent run) muse-spark-1-1-xhigh	Muse Spark 1.1	31.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Muse Spark 1.1 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Luna (max; Artificial Analysis independent run) gpt-5-6-luna-max	GPT-5.6 Luna	31.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.6 Luna individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Gemini 3.6 Flash (high; Artificial Analysis independent run) gemini-3-6-flash-high	Gemini 3.6 Flash	29.9%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemini 3.6 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Flash max as published by Upstage deepseek-v4-flash-max	DeepSeek V4 Flash	22.3%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Solar Open 2 250B (high) solar-open2-250b-high	Solar Open 2 250B	19.6%	bankingSolar Open 2 card English table	Score input provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
MiMo-V2.5 as published by Upstage mimo-v2-5-solar-open2-unspecified	MiMo-V2.5	8.7%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Solar Open 100B as published by Upstage solar-open-100b-reasoning-high	Solar Open 100B (Reasoning)	7.4%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Command A+ as published by Upstage command-a-plus-solar-open2-unspecified	Command A+	5.8%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Mistral Medium 3.5 as published by Upstage mistral-medium-3-5-high	Mistral Medium 3.5	5.8%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95 nemotron-3-5-lightning-30b-a3b-default	NVIDIA Nemotron 3.5 Lightning 30B-A3B	9.3%	3NVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness	Score input provider-reported	NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12
Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64 muse-glimmer-30b-high	Muse Glimmer 30B	23.5%	3 / BankingArtificial Analysis τ³-Banking documented evaluation	Public reference · not scored provider-reported	Muse Glimmer Evaluation Methodology ↗Observed 2026-08-10 · checked 2026-08-10
Artificial Analysis τ³-Banking independent evaluation. source label without registered configuration ID	Gemini 3.6 Flash	24.5%	3Artificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Artificial Analysis τ³-Banking independent evaluation. source label without registered configuration ID	Gemini 3.5 Flash-Lite	16.5%	3Artificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Kimi K3; Artificial Analysis τ³-Banking evaluation. source label without registered configuration ID	Kimi K3	33.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21
Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published. muse-spark-1-1-xhigh	Muse Spark 1.1	25.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16
GPT-5.6 Sol (max) gpt-5-6-sol-max	GPT-5.6 Sol	33.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.5 (high) source label without registered configuration ID	Grok 4.5	32.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Terra (max) gpt-5-6-terra-max	GPT-5.6 Terra	31.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.5 (xhigh) gpt-5-5-xhigh	GPT-5.5	31.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) claude-sonnet-4-6-max	Claude Sonnet 4.6	30.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 (xhigh) gpt-5-4-xhigh	GPT-5.4	30.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) claude-opus-4-7-max	Claude Opus 4.7	28.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 5 (Adaptive Reasoning, Max Effort) claude-sonnet-5-max	Claude Sonnet 5	28.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.8 (Adaptive Reasoning, Max Effort) claude-opus-4-8-max	Claude Opus 4.8	27.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Luna (max) gpt-5-6-luna-max	GPT-5.6 Luna	27.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.2 (max) glm-5-2-max	GLM-5.2	26.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) claude-fable-5-max	Claude Fable 5	26.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Pro (Reasoning, Max Effort) deepseek-v4-pro-max	DeepSeek V4 Pro	25.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.5 Flash (high) gemini-3-5-flash-high	Gemini 3.5 Flash	25.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Muse Spark 1.1 (xhigh) muse-spark-1-1-xhigh	Muse Spark 1.1	25.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Flash (Reasoning, Max Effort) deepseek-v4-flash-max	DeepSeek V4 Flash	22.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 mini (xhigh) gpt-5-4-mini-xhigh	GPT-5.4 mini	21.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 nano (xhigh) gpt-5-4-nano-xhigh	GPT-5.4 nano	21.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.6 source label without registered configuration ID	Kimi K2.6	20.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Muse Spark source label without registered configuration ID	Muse Spark	19.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5 (high) gpt-5-high	GPT-5	19.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Sonnet (Reasoning) source label without registered configuration ID	Claude Sonnet 4.5	19.0%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V3.2 (Reasoning) source label without registered configuration ID	DeepSeek V3.2	18.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.7 Code source label without registered configuration ID	Kimi K2.7 Code	18.1%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Plus source label without registered configuration ID	Qwen3.7-Plus	17.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3 Flash Preview (Reasoning) source label without registered configuration ID	Gemini 3 Flash	17.5%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Pro Preview source label without registered configuration ID	Gemini 3.1 Pro Preview	16.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 Plus source label without registered configuration ID	Qwen3.6 Plus	16.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V3.1 Terminus (Reasoning) source label without registered configuration ID	DeepSeek V3.1 Terminus	15.9%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 27B (Reasoning) source label without registered configuration ID	Qwen3.6 27B	15.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 31B (Reasoning) source label without registered configuration ID	Gemma 4 31B	15.1%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Medium 3.5 source label without registered configuration ID	Mistral Medium 3.5	14.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.5 (Reasoning) source label without registered configuration ID	Kimi K2.5	14.2%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.1 (high) gpt-5-1-high	GPT-5.1	14.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Nemotron 3 Ultra 550B A55B (Reasoning) source label without registered configuration ID	Nemotron 3 Ultra	13.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4 Sonnet (Reasoning) source label without registered configuration ID	Claude Sonnet 4	13.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 122B A10B (Reasoning) source label without registered configuration ID	Qwen3.5 122B	13.6%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 397B A17B (Reasoning) source label without registered configuration ID	Qwen3.5 397B A17B	13.4%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M3 source label without registered configuration ID	MiniMax M3	13.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.3 (high) source label without registered configuration ID	Grok 4.3	12.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 26B A4B (Reasoning) source label without registered configuration ID	Gemma 4 26B	11.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.1 (Reasoning) source label without registered configuration ID	GLM-5.1	11.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Max source label without registered configuration ID	Qwen3.7-Max	10.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-4.6 (Reasoning) source label without registered configuration ID	GLM-4.6	10.5%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
NVIDIA Nemotron 3 Super 120B A12B (Reasoning) source label without registered configuration ID	Nemotron 3 Super	10.1%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-4.7 (Reasoning) source label without registered configuration ID	GLM-4.7	9.7%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 2.5 Pro source label without registered configuration ID	Gemini 2.5 Pro	9.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Haiku (Reasoning) source label without registered configuration ID	Claude Haiku 4.5	9.1%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2.7 source label without registered configuration ID	MiniMax M2.7	8.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Flash-Lite source label without registered configuration ID	Gemini 3.1 Flash-Lite	8.7%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5-Pro source label without registered configuration ID	MiMo-V2.5-Pro	8.7%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Nova 2.0 Pro Preview (medium) source label without registered configuration ID	Nova 2 Pro	7.6%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5 source label without registered configuration ID	MiMo-V2.5	6.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Large 3 source label without registered configuration ID	Mistral Large 3	5.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Command A+ source label without registered configuration ID	Command A+	5.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Small 4 (Reasoning) source label without registered configuration ID	Mistral Small 4	5.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Exact published model / configuration

Canonical product

Score

Version / system

Evidence

Source / observed

Qwen3.8-Flash-Next (Artificial Analysis independent run)

qwen-3-8-flash-next-aa-unspecified

45.4%

3Artificial Analysis tau3-Banking evaluation

Public reference · not scored

independently-verified

Qwen3.8-Flash-Next individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run)

claude-opus-4-7-max

34.6%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

GLM-5.2 (max) (Artificial Analysis independent run)

glm-5-2-max

34.6%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GLM-5.2 (max) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.5 122B A10B (Reasoning) (Artificial Analysis completed independent run)

qwen3-5-122b-a10b-aa-reasoning-default

15.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Qwen3.5 122B A10B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Mistral Medium 3.5 (Artificial Analysis completed independent run)

mistral-medium-3-5-128b-aa-reasoning-default

15.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Mistral Medium 3.5 current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Kimi K2.5 (Reasoning) (Artificial Analysis completed independent run)

kimi-k2-5-thinking

14.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Kimi K2.5 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.5 397B A17B (Reasoning) (Artificial Analysis completed independent run)

qwen3-5-397b-thinking

13.4%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Qwen3.5 397B A17B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

LongCat 2.0 (Artificial Analysis independent run)

longcat-2-0-default

13.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

LongCat 2.0 individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Gemma 4 26B A4B (Reasoning) (Artificial Analysis completed independent run)

gemma-4-26b-a4b-aa-reasoning-default

12.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemma 4 26B A4B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.6 35B A3B (Reasoning) (Artificial Analysis completed independent run)

qwen3-6-35b-a3b-aa-reasoning-default

9.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Qwen3.6 35B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) (Artificial Analysis completed independent run)

nemotron-3-nano-30b-aa-reasoning-default

6.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Trinity Large Thinking (Artificial Analysis completed independent run)

trinity-large-thinking-aa-reasoning-default

5.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Trinity Large Thinking current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

GPT-4.1 mini (Artificial Analysis completed independent run)

gpt-4-1-mini-epoch-gpt-4-1-mini-2025-04-14

5.4%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-4.1 mini current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Mistral Small 4 (Reasoning) (Artificial Analysis completed independent run)

mistral-small-4-reasoning

4.9%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Mistral Small 4 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Llama 4 Maverick (Artificial Analysis completed independent run)

llama-4-maverick-aa-non-reasoning-default

3.7%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Llama 4 Maverick current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

GPT-4.1 nano (Artificial Analysis completed independent run)

gpt-4-1-nano-epoch-gpt-4-1-nano-2025-04-14

3.5%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-4.1 nano current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Llama 4 Scout (Artificial Analysis completed independent run)

llama-4-scout-aa-non-reasoning-default

3.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Llama 4 Scout current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Gemma 3 27B Instruct (Artificial Analysis completed independent run)

gemma-3-27b-aa-non-reasoning-default

0.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemma 3 27B Instruct current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Grok 4.6 (high; Artificial Analysis independent run)

grok-4-6-high

50.7%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Grok 4.6 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GLM-5.3 (max; Artificial Analysis independent run)

glm-5-3-max

50.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GLM-5.3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GLM-5.3-Flash (max; Artificial Analysis independent run)

glm-5-3-flash-max

47.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GLM-5.3-Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Kimi K3 (max; Artificial Analysis independent run)

kimi-k3-max

46.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Kimi K3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Sol (max; Artificial Analysis independent run)

gpt-5-6-sol-max

44.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.6 Sol individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Opus 5 (max; Artificial Analysis independent run)

claude-opus-5-max

42.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Opus 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Grok 4.5 (high; Artificial Analysis independent run)

grok-4-5-aa-2-high

42.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Grok 4.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Flash Vision Exp (max; Artificial Analysis independent run)

deepseek-v4-flash-vision-exp-max-harness

41.0%

3Artificial Analysis tau3-Banking evaluation

Public reference · not scored

independently-verified

DeepSeek V4 Flash Vision Exp individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Terra (max; Artificial Analysis independent run)

gpt-5-6-terra-max

40.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.6 Terra individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Pro 0813 (max; Artificial Analysis independent run)

deepseek-v4-pro-0813-max

39.6%

3Artificial Analysis tau3-Banking evaluation

Public reference · not scored

independently-verified

DeepSeek V4 Pro 0813 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.4 (xhigh; Artificial Analysis independent run)

gpt-5-4-xhigh

39.6%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.4 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.5 (xhigh; Artificial Analysis independent run)

gpt-5-5-xhigh

39.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Fable 5 (max; Artificial Analysis independent run)

claude-fable-5-max

38.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Fable 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Sonnet 5 (max; Artificial Analysis independent run)

claude-sonnet-5-max

37.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Sonnet 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Gemini 3.7 Flash (medium; Artificial Analysis independent run)

gemini-3-7-flash-medium

35.5%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemini 3.7 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Muse Spark 1.2 (xhigh; Artificial Analysis independent run)

muse-spark-1-2-xhigh

34.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Muse Spark 1.2 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Opus 4.8 (max; Artificial Analysis independent run)

claude-opus-4-8-max

34.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Opus 4.8 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Muse Spark 1.1 (xhigh; Artificial Analysis independent run)

muse-spark-1-1-xhigh

31.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Muse Spark 1.1 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Luna (max; Artificial Analysis independent run)

gpt-5-6-luna-max

31.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.6 Luna individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Gemini 3.6 Flash (high; Artificial Analysis independent run)

gemini-3-6-flash-high

29.9%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemini 3.6 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Flash max as published by Upstage

deepseek-v4-flash-max

22.3%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Solar Open 2 250B (high)

solar-open2-250b-high

19.6%

bankingSolar Open 2 card English table

Score input

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

MiMo-V2.5 as published by Upstage

mimo-v2-5-solar-open2-unspecified

Solar Open 100B (Reasoning)

8.7%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Solar Open 100B as published by Upstage

solar-open-100b-reasoning-high

7.4%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Command A+ as published by Upstage

command-a-plus-solar-open2-unspecified

5.8%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Mistral Medium 3.5 as published by Upstage

mistral-medium-3-5-high

5.8%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95

nemotron-3-5-lightning-30b-a3b-default

9.3%

3NVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness

Score input

provider-reported

NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12

Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64

muse-glimmer-30b-high

23.5%

3 / BankingArtificial Analysis τ³-Banking documented evaluation

Public reference · not scored

provider-reported

Muse Glimmer Evaluation Methodology ↗Observed 2026-08-10 · checked 2026-08-10

Artificial Analysis τ³-Banking independent evaluation.

source label without registered configuration ID

24.5%

3Artificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Artificial Analysis τ³-Banking independent evaluation.

source label without registered configuration ID

16.5%

3Artificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Kimi K3; Artificial Analysis τ³-Banking evaluation.

source label without registered configuration ID

33.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21

Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published.

muse-spark-1-1-xhigh

25.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16

GPT-5.6 Sol (max)

gpt-5-6-sol-max

33.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.5 (high)

source label without registered configuration ID

32.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Terra (max)

gpt-5-6-terra-max

31.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.5 (xhigh)

gpt-5-5-xhigh

31.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)

claude-sonnet-4-6-max

30.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 (xhigh)

gpt-5-4-xhigh

30.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.7 (Adaptive Reasoning, Max Effort)

claude-opus-4-7-max

28.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 5 (Adaptive Reasoning, Max Effort)

claude-sonnet-5-max

28.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.8 (Adaptive Reasoning, Max Effort)

claude-opus-4-8-max

27.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Luna (max)

gpt-5-6-luna-max

27.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.2 (max)

glm-5-2-max

26.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)

claude-fable-5-max

26.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Pro (Reasoning, Max Effort)

deepseek-v4-pro-max

25.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.5 Flash (high)

gemini-3-5-flash-high

25.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark 1.1 (xhigh)

muse-spark-1-1-xhigh

25.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Flash (Reasoning, Max Effort)

deepseek-v4-flash-max

22.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 mini (xhigh)

gpt-5-4-mini-xhigh

21.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 nano (xhigh)

gpt-5-4-nano-xhigh

21.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.6

source label without registered configuration ID

20.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark

source label without registered configuration ID

19.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 (high)

gpt-5-high

19.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Sonnet (Reasoning)

source label without registered configuration ID

19.0%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.2 (Reasoning)

source label without registered configuration ID

18.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.7 Code

source label without registered configuration ID

18.1%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Plus

source label without registered configuration ID

17.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3 Flash Preview (Reasoning)

source label without registered configuration ID

17.5%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Pro Preview

source label without registered configuration ID

16.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 Plus

source label without registered configuration ID

16.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.1 Terminus (Reasoning)

source label without registered configuration ID

15.9%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 27B (Reasoning)

source label without registered configuration ID

15.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 31B (Reasoning)

source label without registered configuration ID

15.1%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Medium 3.5

source label without registered configuration ID

14.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.5 (Reasoning)

source label without registered configuration ID

14.2%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.1 (high)

gpt-5-1-high

14.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nemotron 3 Ultra 550B A55B (Reasoning)

source label without registered configuration ID

13.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4 Sonnet (Reasoning)

source label without registered configuration ID

13.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 122B A10B (Reasoning)

source label without registered configuration ID

13.6%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 397B A17B (Reasoning)

source label without registered configuration ID

13.4%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M3

source label without registered configuration ID

13.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.3 (high)

source label without registered configuration ID

12.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 26B A4B (Reasoning)

source label without registered configuration ID

11.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.1 (Reasoning)

source label without registered configuration ID

11.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Max

source label without registered configuration ID

10.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.6 (Reasoning)

source label without registered configuration ID

10.5%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

NVIDIA Nemotron 3 Super 120B A12B (Reasoning)

source label without registered configuration ID

10.1%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.7 (Reasoning)

source label without registered configuration ID

9.7%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 2.5 Pro

source label without registered configuration ID

9.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Haiku (Reasoning)

source label without registered configuration ID

9.1%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.7

source label without registered configuration ID

8.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Flash-Lite

source label without registered configuration ID

8.7%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5-Pro

source label without registered configuration ID

8.7%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nova 2.0 Pro Preview (medium)

source label without registered configuration ID

7.6%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5

source label without registered configuration ID

6.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Large 3

source label without registered configuration ID

5.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Command A+

source label without registered configuration ID

5.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Small 4 (Reasoning)

source label without registered configuration ID

5.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Definition and scoring

Organisation

Sierra / Artificial Analysis

What does τ³-Banking measure?

Fintech customer-support agent benchmark requiring knowledge-base navigation and multi-step tool use on banking workflows.

Which model scores highest on τ³-Banking?

Grok 4.6 by xAI currently leads with 50.7%.

How many models are evaluated on τ³-Banking?

83 canonical model products have a qualifying score, backed by 106 distinct dated source rows.

Does this affect overall Lumina rank?

Yes. This family is ranking-weighted at 1.2% of its capability category. Grok 4.6 is overall #5.

Accessible data for τ³-Banking leaderboard
Model	Rank	Model ID	Provider	Score	Unit
Grok 4.6	#1	grok-4-6	xAI	50.7216494845361	percent
GLM-5.3	#2	glm-5-3	Z.AI	50.3092783505155	percent
GLM-5.3-Flash	#3	glm-5-3-flash	Z.AI	47.2164948453608	percent
Kimi K3	#4	kimi-k3	Moonshot AI	45.979381443299	percent
Qwen3.8-Flash-Next	#5	qwen-3-8-flash-next	Alibaba Cloud	45.360824742268	percent
GPT-5.6 Sol	#6	gpt-5-6-sol	OpenAI	44.3298969072165	percent
Claude Opus 5	#7	claude-opus-5	Anthropic	42.0618556701031	percent
Grok 4.5	#8	grok-4-5	xAI	42.0618556701031	percent
DeepSeek V4 Flash Vision Exp	#9	deepseek-v4-flash-vision-exp	DeepSeek	41.0309278350515	percent
GPT-5.6 Terra	#10	gpt-5-6-terra	OpenAI	40.2061855670103	percent
DeepSeek V4 Pro 0813	#11	deepseek-v4-pro-0813	DeepSeek	39.58762886597941	percent
GPT-5.4	#12	gpt-5-4	OpenAI	39.58762886597941	percent
GPT-5.5	#13	gpt-5-5	OpenAI	38.9690721649485	percent
Claude Fable 5	#14	claude-fable-5	Anthropic	38.144329896907195	percent
Claude Sonnet 5	#15	claude-sonnet-5	Anthropic	37.319587628866	percent
Gemini 3.7 Flash	#16	gemini-3-7-flash	Google	35.4639175257732	percent
Muse Spark 1.2	#17	muse-spark-1-2	Meta	34.8453608247423	percent
Claude Opus 4.7	#18	claude-opus-4-7	Anthropic	34.639175257732	percent
GLM-5.2	#19	glm-5-2	Z.AI	34.639175257732	percent
Claude Opus 4.8	#20	claude-opus-4-8	Anthropic	34.226804123711304	percent
Muse Spark 1.1	#21	muse-spark-1-1	Meta	31.7525773195876	percent
GPT-5.6 Luna	#22	gpt-5-6-luna	OpenAI	31.1340206185567	percent
Claude Sonnet 4.6	#23	claude-sonnet-4-6	Anthropic	30.5155	percent
Gemini 3.6 Flash	#24	gemini-3-6-flash	Google	29.8969072164948	percent
DeepSeek V4 Pro	#25	deepseek-v4-pro	DeepSeek	25.7732	percent
Gemini 3.5 Flash	#26	gemini-3-5-flash	Google	25.3608	percent
Muse Glimmer 30B	#27	muse-glimmer-30b	Meta	23.5	percent
DeepSeek V4 Flash	#28	deepseek-v4-flash	DeepSeek	22.8866	percent
GPT-5.4 mini	#29	gpt-5-4-mini	OpenAI	21.4433	percent
GPT-5.4 nano	#30	gpt-5-4-nano	OpenAI	21.0309	percent
Kimi K2.6	#31	kimi-k2-6	Moonshot AI	20.6186	percent
Solar Open 2 250B	#32	solar-open2-250b	Upstage	19.6	percent
GPT-5	#33	gpt-5	OpenAI	19.5876	percent
Muse Spark	#34	muse-spark	Meta	19.5876	percent
Claude Sonnet 4.5	#35	claude-sonnet-4-5	Anthropic	18.9691	percent
DeepSeek V3.2	#36	deepseek-v3-2	DeepSeek	18.7629	percent
Kimi K2.7 Code	#37	kimi-k2-7-code	Moonshot AI	18.1443	percent
Qwen3.7-Plus	#38	qwen-3-7-plus	Alibaba Cloud	17.8694	percent
Gemini 3 Flash	#39	gemini-3-flash	Google	17.5258	percent
Gemini 3.5 Flash-Lite	#40	gemini-3-5-flash-lite	Google	16.5	percent
Gemini 3.1 Pro Preview	#41	gemini-3-1-pro-preview	Google	16.4948	percent
Qwen3.6 Plus	#42	qwen3-6-plus	Alibaba Cloud	16.4948	percent
DeepSeek V3.1 Terminus	#43	deepseek-v3-1-terminus	DeepSeek	15.8763	percent
Qwen3.5-122B-A10B	#44	qwen3-5-122b-a10b	Alibaba Cloud	15.257731958763	percent
Qwen3.6 27B	#45	qwen3-6-27b	Alibaba Cloud	15.2577	percent
Mistral Medium 3.5 128B	#46	mistral-medium-3-5-128b	Mistral AI	15.051546391753	percent
Gemma 4 31B	#47	gemma-4-31b	Google	15.0515	percent
Mistral Medium 3.5	#48	mistral-medium-3-5	Mistral AI	14.433	percent
Kimi K2.5	#49	kimi-k2-5	Moonshot AI	14.226804123711	percent
GPT-5.1	#50	gpt-5-1	OpenAI	14.0206	percent
Claude Sonnet 4	#51	claude-sonnet-4	Anthropic	13.8144	percent
Nemotron 3 Ultra	#52	nemotron-3-ultra	NVIDIA	13.8144	percent
Qwen3.5 122B	#53	qwen3-5-122b	Alibaba Cloud	13.6082	percent
Qwen3.5 397B A17B	#54	qwen3-5-397b	Alibaba Cloud	13.4021	percent
LongCat-2.0	#55	longcat-2-0	Meituan	13.19587628866	percent
MiniMax M3	#56	minimax-m3	MiniMax	12.9897	percent
Grok 4.3	#57	grok-4-3	xAI	12.1649	percent
Gemma 4 26B A4B	#58	gemma-4-26b-a4b	Google	11.958762886598	percent
Gemma 4 26B	#59	gemma-4-26b	Google	11.7526	percent
GLM-5.1	#60	glm-5-1	Z.AI	11.5464	percent
Qwen3.7-Max	#61	qwen-3-7-max	Alibaba Cloud	10.9278	percent
GLM-4.6	#62	glm-4-6	Z.AI	10.5155	percent
Nemotron 3 Super	#63	nemotron-3-super	NVIDIA	10.1031	percent
GLM-4.7	#64	glm-4-7	Z.AI	9.6907	percent
NVIDIA Nemotron 3.5 Lightning 30B-A3B	#65	nemotron-3-5-lightning-30b-a3b	NVIDIA	9.28	percent
Gemini 2.5 Pro	#66	gemini-2-5-pro	Google	9.2784	percent
Qwen3.6-35B-A3B	#67	qwen3-6-35b-a3b	Alibaba Cloud	9.278350515464	percent
Claude Haiku 4.5	#68	claude-haiku-4-5	Anthropic	9.0722	percent
MiniMax M2.7	#69	minimax-m2-7	MiniMax	8.866	percent
Gemini 3.1 Flash-Lite	#70	gemini-3-1-flash-lite	Google	8.6598	percent
MiMo-V2.5-Pro	#71	mimo-v2-5-pro	Xiaomi	8.6598	percent
Nova 2 Pro	#72	nova-2-pro	Amazon	7.6289	percent
MiMo-V2.5	#73	mimo-v2-5	Xiaomi	6.5979	percent
Nemotron 3 Nano 30B	#74	nemotron-3-nano-30b	NVIDIA	5.979381443299	percent
Command A+	#75	command-a-plus	Cohere	5.7732	percent
Mistral Large 3	#76	mistral-large-3	Mistral AI	5.7732	percent
Trinity-Large-Thinking	#77	trinity-large-thinking	Arcee AI	5.773195876289	percent
GPT-4.1 mini	#78	gpt-4-1-mini	OpenAI	5.360824742268	percent
Mistral Small 4	#79	mistral-small-4	Mistral AI	5.1546	percent
Llama 4 Maverick	#80	llama-4-maverick	Meta	3.711340206186	percent
GPT-4.1 nano	#81	gpt-4-1-nano	OpenAI	3.505154639175	percent
Llama 4 Scout	#82	llama-4-scout	Meta	3.298969072165	percent
Gemma 3 27B	#83	gemma-3-27b	Google	0.824742268041	percent

Model

Rank

Model ID

Provider

Score

Unit

Grok 4.6

grok-4-6

xAI

50.7216494845361

percent

GLM-5.3

glm-5-3

Z.AI

50.3092783505155

percent

GLM-5.3-Flash

glm-5-3-flash

Z.AI

47.2164948453608

percent

Kimi K3

kimi-k3

Moonshot AI

45.979381443299

percent

Qwen3.8-Flash-Next

qwen-3-8-flash-next

Alibaba Cloud

45.360824742268

percent

GPT-5.6 Sol

gpt-5-6-sol

OpenAI

44.3298969072165

percent

Claude Opus 5

claude-opus-5

Anthropic

42.0618556701031

percent

Grok 4.5

grok-4-5

xAI

42.0618556701031

percent

DeepSeek V4 Flash Vision Exp

deepseek-v4-flash-vision-exp

DeepSeek

41.0309278350515

percent

GPT-5.6 Terra

#10

gpt-5-6-terra

OpenAI

40.2061855670103

percent

DeepSeek V4 Pro 0813

#11

deepseek-v4-pro-0813

DeepSeek

39.58762886597941

percent

GPT-5.4

#12

gpt-5-4

OpenAI

39.58762886597941

percent

GPT-5.5

#13

gpt-5-5

OpenAI

38.9690721649485

percent

Claude Fable 5

#14

claude-fable-5

Anthropic

38.144329896907195

percent

Claude Sonnet 5

#15

claude-sonnet-5

Anthropic

37.319587628866

percent

Gemini 3.7 Flash

#16

gemini-3-7-flash

Google

35.4639175257732

percent

Muse Spark 1.2

#17

muse-spark-1-2

Meta

34.8453608247423

percent

Claude Opus 4.7

#18

claude-opus-4-7

Anthropic

34.639175257732

percent

GLM-5.2

#19

glm-5-2

Z.AI

34.639175257732

percent

Claude Opus 4.8

#20

claude-opus-4-8

Anthropic

34.226804123711304

percent

Muse Spark 1.1

#21

muse-spark-1-1

Meta

31.7525773195876

percent

GPT-5.6 Luna

#22

gpt-5-6-luna

OpenAI

31.1340206185567

percent

Claude Sonnet 4.6

#23

claude-sonnet-4-6

Anthropic

30.5155

percent

Gemini 3.6 Flash

#24

gemini-3-6-flash

Google

29.8969072164948

percent

DeepSeek V4 Pro

#25

deepseek-v4-pro

DeepSeek

25.7732

percent

Gemini 3.5 Flash

#26

gemini-3-5-flash

Google

25.3608

percent

Muse Glimmer 30B

#27

muse-glimmer-30b

Meta

23.5

percent

DeepSeek V4 Flash

#28

deepseek-v4-flash

DeepSeek

22.8866

percent

GPT-5.4 mini

#29

gpt-5-4-mini

OpenAI

21.4433

percent

GPT-5.4 nano

#30

gpt-5-4-nano

OpenAI

21.0309

percent

Kimi K2.6

#31

kimi-k2-6

Moonshot AI

20.6186

percent

Solar Open 2 250B

#32

solar-open2-250b

Upstage

19.6

percent

GPT-5

#33

gpt-5

OpenAI

19.5876

percent

Muse Spark

#34

muse-spark

Meta

19.5876

percent

Claude Sonnet 4.5

#35

claude-sonnet-4-5

Anthropic

18.9691

percent

DeepSeek V3.2

#36

deepseek-v3-2

DeepSeek

18.7629

percent

Kimi K2.7 Code

#37

kimi-k2-7-code

Moonshot AI

18.1443

percent

Qwen3.7-Plus

#38

qwen-3-7-plus

Alibaba Cloud

17.8694

percent

Gemini 3 Flash

#39

gemini-3-flash

Google

17.5258

percent

Gemini 3.5 Flash-Lite

#40

gemini-3-5-flash-lite

Google

16.5

percent

Gemini 3.1 Pro Preview

#41

gemini-3-1-pro-preview

Google

16.4948

percent

Qwen3.6 Plus

#42

qwen3-6-plus

Alibaba Cloud

16.4948

percent

DeepSeek V3.1 Terminus

#43

deepseek-v3-1-terminus

DeepSeek

15.8763

percent

Qwen3.5-122B-A10B

#44

qwen3-5-122b-a10b

Alibaba Cloud

15.257731958763

percent

Qwen3.6 27B

#45

qwen3-6-27b

Alibaba Cloud

15.2577

percent

Mistral Medium 3.5 128B

#46

mistral-medium-3-5-128b

Mistral AI

15.051546391753

percent

Gemma 4 31B

#47

gemma-4-31b

Google

15.0515

percent

Mistral Medium 3.5

#48

mistral-medium-3-5

Mistral AI

14.433

percent

Kimi K2.5

#49

kimi-k2-5

Moonshot AI

14.226804123711

percent

GPT-5.1

#50

gpt-5-1

OpenAI

14.0206

percent

Claude Sonnet 4

#51

claude-sonnet-4

Anthropic

13.8144

percent

Nemotron 3 Ultra

#52

nemotron-3-ultra

NVIDIA

13.8144

percent

Qwen3.5 122B

#53

qwen3-5-122b

Alibaba Cloud

13.6082

percent

Qwen3.5 397B A17B

#54

qwen3-5-397b

Alibaba Cloud

13.4021

percent

LongCat-2.0

#55

longcat-2-0

Meituan

13.19587628866

percent

MiniMax M3

#56

minimax-m3

MiniMax

12.9897

percent

Grok 4.3

#57

grok-4-3

xAI

12.1649

percent

Gemma 4 26B A4B

#58

gemma-4-26b-a4b

Google

11.958762886598

percent

Gemma 4 26B

#59

gemma-4-26b

Google

11.7526

percent

GLM-5.1

#60

glm-5-1

Z.AI

11.5464

percent

Qwen3.7-Max

#61

qwen-3-7-max

Alibaba Cloud

10.9278

percent

GLM-4.6

#62

glm-4-6

Z.AI

10.5155

percent

Nemotron 3 Super

#63

nemotron-3-super

NVIDIA

10.1031

percent

GLM-4.7

#64

glm-4-7

Z.AI

9.6907

percent

NVIDIA Nemotron 3.5 Lightning 30B-A3B

#65

nemotron-3-5-lightning-30b-a3b

NVIDIA

9.28

percent

Gemini 2.5 Pro

#66

gemini-2-5-pro

Google

9.2784

percent

Qwen3.6-35B-A3B

#67

qwen3-6-35b-a3b

Alibaba Cloud

9.278350515464

percent

Claude Haiku 4.5

#68

claude-haiku-4-5

Anthropic

9.0722

percent

MiniMax M2.7

#69

minimax-m2-7

MiniMax

8.866

percent

Gemini 3.1 Flash-Lite

#70

gemini-3-1-flash-lite

Google

8.6598

percent

MiMo-V2.5-Pro

#71

mimo-v2-5-pro

Xiaomi

8.6598

percent

Nova 2 Pro

#72

nova-2-pro

Amazon

7.6289

percent

MiMo-V2.5

#73

mimo-v2-5

Xiaomi

6.5979

percent

Nemotron 3 Nano 30B

#74

nemotron-3-nano-30b

NVIDIA

5.979381443299

percent

Command A+

#75

command-a-plus

Cohere

5.7732

percent

Mistral Large 3

#76

mistral-large-3

Mistral AI

5.7732

percent

Trinity-Large-Thinking

#77

trinity-large-thinking

Arcee AI

5.773195876289

percent

GPT-4.1 mini

#78

gpt-4-1-mini

OpenAI

5.360824742268

percent

Mistral Small 4

#79

mistral-small-4

Mistral AI

5.1546

percent

Llama 4 Maverick

#80

llama-4-maverick

Meta

3.711340206186

percent

GPT-4.1 nano

#81

gpt-4-1-nano

OpenAI

3.505154639175

percent

Llama 4 Scout

#82

llama-4-scout

Meta

3.298969072165

percent

Gemma 3 27B

#83

gemma-3-27b

Google

0.824742268041

percent

τ³-Banking leaderboard ranked by score
Rank	Model	Provider	License	Evidence use	Score
#1	Grok 4.6 grok-4.6	xAI	closed	Score input	50.7%
#2	GLM-5.3 glm-5.3	Z.AI	announced-open	Score input	50.3%
#3	GLM-5.3-Flash glm-5.3-flash	Z.AI	open	Score input	47.2%
#4	Kimi K3 kimi-k3	Moonshot AI	open	Score input	46.0%
#5	Qwen3.8-Flash-Next Qwen/Qwen3.8-Flash-Next	Alibaba Cloud	open	Public reference	45.4%
#6	GPT-5.6 Sol gpt-5.6-sol	OpenAI	closed	Score input	44.3%
#7	Claude Opus 5 claude-opus-5	Anthropic	closed	Score input	42.1%
#8	Grok 4.5 grok-4.5	xAI	closed	Score input	42.1%
#9	DeepSeek V4 Flash Vision Exp deepseek-v4-flash-vision-exp	DeepSeek	—	Public reference	41.0%
#10	GPT-5.6 Terra gpt-5.6-terra	OpenAI	closed	Score input	40.2%
#11	DeepSeek V4 Pro 0813 DeepSeek-V4-Pro-0813	DeepSeek	open	Public reference	39.6%
#12	GPT-5.4 gpt-5.4	OpenAI	closed	Score input	39.6%
#13	GPT-5.5 gpt-5.5	OpenAI	closed	Score input	39.0%
#14	Claude Fable 5 claude-fable-5	Anthropic	closed	Score input	38.1%
#15	Claude Sonnet 5 claude-sonnet-5	Anthropic	closed	Score input	37.3%
#16	Gemini 3.7 Flash gemini-3.7-flash	Google	closed	Score input	35.5%
#17	Muse Spark 1.2 muse-spark-1-2	Meta	announced-open	Score input	34.8%
#18	Claude Opus 4.7 claude-opus-4-7	Anthropic	closed	Score input	34.6%
#19	GLM-5.2 glm-5-2	Z.AI	open	Score input	34.6%
#20	Claude Opus 4.8 claude-opus-4-8	Anthropic	closed	Score input	34.2%
#21	Muse Spark 1.1 muse-spark-1-1	Meta	closed	Score input	31.8%
#22	GPT-5.6 Luna gpt-5.6-luna	OpenAI	closed	Score input	31.1%
#23	Claude Sonnet 4.6 claude-sonnet-4-6	Anthropic	closed	Score input	30.5%
#24	Gemini 3.6 Flash gemini-3.6-flash	Google	closed	Score input	29.9%
#25	DeepSeek V4 Pro deepseek-v4-pro	DeepSeek	open	Public reference	25.8%
#26	Gemini 3.5 Flash gemini-3.5-flash	Google	closed	Public reference	25.4%
#27	Muse Glimmer 30B meta-models/Muse-Glimmer-30B	Meta	open	Score input	23.5%
#28	DeepSeek V4 Flash deepseek-v4-flash	DeepSeek	open	Public reference	22.9%
#29	GPT-5.4 mini gpt-5.4-mini	OpenAI	closed	Public reference	21.4%
#30	GPT-5.4 nano gpt-5.4-nano	OpenAI	closed	Public reference	21.0%
#31	Kimi K2.6 kimi-k2.6	Moonshot AI	open	Public reference	20.6%
#32	Solar Open 2 250B upstage/Solar-Open2-250B	Upstage	open	Score input	19.6%
#33	GPT-5 gpt-5	OpenAI	closed	Public reference	19.6%
#34	Muse Spark muse-spark	Meta	closed	Public reference	19.6%
#35	Claude Sonnet 4.5 claude-sonnet-4-5	Anthropic	closed	Score input	19.0%
#36	DeepSeek V3.2 deepseek-v3.2	DeepSeek	open	Score input	18.8%
#37	Kimi K2.7 Code kimi-k2.7-code	Moonshot AI	open	Public reference	18.1%
#38	Qwen3.7-Plus qwen3.7-plus	Alibaba Cloud	closed	Public reference	17.9%
#39	Gemini 3 Flash gemini-3-flash	Google	closed	Score input	17.5%
#40	Gemini 3.5 Flash-Lite gemini-3.5-flash-lite	Google	closed	Public reference	16.5%
#41	Gemini 3.1 Pro Preview gemini-3.1-pro-preview	Google	closed	Public reference	16.5%
#42	Qwen3.6 Plus qwen3-6-plus	Alibaba Cloud	closed	Public reference	16.5%
#43	DeepSeek V3.1 Terminus deepseek-v3.1-terminus	DeepSeek	open	Score input	15.9%
#44	Qwen3.5-122B-A10B Qwen/Qwen3.5-122B-A10B	Alibaba Cloud	open	Score input	15.3%
#45	Qwen3.6 27B qwen3.6-27b	Alibaba Cloud	open	Public reference	15.3%
#46	Mistral Medium 3.5 128B mistralai/Mistral-Medium-3.5-128B	Mistral AI	open	Score input	15.1%
#47	Gemma 4 31B gemma-4-31b	Google	open	Public reference	15.1%
#48	Mistral Medium 3.5 mistral-medium-3-5	Mistral AI	open	Public reference	14.4%
#49	Kimi K2.5 kimi-k2.5	Moonshot AI	open	Score input	14.2%
#50	GPT-5.1 gpt-5.1	OpenAI	closed	Public reference	14.0%
#51	Claude Sonnet 4 claude-sonnet-4	Anthropic	closed	Score input	13.8%
#52	Nemotron 3 Ultra nemotron-3-ultra-550b	NVIDIA	open	Score input	13.8%
#53	Qwen3.5 122B qwen3.5-122b-a10b	Alibaba Cloud	open	Score input	13.6%
#54	Qwen3.5 397B A17B Qwen/Qwen3.5-397B-A17B	Alibaba Cloud	open	Score input	13.4%
#55	LongCat-2.0 meituan-longcat/LongCat-2.0	Meituan	open	Score input	13.2%
#56	MiniMax M3 MiniMax-M3	MiniMax	open	Public reference	13.0%
#57	Grok 4.3 grok-4.3	xAI	closed	Public reference	12.2%
#58	Gemma 4 26B A4B google/gemma-4-26b-a4b-it	Google	open	Score input	12.0%
#59	Gemma 4 26B gemma-4-26b-a4b	Google	open	Score input	11.8%
#60	GLM-5.1 glm-5-1	Z.AI	open	Public reference	11.5%
#61	Qwen3.7-Max qwen3.7-max	Alibaba Cloud	closed	Public reference	10.9%
#62	GLM-4.6 glm-4.6	Z.AI	open	Score input	10.5%
#63	Nemotron 3 Super nemotron-3-super-120b	NVIDIA	open	Score input	10.1%
#64	GLM-4.7 glm-4.7	Z.AI	open	Public reference	9.7%
#65	NVIDIA Nemotron 3.5 Lightning 30B-A3B nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16	NVIDIA	open	Score input	9.3%
#66	Gemini 2.5 Pro gemini-2.5-pro	Google	closed	Public reference	9.3%
#67	Qwen3.6-35B-A3B Qwen/Qwen3.6-35B-A3B	Alibaba Cloud	open	Score input	9.3%
#68	Claude Haiku 4.5 claude-haiku-4-5-20251001	Anthropic	closed	Score input	9.1%
#69	MiniMax M2.7 minimax-m2-7	MiniMax	open	Public reference	8.9%
#70	Gemini 3.1 Flash-Lite gemini-3.1-flash-lite	Google	closed	Public reference	8.7%
#71	MiMo-V2.5-Pro mimo-v2-5-pro	Xiaomi	open	Public reference	8.7%
#72	Nova 2 Pro nova-2-pro-preview	Amazon	closed	Score input	7.6%
#73	MiMo-V2.5 mimo-v2.5	Xiaomi	open	Public reference	6.6%
#74	Nemotron 3 Nano 30B nemotron-3-nano-30b	NVIDIA	open	Score input	6.0%
#75	Command A+ command-a-plus	Cohere	open	Public reference	5.8%
#76	Mistral Large 3 mistral-large-2512	Mistral AI	open	Public reference	5.8%
#77	Trinity-Large-Thinking trinity-large-thinking	Arcee AI	open	Score input	5.8%
#78	GPT-4.1 mini gpt-4-1-mini	OpenAI	closed	Score input	5.4%
#79	Mistral Small 4 mistral-small-2603	Mistral AI	open	Public reference	5.2%
#80	Llama 4 Maverick llama-4-maverick	Meta	open	Score input	3.7%
#81	GPT-4.1 nano gpt-4-1-nano	OpenAI	closed	Score input	3.5%
#82	Llama 4 Scout llama-4-scout	Meta	open	Score input	3.3%
#83	Gemma 3 27B gemma-3-27b	Google	open	Score input	0.8%

Rank

Model

Provider

License

Evidence use

Score

grok-4.6

xAI

closed

Score input

50.7%

glm-5.3

Z.AI

announced-open

Score input

50.3%

glm-5.3-flash

Z.AI

open

Score input

47.2%

kimi-k3

Moonshot AI

open

Score input

46.0%

Qwen/Qwen3.8-Flash-Next

Alibaba Cloud

open

Public reference

45.4%

gpt-5.6-sol

OpenAI

closed

Score input

44.3%

claude-opus-5

Anthropic

closed

Score input

42.1%

grok-4.5

xAI

closed

Score input

42.1%

deepseek-v4-flash-vision-exp

DeepSeek

—

Public reference

41.0%

#10

gpt-5.6-terra

OpenAI

closed

Score input

40.2%

#11

DeepSeek-V4-Pro-0813

DeepSeek

open

Public reference

39.6%

#12

gpt-5.4

OpenAI

closed

Score input

39.6%

#13

gpt-5.5

OpenAI

closed

Score input

39.0%

#14

claude-fable-5

Anthropic

closed

Score input

38.1%

#15

claude-sonnet-5

Anthropic

closed

Score input

37.3%

#16

gemini-3.7-flash

Google

closed

Score input

35.5%

#17

muse-spark-1-2

Meta

announced-open

Score input

34.8%

#18

claude-opus-4-7

Anthropic

closed

Score input

34.6%

#19

glm-5-2

Z.AI

open

Score input

34.6%

#20

claude-opus-4-8

Anthropic

closed

Score input

34.2%

#21

muse-spark-1-1

Meta

closed

Score input

31.8%

#22

gpt-5.6-luna

OpenAI

closed

Score input

31.1%

#23

claude-sonnet-4-6

Anthropic

closed

Score input

30.5%

#24

gemini-3.6-flash

Google

closed

Score input

29.9%

#25

deepseek-v4-pro

DeepSeek

open

Public reference

25.8%

#26

gemini-3.5-flash

Google

closed

Public reference

25.4%

#27

meta-models/Muse-Glimmer-30B

Meta

open

Score input

23.5%

#28

deepseek-v4-flash

DeepSeek

open

Public reference

22.9%

#29

gpt-5.4-mini

OpenAI

closed

Public reference

21.4%

#30

gpt-5.4-nano

OpenAI

closed

Public reference

21.0%

#31

kimi-k2.6

Moonshot AI

open

Public reference

20.6%

#32

upstage/Solar-Open2-250B

Upstage

open

Score input

19.6%

#33

gpt-5

OpenAI

closed

Public reference

19.6%

#34

muse-spark

Meta

closed

Public reference

19.6%

#35

claude-sonnet-4-5

Anthropic

closed

Score input

19.0%

#36

deepseek-v3.2

DeepSeek

open

Score input

18.8%

#37

kimi-k2.7-code

Moonshot AI

open

Public reference

18.1%

#38

qwen3.7-plus

Alibaba Cloud

closed

Public reference

17.9%

#39

gemini-3-flash

Google

closed

Score input

17.5%

#40

gemini-3.5-flash-lite

Google

closed

Public reference

16.5%

#41

gemini-3.1-pro-preview

Google

closed

Public reference

16.5%

#42

qwen3-6-plus

Alibaba Cloud

closed

Public reference

16.5%

#43

deepseek-v3.1-terminus

DeepSeek

open

Score input

15.9%

#44

Qwen/Qwen3.5-122B-A10B

Alibaba Cloud

open

Score input

15.3%

#45

qwen3.6-27b

Alibaba Cloud

open

Public reference

15.3%

#46

mistralai/Mistral-Medium-3.5-128B

Mistral AI

open

Score input

15.1%

#47

gemma-4-31b

Google

open

Public reference

15.1%

#48

mistral-medium-3-5

Mistral AI

open

Public reference

14.4%

#49

kimi-k2.5

Moonshot AI

open

Score input

14.2%

#50

gpt-5.1

OpenAI

closed

Public reference

14.0%

#51

claude-sonnet-4

Anthropic

closed

Score input

13.8%

#52

nemotron-3-ultra-550b

NVIDIA

open

Score input

13.8%

#53

qwen3.5-122b-a10b

Alibaba Cloud

open

Score input

13.6%

#54

Qwen/Qwen3.5-397B-A17B

Alibaba Cloud

open

Score input

13.4%

#55

meituan-longcat/LongCat-2.0

Meituan

open

Score input

13.2%

#56

MiniMax-M3

MiniMax

open

Public reference

13.0%

#57

grok-4.3

xAI

closed

Public reference

12.2%

#58

google/gemma-4-26b-a4b-it

Google

open

Score input

12.0%

#59

gemma-4-26b-a4b

Google

open

Score input

11.8%

#60

glm-5-1

Z.AI

open

Public reference

11.5%

#61

qwen3.7-max

Alibaba Cloud

closed

Public reference

10.9%

#62

glm-4.6

Z.AI

open

Score input

10.5%

#63

nemotron-3-super-120b

NVIDIA

open

Score input

10.1%

#64

glm-4.7

Z.AI

open

Public reference

9.7%

#65

nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

NVIDIA

open

Score input

9.3%

#66

gemini-2.5-pro

Google

closed

Public reference

9.3%

#67

Qwen/Qwen3.6-35B-A3B

Alibaba Cloud

open

Score input

9.3%

#68

claude-haiku-4-5-20251001

Anthropic

closed

Score input

9.1%

#69

minimax-m2-7

MiniMax

open

Public reference

8.9%

#70

gemini-3.1-flash-lite

Google

closed

Public reference

8.7%

#71

mimo-v2-5-pro

Xiaomi

open

Public reference

8.7%

#72

nova-2-pro-preview

Amazon

closed

Score input

7.6%

#73

mimo-v2.5

Xiaomi

open

Public reference

6.6%

#74

nemotron-3-nano-30b

NVIDIA

open

Score input

6.0%

#75

command-a-plus

Cohere

open

Public reference

5.8%

#76

mistral-large-2512

Mistral AI

open

Public reference

5.8%

#77

trinity-large-thinking

Arcee AI

open

Score input

5.8%

#78

gpt-4-1-mini

OpenAI

closed

Score input

5.4%

#79

mistral-small-2603

Mistral AI

open

Public reference

5.2%

#80

llama-4-maverick

Meta

open

Score input

3.7%

#81

gpt-4-1-nano

OpenAI

closed

Score input

3.5%

#82

llama-4-scout

Meta

open

Score input

3.3%

#83

gemma-3-27b

Google

open

Score input

0.8%

Every distinct dated source-published row for τ³-Banking, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
Qwen3.8-Flash-Next (Artificial Analysis independent run) qwen-3-8-flash-next-aa-unspecified	Qwen3.8-Flash-Next	45.4%	3Artificial Analysis tau3-Banking evaluation	Public reference · not scored independently-verified	Qwen3.8-Flash-Next individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run) claude-opus-4-7-max	Claude Opus 4.7	34.6%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Opus 4.7 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
GLM-5.2 (max) (Artificial Analysis independent run) glm-5-2-max	GLM-5.2	34.6%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GLM-5.2 (max) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.5 122B A10B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-122b-a10b-aa-reasoning-default	Qwen3.5-122B-A10B	15.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Qwen3.5 122B A10B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Mistral Medium 3.5 (Artificial Analysis completed independent run) mistral-medium-3-5-128b-aa-reasoning-default	Mistral Medium 3.5 128B	15.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Mistral Medium 3.5 current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Kimi K2.5 (Reasoning) (Artificial Analysis completed independent run) kimi-k2-5-thinking	Kimi K2.5	14.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Kimi K2.5 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.5 397B A17B (Reasoning) (Artificial Analysis completed independent run) qwen3-5-397b-thinking	Qwen3.5 397B A17B	13.4%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Qwen3.5 397B A17B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
LongCat 2.0 (Artificial Analysis independent run) longcat-2-0-default	LongCat-2.0	13.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	LongCat 2.0 individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29
Gemma 4 26B A4B (Reasoning) (Artificial Analysis completed independent run) gemma-4-26b-a4b-aa-reasoning-default	Gemma 4 26B A4B	12.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemma 4 26B A4B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Qwen3.6 35B A3B (Reasoning) (Artificial Analysis completed independent run) qwen3-6-35b-a3b-aa-reasoning-default	Qwen3.6-35B-A3B	9.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Qwen3.6 35B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) (Artificial Analysis completed independent run) nemotron-3-nano-30b-aa-reasoning-default	Nemotron 3 Nano 30B	6.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Trinity Large Thinking (Artificial Analysis completed independent run) trinity-large-thinking-aa-reasoning-default	Trinity-Large-Thinking	5.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Trinity Large Thinking current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
GPT-4.1 mini (Artificial Analysis completed independent run) gpt-4-1-mini-epoch-gpt-4-1-mini-2025-04-14	GPT-4.1 mini	5.4%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-4.1 mini current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Mistral Small 4 (Reasoning) (Artificial Analysis completed independent run) mistral-small-4-reasoning	Mistral Small 4	4.9%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Mistral Small 4 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Llama 4 Maverick (Artificial Analysis completed independent run) llama-4-maverick-aa-non-reasoning-default	Llama 4 Maverick	3.7%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Llama 4 Maverick current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
GPT-4.1 nano (Artificial Analysis completed independent run) gpt-4-1-nano-epoch-gpt-4-1-nano-2025-04-14	GPT-4.1 nano	3.5%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-4.1 nano current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Llama 4 Scout (Artificial Analysis completed independent run) llama-4-scout-aa-non-reasoning-default	Llama 4 Scout	3.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Llama 4 Scout current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Gemma 3 27B Instruct (Artificial Analysis completed independent run) gemma-3-27b-aa-non-reasoning-default	Gemma 3 27B	0.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemma 3 27B Instruct current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29
Grok 4.6 (high; Artificial Analysis independent run) grok-4-6-high	Grok 4.6	50.7%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Grok 4.6 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GLM-5.3 (max; Artificial Analysis independent run) glm-5-3-max	GLM-5.3	50.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GLM-5.3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GLM-5.3-Flash (max; Artificial Analysis independent run) glm-5-3-flash-max	GLM-5.3-Flash	47.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GLM-5.3-Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Kimi K3 (max; Artificial Analysis independent run) kimi-k3-max	Kimi K3	46.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Kimi K3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Sol (max; Artificial Analysis independent run) gpt-5-6-sol-max	GPT-5.6 Sol	44.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.6 Sol individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Opus 5 (max; Artificial Analysis independent run) claude-opus-5-max	Claude Opus 5	42.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Opus 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Grok 4.5 (high; Artificial Analysis independent run) grok-4-5-aa-2-high	Grok 4.5	42.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Grok 4.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Flash Vision Exp (max; Artificial Analysis independent run) deepseek-v4-flash-vision-exp-max-harness	DeepSeek V4 Flash Vision Exp	41.0%	3Artificial Analysis tau3-Banking evaluation	Public reference · not scored independently-verified	DeepSeek V4 Flash Vision Exp individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Terra (max; Artificial Analysis independent run) gpt-5-6-terra-max	GPT-5.6 Terra	40.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.6 Terra individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Pro 0813 (max; Artificial Analysis independent run) deepseek-v4-pro-0813-max	DeepSeek V4 Pro 0813	39.6%	3Artificial Analysis tau3-Banking evaluation	Public reference · not scored independently-verified	DeepSeek V4 Pro 0813 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.4 (xhigh; Artificial Analysis independent run) gpt-5-4-xhigh	GPT-5.4	39.6%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.4 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.5 (xhigh; Artificial Analysis independent run) gpt-5-5-xhigh	GPT-5.5	39.0%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Fable 5 (max; Artificial Analysis independent run) claude-fable-5-max	Claude Fable 5	38.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Fable 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Sonnet 5 (max; Artificial Analysis independent run) claude-sonnet-5-max	Claude Sonnet 5	37.3%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Sonnet 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Gemini 3.7 Flash (medium; Artificial Analysis independent run) gemini-3-7-flash-medium	Gemini 3.7 Flash	35.5%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemini 3.7 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Muse Spark 1.2 (xhigh; Artificial Analysis independent run) muse-spark-1-2-xhigh	Muse Spark 1.2	34.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Muse Spark 1.2 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Claude Opus 4.8 (max; Artificial Analysis independent run) claude-opus-4-8-max	Claude Opus 4.8	34.2%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Claude Opus 4.8 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Muse Spark 1.1 (xhigh; Artificial Analysis independent run) muse-spark-1-1-xhigh	Muse Spark 1.1	31.8%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Muse Spark 1.1 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
GPT-5.6 Luna (max; Artificial Analysis independent run) gpt-5-6-luna-max	GPT-5.6 Luna	31.1%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	GPT-5.6 Luna individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
Gemini 3.6 Flash (high; Artificial Analysis independent run) gemini-3-6-flash-high	Gemini 3.6 Flash	29.9%	3Artificial Analysis tau3-Banking evaluation	Score input independently-verified	Gemini 3.6 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27
DeepSeek V4 Flash max as published by Upstage deepseek-v4-flash-max	DeepSeek V4 Flash	22.3%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Solar Open 2 250B (high) solar-open2-250b-high	Solar Open 2 250B	19.6%	bankingSolar Open 2 card English table	Score input provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
MiMo-V2.5 as published by Upstage mimo-v2-5-solar-open2-unspecified	MiMo-V2.5	8.7%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Solar Open 100B as published by Upstage solar-open-100b-reasoning-high	Solar Open 100B (Reasoning)	7.4%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Command A+ as published by Upstage command-a-plus-solar-open2-unspecified	Command A+	5.8%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
Mistral Medium 3.5 as published by Upstage mistral-medium-3-5-high	Mistral Medium 3.5	5.8%	bankingSolar Open 2 card English table	Relative comparison · not standard direct provider-reported	Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95 nemotron-3-5-lightning-30b-a3b-default	NVIDIA Nemotron 3.5 Lightning 30B-A3B	9.3%	3NVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness	Score input provider-reported	NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12
Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64 muse-glimmer-30b-high	Muse Glimmer 30B	23.5%	3 / BankingArtificial Analysis τ³-Banking documented evaluation	Public reference · not scored provider-reported	Muse Glimmer Evaluation Methodology ↗Observed 2026-08-10 · checked 2026-08-10
Artificial Analysis τ³-Banking independent evaluation. source label without registered configuration ID	Gemini 3.6 Flash	24.5%	3Artificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Artificial Analysis τ³-Banking independent evaluation. source label without registered configuration ID	Gemini 3.5 Flash-Lite	16.5%	3Artificial Analysis evaluation harness	Public reference · not scored source-checked	Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21
Kimi K3; Artificial Analysis τ³-Banking evaluation. source label without registered configuration ID	Kimi K3	33.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21
Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published. muse-spark-1-1-xhigh	Muse Spark 1.1	25.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16
GPT-5.6 Sol (max) gpt-5-6-sol-max	GPT-5.6 Sol	33.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.5 (high) source label without registered configuration ID	Grok 4.5	32.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Terra (max) gpt-5-6-terra-max	GPT-5.6 Terra	31.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.5 (xhigh) gpt-5-5-xhigh	GPT-5.5	31.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) claude-sonnet-4-6-max	Claude Sonnet 4.6	30.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 (xhigh) gpt-5-4-xhigh	GPT-5.4	30.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) claude-opus-4-7-max	Claude Opus 4.7	28.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 5 (Adaptive Reasoning, Max Effort) claude-sonnet-5-max	Claude Sonnet 5	28.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.8 (Adaptive Reasoning, Max Effort) claude-opus-4-8-max	Claude Opus 4.8	27.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Luna (max) gpt-5-6-luna-max	GPT-5.6 Luna	27.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.2 (max) glm-5-2-max	GLM-5.2	26.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) claude-fable-5-max	Claude Fable 5	26.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Pro (Reasoning, Max Effort) deepseek-v4-pro-max	DeepSeek V4 Pro	25.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.5 Flash (high) gemini-3-5-flash-high	Gemini 3.5 Flash	25.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Muse Spark 1.1 (xhigh) muse-spark-1-1-xhigh	Muse Spark 1.1	25.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Flash (Reasoning, Max Effort) deepseek-v4-flash-max	DeepSeek V4 Flash	22.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 mini (xhigh) gpt-5-4-mini-xhigh	GPT-5.4 mini	21.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 nano (xhigh) gpt-5-4-nano-xhigh	GPT-5.4 nano	21.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.6 source label without registered configuration ID	Kimi K2.6	20.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Muse Spark source label without registered configuration ID	Muse Spark	19.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5 (high) gpt-5-high	GPT-5	19.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Sonnet (Reasoning) source label without registered configuration ID	Claude Sonnet 4.5	19.0%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V3.2 (Reasoning) source label without registered configuration ID	DeepSeek V3.2	18.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.7 Code source label without registered configuration ID	Kimi K2.7 Code	18.1%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Plus source label without registered configuration ID	Qwen3.7-Plus	17.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3 Flash Preview (Reasoning) source label without registered configuration ID	Gemini 3 Flash	17.5%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Pro Preview source label without registered configuration ID	Gemini 3.1 Pro Preview	16.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 Plus source label without registered configuration ID	Qwen3.6 Plus	16.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V3.1 Terminus (Reasoning) source label without registered configuration ID	DeepSeek V3.1 Terminus	15.9%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.6 27B (Reasoning) source label without registered configuration ID	Qwen3.6 27B	15.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 31B (Reasoning) source label without registered configuration ID	Gemma 4 31B	15.1%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Medium 3.5 source label without registered configuration ID	Mistral Medium 3.5	14.4%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.5 (Reasoning) source label without registered configuration ID	Kimi K2.5	14.2%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.1 (high) gpt-5-1-high	GPT-5.1	14.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Nemotron 3 Ultra 550B A55B (Reasoning) source label without registered configuration ID	Nemotron 3 Ultra	13.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4 Sonnet (Reasoning) source label without registered configuration ID	Claude Sonnet 4	13.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 122B A10B (Reasoning) source label without registered configuration ID	Qwen3.5 122B	13.6%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 397B A17B (Reasoning) source label without registered configuration ID	Qwen3.5 397B A17B	13.4%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M3 source label without registered configuration ID	MiniMax M3	13.0%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.3 (high) source label without registered configuration ID	Grok 4.3	12.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 26B A4B (Reasoning) source label without registered configuration ID	Gemma 4 26B	11.8%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.1 (Reasoning) source label without registered configuration ID	GLM-5.1	11.5%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Max source label without registered configuration ID	Qwen3.7-Max	10.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-4.6 (Reasoning) source label without registered configuration ID	GLM-4.6	10.5%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
NVIDIA Nemotron 3 Super 120B A12B (Reasoning) source label without registered configuration ID	Nemotron 3 Super	10.1%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-4.7 (Reasoning) source label without registered configuration ID	GLM-4.7	9.7%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 2.5 Pro source label without registered configuration ID	Gemini 2.5 Pro	9.3%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Haiku (Reasoning) source label without registered configuration ID	Claude Haiku 4.5	9.1%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2.7 source label without registered configuration ID	MiniMax M2.7	8.9%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Flash-Lite source label without registered configuration ID	Gemini 3.1 Flash-Lite	8.7%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5-Pro source label without registered configuration ID	MiMo-V2.5-Pro	8.7%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Nova 2.0 Pro Preview (medium) source label without registered configuration ID	Nova 2 Pro	7.6%	3Artificial Analysis independent evaluation	Score input source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5 source label without registered configuration ID	MiMo-V2.5	6.6%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Large 3 source label without registered configuration ID	Mistral Large 3	5.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Command A+ source label without registered configuration ID	Command A+	5.8%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Mistral Small 4 (Reasoning) source label without registered configuration ID	Mistral Small 4	5.2%	3Artificial Analysis independent evaluation	Public reference · not scored source-checked	τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Exact published model / configuration

Canonical product

Score

Version / system

Evidence

Source / observed

Qwen3.8-Flash-Next (Artificial Analysis independent run)

qwen-3-8-flash-next-aa-unspecified

45.4%

3Artificial Analysis tau3-Banking evaluation

Public reference · not scored

independently-verified

Qwen3.8-Flash-Next individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) (Artificial Analysis independent run)

claude-opus-4-7-max

34.6%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Opus 4.7 (Adaptive Reasoning, Max Effort) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

GLM-5.2 (max) (Artificial Analysis independent run)

glm-5-2-max

34.6%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GLM-5.2 (max) individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.5 122B A10B (Reasoning) (Artificial Analysis completed independent run)

qwen3-5-122b-a10b-aa-reasoning-default

15.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Qwen3.5 122B A10B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Mistral Medium 3.5 (Artificial Analysis completed independent run)

mistral-medium-3-5-128b-aa-reasoning-default

15.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Mistral Medium 3.5 current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Kimi K2.5 (Reasoning) (Artificial Analysis completed independent run)

kimi-k2-5-thinking

14.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Kimi K2.5 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.5 397B A17B (Reasoning) (Artificial Analysis completed independent run)

qwen3-5-397b-thinking

13.4%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Qwen3.5 397B A17B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

LongCat 2.0 (Artificial Analysis independent run)

longcat-2-0-default

13.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

LongCat 2.0 individual evaluations ↗Observed 2026-08-29 · checked 2026-08-29

Gemma 4 26B A4B (Reasoning) (Artificial Analysis completed independent run)

gemma-4-26b-a4b-aa-reasoning-default

12.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemma 4 26B A4B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Qwen3.6 35B A3B (Reasoning) (Artificial Analysis completed independent run)

qwen3-6-35b-a3b-aa-reasoning-default

9.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Qwen3.6 35B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) (Artificial Analysis completed independent run)

nemotron-3-nano-30b-aa-reasoning-default

6.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Trinity Large Thinking (Artificial Analysis completed independent run)

trinity-large-thinking-aa-reasoning-default

5.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Trinity Large Thinking current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

GPT-4.1 mini (Artificial Analysis completed independent run)

gpt-4-1-mini-epoch-gpt-4-1-mini-2025-04-14

5.4%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-4.1 mini current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Mistral Small 4 (Reasoning) (Artificial Analysis completed independent run)

mistral-small-4-reasoning

4.9%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Mistral Small 4 (Reasoning) current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Llama 4 Maverick (Artificial Analysis completed independent run)

llama-4-maverick-aa-non-reasoning-default

3.7%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Llama 4 Maverick current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

GPT-4.1 nano (Artificial Analysis completed independent run)

gpt-4-1-nano-epoch-gpt-4-1-nano-2025-04-14

3.5%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-4.1 nano current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Llama 4 Scout (Artificial Analysis completed independent run)

llama-4-scout-aa-non-reasoning-default

3.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Llama 4 Scout current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Gemma 3 27B Instruct (Artificial Analysis completed independent run)

gemma-3-27b-aa-non-reasoning-default

0.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemma 3 27B Instruct current model and individual-evaluation page ↗Observed 2026-08-29 · checked 2026-08-29

Grok 4.6 (high; Artificial Analysis independent run)

grok-4-6-high

50.7%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Grok 4.6 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GLM-5.3 (max; Artificial Analysis independent run)

glm-5-3-max

50.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GLM-5.3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GLM-5.3-Flash (max; Artificial Analysis independent run)

glm-5-3-flash-max

47.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GLM-5.3-Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Kimi K3 (max; Artificial Analysis independent run)

kimi-k3-max

46.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Kimi K3 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Sol (max; Artificial Analysis independent run)

gpt-5-6-sol-max

44.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.6 Sol individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Opus 5 (max; Artificial Analysis independent run)

claude-opus-5-max

42.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Opus 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Grok 4.5 (high; Artificial Analysis independent run)

grok-4-5-aa-2-high

42.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Grok 4.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Flash Vision Exp (max; Artificial Analysis independent run)

deepseek-v4-flash-vision-exp-max-harness

41.0%

3Artificial Analysis tau3-Banking evaluation

Public reference · not scored

independently-verified

DeepSeek V4 Flash Vision Exp individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Terra (max; Artificial Analysis independent run)

gpt-5-6-terra-max

40.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.6 Terra individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Pro 0813 (max; Artificial Analysis independent run)

deepseek-v4-pro-0813-max

39.6%

3Artificial Analysis tau3-Banking evaluation

Public reference · not scored

independently-verified

DeepSeek V4 Pro 0813 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.4 (xhigh; Artificial Analysis independent run)

gpt-5-4-xhigh

39.6%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.4 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.5 (xhigh; Artificial Analysis independent run)

gpt-5-5-xhigh

39.0%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Fable 5 (max; Artificial Analysis independent run)

claude-fable-5-max

38.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Fable 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Sonnet 5 (max; Artificial Analysis independent run)

claude-sonnet-5-max

37.3%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Sonnet 5 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Gemini 3.7 Flash (medium; Artificial Analysis independent run)

gemini-3-7-flash-medium

35.5%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemini 3.7 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Muse Spark 1.2 (xhigh; Artificial Analysis independent run)

muse-spark-1-2-xhigh

34.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Muse Spark 1.2 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Claude Opus 4.8 (max; Artificial Analysis independent run)

claude-opus-4-8-max

34.2%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Claude Opus 4.8 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Muse Spark 1.1 (xhigh; Artificial Analysis independent run)

muse-spark-1-1-xhigh

31.8%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Muse Spark 1.1 individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

GPT-5.6 Luna (max; Artificial Analysis independent run)

gpt-5-6-luna-max

31.1%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

GPT-5.6 Luna individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

Gemini 3.6 Flash (high; Artificial Analysis independent run)

gemini-3-6-flash-high

29.9%

3Artificial Analysis tau3-Banking evaluation

Score input

independently-verified

Gemini 3.6 Flash individual evaluations ↗Observed 2026-08-27 · checked 2026-08-27

DeepSeek V4 Flash max as published by Upstage

deepseek-v4-flash-max

22.3%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Solar Open 2 250B (high)

solar-open2-250b-high

19.6%

bankingSolar Open 2 card English table

Score input

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

MiMo-V2.5 as published by Upstage

mimo-v2-5-solar-open2-unspecified

Solar Open 100B (Reasoning)

8.7%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Solar Open 100B as published by Upstage

solar-open-100b-reasoning-high

7.4%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Command A+ as published by Upstage

command-a-plus-solar-open2-unspecified

5.8%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

Mistral Medium 3.5 as published by Upstage

mistral-medium-3-5-high

5.8%

bankingSolar Open 2 card English table

Relative comparison · not standard direct

provider-reported

Solar Open 2 250B model card ↗Observed 2026-08-15 · checked 2026-08-15

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16; NVIDIA release evaluation; temperature=1.0; top_p=0.95

nemotron-3-5-lightning-30b-a3b-default

9.3%

3NVIDIA NeMo Gym / NeMo Evaluator SDK consistent release harness

Score input

provider-reported

NVIDIA Nemotron 3.5 Lightning 30B-A3B BF16 model card ↗Observed 2026-08-11 · checked 2026-08-12

Muse Glimmer-30B; high reasoning; temperature=1.0; top_p=0.95; top_k=64

muse-glimmer-30b-high

23.5%

3 / BankingArtificial Analysis τ³-Banking documented evaluation

Public reference · not scored

provider-reported

Muse Glimmer Evaluation Methodology ↗Observed 2026-08-10 · checked 2026-08-10

Artificial Analysis τ³-Banking independent evaluation.

source label without registered configuration ID

24.5%

3Artificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.6 Flash (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Artificial Analysis τ³-Banking independent evaluation.

source label without registered configuration ID

16.5%

3Artificial Analysis evaluation harness

Public reference · not scored

source-checked

Gemini 3.5 Flash-Lite (Artificial Analysis) ↗Observed 2026-07-21 · checked 2026-07-21

Kimi K3; Artificial Analysis τ³-Banking evaluation.

source label without registered configuration ID

33.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

Kimi K3 Intelligence, Performance & Price Analysis ↗Observed 2026-07-20 · checked 2026-07-21

Muse Spark 1.1 (xhigh); Artificial Analysis independent evaluation configuration as published.

muse-spark-1-1-xhigh

25.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

Muse Spark 1.1 (xhigh) analysis ↗Observed 2026-07-16 · checked 2026-07-16

GPT-5.6 Sol (max)

gpt-5-6-sol-max

33.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.5 (high)

source label without registered configuration ID

32.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Terra (max)

gpt-5-6-terra-max

31.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.5 (xhigh)

gpt-5-5-xhigh

31.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)

claude-sonnet-4-6-max

30.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 (xhigh)

gpt-5-4-xhigh

30.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.7 (Adaptive Reasoning, Max Effort)

claude-opus-4-7-max

28.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Sonnet 5 (Adaptive Reasoning, Max Effort)

claude-sonnet-5-max

28.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Opus 4.8 (Adaptive Reasoning, Max Effort)

claude-opus-4-8-max

27.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.6 Luna (max)

gpt-5-6-luna-max

27.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.2 (max)

glm-5-2-max

26.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)

claude-fable-5-max

26.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Pro (Reasoning, Max Effort)

deepseek-v4-pro-max

25.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.5 Flash (high)

gemini-3-5-flash-high

25.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark 1.1 (xhigh)

muse-spark-1-1-xhigh

25.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V4 Flash (Reasoning, Max Effort)

deepseek-v4-flash-max

22.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 mini (xhigh)

gpt-5-4-mini-xhigh

21.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.4 nano (xhigh)

gpt-5-4-nano-xhigh

21.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.6

source label without registered configuration ID

20.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Muse Spark

source label without registered configuration ID

19.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5 (high)

gpt-5-high

19.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Sonnet (Reasoning)

source label without registered configuration ID

19.0%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.2 (Reasoning)

source label without registered configuration ID

18.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.7 Code

source label without registered configuration ID

18.1%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Plus

source label without registered configuration ID

17.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3 Flash Preview (Reasoning)

source label without registered configuration ID

17.5%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Pro Preview

source label without registered configuration ID

16.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 Plus

source label without registered configuration ID

16.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

DeepSeek V3.1 Terminus (Reasoning)

source label without registered configuration ID

15.9%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.6 27B (Reasoning)

source label without registered configuration ID

15.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 31B (Reasoning)

source label without registered configuration ID

15.1%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Medium 3.5

source label without registered configuration ID

14.4%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Kimi K2.5 (Reasoning)

source label without registered configuration ID

14.2%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GPT-5.1 (high)

gpt-5-1-high

14.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nemotron 3 Ultra 550B A55B (Reasoning)

source label without registered configuration ID

13.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4 Sonnet (Reasoning)

source label without registered configuration ID

13.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 122B A10B (Reasoning)

source label without registered configuration ID

13.6%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.5 397B A17B (Reasoning)

source label without registered configuration ID

13.4%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M3

source label without registered configuration ID

13.0%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Grok 4.3 (high)

source label without registered configuration ID

12.2%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemma 4 26B A4B (Reasoning)

source label without registered configuration ID

11.8%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-5.1 (Reasoning)

source label without registered configuration ID

11.5%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Qwen3.7 Max

source label without registered configuration ID

10.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.6 (Reasoning)

source label without registered configuration ID

10.5%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

NVIDIA Nemotron 3 Super 120B A12B (Reasoning)

source label without registered configuration ID

10.1%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

GLM-4.7 (Reasoning)

source label without registered configuration ID

9.7%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 2.5 Pro

source label without registered configuration ID

9.3%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Claude 4.5 Haiku (Reasoning)

source label without registered configuration ID

9.1%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiniMax-M2.7

source label without registered configuration ID

8.9%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Gemini 3.1 Flash-Lite

source label without registered configuration ID

8.7%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5-Pro

source label without registered configuration ID

8.7%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Nova 2.0 Pro Preview (medium)

source label without registered configuration ID

7.6%

3Artificial Analysis independent evaluation

Score input

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

MiMo-V2.5

source label without registered configuration ID

6.6%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Large 3

source label without registered configuration ID

5.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Command A+

source label without registered configuration ID

5.8%

3Artificial Analysis independent evaluation

Public reference · not scored

source-checked

τ³-Banking Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Mistral Small 4 (Reasoning)

source label without registered configuration ID