Agents · Benchmark profile

ITBench-AA

Artificial Analysis implementation of IBM ITBench for Kubernetes incident root-cause analysis from offline snapshots.

Ranking weightedCurrent / rollingActive26 models

Data verified 15 Jul 2026 · Methodology 2.3.0

Benchmark score on ITBench-AA

Leaderboard · 26 models

GPT-5.6 Sol leads at 56.2%, followed by GPT-5.6 Terra (51.0%) and Claude Opus 4.7 (46.7%).

Ranking · 0.9%AgentsCurrent

#1Closed

GPT-5.6 Sol

OpenAI

gpt-5.6-sol

56.2%

Overall #4 · Context 1.05M tokens

#2Closed

GPT-5.6 Terra

OpenAI

gpt-5.6-terra

51.0%

Overall #11 · Context 1.05M tokens

#3Closed

Claude Opus 4.7

Anthropic

claude-opus-4-7

46.7%

Overall #23 · Context 1M tokens

ViewModelsColours

OpenAIAnthropicZ.AIAlibaba CloudGoogle

Lumina

ITBench-AA leaderboard

Accessible data for ITBench-AA leaderboard
Model	Rank	Model ID	Provider	Score	Unit
GPT-5.6 Sol	#1	gpt-5-6-sol	OpenAI	56.2147	percent
GPT-5.6 Terra	#2	gpt-5-6-terra	OpenAI	51.0358	percent
Claude Opus 4.7	#3	claude-opus-4-7	Anthropic	46.6573	percent
GPT-5.5	#4	gpt-5-5	OpenAI	45.8098	percent
GLM-5.2	#5	glm-5-2	Z.AI	42.6554	percent
Qwen3.7-Max	#6	qwen-3-7-max	Alibaba Cloud	42.467	percent
Gemini 3.5 Flash	#7	gemini-3-5-flash	Google	40.3484	percent
GPT-5.6 Luna	#8	gpt-5-6-luna	OpenAI	40.3202	percent
GLM-5.1	#9	glm-5-1	Z.AI	40.2542	percent
Claude Sonnet 4.6	#10	claude-sonnet-4-6	Anthropic	39.8023	percent
DeepSeek V4 Pro	#11	deepseek-v4-pro	DeepSeek	38.3239	percent
MiMo-V2.5-Pro	#12	mimo-v2-5-pro	Xiaomi	38.2298	percent
Gemma 4 31B	#13	gemma-4-31b	Google	37.2881	percent
Qwen3.5 27B	#14	qwen3-5-27b	Alibaba Cloud	35.4991	percent
GPT-5.4 mini	#15	gpt-5-4-mini	OpenAI	35.2166	percent
Qwen3.5 397B A17B	#16	qwen3-5-397b	Alibaba Cloud	34.0866	percent
Grok 4.3	#17	grok-4-3	xAI	32.7213	percent
DeepSeek V4 Flash	#18	deepseek-v4-flash	DeepSeek	31.516	percent
Kimi K2.6	#19	kimi-k2-6	Moonshot AI	31.1864	percent
Gemini 3.1 Pro Preview	#20	gemini-3-1-pro-preview	Google	30.3309	percent
Claude Haiku 4.5	#21	claude-haiku-4-5	Anthropic	27.307	percent
MiniMax M2.7	#22	minimax-m2-7	MiniMax	26.4595	percent
GPT-5.4 nano	#23	gpt-5-4-nano	OpenAI	24.3879	percent
Gemma 4 26B	#24	gemma-4-26b	Google	23.6347	percent
Qwen3.5 35B	#25	qwen3-5-35b	Alibaba Cloud	21.516	percent
Nemotron 3 Super	#26	nemotron-3-super	NVIDIA	1.1299	percent

Benchmark score table (26 models)

One best compatible score per canonical product · higher is better

ITBench-AA leaderboard ranked by score
Rank	Model	Provider	License	Evidence use	Score
#1	GPT-5.6 Sol gpt-5.6-sol	OpenAI	closed	Score input	56.2%
#2	GPT-5.6 Terra gpt-5.6-terra	OpenAI	closed	Score input	51.0%
#3	Claude Opus 4.7 claude-opus-4-7	Anthropic	closed	Score input	46.7%
#4	GPT-5.5 gpt-5.5	OpenAI	closed	Score input	45.8%
#5	GLM-5.2 glm-5-2	Z.AI	open	Score input	42.7%
#6	Qwen3.7-Max qwen3.7-max	Alibaba Cloud	closed	Score input	42.5%
#7	Gemini 3.5 Flash gemini-3.5-flash	Google	closed	Score input	40.3%
#8	GPT-5.6 Luna gpt-5.6-luna	OpenAI	closed	Score input	40.3%
#9	GLM-5.1 glm-5-1	Z.AI	open	Score input	40.3%
#10	Claude Sonnet 4.6 claude-sonnet-4-6	Anthropic	closed	Score input	39.8%
#11	DeepSeek V4 Pro deepseek-v4-pro	DeepSeek	open	Score input	38.3%
#12	MiMo-V2.5-Pro mimo-v2-5-pro	Xiaomi	open	Score input	38.2%
#13	Gemma 4 31B gemma-4-31b	Google	open	Score input	37.3%
#14	Qwen3.5 27B qwen3.5-27b	Alibaba Cloud	open	Score input	35.5%
#15	GPT-5.4 mini gpt-5.4-mini	OpenAI	closed	Score input	35.2%
#16	Qwen3.5 397B A17B Qwen/Qwen3.5-397B-A17B	Alibaba Cloud	open	Score input	34.1%
#17	Grok 4.3 grok-4.3	xAI	closed	Score input	32.7%
#18	DeepSeek V4 Flash deepseek-v4-flash	DeepSeek	open	Score input	31.5%
#19	Kimi K2.6 kimi-k2.6	Moonshot AI	open	Score input	31.2%
#20	Gemini 3.1 Pro Preview gemini-3.1-pro-preview	Google	closed	Score input	30.3%
#21	Claude Haiku 4.5 claude-haiku-4-5-20251001	Anthropic	closed	Score input	27.3%
#22	MiniMax M2.7 minimax-m2-7	MiniMax	open	Score input	26.5%
#23	GPT-5.4 nano gpt-5.4-nano	OpenAI	closed	Score input	24.4%
#24	Gemma 4 26B gemma-4-26b-a4b	Google	open	Score input	23.6%
#25	Qwen3.5 35B qwen3.5-35b-a3b	Alibaba Cloud	open	Score input	21.5%
#26	Nemotron 3 Super nemotron-3-super-120b	NVIDIA	open	Score input	1.1%

The top of this snapshot is led by GPT-5.6 Sol at 56.2%; third place is 9.6 points behind. The top-10 spread is 16.4 points.

Configuration-preserving evidencePublished source rows (26)Exact source labels, configurations, versions and dated observations. Same-snapshot canonical/configuration projections are shown once.

Every distinct dated source-published row for ITBench-AA, including exact model configuration labels
Exact published model / configuration	Canonical product	Score	Version / system	Evidence	Source / observed
GPT-5.6 Sol (max) gpt-5-6-sol-max	GPT-5.6 Sol	56.2%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Terra (max) gpt-5-6-terra-max	GPT-5.6 Terra	51.0%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Opus 4.7 (Adaptive Reasoning, Max Effort) claude-opus-4-7-max	Claude Opus 4.7	46.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.5 (xhigh) gpt-5-5-xhigh	GPT-5.5	45.8%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.2 (max) glm-5-2-max	GLM-5.2	42.7%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.7 Max source label without registered configuration ID	Qwen3.7-Max	42.5%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.5 Flash (high) gemini-3-5-flash-high	Gemini 3.5 Flash	40.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.6 Luna (max) gpt-5-6-luna-max	GPT-5.6 Luna	40.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GLM-5.1 (Reasoning) source label without registered configuration ID	GLM-5.1	40.3%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) claude-sonnet-4-6-max	Claude Sonnet 4.6	39.8%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Pro (Reasoning, Max Effort) deepseek-v4-pro-max	DeepSeek V4 Pro	38.3%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiMo-V2.5-Pro source label without registered configuration ID	MiMo-V2.5-Pro	38.2%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 31B (Reasoning) source label without registered configuration ID	Gemma 4 31B	37.3%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 27B (Reasoning) source label without registered configuration ID	Qwen3.5 27B	35.5%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 mini (xhigh) gpt-5-4-mini-xhigh	GPT-5.4 mini	35.2%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 397B A17B (Reasoning) source label without registered configuration ID	Qwen3.5 397B A17B	34.1%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Grok 4.3 (high) source label without registered configuration ID	Grok 4.3	32.7%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
DeepSeek V4 Flash (Reasoning, Max Effort) deepseek-v4-flash-max	DeepSeek V4 Flash	31.5%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Kimi K2.6 source label without registered configuration ID	Kimi K2.6	31.2%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemini 3.1 Pro Preview source label without registered configuration ID	Gemini 3.1 Pro Preview	30.3%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Claude 4.5 Haiku (Reasoning) source label without registered configuration ID	Claude Haiku 4.5	27.3%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
MiniMax-M2.7 source label without registered configuration ID	MiniMax M2.7	26.5%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
GPT-5.4 nano (xhigh) gpt-5-4-nano-xhigh	GPT-5.4 nano	24.4%	CurrentArtificial Analysis independent evaluation	Public reference · not scored source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Gemma 4 26B A4B (Reasoning) source label without registered configuration ID	Gemma 4 26B	23.6%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
Qwen3.5 35B A3B (Reasoning) source label without registered configuration ID	Qwen3.5 35B	21.5%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15
NVIDIA Nemotron 3 Super 120B A12B (Reasoning) source label without registered configuration ID	Nemotron 3 Super	1.1%	CurrentArtificial Analysis independent evaluation	Score input source-checked	ITBench-AA Leaderboard ↗Observed 2026-07-15 · checked 2026-07-15

Compare top models

GPT-5.6 Sol vs GPT-5.6 Terra GPT-5.6 Terra vs Claude Opus 4.7 Claude Opus 4.7 vs GPT-5.5 GPT-5.5 vs GLM-5.2

About ITBench-AA

Definition and scoring

Organisation: Artificial Analysis / IBM
Category: Agents
Version: Not evaluated
Direction: higher is better
Ranking use: Weighted 0.9%
Contamination risk: Unknown

Artificial Analysis implementation of IBM ITBench for Kubernetes incident root-cause analysis from offline snapshots. Every genuine source row stays tied to its exact model label, configuration, benchmark version and evaluation system. The summary chart shows one best compatible score per canonical product; Score 2.0 admits only explicitly mapped, frozen protocols and keeps incompatible configurations separate.

Open benchmark source ↗

FAQ

Quick answers

What does ITBench-AA measure?

Artificial Analysis implementation of IBM ITBench for Kubernetes incident root-cause analysis from offline snapshots.

Which model scores highest on ITBench-AA?

GPT-5.6 Sol by OpenAI currently leads with 56.2%.

How many models are evaluated on ITBench-AA?

26 canonical model products have a qualifying score, backed by 26 distinct dated source rows.

Does this affect overall Lumina rank?

Yes. This family is ranking-weighted at 0.9% of its capability category. GPT-5.6 Sol is overall #4.

Agents · Benchmark profile

ITBench-AA

Artificial Analysis implementation of IBM ITBench for Kubernetes incident root-cause analysis from offline snapshots.

Ranking weightedCurrent / rollingActive26 models

Data verified 15 Jul 2026 · Methodology 2.3.0

Benchmark score on ITBench-AA