Anthropic · deprecated
Claude 3.5 Sonnet is a proprietary model variant recorded in the BenchLM public dataset.
Specialist evidence
Source-native operational evidence for Claude 3.5 Sonnet. Exact configurations remain separate. Costs are comparable only within the same selected benchmark/evaluation, and these rows never enter Overall Score.
| Evaluation | Exact configuration | Performance | Cost / task | Tokens / task | Execution |
|---|---|---|---|---|---|
| SWE-bench Owner Leaderboards · owner-current · lite SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 SWE-agent + Claude 3.5 Sonnet | 23.0% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · lite SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 Moatless Tools + Claude 3.5 Sonnet | 26.7% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · lite SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 Moatless Tools + Claude 3.5 Sonnet (20241022) | 38.3% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · lite SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 Moatless Tools + Claude 3.5 Sonnet (20241022) | 39.0% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · multimodal SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 SWE-agent Multimodal + Claude 3.5 Sonnet | 11.4% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · multimodal SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 Agentless + Claude 3.5 Sonnet | 6.2% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · multimodal SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 RAG + Claude 3.5 Sonnet | 5.0% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · multimodal SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 Agentless Lite + Claude-3.5 Sonnet | 25.3% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · test SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 SWE-agent + Claude 3.5 Sonnet | 18.1% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · verified SWE-bench Owner Leaderboards · checked 2026-08-29 | claude-3-5-sonnet-epoch-claude-3-5-sonnet-20240620 SWE-agent + Claude 3.5 Sonnet | 33.6% | — | — | — |
