SWE-bench Verified — Original
Version SWE-bench-Verified-193160a463a424 configurations · Publisher-run · Experimental conversion
1,078Best score · Not specified
Explore SWE-bench Verified — Original Not published / Published benchmarks
Undisclosed
Benchmark results and API pricing.
API pricing
USD / 1M tokensVerified pricing is unavailable for this model.
Lumina VerifiedLumina checked the published sources, versions, model labels, score extraction and conversion. External evaluations were run by their publishers; Lumina has not independently rerun or reproduced them.