SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Benchmark that tests whether an LLM can take a real GitHub issue and a full repository and produce a passing code change. Went from 2% solve rate in 2023 to 70%+ by 2025 -- the clearest quantitative record of agentic coding progress we have.
Carlos E. Jimenez, John Yang, Alexander Wettig, et al.

