SWE-bench / SWE-bench
Organize software-engineering agent evaluation around real repository issues.
- Repository stars
- 6,133All-time #9,606
- Fork
- 1,041
- Last push
- updated 1 months ago
- Repository created
- since 2023
About
Summarised by AI from the README; the original prevails
Prepare task data and predictions and run the documented Docker evaluation flow.
Use cases：For evaluating coding agents on real repository issues. Selection note: Scores from different subsets and evaluation conditions are not directly interchangeable.
Deployment：Prepare task data and predictions and run the documented Docker evaluation flow.
Check before adopting
- No pushes for over 6 months (last 2026-09-18); check whether it is maintained.
- Platform
- Not verified
- Pricing
- Pricing not verifiedCheck hosted-service, model and infrastructure costs for the option you choose.