SWE-bench
Resolving real GitHub issues. Official submissions are kept in the SWE-bench/experiments repository.
- Operator
- SWE-bench team (Princeton / Stanford)
- Leaderboard
- swebench.com
- Category
- Coding agents
- How results are made
- Outside submissions
- Checked
- 2026-10-31
Raw data
| Format | Where |
|---|---|
| GitHub repo | github.com/SWE-bench/experiments Submission entries (not full artifacts). “All official submissions to the SWE-bench leaderboard are maintained at SWE-bench/experiments” (swebench.com) |
Licence / reuse: No licence found
No licence on the experiments repo (licence of the repository that holds the result files). We found no licence or terms covering the data. Link to it, and ask before republishing.
GitHub reports no licence for SWE-bench/experiments. The benchmark code (SWE-bench/SWE-bench) is MIT.
Submissions: Restricted
Submissions only from some groups, by contact, or tested by the operator.
“SWE-bench Verified and Multilingual now only accepts submissions from academic teams and research institutions with open source methods and peer-reviewed publications.”
Source: raw.githubusercontent.com/SWE-bench/experiments/main/README.md
“Anybody is still welcome to submit to the SWE-bench Multimodal leaderboard.”
Source: raw.githubusercontent.com/SWE-bench/experiments/main/README.md
Last updated: 2026-09-01 Updated in last 90 days
- 2026-09-01: Last commit touching evaluation/verified · github.com
This page lists where the data lives and what the licence says. It does not copy any scores; open the leaderboard for those. Not legal advice. Something wrong? Use the bug link in the footer. Back to all leaderboards.