Why we no longer evaluate SWE-bench Verified
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.
📰 Original Source
Read full article at Openai →KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.