⚡️The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals & Human Data
By Unknown
OpenAI's Frontier Evals team has officially discontinued SWE-Bench Verified, the leading coding benchmark, due to score saturation. They are endorsing SWE-Bench Pro as its successor. This signals that frontier models have effectively maxed out the benchmark.