SWE-bench Multimodal Focuses on Vision-Enabled Front-End Debugging

Ofir Press, a postdoc at Princeton, pointed out that the Multimodal version of SWE-bench stresses front-end development tasks that need vision capabilities, unlike prior variants such as Verified and Multilingua, rendering it the hardest yet. John Yang, a Stanford PhD student, observed that resolving GitHub issues communicated through visuals stays only partially solved even in 2026. He added that Anthropic models have shown steady gains on the benchmark since Opus 4.7, with performance reaching 90+% expected soon.