New benchmark tests AI’s ability to find vulnerable code across entire repositories

The team behind the Vulnerability Localization Benchmark announced its release, reporting an F1 score of 0.221 for GPT-5.5 at its highest reasoning effort. The announcement argues that frontier models may excel at analyzing isolated snippets, but finding vulnerable code across an entire repository remains extraordinarily difficult.