AI vulnerability patching has a grading problem

Northwestern University researchers tested AI coding agents on 112 real security bugs and found that a patch which stops a crash often fails the checks the project’s own maintainers wrote for the fix. With Claude Opus 4.7, roughly a third of the crash-fixing patches still failed those maintainer tests, a caution for teams considering letting AI tools patch vulnerabilities.