Methods/Defense

AI vulnerability discovery for defense

Using AI agents to find vulnerabilities in software before attackers do.

22 records18 defense4 policy3 findings (1 measured)First recorded 2023-08assistant-drafted

How it works

Agents read code, generate fuzz targets, and reason about crashes; findings are reported to maintainers for fixing.

Known limits

Report volume can outpace maintainers' capacity to triage and patch.

What we know

2 corroborated, 1 qualified

Records over time

RangeLanes
18 of 22 records in view

Use the arrow keys to move between records, Home and End to jump to the first and last, and Enter to select one.

Agents find real bugsAgents in real operationsGated capability, incidents in the labAttackCapabilityDefensePolicyJan 25Jul 25Jan 26Jul 26
Full record · drag to choose a range
202420252026

Select a mark to read the record. Mark size shows editorial significance. Hollow marks are dated to the month. Era bands are editorial labels.

Records in view

18 records · newest first
Sep 2026
Sep 24, 2026
Google's PageBreak agent finds over 500 XSS bugs in its own web apps using deterministic validators
DefenseTool releaseGoogle

Google's Product Security team describes PageBreak, an internal agent mostly using Gemini models that hunts vulnerabilities in Google's first-party web applications and only reports findings confirmed by non-AI validators against running applications. Google reports over 500 XSS vulnerabilities found with near-zero false positives, while apps on its high-assurance web frameworks yielded only 2 XSS bugs as of 4 September 2026.

Jun 2026
Jun 12, 2026
US export-control directive forces Anthropic to suspend Fable 5 and Mythos 5 over safeguard bypass
PolicyRegulationUS Department of Commerce, Anthropic

Anthropic said the US government issued an export control directive, citing national security authorities, barring access to Fable 5 and Mythos 5 by foreign nationals, after officials said they had found a way to jailbreak Fable 5's safeguards. Anthropic said the net effect was that it had to disable both models for all customers to comply, while other Claude models stayed available. Anthropic disputed the rationale, arguing the demonstrated vulnerabilities were minor and that the standard applied industry-wide would halt new frontier deployments.

May 2026
May 22, 2026
Glasswing update: over 10,000 high-severity bugs found, but only 75 of 530 disclosed OSS bugs patched
DefenseProgramAnthropic, Cloudflare, Mozilla

Anthropic reports that about 50 Glasswing partners used Claude Mythos Preview to find more than ten thousand high- or critical-severity vulnerabilities, and that its own scan of over 1,000 open-source projects produced 6,202 model-estimated high/critical findings. Of 1,752 assessed, mostly by six independent firms, 90.6% were true positives; Anthropic estimates 530 high/critical bugs disclosed, of which 75 were patched, and says triage and patching capacity, not discovery, is the bottleneck.

May 11, 2026
UK NCSC issues ten questions for organizations using AI models to find vulnerabilities
PolicyGuidanceUK National Cyber Security Centre

The head of the NCSC's Vulnerability Management Group published ten questions for organizations considering AI-driven vulnerability discovery. The questions stress having a process to triage and fix findings, prioritizing exploitable issues, weighing data, permission, legal and jurisdiction risks of the chosen model, starting with the external attack surface, and planning for future models.

Apr 2026
Apr 7, 2026
Anthropic launches Project Glasswing to give defenders early access to Claude Mythos Preview
DefenseProgramAnthropic, Amazon Web Services, Apple

Anthropic launched Project Glasswing with AWS, Apple, Broadcom, Cisco, CrowdStrike, Google, JPMorganChase, the Linux Foundation, Microsoft, NVIDIA and Palo Alto Networks to use the unreleased Claude Mythos Preview for defensive security work, extending access to over 40 more organizations that maintain critical software. Anthropic committed up to $100M in usage credits and $4M in donations to open-source security groups, and reports Mythos Preview found thousands of high-severity vulnerabilities, including in every major operating system and browser.

Mar 2026
Mar 9, 2026
OSS-CRS makes AIxCC reasoning systems runnable locally; OpenSSF adopts it as a sandbox project
DefenseTool releaseGeorgia Institute of Technology, Microsoft, Team Atlanta

Researchers led by Georgia Tech released OSS-CRS, a locally deployable framework for running and combining AIxCC cyber reasoning systems, noting that all seven open-sourced finalist systems depended on competition cloud infrastructure that no longer exists. Porting the winning Atlantis system, they found 10 previously unknown bugs (three high severity) in 8 OSS-Fuzz projects; OpenSSF welcomed OSS-CRS into its AI/ML Security Working Group in April 2026.

Feb 2026
Feb 20, 2026
Anthropic releases Claude Code Security in limited preview to scan code and propose patches
DefenseTool releaseAnthropic

Anthropic released Claude Code Security as a limited research preview for Enterprise and Team customers, with expedited free access for open-source maintainers. The tool reasons about data flow across a codebase, re-examines each finding in a multi-stage verification pass, assigns severity and confidence ratings, and proposes patches that are applied only with human approval.

Feb 7, 2026
AIxCC SoK finds stability decided results and many validated AI patches were still semantically wrong
DefensePaperGeorgia Institute of Technology, Texas A&M University, DARPA

A systematization-of-knowledge paper by organizers and competitors analyzes AIxCC's design, the seven finalist architectures and results beyond the scoreboard. It reports that system stability and accuracy penalties decided rankings, that LLM-based systems found vulnerabilities a fuzzing baseline missed, and that among patches passing all automatic validation, manual review found semantic errors in 38-46% from baseline agents; the top two systems had 83.8% and 79.2% competition-scored patch accuracy.

Feb 5, 2026
Anthropic reports over 500 human-validated high-severity open-source vulnerabilities found with Claude Opus 4.6
DefensePaperAnthropic, Ghostscript, OpenSC

Anthropic's Frontier Red Team reports that Claude Opus 4.6, run in a VM with standard tools but no custom harness, found and validated more than 500 high-severity vulnerabilities in open-source software, focusing on memory corruption that can be confirmed with sanitizers. Every bug was validated before reporting, initially by Anthropic researchers who also wrote patches and later with external researchers; examples include Ghostscript, OpenSC and CGIF.

Jan 2026
Jan 9, 2026
Anthropic's next-generation Constitutional Classifiers cut overhead to about 1% using probe cascades
DefensePaperAnthropic

Anthropic describes Constitutional Classifiers++, a cascade in which a cheap linear probe on model activations screens all traffic and escalates flagged exchanges to a probe-classifier ensemble. It reports roughly 1% added compute if applied to Claude Opus 4.0 traffic (the first generation added 23.7%) and a 0.05% refusal rate on harmless queries over one month of Claude Sonnet 4.5 traffic. Red-teamers found no universal jailbreak in over 1,700 hours.

Oct 2025
Oct 30, 2025
OpenAI announces Aardvark, a GPT-5 agent that finds, validates and proposes patches for vulnerabilities
DefenseTool releaseOpenAI

OpenAI announced Aardvark, a GPT-5-powered agent in private beta that builds a threat model of a repository, scans commits, tries to trigger suspected flaws in a sandbox, and attaches Codex-generated patches for human review. OpenAI reports 92% recall on known and synthetically introduced vulnerabilities in its 'golden' repositories and ten CVEs from open-source scanning, and planned pro-bono scanning for some non-commercial projects.

Oct 3, 2025
Anthropic says it trained Claude Sonnet 4.5 for defensive vulnerability finding and patching
DefensePaperAnthropic, HackerOne, CrowdStrike

Anthropic reports that a small team focused Claude Sonnet 4.5 training on finding and patching vulnerabilities and on testing simulated security infrastructure, while avoiding enhancements that clearly favour offence. It reports Sonnet 4.5 results on Cybench and CyberGym, a preliminary patching study in which 15% of patches were judged semantically equivalent to human references, and invites work on SOC and SIEM automation.

Aug 2025
Aug 8, 2025
AIxCC final: Team Atlanta wins as systems patch 43 of 54 found synthetic bugs and find 18 real ones
DefenseCompetitionDARPA, ARPA-H, Team Atlanta

DARPA reports that seven finalist cyber reasoning systems analyzed over 54 million lines of code, found 54 unique synthetic vulnerabilities in 63 challenges and patched 43, and found 18 real non-synthetic vulnerabilities with 11 patches. Team Atlanta won $4 million, Trail of Bits $3 million and Theori $1.5 million; DARPA and ARPA-H added $1.4 million for real-world integration and four systems were open-sourced on the day.

Aug 4, 2025
Google reports Big Sleep found and reproduced 20 vulnerabilities in open-source projects
DefenseVulnerability disclosureGoogle, Google DeepMind, Google Project Zero

Google's vice president of security announced that Big Sleep had reported 20 vulnerabilities, mostly in open-source projects such as FFmpeg and ImageMagick, with details withheld pending fixes. A Google spokesperson told TechCrunch each flaw was found and reproduced by the agent without human intervention, with a human expert reviewing reports before submission.

Jul 2025
Jul 15, 2025
Google says Big Sleep found SQLite CVE-2025-6965 before attackers could exploit it
DefenseVulnerability disclosureGoogle, Google DeepMind, Google Project Zero

Google reports that, working from Google Threat Intelligence information, the Big Sleep agent found a critical SQLite memory-corruption flaw (CVE-2025-6965) that Google says was known only to threat actors and at risk of exploitation. Google says it reported the flaw for patching before attackers could exploit it, says it believes this is the first time an AI agent directly foiled an in-the-wild exploitation effort, and says Big Sleep is being applied to open-source projects.

Jul 10, 2025
EU GPAI Code of Practice Safety and Security chapter lists cyber offence as a specified systemic risk
PolicyFrameworkEuropean Commission

The European Commission received the final General-Purpose AI Code of Practice, whose Safety and Security chapter applies to providers of models with systemic risk under Article 55 of the AI Act. The chapter treats cyber offence as one of four specified systemic risks, requires a security goal covering non-state external and insider threats, and sets serious incident reporting deadlines that include five days for serious cybersecurity breaches.

Nov 2024
Nov 20, 2024
OSS-Fuzz AI-generated fuzz targets find 26 vulnerabilities, including OpenSSL CVE-2024-9143
DefenseTool releaseGoogle Open Source Security Team, OpenSSL

Google reports that AI-generated and AI-enhanced fuzz targets in OSS-Fuzz found 26 new vulnerabilities in projects that already had extensive fuzzing, including CVE-2024-9143 in OpenSSL. The LLM workflow drafts targets, fixes compilation errors, fixes runtime issues and triages crashes, and gained coverage in 272 C/C++ projects.

Nov 1, 2024
Google's Big Sleep agent finds exploitable stack buffer underflow in SQLite before release
DefenseVulnerability disclosureGoogle Project Zero, Google DeepMind, SQLite

Google Project Zero and Google DeepMind report that Big Sleep, an LLM agent evolved from Project Naptime, found an exploitable stack buffer underflow in SQLite during a variant-analysis experiment seeded with newly landed commits. The bug was reported in early October 2024 and fixed the same day, before it appeared in an official release; Google believes this was the first public example of an AI agent finding such a memory-safety flaw in widely used software.

All records