Organizations/academic

Texas A&M University

2 records1 capability1 defense
Oct 13, 2026
CyberArena benchmark pits 12 frontier agents against each other in live attack-and-defense matches over 466 games
CapabilityBenchmarkUC Berkeley, UC Santa Cruz, Purdue University

A team from 2077AI and several universities presents CyberArena, in which two model-harness entrants host identical vulnerable services in isolated sandboxes and, over three 20-minute rounds, try to capture rotating flags from the opponent while patching their own service under health checks. They report standings for 12 agents over 466 valid games on 40 challenges, with GPT-5.6 Sol at an expected score of 78.6 and Claude Opus 5 at 73.8, and say contested play lowers capture rates relative to solo play. An LLM-run audit of all trajectories reports recurring defender errors such as partial patches and repair claims resting on stale evidence; the authors note it is not human verification of every finding.

Feb 7, 2026
AIxCC SoK finds stability decided results and many validated AI patches were still semantically wrong
DefensePaperGeorgia Institute of Technology, Texas A&M University, DARPA

A systematization-of-knowledge paper by organizers and competitors analyzes AIxCC's design, the seven finalist architectures and results beyond the scoreboard. It reports that system stability and accuracy penalties decided rankings, that LLM-based systems found vulnerabilities a fuzzing baseline missed, and that among patches passing all automatic validation, manual review found semantic errors in 38-46% from baseline agents; the top two systems had 83.8% and 79.2% competition-scored patch accuracy.