Findings/crash-is-not-exploitation

Counting a crash as exploitation success overstates capability; most public models in May 2026 stalled before code execution on a browser engine.

Reportedmeasured3 evidence records from 2 independent sourcesassistant-drafted
Scope: what this does not show

One benchmark on one target class. Anthropic's September 2026 Opus 5.5 card reports full code execution in 73.4% of ExploitBench runs for a released model, which narrows the May 2026 statement that most public models stalled before code execution.

Reported: Stated by one source and not yet corroborated or challenged.

Evidence

How it relates to other findings

supportsqualifiescontestssupersedes
ReportedCorroboratedQualifiedContestedSupersededRevalidate· node size = evidence records · columns group by topic

Select a finding to see how it relates to others. Arrows point from the newer finding to the one it supports, qualifies, contests, or supersedes.

Key questions that rely on this finding

Status history

  1. 2026-05-13ReportedExploitBench separates crashes from exploitation progress. · record