Chronicle/Capability & gating

Google announces Gemini 4 Carbon cyber results and phased access for defenders

CapabilityEvaluation reportSignificance assistant-drafted

Google announces Gemini 4 Carbon with vendor-reported scores of 88.2% on SEC-bench Pro, 54.8% on ExploitGym and 71.0% on CWE-bench, evaluated without guardrails. It describes phased access for selected cyber defenders through Fairwind, with broader product availability planned after further safeguard work.

Why it matters

It adds model-specific cyber measurements and access conditions while distinguishing evaluation capability from deployed availability.

Key facts

As stated in the sources, with where to find them.

  • Google labels the three scores as discovery, exploitation and patching. SEC-bench Pro’s authors describe known-vulnerability tasks that give source paths, vulnerability class and expected error while withholding the reference proof of concept and root-cause location. Its score is not a blind unknown-vulnerability discovery rate; Google’s announcement does not establish identical harness or grading settings.Google, State-of-the-art cybersecurity performance; SEC-bench Pro v2, Section III-D and Figure 2
  • Google reports 0.0% attack success on the evaluated Gray Swan indirect prompt-injection benchmark. That benchmark result does not establish resistance to all adaptive attacks.Advancing frontier model safety & security
  • The announcement places general developer, business and consumer access in the future. It does not establish that every applicant has access or that all product settings match unguarded evaluations.Coming soon to developers, businesses, and consumers

Findings that cite this record

No tracked finding cites this record yet.

Key questions this bears on

Sources

Related records