CyberSOCEval

Benchmarks for malware analysis and threat-intelligence reasoning in security operations.

Records citing CyberSOCEval

Sep 24, 2025

Meta and CrowdStrike release CyberSOCEval benchmarks for malware analysis and threat intel reasoning

DefenseBenchmarkMeta, CrowdStrike

CyberSOCEval adds two open-source SOC benchmarks to CyberSecEval 4: malware analysis questions built from sandbox detonation reports, and threat intelligence reasoning over unstructured reports. The authors find larger, newer models do better, reasoning models gain less than in coding and math, and current models are far from saturating the tasks.