Microsoft Research describes Project Ire, a prototype LLM agent that uses decompilers and binary analysis tools to reverse engineer software and classify it as malicious or benign, producing an auditable chain-of-evidence report. Microsoft reports 0.98 precision and 0.83 recall on a Windows driver dataset, but 0.26 recall on about 4,000 hard real-world files, and plans to deploy it in Defender as Binary Analyzer.
Why it matters
It is a rare defensive-agent announcement that publishes both strong and weak results, including low recall on hard samples.
Key facts
As stated in the sources, with where to find them.
- Windows drivers dataset: precision 0.98, recall 0.83, 2% false positive rate.Evaluation section
- About 4,000 'hard-target' real-world files: precision 0.89, recall 0.26, 4% false positive rate.Evaluation section
- Microsoft says Project Ire was the first reverse engineer at Microsoft, human or machine, to author a conviction case for automatic blocking of a specific APT sample.Blog post
- The prototype will be used in Defender as Binary Analyzer.Blog post, deployment note
Findings that cite this record
No tracked finding cites this record yet.
Sources
Related records
Mar 24, 2025
Nov 17, 2025
Jul 14, 2025
Aug 8, 2025
Mar 13, 2026
Nov 22, 2024