SecAlign

Preference-optimization defense against prompt injection, later released as Meta SecAlign models.

Records citing SecAlign

Oct 27, 2026
Heads of Security reports improved prompt-injection resistance from learned attention gates on two open models
DefensePaperImperial College London

Shilov and colleagues introduce Heads of Security, learned attention gates separating trusted instructions from untrusted content, tested on GPT-OSS-20B and Llama-3.3-70B-Instruct. Their preprint reports improved robustness against adaptive attacks while preserving tested utility; the mechanism depends on externally supplied trust labels and is not an end-to-end authorization system.

Oct 7, 2024
SecAlign uses preference optimization to train LLMs against prompt injection
DefensePaperMeta, UC Berkeley

Chen and colleagues (UC Berkeley and Meta) train models with preference optimization to prefer responses that follow the legitimate instruction over those that follow injected instructions. In the ACM CCS 2025 version they report injection success rates below 10% even for attacks more sophisticated than those seen in training, with utility similar to the undefended model; the October 2024 first version reported GCG-based injection success on Mistral-7B falling from 56% to 2%.