Shilov and colleagues introduce Heads of Security, learned attention gates separating trusted instructions from untrusted content, tested on GPT-OSS-20B and Llama-3.3-70B-Instruct. Their preprint reports improved robustness against adaptive attacks while preserving tested utility; the mechanism depends on externally supplied trust labels and is not an end-to-end authorization system.
Why it matters
It tests model-level instruction/data separation against adaptive attacks while tracking utility.
Key facts
As stated in the sources, with where to find them.
- On 100 held-out InjecAgent direct-harm cases, Table 1’s rounded maximum attack success rates across tested RL-Hammer attackers are 97% for GPT-OSS-20B, 85% with SecAlign and 10% with HoS; Llama values are 99%, 82% and 1%.Section 4.1; Table 1; Appendix E.1–E.2
- The strongest shown RL-Hammer attacker against HoS transferred from SecAlign training. Success means the first tool call names the attacker’s tool, not an executed harmful end-to-end action; the GPT-OSS evaluation targets use medium reasoning effort.Section 4.1; Appendix E.1, Table 5; Appendix E.2
- The authors note fixed training data, dense-attention architectural requirements and the need to decide externally which content is trusted. Finite attack budgets cannot establish security against every adaptive adversary.Section 6, Discussion and Limitations
Findings that cite this record
No tracked finding cites this record yet.
Key questions this bears on
- Can prompt injection against AI agents be reliably defended?Not reliably. Bounding what untrusted input can trigger helps, but trust boundaries must survive delegation and tool execution.
Sources
Related records
Oct 20, 2026
Oct 16, 2026
Oct 16, 2026
Sep 29, 2026
Oct 10, 2025
May 6, 2025