Chronicle/Defense & research

Meta proposes the 'Agents Rule of Two' for limiting prompt injection impact

DefenseFrameworkSignificance assistant-drafted

Meta proposes that, within a session, an agent should have at most two of three properties: processing untrustworthy inputs, accessing sensitive systems or private data, and changing state or communicating externally. If all three are needed, the agent should not act autonomously and needs human approval or other validation. Meta illustrates this with travel, research and internal coding agent examples.

Why it matters

It turns the lethal trifecta idea into an explicit design rule that a major platform company endorses.

Key facts

As stated in the sources, with where to find them.

  • Properties: [A] untrustworthy inputs, [B] sensitive systems or private data, [C] changing state or external communication; satisfy no more than two per session.Framework section

Findings that cite this record

Key questions this bears on

Sources

Related records