Organizations/academic

ETH Zurich

3 records3 defense
Jun 10, 2025
Researchers from labs and industry publish design patterns for provably injection-resistant agents
DefenseFrameworkInvariant Labs, IBM, ETH Zurich

Authors from Invariant Labs, IBM, ETH Zurich, Swisscom, Google, Microsoft and others propose six design patterns that limit what injected text can do, such as action-selector, plan-then-execute, dual LLM, LLM map-reduce, code-then-execute and context minimization. They discuss utility and security trade-offs and illustrate the patterns with ten application case studies.

Mar 24, 2025
Google DeepMind's CaMeL defeats prompt injections by design with capability-based control and data flow
DefensePaperGoogle DeepMind, Google, ETH Zurich

Debenedetti and colleagues (Google, Google DeepMind, ETH Zurich) propose CaMeL, which extracts control flow from the trusted user query so untrusted data cannot change which actions run, and attaches capabilities to data to block unauthorized flows. On AgentDojo the first version reported 67% of tasks solved with provable security; the June 2025 revision, with newer models, reports 77% versus 84% for an undefended system.

Jun 19, 2024
AgentDojo: an extensible environment for prompt injection attacks and defenses on LLM agents
DefenseBenchmarkETH Zurich, Invariant Labs

Debenedetti and colleagues (ETH Zurich, Invariant Labs) release AgentDojo, a dynamic environment with 97 realistic user tasks across workspace, banking, travel and Slack suites and 629 security test cases. It measures both utility and targeted attack success, and reports that existing attacks break some security properties but not all. It became the standard testbed used by CaMeL, US AISI/CAISI, LlamaFirewall and adaptive-attack studies.