Chronicle/Defense & research

UK AISI and Redwood release ControlArena library for AI control experiments

DefenseTool releaseSignificance assistant-drafted

The UK AI Security Institute, with Redwood Research, releases ControlArena, an open-source library built on Inspect for running AI control experiments. It bundles settings from simple programming problems to infrastructure-as-code codebases, attack policies, monitors and protocols such as trusted editing and defer-to-trusted, and AISI says researchers at Anthropic, Google DeepMind and Redwood have used it.

Why it matters

It standardizes testbeds for measuring whether monitors and protocols stop an agent pursuing covert harmful side tasks.

Key facts

As stated in the sources, with where to find them.

  • Includes monitors that score suspicion, trusted editing, defer-to-trusted micro-protocols and macro-protocols across tasks.Blog, protocols section

Findings that cite this record

No tracked finding cites this record yet.

Key questions this bears on

Sources

Related records