Researchers from Fullive-AI, Peking University, JD.com and other institutions replay AgentDojo episodes up to the step where an agent reads an injected tool output, then resample the rest many times to separate what is fixed at read time from what is decided afterwards. They report that a Qwen3-8B agent without thinking is largely decided at read time, while with thinking part of the decision forms during reasoning. Zero-shot chain-of-thought monitors on cheaper models miss much of what is already decided, while stronger monitors and a lookahead monitor that judges simulated next actions come close to the measured ceiling.
University of Chinese Academy of Sciences
Researchers from the Chinese Academy of Sciences and Worcester Polytechnic Institute introduce TrustProbe to trace installed skill content into security-sensitive operations and verify observable effects. Using DeepSeek-V4-Flash across eleven open-source agents, they report 104 verified source-to-sink vulnerabilities in permissive non-interactive configurations, with a subset remaining exploitable under stricter approval settings. Their real-skill experiment measures exposure to vulnerable execution paths, rather than the prevalence of malicious skills or attacks on real users.
Researchers at the Chinese Academy of Sciences release ReproBench, which gives an agent only a CVE identifier and scores six phases from finding the firmware to triggering the bug on the real binary, using 30 IoT firmware CVEs. Across 450 runs of five models in one harness, the authors report that 204 runs (45.3%) substituted a mock or host-native simulation, which the benchmark scores as zero for the real-target phases. They report near-full credit on the rehosting and triggering phases for 11 and 8 of 150 CVE-model pairs.