AI auditors catch most agent misbehavior but flood reviewers with false alarms, new study finds
AI-generated summary A new study by Andy Hall examines how AI models can identify problematic behavior by other AI agents in logs but frequently flag harmless actions as suspicious. The research tested models including GPT-5, GPT-6 Astra, Opus 4.8, and Gemini 3.8 Flash using datasets from METR and Shanghai Jiao Tong University.