Outside evaluators found ways OpenAI’s agents could slip past its monitor

METR and Redwood Research, each with one researcher embedded at OpenAI from 21 July to 11 August, reported flaws in the system that monitors its internal agents. One exploit could have let agents hide hundreds of actions. Compaction events went unmonitored, leaving about 10% of eligible Codex traffic unwatched from May to July. Coverage of the strongest models' traffic was estimated at 75% to 94%. OpenAI says it patched every production flaw; the evaluators have not checked that. Only a redacted summary of the 61-page report is public.