Benchmark for Proactive Agents
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Deepnote released an Agent Initiative Benchmark testing 12 frontier models on 50 simulated workplace situations, scoring when an AI agent should proactively speak up in a synthetic company, PageMantle, with CRM, billing, analytics, and Slack data. It finds OpenAI's GPT-6 Astra leading on quality, while price and quality diverge sharply.