Can AI agents do senior expert work? What the evidence says
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A new review of five recent studies, including OpenAI's GDPval, a field experiment with 758 BCG consultants, and a randomized trial of experienced developers, finds AI can match experts on some well-defined tasks but performs worse on open-ended judgment, and that users consistently overestimate how much it speeds them up.…