We spent $15k and benchmarked 5 DOCX-editing approaches on Harvey LAB
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Hrih News reports that a team spent about $15k benchmarking five approaches to editing Word .docx files on Harvey LAB, an open-source legal agent benchmark with 2,010 tasks, testing a 180-task sample of document-editing work.