How Well Do Agents Perform on DevOps Tasks?
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
CloudOpsBench is a new benchmark of 45 AWS DevOps tasks, such as repairing failures, migrating services, rotating keys, and decommissioning projects, designed to run identically in real AWS and a high-fidelity emulator.