Same model, different agent: 17 points apart on 21 MCP servers
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
SineFrame, maker of the open-source M3 MCP testing tool, ran Claude Haiku 5.5 through two coding agents against 21 MCP servers. OpenCode answered 82.0% of tasks from the server, Claude Code 65.4%. The gap sits on the ten servers that overlap built-in tools such as web search, where agents often answer without calling the server. On the other eleven, agents scored within about four points. For server builders, results depend on the agent used for testing. The figures are SineFrame's own and unverified; Codex also ran a different model.