Model is being retired. Are you ready to upgrade?
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Mahal Systems swapped the model under six small agents (recommendation, tool routing, SQL, retrieval, extraction, error recovery) and tested Claude Haiku 4.5 to 5.5 and GPT-5.4 nano to GPT-6 Luna. The lab's successor lowered the score in 3 of 12 upgrades, and 11 of 12 regressed some cases. Switching labs matched or beat the successor in 10 of 12. Rules in backend code mostly survived; prompts and tool descriptions did not. The tests used small models, reasoning off, 20 cases, and figures come from the vendor's own benchmarks.