TIS-100 Bench: LLMs Push the Pareto Frontier in Programming Puzzle Games
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
A benchmark of 16 LLMs playing TIS-100, a programming puzzle game where solutions are scored on cycles, nodes, and instructions, found that top models like Opus 5.5 and GPT-6 Astra matched community records and found 133 new tradeoff points, with 18 beating a record outright.