The story’s score and claims

Comments on No. 99 of 137 · Wincon · edition of Wednesday 4 November 2026

TIS-100 Bench: LLMs Push the Pareto Frontier in Programming Puzzle Games

Summary

A benchmark of 16 LLMs playing TIS-100, a programming puzzle game where solutions are scored on cycles, nodes, and instructions, found that top models like Opus 5.5 and GPT-6 Astra matched community records and found 133 new tradeoff points, with 18 beating a record outright.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules