The story’s score and claims

Comments on No. 103 of 107 · Jack Clark (Import AI) · edition of Tuesday 3 November 2026

Import AI 479: Spacewar; low-latency tasks versus LLMs; Genie 4

Summary

Realtime-Bench, a 50-task benchmark from UT Austin, Ohio State, UIUC, NVIDIA, Northwestern and Steadyworks, tests whether LLM agents can act on time-sensitive web and game tasks. The best model, GPT-6 Astra, passed only 36% under real-time conditions, versus roughly 70–80% when the clock was paused.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules