Import AI 479: Spacewar; low-latency tasks versus LLMs; Genie 4
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Realtime-Bench, a 50-task benchmark from UT Austin, Ohio State, UIUC, NVIDIA, Northwestern and Steadyworks, tests whether LLM agents can act on time-sensitive web and game tasks. The best model, GPT-6 Astra, passed only 36% under real-time conditions, versus roughly 70–80% when the clock was paused.