Infinity: A runtime for extreme agent concurrency
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
AWS and UC Berkeley released Infinity, an Apache 2.0 research runtime from the Hydro project that treats each agent tool call as a suspension point, like a stackless coroutine. It saves the conversation and ends the process, then resumes when the result arrives on a queue. In AWS's single-thread benchmark with a simulated model, idle agents used about 100 KB each, so roughly 75,000 fit in a Raspberry Pi's 8 GB. The reference deployment uses SQS, Lambda, Aurora DSQL and DynamoDB. The figures are self-reported and unverified.