The story’s score and claims

Comments on No. 64 of 139 · blog.raed.dev · edition of Thursday 5 November 2026

Why is your AI using so many tokens?

Summary

AI chat apps look like they remember conversations, but the model sees only a single block of text rebuilt and resent in full on every turn. That block includes the system prompt, every tool definition, the full history and all tool results, so token use grows with each message and…

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules