Gisting
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Shopify engineering describes gisting, a method that compresses a long system prompt into a short run of learned "gist" token embeddings trained via knowledge distillation. Their GraphQL agent's prompt shrank from about 6,000 tokens to 1,500 with no loss in prediction quality.