The story’s score and claims

Comments on No. 37 of 110 · cameronmpalmer.com · edition of Thursday 29 October 2026

Are you paying for useless LLM prompts?

Summary

An experiment tested whether persona prompts (e.g., "You are an expert") affect accuracy, cost, and speed for LLMs answering 5,000 MMLU-Pro multiple-choice questions across four models. Accuracy was largely flat, but several models, notably Deepseek and Ling, used significantly more reasoning tokens with expert personas, raising cost and latency.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules