Are you paying for useless LLM prompts?
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
An experiment tested whether persona prompts (e.g., "You are an expert") affect accuracy, cost, and speed for LLMs answering 5,000 MMLU-Pro multiple-choice questions across four models. Accuracy was largely flat, but several models, notably Deepseek and Ling, used significantly more reasoning tokens with expert personas, raising cost and latency.