The story’s score and claims

Comments on No. 35 of 109 · vals.ai · edition of Friday 6 November 2026

How Much Does Reasoning Effort Affect Score and Cost?

Summary

Vals AI tested seven frontier models at their lowest, middle, and highest reasoning settings across eight benchmarks in its Vals Index. Lowering reasoning effort cut cost far more than score: four models kept at least 80% of their score at half the cost or less.

Comments

Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules