Hinted Scaling Laws

Hinted scaling laws address a flaw in downstream accuracy forecasting: small models score near zero on hard benchmarks, leaving no trend to extrapolate. Bailey, Kuditipudi, Ye, Band and colleagues at Stanford hint benchmarks with privileged information, such as partial worked solutions, to create easier variants where small models score above…