Officially corrected errors persist in AI training data
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Loxyn, a Lyon measurement group, reports that official corrections often fail to reach public AI training data. It says 1,989 of 2,082 testable EU act corrections (95.5%) remain uncorrected in EurlexResources, and about 12,200 retracted papers in peS2o mostly carry no retraction notice. Five models gave the erroneous version in 45% of committed answers; with dates and corrigendum labels, the four larger ones chose the correction in 99–100% of cases. The figures come from the authors' preregistered package, and the claim check could not verify them independently.