The biggest names in AI are backing a new way to opt out of scraping
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
OpenAI, Google, Microsoft, and Anthropic have committed to honoring a shared "policy token" signal, proposed by Anthropic's Kevin Kelley through the IETF, that lets publishers set AI training preferences once in robots.txt rather than separately for each company.