AI training: A robots.txt entry will soon be enough for all bots
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
Google plans to honor a shared AI-training opt-out token in robots.txt starting in 2027, so site operators can block AI training across providers with one entry instead of per-crawler rules.