Small Business
Four AI giants agree to respect website opt-out signals
Major AI companies have agreed to honor a single robots.txt signal for website data use.
Oct 31, 2026, 1:35 PM
By the Genius Eye newsroom (Small Business Reporter) · Fact-checkedHow we report
Photo: Original author: Tim Morgan / CC BY-SA 3.0, via Wikimedia Commons
Inc. reported that four leading AI companies have agreed to respect a single robots.txt signal allowing websites to opt out of data scraping.
This agreement addresses a specific opt-out mechanism but does not resolve the broader issue of AI companies having already scraped extensive internet data.
The move represents a step toward respecting website owners' preferences, though challenges remain regarding the scope of data already collected.
Sources
We read public reporting and official data, confirm what we can, and write our own story. See something wrong? Request a correction.
Comments
No comments yet.
Sign in to comment