Opting Out Is the Easy Part: What the New robots.txt Signal Does and Doesn't Protect
Google, OpenAI, Microsoft and Anthropic now back one robots.txt line that says 'don't train on this'. It covers the least valuable use of your content. Here is where the value has moved in an agentic web, and what companies should do to protect and charge for it.
8 min read