Public
- Public
- Network
- Groups
- Featured
- Popular
- People

Conversation

Notices

Embed this notice
Hugo Gameiro (hugo@masto.pt)'s status on Friday, 29-Sep-2023 17:52:46 JST Hugo Gameiro

Google finally announced https://blog.google/technology/ai/an-update-on-web-publisher-controls/ a robots.txt flag to opt out a website of their AI models without having to block the full Google crawler and have the website out of Google results.
In theory this should do it:
User-agent: Google-Extended
Disallow: /
In conversation Friday, 29-Sep-2023 17:52:46 JST from masto.pt permalink
Attachments
1. Domain not in remote thumbnail source whitelist: storage.googleapis.com
  
  An update on web publisher controls
  
  We’re announcing Google-Extended, a new control that web publishers can use to manage whether their sites help improve Bard and Vertex AI generative APIs, including future generations of models that power those products.
2. Untitled attachment

Feeds