Conversation

Notices

1. Embed this notice
   Bø!rge (forteller@tutoteket.no)'s status on Thursday, 23-May-2024 19:25:11 JST Bø!rge

   Instead of everyone having to update their robots.txt all the fucking time, is it possible to just link in a trusted common robots.txt that can be kept up to date with the latest AI shit to block for everyone?

   • Embed this notice
     Bø!rge (forteller@tutoteket.no)'s status on Friday, 24-May-2024 00:35:42 JST Bø!rge

     in reply to

     • slembcke

     @slembcke Yeah, I know. Which makes it even less likely that too many people will bother updating their robots.txt regularly. I know I haven't even done it once. Which makes the idea of being able to have a common one that you can auto-import into your own even more important, I think.

   • Embed this notice
     slembcke (slembcke@mastodon.gamedev.place)'s status on Friday, 24-May-2024 00:35:43 JST slembcke

     in reply to

     @forteller How much faith do people have that the AI crawlers respect that anyway? It’s all on the honors system anyway. Like there’s no technical restriction, and no legal ones thought?