Conversation

Notices

1. Embed this notice
   Evan Prodromou (evan@cosocial.ca)'s status on Tuesday, 26-Mar-2024 03:20:34 JST Evan Prodromou

   in reply to

   • Tormod Halvorsen

   @airwhale yes, a way to enforce this would be to give an error message, like 403 Forbidden, if the client has an unpermitted user agent. I think the point of robots.txt is to inform well-behaved software not to waste resources requesting something it may not read nor post to.

   • Embed this notice
     Tormod Halvorsen (airwhale@mastodon.social)'s status on Tuesday, 26-Mar-2024 03:20:35 JST Tormod Halvorsen

     @evan

     Qualified No, because I'm not seeing the use case. When you deliver data using ActivityPub, it really should be a better option than using robots.txt IMHO. Any limitations should be contained in the ActivityPub message itself, right?