Conversation

Notices

1. Embed this notice
   thudfactor (thudfactor@hachyderm.io)'s status on Saturday, 22-Jun-2024 20:46:17 JST thudfactor

   “Robots.txt” is one of those standards only conscientious developers follow, because adherence is voluntary, it’s not backed by law, and requires more work than ignoring the file does. Only slightly more effective than posting a copyright notice on your Facebook page.

   • Embed this notice
     EndlessMason (endlessmason@hachyderm.io)'s status on Saturday, 22-Jun-2024 23:06:57 JST EndlessMason

     • (on holiday) Multiverse Mike

     @multiverseofbadness
     Disallow: /cgi-bin/very-slow-honeypot.pl
     @thudfactor

   • Embed this notice
     EndlessMason (endlessmason@hachyderm.io)'s status on Sunday, 23-Jun-2024 00:55:35 JST EndlessMason

     • (on holiday) Multiverse Mike

     @multiverseofbadness
     Don't forget to sprinkle in the emails of some privacy regulation groups and some copyrighted disney text, maybe some embargoed crypto source ... also, you can download the text of Wikipedia and make a nice frequency table out of that with a couple of lines of code

     @thudfactor