Conversation

Notices

1. Embed this notice
   The MILF Messiah (lunarised@whinge.town)'s status on Thursday, 19-Jun-2025 10:35:41 JST The MILF Messiah
   I don't get it! I had disallow all in my robots.txt file, HOW DID THEY SCRAPE MY SITE, I TOLD THEM NO
   
   I AM INCONSOLABE
   • Embed this notice
     Zergling_man (zergling_man@sacred.harpy.faith)'s status on Thursday, 19-Jun-2025 11:47:23 JST Zergling_man

     in reply to
     @lunarised I still think they should just put a macro on /bottrap/ or whatever that just returns a bunch of internal links at random and link that at the start of the homepage, then disallow it in robots.txt. Any compliant bot will avoid the trap, the rest can suffer.
     The MILF Messiah likes this.
   • Embed this notice
     The MILF Messiah (lunarised@whinge.town)'s status on Thursday, 19-Jun-2025 11:47:54 JST The MILF Messiah

     in reply to

     • Zergling_man
     @Zergling_man i don't check robots.txt myself... but based