@benis_redux @i @graf @kirby @sun It's retarded. It is not how robots.txt works.

Here's the draft of the blog post; I hoped it would clarify things. The only reason I haven't published it yet is that it included links to the "FSE Meets the FBI" article, which I have not published yet. (That one will take some work to finish up; the current draft has some events going in the wrong order, I have to correct them, so it is about 4k words.) This is a draft so I might change some of it, and there are some links missing, and my markdown format is idiosyncratic because it is half Ward's Wiki and half RedCloth.
about-fedilist