@p @benis_redux @kirby @graf @sun >robots.txt is intended to avoid content being indexed
>The search engine exclusion standard doesn't apply.

how is your instance metadata search engine, that indexes /api/'s meant for clients, not fit for robots.txt exactly?

it's a weak attempt at signaling an opt out, but what other option do they have given that client compatibility would break if it were behind auth

you not caring is fair, but them not caring is fair too