@stefan that'd be pretty good. Make robots.txt configurable for every user. It can already be limited by path.