On a related note, I am pleased to report that in the many weeks since I opened wide the robots.txt for https://wookieepedia.org, bots for both Amazon and Anthropic have been slurping up its unbounded-for-practical-purposes page graph at high speed basically 24/7.