(If you don't know, "AI" crawlers come to your site and download whatever they can get, aggressively, to collect training data for "AI" models. And they come in masses. Every "AI" startup has a swarm of these crawlers. The big "AI" companies do it themselves and outsource it to shady companies that are specialising on this. These crawlers often ignore robots.txt restrictions. They burn traffic like hell and they come back often.)