Reading all these articles about the high traffic from AI bots, here is my experience from a small German hoster: It's a huge problem, and it is getting worse very fast. There are bots like claudebot from Antrophic which are so aggressive that they block whole systems, outranking actual attacks for example against WordPress. And they change their AWS cloud IPs so often that blocking doesn't help for long and they also ignore robots.txt. Our on-call is regularly alerted for such issues.
Conversation
Notices
-
Embed this notice
Leah (Cloudstylistin) (leah@chaos.social)'s status on Tuesday, 30-Jul-2024 05:52:40 JST Leah (Cloudstylistin) - Minoru Saba repeated this.
-
Embed this notice
Leah (Cloudstylistin) (leah@chaos.social)'s status on Tuesday, 30-Jul-2024 21:36:26 JST Leah (Cloudstylistin) I would go so far to say that for small sites 30-50% of traffic is now artificial bot traffic. 20-75% for bigger sites with much content. It's a huge waste of resources they outsource to all of us in terms of money and environmental damage.
And this is part of the much bigger footprint all this AI shit has beside the irresponsible big amounts of resources they waste officially.