Unfortunately the #OpenStreetMap wiki is very slow today. We are fighting an aggressive web scraper bot. 10,000 of IPs involved. Randomised User-Agent. Ignoring robots.txt #aibot #ddos
Conversation
Notices
-
Embed this notice
OpenStreetMap Ops Team (osm_tech@en.osm.town)'s status on Thursday, 29-May-2025 22:59:56 JST
OpenStreetMap Ops Team
- Haelwenn /элвэн/ :triskell: likes this.
-
Embed this notice
OpenStreetMap Ops Team (osm_tech@en.osm.town)'s status on Friday, 30-May-2025 10:55:40 JST
OpenStreetMap Ops Team
@mvexel This is a whole new level of abuse we're seeing. 32,000+ IPv4 /24 ranges now blocked. Requests being proxied via 2 million+ unique IP addresses. Server ranges and home users. Annoyingly anonymous.
Haelwenn /элвэн/ :triskell: likes this. -
Embed this notice
Martijn van Exel (mvexel@en.osm.town)'s status on Friday, 30-May-2025 10:55:42 JST
Martijn van Exel
@osm_tech I'm going to resist the urge to say something really unpleasant but I will say this.
It's the open internet that suffers from the VC-backed LLM / AI bubble. They could *not* care less.
"If you think these crawlers respect robots.txt then you are several assumptions of good faith removed from reality." - Drew DeVault, https://drewdevault.com/2025/03/17/2025-03-17-Stop-externalizing-your-costs-on-me.html