I worry not because Cloudflare is wrong to take this stance, but because for years they’ve done a mediocre job of differentiating RSS crawlers from AI scrapers, and the difference matters. (Just ask @johnbrayton what it can mean to a small business that tries very hard to support the open web.)
Conversation
Notices
-
Embed this notice
Joe Fabisevich :verified: (mergesort@macaw.social)'s status on Friday, 04-Jul-2025 08:05:49 JST
Joe Fabisevich :verified:
-
Embed this notice
Joe Fabisevich :verified: (mergesort@macaw.social)'s status on Friday, 04-Jul-2025 08:05:50 JST
Joe Fabisevich :verified:
Really hoping for the sake of @plinky.app that this new opt-into scraping default doesn’t mean small well-intentioned scrapers like mine don’t suddenly stop working. 😬 https://arstechnica.com/tech-policy/2025/07/pay-up-or-stop-scraping-cloudflare-program-charges-bots-for-each-crawl
Tim Chambers repeated this.
-
Embed this notice