Embed Notice
HTML Code
Corresponding Notice
- Embed this notice
pistolero (p@fsebugoutzone.org)'s status on Friday, 04-Apr-2025 12:41:40 JST pistolero
@ignaloidas
> they had a bunch of problems with dumb llm scrapers
So have I. I've just kicked Amazon and Facebook and Claudebot out of Fedilist, FSE has gotten DDoS'd and scraped and whatnot, sometimes by companies that went to lengths to conceal the scraping, once by a guy that was renting a bucket of machines from a massive cluster UU owns, etc. Unlike SourceHut, FSE doesn't generate revenue, and I still managed to solve this problem without interstitial pages or draining anyone's battery. (I'm a professional.)
> Reportedly, they scraped every single git blame, for some fucking reason.
Yeah, they do this with cgit, too. I ran into it when Google was doing it, but since then, Amazon/Facebook/Claudebot/etc. have been through: https://fsebugoutzone.org/notice/AqxQDFgjbxsTzXAwFM . (Facebook uses a unique UA for its AI-scraper versus its general-purpose crawler.)