Conversation

Notices

1. Embed this notice
   Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 07:01:57 JST Haelwenn /элвэн/ :triskell:

   • LisPi
   @mirabilos @lispi314 Same kind of deal with scrapping the webview of git repositories (ironically they seem to fail to scrape mine as it's not cgit, gitlab, forgjo, … meaning their stuff is forge-dependent already) instead of just using git as intended.
   • Embed this notice
     Phantasm (phnt@fluffytail.org)'s status on Tuesday, 20-May-2025 07:09:44 JST Phantasm

     in reply to

     • LisPi
     @lanodan @mirabilos @lispi314 I think they stopped trying since my gitea instance now barely gets a request every minute. Or nullrouting like hundred subnets did the trick.
     
     Either way it seems fine. For now.
   • Embed this notice
     Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 07:14:06 JST Haelwenn /элвэн/ :triskell:

     in reply to

     • Phantasm
     • LisPi

     @phnt @mirabilos @lispi314 Well… the only one I saw mass scrapping so far just did the equivalent of a wget --mirror that would try to fetch extra URLs. (And I didn't have any autoblocker yet)
     Luckily hacktivis.me is entirely static so it just happily used the available bandwidth for ~2 hours.

     Otherwise it's just search engines kind of scrap that just grab few pages here and there.

     Phantasm likes this.
   • Embed this notice
     Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 07:19:55 JST Haelwenn /элвэн/ :triskell:

     in reply to

     • Phantasm
     • LisPi
     @phnt @lispi314 @mirabilos And from time to time I grep for 404, and in the last months have seen the introduction of forge-specific URLs.
     Phantasm likes this.
   • Embed this notice
     Phantasm (phnt@fluffytail.org)'s status on Tuesday, 20-May-2025 07:26:32 JST Phantasm

     in reply to

     • LisPi
     @lanodan @mirabilos @lispi314 Btw did Pleroma Gitlab hold up without much issues? It was probably the most scraped project I have on my instance.
   • Embed this notice
     Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 07:27:03 JST Haelwenn /элвэн/ :triskell:

     in reply to

     • Phantasm
     • LisPi
     @phnt @mirabilos @lispi314 No idea, I don't admin it, feld somewhat does and has the contacts.
     Phantasm likes this.
   • Embed this notice
     LisPi (lispi314@udongein.xyz)'s status on Tuesday, 20-May-2025 07:27:33 JST LisPi

     in reply to

     • Phantasm
     @lanodan @mirabilos @phnt Using wget --mirror on others' services without --wait is impolite/abusive.
     Phantasm likes this.
   • Embed this notice
     Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 07:29:29 JST Haelwenn /элвэн/ :triskell:

     in reply to

     • Phantasm
     • LisPi

     @lispi314 @phnt @mirabilos And that's what these bots have been doing for the past months, over massive swarms of cloud and residential IP addresses, typically doing one request per IP.
     (I blame stuff like https://en.wikipedia.org/wiki/Hola_(VPN) )

   • Embed this notice
     Phantasm (phnt@fluffytail.org)'s status on Tuesday, 20-May-2025 07:35:38 JST Phantasm

     in reply to

     • LisPi
     @lanodan @mirabilos @lispi314 There were also some news recently about a mobile app framework you could use as a developer that turned phones into proxies without the user ever knowing. Can't remember the name of it though.
     Haelwenn /элвэн/ :triskell: likes this.
   • Embed this notice
     Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 07:39:13 JST Haelwenn /элвэн/ :triskell:

     in reply to

     • Phantasm
     • LisPi
     @phnt @mirabilos @lispi314 Yeah, makes me wish ISPs would start having anti-DDoS stuff on the user side of things.
     
     I think they will have to anyway because well… imagine having your IPv4 addresses so burned you can't access most websites due to the AI-scrapping botnets.
   • Embed this notice
     Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 07:49:42 JST Haelwenn /элвэн/ :triskell:

     in reply to

     • Phantasm
     • LisPi
     @lispi314 @phnt @mirabilos I don't think it's a monkey paw, it's the equivalent of saying "No, you cannot run an email server that's an open-relay".
     
     And services *exclusively* available via overlay networks are basically either toys for nerds, or are for criminals.
   • Embed this notice
     LisPi (lispi314@udongein.xyz)'s status on Tuesday, 20-May-2025 07:49:44 JST LisPi

     in reply to

     • Phantasm
     @lanodan @mirabilos @phnt > Yeah, makes me wish ISPs would start having anti-DDoS stuff on the user side of things.
     
     That's a monkey paw one. Don't.
     
     > imagine having your IPv4 addresses so burned you can't access most websites due to the AI-scrapping botnets.
     
     The clearnet has long outlived its usefulness as anything other than a routing layer for overlay networks. It has been unsafe and unfit for anything else for decades now.
   • Embed this notice
     Haelwenn /элвэн/ :triskell: (lanodan@queer.hacktivis.me)'s status on Tuesday, 20-May-2025 08:09:45 JST Haelwenn /элвэн/ :triskell:

     in reply to

     • Phantasm
     • LisPi
     @lispi314 @phnt @mirabilos There's been dogshit ISPs since at least AOL, I don't expect most people to have anything else than dogshit ISPs, even nerds end up with those from time to time.
     So no they won't act in good faith, because they already don't.
     
     re overlay network: I don't think arguing over technicalities there makes sense, they do work on a technical level. They do *not* work on a user level, like senators won't be using overlay networks, nor will TikTok zoomers.
   • Embed this notice
     LisPi (lispi314@udongein.xyz)'s status on Tuesday, 20-May-2025 08:09:46 JST LisPi

     in reply to

     • Phantasm
     @lanodan @mirabilos @phnt > I don't think it's a monkey paw, it's the equivalent of saying "No, you cannot run an email server that's an open-relay".
     
     Do you really expect ISPs to be reasonable about it? Or to act in good faith?
     
     > And services *exclusively* available via overlay networks are basically either toys for nerds, or are for criminals.
     
     Everything should be mostly or only available through those. Because of the middlebox problem it is /impossible/ to switch to a content-addressed model without those anyway. (It's also generally a bad idea to tie the hardware to a particular protocol/scheme.)
   • Embed this notice
     LisPi (lispi314@udongein.xyz)'s status on Tuesday, 20-May-2025 08:26:47 JST LisPi

     in reply to

     • Phantasm
     • LisPi
     @phnt @mirabilos @lanodan > Got to love anticompetitive practices.
     
     That was sarcasm, obviously. (I don't feel like opening up the client capable of edits atm)
     Haelwenn /элвэн/ :triskell: likes this.
   • Embed this notice
     LisPi (lispi314@udongein.xyz)'s status on Tuesday, 20-May-2025 08:26:48 JST LisPi

     in reply to

     • Phantasm
     @lanodan @mirabilos @phnt They can perfectly work on a user level and Veilid has shown a very simple way of ensuring that even for low technical literacy noobs.
     
     Simply build the support for it into the application/program (personally I much prefer pluggable transports but that's right back to noob-unfriendly). A lot of them already conflate "Facebook" (or whatever other brand app) with the Internet or don't understand they're all technically using the same network. So there's no user-facing change (to their understanding) there.
     
     Sure it's more efficient and provides much better anonymization opportunities to have something aware of the global communication state and managing it (Veilid does also support a daemon mode like I2P & Tor do), but it'll still work.
     
     > I don't expect most people to have anything else than dogshit ISPs, even nerds end up with those from time to time.
     
     Got to love anticompetitive practices.
     
     > So no they won't act in good faith, because they already don't.
     
     Indeed.