Conversation

Notices

1. Embed this notice
   Sick Sun (sun@shitposter.world)'s status on Saturday, 02-Nov-2024 08:20:40 JST Sick Sun
   I want to write my own Web spider I think for my own indexing of things I care about. I wonder if there's a good free one.
   • soberano likes this.
   • Embed this notice
     on-lain ✔ᵛᵉʳᶦᶠᶦᵉᵈ (lain@lain.com)'s status on Saturday, 02-Nov-2024 08:22:45 JST on-lain ✔ᵛᵉʳᶦᶠᶦᵉᵈ

     in reply to
     @sun *me, writing in my notebooks while you're on the couch* so you want to write your own system again... this seems to happen a lot. why don't you trust other peoples' code?
     Sick Sun likes this.
   • Embed this notice
     Sick Sun (sun@shitposter.world)'s status on Saturday, 02-Nov-2024 08:23:09 JST Sick Sun

     in reply to

     • on-lain ✔ᵛᵉʳᶦᶠᶦᵉᵈ
     @lain I'll run other people's code I just don't want to rely on a third party to store the data for me.
     on-lain ✔ᵛᵉʳᶦᶠᶦᵉᵈ likes this.
   • Embed this notice
     :blank: (i@declin.eu)'s status on Saturday, 02-Nov-2024 08:24:05 JST :blank:

     in reply to
     @sun https://www.cs.toronto.edu/~muuo/blog/build-yourself-a-mini-search-engine/
     Sick Sun likes this.
   • Embed this notice
     Sick Sun (sun@shitposter.world)'s status on Saturday, 02-Nov-2024 08:54:31 JST Sick Sun

     in reply to

     • :blank:
     @i Apache Nutch is exactly what I need, thanks!