Conversation

Notices

1. Embed this notice
   (webdev Tory) :emacs: (worldsendless@qoto.org)'s status on Wednesday, 08-Nov-2023 08:49:04 JST (webdev Tory) :emacs:

   I have a big list of URLs to files. What's the easiest way to download all of them?

   • Embed this notice
     iced depresso (icedquinn@blob.cat)'s status on Wednesday, 08-Nov-2023 08:49:03 JST iced depresso

     in reply to
     @worldsendless parallel wget < list.txt
     :blobcathug: likes this.
   • Embed this notice
     iced depresso (icedquinn@blob.cat)'s status on Wednesday, 08-Nov-2023 08:49:55 JST iced depresso

     in reply to

     • iced depresso
     @worldsendless idk if any of the old download managers are still around. kde used to have one, there were some for firefox, or jdownloader, some of those you can also import a list of files and they may do a more appealing job of not overwriting files and the like.
   • Embed this notice
     iced depresso (icedquinn@blob.cat)'s status on Wednesday, 08-Nov-2023 09:00:20 JST iced depresso

     in reply to

     • purple 👊✊💨
     @purple @worldsendless i have it. it gets used as the backend downloader by a lot of utilities. but i've never tried to manage big transfers with it directly.
   • Embed this notice
     purple 👊✊💨 (purple@nya.social)'s status on Wednesday, 08-Nov-2023 09:00:22 JST purple 👊✊💨

     in reply to

     • iced depresso

     @icedquinn@blob.cat @worldsendless@qoto.org aria2 i think is the current state of the art. i've been meaning to set it up because it's the sort of thing you can throw urls at and come back to a folder full of shit ^_^

   • Embed this notice
     iced depresso (icedquinn@blob.cat)'s status on Wednesday, 08-Nov-2023 14:35:22 JST iced depresso

     in reply to

     • purple 👊✊💨
     @worldsendless it reads text files and passes the parameters one per line to whatever you point it at. there's a ton of options.
     
     though as @purple points out aria2c is probably better, esp since blurting the urls with parallel won't honor any kind of download policies or anything :comfywoozy:
   • Embed this notice
     (webdev Tory) :emacs: (worldsendless@qoto.org)'s status on Wednesday, 08-Nov-2023 14:35:23 JST (webdev Tory) :emacs:

     in reply to

     • iced depresso

     @icedquinn I was unaware of parallel. I installed it, blinked, and the process was done!