Conversation

Notices

1. Embed this notice
   Dr. Lucky Tran :verified: (luckytran@med-mastodon.com)'s status on Monday, 03-Feb-2025 13:48:15 JST Dr. Lucky Tran :verified:

   in reply to

   Link: https://archive.org/details/20250128-cdc-datasets

   • Embed this notice
     Dr. Lucky Tran :verified: (luckytran@med-mastodon.com)'s status on Monday, 03-Feb-2025 13:48:16 JST Dr. Lucky Tran :verified:

     The entire archive of all CDC datasets uploaded before January 28th, 2025 has been backed up on Internet Archive.

     Incredible work everyone. Science will never be silenced!

   • Embed this notice
     Moritz Bartl (gamambel@social.tchncs.de)'s status on Monday, 03-Feb-2025 15:53:09 JST Moritz Bartl

     • Infoseepage

     @Infoseepage @luckytran As per comments on the IA page: Use https://archive.org/download/20250128-cdc-datasets/full-20250128-cdc-datasets-USETHIS.torrent instead of the IA auto generated one. That should be complete.

   • Embed this notice
     F4GRX Sébastien (f4grx@chaos.social)'s status on Monday, 03-Feb-2025 17:35:16 JST F4GRX Sébastien

     • Infoseepage

     @Infoseepage @luckytran oh come on.

   • Embed this notice
     James 🌈💜 (shaknais@mastodon.social)'s status on Monday, 03-Feb-2025 21:20:05 JST James 🌈💜

     in reply to

     • Infoseepage
     • Moritz Bartl

     @gamambel @Infoseepage @luckytran

     That's hitting a 500 error at the moment.
     Any chance you have the magnet link?

   • Embed this notice
     Ramin Honary (ramin_hal9001@fe.disroot.org)'s status on Monday, 03-Feb-2025 22:08:15 JST Ramin Honary

     • James 🌈💜
     • Infoseepage
     • Moritz Bartl

     Does anyone have a pkzipped or tar-[bgx]zipped torrent of the same data? The torrent file on Archive.org seems to be all uncompressed CSV data which makes it much heavier to share around than it should be.

     @Infoseepage @shaknais @gamambel @luckytran

   • Embed this notice
     Ramin Honary (ramin_hal9001@fe.disroot.org)'s status on Monday, 03-Feb-2025 22:39:45 JST Ramin Honary

     • James 🌈💜
     • Infoseepage
     • Moritz Bartl

     No joke. I just ran a test compressing the 100+ GB and it is compressing down to maybe 1/10th the size using 7z on the LZMA2 Ultra setting.

     @Infoseepage I believe it. CSV data is usually incredibly repetitive and can often compress down quite a lot.

     Maybe we should update the Internet Archive page for this dataset with the compressed files?

     @shaknais @luckytran @gamambel

   • Embed this notice
     Ramin Honary (ramin_hal9001@fe.disroot.org)'s status on Tuesday, 04-Feb-2025 01:53:41 JST Ramin Honary

     • James 🌈💜
     • Infoseepage
     • Moritz Bartl

     The box which has it isn’t exactly what I’d call fast, so still chugging away, but it’s a third of the way through and so far it is compressing to 5% of it’s unpack size.

     @Infoseepage thank you for doing the compression!

     @shaknais @luckytran @gamambel

   • Embed this notice
     James 🌈💜 (shaknais@mastodon.social)'s status on Tuesday, 04-Feb-2025 09:51:55 JST James 🌈💜

     • Infoseepage
     • Moritz Bartl
     • Ramin Honary

     @Infoseepage @ramin_hal9001 @luckytran @gamambel

     Torrent seems best for something like this.