It appears that DPReview (owned by Amazon) is intentionally ignoring requests to let people archive the content.
It's bad enough they're shutting down with little notice, but why do they have to be dicks about it.
It appears that DPReview (owned by Amazon) is intentionally ignoring requests to let people archive the content.
It's bad enough they're shutting down with little notice, but why do they have to be dicks about it.
E.g. archive.org is limited to about 1 req/s other use rate limiting kicks in.
With literally millions of pages to archive, and the site shutting down on April 10, there’s not enough time.
If you work at Amazon, please ring the internal alarm bell. This is a resource that will be tragic to lose.
@NikaShilobod I'm not talking about downloading from archive.org
@thomasfuchs By default runs 5 threads, I have 5 instances running np.
https://github.com/john-corcoran/internetarchive-downloader
The Library of Alexandria is burning. This script works.
Directions (powershell):
1.) git clone https://github.com/john-corcoran/internetarchive-downloader
2.) cd "folder path"
3.) pip install -r requirements.txt
4.) my example script: python "X:\Downloads\internetarchive-downloader\ia_downloader.py" download -s "archaeology" -o "X:\downloads" -c email password
Run off your C:\ drive and point to external hardware if you need it.
@ZiggyTheHamster The information about 1req/s is literally from the people archiving on archive.org.
They do have plans to use their distributed archiver to bypass the limit but it's "ready in the beginning of April", which might not leave enough time.
@thomasfuchs the rate limit can be bypassed by someone like @textfiles.
Re: ringing the alarm bell… I am sure that is already happening. The question is whether VPs are hearing it and take some kind of action, and I don’t know they will. Hopefully they will.
@ZiggyTheHamster See https://old.reddit.com/r/photography/comments/11ya4fa/dpreview_is_being_archived_by_the_archive_team/ for more info on this
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.