E.g. archive.org is limited to about 1 req/s other use rate limiting kicks in.
With literally millions of pages to archive, and the site shutting down on April 10, there’s not enough time.
If you work at Amazon, please ring the internal alarm bell. This is a resource that will be tragic to lose.