I also think there is a general trend of moving stuff off, and no longer publishing, information openly - both because it's increasingly expensive to do so outside of centralized silos (try spotting the difference between a ddos and a web crawl these days) and because of the general sense that the primary consumer of such information will be the same AI models that make up concepts and spew them at you during search.
So more and more public information is silo'd and unsearchable.