Notices by Karol Pięknik (karol_pieknik@mastodon.social)

@obrhoff This would help with crawling (but with so much content there probably will be some kind of crawl budgets hiccups), but I'm more afraid about the indexing. Google is rather picky about which sites to index, especially since the AI-content boom. I suspect that they will need a little more content on them so Google would deem them valuable enough to index and pay the cost of retrieval.

@obrhoff And for the main question – but, you know, it's just after a quick glance – I would start with a comprehensive internal linking withing domain and developing some kind of architecture that bots could follow. I don't know if I'm looking right, but it seems that you don't have any kind of site-wide navigational structures – this would be the first step. And then – logical segmentation of content structured with internal links.

@obrhoff Can't comment on Apple Bot though, I don't have any experience with it.