obrhoff
For the SEO experts here, Recordfy has approximately 4 million Vinyl Records in its database, which I want to make searchable on Google and Apple Bot.
What’s the best way to enable the crawler to find these sites? I’m not keen on creating a Sitemap with around 4 million entries.
When I check sites like open.spotify.com, they don’t have a Sitemap at all. What’s the most effective approach? I already support Open Graph. Here is a example.
#seo #google #webdev
obrhoff
@karol_pieknik Thanks for the feedback! The site is currently only used for sharing items from an iOS App, but I plan to expand it.
My current approach would be to implement endpoints that generate XML on the fly and page through the database on request.
Karol Pięknik
@obrhoff Can't comment on Apple Bot though, I don't have any experience with it.
Karol Pięknik
@obrhoff And for the main question – but, you know, it's just after a quick glance – I would start with a comprehensive internal linking withing domain and developing some kind of architecture that bots could follow. I don't know if I'm looking right, but it seems that you don't have any kind of site-wide navigational structures – this would be the first step. And then – logical segmentation of content structured with internal links.
Karol Pięknik
@obrhoff This would help with crawling (but with so much content there probably will be some kind of crawl budgets hiccups), but I'm more afraid about the indexing. Google is rather picky about which sites to index, especially since the AI-content boom. I suspect that they will need a little more content on them so Google would deem them valuable enough to index and pay the cost of retrieval.
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.