I've been on a FediDB binge lately.
Some updates:
- New redesign is almost ready
- And it's going to be open source https://github.com/fedidb/fedidb-nuxt
- I made significant improvements to our crawler and robots.txt parsing (thanks again @dumpsterqueer)
- As a result, the stats have increased and we're now re-crawling robots.txt weekly