Now SSB gets around this by only fetching messages from your followers and several degrees out from them, for instance. You don't receive all messages, but it's lossy, lossier than ActivityPub and "missing replies" by far, and you still receive *many* more messages than are relevant to you.
Of course the general approach taken by Bluesky is: "well, we aren't aiming for full self-hosting".