Something that should theoretically be possible is maintaining separate collections of actors to address content to, and software should be able to handle that.
e.g., followers is a collection intrinsically managed by the protocol: Accept(Follow) adds that actor to the collection for your followers. (All follows on the fediverse are really follow requests, no matter what)