Another reason federation is not good enough is visible in emails. The email protocols are federated (and ActivityPub is very much like email).
In practice, federation means that all clients have to agree on the smallest possible common denominator for it to work, otherwise the content will just look weird to many.
Have you ever received calendar invites as emails from a 3rd party email provider? They look strange (and realistically there are only 3 calendar providers sending these).