@tisha yes, but then if you don't have Authorized Fetch on the instance level, they can still see and interact with your posts and you wouldn't be able to know.
Also, you'd be able to see others mention them if they're popular enough, which might not be an issue.
I personally block, then suspend. That takes care of both issues.