Even as someone who mostly replies, I think these would be good features to have. If someone really only wants to talk to their followers or mutuals, I don’t want to be there. Giving people mod power over their replies appeals to me less.
Maybe until the feature is built folks could experiment with a hack, like start with # for followers only and ## for mutuals only? Some Twitter features started as hacks like that.