@monkeyben they'll still see the replies if they can find them. On mastodon, replies from people you follow aren't shown on the home timeline unless you also follow the person they're replying to.
But yes, it only filters specific things that are put into the filter. If I filter the word "the", I'll barely see anything but if I filter #the, it's different.