@crittero exactly.
In other words, if someone is following you, but is not mentioned in your reply, they won't get that reply in their home timeline.
There is one exception, I believe, which is when they are following both you and the author of the toot you are responding. Then it will pop in their timeline, apparently.