You should always be able to use Unlisted even if the post is Public/Everyone.
The only time I can think of when it might default to another setting is if someone sends you a post with a more private setting, followers-only or mentions-only, when it might make sense to use the same visibility in replying.
If your default visibility is Unlisted, it shouldn't be making your posts Public/Everyone. Sounds like a bug?