Sometimes people stare and I do the "primate who dares you to say something so they can let off some steam" stare-back and they turn away quickly.
I will say that I can't imagine being visibly disabled or genderqueer-presenting or a person of color wearing a mask in most of the US. Anti-maskers are universally bullies, and bullies are drawn to vulnerability like flies are to carrion.
Pro-mask is anti-Trump is something I need to see more of from liberal orgs leading these protests.