The alternative is that they do not believe the pandemic is a hoax, but believe that the virus is only dangerous for the "vulnerable".
The mask then a sign that you are vulnerable. And part of the population think that they are allowed to bully the vulnerable.
This is, in part, because they were made to believe that measures were only in place to protect the vulnerable, and they felt they were punished for something that did not affect them.