What happens when people with the institutional power to fight evil people don’t fight is those without institutional power despair.
You can blame desperate people for the suffering that’s coming their way, if you want, but doing so doesn’t distinguish you from fascists.