You do not get to shut down valid criticism of your work and actions just by virtue of being a member of a minority. I can't believe how often this comes up even still.
Obviously if one is targeted, that's a problem, but please look up and understand disparate treatment and disparate impact. These concepts are /comparative/. Between marginalized and non-marginalized groups.
Also fwiw my own experience is that I feel most safe when my work gets the same type of feedback others' does.