Many people tend to just go with whatever "feels right" to them. Challenging them to examine their prejudices and bigoted behaviors is a challenge to what feels comfortable and normal because that harm was normalized from the time they are children onward to adulthood.
Retreating to "common sense" is a self-soothing act in the face of one's normalized harm toward others being called out and opposed.