I think one of the reasons privileged people can be such jerks is because people are generally unable to perceive that which lies outside of their own experiences. So when they see someone who's really suffering, they just assume they're weak. "I don't suffer, so why should THEY?"
That's why people tend to despise those of us living with depression. They see us as weak because, in their minds, they believe everyone around them is as privileged as they are. They actually cannot see other people's experiences, ony a mirror reflecting their own experiences back at them.