I personally think that the reason that some people act callous towards those who are poor/experiencing misfortune is ultimately because they're afraid. If you tell yourself that people end up poor because of a moral failing, you make poverty seem like something that won't and can't ever happen to you, because the very fact that you're not currently in poverty proves that you must have a better moral constitution somehow.
Yes. Fear drives a lot, if not all, negative human behavior. What makes matters worse is it's difficult to self-identity that we are acting out of fear.
I want to believe in such a redeeming explanation for moral failings, but I think my experiences have shown that a lot of people just care about themselves, and some are enthused to defeat or put down others, even by cheating or other abuse.
I wish I knew where to get help. I just want to have a normal life.