Evolutionarily, that would make sense as well: creatures similar to us are likely to be competing for the same resources -- and as they are different they can't be trusted to collaborate.

I guess this could also be the cause of racism.