You might get deported like that Saudi guy for being too handsome.
You can also be targeted by other men (of a different race for example) that feel threatened by you - or women too, the bitter type, in all seriousness.
To make it easier for your probable world view: being a very good looking tall black man for example, won't necessarily have everyone open up to you with smiles on their faces (especially if you don't necessarily want to assimilate into their 'culture'/social structure).
Being a very good looking asian (yes they exist, haha) guy myself - I would say I have experienced many instances in my life where white men have attempted to sabotage me.
People like things that make them feel/seem more powerful, and hate things that tend to do the opposite.
No guarantee's there, but I can say that it works both ways. Xenophobia and these sorts of biases exist and are normal parts of being a human being.
I would say, it's better to accept that these biases exist, so that you can take them into account when reasoning - rather than trying to delude yourself into thinking you are in entire control of all that is going on in your mind (and body).
I mean, what caused you to believe they were sabotaging you based on looks?
I'm sure there are all kinds of odd reasons why somebody might do that, but it seems like an odd one to assume unless there's a reason for it.