"they might be different to me" is not the same as "they will be actively hostile to me when they learn more about how different I am".
In the US I find conformity to be widely regarded as desirable, and being "weird" to be seen as a negative. I am weird. This lowers most normal people's opinions of me.
On the contrary I think many people desire conformance in themselves because they are afraid to stand out. However, often weirdness is admired when it is observed. This is why 'artists' are a thing. Granted, the specific ways in which you are weird could definitely influence this, no one likes a creepy person.
If you want to be a misanthrope that's fine, but that's on you, not your local community.