If you think a 100+ LDL-C is normal you're basing things off of significantly outdated information.
Expect the normal range to drop in the coming years as well - the AHA and NLA have both been talking about how this needs to go lower, and the science is robust. See my other comments for study links, the NLA's latest guidance, etc.
If your doctor is only getting concerned at 160+, find a new doctor.