That's a valid point, there is significant selection bias in different workplaces, locations, and institutions.

E.g.: I noticed variance comparable to yours going from a general public school in a poor neighbourhood to a university.