That is the cant, yes. Personally I'd prefer to live among obnoxious judgmental hectoring Berkeley liberals than in an Amish or Hasidic neighbourhood but I'd prefer either to the kind of place where the police come around all the time.
While I agree there is no reason to segregate along artificial "racial" lines, with seven billion people its not the same as living in a "tight knit" village. Sometimes foes arise and you need to segregate to that extent. Also in the workforce you need to segregate on ability ; in education among age/development/ability lines.
I think both are present. Ever see two siblings go in opposite academic direction from grade school to high school? Yes some is innate on the other hand some kids with great aptitude just don't have the opportunity due to their circumstance
We're all humans? Aren't we all our own kind? There is no need to make further segregation.