No, the point is that for certain sets of numbers, calculating the mean does not give you a summary statistic. It just gives the average of a bunch of numbers, not a number that is representative of your population.
This is why using Gaussian models to predict something that's fundamentally fat-tailed (e.g. IQ vs. many forms of societal achievemnt) is doomed to failure.