I think the median works better in this situation because the huge population means that both the outliers and the skewness have much less effect than they do on the mean. The problem with using the mean “without outliers” is that you have to make arbitrary decisions about what data to exclude as an outlier, unlike with the median.