It actually trends down, likely because children have historically been used as a retirement plan of sorts, and of course you'd never be sure how many of your ten made it to adulthood.

Financially comfortable and well educated families tend to have less children, this is a pattern that has been repeated many times across country and cultural borders.