Prosperity IMHO means a growth in per-capita wealth. On the other hands, "the elites" may prefer a growth in total wealth (since part of that growth accumulates to them) through a population increase even if it comes at the cost of decrease in per-capita wealth for the actual society.
How do you suppose we incentive competition in stagnation?