American here. I don't interpret it that way. I strongly desire to always be growing as a person yet I find quiet reflection some of my most valuable time. I don't think they're mutually exclusive.
The problem to me is on the metrics some parents use to define growth. I do agree with you that quiet reflection is some valuable time. Personally, some of my most valuable ideas and projects came out of the blue, during leisure time.
But my experience is one of seeing parents who think everything should be scheduled to their correct dosages, and that "quiet reflection" is rarely considered as part of the equation. At least in my limited observations, it seems to be there's a certain need for constant measurable growth (or measurable fun), and everything that doesn't fit that framework is to be shunned.
To many parent, "growing" is to be sure to be always moving forward. You need to always have the speedometer at a certain minimum speed. While in reality the twists and turns of healthy learning and healthy living often requires stopping and slowing down at times.