Do you have kids? I would hardly say every parent I know looks back on it with "nothing but fondness". Some would even say that on balance, they would have rather not had children at all.
I should have rephrased it to include only people who enjoy raising children. For those people, it's OK not to be maximally productive. It's ok to not want to outsource raising a child by strangers.