I once interviewed with a team leader and two of his engineers. When I asked "What qualities characterize a valuable member of your team?", one of the engineers described how hard they work: they work so hard that the team leader cancelled dinner with his wife on their 10th anniversary so he could work late that night. The team leader was beaming with pride. I felt sorry for all of them and especially for that guy's family.

Unless his kids are more like him than you and can take a bit of joking.

I dunno, you could take it lightheartedly. It's good for a relationship for the partners to have their own interests and have some time apart.

I've been in that position, and yes you are spot on.