Unless you have enough money to comfortably retire, or at least, the social network that can catch you if you meet catastrophe, allowing your skills to erode or even allowing the perception that they have via not having a day job is probably a bad idea.