These same thoughts often cross my mind. But the grass is always greener on the other side. I do really love how unstructured being a prof is though.