I tend to hear this quote brought up by people who are either really eager to name drop Einstein or excuse themselves for being insane.

The quote makes much more sense within the context of scientific experimentation. Applying it to a typical, mundane set of experiences, to me, is pretty crass.