I've been using google calendar for the same thing, it make it easy to start dragging to log what task I've been doing, the fact that you can show multiple calendar and easily toggle between them helps with this theoretical plan vs what actually happened. there's also a script/webapp on github that help you sum the total time spent per timeunit per task or calendar.

does anyone know of an open source calendar app with the same ui/ux ?