I would absolutely love to see papers that apply techniques like this to video. I've got an interest in filmmaking and would have a great deal of fun processing video with something like this.
Naively I imagine you could pipe every frame through an algorithm like this, but it likely won't have a smooth evolution over time. Maybe that isn't a problem?
Looking at more examples, I'm not yet convinced this technique isn't straight-up magic: http://www.mrl.nyu.edu/projects/image-analogies/flightsim.ht...