Enhance Videos with Photos

One of my friend show me something quite interesting, a research group created a video enhancement technology that makes use of photos to compensate / enhance videos.

Here is the research group’s introduction of their new technology:

We present a framework for automatically enhancing videos of a static scene using a few photographs of the same scene. For example, our system can transfer photographic qualities such as high resolution, high dynamic range and better lighting from the photographs to the video. Additionally, the user can quickly modify the video by editing only a few still images of the scene. Finally, our system allows a user to remove unwanted objects and camera shake from the video. These capabilities are enabled by two technical contributions presented in this paper. First, we make several improvements to a state-of-the-art multiview stereo algorithm in order to compute view-dependent depths using video, photographs, and structure-from-motion data. Second, we present a novel image-based rendering algorithm that can re-render the input video using the appearance of the photographs while preserving certain temporal dynamics such as specularities and dynamic scene lighting.

enhance video with photos

enhance video with photos

Some of the video enhancements produced by our system. Given a low quality video of a static scene (top row) and a few high quality photographs of the scene, our system can automatically produce a variety of video enhancements (bottom row). Enhancements include the transfer of photographic qualities such as high resolution, high dynamic range, and better exposure from photographs to video. The video can also be edited in a variety of ways (e.g., object touchup, object removal) by simply editing a few photographs or video frames.

The demonstration video is quite impressive. I can imagine that one day we can also make Hollywood quality level video at home. And, more importantly, this technology may help Hollywood movie makers greatly speed up their “special effect post processing”; which means better movies with lower budget and shorter production time. Really look forward to see commercial use of this video enhancement research.

Share and Enjoy:
  • Digg
  • Sphinn
  • del.icio.us
  • Facebook
  • Mixx
  • MisterWong
  • Reddit
  • Technorati

You may also like

Posted in Photography | No Comments » December 1st, 2008

Leave a Comment

Please note: Comment moderation is enabled and may delay your comment. There is no need to resubmit your comment.

Digital camera forum logo
DC User logo