|
Perception-motivated Interpolation of Image Sequences
|
|
| Home | Team | Research | Teaching | Publications |
We present a method for image interpolation which is able to create high-quality, perceptually convincing transitions between recorded images. By implementing concepts derived from human vision, the problem of a physically correct image interpolation is relaxed to an image interpolation that is perceived as physically correct by human observers. We find that it suffices to focus on exact edge correspondences, homogeneous regions and coherent motion to compute such solutions. In our user study we confirm the visual quality of the proposed image interpolation approach. We show how each aspect of our approach increases the perceived quality of the interpolation results, compare the results obtained by other methods and investigate the achieved quality for different types of scenes.
|
Timo Stich,
Christian Linz,
Christian Wallraven,
Douglas Cunningham,
and
Marcus Magnor:
"Perception-motivated interpolation of image sequences", ACM Transactions on Applied Perception (TAP), vol. 8, no. 2, pp. 1–25, January 2011. http://doi.acm.org/10.1145/1870076.1870079 Part of project "Perception-motivated Interpolation of Image Sequences". [pdf] [bib] We present a method for image interpolation that is able to create high-quality, perceptually convincing transitions between recorded images. By implementing concepts derived from human vision, the problem of a physically correct image interpolation is relaxed to that of image interpolation which is perceived as visually correct by human observers. We find that it suffices to focus on exact edge correspondences, homogeneous regions and coherent motion to compute convincing results. A user study confirms the visual quality of the proposed image interpolation approach. We show how each aspect of our approach increases perceived quality of the result. We compare the results to other methods and assess achievable quality for different types of scenes. |
|
Timo Stich,
Christian Linz,
Christian Wallraven,
Douglas Cunningham,
and
Marcus Magnor:
"Perception-motivated Interpolation of Image Sequences", in Proc. ACM Applied Perception in Computer Graphics and Visualization (APGV) 2008, Los Angeles, USA, pp. 97–106, ACM, July 2008. http://doi.acm.org/10.1145/1394281.1394299 Part of project "Perception-motivated Interpolation of Image Sequences". [pdf] [bib] We present a method for image interpolation which is able to create high-quality, perceptually convincing transitions between recorded images. By implementing concepts derived from human vision, the problem of a physically correct image interpolation is relaxed to an image interpolation that is perceived as physically correct by human observers. We find that it suffices to focus on exact edge correspondences, homogeneous regions and coherent motion to compute such solutions. In our user study we confirm the visual quality of the proposed image interpolation approach. We show how each aspect of our approach increases the perceived quality of the interpolation results, compare the results obtained by other methods and investigate the achieved quality for different types of scenes. |
|
Timo Stich,
Christian Linz,
Georgia Albuquerque,
and
Marcus Magnor:
"View and Time Interpolation in Image Space", Computer Graphics Forum (Proc. of Pacific Graphics), vol. 27, no. 7, pp. 1781–1787, February 2008. Part of projects "Perception-motivated Interpolation of Image Sequences" and "Virtual Video Camera". [pdf] [bib] [youtube] |
|
Timo Stich
and
Marcus Magnor:
"Keyframe Animation from Video", in Proc. IEEE International Conference on Image Processing (ICIP) 2006, pp. 2713–2716, October 2006. Part of project "Perception-motivated Interpolation of Image Sequences". [pdf] [bib] This paper proposes a method for analyzing and synthesizing video sequences, specifically suited for image sequences of natural phenomena. We combine a low-dimensional representation of arbitrary image sequences and an image morphing technique to create realistic in-between images. The visualization based on the Isomap algorithm allows users to easily select parts of the video that have periodic character. From these segments, new sequences can be synthesized in realtime. To smooth transition artifacts between the reordered subsequences a Monge-Kantorovich based image morphing method is applied to interpolate in-between images. Our approach is useful for e.g. video key-frame animation, automatic looping or creating slow-motion sequences. |
|
"Alternate Exposure Imaging" Traditional optic flow algorithms rely on consecutive short-exposure images. In contrast, long-exposed images contain integrated motion information directly in form of motion blur. In this project, we use the additional information provided by a long exposure image to improve robustness and accuracy of motion field estimation. Furthermore, the long exposure image can be used to determine the moment of occlusion for the pixels in any of the short exposure images that are occluded or disoccluded. |
|
"Multi-Image Correspondences" Multi-view video camera setups record many images that capture nearly the same scene at nearly the same instant in time. Neighboring images in a multi-video setup restrict the solution space between two images: correspondences between one pair of images must be in accordance with the correspondences to the neighboring images. This work has been partially funded by the German Science Foundation, DFG MA2555/4-2. |
|
"Reality CG" Scope of Reality CG is to pioneer a novel approach to modelling, editing and rendering in computer graphics. Instead of manually creating digital models of virtual worlds, Reality CG will explore new ways to achieve visual realism from the kind of approximate models that can be derived from conventional, real-world imagery as input. |
|
"Virtual Video Camera" The Virtual Video Camera research project is aimed to provide algorithms for rendering free-viewpoint video from asynchronous camcorder captures. We want to record our multi-video data without the need of specialized hardware or intrusive setup procedures (e.g., waving calibration patterns). |

TU Braunschweig
- Fakultät für Mathematik und Informatik
- Computer Graphics
- Research Projects
- Perception-motivated Interpolation of Image Sequences