Spatio-Temporal Registration Techniques for Relightable 3D Video Naveed Ahmed, Christian Theobalt, Marcus Magnor, Hans-Peter Seidel

Naveed Ahmed, Christian Theobalt, Marcus Magnor, and Hans-Peter Seidel: "Spatio-Temporal Registration Techniques for Relightable 3D Video", in Proc. IEEE International Conference on Image Processing (ICIP), September 2007. [pdf] [bib]

Abstract

By jointly applying a model-based marker-less motion capture approach and multi-view texture generation 3D Videos of human actors can be reconstructed from multi-view video streams. If the input data were recorded under calibrated lighting, the texture information can also be used to measure time-varying surface reflectance. This way, 3D videos can be realistically displayed under novel lighting conditions. Reflectance estimation is only feasible if the multi-view textureto-surface registration is consistent over time. In this paper, we propose two image-based warping methods that compensate
registration errors due to inaccurate model geometry and shifting of apparel over the body.

TU Braunschweig - Fakultät für Mathematik und Informatik - Computer Graphics - Publications - Spatio-Temporal Registration Techniques for Relightable 3D Video