Seeing People in Different Light - Joint Shape, Motion, and Reflectance Capture Christian Theobalt, Naveed Ahmed, Hendrik Lensch, Marcus Magnor, Hans-Peter Seidel

Christian Theobalt, Naveed Ahmed, Hendrik Lensch, Marcus Magnor, and Hans-Peter Seidel: "Seeing People in Different Light - Joint Shape, Motion, and Reflectance Capture", IEEE Transactions on Visualization and Computer Graphics (TVCG), vol. 13, no. 4, pp. 663–674, July 2007. [pdf] [bib]

Abstract

By means of passive optical motion capture real people can be authentically animated and photo-realistically textured. To import real-world characters into virtual environments, however, also surface reflectance properties must be known. We describe a video-based modeling approach that captures human shape and motion as well as reflectance characteristics from a handful of synchronized video recordings. The presented method is able to recover spatially varying surface reflectance properties of clothes from multi-view video footage. The resulting model description enables us to realistically reproduce the appearance of animated virtual actors under different lighting conditions, as well as to interchange surface attributes among different people, e.g. for virtual dressing. Our contribution can be used to create 3D renditions of real-world people under arbitrary novel lighting conditions on standard graphics hardware.

TU Braunschweig - Fakultät für Mathematik und Informatik - Computer Graphics - Publications - Seeing People in Different Light - Joint Shape, Motion, and Reflectance Capture