Computer Graphics
TU Braunschweig

Altering the Conveyed Facial Emotion Through Automatic Reenactment of Video Portraits


Altering the Conveyed Facial Emotion Through Automatic Reenactment of Video Portraits

Current facial reenactment techniques are able to generate results with a high level of photo-realism and temporal consistency. Although the technical possibilities are rapidly progressing, recent techniques focus on achieving fast, visually plausible results. Further perceptual effects caused by altering the original facial expressivity of the recorded individual are disregarded. By investigating the influence of altered facial movements on the perception of expressions we aim to generate not only physically possible but truly believable reenactments.

In this paper we perform two experiments using a modified state-of-the-art technique to reenact a video portrait of a person with different expressions gathered from a validated database of motion captured facial expressions to better understand the impact of reenactment.


Author(s):Colin Groth, Jan-Philipp Tauscher, Susana Castillo, Marcus Magnor
Published:November 2020
Type:Article in conference proceedings
Book:Proc. International Conference on Computer Animation and Social Agents (CASA) (Springer, Cham)
ISBN:978-3-030-63425-4
DOI:10.1007/978-3-030-63426-1_14
Presented at:International Conference on Computer Animation and Social Agents (CASA) 2020
Project(s): Perception of Video Manipulation   Immersive Digital Reality 


@inproceedings{groth2020altering,
  title = {Altering the Conveyed Facial Emotion Through Automatic Reenactment of Video Portraits},
  author = {Groth, Colin and Tauscher, Jan-Philipp and Castillo, Susana  and Magnor, Marcus},
  booktitle = {Proc. International Conference on Computer Animation and Social Agents ({CASA})},
  organization = {Springer},
  isbn = {978-3-030-63425-4},
  doi = {10.1007/978-3-030-63426-1\_14},
  editor = {Tian F. et al.},
  volume = {1300},
  pages = {128--135},
  month = {Nov},
  year = {2020}
}

Authors