Computer Graphics
TU Braunschweig

Automatic Generation of Customized AOIs and Evaluation of Observers' Gaze in Portrait Videos


Automatic Generation of Customized AOIs and Evaluation of Observers' Gaze in Portrait Videos

We present a novel framework for the evaluation of eye tracking data in portrait videos including the automatic generation of customized areas of interest (AOIs) based on facial landmarks. In contrast to previous work, our framework allows the user to flexibly create AOIs by grouping the detected landmarks. Moreover, their shape and size can be modified to better fit both the research question and the precision of the eye tracker. The framework can be used as an integrated solution to not only generate AOIs but also to evaluate viewing behavior like the overall fixation times, the similarity of scanpaths, and the number of saccades between AOIs. Other functionalities include the visualization of gaze paths and the creation of heatmaps. We demonstrate the benefits of our framework and user-defined AOI layouts via an exemplary application, i.e., the investigation of face swapping artifacts.


Author(s):Leslie Wöhler, Moritz von Estorff, Susana Castillo, Marcus Magnor
Published:to appear
Type:Article in conference proceedings
Book:Proceedings of the ACM on Human-Computer Interaction (ACM)
DOI:10.1145/3530885
Presented at:ACM Symposium on Eye Tracking Research and Applications (ETRA) 2022


@inproceedings{wohler2022automatic,
  title = {Automatic Generation of Customized {AOI}s and Evaluation of Observers' Gaze in Portrait Videos},
  author = {W{\"o}hler, Leslie and von Estorff, Moritz and Castillo, Susana  and Magnor, Marcus},
  booktitle = {Proceedings of the {ACM} on Human-Computer Interaction },
  doi = {10.1145/3530885},
  volume = {6},
  number = {{ETRA}},
  pages = {144:1--144:14},
  year = {2022}
}

Authors