Computer Graphics
TU Braunschweig

Interactive Scene Flow Editing for Improved Image-based Rendering and Virtual Spacetime Navigation


Interactive Scene Flow Editing for Improved Image-based Rendering and Virtual Spacetime Navigation

High-quality stereo and optical flow maps are essential for a multitude of tasks in visual media production, e.g. virtual camera navigation, disparity adaptation or scene editing. Rather than estimating stereo and optical flow separately, scene flow is a valid alternative since it combines both spatial and temporal information and recently surpassed the former two in terms of accuracy. However, since automated scene flow estimation is non-accurate in a number of situations, resulting rendering artifacts have to be corrected manually in each output frame, an elaborate and time-consuming task. We propose a novel workflow to edit the scene flow itself, catching the problem at its source and yielding a more flexible instrument for further processing. By integrating user edits in early stages of the optimization, we allow the use of approximate scribbles instead of accurate editing, thereby reducing interaction times. Our results show that editing the scene flow improves the quality of visual results considerably while requiring vastly less editing effort.


Video

For more information, please contact the author via email.

Author(s):Kai Ruhl, Martin Eisemann, Anna Hilsmann, Peter Eisert, Marcus Magnor
Year:2015
Month:October
Type:Article in conference proceedings
Book:Proc. ACM Multimedia (ACM)
Presented at:ACM Multimedia
Project(s): Image-space Editing of 3D Content  Reality CG 


@inproceedings{ruhl2015acmmm,
  title = {Interactive Scene Flow Editing for Improved Image-based Rendering and Virtual Spacetime Navigation},
  author = {Ruhl, Kai and Eisemann, Martin and Hilsmann, Anna  and Eisert, Peter and Magnor, Marcus},
  booktitle = {Proc. {ACM} Multimedia},
  pages = {631--640},
  month = {Oct},
  year = {2015}
}

Authors