Computer Graphics
TU Braunschweig

Optimizing Temporal Stability in Underwater Video Tone Mapping

Optimizing Temporal Stability in Underwater Video Tone Mapping

In this paper, we present an approach for temporal stabilization of depth-based underwater image tone mapping methods for application to monocular RGB video. Typically, the goal is to improve the colors of focused objects, while leaving more distant regions nearly unchanged, to preserve the underwater look-and-feel of the overall image. To do this, many methods rely on estimated depth to control the recolorization process, i.e., to enhance colors (reduce blue tint) only for objects close to the camera. However, while single-view depth estimation is usually consistent within a frame, it often suffers from inconsistencies across sequential frames, resulting in color fluctuations during tone mapping. We propose a simple yet effective inter-frame stabilization of the computed depth maps to achieve stable tone mapping results. The evaluation of eight test sequences shows the effectiveness in a wide range of underwater scenarios.

Creative commons videos used for evaluation: 1, 2, 3, 4, 5, 6, 7, 8

Author(s):Matthias Franz, Bill Matthias Thang, Pascal Sackhoff, Timon Scholz, Jannis Malte Möller, Steve Grogorick, Martin Eisemann
Published:September 2023
Type:Article in conference proceedings
Book:Proc. Vision, Modeling and Visualization (VMV) (The Eurographics Association)
Presented at:Vision, Modeling and Visualization (VMV) 2023
Project(s): Future Lab Water  Realism-enhanced Omnidirectional Video in Virtual Reality 

  title = {Optimizing Temporal Stability in Underwater Video Tone Mapping},
  author = {Franz, Matthias and Thang, Bill Matthias and Sackhoff, Pascal and Scholz, Timon and M{\"o}ller, Jannis Malte and Grogorick, Steve and Eisemann, Martin},
  booktitle = {Proc. Vision, Modeling and Visualization ({VMV})},
  organization = {Eurographics},
  isbn = {978-3-03868-232-5},
  doi = {10.2312/vmv.20231239},
  editor = {T. Grosch and M. Guthe},
  pages = {165--172},
  month = {Sep},
  year = {2023}