Computer Graphics
TU Braunschweig

Adaptive Image-Space Sampling for Gaze-Contingent Real-time Rendering


Adaptive Image-Space Sampling for Gaze-Contingent Real-time Rendering

With ever-increasing display resolution for wide field-of-view displays - such as head-mounted displays or 8k projectors - shading has become the major computational cost in rasterization. To reduce computational effort, we propose an algorithm that only shades visible features of the image while cost-effectively interpolating the remaining features without affecting perceived quality. In contrast to previous approaches we do not only simulate acuity falloff but also introduce a sampling scheme that incorporates multiple aspects of the human visual system: acuity, eye motion, contrast (stemming from geometry, material or lighting properties), and brightness adaptation. Our sampling scheme is incorporated into a deferred shading pipeline to shade the image’s perceptually relevant fragments while a pull-push algorithm interpolates the radiance for the rest of the image. Our approach does not impose any restrictions on the performed shading. We conduct a number of psycho-visual experiments to validate scene- and task-independence of our approach. The number of fragments that need to be shaded is reduced by 50 % to 80 %. Our algorithm scales favorably with increasing resolution and field-of-view, rendering it well-suited for head-mounted displays and wide-field-of-view projection.


Author(s):Michael Stengel, Steve Grogorick, Martin Eisemann, Marcus Magnor
Year:2016
Month:September
Type:Misc
Howpublished:Poster @ German Conference on Pattern Recognition 2016
Presented at:German Conference on Pattern Recognition (GCPR) 2016
Project(s): Reality CG  Eye-tracking Head-mounted Display  Immersive Digital Reality 


@misc{gcpr2016adaptsampling,
  title = {Adaptive Image-Space Sampling for Gaze-Contingent Real-time Rendering},
  author = {Stengel, Michael and Grogorick, Steve and Eisemann, Martin and Magnor, Marcus},
  howpublished = {Poster @ German Conference on Pattern Recognition 2016},
  month = {Sep},
  year = {2016}
}

Authors