Computer Graphics
TU Braunschweig

Web-based Interactive Free-Viewpoint Streaming

Recent advances in free-viewpoint rendering techniques as well as the continued improvements of the internet network infrastructure open the door for challenging new applications. In this paper, we present a framework for interactive free-viewpoint streaming with open standards and software. Network bandwidth, encoding strategy as well as codec support for open source browsers are key constraints to be considered for our interactive streaming applications. Our framework is capable of real-time server-side rendering and interactively streaming the output by means of open source streaming. To enable viewer interaction with the free-viewpoint video rendering back-end in a standard browser, user events are captured with Javascript and transmitted using WebSockets. The rendered video is streamed to the browser using the FFmpeg free software project. This paper discusses the applicability of open source streaming and presents timing measurements for video-frame transmission over network.

Author(s):Matthias Überheide, Felix Klose, Tilak Varisetty, Markus Fidler, Marcus Magnor
Published:October 2015
Type:Article in conference proceedings
Book:Proc. ACM Multimedia
Presented at:ACM Multimedia
Note:Poster Presentation
Project(s): Virtual Video Camera  Reality CG 

  title = {Web-based Interactive Free-Viewpoint Streaming},
  author = {{\"U}berheide, Matthias and Klose, Felix and Varisetty, Tilak and Fidler, Markus and Magnor, Marcus},
  booktitle = {Proc. {ACM} Multimedia},
  note = {Poster Presentation},
  pages = {1031--1034},
  month = {Oct},
  year = {2015}