A low-cost, practical acquisition and rendering pipeline for real-time free-viewpoint video communication
Journal article, 2021

We present a semiautomatic real-time pipeline for capturing and rendering free-viewpoint video using passive stereo matching. The pipeline is simple and achieves agreeable quality in real time on a system of commodity web cameras and a single desktop computer. We suggest an automatic algorithm to compute a constrained search space for an efficient and robust hierarchical stereo reconstruction algorithm. Due to our fast reconstruction times, we can eliminate the need for an expensive global surface reconstruction with a combination of high coverage and aggressive filtering. Finally, we employ a novel color weighting scheme that generates credible new viewpoints without noticeable seams, while keeping the computational complexity low. The simplicity and low cost of the system make it an accessible and more practical alternative for many applications compared to previous methods.

Free-viewpoint video

Stereo reconstruction

3D acquisition

Author

Sverker Rasmuson

Chalmers, Computer Science and Engineering (Chalmers), Computer Engineering (Chalmers)

Erik Sintorn

Chalmers, Computer Science and Engineering (Chalmers), Computer Engineering (Chalmers)

Ulf Assarsson

Chalmers, Computer Science and Engineering (Chalmers), Computer Engineering (Chalmers)

Visual Computer

0178-2789 (ISSN) 1432-2315 (eISSN)

Vol. 37 3 553-565

Real-time Photo-realistic Rendering

Swedish Research Council (VR) (2014-4559), 2014-01-01 -- 2021-12-31.

Subject Categories

Signal Processing

Computer Science

Computer Vision and Robotics (Autonomous Systems)

DOI

10.1007/s00371-020-01823-7

More information

Latest update

5/19/2021