A low-cost, practical acquisition and rendering pipeline for real-time free-viewpoint video communication
Artikel i vetenskaplig tidskrift, 2021

We present a semiautomatic real-time pipeline for capturing and rendering free-viewpoint video using passive stereo matching. The pipeline is simple and achieves agreeable quality in real time on a system of commodity web cameras and a single desktop computer. We suggest an automatic algorithm to compute a constrained search space for an efficient and robust hierarchical stereo reconstruction algorithm. Due to our fast reconstruction times, we can eliminate the need for an expensive global surface reconstruction with a combination of high coverage and aggressive filtering. Finally, we employ a novel color weighting scheme that generates credible new viewpoints without noticeable seams, while keeping the computational complexity low. The simplicity and low cost of the system make it an accessible and more practical alternative for many applications compared to previous methods.

Free-viewpoint video

Stereo reconstruction

3D acquisition

Författare

Sverker Rasmuson

Chalmers, Data- och informationsteknik, Datorteknik

Erik Sintorn

Chalmers, Data- och informationsteknik, Datorteknik

Ulf Assarsson

Chalmers, Data- och informationsteknik, Datorteknik

Visual Computer

0178-2789 (ISSN) 1432-2315 (eISSN)

Vol. 37 3 553-565

Fotorealistisk rendering för realtid

Vetenskapsrådet (VR) (2014-4559), 2014-01-01 -- 2021-12-31.

Ämneskategorier

Signalbehandling

Datavetenskap (datalogi)

Datorseende och robotik (autonoma system)

DOI

10.1007/s00371-020-01823-7

Mer information

Senast uppdaterat

2021-05-19