Free-viewpoint depth image based rendering

Research output: Contribution to journalArticleAcademicpeer-review

112 Citations (Scopus)
2 Downloads (Pure)

Abstract

In 3D TV research, one approach is to employ multiple cameras for creating a 3D multi-view signal with the aim to make interactive free-viewpoint selection possible in 3D TV media. This paper explores a new rendering algorithm that enables to compute a free-viewpoint between two reference views from existing cameras. A unique property is that we perform forward warping for both texture and depth simultaneously. Advantages of our rendering are manyfold. First, resampling artifacts are filled in by inverse warping. Second, disocclusions are processed while omitting warping of edges at high discontinuities. Third, our disocclusion inpainting approach explicitly uses depth information. We obtain an average PSNR gain of 3 dB and 4.5 dB for the ‘Breakdancers’ and ‘Ballet’ sequences, respectively, compared recently published results. Moreover, experiments are performed using compressed video from surrounding cameras. The overall system quality is dominated by rendering quality and not by coding.
Original languageEnglish
Pages (from-to)533-541
Number of pages9
JournalJournal of Visual Communication and Image Representation
Volume21
Issue number5-6
DOIs
Publication statusPublished - 2010

Fingerprint Dive into the research topics of 'Free-viewpoint depth image based rendering'. Together they form a unique fingerprint.

Cite this