The effects of multiview depth video compression on multiview rendering

P. Merkle, Y. Morvan, A. Smolic, D.S. Farin, K. Mueller, P.H.N. With, de, T. Wiegang

Research output: Contribution to journalArticleAcademicpeer-review

210 Citations (Scopus)

Abstract

This article investigates the interaction between different techniques for depth compression and view synthesis rendering with multiview video plus scene depth data. Two different approaches for depth coding are compared, namely H.264/MVC, using temporal and inter-view reference images for efficient prediction, and the novel platelet-based coding algorithm, characterized by being adapted to the special characteristics of depth-images. Since depth-images are a 2D representation of the 3D scene geometry, depth-image errors lead to geometry distortions. Therefore, the influence of geometry distortions resulting from coding artifacts is evaluated for both coding approaches in two different ways. First, the variation of 3D surface meshes is analyzed using the Hausdorff distance and second, the distortion is evaluated for 2D view synthesis rendering, where color and depth information are used together to render virtual intermediate camera views of the scene. The results show that—although its rate-distortion (R-D) performance is worse—platelet-based depth coding outperforms H.264, due to improved sharp edge preservation. Therefore, depth coding needs to be evaluated with respect to geometry distortions.
Original languageEnglish
Pages (from-to)73-88
Number of pages16
JournalSignal Processing : Image Communication
Volume24
Issue number1-2
DOIs
Publication statusPublished - 2009

Fingerprint Dive into the research topics of 'The effects of multiview depth video compression on multiview rendering'. Together they form a unique fingerprint.

Cite this