Warping error analysis and reduction for depth image based rendering in 3DTV

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

4 Citations (Scopus)
2 Downloads (Pure)

Abstract

Interactive free-viewpoint selection applied to a 3D multi-view video signal is an attractive feature of the rapidly developing 3DTV media. In recent years, significant research has been done on free-viewpoint rendering algorithms which mostly have similar building blocks. In our previous work, we have analyzed the principal building blocks of most recent rendering algorithms and their contribution to the overall rendering quality. We have discovered that the first step, Warping determines the basic quality level of the complete rendering chain. In this paper, we have analyzed the warping step in more detail since it leads to ways for improvement. We have observed that the accuracy of warping is mainly determined by two factors which are sampling and rounding errors when performing pixel-based warping and quantization errors of depth maps. For each error factor, we have proposed a technique that can reduce the errors and thus increase the warping quality. Pixel-based warping errors are reduced by employing supersampling at the reference and virtual images and we decrease depth map errors by creating depth maps with more quantization levels. The new techniques are evaluated with two series of experiments using real-life and synthetic data. From these experiments, we have observed that reducing warping errors may increases the overall rendering quality and that the impact of errors due to pixel-based warping is much larger than that of errors due to depth quantization.
Original languageEnglish
Title of host publicationProceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A.
EditorsA.J. Woods, N.S. Holiman, N.A. Dodgson
Place of PublicationBellingham, USA
PublisherSPIE
Pages78630B-1-78630B-9
ISBN (Print)978-0-8194-8400-0
DOIs
Publication statusPublished - 2011
EventIS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII -
Duration: 1 Jan 2011 → …

Publication series

NameProceedings of SPIE
Volume7863
ISSN (Print)0277-786X

Conference

ConferenceIS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII
Period1/01/11 → …
OtherIS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII

Fingerprint

Error analysis
Pixels
Experiments
Sampling

Cite this

Do, Q. L., Zinger, S., & With, de, P. H. N. (2011). Warping error analysis and reduction for depth image based rendering in 3DTV. In A. J. Woods, N. S. Holiman, & N. A. Dodgson (Eds.), Proceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A. (pp. 78630B-1-78630B-9). (Proceedings of SPIE; Vol. 7863). Bellingham, USA: SPIE. https://doi.org/10.1117/12.873384
Do, Q.L. ; Zinger, S. ; With, de, P.H.N. / Warping error analysis and reduction for depth image based rendering in 3DTV. Proceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A.. editor / A.J. Woods ; N.S. Holiman ; N.A. Dodgson. Bellingham, USA : SPIE, 2011. pp. 78630B-1-78630B-9 (Proceedings of SPIE).
@inproceedings{298b0dde05cf4e09a883f0adc7fa9abe,
title = "Warping error analysis and reduction for depth image based rendering in 3DTV",
abstract = "Interactive free-viewpoint selection applied to a 3D multi-view video signal is an attractive feature of the rapidly developing 3DTV media. In recent years, significant research has been done on free-viewpoint rendering algorithms which mostly have similar building blocks. In our previous work, we have analyzed the principal building blocks of most recent rendering algorithms and their contribution to the overall rendering quality. We have discovered that the first step, Warping determines the basic quality level of the complete rendering chain. In this paper, we have analyzed the warping step in more detail since it leads to ways for improvement. We have observed that the accuracy of warping is mainly determined by two factors which are sampling and rounding errors when performing pixel-based warping and quantization errors of depth maps. For each error factor, we have proposed a technique that can reduce the errors and thus increase the warping quality. Pixel-based warping errors are reduced by employing supersampling at the reference and virtual images and we decrease depth map errors by creating depth maps with more quantization levels. The new techniques are evaluated with two series of experiments using real-life and synthetic data. From these experiments, we have observed that reducing warping errors may increases the overall rendering quality and that the impact of errors due to pixel-based warping is much larger than that of errors due to depth quantization.",
author = "Q.L. Do and S. Zinger and {With, de}, P.H.N.",
year = "2011",
doi = "10.1117/12.873384",
language = "English",
isbn = "978-0-8194-8400-0",
series = "Proceedings of SPIE",
publisher = "SPIE",
pages = "78630B--1--78630B--9",
editor = "A.J. Woods and N.S. Holiman and N.A. Dodgson",
booktitle = "Proceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A.",
address = "United States",

}

Do, QL, Zinger, S & With, de, PHN 2011, Warping error analysis and reduction for depth image based rendering in 3DTV. in AJ Woods, NS Holiman & NA Dodgson (eds), Proceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A.. Proceedings of SPIE, vol. 7863, SPIE, Bellingham, USA, pp. 78630B-1-78630B-9, IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 1/01/11. https://doi.org/10.1117/12.873384

Warping error analysis and reduction for depth image based rendering in 3DTV. / Do, Q.L.; Zinger, S.; With, de, P.H.N.

Proceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A.. ed. / A.J. Woods; N.S. Holiman; N.A. Dodgson. Bellingham, USA : SPIE, 2011. p. 78630B-1-78630B-9 (Proceedings of SPIE; Vol. 7863).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Warping error analysis and reduction for depth image based rendering in 3DTV

AU - Do, Q.L.

AU - Zinger, S.

AU - With, de, P.H.N.

PY - 2011

Y1 - 2011

N2 - Interactive free-viewpoint selection applied to a 3D multi-view video signal is an attractive feature of the rapidly developing 3DTV media. In recent years, significant research has been done on free-viewpoint rendering algorithms which mostly have similar building blocks. In our previous work, we have analyzed the principal building blocks of most recent rendering algorithms and their contribution to the overall rendering quality. We have discovered that the first step, Warping determines the basic quality level of the complete rendering chain. In this paper, we have analyzed the warping step in more detail since it leads to ways for improvement. We have observed that the accuracy of warping is mainly determined by two factors which are sampling and rounding errors when performing pixel-based warping and quantization errors of depth maps. For each error factor, we have proposed a technique that can reduce the errors and thus increase the warping quality. Pixel-based warping errors are reduced by employing supersampling at the reference and virtual images and we decrease depth map errors by creating depth maps with more quantization levels. The new techniques are evaluated with two series of experiments using real-life and synthetic data. From these experiments, we have observed that reducing warping errors may increases the overall rendering quality and that the impact of errors due to pixel-based warping is much larger than that of errors due to depth quantization.

AB - Interactive free-viewpoint selection applied to a 3D multi-view video signal is an attractive feature of the rapidly developing 3DTV media. In recent years, significant research has been done on free-viewpoint rendering algorithms which mostly have similar building blocks. In our previous work, we have analyzed the principal building blocks of most recent rendering algorithms and their contribution to the overall rendering quality. We have discovered that the first step, Warping determines the basic quality level of the complete rendering chain. In this paper, we have analyzed the warping step in more detail since it leads to ways for improvement. We have observed that the accuracy of warping is mainly determined by two factors which are sampling and rounding errors when performing pixel-based warping and quantization errors of depth maps. For each error factor, we have proposed a technique that can reduce the errors and thus increase the warping quality. Pixel-based warping errors are reduced by employing supersampling at the reference and virtual images and we decrease depth map errors by creating depth maps with more quantization levels. The new techniques are evaluated with two series of experiments using real-life and synthetic data. From these experiments, we have observed that reducing warping errors may increases the overall rendering quality and that the impact of errors due to pixel-based warping is much larger than that of errors due to depth quantization.

U2 - 10.1117/12.873384

DO - 10.1117/12.873384

M3 - Conference contribution

SN - 978-0-8194-8400-0

T3 - Proceedings of SPIE

SP - 78630B-1-78630B-9

BT - Proceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A.

A2 - Woods, A.J.

A2 - Holiman, N.S.

A2 - Dodgson, N.A.

PB - SPIE

CY - Bellingham, USA

ER -

Do QL, Zinger S, With, de PHN. Warping error analysis and reduction for depth image based rendering in 3DTV. In Woods AJ, Holiman NS, Dodgson NA, editors, Proceedings for IS&T/SPIE Electronic Imaging, Stereoscopic Displays and Applications XXII, 22-24th January, 2011, San Francisco, U.S.A.. Bellingham, USA: SPIE. 2011. p. 78630B-1-78630B-9. (Proceedings of SPIE). https://doi.org/10.1117/12.873384