Enabling arbitrary rotation camera-motion using multi-sprites with minimum coding cost

D.S. Farin, P.H.N. With, de

Research output: Contribution to journalArticleAcademicpeer-review

14 Citations (Scopus)
88 Downloads (Pure)

Abstract

Object-oriented coding in the MPEG-4 standard enables the separate processing of foreground objects and the scene background (sprite). Since the background sprite only has to be sent once, transmission bandwidth can be saved.We have found that the counter-intuitive approach of splitting the background into several independent parts can reduce the overall amount of data. Furthermore, we show that in the general case, the synthesis of a single background sprite is even impossible and that the scene background must be sent as multiple sprites instead. For this reason, we propose an algorithm that provides an optimal partitioning of a video sequence into independent background sprites (a multisprite), resulting in a significant reduction of the involved coding cost. Additionally, our sprite-generation algorithm ensures that the sprite resolution is kept high enough to preserve all details of the input sequence, which is a problem especially during camera zoom-in operations. Even though our sprite generation algorithm creates multiple sprites instead of only a single background sprite, it is fully compatible with the existing MPEG-4 standard. The algorithm has been evaluated with several test sequences, including the well-known Table-tennis and Stefan sequences. The total coding cost for the sprite VOP is reduced by a factor of about 2.6 or even higher, depending on the sequence.
Original languageEnglish
Pages (from-to)492-506
Number of pages15
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume16
Issue number4
DOIs
Publication statusPublished - 2006

Fingerprint

Dive into the research topics of 'Enabling arbitrary rotation camera-motion using multi-sprites with minimum coding cost'. Together they form a unique fingerprint.

Cite this