Fast 3D scene alignment with stereo images using a stixel-based 3D model

D.W.J.M. van de Wouw, W.P. Sanberg, G. Dubbelman, P.H.N. de With

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

2 Citations (Scopus)
1 Downloads (Pure)


Scene alignment for images recorded from different viewpoints is a challenging task, especially considering strong parallax effects. This work proposes a diorama-box model for a 2.5D hierarchical alignment approach, which is specifically designed for image registration from a moving vehicle using a stereo camera. For this purpose, the Stixel World algorithm is used to partition the scene into super-pixels, which are transformed to 3D. This model is further refined by assigning a slanting orientation to each stixel and by interpolating between stixels, to prevent gaps in the 3D model. The resulting alignment shows promising results, where under normal viewing conditions, more than 96% of all annotated points are registered with an alignment error up to 5 pixels at a resolution of 1920x1440 pixels, executing at near-real time performance (4 fps) for the intended application.
Original languageEnglish
Title of host publicationProceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - (Volume 4)
EditorsAlain Tremeau, Francisco Imai, Jose Braz
Place of PublicationSétubal
PublisherSCITEPRESS-Science and Technology Publications, Lda.
Number of pages10
ISBN (Electronic)9789897582905
ISBN (Print)978-989-758-290-5
Publication statusPublished - 2018
EventInternational Conference on Computer Vision Theory and Applications 2018 - Funchal, Portugal
Duration: 27 Jan 201829 Jan 2018


ConferenceInternational Conference on Computer Vision Theory and Applications 2018
Abbreviated titleVISAPP


  • Image registration
  • Real-time
  • Stixel-world
  • View synthesis


Dive into the research topics of 'Fast 3D scene alignment with stereo images using a stixel-based 3D model'. Together they form a unique fingerprint.

Cite this