Privacy protection in street-view panoramas using depth and multi-view imagery

Ries Uittenbogaard, Clint Sebastian, J.A. Vijverberg, Bas Boom, Dariu Gavrila, Peter de With

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

10 Citations (Scopus)
31 Downloads (Pure)

Abstract

The current paradigm in privacy protection in street-view images is to detect and blur sensitive information. In this paper, we propose a framework that is an alternative to blurring, which automatically removes and inpaints moving objects (e.g. pedestrians, vehicles) in street-view imagery. We propose a novel moving object segmentation algorithm exploiting consistencies in depth across multiple street-view images that are later combined with the results of a segmentation network. The detected moving objects are removed and inpainted with information from other views, to obtain a realistic output image such that the moving object is not visible anymore. We evaluate our results on a dataset of 1000 images to obtain a peak noise-to-signal ratio (PSNR) and L 1 loss of 27.2 dB and 2.5%, respectively. To assess overall quality, we also report the results of a survey conducted on 35 professionals, asked to visually inspect the images whether object removal and inpainting had taken place. The inpainting dataset will be made publicly available for scientific benchmarking purposes at https://research.cyclomedia.com/.

Original languageEnglish
Title of host publication13th IEEE/CVF Conference on Computer Vision and Pattern Recognition, (CVPR2019)
Place of PublicationPiscataway
PublisherInstitute of Electrical and Electronics Engineers
Pages10573-10582
Number of pages10
ISBN (Electronic)978-1-7281-3293-8
DOIs
Publication statusPublished - Jun 2019
Event13th IEEE/CVF Conference on Computer Vision and Pattern Recognition, (CVPR2019) - Long Beach, United States
Duration: 16 Jun 201920 Jun 2019
http://cvpr2019.thecvf.com/

Conference

Conference13th IEEE/CVF Conference on Computer Vision and Pattern Recognition, (CVPR2019)
Abbreviated titleCVPR 2019
CountryUnited States
CityLong Beach
Period16/06/1920/06/19
Internet address

Keywords

  • privacy protection
  • GAN
  • moving object segmentation
  • inpainting
  • Others
  • Vision Applications and Systems

Fingerprint Dive into the research topics of 'Privacy protection in street-view panoramas using depth and multi-view imagery'. Together they form a unique fingerprint.

Cite this