Towards accurate camera geopositioning by image matching

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

8 Downloads (Pure)

Abstract

In this work, we present a camera geopositioning system based on matching a query image against a database with panoramic images. For matching, our system uses memory vectors aggregated from global image descriptors based on convolutional features to facilitate fast searching in the database. To speed up searching, a clustering algorithm is used to balance geographical positioning and computation time. We refine the obtained position from the query image using a new outlier removal algorithm. The matching of the query image is obtained with a recall@5 larger than 90% for panorama-to-panorama matching. We cluster available panoramas from geographically adjacent locations into a single compact representation and observe computational gains of approximately 50% at the cost of only a small (approximately 3%) recall loss. Finally, we present a coordinate estimation algorithm that reduces the median geopositioning error by up to 20%.

Original languageEnglish
Title of host publicationEleventh International Conference on Machine Vision, ICMV 2018
EditorsAntanas Verikas, Dmitry P. Nikolaev, Petia Radeva, Jianhong Zhou
Place of PublicationBellingham
PublisherSPIE
Number of pages8
ISBN (Electronic)9781510627482
DOIs
Publication statusPublished - 1 Jan 2019
Event11th International Conference on Machine Vision, ICMV 2018 - Munich, Germany
Duration: 1 Nov 20183 Nov 2018
Conference number: 11

Publication series

NameProceedings of SPIE
Volume11041
ISSN (Print)0277-786X

Conference

Conference11th International Conference on Machine Vision, ICMV 2018
Abbreviated titleICMV
CountryGermany
CityMunich
Period1/11/183/11/18

Fingerprint

Image matching
Image Matching
Camera
Cameras
cameras
Clustering algorithms
Query
Data storage equipment
Estimation Algorithms
Descriptors
positioning
Positioning
Outlier
Clustering Algorithm
Speedup
Adjacent

Keywords

  • convolutional neural networks
  • geopositioning
  • Image matching
  • panoramic images
  • visual place recognition

Cite this

Imbriaco, R., Sebastian, C., Bondarev, E., & De With, P. H. N. (2019). Towards accurate camera geopositioning by image matching. In A. Verikas, D. P. Nikolaev, P. Radeva, & J. Zhou (Eds.), Eleventh International Conference on Machine Vision, ICMV 2018 [110411C] (Proceedings of SPIE; Vol. 11041). Bellingham: SPIE. https://doi.org/10.1117/12.2522999
Imbriaco, Raffaele ; Sebastian, Clint ; Bondarev, Egor ; De With, Peter H.N. / Towards accurate camera geopositioning by image matching. Eleventh International Conference on Machine Vision, ICMV 2018. editor / Antanas Verikas ; Dmitry P. Nikolaev ; Petia Radeva ; Jianhong Zhou. Bellingham : SPIE, 2019. (Proceedings of SPIE).
@inproceedings{72203ab19050437790d7cdb66c2ee1ef,
title = "Towards accurate camera geopositioning by image matching",
abstract = "In this work, we present a camera geopositioning system based on matching a query image against a database with panoramic images. For matching, our system uses memory vectors aggregated from global image descriptors based on convolutional features to facilitate fast searching in the database. To speed up searching, a clustering algorithm is used to balance geographical positioning and computation time. We refine the obtained position from the query image using a new outlier removal algorithm. The matching of the query image is obtained with a recall@5 larger than 90{\%} for panorama-to-panorama matching. We cluster available panoramas from geographically adjacent locations into a single compact representation and observe computational gains of approximately 50{\%} at the cost of only a small (approximately 3{\%}) recall loss. Finally, we present a coordinate estimation algorithm that reduces the median geopositioning error by up to 20{\%}.",
keywords = "convolutional neural networks, geopositioning, Image matching, panoramic images, visual place recognition",
author = "Raffaele Imbriaco and Clint Sebastian and Egor Bondarev and {De With}, {Peter H.N.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1117/12.2522999",
language = "English",
series = "Proceedings of SPIE",
publisher = "SPIE",
editor = "Antanas Verikas and Nikolaev, {Dmitry P.} and Petia Radeva and Jianhong Zhou",
booktitle = "Eleventh International Conference on Machine Vision, ICMV 2018",
address = "United States",

}

Imbriaco, R, Sebastian, C, Bondarev, E & De With, PHN 2019, Towards accurate camera geopositioning by image matching. in A Verikas, DP Nikolaev, P Radeva & J Zhou (eds), Eleventh International Conference on Machine Vision, ICMV 2018., 110411C, Proceedings of SPIE, vol. 11041, SPIE, Bellingham, 11th International Conference on Machine Vision, ICMV 2018, Munich, Germany, 1/11/18. https://doi.org/10.1117/12.2522999

Towards accurate camera geopositioning by image matching. / Imbriaco, Raffaele; Sebastian, Clint; Bondarev, Egor; De With, Peter H.N.

Eleventh International Conference on Machine Vision, ICMV 2018. ed. / Antanas Verikas; Dmitry P. Nikolaev; Petia Radeva; Jianhong Zhou. Bellingham : SPIE, 2019. 110411C (Proceedings of SPIE; Vol. 11041).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Towards accurate camera geopositioning by image matching

AU - Imbriaco, Raffaele

AU - Sebastian, Clint

AU - Bondarev, Egor

AU - De With, Peter H.N.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - In this work, we present a camera geopositioning system based on matching a query image against a database with panoramic images. For matching, our system uses memory vectors aggregated from global image descriptors based on convolutional features to facilitate fast searching in the database. To speed up searching, a clustering algorithm is used to balance geographical positioning and computation time. We refine the obtained position from the query image using a new outlier removal algorithm. The matching of the query image is obtained with a recall@5 larger than 90% for panorama-to-panorama matching. We cluster available panoramas from geographically adjacent locations into a single compact representation and observe computational gains of approximately 50% at the cost of only a small (approximately 3%) recall loss. Finally, we present a coordinate estimation algorithm that reduces the median geopositioning error by up to 20%.

AB - In this work, we present a camera geopositioning system based on matching a query image against a database with panoramic images. For matching, our system uses memory vectors aggregated from global image descriptors based on convolutional features to facilitate fast searching in the database. To speed up searching, a clustering algorithm is used to balance geographical positioning and computation time. We refine the obtained position from the query image using a new outlier removal algorithm. The matching of the query image is obtained with a recall@5 larger than 90% for panorama-to-panorama matching. We cluster available panoramas from geographically adjacent locations into a single compact representation and observe computational gains of approximately 50% at the cost of only a small (approximately 3%) recall loss. Finally, we present a coordinate estimation algorithm that reduces the median geopositioning error by up to 20%.

KW - convolutional neural networks

KW - geopositioning

KW - Image matching

KW - panoramic images

KW - visual place recognition

UR - http://www.scopus.com/inward/record.url?scp=85063512289&partnerID=8YFLogxK

U2 - 10.1117/12.2522999

DO - 10.1117/12.2522999

M3 - Conference contribution

AN - SCOPUS:85063512289

T3 - Proceedings of SPIE

BT - Eleventh International Conference on Machine Vision, ICMV 2018

A2 - Verikas, Antanas

A2 - Nikolaev, Dmitry P.

A2 - Radeva, Petia

A2 - Zhou, Jianhong

PB - SPIE

CY - Bellingham

ER -

Imbriaco R, Sebastian C, Bondarev E, De With PHN. Towards accurate camera geopositioning by image matching. In Verikas A, Nikolaev DP, Radeva P, Zhou J, editors, Eleventh International Conference on Machine Vision, ICMV 2018. Bellingham: SPIE. 2019. 110411C. (Proceedings of SPIE). https://doi.org/10.1117/12.2522999