Introducing Scene Understanding to Person Re-Identification using a Spatio-Temporal Multi-Camera Model

Research output: Contribution to journalConference articleAcademicpeer-review

Abstract

In this paper, we investigate person re-identification (re-ID) in a multi-camera network for surveillance applications. To this end, we create a Spatio-Temporal Multi-Camera model (ST-MC model), which exploits statistical data on a person’s entry/exit points in the multi-camera network, to predict in which camera view a person will re-appear. The created ST-MC model is used as a novel extension to the Multiple Granularity Network (MGN) [1], which is the current state of the art in person re-ID. Compared to existing approaches that are solely based on Convolutional Neural Networks (CNNs), our approach helps to improve the re-ID performance by considering not only appearance-based features of a person from a CNN, but also contextual information. The latter serves as scene understanding information complimentary to person re-ID. Experimental results show that for the DukeMTMC-reID dataset [2][3], introduction of our ST-MC model substantially increases the mean Average Precision (mAP) and Rank-1 score from 77.2% to 84.1%, and from 88.6% to 96.2%, respectively.

Original languageEnglish
Article number95
Number of pages13
JournalIS and T International Symposium on Electronic Imaging Science and Technology
Volume2020
Issue number10
DOIs
Publication statusPublished - 26 Jan 2020
Event18th Image Processing: Algorithms and Systems Conference, IPAS 2020 - Burlingame, United States
Duration: 26 Jan 202030 Jan 2020

Keywords

  • CNN
  • Context information DukeMTMC
  • DukeMTMC-reID
  • Person re-identification
  • Scene understanding
  • Spatial constraints
  • Temporal constraints

Fingerprint Dive into the research topics of 'Introducing Scene Understanding to Person Re-Identification using a Spatio-Temporal Multi-Camera Model'. Together they form a unique fingerprint.

Cite this