Dual-camera facial landmark tracking for clinical infant monitoring

Ronald W.J.J. Saeijs, Walther E. Tjona Ten, Peter H.N. de With

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

This paper presents a new algorithm for dual-camera facial landmark tracking, intended for clinical infant monitoring. For landmark tracking of in-the-wild faces, state-of-the-art solutions use deep networks for face detection and landmark localization. For clinical infant monitoring, however, there is currently not enough data to reliably train such networks. The proposed algorithm overcomes this by incorporating 3D head tracking, to supplement face detection and to enable a refinement version of landmark localization that is more easily learned from less data. The paper reports experimental results on real-life video of infants in bed in hospital (in visual light or near-infrared light), showing good landmark tracking behavior. For challenging sequences without severe occlusions, the mean tracking error, in terms of the RMS error measured for a subset of landmarks and divided by the maximum eye-philtrum distance, remains below 20%. The proposed algorithm is used successfully in an infant monitoring system under development.

Original languageEnglish
Title of host publicationProceedings - 14th International Conference on Signal Image Technology and Internet Based Systems, SITIS 2018
EditorsRichard Chbeir, Gabriella Sanniti di Baja, Luigi Gallo, Kokou Yetongnon, Albert Dipanda, Modesto Castrillon-Santana
Place of PublicationPiscataway
PublisherInstitute of Electrical and Electronics Engineers
Pages151-158
Number of pages8
ISBN (Electronic)978-1-5386-9385-8
DOIs
Publication statusPublished - 2 Jul 2018
Event14th International Conference on Signal Image Technology and Internet Based Systems, SITIS 2018 - Las Palmas de Gran Canaria, Spain
Duration: 26 Nov 201829 Nov 2018

Conference

Conference14th International Conference on Signal Image Technology and Internet Based Systems, SITIS 2018
CountrySpain
CityLas Palmas de Gran Canaria
Period26/11/1829/11/18

Keywords

  • Dense HOG
  • Dual camera
  • Face alignment
  • Facial landmark tracking
  • Infant monitoring
  • dense HOG
  • infant monitoring
  • facial landmark tracking
  • dual camera
  • face alignment

Fingerprint Dive into the research topics of 'Dual-camera facial landmark tracking for clinical infant monitoring'. Together they form a unique fingerprint.

  • Cite this

    Saeijs, R. W. J. J., Tjona Ten, W. E., & de With, P. H. N. (2018). Dual-camera facial landmark tracking for clinical infant monitoring. In R. Chbeir, G. S. di Baja, L. Gallo, K. Yetongnon, A. Dipanda, & M. Castrillon-Santana (Eds.), Proceedings - 14th International Conference on Signal Image Technology and Internet Based Systems, SITIS 2018 (pp. 151-158). [8706162] Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/SITIS.2018.00032