Automatic Separation of Respiratory Flow from Motion in Thermal Videos for Infant Apnea Detection

Ilde Lorato (Corresponding author), Sander Stuijk, Mohammed Meftah, Deedee Kommers, Peter Andriessen, Carola van Pul, Gerard de Haan

Research output: Contribution to journalArticleAcademicpeer-review

14 Citations (Scopus)
51 Downloads (Pure)

Abstract

Both Respiratory Flow (RF) and Respiratory Motion (RM) are visible in thermal recordings of infants. Monitoring these two signals usually requires landmark detection for the selection of a region of interest. Other approaches combine respiratory signals coming from both RF and RM, obtaining a Mixed Respiratory (MR) signal. The detection and classification of apneas, particularly common in preterm infants with low birth weight, would benefit from monitoring both RF and RM, or MR, signals. Therefore, we propose in this work an automatic RF pixel detector not based on facial/body landmarks. The method is based on the property of RF pixels in thermal videos, which are in areas with a smooth circular gradient. We defined 5 features combined with the use of a bank of Gabor filters that together allow selection of the RF pixels. The algorithm was tested on thermal recordings of 9 infants amounting to a total of 132 minutes acquired in a neonatal ward. On average the percentage of correctly identified RF pixels was 84%. Obstructive Apneas (OAs) were simulated as a proof of concept to prove the advantage in monitoring the RF signal compared to the MR signal. The sensitivity in the simulated OA detection improved for the RF signal reaching 73% against the 23% of the MR signal. Overall, the method yielded promising results, although the positioning and number of cameras used could be further optimized for optimal RF visibility.
Original languageEnglish
Article number6306
Number of pages16
JournalSensors
Volume21
Issue number18
DOIs
Publication statusPublished - 21 Sept 2021

Funding

Funding: This research was performed within the Alarm-Limiting AlgoRithm-based Monitoring (ALARM) project funded by Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO) grant number 15345.

FundersFunder number
Nederlandse Organisatie voor Wetenschappelijk Onderzoek15345

    Keywords

    • Algorithms
    • Humans
    • Infant
    • Infant, Newborn
    • Infant, Premature
    • Motion
    • Sleep Apnea Syndromes
    • Sleep Apnea, Obstructive
    • Neonatal
    • Obstructive apnea
    • NICU
    • Vital signs
    • Thermal camera
    • Unobtrusive
    • Apnea
    • Respiratory flow
    • Respiration
    • Thermography

    Fingerprint

    Dive into the research topics of 'Automatic Separation of Respiratory Flow from Motion in Thermal Videos for Infant Apnea Detection'. Together they form a unique fingerprint.
    • Alarm-Limiting AlgoRithm-based Monitoring

      Stuijk, S. (Project Manager), Sanders, R. (Project communication officer), van der Hagen, D. (Project communication officer) & de Mol-Regels, M. (Project communication officer)

      15/06/1715/10/22

      Project: Research direct

    Cite this