Improving emotional expression recognition of robots using regions of interest from human data

Anne C. Bloem, Emilia Barakova, Inge M. Hootsmans, Lena M. Opheij, Romain H.A. Toebosch, Matthias Kerzel, Pablo Barros

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)

Abstract

This paper is the first step of an attempt to equip social robots with emotion recognition capabilities comparable to those of humans. Most of the recent deep learning solutions for facial expression recognition under-perform when deployed in Human-Robot-Interaction scenarios, although they are capable of breaking records on the most varied benchmarks on facial expression recognition. The main reason for that we believe is that they are using techniques that are developed for recognition of static pictures, while in real-life scenarios, we infer emotions from intervals of expression. Utilising on the feature of CNN to form regions of interests that are similar to human gaze patterns, we use recordings from human-gaze patterns to train such a network to infer facial emotions from 3 seconds video footage of humans expressing 6 basic emotions.

Original languageEnglish
Title of host publicationHRI 2020 - Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction
PublisherIEEE Computer Society
Pages142-144
Number of pages3
ISBN (Electronic)9781450370578
DOIs
Publication statusPublished - 23 Mar 2020
Event15th Annual ACM/IEEE International Conference on Human Robot Interaction, HRI 2020 - Cambridge, United Kingdom
Duration: 23 Mar 202026 Mar 2020

Conference

Conference15th Annual ACM/IEEE International Conference on Human Robot Interaction, HRI 2020
CountryUnited Kingdom
CityCambridge
Period23/03/2026/03/20

Keywords

  • Attention maps
  • Emotion recognition
  • HRI
  • Neural networks

Fingerprint Dive into the research topics of 'Improving emotional expression recognition of robots using regions of interest from human data'. Together they form a unique fingerprint.

Cite this