Directing attention through gaze hints improves task solving in human–humanoid interaction

Eunice Mwangi, Emilia I. Barakova, Marta Díaz-Boladeras, Andreu Català Mallofré, Matthias Rauterberg

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)
49 Downloads (Pure)

Abstract

In this paper, we report an experimental study designed to examine how participants perceive and interpret social hints from gaze exhibited by either a robot or a human tutor when carrying out a matching task. The underlying notion is that knowing where an agent is looking at provides cues that can direct attention to an object of interest during the activity. In this regard, we asked human participants to play a card matching game in the presence of either a human or a robotic tutor under two conditions. In one case, the tutor gave hints to help the participant find the matching cards by gazing toward the correct match, in the other case, the tutor only looked at the participants and did not give them any help. The performance was measured based on the time and the number of tries taken to complete the game. Results show that gaze hints (helping tutor) made the matching task significantly easier (fewer tries) with the robot tutor. Furthermore, we found out that the robots’ gaze hints were recognized significantly more often than the human tutor gaze hints, and consequently, the participants performed significantly better with the robot tutor. The reported study provides new findings towards the use of non-verbal gaze hints in human–robot interaction, and lays out new design implications, especially for robot-based educative interventions.

Original languageEnglish
Pages (from-to)343-355
Number of pages13
JournalInternational Journal of Social Robotics
Volume10
Issue number3
DOIs
Publication statusPublished - 1 Jun 2018

Fingerprint

Robots
Robotics

Keywords

  • Attentional cues
  • Directed attention
  • Embodied cues
  • Facial orientation
  • Game-based human–robot interaction
  • Gaze perception
  • Gaze-based interactions

Cite this

@article{4a53cc6651a64ea09d0b5e7cfbe72707,
title = "Directing attention through gaze hints improves task solving in human–humanoid interaction",
abstract = "In this paper, we report an experimental study designed to examine how participants perceive and interpret social hints from gaze exhibited by either a robot or a human tutor when carrying out a matching task. The underlying notion is that knowing where an agent is looking at provides cues that can direct attention to an object of interest during the activity. In this regard, we asked human participants to play a card matching game in the presence of either a human or a robotic tutor under two conditions. In one case, the tutor gave hints to help the participant find the matching cards by gazing toward the correct match, in the other case, the tutor only looked at the participants and did not give them any help. The performance was measured based on the time and the number of tries taken to complete the game. Results show that gaze hints (helping tutor) made the matching task significantly easier (fewer tries) with the robot tutor. Furthermore, we found out that the robots’ gaze hints were recognized significantly more often than the human tutor gaze hints, and consequently, the participants performed significantly better with the robot tutor. The reported study provides new findings towards the use of non-verbal gaze hints in human–robot interaction, and lays out new design implications, especially for robot-based educative interventions.",
keywords = "Attentional cues, Directed attention, Embodied cues, Facial orientation, Game-based human–robot interaction, Gaze perception, Gaze-based interactions",
author = "Eunice Mwangi and Barakova, {Emilia I.} and Marta D{\'i}az-Boladeras and Mallofr{\'e}, {Andreu Catal{\`a}} and Matthias Rauterberg",
year = "2018",
month = "6",
day = "1",
doi = "10.1007/s12369-018-0473-8",
language = "English",
volume = "10",
pages = "343--355",
journal = "International Journal of Social Robotics",
issn = "1875-4791",
publisher = "Springer",
number = "3",

}

Directing attention through gaze hints improves task solving in human–humanoid interaction. / Mwangi, Eunice; Barakova, Emilia I.; Díaz-Boladeras, Marta; Mallofré, Andreu Català; Rauterberg, Matthias.

In: International Journal of Social Robotics, Vol. 10, No. 3, 01.06.2018, p. 343-355.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Directing attention through gaze hints improves task solving in human–humanoid interaction

AU - Mwangi, Eunice

AU - Barakova, Emilia I.

AU - Díaz-Boladeras, Marta

AU - Mallofré, Andreu Català

AU - Rauterberg, Matthias

PY - 2018/6/1

Y1 - 2018/6/1

N2 - In this paper, we report an experimental study designed to examine how participants perceive and interpret social hints from gaze exhibited by either a robot or a human tutor when carrying out a matching task. The underlying notion is that knowing where an agent is looking at provides cues that can direct attention to an object of interest during the activity. In this regard, we asked human participants to play a card matching game in the presence of either a human or a robotic tutor under two conditions. In one case, the tutor gave hints to help the participant find the matching cards by gazing toward the correct match, in the other case, the tutor only looked at the participants and did not give them any help. The performance was measured based on the time and the number of tries taken to complete the game. Results show that gaze hints (helping tutor) made the matching task significantly easier (fewer tries) with the robot tutor. Furthermore, we found out that the robots’ gaze hints were recognized significantly more often than the human tutor gaze hints, and consequently, the participants performed significantly better with the robot tutor. The reported study provides new findings towards the use of non-verbal gaze hints in human–robot interaction, and lays out new design implications, especially for robot-based educative interventions.

AB - In this paper, we report an experimental study designed to examine how participants perceive and interpret social hints from gaze exhibited by either a robot or a human tutor when carrying out a matching task. The underlying notion is that knowing where an agent is looking at provides cues that can direct attention to an object of interest during the activity. In this regard, we asked human participants to play a card matching game in the presence of either a human or a robotic tutor under two conditions. In one case, the tutor gave hints to help the participant find the matching cards by gazing toward the correct match, in the other case, the tutor only looked at the participants and did not give them any help. The performance was measured based on the time and the number of tries taken to complete the game. Results show that gaze hints (helping tutor) made the matching task significantly easier (fewer tries) with the robot tutor. Furthermore, we found out that the robots’ gaze hints were recognized significantly more often than the human tutor gaze hints, and consequently, the participants performed significantly better with the robot tutor. The reported study provides new findings towards the use of non-verbal gaze hints in human–robot interaction, and lays out new design implications, especially for robot-based educative interventions.

KW - Attentional cues

KW - Directed attention

KW - Embodied cues

KW - Facial orientation

KW - Game-based human–robot interaction

KW - Gaze perception

KW - Gaze-based interactions

UR - http://www.scopus.com/inward/record.url?scp=85048667753&partnerID=8YFLogxK

U2 - 10.1007/s12369-018-0473-8

DO - 10.1007/s12369-018-0473-8

M3 - Article

C2 - 30996753

AN - SCOPUS:85048667753

VL - 10

SP - 343

EP - 355

JO - International Journal of Social Robotics

JF - International Journal of Social Robotics

SN - 1875-4791

IS - 3

ER -