On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry

G. Perugia; Maike Paetzel; Ginevra Castellano

doi:10.1007/978-3-030-62056-1_11

On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry

G. Perugia, Maike Paetzel, Ginevra Castellano

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

7 Citations (Scopus)

Abstract

Facial mimicry is crucial in social interactions as it communicates the intent to bond with another person. While human-human mimicry has been extensively studied, human-agent and human-robot mimicry have been addressed only recently, and the individual characteristics that affect them are still unknown. This paper explores whether the humanlikeness and embodiment of an agent affect human facial mimicry and which personality and empathy traits are related to facial mimicry of human and artificial agents. We exposed 46 participants to the six basic emotions displayed by a video-recorded human and three artificial agents (a physical robot, a video-recorded robot, and a virtual agent) differing in
humanlikeness (humanlike, characterlike, and a morph between the two). We asked participants to recognize the facial expressions performed by each agent and measured their facial mimicry using automatic detection of facial action unit activation. Results showed that mimicry was affected by the agents’ embodiment, but not by their humanlikeness, and that it correlated both with individual traits denoting sociability and sympathy and with traits advantageous for emotion recognition.

Original language	English
Title of host publication	Social Robotics
Subtitle of host publication	12th International Conference, ICSR 2020, Golden, CO, USA, November 14–18, 2020, Proceedings
Editors	Alan R. Wagner, David Feil-Seifer, Kerstin S. Haring, Silvia Rossi, Thomas Williams, Hongsheng He, Shuzhi Sam Ge
Place of Publication	Cham
Publisher	Springer
Chapter	11
Pages	120-131
Number of pages	12
ISBN (Electronic)	978-3-030-62056-1
ISBN (Print)	978-3-030-62055-4
DOIs	https://doi.org/10.1007/978-3-030-62056-1_11
Publication status	Published - Nov 2020
Externally published	Yes
Event	12th International Conference on Social Robotics, ICSR 2020 - Golden, United States Duration: 14 Nov 2020 → 18 Nov 2020 Conference number: 12

Publication series

Name	Lecture Notes in Computer Science (LNCS)
Publisher	Springer
Volume	12483
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Name	Lecture Notes in Artificial Intelligence (LNAI)
Volume	12483

Conference

Conference	12th International Conference on Social Robotics, ICSR 2020
Abbreviated title	ICSR 2020
Country/Territory	United States
City	Golden
Period	14/11/20 → 18/11/20

Keywords

Facial mimicry
Social robots
Virtual agents

Access to Document

10.1007/978-3-030-62056-1_11

Cite this

Perugia, G., Paetzel, M., & Castellano, G. (2020). On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry. In A. R. Wagner, D. Feil-Seifer, K. S. Haring, S. Rossi, T. Williams, H. He, & S. Sam Ge (Eds.), Social Robotics: 12th International Conference, ICSR 2020, Golden, CO, USA, November 14–18, 2020, Proceedings (pp. 120-131). (Lecture Notes in Computer Science (LNCS); Vol. 12483), (Lecture Notes in Artificial Intelligence (LNAI); Vol. 12483). Springer. https://doi.org/10.1007/978-3-030-62056-1_11

Perugia, G. ; Paetzel, Maike ; Castellano, Ginevra. / On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry. Social Robotics: 12th International Conference, ICSR 2020, Golden, CO, USA, November 14–18, 2020, Proceedings. editor / Alan R. Wagner ; David Feil-Seifer ; Kerstin S. Haring ; Silvia Rossi ; Thomas Williams ; Hongsheng He ; Shuzhi Sam Ge. Cham : Springer, 2020. pp. 120-131 (Lecture Notes in Computer Science (LNCS)). (Lecture Notes in Artificial Intelligence (LNAI)).

@inproceedings{dd423e31c1194db78dc16aa59d699ee2,

title = "On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry",

abstract = "Facial mimicry is crucial in social interactions as it communicates the intent to bond with another person. While human-human mimicry has been extensively studied, human-agent and human-robot mimicry have been addressed only recently, and the individual characteristics that affect them are still unknown. This paper explores whether the humanlikeness and embodiment of an agent affect human facial mimicry and which personality and empathy traits are related to facial mimicry of human and artificial agents. We exposed 46 participants to the six basic emotions displayed by a video-recorded human and three artificial agents (a physical robot, a video-recorded robot, and a virtual agent) differing inhumanlikeness (humanlike, characterlike, and a morph between the two). We asked participants to recognize the facial expressions performed by each agent and measured their facial mimicry using automatic detection of facial action unit activation. Results showed that mimicry was affected by the agents{\textquoteright} embodiment, but not by their humanlikeness, and that it correlated both with individual traits denoting sociability and sympathy and with traits advantageous for emotion recognition.",

keywords = "Facial mimicry, Social robots, Virtual agents",

author = "G. Perugia and Maike Paetzel and Ginevra Castellano",

year = "2020",

month = nov,

doi = "10.1007/978-3-030-62056-1_11",

language = "English",

isbn = "978-3-030-62055-4",

series = "Lecture Notes in Computer Science (LNCS)",

publisher = "Springer",

pages = "120--131",

editor = "Wagner, {Alan R.} and David Feil-Seifer and Haring, {Kerstin S.} and Silvia Rossi and Thomas Williams and Hongsheng He and {Sam Ge}, Shuzhi",

booktitle = "Social Robotics",

address = "Germany",

note = "12th International Conference on Social Robotics, ICSR 2020, ICSR 2020 ; Conference date: 14-11-2020 Through 18-11-2020",

}

Perugia, G, Paetzel, M & Castellano, G 2020, On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry. in AR Wagner, D Feil-Seifer, KS Haring, S Rossi, T Williams, H He & S Sam Ge (eds), Social Robotics: 12th International Conference, ICSR 2020, Golden, CO, USA, November 14–18, 2020, Proceedings. Lecture Notes in Computer Science (LNCS), vol. 12483, Lecture Notes in Artificial Intelligence (LNAI), vol. 12483, Springer, Cham, pp. 120-131, 12th International Conference on Social Robotics, ICSR 2020, Golden, Colorado, United States, 14/11/20. https://doi.org/10.1007/978-3-030-62056-1_11

On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry. / Perugia, G.; Paetzel, Maike; Castellano, Ginevra.
Social Robotics: 12th International Conference, ICSR 2020, Golden, CO, USA, November 14–18, 2020, Proceedings. ed. / Alan R. Wagner; David Feil-Seifer; Kerstin S. Haring; Silvia Rossi; Thomas Williams; Hongsheng He; Shuzhi Sam Ge. Cham: Springer, 2020. p. 120-131 (Lecture Notes in Computer Science (LNCS); Vol. 12483), (Lecture Notes in Artificial Intelligence (LNAI); Vol. 12483).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry

AU - Perugia, G.

AU - Paetzel, Maike

AU - Castellano, Ginevra

N1 - Conference code: 12

PY - 2020/11

Y1 - 2020/11

N2 - Facial mimicry is crucial in social interactions as it communicates the intent to bond with another person. While human-human mimicry has been extensively studied, human-agent and human-robot mimicry have been addressed only recently, and the individual characteristics that affect them are still unknown. This paper explores whether the humanlikeness and embodiment of an agent affect human facial mimicry and which personality and empathy traits are related to facial mimicry of human and artificial agents. We exposed 46 participants to the six basic emotions displayed by a video-recorded human and three artificial agents (a physical robot, a video-recorded robot, and a virtual agent) differing inhumanlikeness (humanlike, characterlike, and a morph between the two). We asked participants to recognize the facial expressions performed by each agent and measured their facial mimicry using automatic detection of facial action unit activation. Results showed that mimicry was affected by the agents’ embodiment, but not by their humanlikeness, and that it correlated both with individual traits denoting sociability and sympathy and with traits advantageous for emotion recognition.

AB - Facial mimicry is crucial in social interactions as it communicates the intent to bond with another person. While human-human mimicry has been extensively studied, human-agent and human-robot mimicry have been addressed only recently, and the individual characteristics that affect them are still unknown. This paper explores whether the humanlikeness and embodiment of an agent affect human facial mimicry and which personality and empathy traits are related to facial mimicry of human and artificial agents. We exposed 46 participants to the six basic emotions displayed by a video-recorded human and three artificial agents (a physical robot, a video-recorded robot, and a virtual agent) differing inhumanlikeness (humanlike, characterlike, and a morph between the two). We asked participants to recognize the facial expressions performed by each agent and measured their facial mimicry using automatic detection of facial action unit activation. Results showed that mimicry was affected by the agents’ embodiment, but not by their humanlikeness, and that it correlated both with individual traits denoting sociability and sympathy and with traits advantageous for emotion recognition.

KW - Facial mimicry

KW - Social robots

KW - Virtual agents

UR - http://www.scopus.com/inward/record.url?scp=85097197855&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-62056-1_11

DO - 10.1007/978-3-030-62056-1_11

M3 - Conference contribution

SN - 978-3-030-62055-4

T3 - Lecture Notes in Computer Science (LNCS)

SP - 120

EP - 131

BT - Social Robotics

A2 - Wagner, Alan R.

A2 - Feil-Seifer, David

A2 - Haring, Kerstin S.

A2 - Rossi, Silvia

A2 - Williams, Thomas

A2 - He, Hongsheng

A2 - Sam Ge, Shuzhi

PB - Springer

CY - Cham

T2 - 12th International Conference on Social Robotics, ICSR 2020

Y2 - 14 November 2020 through 18 November 2020

ER -

Perugia G, Paetzel M, Castellano G. On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry. In Wagner AR, Feil-Seifer D, Haring KS, Rossi S, Williams T, He H, Sam Ge S, editors, Social Robotics: 12th International Conference, ICSR 2020, Golden, CO, USA, November 14–18, 2020, Proceedings. Cham: Springer. 2020. p. 120-131. (Lecture Notes in Computer Science (LNCS)). (Lecture Notes in Artificial Intelligence (LNAI)). doi: 10.1007/978-3-030-62056-1_11

On the Role of Personality and Empathy in Human-Human, Human-Agent, and Human-Robot Mimicry

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this