Social glasses: simulating interactive gaze for visually impaired people in face-to-face communication

Shi Qiu; Jun Hu; Ting Han; Hirotaka Osawa; Matthias Rauterberg

doi:10.1080/10447318.2019.1696513

Social glasses: simulating interactive gaze for visually impaired people in face-to-face communication

Shi Qiu (Corresponding author), Jun Hu (Corresponding author), Ting Han, Hirotaka Osawa, Matthias Rauterberg

EAISI Health

Research output: Contribution to journal › Article › Academic › peer-review

16 Citations (Scopus)

Abstract

Eye contact is crucial in social interactions, linking with sincerity and friendliness. However, blind people cannot see and make eye contact when they communicate with sighted people. It influences the involvement of blind people in blind-sighted conversations. Based on this context, we implemented Social glasses with an eye-tracking system, aiming to improve the communication quality between blind and sighted people in face-to-face conversations. Social glasses attempts to simulate the appropriate gaze for blind people, especially establishing the “eye contact” in blind-sighted conversations. To evaluate the impact of the interactive gaze displayed on the Social glasses, we performed dyadic-conversation tests under four experimental conditions (No Gaze, Constant Gaze, Random Gaze, and Interactive Gaze) for 40 participants. Quantitative results showed that the Interactive gaze has a positive impact on improving the communication quality between blind and sighted people, which were consistent with a qualitative analysis of the participants’ comments.

Original language	English
Pages (from-to)	839-855
Number of pages	17
Journal	International Journal of Human-Computer Interaction
Volume	36
Issue number	9
DOIs	https://doi.org/10.1080/10447318.2019.1696513
Publication status	Published - 27 May 2020

Funding

We thank Siti Aisyah binti Anas for the effort and expertise in developing the Social glasses system. We also thank Xiang Cheng, Liang Zang, and Zhi Liu to help us organize the participants from Yangzhou Special Education School and Jiangsu College of Tourism to participate in this research project. This research is strongly supported by the China Scholarship Council and facilitated by the Eindhoven University of Technology and the Shanghai Jiao Tong University. The initial prototype was partially helped by JSPS KAKENHI Grant Numbers [JP16K12484] and [JP26118006].

Funders	Funder number
Japan Society for the Promotion of Science	JP16K12484, JP26118006
Eindhoven University of Technology
China Scholarship Council
Shanghai Jiao Tong University

Access to Document

10.1080/10447318.2019.1696513

Cite this

@article{a031daa0c47f4101bb4e91a47cb4abf1,

title = "Social glasses: simulating interactive gaze for visually impaired people in face-to-face communication",

abstract = "Eye contact is crucial in social interactions, linking with sincerity and friendliness. However, blind people cannot see and make eye contact when they communicate with sighted people. It influences the involvement of blind people in blind-sighted conversations. Based on this context, we implemented Social glasses with an eye-tracking system, aiming to improve the communication quality between blind and sighted people in face-to-face conversations. Social glasses attempts to simulate the appropriate gaze for blind people, especially establishing the “eye contact” in blind-sighted conversations. To evaluate the impact of the interactive gaze displayed on the Social glasses, we performed dyadic-conversation tests under four experimental conditions (No Gaze, Constant Gaze, Random Gaze, and Interactive Gaze) for 40 participants. Quantitative results showed that the Interactive gaze has a positive impact on improving the communication quality between blind and sighted people, which were consistent with a qualitative analysis of the participants{\textquoteright} comments.",

author = "Shi Qiu and Jun Hu and Ting Han and Hirotaka Osawa and Matthias Rauterberg",

year = "2020",

month = may,

day = "27",

doi = "10.1080/10447318.2019.1696513",

language = "English",

volume = "36",

pages = "839--855",

journal = "International Journal of Human-Computer Interaction",

issn = "1044-7318",

publisher = "Taylor and Francis Ltd.",

number = "9",

}

TY - JOUR

T1 - Social glasses

T2 - simulating interactive gaze for visually impaired people in face-to-face communication

AU - Qiu, Shi

AU - Hu, Jun

AU - Han, Ting

AU - Osawa, Hirotaka

AU - Rauterberg, Matthias

PY - 2020/5/27

Y1 - 2020/5/27

N2 - Eye contact is crucial in social interactions, linking with sincerity and friendliness. However, blind people cannot see and make eye contact when they communicate with sighted people. It influences the involvement of blind people in blind-sighted conversations. Based on this context, we implemented Social glasses with an eye-tracking system, aiming to improve the communication quality between blind and sighted people in face-to-face conversations. Social glasses attempts to simulate the appropriate gaze for blind people, especially establishing the “eye contact” in blind-sighted conversations. To evaluate the impact of the interactive gaze displayed on the Social glasses, we performed dyadic-conversation tests under four experimental conditions (No Gaze, Constant Gaze, Random Gaze, and Interactive Gaze) for 40 participants. Quantitative results showed that the Interactive gaze has a positive impact on improving the communication quality between blind and sighted people, which were consistent with a qualitative analysis of the participants’ comments.

AB - Eye contact is crucial in social interactions, linking with sincerity and friendliness. However, blind people cannot see and make eye contact when they communicate with sighted people. It influences the involvement of blind people in blind-sighted conversations. Based on this context, we implemented Social glasses with an eye-tracking system, aiming to improve the communication quality between blind and sighted people in face-to-face conversations. Social glasses attempts to simulate the appropriate gaze for blind people, especially establishing the “eye contact” in blind-sighted conversations. To evaluate the impact of the interactive gaze displayed on the Social glasses, we performed dyadic-conversation tests under four experimental conditions (No Gaze, Constant Gaze, Random Gaze, and Interactive Gaze) for 40 participants. Quantitative results showed that the Interactive gaze has a positive impact on improving the communication quality between blind and sighted people, which were consistent with a qualitative analysis of the participants’ comments.

UR - http://www.scopus.com/inward/record.url?scp=85075709516&partnerID=8YFLogxK

U2 - 10.1080/10447318.2019.1696513

DO - 10.1080/10447318.2019.1696513

M3 - Article

AN - SCOPUS:85075709516

SN - 1044-7318

VL - 36

SP - 839

EP - 855

JO - International Journal of Human-Computer Interaction

JF - International Journal of Human-Computer Interaction

IS - 9

ER -

Social glasses: simulating interactive gaze for visually impaired people in face-to-face communication

Abstract

Funding

Access to Document

Other files and links

Fingerprint

Cite this