The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation

Jiaxin Dai; Chao Zhang; Dzmitry Aliakseyeu; Samantha Peeters; Wijnand A. Ijsselsteijn

doi:10.1145/3544548.3581263

The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation

Jiaxin Dai, Chao Zhang, Dzmitry Aliakseyeu, Samantha Peeters, Wijnand A. Ijsselsteijn

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

4 Citations (Scopus)

1 Downloads (Pure)

Abstract

It has been shown that providing explanations about AI-based systems' decisions can be an effective way to increase users' trust and acceptance. The effect of explanation design in smart home systems on users' acceptance and perceptions is however less known. We therefore explored the effect of different explanation designs on acceptance in the context of the Philips Hue smart home lighting system. We conducted interviews (N = 10) and an online experiment (N = 452) using three everyday smart home lighting scenarios with different explanation types. The results showed that although participants indicated a positive attitude towards explanations, receiving an explanation can potentially reduce the perceived control of the lighting system. Furthermore, participants preferred system-based explanations rather than user-based explanations. Our study also provides recommendations for the design of explanations in smart home systems.

Original language	English
Title of host publication	CHI 2023
Subtitle of host publication	Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Editors	Albrecht Schmidt, Kaisa Väänänen, Tesh Goyal, Per Ola Kristensson, Anicia Peters, Stefanie Mueller, Julie R. Williamson, Max L. Wilson
Publisher	Association for Computing Machinery, Inc
Number of pages	14
ISBN (Electronic)	978-1-4503-9421-5
DOIs	https://doi.org/10.1145/3544548.3581263
Publication status	Published - 19 Apr 2023
Event	2023 Conference on Human Factors in Computing Systems, CHI 2023 - Hamburg, Germany Duration: 23 Apr 2023 → 28 Apr 2023 https://chi2023.acm.org

Conference

Conference	2023 Conference on Human Factors in Computing Systems, CHI 2023
Abbreviated title	CHI 2023
Country/Territory	Germany
City	Hamburg
Period	23/04/23 → 28/04/23
Internet address	https://chi2023.acm.org

Keywords

Ambient Devices / Internet of Things
Empirical study that tells us about people
Home
Smart Environments / Connected Home

Access to Document

10.1145/3544548.3581263

Cite this

Dai, J., Zhang, C., Aliakseyeu, D., Peeters, S., & Ijsselsteijn, W. A. (2023). The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation. In A. Schmidt, K. Väänänen, T. Goyal, P. O. Kristensson, A. Peters, S. Mueller, J. R. Williamson, & M. L. Wilson (Eds.), CHI 2023: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Article 645 Association for Computing Machinery, Inc. https://doi.org/10.1145/3544548.3581263

Dai, Jiaxin ; Zhang, Chao ; Aliakseyeu, Dzmitry et al. / The Effect of Explanation Design on User Perception of Smart Home Lighting Systems : A Mixed-method Investigation. CHI 2023: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. editor / Albrecht Schmidt ; Kaisa Väänänen ; Tesh Goyal ; Per Ola Kristensson ; Anicia Peters ; Stefanie Mueller ; Julie R. Williamson ; Max L. Wilson. Association for Computing Machinery, Inc, 2023.

@inproceedings{416d2fa75807499f8dabf1d3feede2e4,

title = "The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation",

abstract = "It has been shown that providing explanations about AI-based systems' decisions can be an effective way to increase users' trust and acceptance. The effect of explanation design in smart home systems on users' acceptance and perceptions is however less known. We therefore explored the effect of different explanation designs on acceptance in the context of the Philips Hue smart home lighting system. We conducted interviews (N = 10) and an online experiment (N = 452) using three everyday smart home lighting scenarios with different explanation types. The results showed that although participants indicated a positive attitude towards explanations, receiving an explanation can potentially reduce the perceived control of the lighting system. Furthermore, participants preferred system-based explanations rather than user-based explanations. Our study also provides recommendations for the design of explanations in smart home systems.",

keywords = "Ambient Devices / Internet of Things, Empirical study that tells us about people, Home, Smart Environments / Connected Home",

author = "Jiaxin Dai and Chao Zhang and Dzmitry Aliakseyeu and Samantha Peeters and Ijsselsteijn, {Wijnand A.}",

year = "2023",

month = apr,

day = "19",

doi = "10.1145/3544548.3581263",

language = "English",

editor = "Albrecht Schmidt and Kaisa V{\"a}{\"a}n{\"a}nen and Tesh Goyal and Kristensson, {Per Ola} and Anicia Peters and Stefanie Mueller and Williamson, {Julie R.} and Wilson, {Max L.}",

booktitle = "CHI 2023",

publisher = "Association for Computing Machinery, Inc",

address = "United States",

note = "2023 Conference on Human Factors in Computing Systems, CHI 2023, CHI 2023 ; Conference date: 23-04-2023 Through 28-04-2023",

url = "https://chi2023.acm.org",

}

Dai, J, Zhang, C, Aliakseyeu, D, Peeters, S & Ijsselsteijn, WA 2023, The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation. in A Schmidt, K Väänänen, T Goyal, PO Kristensson, A Peters, S Mueller, JR Williamson & ML Wilson (eds), CHI 2023: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems., 645, Association for Computing Machinery, Inc, 2023 Conference on Human Factors in Computing Systems, CHI 2023, Hamburg, Germany, 23/04/23. https://doi.org/10.1145/3544548.3581263

The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation. / Dai, Jiaxin; Zhang, Chao; Aliakseyeu, Dzmitry et al.
CHI 2023: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ed. / Albrecht Schmidt; Kaisa Väänänen; Tesh Goyal; Per Ola Kristensson; Anicia Peters; Stefanie Mueller; Julie R. Williamson; Max L. Wilson. Association for Computing Machinery, Inc, 2023. 645.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - The Effect of Explanation Design on User Perception of Smart Home Lighting Systems

T2 - 2023 Conference on Human Factors in Computing Systems, CHI 2023

AU - Dai, Jiaxin

AU - Zhang, Chao

AU - Aliakseyeu, Dzmitry

AU - Peeters, Samantha

AU - Ijsselsteijn, Wijnand A.

PY - 2023/4/19

Y1 - 2023/4/19

N2 - It has been shown that providing explanations about AI-based systems' decisions can be an effective way to increase users' trust and acceptance. The effect of explanation design in smart home systems on users' acceptance and perceptions is however less known. We therefore explored the effect of different explanation designs on acceptance in the context of the Philips Hue smart home lighting system. We conducted interviews (N = 10) and an online experiment (N = 452) using three everyday smart home lighting scenarios with different explanation types. The results showed that although participants indicated a positive attitude towards explanations, receiving an explanation can potentially reduce the perceived control of the lighting system. Furthermore, participants preferred system-based explanations rather than user-based explanations. Our study also provides recommendations for the design of explanations in smart home systems.

AB - It has been shown that providing explanations about AI-based systems' decisions can be an effective way to increase users' trust and acceptance. The effect of explanation design in smart home systems on users' acceptance and perceptions is however less known. We therefore explored the effect of different explanation designs on acceptance in the context of the Philips Hue smart home lighting system. We conducted interviews (N = 10) and an online experiment (N = 452) using three everyday smart home lighting scenarios with different explanation types. The results showed that although participants indicated a positive attitude towards explanations, receiving an explanation can potentially reduce the perceived control of the lighting system. Furthermore, participants preferred system-based explanations rather than user-based explanations. Our study also provides recommendations for the design of explanations in smart home systems.

KW - Ambient Devices / Internet of Things

KW - Empirical study that tells us about people

KW - Home

KW - Smart Environments / Connected Home

UR - http://www.scopus.com/inward/record.url?scp=85160020298&partnerID=8YFLogxK

U2 - 10.1145/3544548.3581263

DO - 10.1145/3544548.3581263

M3 - Conference contribution

AN - SCOPUS:85160020298

BT - CHI 2023

A2 - Schmidt, Albrecht

A2 - Väänänen, Kaisa

A2 - Goyal, Tesh

A2 - Kristensson, Per Ola

A2 - Peters, Anicia

A2 - Mueller, Stefanie

A2 - Williamson, Julie R.

A2 - Wilson, Max L.

PB - Association for Computing Machinery, Inc

Y2 - 23 April 2023 through 28 April 2023

ER -

Dai J, Zhang C, Aliakseyeu D, Peeters S, Ijsselsteijn WA. The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation. In Schmidt A, Väänänen K, Goyal T, Kristensson PO, Peters A, Mueller S, Williamson JR, Wilson ML, editors, CHI 2023: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, Inc. 2023. 645 doi: 10.1145/3544548.3581263

The Effect of Explanation Design on User Perception of Smart Home Lighting Systems: A Mixed-method Investigation

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this