TY - GEN
T1 - "It's like a puppet master": User Perceptions of Personal Autonomy when Interacting with Intelligent Technologies.
AU - Sankaran, Supraja
AU - Markopoulos, Panos
PY - 2021/6/21
Y1 - 2021/6/21
N2 - Applications which use some form of artificial intelligence (AI) have become embedded in our everyday interactions. Very often, AI-based apps are personalized and modelled on users' needs and preferences. However, such applications of AI tread a delicate balance between enhancing user experience and jeopardizing personal autonomy. Personal autonomy and sense of agency are crucial for human well-being and development. In this paper, we probe this fine balance aiming to capture users' lived experiences and perceptions of interacting with AI-based apps. We present insights from a phenomenological study (N=15) regarding users' perception of personal autonomy when interacting with AI in everyday contexts. We found that these experiences are transitory and largely influenced by contextual factors. Users experience a loss of autonomy when their privacy or identity is threatened or when their expectations are broken. To mitigate such loss of autonomy, mechanisms for providing intelligibility and control of AI are desired.
AB - Applications which use some form of artificial intelligence (AI) have become embedded in our everyday interactions. Very often, AI-based apps are personalized and modelled on users' needs and preferences. However, such applications of AI tread a delicate balance between enhancing user experience and jeopardizing personal autonomy. Personal autonomy and sense of agency are crucial for human well-being and development. In this paper, we probe this fine balance aiming to capture users' lived experiences and perceptions of interacting with AI-based apps. We present insights from a phenomenological study (N=15) regarding users' perception of personal autonomy when interacting with AI in everyday contexts. We found that these experiences are transitory and largely influenced by contextual factors. Users experience a loss of autonomy when their privacy or identity is threatened or when their expectations are broken. To mitigate such loss of autonomy, mechanisms for providing intelligibility and control of AI are desired.
KW - Autonomy
KW - Human-AI interaction
KW - Phenomenology
KW - User experience
UR - http://www.scopus.com/inward/record.url?scp=85109528150&partnerID=8YFLogxK
U2 - 10.1145/3450613.3456820
DO - 10.1145/3450613.3456820
M3 - Conference contribution
SP - 108
EP - 118
BT - UMAP 2021 - Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization
ER -