The Trust Recovery Journey: The Effect of Timing of Errors on the Willingness to Follow AI Advice

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/CongresprocedureConferentiebijdrageAcademicpeer review

18 Downloads (Pure)

Samenvatting

Complementing human decision-making with AI advice offers substantial advantages. However, humans do not always trust AI advice appropriately and are overly sensitive to incidental AI errors, even in cases with overall good performance. Today’s research still needs to uncover the underlying aspects of trust decline and recovery over time in repeated human-AI interactions. Our work investigates the consequences of incidental AI error on (self-reported) trust and participants’ reliance on AI advice. Results from our experiment, where 208 participants evaluated 14 legal cases before and after receiving algorithmic advice, showed that trust significantly decreased after early and late errors but was rapidly restored in both scenarios. Reliance significantly dropped only for early errors but not for late errors. In both scenarios, reliance was able to be restored. Results suggest that late (compared to early) errors are less drastic in trust loss and allow quicker recovery. These findings align with an interpretation in which humans can build up trust over time if a system is performing well, making them more tolerant of incidental AI errors.
Originele taal-2Engels
TitelIUI '24
SubtitelProceedings of the 29th International Conference on Intelligent User Interfaces
UitgeverijAssociation for Computing Machinery, Inc
Pagina's609-622
Aantal pagina's14
ISBN van elektronische versie979-8-4007-0508-3
DOI's
StatusGepubliceerd - 5 apr. 2024
EvenementIUI 2024 – International Conference on Intelligent User Interface (IUI '24) - Greenville, Greenville, Verenigde Staten van Amerika
Duur: 18 mrt. 202421 mrt. 2024

Congres

CongresIUI 2024 – International Conference on Intelligent User Interface (IUI '24)
Verkorte titelIUI
Land/RegioVerenigde Staten van Amerika
StadGreenville
Periode18/03/2421/03/24

Financiering

We thank Claudia Sprenger (Eindhoven University of Technology) for supporting the study setup, as well as Ralf Schmidt (Eindhoven University of Technology) for his guidance on the technical implementation of our study. Our gratitude extends to the European Supply Chain Forum (ESCF), the Department of Industrial Engineering and Innovation Sciences (IE&IS), the Eindhoven Artificial Intelligence Systems Institute (EAISI), and the Logistics Community Brabant for their sponsorship of the research project \"AI Planner of the Future\", which supports the PhD project \"Trust in AI over time\".

FinanciersFinanciernummer
Technische Universiteit Eindhoven

    Vingerafdruk

    Duik in de onderzoeksthema's van 'The Trust Recovery Journey: The Effect of Timing of Errors on the Willingness to Follow AI Advice'. Samen vormen ze een unieke vingerafdruk.

    Citeer dit