A Sequential Sampling Approach to the Integration of Habits and Goals

Chao Zhang (Corresponding author), Arlette van Wissen, Ron Dotsch, Daniël Lakens, Wijnand A. IJsselsteijn

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)
25 Downloads (Pure)

Abstract

Habits often conflict with goal-directed behaviors and this phenomenon continues to attract interests from neuroscientists, experimental psychologists, and applied health psychologists. Recent computational models explain habit-goal conflicts as the competitions between two learning systems, arbitrated by a central unit. Based on recent research that combined reinforcement learning and sequential sampling, we show that habit-goal conflicts can be more parsimoniously explained by a dynamic integration of habit and goal values in a sequential sampling model, without any arbitration. A computational model was developed by extending the multialternative decision field theory with the assumptions that habits bias starting points of preference accumulation, and that goal importance and goal relevance determine sampling probabilities of goal-related attributes. Simulation studies demonstrated our approach’s ability to qualitatively reproduce important empirical findings from three paradigms – classic devaluation, devaluation with a concurrent schedule, and reversal learning, and to predict gradual changes in decision times. In addition, a parameter recovery exercise using approximate Bayesian computation showcased the possibility of fitting the model to empirical data in future research. Implications of our work for habit theories and applications are discussed.

Original languageEnglish
Pages (from-to)480-501
Number of pages22
JournalComputational Brain and Behavior
Volume7
Issue number3
Early online date5 Mar 2024
DOIs
Publication statusPublished - Sept 2024

Funding

The research is supported by the Data Science Flagship collaboration between Eindhoven University of Technology and Philips Research.

FundersFunder number
Eindhoven University of Technology

    Keywords

    • Computational modeling
    • Decision field theory
    • Habit formation
    • Habit-goal conflict
    • Reinforcement learning
    • Sequential sampling models

    Fingerprint

    Dive into the research topics of 'A Sequential Sampling Approach to the Integration of Habits and Goals'. Together they form a unique fingerprint.

    Cite this