The Library
Re-aligning models of habitual and goal-directed decision-making
Tools
Miller, Kevin, Ludvig, Elliot Andrew, Pezzulo, Giovanni and Shenhav, Amitai (2018) Re-aligning models of habitual and goal-directed decision-making. In: Bornstein, Aaron and Morris, Richard W and Shenhav, Amitai, (eds.) Goal-Directed Decision Making : Computations and Neural Circuits. London San Diego, CA: Cambridge Academic Press, Elsevier , pp. 407-428. ISBN 9780128120989
PDF
MillerLudvigPezzuloShenhav_submitted_GDChapter.pdf - Unspecified Version Embargoed item. Restricted access to Repository staff only - Requires a PDF viewer. Download (855Kb) |
Official URL: https://www.elsevier.com/books/goal-directed-decis...
Abstract
The classic dichotomy between habitual and goal-directed behavior is often mapped onto a dichotomy between model-free and model-based reinforcement learning (RL) algorithms, putatively implemented in segregated neuronal circuits. Despite significant heuristic value in motivating experimental investigations, several lines of evidence suggest that this mapping is in need of modification and/or realignment. First, whereas habitual and goal-directed behaviors have been shown to depend on cleanly separable neural circuitry, recent data suggest that model-based and model-free representations in the brain are largely overlapping. Second, habitual behaviors need not involve representations of expected reinforcement (i.e., need not involve RL, model-free or otherwise), but may be based instead on simple stimulus-response associations. Finally, goal-directed decisions may not reflect a single model-based algorithm but rather a continuum of “model-basedness”. These lines of evidence thus suggest a possible reconceptualization of the distinction between model-free vs. model-based RL--one in which both contribute to a single goal-directed system that is value-based, as opposed to distinct, habitual mechanisms that are value-free. In this chapter, we discuss new models that have extended the RL approach to modeling habitual and goal-directed behavior and assess how these have clarified our understanding of the underlying neural circuitry.
Item Type: | Book Item | ||||
---|---|---|---|---|---|
Subjects: | B Philosophy. Psychology. Religion > BF Psychology | ||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Psychology | ||||
Publisher: | Cambridge Academic Press, Elsevier | ||||
Place of Publication: | London San Diego, CA | ||||
ISBN: | 9780128120989 | ||||
Book Title: | Goal-Directed Decision Making : Computations and Neural Circuits | ||||
Editor: | Bornstein, Aaron and Morris, Richard W and Shenhav, Amitai | ||||
Official Date: | 24 August 2018 | ||||
Dates: |
|
||||
Number of Pages: | 484 | ||||
Page Range: | pp. 407-428 | ||||
Status: | Peer Reviewed | ||||
Publication Status: | Published | ||||
Access rights to Published version: | Restricted or Subscription Access | ||||
Copyright Holders: | © Academic Press 2019 | ||||
Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |