The Library
Information seeking as chasing anticipated prediction errors
Tools
Zhu, Jian-Qiao, Xiang, Wendi and Ludvig, Elliot Andrew (2017) Information seeking as chasing anticipated prediction errors. In: CogSci 2017: 39th Annual Meeting of the Cognitive Science Society, London, UK, 26–29 July 2017. Published in: Proceedings of the 39th Annual Meeting of the Cognitive Science Society
|
PDF
WRAP-informatio-seeking-chasing-anticipated-prediction-error-Zhu-2017.pdf - Accepted Version - Requires a PDF viewer. Download (683Kb) | Preview |
Official URL: https://mindmodeling.org/cogsci2017/papers/0690/
Abstract
When faced with delayed, uncertain rewards, humans and other animals usually prefer to know the eventual outcomes in advance. This preference for cues providing advance information can lead to seemingly suboptimal choices, where less reward is preferred over more reward. Here, we introduce a reinforcement-learning model of this behavior, the anticipated prediction error (APE) model, based on the idea that prediction errors themselves can be rewarding. As a result, animals will sometimes pick options that yield large prediction errors, even when the expected rewards are smaller. We compare the APE model against an alternative information-bonus model, where information itself is viewed as rewarding. These models are evaluated against a newly collected dataset with human participants. The APE model fits the data as well or better than the other models, with fewer free parameters, thus providing a more robust and parsimonious account of the suboptimal choices. These results suggest that anticipated prediction errors can be an important signal underpinning decision making.
Item Type: | Conference Item (Paper) | ||||
---|---|---|---|---|---|
Subjects: | Q Science > QA Mathematics | ||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Psychology | ||||
Library of Congress Subject Headings (LCSH): | Decision making -- Mathematical models, Uncertainty | ||||
Journal or Publication Title: | Proceedings of the 39th Annual Meeting of the Cognitive Science Society | ||||
Official Date: | 11 April 2017 | ||||
Dates: |
|
||||
Status: | Peer Reviewed | ||||
Publication Status: | Published | ||||
Date of first compliant deposit: | 15 May 2017 | ||||
Date of first compliant Open Access: | 18 January 2018 | ||||
Conference Paper Type: | Paper | ||||
Title of Event: | CogSci 2017: 39th Annual Meeting of the Cognitive Science Society | ||||
Type of Event: | Other | ||||
Location of Event: | London, UK | ||||
Date(s) of Event: | 26–29 July 2017 | ||||
Related URLs: | |||||
Open Access Version: |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |
Downloads
Downloads per month over past year