The Library
Learning to generalize through predictive representations: a computational model of mediated conditioning
Tools
Ludvig, Elliot Andrew and Koop, Anna (2008) Learning to generalize through predictive representations: a computational model of mediated conditioning. In: From Animals to Animats 10: Proceedings of Simulation of Adaptive Behavior. Lecture Notes in Computer Science , Volume 5040 . Springer Berlin Heidelberg, pp. 342-351. ISBN 9783540691334
Research output not available from this repository.
Request-a-Copy directly from author or use local Library Get it For Me service.
Official URL: http://dx.doi.org/10.1007/978-3-540-69134-1_34
Abstract
Learning when and how to generalize knowledge from past experience to novel circumstances is a challenging problem many agents face. In animals, this generalization can be caused by mediated conditioning—when two stimuli gain a relationship through the mediation of a third stimulus. For example, in sensory preconditioning, if a light is always followed by a tone, and that tone is later paired with a shock, the light will come to elicit a fear reaction, even though the light was never directly paired with shock. In this paper, we present a computational model of mediated conditioning based on reinforcement learning with predictive representations. In the model, animals learn to predict future observations through the temporal-difference algorithm. These predictions are generated using both current observations and other predictions. The model was successfully applied to a range of animal learning phenomena, including sensory preconditioning, acquired equivalence, and mediated aversion. We suggest that animals and humans are fruitfully understood as representing their world as a set of chained predictions and propose that generalization in artificial agents may benefit from a similar approach.
Item Type: | Book Item | ||||
---|---|---|---|---|---|
Subjects: | B Philosophy. Psychology. Religion > BF Psychology | ||||
Divisions: | Faculty of Science, Engineering and Medicine > Science > Psychology | ||||
Library of Congress Subject Headings (LCSH): | Conditioned response -- Computer simulation, Mediated learning experience | ||||
Series Name: | Lecture Notes in Computer Science | ||||
Publisher: | Springer Berlin Heidelberg | ||||
ISBN: | 9783540691334 | ||||
ISSN: | 0302-9743 | ||||
Book Title: | From Animals to Animats 10: Proceedings of Simulation of Adaptive Behavior | ||||
Official Date: | 2008 | ||||
Dates: |
|
||||
Volume: | Volume 5040 | ||||
Page Range: | pp. 342-351 | ||||
DOI: | 10.1007/978-3-540-69134-1_34 | ||||
Status: | Not Peer Reviewed | ||||
Publication Status: | Published | ||||
Access rights to Published version: | Restricted or Subscription Access | ||||
Funder: | Alberta Ingenuity Fund, iCORE (Alta.) | ||||
Conference Paper Type: | Paper | ||||
Title of Event: | 10th International Conference on Simulation of Adaptive Behavior | ||||
Type of Event: | Conference | ||||
Location of Event: | Osaka, Japan | ||||
Date(s) of Event: | 7-12 July 2008 |
Request changes or add full text files to a record
Repository staff actions (login required)
View Item |