Please report any queries concerning the funding data grouped in the sections named "Externally Awarded" or "Internally Disbursed" (shown on the profile page) to
your Research Finance Administrator. Your can find your Research Finance Administrator at https://www.ucl.ac.uk/finance/research/rs-contacts.php by entering your department
Please report any queries concerning the student data shown on the profile page to:
Email: portico-services@ucl.ac.uk
Help Desk: http://www.ucl.ac.uk/ras/portico/helpdesk
Email: portico-services@ucl.ac.uk
Help Desk: http://www.ucl.ac.uk/ras/portico/helpdesk
Publication Detail
Temporal difference models describe higher-order learning in humans
-
Publication Type:Journal article
-
Publication Sub Type:Article
-
Authors:Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK, Dolan RJ, Friston KJ, Frackowiak RS
-
Publication date:06/2004
-
Pagination:664, 667
-
Journal:Nature
-
Volume:429
-
Issue:6992
-
Print ISSN:0028-0836
-
Keywords:12, A, ACCOUNT, activity, AND, ARTICLE, Behaviour, Chain, COMPLEX, COMPLEXES, Conditioning, Classical, CORRESPONDENCE, Cues, DIFFERENCE, Electric Stimulation, Environment, fMRI, FOR, Hand, Human, HUMANS, IM, IMAGING, IS, JOURNAL, LA, learning, LONDON, MAGNETIC RESONANCE, Magnetic Resonance Imaging, MAGNETIC-RESONANCE, MODEL, models, Models, Neurological, Neostriatum, Neuroscience, NO, OF, PAIN, PHYSIOLOGY, physiopathology, prediction, Punishment, relationship, Research Support, Non-U.S.Gov\'t, resonance, Result, SIGNAL, STRATEGY, SURVIVAL, TERM, THE, Theories, Time Factors, UK, Use, 2003/04, 2004mock-rae-frackowiak, 2004mock-rae-friston, 2004mock-rae-koltzenburg, 2005ReportTopTen-Wellcome, checked, Dept-Gatsby, Dept-Molecular Neuroscience, Dept-Wellcome, Div-Neurology, Div-Neuropsychiatry, July, letter, WOS, MyOPIA-submitted
-
Author URL:
-
Full Text URL:
-
Addresses:Wellcome Department of Imaging Neuroscience, 12 Queen Square, London WC1N 3BG, UK. bseymour@fil.ion.ucl.ac.uk
-
Notes:DA - 20040610 IS - 1476-4687 LA - eng PT - Journal Article SB - IM
Abstract
The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour
› More search options
UCL Researchers
Show More