Institutional Research Information Service
UCL Logo
Please report any queries concerning the funding data grouped in the sections named "Externally Awarded" or "Internally Disbursed" (shown on the profile page) to your Research Finance Administrator. Your can find your Research Finance Administrator at https://www.ucl.ac.uk/finance/research/rs-contacts.php by entering your department
Please report any queries concerning the student data shown on the profile page to:

Email: portico-services@ucl.ac.uk

Help Desk: http://www.ucl.ac.uk/ras/portico/helpdesk
Publication Detail
States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.
  • Publication Type:
    Journal article
  • Publication Sub Type:
    Comparative Study
  • Authors:
    Gläscher J, Daw N, Dayan P, O'Doherty JP
  • Publication date:
  • Pagination:
    585, 595
  • Journal:
  • Volume:
  • Issue:
  • Status:
  • Country:
    United States
  • PII:
  • Language:
  • Keywords:
    Adolescent, Adult, Choice Behavior, Female, Forecasting, Humans, Learning, Male, Models, Neurological, Psychomotor Performance, Reinforcement (Psychology), Research Design, Reward, Young Adult
Reinforcement learning (RL) uses sequential experience with situations ("states") and outcomes to assess actions. Whereas model-free RL uses this experience directly, in the form of a reward prediction error (RPE), model-based RL uses it indirectly, building a model of the state transition and outcome structure of the environment, and evaluating actions by searching this model. A state prediction error (SPE) plays a central role, reporting discrepancies between the current model and the observed state transitions. Using functional magnetic resonance imaging in humans solving a probabilistic Markov decision task, we found the neural signature of an SPE in the intraparietal sulcus and lateral prefrontal cortex, in addition to the previously well-characterized RPE in the ventral striatum. This finding supports the existence of two unique forms of learning signal in humans, which may form the basis of distinct computational strategies for guiding behavior.
Publication data is maintained in RPS. Visit https://rps.ucl.ac.uk
 More search options
UCL Researchers
Gatsby Computational Neurosci Unit
University College London - Gower Street - London - WC1E 6BT Tel:+44 (0)20 7679 2000

© UCL 1999–2011

Search by