Palminteri, S;
Khamassi, M;
Joffily, M;
Coricelli, G;
(2015)
Contextual modulation of value signals in reward and punishment learning.
Nature Communications
, 6
(8096)
10.1038/ncomms9096.
Preview |
Text
Contextual modulation of value signals in reward and punishment learning..pdf Download (835kB) | Preview |
Abstract
Compared with reward seeking, punishment avoidance learning is less clearly understood at both the computational and neurobiological levels. Here we demonstrate, using computational modelling and fMRI in humans, that learning option values in a relative--context-dependent--scale offers a simple computational solution for avoidance learning. The context (or state) value sets the reference point to which an outcome should be compared before updating the option value. Consequently, in contexts with an overall negative expected value, successful punishment avoidance acquires a positive value, thus reinforcing the response. As revealed by post-learning assessment of options values, contextual influences are enhanced when subjects are informed about the result of the forgone alternative (counterfactual information). This is mirrored at the neural level by a shift in negative outcome encoding from the anterior insula to the ventral striatum, suggesting that value contextualization also limits the need to mobilize an opponent punishment learning system.
| Type: | Article |
|---|---|
| Title: | Contextual modulation of value signals in reward and punishment learning. |
| Location: | England |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1038/ncomms9096 |
| Publisher version: | http://dx.doi.org/10.1038/ncomms9096 |
| Language: | English |
| Additional information: | This article is published under a Creative Commons Attribution 4.0 International license (CC BY 4.0). This license allows you to share, copy, distribute and transmit the work for personal and non-commercial use providing author and publisher attribution is clearly stated. Further details about CC BY licenses are available at http://creativecommons.org/ licenses/by/4.0 |
| Keywords: | Biological sciences, Neuroscience |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/1471125 |
Archive Staff Only
 |
View Item |
