UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system

Iigaya, K; (2016) Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system. eLife , 5 , Article e18. 10.7554/eLife.18073. Green open access

[thumbnail of Iigaya_elife-18073-v2.pdf]
Preview
Text
Iigaya_elife-18073-v2.pdf - Published Version

Download (2MB) | Preview

Abstract

Recent experiments have shown that animals and humans have a remarkable ability to adapt their learning rate according to the volatility of the environment. Yet the neural mechanism responsible for such adaptive learning has remained unclear. To fill this gap, we investigated a biophysically inspired, metaplastic synaptic model within the context of a well-studied decision-making network, in which synapses can change their rate of plasticity in addition to their efficacy according to a reward-based learning rule. We found that our model, which assumes that synaptic plasticity is guided by a novel surprise detection system, captures a wide range of key experimental findings and performs as well as a Bayes optimal model, with remarkably little parameter tuning. Our results further demonstrate the computational power of synaptic plasticity, and provide insights into the circuit-level computation which underlies adaptive decision-making.

Type: Article
Title: Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
Open access status: An open access version is available from UCL Discovery
DOI: 10.7554/eLife.18073
Publisher version: http://dx.doi.org/10.7554/eLife.18073
Language: English
Additional information: © 2016, Iigaya et al. This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Keywords: SYNAPTIC PLASTICITY, CHANGING ENVIRONMENT, MIXED SELECTIVITY, MATCHING BEHAVIOR, PREFRONTAL CORTEX, CINGULATE CORTEX, ADAPTATION, NEURONS, MEMORY, DYNAMICS
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Life Sciences
URI: https://discovery-pp.ucl.ac.uk/id/eprint/1508888
Downloads since deposit
640Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item