Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty
Autor: | Shiva Farashahi, Alireza Soltani, Daeyeol Lee, Christopher H. Donahue, Peyman Khorsand, Hyojung Seo |
---|---|
Jazyk: | angličtina |
Rok vydání: | 2017 |
Předmět: |
0301 basic medicine
Male Neural substrate Reward-based selection Reversal Learning Machine learning computer.software_genre Choice Behavior Article Task (project management) 03 medical and health sciences 0302 clinical medicine Metaplasticity Adaptation Psychological Animals Neuronal Plasticity Behavior Animal Mechanism (biology) business.industry General Neuroscience SIGNAL (programming language) Probabilistic logic Uncertainty Brain Macaca mulatta 030104 developmental biology Artificial intelligence Adaptive learning business Psychology Social psychology computer 030217 neurology & neurosurgery |
Popis: | Value-based decision making often involves integration of reward outcomes over time, but this becomes considerably more challenging if reward assignments on alternative options are probabilistic and non-stationary. Despite the existence of various models for optimally integrating reward under uncertainty, the underlying neural mechanisms are still unknown. Here we propose that reward-dependent metaplasticity (RDMP) can provide a plausible mechanism for both integration of reward under uncertainty and estimation of uncertainty itself. We show that a model based on RDMP can robustly perform the probabilistic reversal learning task via dynamic adjustment of learning based on reward feedback, while changes in its activity signal unexpected uncertainty. The model predicts time-dependent and choice-specific learning rates which strongly depend on reward history. Key predictions from this model were confirmed with behavioral data from non-human primates. Overall, our results suggest that metaplasticity can provide a neural substrate for adaptive learning and choice under uncertainty. |
Databáze: | OpenAIRE |
Externí odkaz: |