Discrete coding of reward probability and uncertainty by dopamine neurons
- PMID: 12649484
- DOI: 10.1126/science.1077349
Discrete coding of reward probability and uncertainty by dopamine neurons
Abstract
Uncertainty is critical in the measure of information and in assessing the accuracy of predictions. It is determined by probability P, being maximal at P = 0.5 and decreasing at higher and lower probabilities. Using distinct stimuli to indicate the probability of reward, we found that the phasic activation of dopamine neurons varied monotonically across the full range of probabilities, supporting past claims that this response codes the discrepancy between predicted and actual reward. In contrast, a previously unobserved response covaried with uncertainty and consisted of a gradual increase in activity until the potential time of reward. The coding of uncertainty suggests a possible role for dopamine signals in attention-based learning and risk-taking behavior.
Comment in
-
Neuroscience. Gambling on dopamine.Science. 2003 Mar 21;299(5614):1856-8. doi: 10.1126/science.1083627. Science. 2003. PMID: 12649473 No abstract available.
Similar articles
-
Neuroscience. Gambling on dopamine.Science. 2003 Mar 21;299(5614):1856-8. doi: 10.1126/science.1083627. Science. 2003. PMID: 12649473 No abstract available.
-
Adaptive coding of reward value by dopamine neurons.Science. 2005 Mar 11;307(5715):1642-5. doi: 10.1126/science.1105370. Science. 2005. PMID: 15761155
-
Correlated coding of motivation and outcome of decision by dopamine neurons.J Neurosci. 2003 Oct 29;23(30):9913-23. doi: 10.1523/JNEUROSCI.23-30-09913.2003. J Neurosci. 2003. PMID: 14586021 Free PMC article.
-
Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.Prog Brain Res. 2000;126:193-215. doi: 10.1016/S0079-6123(00)26015-9. Prog Brain Res. 2000. PMID: 11105648 Review.
-
Dopamine signals for reward value and risk: basic and recent data.Behav Brain Funct. 2010 Apr 23;6:24. doi: 10.1186/1744-9081-6-24. Behav Brain Funct. 2010. PMID: 20416052 Free PMC article. Review.
Cited by
-
Basal ganglia circuit loops, dopamine and motivation: A review and enquiry.Behav Brain Res. 2015 Sep 1;290:17-31. doi: 10.1016/j.bbr.2015.04.018. Epub 2015 Apr 20. Behav Brain Res. 2015. PMID: 25907747 Free PMC article. Review.
-
Reward uncertainty enhances incentive salience attribution as sign-tracking.Behav Brain Res. 2013 Feb 1;238:53-61. doi: 10.1016/j.bbr.2012.10.006. Epub 2012 Oct 16. Behav Brain Res. 2013. PMID: 23078951 Free PMC article.
-
Exploring the steps of learning: computational modeling of initiatory-actions among individuals with attention-deficit/hyperactivity disorder.Transl Psychiatry. 2024 Jan 8;14(1):10. doi: 10.1038/s41398-023-02717-7. Transl Psychiatry. 2024. PMID: 38191535 Free PMC article.
-
Differential coding of uncertain reward in rat insular and orbitofrontal cortex.Sci Rep. 2016 Apr 7;6:24085. doi: 10.1038/srep24085. Sci Rep. 2016. PMID: 27052943 Free PMC article.
-
Choice-correlated activity fluctuations underlie learning of neuronal category representation.Nat Commun. 2015 Mar 11;6:6454. doi: 10.1038/ncomms7454. Nat Commun. 2015. PMID: 25759251 Free PMC article.
MeSH terms
Substances
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous