Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2014 Feb:108:119-35.
doi: 10.1016/j.nlm.2013.07.018. Epub 2013 Jul 25.

The error in total error reduction

James E Witnauer  1 , Gonzalo P Urcelay  2 , Ralph R Miller  3
Affiliations
Review

The error in total error reduction

James E Witnauer et al. Neurobiol Learn Mem. 2014 Feb.

Abstract

Most models of human and animal learning assume that learning is proportional to the discrepancy between a delivered outcome and the outcome predicted by all cues present during that trial (i.e., total error across a stimulus compound). This total error reduction (TER) view has been implemented in connectionist and artificial neural network models to describe the conditions under which weights between units change. Electrophysiological work has revealed that the activity of dopamine neurons is correlated with the total error signal in models of reward learning. Similar neural mechanisms presumably support fear conditioning, human contingency learning, and other types of learning. Using a computational modeling approach, we compared several TER models of associative learning to an alternative model that rejects the TER assumption in favor of local error reduction (LER), which assumes that learning about each cue is proportional to the discrepancy between the delivered outcome and the outcome predicted by that specific cue on that trial. The LER model provided a better fit to the reviewed data than the TER models. Given the superiority of the LER model with the present data sets, acceptance of TER should be tempered.

Keywords: Associative learning; Conditioned inhibition; Cue competition; Local error reduction; Pavlovian conditioning; Total error reduction; Within-compound associations.

PubMed Disclaimer

Similar articles

See all similar articles

Cited by

References

    1. Aitken MR, Larkin MJ, Dickinson A. Re-examination of the role of within-compound associations in retrospective revaluation of causal judgements. Quarterly Journal of Experimental Psychology. 2001;54B:27–51. - PubMed
    1. Amundson JC, Witnauer JE, Pineno O, Miller RR. An inhibitory within-compound association attenuates overshadowing. Journal of Experimental Psychology: Animal Behavior Processes. 2008;34:133–143. - PMC - PubMed
    1. Annau Z, Kamin LT. The conditioned emotional response as a function of intensity of the US. Journal of Comparative and Physiological Psychology. 1961;51:128–132. - PubMed
    1. Arcediano F, Escobar M, Miller RR. Is stimulus competition an acquisition deficit or a performance deficit? Psychonomic Bulletin & Review. 2004;11:1105–1110. - PubMed
    1. Azorlosa JL, Cicala GA. Increased conditioning in rats to a blocked CS after the first compound trial. Bulletin of the Psychonomic Society. 1988;26:254–275.

Publication types