Throughout life, we learn to associate stimuli with their consequences. But some of the new information that we encounter forces us to abandon what we had previously acquired. This old information is then subject to a new learning process that is called extinction learning. This involves a large number of brain structures (Kattoor et al., 2013; Lissek et al., 2013, Lissek et al.; Merz et al., 2014). Extinction is an unusually complex learning process that can involve both Pavlovian (classical; Pavlov, 1927; Lattal and Lattal, 2012) and operant (instrument) conditioning (Skinner, 1938; Bouton et al., 2012). A further hallmark is its context-dependency (Bouton, 2004) that is likely to rely on a tight interaction between the hippocampus and other brain areas (e.g., André et al.; Icenhour et al., 2015). Thus, one of the aims of the present Research Topic was to incorporate studies that analyze the concert of neural structures that enable extinction learning.
The old memory trace may be partly, or not at all forgotten during extinction (Üngör and Lachnit, 2006). It tends to re-emerge after a passage of time (spontaneous recovery), when re-exposure to the context of original learning occurs (renewal), or unexpected exposure to the unconditioned stimulus takes place (reinstatement). Such invasive memories are key symptoms of anxiety or pain disorders. They especially occur in individuals with enhanced susceptibility (Mosig et al.; Glombiewski et al., 2015). Although pathological fear in anxiety disorders can be treated through extinction-based approaches, treatment is not always successful in the long-term, underscoring the need to understand the mechanisms underlying impaired extinction. Therefore, the second aim of the Research Topic was to include publications that are situated at the transition between basic and clinical neuroscience.
Given the relevance of extinction, it is astonishing how little we know about extinction learning, in terms of its neural fundaments and its development, especially when moving outside the realm of fear extinction in rodents. The third aim of the Research Topic was therefore to include papers on the uncharted territories of extinction learning that involve less-studied entities such as the immune system (Hadamitzky et al., 2016) or hormonal factors (Wolf et al., 2015; Maren and Holmes, 2016), less-studied species (Lengersdorf et al.) or novel paradigms (Wiescholleck et al., 2014).
One specific goal of this Research Topic was to offer a basis for trans-species comparisons, as reflected by the spectrum of animals described that range from snails, through mice, rats, and pigeons. Several of the studies also describe extinction learning in humans, including pharmacological approaches. A number of studies (André et al.; Lengersdorf et al.; André and Manahan-Vaughan; Andrianov et al.; de Oliveira et al.; Lissek et al.) addressed neurotransmitter systems that are known to be involved in other forms of learning (Morris, 2013; Seyedabadi et al., 2014; Bauer, 2015) and in synaptic plasticity that is believed to underlie learning (Harley, 2004; Lesch and Waider, 2012; Park et al., 2013; Hansen and Manahan-Vaughan, 2014; Hagena et al., 2015). Here, for example, antagonism of N-methyl-D-aspartate receptors (NMDAR) prevented appetitive extinction in pigeons (Lengersdorf et al.), and GluN2B-containing NMDAR were found to play a key role in extinction of conditioned suppression of licking in rats (de Oliveira et al.). In an interesting corollary to the latter finding, Shumake and Monfils describe how conditioned suppression of licking is far more sensitive to extinction than freezing behavior, and along with Lee et al. investigated the impact of reactivating the original memory trace on extinction success. Examination of the role of dopamine receptors in appetitive learning in rats (André and Manahan-Vaughan) and predictive learning in humans (Lissek et al.), highlight differences that may relate to the species, or the extinction learning paradigm studied.
Studies with regard to the neural basis of extinction learning, and its associated brain structures, revealed a specific and experience-dependent role of microcircuitry within the basolateral amygdala (Sangha). In their review article, Giustino and Maren challenge the common assumption that the medial prefrontal cortex (mPFC) mediates the expression, whereas the infralimbic cortex (IL) mediates the suppression of fear responses, whereas Lee at al. offer experimental evidence that extinction learning and retrieval trigger differentiated responses in the mPFC and amygdala. Goodman and Packard differentiated between extinction learning of response and place learning, and provide evidence that the effectivity of the extinction learning strategy depends on the memory system (dorsolateral striatum vs. hippocampus) that encoded the original experience. In line with studies in rats (Gershman et al.), Shiban et al. observed that gradually reducing the frequency of aversive stimuli, in a Pavlovian fear conditioning paradigm in humans, is more effective in averting the return of fear than abrupt stimulus withdrawal, and Zlomuzica et al. demonstrate that improved self-efficacy also improves fear extinction. By contrast, Vervliet and Indekkeu show that low-cost avoidance behavior is resilient to extinction. Earlier studies indicate that extinction learning is reinforced by a context change (Bouton, 2004). Here, Sjouwerman et al. report that the timing of the context change is decisive with regard to the functional outcome with regard to both extinction and renewal. At the structural and/or molecular levels, several studies provided evidence for the direct involvement of the hippocampus in extinction learning (Lissek et al.; de Oliveira et al.; Wille et al.). Whereas, de Oliveira et al. provide evidence of the involvement of the dorsal hippocampus in conditioned suppression, Wille et al. describe how modulation of the expression of chromatin remodeling factors in the ventral hippocampus rescue impaired extinction of conditioned fear. Several studies examined hormonal control of extinction learning in fear, or stress-based, paradigms (Perez-Torres et al.; Hadad-Ophir et al.; Labrenz et al.): aspects that were also addressed in a review article by Stockhorst and Antov and a research perspective by Elsenbruch and Wolf.
What becomes apparent from these studies is the emergence of fine-tuning of our understanding as to which neural structures regulate extinction learning, what common denominators (and differences) exist between species, and how the regulation of extinction learning by neurotransmitter systems aligns with current knowledge as to the role of these systems in learning and memory. The papers compiled in this Research Topic offer new and valuable insights into the mechanisms and functional implementation of extinction learning at its different levels of complexity, and form the basis for new concepts and research ideas in this field.
Statements
Author contributions
All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.
Acknowledgments
DM, OW, and OG are members of the research consortium FOR1581 “Extinction Learning: Neural mechanisms, behavioral manifestations, and clinical implications,” that is funded by the German Research Foundation (DFG) and which supported this article.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
BauerE. P. (2015) Serotonin in fear conditioning processes. Behav Brain Res. 277, 68–77. 10.1016/j.bbr.2014.07.028
2
BoutonM. E. (2004). Context and behavioral processes in extinction. Learn. Mem.11, 485–494. 10.1101/lm.78804
3
BoutonM. E.WinterbauerN. E.ToddT. P. (2012). Relapse processes after the extinction of instrumental learning: renewal, resurgence, and reacquisition. Behav. Process.90, 130–141. 10.1016/j.beproc.2012.03.004
4
GlombiewskiJ. A.RieckeJ.HolzapfelS.RiefW.KönigS.LachnitH.et al. (2015). Do patients with chronic pain show autonomic arousal when confronted with feared movements? An experimental investigation of the fear-avoidance model. Pain156, 547–554. 10.1097/01.j.pain.0000460329.48633.ce
5
HadamitzkyM.BöscheK.WirthT.BuckB.BeetzO.ChristiansU.et al. (2016). Memory-updating abrogates extinction of learned immunosuppression. Brain Behav. Immun. 52, 40–48. 10.1016/j.bbi.2015.09.009
6
HagenaH.HansenN.Manahan-VaughanD. (2015). β-adrenergic control of hippocampal function: subserving the choreography of synaptic information storage and memory. Cereb. Cortex26, 1349–1364. 10.1093/cercor/bhv330
7
HansenN.Manahan-VaughanD. (2014). Dopamine D1/D5 receptors mediate informational saliency that promotes persistent hippocampal long-term plasticity. Cereb. Cortex24, 845–858. 10.1093/cercor/bhs362
8
HarleyC. W. (2004). Norepinephrine and dopamine as learning signals. Neural Plast. 11, 191–204. 10.1155/NP.2004.191
9
IcenhourA.KattoorJ.BensonS.BoekstegersA.SchlamannM.MerzC.et al. (2015). Neural circuitry underlying effects of context on human pain-related fear extinction in a renewal paradigm. Hum. Brain Mapp.36, 317–393. 10.1002/hbm.22837
10
KattoorJ.GizewskiE. R.KotsisV.BensonS.GramschC.TheysohnN.et al. (2013). Fear conditioning in an abdominal pain model: neural responses during associative learning and extinction in healthy subjects. PLoS ONE8:e51149. 10.1371/journal.pone.0051149
11
LattalK. M.LattalK. A. (2012). Facets of Pavlovian and operant extinction. Behav. Processes90, 1–8. 10.1016/j.beproc.2012.03.009
12
LeschK. P.WaiderJ. (2012). Serotonin in the modulation of neural plasticity and networks: implications for neurodevelopmental disorders. Neuron76, 175–191. 10.1016/j.neuron.2012.09.013
13
LissekS.GlaubitzB.UengoerM.TegenthoffM. (2013). Hippocampal activation during extinction learning predicts occurrence of the renewal effect in extinction recall. Neuroimage81, 131–143. 10.1016/j.neuroimage.2013.05.025
14
MarenS.HolmesA. (2016). Stress and Fear Extinction. Neuropsychopharmacology41, 58–79. 10.1038/npp.2015.180
15
MerzC. J.HerrmannA.StarkR.WolfO. T. (2014). Cortisol modifies extinction learning of recently acquired fear in men. Soc. Cogn. Affect. Neurosci. 9, 1426–1434. 10.1093/scan/nst137
16
MorrisR. G. (2013). NMDA receptors and memory encoding. Neuropharmacology74, 32–40. 10.1016/j.neuropharm.2013.04.014
17
ParkP.VolianskisA.SandersonT. M.BortolottoZ. A.JaneD. E.ZhuoM.et al. (2013). NMDA receptor-dependent long-term potentiation comprises a family of temporally overlapping forms of synaptic plasticity that are induced by different patterns of stimulation. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 369, 20130131. 10.1098/rstb.2013.0131
18
PavlovI. (1927). Conditioned Reflexes (Trans. G. V. Anrep). London: Oxford University Press.
19
SeyedabadiM.FakhfouriG.RamezaniV.MehrS. E.RahimianR. (2014). The role of serotonin in memory: interactions with neurotransmitters and downstream signaling. Exp. Brain Res.232, 723–738. 10.1007/s00221-013-3818-4
20
SkinnerB. F. (1938). Behaviour of Organisms. New York, NY: Appleton-Century-Crofts.
21
ÜngörM.LachnitH. (2006). Contextual control in discrimination reversal learning. J. Exp. Psychol. Anim. Behav. Process.32, 441–453. 10.1037/0097-7403.32.4.441
22
WiescholleckV.AndréM.Manahan-VaughanD. (2014). Early age-dependent impairments of context-dependent extinction learning, object recognition, and object-place learning occur in rats. Hippocampus24, 270–279. 10.1002/hipo.22220
23
WolfO. T.AtsakP.de QuervainD. J.RoozendaalB.WingenfeldK. (2015). Stress and memory: a selective review on recent developments in the understanding of stress hormone effects on memory and their clinical relevance. J. Neuroendocrinol. 10.1111/jne.12353. [Epub ahead of print].
Summary
Keywords
extinction learning, fear conditioning, appetitive learning, predictive learning, Pavlovian conditioning, brain structure, neurotransmitter, renewal
Citation
Manahan-Vaughan D, Wolf OT and Güntürkün O (2016) Editorial: Extinction Learning from a Mechanistic and Systems Perspective. Front. Behav. Neurosci. 10:115. doi: 10.3389/fnbeh.2016.00115
Received
26 April 2016
Accepted
24 May 2016
Published
13 June 2016
Volume
10 - 2016
Edited and reviewed by
Nuno Sousa, University of Minho, Portugal
Updates
Copyright
© 2016 Manahan-Vaughan, Wolf and Güntürkün.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Denise Manahan-Vaughan denise.manahan-vaughan@rub.de
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.