Denise Manahan-Vaughan
Oliver T. Wolf
Onur Güntürkün- 1Department of Neurophysiology, Medical Faculty, Ruhr University Bochum, Bochum, Germany
- 2Department of Cognitive Psychology, Faculty of Psychology, Institute of Cognitive Neuroscience, Ruhr University Bochum, Bochum, Germany
- 3Department of Biopsychology, Faculty of Psychology, Institute of Cognitive Neuroscience, Ruhr University Bochum, Bochum, Germany
The Editorial on the Research Topic
Extinction Learning from a Mechanistic and Systems Perspective
Throughout life, we learn to associate stimuli with their consequences. But some of the new information that we encounter forces us to abandon what we had previously acquired. This old information is then subject to a new learning process that is called extinction learning. This involves a large number of brain structures (Kattoor et al., 2013; Lissek et al., 2013, Lissek et al.; Merz et al., 2014). Extinction is an unusually complex learning process that can involve both Pavlovian (classical; Pavlov, 1927; Lattal and Lattal, 2012) and operant (instrument) conditioning (Skinner, 1938; Bouton et al., 2012). A further hallmark is its context-dependency (Bouton, 2004) that is likely to rely on a tight interaction between the hippocampus and other brain areas (e.g., André et al.; Icenhour et al., 2015). Thus, one of the aims of the present Research Topic was to incorporate studies that analyze the concert of neural structures that enable extinction learning.
The old memory trace may be partly, or not at all forgotten during extinction (Üngör and Lachnit, 2006). It tends to re-emerge after a passage of time (spontaneous recovery), when re-exposure to the context of original learning occurs (renewal), or unexpected exposure to the unconditioned stimulus takes place (reinstatement). Such invasive memories are key symptoms of anxiety or pain disorders. They especially occur in individuals with enhanced susceptibility (Mosig et al.; Glombiewski et al., 2015). Although pathological fear in anxiety disorders can be treated through extinction-based approaches, treatment is not always successful in the long-term, underscoring the need to understand the mechanisms underlying impaired extinction. Therefore, the second aim of the Research Topic was to include publications that are situated at the transition between basic and clinical neuroscience.
Given the relevance of extinction, it is astonishing how little we know about extinction learning, in terms of its neural fundaments and its development, especially when moving outside the realm of fear extinction in rodents. The third aim of the Research Topic was therefore to include papers on the uncharted territories of extinction learning that involve less-studied entities such as the immune system (Hadamitzky et al., 2016) or hormonal factors (Wolf et al., 2015; Maren and Holmes, 2016), less-studied species (Lengersdorf et al.) or novel paradigms (Wiescholleck et al., 2014).
One specific goal of this Research Topic was to offer a basis for trans-species comparisons, as reflected by the spectrum of animals described that range from snails, through mice, rats, and pigeons. Several of the studies also describe extinction learning in humans, including pharmacological approaches. A number of studies (André et al.; Lengersdorf et al.; André and Manahan-Vaughan; Andrianov et al.; de Oliveira et al.; Lissek et al.) addressed neurotransmitter systems that are known to be involved in other forms of learning (Morris, 2013; Seyedabadi et al., 2014; Bauer, 2015) and in synaptic plasticity that is believed to underlie learning (Harley, 2004; Lesch and Waider, 2012; Park et al., 2013; Hansen and Manahan-Vaughan, 2014; Hagena et al., 2015). Here, for example, antagonism of N-methyl-D-aspartate receptors (NMDAR) prevented appetitive extinction in pigeons (Lengersdorf et al.), and GluN2B-containing NMDAR were found to play a key role in extinction of conditioned suppression of licking in rats (de Oliveira et al.). In an interesting corollary to the latter finding, Shumake and Monfils describe how conditioned suppression of licking is far more sensitive to extinction than freezing behavior, and along with Lee et al. investigated the impact of reactivating the original memory trace on extinction success. Examination of the role of dopamine receptors in appetitive learning in rats (André and Manahan-Vaughan) and predictive learning in humans (Lissek et al.), highlight differences that may relate to the species, or the extinction learning paradigm studied.
Studies with regard to the neural basis of extinction learning, and its associated brain structures, revealed a specific and experience-dependent role of microcircuitry within the basolateral amygdala (Sangha). In their review article, Giustino and Maren challenge the common assumption that the medial prefrontal cortex (mPFC) mediates the expression, whereas the infralimbic cortex (IL) mediates the suppression of fear responses, whereas Lee at al. offer experimental evidence that extinction learning and retrieval trigger differentiated responses in the mPFC and amygdala. Goodman and Packard differentiated between extinction learning of response and place learning, and provide evidence that the effectivity of the extinction learning strategy depends on the memory system (dorsolateral striatum vs. hippocampus) that encoded the original experience. In line with studies in rats (Gershman et al.), Shiban et al. observed that gradually reducing the frequency of aversive stimuli, in a Pavlovian fear conditioning paradigm in humans, is more effective in averting the return of fear than abrupt stimulus withdrawal, and Zlomuzica et al. demonstrate that improved self-efficacy also improves fear extinction. By contrast, Vervliet and Indekkeu show that low-cost avoidance behavior is resilient to extinction. Earlier studies indicate that extinction learning is reinforced by a context change (Bouton, 2004). Here, Sjouwerman et al. report that the timing of the context change is decisive with regard to the functional outcome with regard to both extinction and renewal. At the structural and/or molecular levels, several studies provided evidence for the direct involvement of the hippocampus in extinction learning (Lissek et al.; de Oliveira et al.; Wille et al.). Whereas, de Oliveira et al. provide evidence of the involvement of the dorsal hippocampus in conditioned suppression, Wille et al. describe how modulation of the expression of chromatin remodeling factors in the ventral hippocampus rescue impaired extinction of conditioned fear. Several studies examined hormonal control of extinction learning in fear, or stress-based, paradigms (Perez-Torres et al.; Hadad-Ophir et al.; Labrenz et al.): aspects that were also addressed in a review article by Stockhorst and Antov and a research perspective by Elsenbruch and Wolf.
What becomes apparent from these studies is the emergence of fine-tuning of our understanding as to which neural structures regulate extinction learning, what common denominators (and differences) exist between species, and how the regulation of extinction learning by neurotransmitter systems aligns with current knowledge as to the role of these systems in learning and memory. The papers compiled in this Research Topic offer new and valuable insights into the mechanisms and functional implementation of extinction learning at its different levels of complexity, and form the basis for new concepts and research ideas in this field.
Author Contributions
All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
DM, OW, and OG are members of the research consortium FOR1581 “Extinction Learning: Neural mechanisms, behavioral manifestations, and clinical implications,” that is funded by the German Research Foundation (DFG) and which supported this article.
References
Bauer, E.P. (2015) Serotonin in fear conditioning processes. Behav Brain Res. 277, 68–77. doi: 10.1016/j.bbr.2014.07.028
Bouton, M. E. (2004). Context and behavioral processes in extinction. Learn. Mem. 11, 485–494. doi: 10.1101/lm.78804
Bouton, M. E., Winterbauer, N. E., and Todd, T. P. (2012). Relapse processes after the extinction of instrumental learning: renewal, resurgence, and reacquisition. Behav. Process. 90, 130–141. doi: 10.1016/j.beproc.2012.03.004
Glombiewski, J. A., Riecke, J., Holzapfel, S., Rief, W., König, S., Lachnit, H., et al. (2015). Do patients with chronic pain show autonomic arousal when confronted with feared movements? An experimental investigation of the fear-avoidance model. Pain 156, 547–554. doi: 10.1097/01.j.pain.0000460329.48633.ce
Hadamitzky, M., Bösche, K., Wirth, T., Buck, B., Beetz, O., Christians, U., et al. (2016). Memory-updating abrogates extinction of learned immunosuppression. Brain Behav. Immun. 52, 40–48. doi: 10.1016/j.bbi.2015.09.009
Hagena, H., Hansen, N., and Manahan-Vaughan, D. (2015). β-adrenergic control of hippocampal function: subserving the choreography of synaptic information storage and memory. Cereb. Cortex 26, 1349–1364. doi: 10.1093/cercor/bhv330
Hansen, N., and Manahan-Vaughan, D. (2014). Dopamine D1/D5 receptors mediate informational saliency that promotes persistent hippocampal long-term plasticity. Cereb. Cortex 24, 845–858. doi: 10.1093/cercor/bhs362
Harley, C. W. (2004). Norepinephrine and dopamine as learning signals. Neural Plast. 11, 191–204. doi: 10.1155/NP.2004.191
Icenhour, A., Kattoor, J., Benson, S., Boekstegers, A., Schlamann, M., Merz, C., et al. (2015). Neural circuitry underlying effects of context on human pain-related fear extinction in a renewal paradigm. Hum. Brain Mapp. 36, 317–393. doi: 10.1002/hbm.22837
Kattoor, J., Gizewski, E. R., Kotsis, V., Benson, S., Gramsch, C., Theysohn, N., et al. (2013). Fear conditioning in an abdominal pain model: neural responses during associative learning and extinction in healthy subjects. PLoS ONE 8:e51149. doi: 10.1371/journal.pone.0051149
Lattal, K. M., and Lattal, K. A. (2012). Facets of Pavlovian and operant extinction. Behav. Processes 90, 1–8. doi: 10.1016/j.beproc.2012.03.009
Lesch, K. P., and Waider, J. (2012). Serotonin in the modulation of neural plasticity and networks: implications for neurodevelopmental disorders. Neuron 76, 175–191. doi: 10.1016/j.neuron.2012.09.013
Lissek, S., Glaubitz, B., Uengoer, M., and Tegenthoff, M. (2013). Hippocampal activation during extinction learning predicts occurrence of the renewal effect in extinction recall. Neuroimage 81, 131–143. doi: 10.1016/j.neuroimage.2013.05.025
Maren, S., and Holmes, A. (2016). Stress and Fear Extinction. Neuropsychopharmacology 41, 58–79. doi: 10.1038/npp.2015.180
Merz, C. J., Herrmann, A., Stark, R., and Wolf, O. T. (2014). Cortisol modifies extinction learning of recently acquired fear in men. Soc. Cogn. Affect. Neurosci. 9, 1426–1434. doi: 10.1093/scan/nst137
Morris, R. G. (2013). NMDA receptors and memory encoding. Neuropharmacology 74, 32–40. doi: 10.1016/j.neuropharm.2013.04.014
Park, P., Volianskis, A., Sanderson, T. M., Bortolotto, Z. A., Jane, D. E., Zhuo, M., et al. (2013). NMDA receptor-dependent long-term potentiation comprises a family of temporally overlapping forms of synaptic plasticity that are induced by different patterns of stimulation. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 369, 20130131. doi: 10.1098/rstb.2013.0131
Seyedabadi, M., Fakhfouri, G., Ramezani, V., Mehr, S. E., and Rahimian, R. (2014). The role of serotonin in memory: interactions with neurotransmitters and downstream signaling. Exp. Brain Res. 232, 723–738. doi: 10.1007/s00221-013-3818-4
Üngör, M., and Lachnit, H. (2006). Contextual control in discrimination reversal learning. J. Exp. Psychol. Anim. Behav. Process. 32, 441–453. doi: 10.1037/0097-7403.32.4.441
Wiescholleck, V., André, M., and Manahan-Vaughan, D. (2014). Early age-dependent impairments of context-dependent extinction learning, object recognition, and object-place learning occur in rats. Hippocampus 24, 270–279. doi: 10.1002/hipo.22220
Wolf, O. T., Atsak, P., de Quervain, D. J., Roozendaal, B., and Wingenfeld, K. (2015). Stress and memory: a selective review on recent developments in the understanding of stress hormone effects on memory and their clinical relevance. J. Neuroendocrinol. doi: 10.1111/jne.12353. [Epub ahead of print].
Keywords: extinction learning, fear conditioning, appetitive learning, predictive learning, Pavlovian conditioning, brain structure, neurotransmitter, renewal
Citation: Manahan-Vaughan D, Wolf OT and Güntürkün O (2016) Editorial: Extinction Learning from a Mechanistic and Systems Perspective. Front. Behav. Neurosci. 10:115. doi: 10.3389/fnbeh.2016.00115
Received: 26 April 2016; Accepted: 24 May 2016;
Published: 13 June 2016.
Edited and reviewed by: Nuno Sousa, University of Minho, Portugal
Copyright © 2016 Manahan-Vaughan, Wolf and Güntürkün. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Denise Manahan-Vaughan, ZGVuaXNlLm1hbmFoYW4tdmF1Z2hhbkBydWIuZGU=