Abstract
Aversive or rewarding experiences are remembered better than those of lesser survival significance. These emotional memories, whether negative or positive, leave traces in the brain which can later be retrieved and strongly influence how we perceive, how we form associations with environmental stimuli and, ultimately, guide our decision-making. In this review aticle, we outline what constitutes an emotional memory by focusing on threat- and reward-related memories and describe how they are formed in the brain during learning and reformed during retrieval. Finally, we discuss how the field is moving from understanding emotional memory brain circuits separately, towards studying how these two opposing brain systems interact to guide choices during conflict. Here, we outline two novel tasks in rodents that model opposing binary choices (approach or avoid) guided by competing emotional memories. The prefrontal cortex (PFC) is a major integration hub of emotional information which is also known to be critical for decision-making. Consequently, brain circuits that involve this brain region may be key for understanding how the retrieval of emotional memories flexibly orchestrates adaptive choice behavior. Because several mental disorders (e.g., drug addiction and depression) are characterized by deficits in decision-making in the face of conflicting emotional memories (maladaptively giving more weight to one memory over the other), the development of choice-based animal models for emotional regulation could give rise to new approaches for the treatment of these disorders in humans.
Introduction
An emotional memory represents the storage of information about a survival experience. Through associative mechanisms, neurons assign emotional significance to environmental stimuli, and these memories influence motivation to behave adaptively. Thus, individuals revisit places previously associated with reward, whereas they avoid ones previously associated with aversion.
Emotional memories can be categorized along two dimensions: salience ranging from weak to strong, and valence ranging from negative (aversive) to positive (rewarding). The salience of an emotional memory represents the apparent impact of the experience, and it correlates with arousal intensity. Emotionally-charged memories are better retrieved than neutral ones (Conway et al., 1994). Indeed, stress responses elicited during salient situations facilitate memory formation (McGaugh, 1983). Importantly, salience signals that something relevant is occurring and it is dissociable from valence (Lin and Nicolelis, 2008). The valence of an emotional memory represents the value of the experience; whether environmental elements were paired with pleasant or aversive experiences. These value- and saliency-based signaling are encoded in neural circuits that involve the amygdala, nucleus accumbens (NAcc) and prefrontal cortex (PFC), which ultimately guide behavior (Rangel et al., 2008; Tye, 2018).
Many groups focus on dissecting the contribution of neural circuits connecting them in valence and salience, partly to understand emotional processing (Namburi et al., 2016). Several decades of research on aversive memories have focused primarily on the contribution of the amygdala in threat (fear) conditioning. Also, decades of research on appetitive and drug-seeking memories have focused primarily on the NAcc in reward encoding. Although there is overlap (Xiu et al., 2014), encoding of aversive memories occurs in several structures including the amygdala, prelimbic (PL) PFC and periaqueductal gray matter (PAG) whereas encoding of reward or safety memories occurs mainly in the NAcc, ventral tegmental area (VTA), as well as infralimbic (IL) prefrontal and orbitofrontal cortices (OFC; Peters et al., 2009; Sotres-Bayon and Quirk, 2010). This is not to say that structures are exclusively dedicated to either reward or aversion processing; the amygdala is also critical for reward processing (Balleine et al., 2003) whereas NAcc mediates aversion as well (Berridge, 2019). The reward and aversion models we describe below are not comprehensive, but rather, simplified models that are suitable as an outline for reward and aversion circuits.
Aversive Memories
Learning to detect and respond to threats is necessary for survival. Individuals remember aversive situations, such that they subsequently avoid stimuli previously associated with aversion. These aversive experiences are stored as emotional memories that guide our behavior. The most fruitful advances in the neurobiology of aversive encoding have been achieved by studying Pavlovian threat conditioning (Davis, 1992b; LeDoux, 1996). Threat conditioning involves learning that a neutral stimulus, such as a tone, predicts a co-terminating aversive event, such as a shock. Subsequent presentations of the tone evoke defensive behaviors that include freezing and avoidance (Figure 1A).
Figure 1
The neural circuit involving this type of conditioning centers on the amygdala (Davis, 1992a; LeDoux, 1992), a structure with well-suited connections to detect and avoid the threat. Information about the tone and shock converge in the amygdala directly from sensory thalamus (LeDoux et al., 1990; Quirk et al., 1995). Synaptic plasticity mechanisms within the amygdala have been identified as a key component underlying the ability to learn and store this type of emotional experience (Rodrigues et al., 2004). After the initial synaptic strengthening that occurred during learning-related plasticity, other processes take over to maintain the potentiation of synapses, thereby keeping the memory in long-term storage (Sacktor, 2008).
When retrieving the conditioned threat memory, amygdala neurons trigger defensive responses via descending projections to midbrain structures, such as the PAG, involved in freezing (LeDoux et al., 1988; Amorapanth et al., 1999), or the NAcc, involved in active threat avoidance (Amorapanth et al., 2000; Bravo-Rivera et al., 2014; Ramirez et al., 2015). Importantly, the amygdala has strong reciprocal connections with PFC (Gabbott et al., 2005), which allows PL to upregulate fear responses generated by the amygdala (Burgos-Robles et al., 2009; Sotres-Bayon et al., 2012). Thus, expressing a fear memory involves the concerted activity of a distributed neural circuit.
Because aversive memories stored in the defensive survival circuit can last a lifetime (Gale et al., 2004), their expression needs to be highly regulated. One way to suppress obsolete fear memories is through fear extinction, in which subjects learn that the once-threatening stimulus no longer predicts danger (Pavlov, 1927; Rescorla, 2001). After threat conditioning, repeated exposure to unreinforced tones progressively results in reduced freezing (Bouton and Bolles, 1980). However, fear is not unlearned or erased; rather, a safety memory is formed that suppresses the original fear memory (Lolordo and Rescorla, 1966; Quirk and Mueller, 2008). Understanding the neural circuit that underlies fear extinction promises to improve methods to treat fear-related disorders (Anderson and Insel, 2006). Because extinction is the basis of exposure-based therapy in humans, its neuronal circuits are currently under intense investigation (Sotres-Bayon et al., 2006; Quirk and Mueller, 2008). This neuronal circuit involves both the amygdala and PFC (Sotres-Bayon et al., 2007, 2009). In brief, the current circuit model for extinction requires that information about the conditioned tone from the amygdala reaches IL. After presentations of tones in the absence of the shock, IL facilitates plasticity in the amygdala that stores the extinction memory (Amano et al., 2010; Amir et al., 2011; Cho et al., 2013; Do-Monte et al., 2015). Plasticity changes in amygdala neurons store the extinction memory and inhibit fear-generating neurons, thereby reducing fear expression. Yet extinction is a passive form of fear suppression, and often the adaptive response needs to be immediate to either actively suppress fear in order to obtain a reward or to actively avoid threatening stimuli or places. Fear memories not only trigger reactive freezing but also trigger deliberate actions in the face of threats such as avoidance. Evidence suggests that the amygdala is necessary for avoidance behaviors (Choi et al., 2010; Bravo-Rivera et al., 2014; Ramirez et al., 2015). Interestingly, regulation of these amygdala-dependent avoidance responses requires PL encoding (Bravo-Rivera et al., 2014, 2015a), which controls behavioral output through projections to NAcc, a limbic-motor interface (Bravo-Rivera et al., 2015b; Floresco, 2015; Diehl et al., 2019).
Retrieval of fear memories involves activation of neuronal circuits containing previously potentiated synapses. When retrieving the memory, synapses undergo re-strengthening. This process is called reconsolidation (Alberini and Ledoux, 2013). Because synapses undergo restructuration during reconsolidation, this process renders memories labile to editing; this allows current memories to interact with the retrieved ones. For example, during the reconsolidation of a fear-memory, new information can be integrated, such as if the cue was present in a different context from the original dangerous experience (Nader and Hardt, 2009). The susceptibility of memories during reconsolidation is currently explored as a therapeutic target, such that administering drugs that impair reconsolidation may disrupt the fear memory, thereby alleviating excessive fear in patients (Kindt et al., 2009). The reviewed brain mechanisms that underlie formation/reformation of aversive memories can occur simultaneously with those of memories with the opposite valence, reward, such that memories can have both positive and negative associated valences.
Reward Memories
Natural rewards produce pleasure and are necessary for species preservation, such as with food and sex. To benefit from the experience, individuals learn to associate stimuli and actions with the availability of rewards. A commonly used assay to study reward learning is appetitive instrumental conditioning (Cardinal et al., 2002), in which an action such as pressing a bar leads to a reward such as food (Figure 1B). The neural circuit that underlies this approach behavior has been widely studied and involves the VTA and NAcc (Parkinson et al., 2000; Martin-Soelch et al., 2007). In a series of experiments in the 1950s, Olds and Milner (1954) found that rats will press a lever to self-stimulate the VTA to NAcc pathway at an even faster rate than to obtain food. Activity in this pathway is responsible for learning to predict future rewards (Schultz and Dickinson, 2000) and storing reward associations (Kalivas and Nakamura, 1999). Thus, synaptic plasticity in this circuit permits associations to be formed between stimuli/responses and rewards. The VTA projects primarily to NAcc/PFC and receives input from the lateral hypothalamus that detects the presence of food reward (Schultz, 1998). The NAcc is the ventral region of the striatum, the main input nucleus of the basal ganglia and the site of action for most addictions (Kalivas et al., 2006). In turn, the NAcc sends axons to brain regions involved in the movement, including the globus pallidus and, via the thalamus-PFC relay, motor cortices. In brief, in instrumental conditioning, the response associated with the availability of a reward excites the pathway from the VTA to NAcc, which in turn triggers an approach response by acting on the motor system (Yun et al., 2004; Fields et al., 2007).
Retrieval of the cue associated with the reward triggers the excitation of VTA. In reward conditioning, rodents learn that a sensory stimulus (e.g., light) predicts a reward. When presented with reward, VTA neurons release dopamine in PFC and NAcc, which together with a concurrent surge of norepinephrine, stores the salient reward memory with positive valence. After learning, the reward memory is stored in the PFC and NAcc, and activation of the PFC-NAcc circuit that participated in storing the reward memory results in retrieval of the memory (Peters et al., 2005, 2009; Kalivas et al., 2006).
Vast research resources are directed to understand the underpinnings of reconsolidation and extinction of reward memories partly because tampering with these processes may serve as a therapy for addictions (Otis et al., 2015). Moreover, like fear extinction, drug-seeking extinction is also mediated by PFC. In fact, in drug-seeking as in fear conditioning, the same dorsal-ventral dichotomy (PL-IL) function of PFC is involved, but via divergent projections to the NAcc rather than to the amygdala (Peters et al., 2009). Notwithstanding, the approach system must interact and even suppress the aversive system to attain reward. Therefore, to have a complete understanding of the neural circuit that supports approach behaviors, it is necessary to understand how reward interacts with the neural circuit controlling opposing actions such as avoidance behaviors.
Interaction of Competing Emotional Memories Circuits
A burning question in the field of emotion neurobiology is how does the brain integrates different types of emotional experiences to achieve an adaptive behavioral response? There are several structures that engage in balancing competing drives that have been characterized, to some extent. The resolution of this emotional conflict is thought to be critically mediated by cortical subregions of PFC integrating information from and exerting its influence over downstream subcortical structures. Next, we discuss how the PFC has been involved in processing competing emotional memories.
A characteristic feature of PFC is that it is a massive information hub, receiving input from other cortices, thalamus, amygdala, and the hippocampus, among others, and it is likely involved in deliberate decision-making. The central components of the aversion and reward circuits are highly interconnected with the PFC (Peters et al., 2009). Indeed, damage to this cortical region impairs the ability to flexibly select suitable behaviors (Sotres-Bayon et al., 2006; Schoenbaum et al., 2009). A currently popular notion of PFC suggests its key role in emotional processing and decision making (Damasio, 1996; Miller and Cohen, 2001) which often depends on weighing information about aversion and reward memories to control behavior. The PFC may exert its conflict resolution function through connections with other structures, such as the striatum (Berendse et al., 1992), thalamus (Choi et al., 2019), ventral hippocampus (Schumacher et al., 2018) and amygdala (McDonald et al., 1996; Gabbott et al., 2005), to name a few. A broad range of studies has shown that medial PFC (mPFC) encodes both rewarding (Otis et al., 2015) and aversive stimuli (Burgos-Robles et al., 2009). Enhancing activity in PL increases fear and drug-seeking, while activity in IL decreases fears and drug-seeking, through projections to the amygdala and the NAcc, respectively. These findings suggest that mPFC provides control of the amygdala for aversive memories and of the NAcc for reward memories (Peters et al., 2009). On the other hand, damage to OFC impairs reversal learning of both aversive and appetitive association (Murray et al., 2007). In addition, although most OFC studies have focused on its role in processing reward value, there is also evidence that OFC signals aversive stimuli (Morrison and Salzman, 2011). In fact, a recent report shows that neurons in OFC can respond to both aversive and appetitive stimuli (Morrison et al., 2011) and guide choice-behavior (Ramírez-Lugo et al., 2016). This suggests that OFC weighs information from these opposing stimuli and regulates behavior. Further, the PFC has direct access to/from a set of brain structures that signal context (hippocampus Smith and Bulkin, 2014), “controllability” (raphe nucleus Maier and Watkins, 2005) and perception (sensory thalamus as well as sensory cortices). Taken together, these findings suggest both IL/PL and OFC coordinate the interaction between threat- and reward-related stimuli. The working hypothesis is that PFC is responsible for orchestrating the interaction between the drive to avoid and the drive to approach, thus allowing for flexible emotional regulation (Sotres-Bayon and Quirk, 2010).
Using Conflict Choice Behavior to Understand Competing Emotional Memories
In our everyday life, we are frequently challenged with emotional conflicts. We are often challenged with opportunities of reward with a risk of aversion, and sometimes reward attainment involves imminent aversion. The field has made great strides in characterizing neuronal systems of reward-seeking and aversion avoidance, and with the development of new technologies, it is now timely to probe how these two systems compete for control of behavior. Many behavioral tasks that involve evaluating approach and avoidance motivated behaviors have been developed (Elliot, 2008). Yet only recently a few have evaluated them when in competition during conflict. Here, we outline two novel conflict tasks in rodents that model opposing binary choices (approach or avoid) guided by competing emotional memories.
Most previous studies of emotional memory regulation use tasks where individuals have only one behavioral goal; either approach a reward or avoid a threat. In these cases, emotional memories are studied in isolation. But in nature, when an animal is challenged to choose between approach or avoidance drives, both systems interact. To understand the interaction between competing emotional memories, we need to look at the nature of the choice-mediated conflict. This involves considering the weights of each emotional memory because animals choose what behavior to execute guided by the relative weighs of opposing memories. Both early and recent works have made efforts to characterize approach-avoidance conflict (Miller, 1944; Choi and Kim, 2010; Friedman et al., 2015; Burgos-Robles et al., 2017; Schumacher et al., 2018; Choi et al., 2019; Verharen et al., 2019; Walters et al., 2019). We recently developed two related approach-avoidance conflict animal models that are set to separate discrete variables (reward memory retrieval, threat memory retrieval and their competition) in the same individual by putting variable weigh on reward- or threat-related memories through training, and therefore are amenable to study both sides of the coin: when reward has higher relative value than threat and vice versa.
One of our tasks requires rodents to choose whether to step into a safe platform to avoid the threat, while the other task requires rodents to choose whether to cross a threat zone to obtain a reward. Both tasks involve an approach-avoidance conflict and a cost-benefit decision guided by competing emotional memories. The platform-mediated avoidance (PMA) task serves a model of risky-reward seeking, in which animals foraging reward in the corner of a behavioral box must go onto a safety platform on the opposite corner to avoid a tone-signaled foot-shock (Bravo-Rivera et al., 2014, 2016; Figure 2A). The advantages and disadvantages of PMA compared to other avoidance tasks have been described elsewhere (Diehl et al., 2019). In the crossing-mediated conflict (CMC) task, an animal that is placed on one end of a straight alley must cross a grid to obtain a light-signaled reward on the safe zone on the opposite side of the alley. However, the animal also learns that a sound signals the presence of a foot-shock in the grid (threat zone). This task allows for discrimination of no-conflict trials (crossings when obtaining reward does not have a cost) and conflict trials (crossings that challenge the animal to take action to face the threat in order to obtain the reward; Hernandez-Jaramillo and Sotres-Bayon, 2018; Illescas-Huerta et al., 2018; Figure 2B). The CMC task is similar to the task employed by Olds (1958) in his classical self-stimulation studies, but this model of active suppression of fear remains largely unstudied and unmodeled. The key difference between PMA and CMC tasks is that in the former animals seek reward while avoiding threat and, in the latter, animals must actively overcome the threat to execute reward-seeking behavior. In PMA, the threat is a risk while in CMC, the threat is imminent and must be faced. Notably, both tasks allow identifying risk-prone or “courageous” and risk-taker or “cowardly” traits in rats. These features make these conflict tasks suitable to study brain circuit mechanisms that underlie the ability of animals to execute opposing behavioral responses guided by competing emotional memories.
Figure 2
Maladaptive Emotional Decision-Making in Humans
Individuals weigh benefits of rewards against their associated costs to make more advantageous decisions (Hu, 2016). There are, however, crippling mental disorders that impair an individual’s ability to make appropriate decisions when presented with risky-reward opportunities. A major depressive disorder is characterized by a persistently depressed mood. Patients are unmotivated to seek rewards, which impairs the quality of life (American-Psychiatric-Association, 2013). Depressive patients tend to have exaggerated perceptions of punishment (Hevey et al., 2017), which leads to excessive avoidance and perpetuate their symptoms (Trew, 2011). Another mental disorder that impairs decisions regarding risky-reward situations is addiction. Addiction patients have exaggerated perceptions of reward and decreased sensitivity to punishment, which often results in neglecting the aversive consequences that addictions entail, such as health detriment or social problems (Myers et al., 2017). Characterizing motivation circuits that govern approach/avoidance conflict behavior in rodents is an important step to understand the underpinnings of these emotional disorders in humans.
Statements
Author contributions
CB-R and FS-B wrote the manuscript.
Funding
This work was supported by National Institutes of Health (NIH) F32MH113316 to CB-R and by the Consejo Nacional de Ciencia y Tecnología (Grant PN2463), as well as by the Dirección General de Asuntos del Personal Académico de la Universidad Nacional Autónoma de México (Grants IN205417 and IN214520) to FS-B.
Acknowledgments
We thank G.J. Quirk for helpful comments on this manuscript and Sotres-Bayon laboratory members for helpful discussions.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AlberiniC. M.LedouxJ. E. (2013). Memory reconsolidation. Curr. Biol.23, R746–R750. 10.1016/j.cub.2013.06.046
2
AmanoT.UnalC. T.PareD. (2010). Synaptic correlates of fear extinction in the amygdala. Nat. Neurosci.13, 489–494. 10.1038/nn.2499
3
American-Psychiatric-Association. (2013). Diagnostic and Statistical Manual of Mental Disorders.5th Edn.Washington, DC: American Psychiatric Association.
4
AmirA.AmanoT.PareD. (2011). Physiological identification and infralimbic responsiveness of rat intercalated amygdala neurons. J. Neurophysiol.105, 3054–3066. 10.1152/jn.00136.2011
5
AmorapanthP.LeDouxJ. E.NaderK. (2000). Different lateral amygdala outputs mediate reactions and actions elicited by a fear-arousing stimulus. Nat. Neurosci.3, 74–79. 10.1038/71145
6
AmorapanthP.NaderK.LeDouxJ. E. (1999). Lesions of periaqueductal gray dissociate-conditioned freezing from conditioned suppression behavior in rats. Learn. Mem.6, 491–499. 10.1101/lm.6.5.491
7
AndersonK. C.InselT. R. (2006). The promise of extinction research for the prevention and treatment of anxiety disorders. Biol. Psychiatry60, 319–321. 10.1016/j.biopsych.2006.06.022
8
BalleineB. W.KillcrossA. S.DickinsonA. (2003). The effect of lesions of the basolateral amygdala on instrumental conditioning. J. Neurosci.23, 666–675. 10.1523/JNEUROSCI.23-02-00666.2003
9
BerendseH. W.Galis-de GraafY.GroenewegenH. J. (1992). Topographical organization and relationship with ventral striatal compartments of prefrontal corticostriatal projections in the rat. J. Comp. Neurol.316, 314–347. 10.1002/cne.903160305
10
BerridgeK. C. (2019). Affective valence in the brain: modules or modes?Nat. Rev. Neurosci.20, 225–234. 10.1038/s41583-019-0122-8
11
BoutonM. E.BollesR. C. (1980). Conditioned fear assessed by freezing and by the suppression of three different baselines. Anim. Learn. Behav.8, 429–434. 10.3758/bf03199629
12
Bravo-RiveraC.DiehlM. M.Roman-OrtizC.Rodriguez-RomagueraJ.Rosas-VidalL. E.Bravo-RiveraH.et al. (2015a). Long-range GABAergic neurons in the prefrontal cortex modulate behavior. J. Neurophysiol.114, 1357–1359. 10.1152/jn.00861.2014
13
Bravo-RiveraC.Roman-OrtizC.Montesinos-CartagenaM.QuirkG. J. (2015b). Persistent active avoidance correlates with activity in prelimbic cortex and ventral striatum. Front. Behav. Neurosci.9:184. 10.3389/fnbeh.2015.00184
14
Bravo-RiveraC.Roman-OrtizC.Brignoni-PerezE.Sotres-BayonF.QuirkG. J. (2014). Neural structures mediating expression and extinction of platform-mediated avoidance. J. Neurosci.34, 9736–9742. 10.1523/JNEUROSCI.0191-14.2014
15
Bravo-RiveraH.Rubio-ArzolaP.QuirkG. J. (2016). A Modification of the Platform-Mediated Avoidance Task to Study Food-Avoidance Conflict.San Diego, CA: Society for Neuroscience.
16
Burgos-RoblesA.KimchiE. Y.IzadmehrE. M.PorzenheimM. J.Ramos-GuaspW. A.NiehE. H.et al. (2017). Amygdala inputs to prefrontal cortex guide behavior amid conflicting cues of reward and punishment. Nat. Neurosci.20, 824–835. 10.1038/nn.4553
17
Burgos-RoblesA.Vidal-GonzalezI.QuirkG. J. (2009). Sustained conditioned responses in prelimbic prefrontal neurons are correlated with fear expression and extinction failure. J. Neurosci.29, 8474–8482. 10.1523/JNEUROSCI.0378-09.2009
18
CardinalR. N.ParkinsonJ. A.HallJ.EverittB. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum and prefrontal cortex. Neurosci. Biobehav. Rev.26, 321–352. 10.1016/s0149-7634(02)00007-6
19
ChoJ. H.DeisserothK.BolshakovV. Y. (2013). Synaptic encoding of fear extinction in mPFC-amygdala circuits. Neuron80, 1491–1507. 10.1016/j.neuron.2013.09.025
20
ChoiJ. S.CainC. K.LeDouxJ. E. (2010). The role of amygdala nuclei in the expression of auditory signaled two-way active avoidance in rats. Learn. Mem.17, 139–147. 10.1101/lm.1676610
21
ChoiE. A.Jean-Richard-Dit-BresselP.CliffordC. W. G.McNallyG. P. (2019). Paraventricular thalamus controls behavior during motivational conflict. J. Neurosci.39, 4945–4958. 10.1523/JNEUROSCI.2480-18.2019
22
ChoiJ. S.KimJ. J. (2010). Amygdala regulates risk of predation in rats foraging in a dynamic fear environment. Proc. Natl. Acad. Sci. U S A107, 21773–21777. 10.1073/pnas.1010079108
23
ConwayM. A.AndersonS. J.LarsenS. F.DonnellyC. M.McDanielM. A.McClellandA. G.et al. (1994). The formation of flashbulb memories. Mem. Cognit.22, 326–343. 10.3758/bf03200860
24
DamasioA. R. (1996). The somatic marker hypothesis and the possible functions of the prefrontal cortex. Philos. Trans. R. Soc. Lond. B Biol. Sci.351, 1413–1420. 10.1098/rstb.1996.0125
25
DavisM. (1992a). “The role of the amygdala in conditioned fear,” in The Amygdala: Neurobiological Aspects of Emotion, Memory, and Mental Dysfunction, ed. AggletonJ. P. (New York, NY: Wiley-Liss, Inc.), 255–306.
26
DavisM. (1992b). The role of the amygdala in fear and anxiety. Annu. Rev. Neurosci.15, 353–375. 10.1146/annurev.ne.15.030192.002033
27
DiehlM. M.Bravo-RiveraC.QuirkG. J. (2019). The study of active avoidance: a platform for discussion. Neurosci. Biobehav. Rev.107, 229–237. 10.1016/j.neubiorev.2019.09.010
28
Do-MonteF. H.Manzano-NievesG.Quiñones-LaracuenteK.Ramos-MedinaL.QuirkG. J. (2015). Revisiting the role of infralimbic cortex in fear extinction with optogenetics. J. Neurosci.35, 3607–3615. 10.1523/JNEUROSCI.3137-14.2015
29
ElliotA. J. (2008). Handbook of Approach and Avoidance Motivation.New York, NY: Psychology Press.
30
FieldsH. L.HjelmstadG. O.MargolisE. B.NicolaS. M. (2007). Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci.30, 289–316. 10.1146/annurev.neuro.30.051606.094341
31
FlorescoS. B. (2015). The nucleus accumbens: an interface between cognition, emotion, and action. Annu. Rev. Psychol.66, 25–52. 10.1146/annurev-psych-010213-115159
32
FriedmanA.HommaD.GibbL. G.AmemoriK.RubinS. J.HoodA. S.et al. (2015). A corticostriatal path targeting striosomes controls decision-making under conflict. Cell161, 1320–1333. 10.1016/j.cell.2015.04.049
33
GabbottP. L.WarnerT. A.JaysP. R.SalwayP.BusbyS. J. (2005). Prefrontal cortex in the rat: projections to subcortical autonomic, motor, and limbic centers. J. Comp. Neurol.492, 145–177. 10.1002/cne.20738
34
GaleG. D.AnagnostarasS. G.GodsilB. P.MitchellS.NozawaT.SageJ. R.et al. (2004). Role of the basolateral amygdala in the storage of fear memories across the adult lifetime of rats. J. Neurosci.24, 3810–3815. 10.1523/JNEUROSCI.4100-03.2004
35
Hernandez-JaramilloA.Sotres-BayonF. (2018). “Basolateral amygdala, but not the orbitofrontal cortex, is necessary for motivational conflict responses guided by previous experiences,” in Neuroscience Meeting Planner, (San Diego, CA: Society for Neuroscience).
36
HeveyD.ThomasK.Laureano-ScheltenS.LooneyK.BoothR. (2017). Clinical depression and punishment sensitivity on the BART. Front. Psychol.8:670. 10.3389/fpsyg.2017.00670
37
HuH. (2016). Reward and aversion. Annu. Rev. Neurosci.39, 297–324. 10.1146/annurev-neuro-070815-014106
38
Illescas-HuertaE.Ramirez-LugoL.Ordoñez-SierraR.Sotres-BayonF. (2018). “Prelimbic prefrontal cortex is necessary to face threats during a motivational conflict guided by learned, but not innate, stimuli,” in Neuroscience Meeting Planner, (San Diego, CA: Society for Neuroscience).
39
KalivasP. W.NakamuraM. (1999). Neural systems for behavioral activation and reward. Curr. Opin. Neurobiol.9, 223–227. 10.1016/s0959-4388(99)80031-2
40
KalivasP. W.PetersJ.KnackstedtL. (2006). Animal models and brain circuits in drug addiction. Mol. Interv.6, 339–344. 10.1124/mi.6.6.7
41
KindtM.SoeterM.VervlietB. (2009). Beyond extinction: erasing human fear responses and preventing the return of fear. Nat. Neurosci.12, 256–258. 10.1038/nn.2271
42
LeDouxJ. E. (1992). “Emotion and the amygdala,” in The Amygdala: Neurobiological Aspects of Emotion, Memory, and Mental Dysfunction, ed. AggletonJ. P. (New York, NY: Wiley-Liss, Inc.), 339–351.
43
LeDouxJ. E. (1996). The Emotional Brain: The Mysterious Underpinnings of Emotional Life.New York, NY: Simon and Scuster.
44
LeDouxJ. E.CicchettiP.XagorarisA.RomanskiL. M. (1990). The lateral amygdaloid nucleus: sensory interface of the amygdala in fear conditioning. J. Neurosci.10, 1062–1069. 10.1523/JNEUROSCI.10-04-01062.1990
45
LeDouxJ. E.IwataJ.CicchettiP.ReisD. J. (1988). Different projections of the central amygdaloid nucleus mediate autonomic and behavioral correlates of conditioned fear. J. Neurosci.8, 2517–2529. 10.1523/JNEUROSCI.08-07-02517.1988
46
LinS. C.NicolelisM. A. (2008). Neuronal ensemble bursting in the basal forebrain encodes salience irrespective of valence. Neuron59, 138–149. 10.1016/j.neuron.2008.04.031
47
LolordoV. M.RescorlaR. A. (1966). Protection of the fear-eliciting capacity of a stimulus from extinction. Acta Biol. Exp.26, 251–258.
48
MaierS. F.WatkinsL. R. (2005). Stressor controllability and learned helplessness: the roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor. Neurosci. Biobehav. Rev.29, 829–841. 10.1016/j.neubiorev.2005.03.021
49
Martin-SoelchC.LinthicumJ.ErnstM. (2007). Appetitive conditioning: neural bases and implications for psychopathology. Neurosci. Biobehav. Rev.31, 426–440. 10.1016/j.neubiorev.2006.11.002
50
McDonaldA. J.MascagniF.GuoL. (1996). Projections of the medial and lateral prefrontal cortices to the amygdala: a Phaseolus vulgaris leucoagglutinin study in the rat. Neuroscience71, 55–75. 10.1016/0306-4522(95)00417-3
51
McGaughJ. L. (1983). Hormonal influences on memory. Annu. Rev. Psychol.34, 297–323. 10.1146/annurev.ps.34.020183.001501
52
MillerN. E. (1944). “Experimental studies of conflict behavior,” in Personality and Behavior Disorders, ed. HuntJ. M. (New York, NY: Ronald Press), 431–465.
53
MillerE. K.CohenJ. D. (2001). An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci.24, 167–202. 10.1146/annurev.neuro.24.1.167
54
MorrisonS. E.SaezA.LauB.SalzmanC. D. (2011). Different time courses for learning-related changes in amygdala and orbitofrontal cortex. Neuron71, 1127–1140. 10.1016/j.neuron.2011.07.016
55
MorrisonS. E.SalzmanC. D. (2011). Representations of appetitive and aversive information in the primate orbitofrontal cortex. Ann. N Y Acad. Sci.1239, 59–70. 10.1111/j.1749-6632.2011.06255.x
56
MurrayE. A.O’DohertyJ. P.SchoenbaumG. (2007). What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J. Neurosci.27, 8166–8169. 10.1523/JNEUROSCI.1556-07.2007
57
MyersC. E.RegoJ.HaberP.MorleyK.BeckK. D.HogarthL.et al. (2017). Learning and generalization from reward and punishment in opioid addiction. Behav. Brain Res.317, 122–131. 10.1016/j.bbr.2016.09.033
58
NaderK.HardtO. (2009). A single standard for memory: the case for reconsolidation. Nat. Rev. Neurosci.10, 224–234. 10.1038/nrn2590
59
NamburiP.Al-HasaniR.CalhoonG. G.BruchasM. R.TyeK. M. (2016). Architectural representation of valence in the limbic system. Neuropsychopharmacology41, 1697–1715. 10.1038/npp.2015.358
60
OldsJ.MilnerP. (1954). Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol.47, 419–427. 10.1037/h0058775
61
OldsJ. (1958). Self-stimulation of the brain; its use to study local effects of hunger, sex, and drugs. Science127, 315–324. 10.1126/science.127.3294.315
62
OtisJ. M.WernerC. T.MuellerD. (2015). Noradrenergic regulation of fear and drug-associated memory reconsolidation. Neuropsychopharmacology40, 793–803. 10.1038/npp.2014.243
63
ParkinsonJ. A.CardinalR. N.EverittB. J. (2000). Limbic cortical-ventral striatal systems underlying appetitive conditioning. Prog. Brain Res.126, 263–285. 10.1016/s0079-6123(00)26019-6
64
PavlovI. (1927). Conditioned Reflexes.London: Oxford University Press.
65
PetersJ.KalivasP. W.QuirkG. J. (2009). Extinction circuits for fear and addiction overlap in prefrontal cortex. Learn. Mem.16, 279–288. 10.1101/lm.1041309
66
PetersY. M.O’DonnellP.CarelliR. M. (2005). Prefrontal cortical cell firing during maintenance, extinction and reinstatement of goal-directed behavior for natural reward. Synapse56, 74–83. 10.1002/syn.20129
67
QuirkG. J.MuellerD. (2008). Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology33, 56–72. 10.1038/sj.npp.1301555
68
QuirkG. J.RepaC.LeDouxJ. E. (1995). Fear conditioning enhances short-latency auditory responses of lateral amygdala neurons: parallel recordings in the freely behaving rat. Neuron15, 1029–1039. 10.1016/0896-6273(95)90092-6
69
RamirezF.MoscarelloJ. M.LeDouxJ. E.SearsR. M. (2015). Active avoidance requires a serial basal amygdala to nucleus accumbens shell circuit. J. Neurosci.35, 3470–3477. 10.1523/JNEUROSCI.1331-14.2015
70
Ramírez-LugoL.Peñas-RincónA.Ángeles-DuránS.Sotres-BayonF. (2016). Choice behavior guided by learned, but not innate, taste aversion recruits the orbitofrontal cortex. J. Neurosci.36, 10574–10583. 10.1523/JNEUROSCI.0796-16.2016
71
RangelA.CamererC.MontagueP. R. (2008). A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci.9, 545–556. 10.1038/nrn2357
72
RescorlaR. A. (2001). “Experimental extinction,” in Handbook of Contemporary Learning Theories, eds MowrerR. R.KleinS. (Mahwah, NJ: Erlbaum), 119–154.
73
RodriguesS. M.SchafeG. E.LeDouxJ. E. (2004). Molecular mechanisms underlying emotional learning and memory in the lateral amygdala. Neuron44, 75–91. 10.1016/j.neuron.2004.09.014
74
SacktorT. C. (2008). PKMzeta, LTP maintenance, and the dynamic molecular biology of memory storage. Prog. Brain Res.169, 27–40. 10.1016/s0079-6123(07)00002-7
75
SchoenbaumG.RoeschM. R.StalnakerT. A.TakahashiY. K. (2009). A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci.10, 885–892. 10.1038/nrn2753
76
SchultzW. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol.80, 1–27. 10.1152/jn.1998.80.1.1
77
SchultzW.DickinsonA. (2000). Neuronal coding of prediction errors. Annu. Rev. Neurosci.23, 473–500. 10.1146/annurev.neuro.23.1.473
78
SchumacherA.VillaruelF. R.UsslingA.RiazS.LeeA. C. H.ItoR. (2018). Ventral hippocampal CA1 and CA3 differentially mediate learned approach-avoidance conflict processing. Curr. Biol.28, 1318.e4–1324.e4. 10.1016/j.cub.2018.03.012
79
SmithD. M.BulkinD. A. (2014). The form and function of hippocampal context representations. Neurosci. Biobehav. Rev.40, 52–61. 10.1016/j.neubiorev.2014.01.005
80
Sotres-BayonF.BushD. E.LeDouxJ. E. (2007). Acquisition of fear extinction requires activation of NR2B-containing NMDA receptors in the lateral amygdala. Neuropsychopharmacology32, 1929–1940. 10.1038/sj.npp.1301316
81
Sotres-BayonF.CainC. K.LeDouxJ. E. (2006). Brain mechanisms of fear extinction: historical perspectives on the contribution of prefrontal cortex. Biol. Psychiatry60, 329–336. 10.1016/j.biopsych.2005.10.012
82
Sotres-BayonF.Diaz-MataixL.BushD. E.LeDouxJ. E. (2009). Dissociable roles for the ventromedial prefrontal cortex and amygdala in fear extinction: NR2B contribution. Cereb. Cortex19, 474–482. 10.1093/cercor/bhn099
83
Sotres-BayonF.QuirkG. J. (2010). Prefrontal control of fear: more than just extinction. Curr. Opin. Neurobiol.20, 231–235. 10.1016/j.conb.2010.02.005
84
Sotres-BayonF.Sierra-MercadoD.Pardilla-DelgadoE.QuirkG. J. (2012). Gating of fear in prelimbic cortex by hippocampal and amygdala inputs. Neuron76, 804–812. 10.1016/j.neuron.2012.09.028
85
TrewJ. L. (2011). Exploring the roles of approach and avoidance in depression: an integrative model. Clin. Psychol. Rev.31, 1156–1168. 10.1016/j.cpr.2011.07.007
86
TyeK. M. (2018). Neural circuit motifs in valence processing. Neuron100, 436–452. 10.1016/j.neuron.2018.10.001
87
VerharenJ. P. H.van den HeuvelM. W.LuijendijkM.VanderschurenL.AdanR. A. H. (2019). Corticolimbic mechanisms of behavioral inhibition under threat of punishment. J. Neurosci.39, 4353–4364. 10.1523/JNEUROSCI.2814-18.2019
88
WaltersC. J.JubranJ.SheehanA.EricksonM. T.RedishA. D. (2019). Avoid-approach conflict behaviors differentially affected by anxiolytics: implications for a computational model of risky decision-making. Psychopharmacology236, 2513–2525. 10.1007/s00213-019-05197-0
89
XiuJ.ZhangQ.ZhouT.ZhouT. T.ChenY.HuH. (2014). Visualizing an emotional valence map in the limbic forebrain by TAI-FISH. Nat. Neurosci.17, 1552–1559. 10.1038/nn.3813
90
YunI. A.WakabayashiK. T.FieldsH. L.NicolaS. M. (2004). The ventral tegmental area is required for the behavioral and nucleus accumbens neuronal firing responses to incentive cues. J. Neurosci.24, 2923–2933. 10.1523/JNEUROSCI.5282-03.2004
Summary
Keywords
aversion, risk, reward, valence, prefrontal cortex, amygdala, nucleus accumbens, avoidance
Citation
Bravo-Rivera C and Sotres-Bayon F (2020) From Isolated Emotional Memories to Their Competition During Conflict. Front. Behav. Neurosci. 14:36. doi: 10.3389/fnbeh.2020.00036
Received
11 December 2019
Accepted
20 February 2020
Published
12 March 2020
Volume
14 - 2020
Edited by
Devin Mueller, Kent State University, United States
Reviewed by
Gavan McNally, University of New South Wales, Australia; Emma Cahill, University of Cambridge, United Kingdom
Updates
Copyright
© 2020 Bravo-Rivera and Sotres-Bayon.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Christian Bravo-Rivera christian.bravorivera@upr.edu Francisco Sotres-Bayon sotres@ifc.unam.mx
Specialty section: This article was submitted to Motivation and Reward, a section of the journal Frontiers in Behavioral Neuroscience
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.