Mario Rafael Pagani
Emiliano Merlo- 1Instituto de Fisiología y Biofísica Bernardo Houssay (IFIBIO)-Houssay, Facultad de Medicina, Universidad de Buenos Aires—Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), Buenos Aires, Argentina
- 2Department of Psychology, University of Cambridge, Cambridge, United Kingdom
Associative long-term memories (LTMs) support long-lasting behavioral changes resulting from sensory experiences. Retrieval of a stable LTM by means of a large number of conditioned stimulus (CS) alone presentations produces inhibition of the original memory through extinction. Currently, there are two opposing hypotheses to account for the neural mechanisms supporting extinction. The unlearning hypothesis posits that extinction affects the original memory trace by reverting the synaptic changes supporting LTM. On the contrary, the new learning hypothesis proposes that extinction is simply the formation of a new associative memory that inhibits the expression of the original one. We propose that detailed analysis of extinction-associated molecular mechanisms could help distinguish between these hypotheses. Here we will review experimental evidence regarding the role of protein kinases and phosphatases (K&P) on LTM formation and extinction. Even though K&P regulate both memory processes, their participation appears to be dissociated. LTM formation recruits kinases, but is constrained by phosphatases. Memory extinction presents a more diverse molecular landscape, requiring phosphatases and some kinases, but also being constrained by kinase activity. Based on the available evidence, we propose a new theoretical model for memory extinction: a neuronal segregation of K&P supports a combination of time-dependent reversible inhibition of the original memory [CS-unconditioned stimulus (US)], with establishment of a new associative memory trace (CS-noUS).
Introduction
Having a brain allows animals to integrate environmental and internal sensory information to generate adaptive behaviors. In some cases, these behaviors are acquired through an interaction of actual experiences and the animal’s intrinsic behavioral repertoire. Our current understanding of these behavioral phenomena posits that while learning is a behavioral change as a function of somatosensory experience, memory is the maintenance of that change for a given period of time. Whereas forming adaptive memories is beneficial, maximizing fitness in ever changing environmental conditions, sometimes it is necessary to inhibit existing outdated memories through a process called memory extinction. Memory formation and extinction are multi-level psychobiological phenomena that require changes in neuronal connectivity supported by intricate neural and molecular events. In humans, persistent maladaptive memories are at the core of psychiatric disorders such as anxiety disorders (e.g., post-traumatic stress disorder and specific phobias) or drug addiction (Everitt and Robbins, 2016; Walsh et al., 2018). Understanding better the molecular underpinnings that support memory formation and extinction would be key to design and implement more effective clinical interventions to treat these psychiatric conditions.
Formation and Extinction of Associative Memories. Behavioral and Mechanistic Insights
Learning can lead to the formation of short- or long-term memories (STM, LTM) by altering neuronal connectivity within specific brain networks. Associative memory formation depends on the contingent occurrence of a previously irrelevant environmental stimulus (conditioned stimulus, CS) with a biologically relevant environmental or internal stimulus (unconditioned stimulus, US). USs that may reduce survival probabilities (e.g., presence of a predator or sickness) result in aversive memories, whereas USs that may enhance survival probabilities (e.g., food or mate) result in appetitive memories. As a consequence of successful associative learning the behavioral response typically associated with the US becomes a conditioned response (CR) under CS control.
The capacity to form associative memories is an evolutionary conserved feature, present in most species within the Animal Kingdom. For example, adult Drosophila flies trained with pairings of an electric shock (US) with an odor (CS) will avoid the CS during subsequent memory tests, evidencing the formation of an associative CS-US LTM (Tully and Quinn, 1985). Similarly, rodents trained with contingent presentations of an auditory cue (CS) and an electric footshock (US) will freeze to later presentations of the CS alone, a typical defensive behavior normally elicited by the US (Blanchard et al., 1975).
Research conducted in diverse animal paradigms has revealed conserved fundamental mechanisms supporting associative memory formation. CS-US memory traces are sensitive to disruption during or shortly after learning and require a period of consolidation in order to become stable and long-lasting. LTM consolidation is a time-dependent process entailing de novo mRNA and protein synthesis (Katche et al., 2013). Memory consolidation recruits specific neuronal subpopulations within distinctive brain regions, with the basolateral amygdala (BLA) and the dorsal hippocampus acting as key hubs within an extended network (Han et al., 2007; Grewe et al., 2017).
Once fully consolidated, associative memories can undergo alternative retrieval-dependent memory processes (Figure 1). Depending on the extent of CS-alone exposure, CS-US memories can be maintained or inhibited (Merlo et al., 2014). A brief CS presentation session can result in memory destabilization followed by a (so-called) reconsolidation process. Reconsolidation leaves the CR intact, and is proposed as an updating opportunity in face of new information regarding the CS-US association (Pedreira et al., 2004; Lee, 2008). Even though consolidation and reconsolidation of an associative memory share the requirement of mRNA and protein synthesis (Nader et al., 2000; Duvarci et al., 2008), they are dissociable at the molecular level (Lee et al., 2004; Lee and Hynds, 2013) On the contrary, extensive CS-alone exposure results in memory extinction and inhibition of the CR. Memory extinction was first described by Pavlov and Anrep (1927) and is an evolutionary conserved mechanism (Pedreira and Maldonado, 2003; Merlo et al., 2014; Felsenberg et al., 2017; Hermann et al., 2017; Nishijima and Maruyama, 2017). Memory extinction is characterized by distinctive features (i.e., spontaneous recovery, renewal, reinstatement and savings) which indicate that extinction does not erase the original CS-US memory trace, but transiently inhibits it by the formation of a new associative memory (CS-noUS) as a consequence of CS-alone trials (Todd et al., 2014). Successful memory extinction is defined by effective short- or long-lasting CR reduction towards the CS after repeated CS-alone presentations, rather than the mere experimental manipulation. As for CS-US memories, long-term extinction requires a period of consolidation where de novo mRNA and protein synthesis are required (Vianna et al., 2003; Santini et al., 2004).
Figure 1. Effect of conditioned stimulus (CS) alone presentations on associative memory fate. Contingent CS-unconditioned stimulus (US) presentations promote memory formation (Memory Acquisition), which might consolidate into long-term memory (LTM) over time under appropriate training conditions (Memory Consolidation). CS-exposure could have alternative effects depending on number or extent of CS events. A brief CS presentation triggers the conditioned response (CR; Memory Retrieval). However, under certain boundary conditions (e.g., prediction error signal, PE), this brief CS presentation leads to memory destabilization (Memory Labilization), from which the memory becomes stable again by a restabilization process (Memory Reconsolidation). After reconsolidation, the original memory persists, shown by the maintenance of the CR at subsequent retrieval (Memory Retrieval). Alternatively, after repeated CS presentations (e.g., 10 CSs) the CR is inhibited (Memory Extinction).
To date, there are two alternative hypotheses that account for extinction. On the one hand, the new learning hypothesis posits that extinction entails the formation of a new inhibitory memory trace formed by the association of the CS and the absence of the US (new learning hypothesis; Todd et al., 2014; Felsenberg et al., 2018). On the other hand, extinction may be underpinned by an unlearning mechanism partially affecting the original memory trace, hence reducing or preventing it from taking behavioral control upon later CS presentations (unlearning hypothesis; Mauk and Ohyama, 2004; Delamater and Westbrook, 2014; Khalaf et al., 2018). Experimental observations at both neural and molecular levels indicate that both alternative processes could be required to explain extinction mechanisms. Within the BLA, an extinguished CS specifically activates “extinction neurons” and fails to activate “fear neurons” which were active after fear conditioning (Herry et al., 2008). Moreover, extinction reverts structural modifications induced by the formation of the original memory (Lai et al., 2012) presumably by counteracting memory formation at the subcellular level (Schwaerzel et al., 2002). Whereas Herry and colleagues’ results could be explained by either the alternative extinction hypotheses, Lai et al. (2012) results clearly show that extinction affects the CS-US ensemble neurons in a way that opposes the structural changes caused by memory formation.
At the molecular level, memory formation and extinction rely on both common and exclusive mechanisms. For instance, whereas both processes depend on N-methyl-D-aspartate-type glutamate receptor (NMDAR) activity (Lee and Kim, 1998; Wu et al., 2007; Zimmerman and Maren, 2010), they require activation or inhibition of NF-κB- (Merlo et al., 2005; Merlo and Romano, 2008; de la Fuente et al., 2011) or AP-1-dependent gene expression (Guedea et al., 2011), respectively. Hence, the molecular events linking NMDAR activation with NF-κB- or AP-1-dependent gene expression under consolidation of the original memory or its extinction should be fundamentally different. One could argue that if memory extinction was solely supported by the formation of an inhibitory CS-noUS memory trace, it would rely on qualitatively similar molecular mechanisms to formation of the original memory. We, and others (Delamater and Westbrook, 2014; Clem and Schiller, 2016), believe that a combination of these two alternative (and apparently opposing) hypotheses provides the best theoretical framework to account for most of the behavioral, pharmacological and molecular empirical data to date.
Fear conditioning in rodents is the most used behavioral paradigm to study neuronal and molecular mechanisms in associative memory mechanisms. However, given their easily accessible and relatively simple central nervous systems, invertebrates such as the sea snail Aplysia, fruit flies, crabs and honey bees, had contributed significantly to this research area. Among the complex molecular events subserving memory formation and extinction, we will review the role of protein kinases and phosphatases (K&P). These two protein families are vital for the integration of chemical extracellular information (e.g., glutamate release) and intracellular states that lead to specific gene expression regulation (e.g., recruitment of constitutive or inducible transcription factors), two well established events supporting such behavioral changes. Despite fundamental neuroanatomical differences between vertebrates and invertebrates, empirical data support an evolutionary conserved role of K&P for memory formation and extinction. Here, we will show that K&P together define the course and quality of memory formation and extinction in a specific and evolutionarily conserved manner. Moreover, we will propose a new theoretical model to account for the molecular mechanisms subserving memory extinction.
Due to the widespread use of fear conditioning in rodents, most of the scientific evidence reviewed here has been obtained in that behavioral paradigm. When available, we will include additional key evidence supporting and expanding specific topics coming from other learning paradigms.
Synaptic Plasticity Subserving Memory Formation and Inhibition
During cued fear conditioning, a sub-population of lateral amygdala (LA) pyramidal neurons react to the US (an electric footshock) with a strong depolarization, which contributes to strengthen the response to the contingent CS (a tone; Grewe et al., 2017). Thus, in a Hebbian manner, a weak neuronal activation produced by the tone is strengthened by the temporal pairing with the strong input produced by the US (Hebb, 1949; LeDoux, 2000). The necessary synaptic plasticity underlying fear conditioning is proposed to be supported by long-term potentiation (LTP) mechanisms. For decades, LTP has been proposed as the cellular basis of memory formation and many correlations with memory mechanisms have been described (Martin et al., 2000). However, a causal relationship between LTP induction and memory formation has been shown just recently. Nabavi et al. (2014) showed that fear conditioning can be induced in animals by pairing an electric footshock with optogenetic stimulation of a light-activated channel ChR2 of LA auditory inputs. This artificial optogenetic training had the ability to implant a fear memory since treated animals tested by the presentation of a tone alone displayed a CR. Remarkably, the artificially implanted memory was inactivated by optogenetic low frequency stimulation that produced long-term depression (LTD), as well as reactivated by optogenetic high frequency stimulation that produced LTP. These experiments showed that synaptic strengthening by LTP in LA permits the retrieval of a memory, whereas synaptic weakening by LTD prevented retrieval. Of note, the optogenetic stimulation alone, without the presentation of the electric shock did not produce a CR to the test tone. Similarly, unpaired presentation of the US and the optogenetic-CS produced neither LTP nor a CR. These results, among a considerable number of previous reports, strongly associate synaptic plasticity in the form of LTP and LTD with memory formation and inhibition. Moreover, expression and inhibition of a fully consolidated fear memory are linked to potentiation and depotentiation of the same set of synaptic contacts. These data add support to the interpretation that extinction of a fully consolidated associative memory specifically affects synaptic contacts within the CS-US memory ensemble.
Memory Acquisition
CS-US memory formation can be divided into processes of memory acquisition and memory consolidation. Memory acquisition refers to neural and molecular events that influence behavioral performance during or shortly after training. On the contrary, memory consolidation refers to neural and molecular processes involved in the establishment of a long-lasting memory.
K&P Regulation of Glutamate Receptors
K&P regulate a number of key molecular partners supporting memory acquisition, including NMDA-type and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid-type (AMPA) glutamate receptors, and Ca2+/calmodulin-dependent protein kinase II (CaMKII). Postsynaptic NMDARs in LA are essential for establishment of LTP and associative memory. As coincidence detector of pre- and postsynaptic contingent activity NMDARs are permeable to Ca2+, which in turn promotes autophosphorylation of CaMKII Thr286 residue (Giese et al., 1998). CaMKII autophosphorylation promotes prolonged kinase activation by switching from a Ca2+-dependent to a Ca2+-independent mode (Miller and Kennedy, 1986). Whereas CaMKII acting on a number of molecular substrates contributes to different aspects of fear memory, its action on GluA1 subunits of AMPARs contribute specifically to AMPAR insertion in the postsynaptic membrane (Hayashi et al., 2000), a major event in LTP and memory acquisition (Malinow and Malenka, 2002). Consistently, pharmacological blockade of NMDARs and CaMKII in the amygdala has been shown to prevent memory acquisition (Fanselow and Kim, 1994; Rodrigues et al., 2004).
Protein kinase A (PKA) and C (PKC), as well as CaMKII, phosphorylate NR1, NR2A, and NR2B NMDAR subunits in different sites (Omkumar et al., 1996; Leonard and Hell, 1997; Tingley et al., 1997). However, the role of these post-translational modifications in associative learning is unclear. The role of PKA as a regulator of NMDAR activity and LTP has been reported consistently, with PKA activity enhancing NMDAR total currents and Ca2+ influx in cell cultures and hippocampal slices (Skeberdis et al., 2006). Similarly, protein tyrosine kinases enhance NMDAR-dependent currents and Ca2+ influx (Wang and Salter, 1994). Intra-BLA injection of PKA inhibitor H7 blocks contextual and cued fear memory acquisition (Goosens et al., 2000).
NMDAR activation in neurons also produces activation of protein phosphatases 1 (PP1). In particular, PP1 is activated by Ca2+ influx through synaptic NMDARs (Hou et al., 2013). PP1 activity regulates LTD and LTP induction in opposite ways, with PP1 being required for LTD but opposing LTP induction via CaMKII dephosphorylation (Jouvenceau and Dutar, 2006). In hippocampal slices cAMP-dependent PP1 inhibitor 1 (PP1-I1) activation results in increased CaMKII Thr286 phosphorylation, leading to a Ca2+-independent CaMKII sustained activity (Blitzer et al., 1998). Consistently, genetic inhibition of PP1 within the cortex and hippocampal formation facilitates two forms of associative learning, novel object recognition and spatial navigation (Genoux et al., 2002). Even though these two types of memories are associated with specific concerted actions of hippocampal LTD and LTP (Wang et al., 2004; Goh and Manahan-Vaughan, 2013), they are both equally influenced by PP1 inhibition. Similar to PP1, the PP1 calcineurin (CaN; also known as PP2B) is activated by Ca2+ influx through NMDARs and reduces the opening probability of the receptor in a typical negative feedback loop mechanism (Lieberman and Mody, 1994). Reduction of hippocampal CaN levels by intraventricular-administration of CaN antisense oligodeoxynucleotide facilitates in vivo hippocampal LTP and enhances contextual fear memory (Ikegami et al., 1996; Ikegami and Inokuchi, 2000). Transgenic expression of a CaN specific inhibitor driven by CaMKIIα promoter in the brain reduces CaN activity in the hippocampus and cortex, facilitates hippocampal LTP in vitro and improves short- and long-term object recognition memory and LTM of spatial navigation (Malleret et al., 2001).
Neuromodulatory Inputs Regulating K&Ps
The firing of a third neuromodulatory category of neuron, other than the pre- and postsynaptic neurons described above, also contributes to synaptic plasticity and memory acquisition. Norepinephrine (NE) and dopamine (DA) have been implicated in fear conditioning. Both neurotransmitters, binding to G-protein-coupled receptors, regulate adenylate cyclase with the subsequent modulation of intra-cellular cAMP levels (Cerne et al., 1993; Raman et al., 1996). NE and DA release increases in LA after US presentation (Yokoyama et al., 2005) and receptors for both neurotransmitters are expressed in LA (Muly et al., 2009; Farb et al., 2010). Beta-adrenergic receptor (β-AR) activation promotes PKA-mediated enhancement of NMDAR-dependent excitatory post-synaptic currents in the hippocampus. Such an effect appears to be constitutively downregulated by CaN (Raman et al., 1996). Moreover, in medium spiny neurons of the nucleus accumbens DA-dependent PKA activation also phosphorylates the NR1 NMDAR subunit, which is sensitive to PP1/PP2A dephosphorylation (Snyder et al., 1998). This evidence indicates that PP1 and CaN constraining effects on memory formation could be due, at least in part, to alteration of DA or NE signaling recruited by training.
Typically, if a drug reduces STM and LTM when it is administered before training, but has no effect when administered after training, it is interpreted that it affects learning or memory acquisition. However, if the drug reduces LTM when is administered after training, it is interpreted that it affects memory consolidation. This reasoning may have some caveats, as discussed presently. Pre-training administration of propranolol, a non-selective antagonist of β-ARs, produced amnesia for auditory fear conditioning. Systemic or intra-LA application of propranolol after training or before memory retrieval had no effect on memory, suggesting that β-ARs were not involved in either memory consolidation or retrieval (Cole and Koob, 1988; Bush et al., 2010). However, later studies showed that during training β-ARs initiate two different molecular processes, AMPARs phosphorylation at Ser845, which contributes to memory acquisition, and extracellular regulated kinase (ERK) activation, which contributes to memory consolidation (Schiff et al., 2017). Thus, when an intervention affects LTM, leaving STM intact, it should be considered as affecting memory consolidation, regardless of the manipulation time relative to training.
Numerous reports have implicated DA signaling on various forms of associative learning, including aversive and appetitive conditioning. The requirement of DA neuromodulation for associative memory formation and extinction appears to be a conserved property in vertebrates and invertebrates (Burke et al., 2012; Abraham et al., 2016). In general DA has a positive modulatory effect on memory processes, but the specific effect on K&Ps in the postsynaptic partner depends on the extent to which D1-like or D2-like receptors are engaged. The complexity of DA signaling with respect to brain regions, receptor activation and effect on memory process far exceeds the objective of this review (for a specific review see Abraham et al., 2014).
Together, these findings show that protein kinases acting directly or indirectly on glutamate receptors enable synaptic events leading to synaptic plasticity and memory formation. On the contrary, PP1s appear to counteract these processes, obstructing memory formation. DA and NE neuromodulatory inputs modulate memory by affecting the balance between K&P.
Memory Consolidation
Immediately after learning the newly acquired CR is sensitive to disruption by a number of interventions, including amnestic drugs. However, after several hours, the recently established memory becomes stabilized and insensitive to amnestic interventions. This process of memory stabilization is commonly known as cellular consolidation or simply consolidation. In contrast to memory acquisition, a large number of molecular mechanisms have been identified for consolidation. Here we review the most relevant data to discuss the role of (K&P) in memory consolidation.
Memory consolidation involves the activation of constitutive and inducible transcription factors, which regulate gene expression to support changes in synaptic strength and learning in key brain regions (Alberini and Kandel, 2014). A conceptual framework, on which we build our discussion, can be summarized as follows: after training, activated kinases (e.g., PKA, MAPK) activate transcription factors (e.g., NF-κB, CREB or AP-1), which leads to gene transcription and protein translation that provides effector proteins for structural synaptic modifications. These molecular landscapes underlying associative memory consolidation were originally observed in Aplysia’s gill and siphon withdrawal reflex mediated by long-term sensitization (Kandel, 2001), but then confirmed and expanded in other animals. Memory consolidation mechanisms constitute an evolutionarily conserved feature of associative LTM formation present from C. elegans to mammals.
sCaMK, PKA and MAPK
In cued and contextual fear conditioning, intra-BLA administration of PKA, MAPK, or protein synthesis inhibitors immediately after training (Rp-cAMPS, PD098059 and anisomycin, respectively) disrupt LTM while leaving STM intact (Goosens et al., 2000; Schafe and LeDoux, 2000; Schafe et al., 2000). CaMKII is also required for memory consolidation. Intra-hippocampal or amygdala injection of the CaMKII inhibitor KN62 administered immediately after inhibitory avoidance training disrupted LTM (Wolfman et al., 1994). Similarly, CaMKII transgenic inhibition in the forebrain impaired LTM formation in contextual and cued fear conditioning (Mayford et al., 1996). Another Ca2+-calmodulin dependent kinase, CaMKIV, is required for contextual fear LTM formation without affecting STM (Wei et al., 2002). Kinase activity of CaMKII, CaMKIV, PKA and the MAPK ERK1/2 contributes to CREB-dependent gene expression in neurons (Gonzalez and Montminy, 1989; Dash et al., 1991; Bito et al., 1996; Bartsch et al., 1998; Impey et al., 1998; Kang et al., 2001). In addition, in contextual fear conditioning Ca2+/calmodulin-dependent adenylate cyclase signaling is required for the sequential activation of ERK, the CREB kinase MSK1 and finally CREB. Interestingly, activation of ERK and CREB co-localizes with PKA into the same hippocampal CA1 neuronal subpopulation (Sindreu et al., 2007). In line with the proposed role of these kinases in consolidation, ERK1/2 is transiently activated by associative learning experience in the LA and its blockade specifically affects LTM, but not STM (Schafe et al., 2000). Similar results have been observed in mice and invertebrates, including Aplysia, Drosophila and the crab Neohelice granulathus (Shalin et al., 2004; Feld et al., 2005; Fioravante et al., 2006; Pagani et al., 2009). Activation of CaMKs, PKA, ERK1/2 and MSK1 leads to the phosphorylation and activation of the transcription factor CREB, which in turn conduct the cAMP response element (CRE)-dependent gene expression necessary for memory consolidation (Lisman et al., 2018). As a proof of concept, disruption of CRE-dependent gene expression by means of a αCaMKII promoter-dependent inducible expression of a CREB repressor fusion protein disrupts LTM formation, without altering STM (Kida et al., 2002). This pattern of results, with intact STM and disrupted LTM, are characteristic of manipulations that alter memory consolidation specifically, and has been a gold standard for discovering consolidation mechanisms for the last three decades.
Although CREB has been at the center of studies on memory consolidation mechanisms, its role as a gene expression regulator is not unique, but in concert with the action of other transcription factors. For instance, NMDAR-dependent hippocampal ERK1/2 activation induced by an inhibitory avoidance training activates Elk-1 (Cammarota et al., 2000). Also in an ERK-dependent manner, induction of AP-1-dependent gene expression in the hippocampus mediates contextual fear memory consolidation (Guedea et al., 2011). Consolidation of fear memories in crabs, rats and mice requires the activation of the constitutive transcription factor NF-κB. Pharmacological blockade of Iκ-B kinase (IKK), responsible for NF-κB activation, or silencing of κB-dependent gene expression by specific oligonucleotides results in intact STM, but impaired LTM, for aversive associative memory in mice, rats and crabs (Romano et al., 2006).
So far, we have reviewed experimental data linking kinase activity with memory formation in the context of transcriptional activation. Next, we will review the role of other, less studied, kinases in memory formation. As mentioned above, ERK1/2 is a major molecular component of memory consolidation, though other MAPKs, including ERK5, c-JNK1–3, and p38 are also involved in memory formation (Adams and Sweatt, 2002). The kinase p38 is activated in the dorsal hippocampus after inhibitory avoidance training, and its inhibition impairs both STM and LTM (Alonso et al., 2003). c-JNK function in memory is still under debate. Intra-hippocampal administration of c-JNK inhibitor SP600125 enhanced LTM of contextual fear conditioning (Sherrin et al., 2010) but blocked inhibitory avoidance memory (Bevilaqua et al., 2003). Bevilaqua and colleagues also observed a memory enhancing effect of SP600125 but only affecting STM. The observation of c-JNK activity as a memory constraining mechanism is the only report so far of kinase activity opposing the establishment of an associative memory (but also see section “Cdk5 in plasticity and memory”). Clearly, further studies are needed to solve this discrepancy and establish the true nature of c-JNK involvement during memory formation.
PKA and CaMKII Functions Are Restrained by PP1, CaN and STEP
In contrast to the requirement of CaMKII and PKA, PP1 appears to restrain LTM consolidation since transgenic inhibition of PP1 facilitates spatial and novel object recognition LTMs. PP1 inhibition enhances CREB and CaMKII activity in cortex and hippocampus, suggesting that the phosphatase constrains canonical memory mechanisms (Genoux et al., 2002). Also, PP1 appears to be a major regulator of histone phosphorylation in the nucleus (Koshibu et al., 2009), another mechanism required for LTM formation through an MSK1-dependent histone phosphorylation (Chwang et al., 2007). Similarly, the PP1 Inhibitor-2 (PP1-I2) also controls CREB activation and CREB-dependent gene transcription in fear conditioning. Lentiviral knockdown of PP1-I2 in the dorsal hippocampus does not affect STM, but enhances LTM, possibly through positive regulation of PP1 and suppression of CREB-mediated gene expression (Yang et al., 2015).
The phosphatases CaN and striatal-enriched protein tyrosine phosphatase (STEP) are both activated by exposing rats to a novel context and have comparable effects on LTD and LTP (Yang et al., 2006). Pharmacological inhibition of CaN or STEP in CA1 hippocampal neurons promotes synaptic potentiation (Wang and Kelly, 1996, 1997; Pelkey et al., 2002). Conversely, overexpression of CaN or STEP impairs long-lasting hippocampal LTP (Winder et al., 1998; Paul et al., 2007). CaN effects on synaptic plasticity are mediated, at least in part, by dephosphorylation of AMPAR GluR1 subunit at Ser845. This post-translational modification of AMPARs regulates receptor trafficking, open-state probability and membrane insertion (Banke et al., 2000; Beattie et al., 2000; Man et al., 2007). Interestingly, PKA activation increases Ser845 phosphorylation (Price et al., 1999).
In relation to memory mechanisms, CaN was also reported as a key component of memory consolidation, but in an opposite way to PKA or MAPK. Overexpression of a truncated CaN in the hippocampus prevented LTM, but left STM intact, in spatial navigation and object recognition (Mansuy et al., 1998). Similarly, CaN inhibition by anti-sense oligodeoxynucleotides or transgenic interventions in dorsal hippocampus enhanced associative memory formation (Ikegami and Inokuchi, 2000; Malleret et al., 2001). As with CaN, STEP knockout (KO) mice show improvement in hippocampal-dependent memory tasks. This effect may be mediated by an increase in ERK1/2 activation, and NMDA and AMPA receptor phosphorylation in the hippocampus (Venkitaramani et al., 2011). On the contrary, intra-BLA administration of a substrate-trapping STEP, a hyperactivated version of the phosphatase, prevents activated ERK1/2 nuclear translocation and disrupts fear memory consolidation (Paul et al., 2007).
Paradoxical Relationship Between PI3K and PTEN Actions on Memory Formation
Another important phosphorylation signaling pathway for CREB-dependent gene transcription involves phosphatidylinositol-3-kinase (PI3K) and AKT. Activated PI3K phosphorylates phosphatidylinositol (4,5)-bisphosphate, producing phosphatidylinositol (3,4,5)-triphosphate (PIP3) in the plasma membrane. PI3P serves as a substrate and molecular dock for many signaling mechanisms including AKT and PKC (Vanhaesebroeck et al., 2010). PI3K activation within the BLA is mediated by two distinct mechanisms: activation of tyrosine kinase receptors (e.g., TrkB), and Ca2+ influx through NMDARs (Lin et al., 2001; Ou and Gean, 2006). Notably, brain-derived neurotropic factor (BDNF) induction of TrkB promotes ERK1/2 activation by either activation of Ras/Raf/MEK signaling pathway, or activation of PI3K (Lin et al., 2001, 2003b; Ou and Gean, 2006). These BDNF-dependent signaling mechanisms appear necessary to promote fear LTM in lateral and basal amygdala, but not in hippocampus or cortex. Similarly, PI3K-dependent signaling within the BLA is necessary for LTM (Lin et al., 2001; Ou and Gean, 2006). Additionally, AKT regulates mTOR, a kinase required for translation control in synaptic plasticity and fear memory consolidation (Hoeffer and Klann, 2010).
The phosphatase and tensin homolog (PTEN) counteracts PI3K function. Inducible deletion of PTEN in adult mice impairs hippocampal LTD and LTP, spatial memory (Wang et al., 2006; Sperow et al., 2012) and contextual fear conditioning (Lugo et al., 2013). Interestingly, deletion of PDK1 (3-phosphoinositide-dependent protein kinase 1) rescues the defect in synaptic plasticity but not spatial memory observed in PTEN mutant mice (Sperow et al., 2012). Even though PTEN counteracts PI3K, they are both necessary for plasticity and memory consolidation. This paradox may be explained by recent evidence indicating that PTENα dephosphorylates CaMKII at T305/306 and T337. This molecular event makes CaMKII activatable by promoting its interaction with NR2B subunits of NMDARs (Wang et al., 2017). Consistently, mutant mice lacking PTENα activity show a deficit in LTP as well as in fear conditioning and spatial memory (Wang et al., 2017).
Cdk5 in Plasticity and Memory
The cyclin-dependent kinase 5 (Cdk5) is involved in cytoskeletal dynamics, affecting synaptic transmission and plasticity (Lalioti et al., 2010). The Ca2+-dependent protease calpain can cleave p35, a regulatory subunit of Cdk5, producing p25, which in turn promotes Cdk5 activity. p25 fragments are generated in the hippocampus after spatial learning (Engmann et al., 2011). Transient overexpression of p25 in hippocampus enhances cued and contextual fear and spatial memory (Angelo et al., 2003; Fischer et al., 2005). Moreover, pharmacological or genetic inhibition of Cdk5 in lateral septum or hippocampus in mice impairs contextual fear and spatial memory (Fischer et al., 2002, 2003; Guan et al., 2011), suggesting p25/Cdk5 pathway is necessary for memory formation. Nevertheless, long-term Cdk5 loss enhanced synaptic plasticity and spatial memory, probably by reducing NR2B NMDAR subunit degradation (Hawasli et al., 2007). Hence, Cdk5 affects synaptic activity and memory formation in opposite ways depending on the timescale of the manipulation (Fischer et al., 2005). Importantly, acute pharmacological manipulations are consistent and indicate that under physiological conditions Cdk5 is required for associative LTM formation.
Shp2 a Phosphatase Promoting Plasticity and Memory
Most phosphatases involved in learning and memory appear to inhibit plasticity and memory formation. However, the Src homology 2-containing tyrosine phosphatase (Shp2) appears to promote LTM formation in olfactory conditioning in Drosophila (Pagani et al., 2009), and contextual fear conditioning and spatial navigation in mice (Kusakari et al., 2015; Zhang et al., 2016; Yan et al., 2017). Although Shp2 is not required for STM, during training it contributes to ERK1/2 activation and is critical for the trial spacing effect affecting LTM formation (Pagani et al., 2009). In terms of Shp2 function, it has been shown to be required for the BDNF-induced complete activation of RAS/ERK (Easton et al., 2006), and contributes to LTP induction by regulating AMPARs trafficking as well as NMDARs phosphorylation (Zhang et al., 2016; Yan et al., 2017).
Role of Fyn, LIMK and PTPRR on Memory Formation
Even though there is little information about the role of these enzymes on memory mechanisms, the available data is enough to make meaningful comparisons between memory formation and extinction processes.
Contextual fear conditioning activates the tyrosine kinase Fyn, a member of the Src kinase family, in mouse dorsal hippocampus. Fyn-deficient mice show no increase in tyrosine phosphorylation after fear conditioning in the hippocampus, and also fail to form STM and LTM (Isosaka et al., 2008) suggesting that Fyn is required for memory formation.
LIM kinase 1 and 2 (LIMK1/2) are involved in cytoskeleton dynamics and synaptic plasticity. LIMK KO mice showed altered excitatory synaptic plasticity, with an enhanced hippocampal LTP induction in LIMK1/2 or LIMK1 KO compared to wild type and LIMK2 KO mice (Meng et al., 2002, 2004). LIMK1 KO mice showed mild auditory fear conditioning enhancement, but also severe morphological alterations in synaptic structures (Meng et al., 2002). Pharmacological inhibition of LIMK by intra-hippocampal BMS-5 administration immediately after training disrupts contextual fear memory, but not memory extinction (Lunardi et al., 2018), indicating an exclusive participation of LIMK on memory formation.
Another phosphatase involved in memory mechanisms is the protein tyrosine phosphatase receptor type R (PTPRR). Homozygous KO mice for PTPRR show enhanced fear conditioning compared to wild types, but normal fear memory extinction and spatial learning. Importantly, elevated freezing behavior after training could not be due to a generalized elevated anxiety in the KO mice since their displayed similar levels of anxiety to wild types in the mirrored chamber test (Erkens et al., 2014). This pattern of results indicates that PTPRR acts as a constraint during memory formation, but does not take part in memory extinction.
Memory Extinction
In comparison to memory formation mechanisms, memory extinction mechanisms are known in much less detail. Here, we review experimental evidence addressing the participation of K&P in extinction. As with CS-US memory formation, these studies are diverse in terms of the animal species, types of memory and experimental approaches used.
Protein Phosphatases
The involvement of CaN (also known as PP2B) in memory extinction has been studied in auditory and contextual fear memory, the fear-potentiated startle response and conditioned taste aversion in rats and mice.
Lin et al. (2003a, b) showed that extinction of fear-potentiated startle response in rats increases BLA CaN expression. Administration of the CaN inhibitors FK506 or cypermethrin intra-BLA, or cyclosporin A intravenously, disrupted extinction of the fear-potentiated startle response. These data were the first indication that, contrary to the role of CaN constraining CS-US memory acquisition, the phosphatase is necessary for extinction memory formation.
Extinction of auditory fear conditioning in rats also increases BLA CaN protein levels in the cytosolic fraction. Reduction of CaN expression by means of intra-BLA injection of an oligodeoxynucleotide against the A and B subunits of CaN does not affect extinction learning but does disrupts extinction consolidation. Interestingly, analysis at the single animal level shows a negative correlation between fear reduction and CaN expression, suggesting that not only is CaN required for memory extinction, but also that its BLA expression level indicates extinction intensity (Merlo et al., 2014). Extinction of contextual fear memory is also dependent on CaN activity. This was shown by interfering with CaN activation state either by intra-hippocampal injection of FK506 (de la Fuente et al., 2011) or transgenic inhibition of CaN in the forebrain (Havekes et al., 2008). Intriguingly, forebrain transgenic CaN inhibition or activation failed to affect extinction of conditioned taste aversion in mice (Baumgärtel et al., 2008) suggesting that extinction of some associative memory types is CaN-independent.
As mentioned above, the role of PP1 during memory formation is to constrain the process. Unfortunately, there is virtually no information regarding the role of PP1 in memory extinction. In an in vitro extinction model in Hermissenda crassicornis, PP1 inhibition prevents decreases in B-cell spike frequency, suggesting that PP1 is a key component in extinction mechanisms (Cavallo et al., 2014). Investigating the role of PP1 in behavioral extinction is necessary and will help to better understand the mechanisms of memory inhibition through extinction.
In contextual fear conditioning in rodents, intra-hippocampal NSC87877, an inhibitor of Shp2, disrupts memory extinction but does not affect fear memory formation (Isosaka and Yuasa, 2010). The discrepancy between this study and the ones showing a requirement of Shp2 on memory formation (see section “Shp2 a phosphatase promoting plasticity and memory”) could be explained by procedural differences, species or pharmacokinetics of Shp2 inhibitor NSC87877 compared to transgenic manipulations of Shp2 gene. But also, given the role of Shp2 in mediating the effect of spacing learning trials, it is probable that under the training conditions used by Isosaka and Yuasa, Shp2 was not recruited for memory formation. Altogether, these results suggest that Shp2 activity is a necessary mechanism for the formation and extinction of associative memories.
In relation to the other phosphatases studied on CS-US memory formation and mentioned in the previous section, PTPRR, STEP and PTEN, their role on memory extinction remains poorly understood. The only one that has been experimentally evaluated during memory extinction is PTPRR, which has been shown to not be required (Erkens et al., 2014). More research is needed to understand the contribution of STEP and PTEN to this memory process.
Kinases Necessary for Memory Extinction
ERK1/2
ERK1/2 is a key molecule for memory extinction mechanisms. Intra-BLA or dorsal hippocampus administration of ERK1/2-dependent intracellular pathway inhibitors U0126 or PD9859 impair auditory and contextual fear memory extinction (Herry et al., 2006; Fischer et al., 2007). Moreover, extinction enhancement by the NMDAR partial agonist D-cycloserine is mediated by an increase on BLA ERK1/2 activation (Merlo et al., 2018). Besides being a common mechanism between memory formation and extinction, ERK1/2 activation shows specific time scales for each process. Whereas ERK1/2 is activated in the BLA 1 h after fear conditioning, after extinction training it is activated within 20 min (Schafe et al., 2000; Merlo et al., 2014). Even though ERK pharmacological inhibition blocks both memory acquisition and extinction, some findings suggest fundamental differences in its role during each process. For instance, the requirement for ERK-dependent signaling for memory acquisition and extinction in the hippocampus is associated with opposing regulation of cFos and GluR2/3 gene expression (Guedea et al., 2011).
p38
Another member of the MAPK family, p38 is required for memory extinction. Blockade of p38 activity, by intra-hippocampal administration of the specific inhibitor SB203580 immediately after extinction sessions, prevented the extinction of inhibitory avoidance memory. The fact that the amnestic effect on extinction was present when the injection was given immediately after but not 180 min later, and that the inactive analog of SB203580 (SB202474) was ineffective, strongly indicates that the extinction impairment is specific to p38 blockade (Rossato et al., 2006).
CASK
A kinase with apparent specific participation in memory extinction is the Ca2+/calmodulin-dependent serine kinase (CASK). The role of CASK on memory processes has been tested by using transgenic mice carrying a point mutation in the protein, T470A. T470 is a PKA phosphorylation site, and when phosphorylated allows CASK to increase the transcriptional activity of T-Brain-1, an immediate early gene associated with synaptic plasticity (Chuang et al., 2014). CASK T470A mice show normal auditory fear conditioning and conditioned taste aversion, but impaired extinction of both memories. Notably, T470A mice show normal acquisition and extinction of contextual fear memory (Huang and Hsueh, 2017).
c-JNK
Micro-injections of the c-JNK specific inhibitor SP600125 into the dorsal hippocampus immediately after daily extinction sessions prevented inhibitory avoidance extinction in comparison with vehicle treatment (Bevilaqua et al., 2007). Moreover, CA1 neurons within the dorsal hippocampus show an increase in c-JNK/phosphoERK interaction induced by extinction of contextual fear memory. Through this interaction, memory extinction results in a specific increase in phosphorylation of c-JNK in Ser63/73 and Ser243, in contrast to a reduction of p-c-JNK Ser243 observed after acquisition. These findings suggest that fear memory extinction requires a concerted action of ERK and c-JNK reducing the expression of AP-1-dependent genes (Guedea et al., 2011).
α-Ca2+/CaMKII (αCaMKII)
αCAMKII T286A point mutation prevents the autophosphorylation activity of the kinase, weakening the binding of calmodulin and shortening its activation state (Rodrigues et al., 2004). Whereas homozygous αCaMKIIT286A−/− mice have defects on contextual fear memory acquisition, heterozygous αCaMKIIT286A+/– mice can learn the task and have been used to analyze the participation of this kinase on memory extinction. Heterozygous αCaMKIIT286A+/– mice show impairments in both contextual fear and spatial memory extinction tasks (Kimura et al., 2008). The differential sensitivity of memory acquisition and extinction to homo- or heterozygosity suggests a differential involvement of αCaMKII, with extinction showing more sensitivity to alterations in αCaMKII activity. Furthermore, pharmacological inhibition of αCaMKII in dorsal hippocampus by local injection of the inhibitor KN-62 prevents extinction of inhibitory avoidance memory (Szapiro et al., 2003).
LIM Kinase (LIMK)
LIMKs are serine protein kinases that regulate actin and microtubule reorganizations in various cell types (Bernard, 2007). Intra-hippocampal injection of LIMK inhibitor BMS-5 20 min before extinction training had no effect on extinction or spontaneous recovery of contextual fear memory. Interestingly, the same pharmacological intervention impaired fear memory acquisition (Lunardi et al., 2018), suggesting LIMK is a specific for the establishment of the original memory but not for extinction.
PI3K
Using the PI3K inhibitor LY294002 administered into the dorsal hippocampus immediately after extinction training, Chen et al. (2005) showed that the kinase is necessary for memory extinction. At the synaptic plasticity level, hippocampal slices of mice with disrupted PI3Kγ subunit or slices from wild type mice treated with the selective PI3Kγ inhibitor AS-605240 showed NMDAR-dependent LTD deficits. Unexpectedly, PI3Kγ deficient mice and mice injected with AS-605240 intra-hippocampally did not show defects in contextual fear memory consolidation or extinction (Kim et al., 2011), suggesting that other isoforms of PI3K could explain the results obtained with LY294002.
Kinases Constraining Memory Extinction
In contrast to its role during memory acquisition, IKK activity constrains memory extinction. In crabs, systemic administration of the specific IKK inhibitor sulfasalazine before extinction training delays spontaneous recovery of the original memory (Merlo and Romano, 2008). Moreover, extinction training induces NF-κB inhibition in crab brain, confirming that an extinction-mediated IKK inactivation is required for the establishment of an extinction memory. In mice, contextual fear memory extinction also requires a functional reduction in NF-κB activity in dorsal hippocampus (de la Fuente et al., 2011), supporting an evolutionarily conserved function of IKK inactivation during memory extinction. Even though pharmacological blockade of IKK resulting in enhanced extinction could be interpreted as an experimental artifact, the fact that NF-κB is inhibited in the brain by extinction training suggests that IKK inactivation is an intrinsic extinction mechanism.
Extinction training inhibits another memory-related kinase, Cdk5. Intra-hippocampal injection of Cdk5 inhibitor butyrolactone I enhances contextual fear extinction. Consistently, time-specific over-expression of the Cdk5 activator p25 results in increased Cdk5 activity in dorsal hippocampus, and when p25 expression is induced before extinction training prevents contextual fear extinction (Sananbenesi et al., 2007). As with IKK, memory extinction inhibits Cdk5.
Another kinase necessary for memory formation, Fyn, has opposite effect on extinction. Contextual fear extinction specifically downregulates Fyn activity in the dorsal hippocampus. Pharmacological inhibition of Fyn by intra-hippocampal injection of PP2 facilitated fear extinction (Isosaka et al., 2009).
The role of PKA on extinction has been shown to be either a requirement or a constraint, depending on the brain region and type of memory. In inhibitory avoidance, intra-hippocampal administration of the PKA inhibitor Rp-cAMPs prevents extinction (Szapiro et al., 2003), indicating hippocampal PKA activity is necessary for extinction of this memory. On the contrary, extinction of contextual fear conditioning is constrained by PKA activity. Increasing PKA activity in the forebrain by means of post-natal transgenic overexpression of adenylate cyclase type-1 delayed extinction (Wang et al., 2004), while decreasing its activity in hippocampus, amygdala, temporal and prefrontal cortex by overexpression of a PKA dominant negative form R(AB) enhanced extinction (Isiegas et al., 2006). Similarly, disrupting intra-cellular PKA compartmentalization in dorsal hippocampus by micro-injection of membrane permeable PKA anchoring disrupting peptides St-Ht31 or St-superAKAP-IS enhanced contextual fear extinction (Nijholt et al., 2008). Hence, PKA is necessary for acquisition and extinction of inhibitory avoidance, but produces opposing effects in acquisition and extinction of contextual fear conditioning.
Altogether, these data indicate that PKA, IKK, Cdk5 and Fyn have opposing roles on the acquisition or extinction of purely Pavlovian memories, such as contextual fear conditioning.
Molecular Landscapes Associated with Memory Formation and Extinction
The experimental evidence presented so far aims to establish modes of kinase and phosphatases actions on memory formation and extinction in order to better understand the nature of these memory mechanisms. This information has been gathered in different species and behavioral paradigms, and constitute a prime example of independent and convergent empirical evidence. This type of knowledge, far from weakening our understanding of memory mechanisms, brings strong support to conserved and general principles of such complex phenomenon. The intention of this review is not to generate a complete list of molecular events associated with these memory processes, but to analyze representative examples where the enzymatic activities have been tested both in memory formation and extinction. Exceptions to this rule are to highlight areas were more research is needed. In Table 1 we present a summary of the literature presented in previous sections.
Table 1. Role of kinases and phosphatases (K&P) on associative memory formation and extinction.
The first clear conclusion from Table 1 is that memory formation requires PKActivation in different brain regions. This is a well-documented feature of both STM and LTM formation. Training for associative memory induces the activation of several kinases, and their activity is necessary in order to acquire and/or consolidate that learning experience and form a memory. These kinases have different activation requirements and modes of actions, but their activation would be important to support changes in synaptic connectivity by affecting existing proteins or promote synthesis of new ones through translation of existing or new mRNAs. Apparently, the only exception to this rule is c-JNK, for which contradictory evidence has been reported (Bevilaqua et al., 2003; Sherrin et al., 2010).
The next conclusion is that most of the phosphatases studied during memory induction restrain memory mechanisms. In other words, when CaN or PP1 are inhibited during training, the resulting associative memory is enhanced, which means it would be retained for longer or be more resistant to extinction. Phosphatase action during memory acquisition or consolidation would specifically counteract the phosphorylation of kinases activated by the learning experience. Removal of this counteracting action results in more intense or prolonged kinase activation and a larger impact of their positive effect in memory establishment. Altogether, this evidence indicates that associative memory consolidation results from a balanced and coordinated action of K&P in key neurons within specific brain regions. A balance favoring kinase activation will result in activation of constitutive and inducible transcription factors and mRNA and protein synthesis. On the contrary, when the balance favors phosphatase activity memory consolidation is compromised.
The only two examples of phosphatases being necessary for memory formation are PTEN and Shp2. Probably, this difference is due to the fact that Shp2 and PTEN promote excitatory synaptic potentiation in contrast to the canonical role of phosphatases constraining excitatory synaptic potentiation and promoting LTD (Baumgärtel and Mansuy, 2012; Connor and Wang, 2016).
Analysis of K&P involvement in memory extinction produces a more heterogeneous molecular landscape. Among the kinases discussed here, ERK, PI3K, CaMKII and p38 have similar effects when subserving memory formation or extinction, as they are all required. A similarly frequent set of kinases show a different profile, being necessary for memory formation but constraining memory extinction. This is the case for IKK, PKA, Fyn and Cdk5, whose inhibition during memory extinction facilitated extinction learning and consolidation. The latter group is particularly interesting from a theoretical perspective, since it strongly supports a fundamental difference between memory formation and extinction mechanisms (see below). The role of phosphatases during extinction has attracted much less attention, but the available data are indicative of such fundamental differences. The paradigmatic example of this disparity is the role of CaN, of which activity is required for memory extinction. Interestingly, CaN is associated to memory formation and inhibition in a similar way to synaptic plasticity. Whereas CaN constrains associative memory formation and LTP, it is required for memory extinction and LTD induction. Shp2 is also required for extinction, but in contrast to CaN it is also required for CS-US memory formation. Even though there are no reports on the role of PP1 or STEP in memory extinction, their involvement could be similar to CaN, as suggested for some preliminary in vitro analysis.
These molecular landscapes also present rare kinase and phosphatase examples. The kinases LIMK and CASK are specifically associated to memory formation or extinction, respectively; whereas the phosphatase PTPRR is specifically involved in establishment of the original memory. Suggesting there are a subset of K&P that are specific to one or the other memory mechanism is appealing, but more research needs to be done to understand fully the contribution of these partners on memory mechanisms.
Extinction as A Combination of Memory Formation and Inhibition
At first sight, the increased molecular heterogeneity underpinning CR inhibition suggests that extinction mechanisms go beyond the formation of a new CS-noUS inhibitory associative memory trace. Moreover, extinction could be conceptualized as a combination of associative memory promotion mechanisms, in charge of CS-noUS memory formation, and memory depression events, associated with a temporary inhibition of the original CS-US trace.
At the neuronal level, CS-US and extinction memories are supported by distinctive neuronal subpopulations within specific brain regions. In the BLA, high CS fear is associated with activation of “fear neurons” characterized for their response to the CS in fear conditioned animals. Similarly, when these animals extinguish the fear memory, the “fear neurons” stop responding to the CS, but a new neuronal subpopulation is engaged and specifically respond to the extinguished CS. These so-called “extinction neurons” did not respond to the CS when the animals were in a high CS fear state (Herry et al., 2008). In the dentate gyrus (DG), activation of contextual fear memory recall-induced neurons is required for memory extinction, indicating that extinction affects the original memory trace at a cellular level (Khalaf et al., 2018). These results indicate that extinction affects both BLA and DG original CS-US memory trace neurons at an engram-specific level by silencing or changing the valence of neuronal activation. We propose that specific subsets of K&P are associated with “fear” and “extinction neurons.” During fear conditioning, the coordinated action of K&P will help in establishing a neuronal ensemble of “fear neurons” within the BLA, associated to other specific neuronal subpopulations in other key brain regions (e.g., mPFC or dorsal hippocampus). For this reason, the molecular landscape of CS-US memory formation would be more homogeneous, with kinases promoting, and phosphatases controlling, the sculpture of an internal CS representation that closely resembles the US representation (Figure 2; Grewe et al., 2017). Extinction would comprise a much more diverse set of events. Synaptic or excitability changes affecting the response of “fear neurons” to the CS would be under the control of PP1s such as CaN. Complementary synaptic changes would affect a new neuronal population, the “extinction neurons,” where activation of kinases, transcriptional and translational machinery would lead to the establishment of a new associative CS-noUS memory trace (Figure 2). Under this theoretical framework, those kinases that constrain memory extinction would be acting specifically on “fear neurons,” counteracting the effect of CaN or other required phosphatases.
Figure 2. Proposed neuronal distribution of kinases and phosphatases (K&P) during memory acquisition and extinction. Blue circles: neurons participating in CS-US memory acquisition, requiring activation of kinases, and constrained by phosphatases. Yellow circles: “fear neurons” undergoing synaptic depotentiation, requiring the activity of phosphatases and constrained by kinase activities. Red circles: “extinction neurons” responsible for acquisition of the new CS-noUS memory through activation of various kinases.
This model of memory extinction allows for the development of testable hypotheses to understand better the underlying mechanisms. For instance, this model predicts the segregation of specific molecular mechanisms subserving extinction in specific brain regions. Using anatomical assessment and pharmacological manipulations it should be possible to test if the activation of K&P required for extinction are independent molecular events, taking place in different neuronal populations. Moreover, it should be interesting to analyze whether phosphatase activation affects specifically neurons allocated to the CS-US neuronal ensemble.
Concluding Remarks
Here, we have reviewed the participation of K&P for the formation and extinction of associative memories. The available evidence strongly suggests that extinction mechanisms exceed, in complexity and variety, the mechanisms sub-serving the establishment of the original memory trace. We propose a novel theoretical frame-work explaining the complexity of memory extinction and generating testable new hypotheses. Memory extinction is the basis of current treatments for anxiety disorders such as post-traumatic stress disorder or specific phobias. Aversive conditioning in humans appears to have similar properties to those described in animal models (Martin-Soelch et al., 2007). Therefore, many extinction mechanisms presented here are expected to be relevant for humans as well. Hence, expanding and improving our understanding of memory inhibition mechanisms would be crucial to improve existing treatments or design new ones.
Author Contributions
EM and MP designed and wrote the manuscript.
Funding
This work was supported by International Brain Research Organization (IBRO) Return Home Fellowship and National Agency of Scientific and Technological Promotion (Fondo para la Investigación Científica y Tecnológica; Grants PICT-2017-0251 and PRH-2016-0003) to EM. These grants do not contemplate covering open access publication fees.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We would like to thank Jimena Berni for her helpful comments on the manuscript and Amy L. Milton for assistance with English language usage. We would like to apologize to colleagues who have made valuable scientific contributions to this area of research whose work was not mentioned here owing to space limitations.
References
Abraham, A. D., Neve, K. A., and Lattal, K. M. (2014). Dopamine and extinction: a convergence of theory with fear and reward circuitry. Neurobiol. Learn. Mem. 108, 65–77. doi: 10.1016/j.nlm.2013.11.007
Abraham, A. D., Neve, K. A., and Lattal, K. M. (2016). Effects of D1 receptor knockout on fear and reward learning. Neurobiol. Learn. Mem. 133, 265–273. doi: 10.1016/j.nlm.2016.07.010
Adams, J. P., and Sweatt, J. D. (2002). Molecular psychology: roles for the ERK MAP kinase cascade in memory. Annu. Rev. Pharmacol. Toxicol. 42, 135–163. doi: 10.1146/annurev.pharmtox.42.082701.145401
Alberini, C. M., and Kandel, E. R. (2014). The regulation of transcription in memory consolidation. Cold Spring Harb. Perspect. Biol. 7:a021741. doi: 10.1101/cshperspect.a021741
Alonso, M., Bevilaqua, L. R., Izquierdo, I., Medina, J. H., and Cammarota, M. (2003). Memory formation requires p38MAPK activity in the rat hippocampus. Neuroreport 14, 1989–1992. doi: 10.1097/00001756-200310270-00022
Angelo, M., Plattner, F., Irvine, E. E., and Giese, K. P. (2003). Improved reversal learning and altered fear conditioning in transgenic mice with regionally restricted p25 expression. Euro. J. Neurosci. 18, 423–431. doi: 10.1046/j.1460-9568.2003.02746.x
Banke, T. G., Bowie, D., Lee, H., Huganir, R. L., Schousboe, A., and Traynelis, S. F. (2000). Control of GluR1 AMPA receptor function by cAMP-dependent protein kinase. J. Neurosci. 20, 89–102. doi: 10.1523/jneurosci.20-01-00089.2000
Bartsch, D., Casadio, A., Karl, K. A., Serodio, P., and Kandel, E. R. (1998). CREB1 encodes a nuclear activator, a repressor and a cytoplasmic modulator that form a regulatory unit critical for long-term facilitation. Cell 95, 211–223. doi: 10.1016/s0092-8674(00)81752-3
Baumgärtel, K., Genoux, D., Welzl, H., Tweedie-Cullen, R. Y., Koshibu, K., Livingstone-Zatchej, M., et al. (2008). Control of the establishment of aversive memory by calcineurin and Zif268. Nat. Neurosci. 11, 572–578. doi: 10.1038/nn.2113
Baumgärtel, K., and Mansuy, I. M. (2012). Neural functions of calcineurin in synaptic plasticity and memory. Learn. Mem. 19, 375–384. doi: 10.1101/lm.027201.112
Beattie, E. C., Carroll, R. C., Yu, X., Morishita, W., Yasuda, H., von Zastrow, M., et al. (2000). Regulation of AMPA receptor endocytosis by a signaling mechanism shared with LTD. Nat. Neurosci. 3, 1291–1300. doi: 10.1038/81823
Bernard, O. (2007). Lim kinases, regulators of actin dynamics. Int. J. Biochem. Cell Biol. 39, 1071–1076. doi: 10.1016/j.biocel.2006.11.011
Bevilaqua, L. R., Kerr, D. S., Medina, J. H., Izquierdo, I., and Cammarota, M. (2003). Inhibition of hippocampal Jun N-terminal kinase enhances short-term memory but blocks long-term memory formation and retrieval of an inhibitory avoidance task. Eur. J. Neurosci. 17, 897–902. doi: 10.1046/j.1460-9568.2003.02524.x
Bevilaqua, L. R., Rossato, J. I., Clarke, J. H., Medina, J. H., Izquierdo, I., and Cammarota, M. (2007). Inhibition of c-Jun N-terminal kinase in the CA1 region of the dorsal hippocampus blocks extinction of inhibitory avoidance memory. Behav. Pharmacol. 18, 483–489. doi: 10.1097/fbp.0b013e3282ee7436
Bito, H., Deisseroth, K., and Tsien, R. W. (1996). CREB phosphorylation and dephosphorylation: a Ca2+- and stimulus duration-dependent switch for hippocampal gene expression. Cell 87, 1203–1214. doi: 10.1016/s0092-8674(00)81816-4
Blanchard, R. J., Mast, M., and Blanchard, D. C. (1975). Stimulus control of defensive reactions in the albino rat. J. Comp. Physiol. Psychol. 88, 81–88. doi: 10.1037/h0076213
Blitzer, R. D., Connor, J. H., Brown, G. P., Wong, T., Shenolikar, S., Iyengar, R., et al. (1998). Gating of CaMKII by cAMP-regulated protein phosphatase activity during LTP. Science 280, 1940–1942. doi: 10.1126/science.280.5371.1940
Burke, C. J., Huetteroth, W., Owald, D., Perisse, E., Krashes, M. J., Das, G., et al. (2012). Layered reward signalling through octopamine and dopamine in Drosophila. Nature 492, 433–437. doi: 10.1038/nature11614
Bush, D. E. A., Caparosa, E. M., Gekker, A., and LeDoux, J. (2010). β-adrenergic receptors in the lateral nucleus of the amygdala contribute to the acquisition but not the consolidation of auditory fear conditioning. Front. Behav. Neurosci. 4:154. doi: 10.3389/fnbeh.2010.00154
Cammarota, M., Bevilaqua, L. R., Ardenghi, P., Paratcha, G., Levi de Stein, M., Izquierdo, I., et al. (2000). Learning-associated activation of nuclear MAPK, CREB and Elk-1, along with Fos production, in the rat hippocampus after a one-trial avoidance learning: abolition by NMDA receptor blockade. Mol. Brain Res. 76, 36–46. doi: 10.1016/s0169-328x(99)00329-0
Cavallo, J. S., Hamilton, B. N., and Farley, J. (2014). In vitro extinction learning in Hermissenda: involvement of conditioned inhibition molecules. Front. Behav. Neurosci. 8:354. doi: 10.3389/fnbeh.2014.00354
Cerne, R., Rusin, K. I., and Randic, M. (1993). Enhancement of the N-methyl-D-aspartate response in spinal dorsal horn neurons by cAMP-dependent protein kinase. Neurosci. Lett. 161, 124–128. doi: 10.1016/0304-3940(93)90275-p
Chen, X., Garelick, M. G., Wang, H., Lil, V., Athos, J., and Storm, D. R. (2005). PI3 kinase signaling is required for retrieval and extinction of contextual memory. Nat. Neurosci. 8, 925–931. doi: 10.1038/nn1482
Chuang, H. C., Huang, T. N., and Hsueh, Y. P. (2014). Neuronal excitation upregulates Tbr1, a high-confidence risk gene of autism, mediating Grin2b expression in the adult brain. Front. Cell. Neurosci. 8:280. doi: 10.3389/fncel.2014.00280
Chwang, W. B., Arthur, J. S., Schumacher, A., and Sweatt, J. D. (2007). The nuclear kinase mitogen- and stress-activated protein kinase 1 regulates hippocampal chromatin remodeling in memory formation. J. Neurosci. 27, 12732–12742. doi: 10.1523/jneurosci.2522-07.2007
Clem, R. L., and Schiller, D. (2016). New learning and unlearning: strangers or accomplices in threat memory attenuation? Trends Neurosci. 39, 340–351. doi: 10.1016/j.tins.2016.03.003
Cole, B. J., and Koob, G. F. (1988). Propranolol antagonizes the enhanced conditioned fear produced by corticotropin releasing factor. J. Pharmacol. Exp. Ther. 247, 902–910.
Connor, S. A., and Wang, Y. T. (2016). A place at the table: LTD as a mediator of memory genesis. Neuroscientist 22, 359–371. doi: 10.1177/1073858415588498
Dash, P. K., Karl, K. A., Colicos, M. A., Prywes, R., and Kandel, E. R. (1991). cAMP response element-binding protein is activated by Ca2+/calmodulin- as well as cAMP-dependent protein kinase. Proc. Natl. Acad. Sci. U S A 88, 5061–5065. doi: 10.1073/pnas.88.11.5061
de la Fuente, V., Freudenthal, R., and Romano, A. (2011). Reconsolidation or extinction: transcription factor switch in the determination of memory course after retrieval. J. Neurosci. 31, 5562–5573. doi: 10.1523/JNEUROSCI.6066-10.2011
Delamater, A. R., and Westbrook, R. F. (2014). Psychological and neural mechanisms of experimental extinction: a selective review. Neurobiol. Learn. Mem. 108, 38–51. doi: 10.1016/j.nlm.2013.09.016
Duvarci, S., Nader, K., and LeDoux, J. E. (2008). De novo mRNA synthesis is required for both consolidation and reconsolidation of fear memories in the amygdala. Learn. Mem. 15, 747–755. doi: 10.1101/lm.1027208
Easton, J. B., Royer, A. R., and Middlemas, D. S. (2006). The protein tyrosine phosphatase, Shp2, is required for the complete activation of the RAS/MAPK pathway by brain-derived neurotrophic factor. J. Neurochem. 97, 834–845. doi: 10.1111/j.1471-4159.2006.03789.x
Engmann, O., Hortobagyi, T., Thompson, A. J., Guadagno, J., Troakes, C., Soriano, S., et al. (2011). Cyclin-dependent kinase 5 activator p25 is generated during memory formation and is reduced at an early stage in Alzheimer’s disease. Biol. Psychiatry 70, 159–168. doi: 10.1016/j.biopsych.2011.04.011
Erkens, M., Bakker, B., van Duijn, L. M., Hendriks, W. J., and Van der Zee, C. E. (2014). Protein tyrosine phosphatase receptor type R deficient mice exhibit increased exploration in a new environment and impaired novel object recognition memory. Behav. Brain Res. 265, 111–120. doi: 10.1016/j.bbr.2014.02.014
Everitt, B. J., and Robbins, T. W. (2016). Drug addiction: updating actions to habits to compulsions ten years on. Annu. Rev. Psychol. 67, 23–50. doi: 10.1146/annurev-psych-122414-033457
Fanselow, M. S., and Kim, J. J. (1994). Acquisition of contextual Pavlovian fear conditioning is blocked by application of an NMDA receptor antagonist D,L-2-amino-5-phosphonovaleric acid to the basolateral amygdala. Behav. Neurosci. 108, 210–212. doi: 10.1037/0735-7044.108.1.210
Farb, C. R., Chang, W., and LeDoux, J. E. (2010). Ultrastructural characterization of noradrenergic axons and β-adrenergic receptors in the lateral nucleus of the amygdala. Front. Behav. Neurosci. 4:162. doi: 10.3389/fnbeh.2010.00162
Feld, M., Dimant, B., Delorenzi, A., Coso, O., and Romano, A. (2005). Phosphorylation of extra-nuclear ERK/MAPK is required for long-term memory consolidation in the crab Chasmagnathus. Behav. Brain Res. 158, 251–261. doi: 10.1016/j.bbr.2004.09.005
Felsenberg, J., Barnstedt, O., Cognigni, P., Lin, S., and Waddell, S. (2017). Re-evaluation of learned information in Drosophila. Nature 544, 240–244. doi: 10.1038/nature21716
Felsenberg, J., Jacob, P. F., Walker, T., Barnstedt, O., Edmondson-Stait, A. J., Pleijzier, M. W., et al. (2018). Integration of parallel opposing memories underlies memory extinction. Cell 175, 709.e715–722.e715. doi: 10.1016/j.cell.2018.08.021
Fioravante, D., Smolen, P. D., and Byrne, J. H. (2006). The 5-HT- and FMRFa-activated signaling pathways interact at the level of the Erk MAPK cascade: potential inhibitory constraints on memory formation. Neurosci. Lett. 396, 235–240. doi: 10.1016/j.neulet.2005.11.036
Fischer, A., Radulovic, M., Schrick, C., Sananbenesi, F., Godovac-Zimmermann, J., and Radulovic, J. (2007). Hippocampal Mek/Erk signaling mediates extinction of contextual freezing behavior. Neurobiol. Learn. Mem. 87, 149–158. doi: 10.1016/j.nlm.2006.08.003
Fischer, A., Sananbenesi, F., Pang, P. T., Lu, B., and Tsai, L. H. (2005). Opposing roles of transient and prolonged expression of p25 in synaptic plasticity and hippocampus-dependent memory. Neuron 48, 825–838. doi: 10.1016/j.neuron.2005.10.033
Fischer, A., Sananbenesi, F., Schrick, C., Spiess, J., and Radulovic, J. (2002). Cyclin-dependent kinase 5 is required for associative learning. J. Neurosci. 22, 3700–3707. doi: 10.1523/JNEUROSCI.22-09-03700.2002
Fischer, A., Sananbenesi, F., Schrick, C., Spiess, J., and Radulovic, J. (2003). Regulation of contextual fear conditioning by baseline and inducible septo-hippocampal cyclin-dependent kinase 5. Neuropharmacology 44, 1089–1099. doi: 10.1016/s0028-3908(03)00102-3
Genoux, D., Haditsch, U., Knobloch, M., Michalon, A., Storm, D., and Mansuy, I. M. (2002). Protein phosphatase 1 is a molecular constraint on learning and memory. Nature 418, 970–975. doi: 10.1038/nature00928
Giese, K. P., Fedorov, N. B., Filipkowski, R. K., and Silva, A. J. (1998). Autophosphorylation at Thr286 of the α calcium-calmodulin kinase II in LTP and learning. Science 279, 870–873. doi: 10.1126/science.279.5352.870
Goh, J. J., and Manahan-Vaughan, D. (2013). Spatial object recognition enables endogenous LTD that curtails LTP in the mouse hippocampus. Cereb. Cortex 23, 1118–1125. doi: 10.1093/cercor/bhs089
Gonzalez, G. A., and Montminy, M. R. (1989). Cyclic AMP stimulates somatostatin gene transcription by phosphorylation of CREB at serine 133. Cell 59, 675–680. doi: 10.1016/0092-8674(89)90013-5
Goosens, K. A., Holt, W., and Maren, S. (2000). A role for amygdaloid PKA and PKC in the acquisition of long-term conditional fear memories in rats. Behav. Brain Res. 114, 145–152. doi: 10.1016/s0166-4328(00)00224-2
Grewe, B. F., Grundemann, J., Kitch, L. J., Lecoq, J. A., Parker, J. G., Marshall, J. D., et al. (2017). Neural ensemble dynamics underlying a long-term associative memory. Nature 543, 670–675. doi: 10.1038/nature21682
Guan, J. S., Su, S. C., Gao, J., Joseph, N., Xie, Z., Zhou, Y., et al. (2011). Cdk5 is required for memory function and hippocampal plasticity via the cAMP signaling pathway. PLoS One 6:e25735. doi: 10.1371/journal.pone.0025735
Guedea, A. L., Schrick, C., Guzman, Y. F., Leaderbrand, K., Jovasevic, V., Corcoran, K. A., et al. (2011). ERK-associated changes of AP-1 proteins during fear extinction. Mol. Cell. Neurosci. 47, 137–144. doi: 10.1016/j.mcn.2011.03.009
Han, J. H., Kushner, S. A., Yiu, A. P., Cole, C. J., Matynia, A., Brown, R. A., et al. (2007). Neuronal competition and selection during memory formation. Science 316, 457–460. doi: 10.1126/science.1139438
Havekes, R., Nijholt, I. M., Visser, A. K., Eisel, U. L., and Van der Zee, E. A. (2008). Transgenic inhibition of neuronal calcineurin activity in the forebrain facilitates fear conditioning, but inhibits the extinction of contextual fear memories. Neurobiol. Learn. Mem. 89, 595–598. doi: 10.1016/j.nlm.2007.08.003
Hawasli, A. H., Benavides, D. R., Nguyen, C., Kansy, J. W., Hayashi, K., Chambon, P., et al. (2007). Cyclin-dependent kinase 5 governs learning and synaptic plasticity via control of NMDAR degradation. Nat. Neurosci. 10, 880–886. doi: 10.1038/nn1914
Hayashi, Y., Shi, S. H., Esteban, J. A., Piccini, A., Poncer, J. C., and Malinow, R. (2000). Driving AMPA receptors into synapses by LTP and CaMKII: requirement for GluR1 and PDZ domain interaction. Science 287, 2262–2267. doi: 10.1126/science.287.5461.2262
Hermann, A., Stark, R., Blecker, C. R., Milad, M. R., and Merz, C. J. (2017). Brain structural connectivity and context-dependent extinction memory. Hippocampus 27, 883–889. doi: 10.1002/hipo.22738
Herry, C., Ciocchi, S., Senn, V., Demmou, L., Muller, C., and Luthi, A. (2008). Switching on and off fear by distinct neuronal circuits. Nature 454, 600–606. doi: 10.1038/nature07166
Herry, C., Trifilieff, P., Micheau, J., Luthi, A., and Mons, N. (2006). Extinction of auditory fear conditioning requires MAPK/ERK activation in the basolateral amygdala. Eur. J. Neurosci. 24, 261–269. doi: 10.1111/j.1460-9568.2006.04893.x
Hoeffer, C. A., and Klann, E. (2010). mTOR signaling: at the crossroads of plasticity, memory, and disease. Trends Neurosci. 33, 67–75. doi: 10.1016/j.tins.2009.11.003
Hou, H., Sun, L., Siddoway, B. A., Petralia, R. S., Yang, H., Gu, H., et al. (2013). Synaptic NMDA receptor stimulation activates PP1 by inhibiting its phosphorylation by Cdk5. J. Cell Biol. 203, 521–535. doi: 10.1083/jcb.201303035
Huang, T. N., and Hsueh, Y. P. (2017). Calcium/calmodulin-dependent serine protein kinase (CASK), a protein implicated in mental retardation and autism-spectrum disorders, interacts with T-Brain-1 (TBR1) to control extinction of associative memory in male mice. J. Psychiatry Neurosci. 42, 37–47. doi: 10.1503/jpn.150359
Ikegami, S., and Inokuchi, K. (2000). Antisense DNA against calcineurin facilitates memory in contextual fear conditioning by lowering the threshold for hippocampal long-term potentiation induction. Neuroscience 98, 637–646. doi: 10.1016/s0306-4522(00)00161-5
Ikegami, S., Kato, A., Kudo, Y., Kuno, T., Ozawa, F., and Inokuchi, K. (1996). A facilitatory effect on the induction of long-term potentiation in vivo by chronic administration of antisense oligodeoxynucleotides against catalytic subunits of calcineurin. Mol. Brain Res. 41, 183–191. doi: 10.1016/0169-328x(96)00094-0
Impey, S., Obrietan, K., Wong, S. T., Poser, S., Yano, S., Wayman, G., et al. (1998). Cross talk between ERK and PKA is required for Ca2+ stimulation of CREB-dependent transcription and ERK nuclear translocation. Neuron 21, 869–883. doi: 10.1016/s0896-6273(00)80602-9
Isiegas, C., Park, A., Kandel, E. R., Abel, T., and Lattal, K. M. (2006). Transgenic inhibition of neuronal protein kinase A activity facilitates fear extinction. J. Neurosci. 26, 12700–12707. doi: 10.1523/JNEUROSCI.2743-06.2006
Isosaka, T., Hattori, K., Kida, S., Kohno, T., Nakazawa, T., Yamamoto, T., et al. (2008). Activation of Fyn tyrosine kinase in the mouse dorsal hippocampus is essential for contextual fear conditioning. Eur. J. Neurosci. 28, 973–981. doi: 10.1111/j.1460-9568.2008.06405.x
Isosaka, T., Kida, S., Kohno, T., Hattori, K., and Yuasa, S. (2009). Hippocampal Fyn activity regulates extinction of contextual fear. Neuroreport 20, 1461–1465. doi: 10.1097/wnr.0b013e32833203a8
Isosaka, T., and Yuasa, S. (2010). Hippocampal SH2-containing protein-tyrosine phosphatases are involved in extinction of contextual fear. Neuroreport 21, 554–558. doi: 10.1097/wnr.0b013e328338ba4f
Jouvenceau, A., and Dutar, P. (2006). A role for the protein phosphatase 2B in altered hippocampal synaptic plasticity in the aged rat. J. Physiol. Paris 99, 154–161. doi: 10.1016/j.jphysparis.2005.12.009
Kandel, E. R. (2001). The molecular biology of memory storage: a dialogue between genes and synapses. Science 294, 1030–1038. doi: 10.1126/science.1067020
Kang, H., Sun, L. D., Atkins, C. M., Soderling, T. R., Wilson, M. A., and Tonegawa, S. (2001). An important role of neural activity-dependent CaMKIV signaling in the consolidation of long-term memory. Cell 106, 771–783. doi: 10.1016/s0092-8674(01)00497-4
Katche, C., Cammarota, M., and Medina, J. H. (2013). Molecular signatures and mechanisms of long-lasting memory consolidation and storage. Neurobiol. Learn. Mem. 106, 40–47. doi: 10.1016/j.nlm.2013.06.018
Khalaf, O., Resch, S., Dixsaut, L., Gorden, V., Glauser, L., and Gräff, J. (2018). Reactivation of recall-induced neurons contributes to remote fear memory attenuation. Science 360, 1239–1242. doi: 10.1126/science.aas9875
Kida, S., Josselyn, S. A., Peña de Ortiz, S., Kogan, J. H., Chevere, I., Masushige, S., et al. (2002). CREB required for the stability of new and reactivated fear memories. Nat. Neurosci. 5, 348–355. doi: 10.1038/nn819
Kim, J. I., Lee, H. R., Sim, S. E., Baek, J., Yu, N. K., Choi, J. H., et al. (2011). PI3Kγ is required for NMDA receptor-dependent long-term depression and behavioral flexibility. Nat. Neurosci. 14, 1447–1454. doi: 10.1038/nn.2937
Kimura, R., Silva, A. J., and Ohno, M. (2008). Autophosphorylation of αCaMKII is differentially involved in new learning and unlearning mechanisms of memory extinction. Learn. Mem. 15, 837–843. doi: 10.1101/lm.1049608
Koshibu, K., Graff, J., Beullens, M., Heitz, F. D., Berchtold, D., Russig, H., et al. (2009). Protein phosphatase 1 regulates the histone code for long-term memory. J. Neurosci. 29, 13079–13089. doi: 10.1523/JNEUROSCI.3610-09.2009
Kusakari, S., Saitow, F., Ago, Y., Shibasaki, K., Sato-Hashimoto, M., Matsuzaki, Y., et al. (2015). Shp2 in forebrain neurons regulates synaptic plasticity, locomotion and memory formation in mice. Mol. Cell Biol. 35, 1557–1572. doi: 10.1128/mcb.01339-14
Lai, C. S., Franke, T. F., and Gan, W. B. (2012). Opposite effects of fear conditioning and extinction on dendritic spine remodelling. Nature 483, 87–91. doi: 10.1038/nature10792
Lalioti, V., Pulido, D., and Sandoval, I. V. (2010). Cdk5, the multifunctional surveyor. Cell Cycle 9, 284–311. doi: 10.4161/cc.9.2.10466
LeDoux, J. E. (2000). Emotion circuits in the brain. Annu. Rev. Neurosci. 23, 155–184. doi: 10.1146/annurev.neuro.23.1.155
Lee, J. L. (2008). Memory reconsolidation mediates the strengthening of memories by additional learning. Nat. Neurosci. 11, 1264–1266. doi: 10.1038/nn.2205
Lee, J. L., Everitt, B. J., and Thomas, K. L. (2004). Independent cellular processes for hippocampal memory consolidation and reconsolidation. Science 304, 839–843. doi: 10.1126/science.1095760
Lee, J. L., and Hynds, R. E. (2013). Divergent cellular pathways of hippocampal memory consolidation and reconsolidation. Hippocampus 23, 233–244. doi: 10.1002/hipo.22083
Lee, H., and Kim, J. J. (1998). Amygdalar NMDA receptors are critical for new fear learning in previously fear-conditioned rats. J. Neurosci. 18, 8444–8454. doi: 10.1523/JNEUROSCI.18-20-08444.1998
Leonard, A. S., and Hell, J. W. (1997). Cyclic AMP-dependent protein kinase and protein kinase C phosphorylate N-methyl-D-aspartate receptors at different sites. J. Biol. Chem. 272, 12107–12115. doi: 10.1074/jbc.272.18.12107
Lieberman, D. N., and Mody, I. (1994). Regulation of NMDA channel function by endogenous Ca2+-dependent phosphatase. Nature 369, 235–239. doi: 10.1038/369235a0
Lin, C. H., Yeh, S. H., Leu, T. H., Chang, W. C., Wang, S. T., and Gean, P. W. (2003a). Identification of calcineurin as a key signal in the extinction of fear memory. J. Neurosci. 23, 1574–1579. doi: 10.1523/JNEUROSCI.23-05-01574.2003
Lin, C. H., Yeh, S. H., Lu, H. Y., and Gean, P. W. (2003b). The similarities and diversities of signal pathways leading to consolidation of conditioning and consolidation of extinction of fear memory. J. Neurosci. 23, 8310–8317. doi: 10.1523/JNEUROSCI.23-23-08310.2003
Lin, C. H., Yeh, S. H., Lin, C. H., Lu, K. T., Leu, T. H., Chang, W. C., et al. (2001). A role for the PI-3 kinase signaling pathway in fear conditioning and synaptic plasticity in the amygdala. Neuron 31, 841–851. doi: 10.1016/s0896-6273(01)00433-0
Lisman, J., Cooper, K., Sehgal, M., and Silva, A. J. (2018). Memory formation depends on both synapse-specific modifications of synaptic strength and cell-specific increases in excitability. Nat. Neurosci. 21, 309–314. doi: 10.1038/s41593-018-0076-6
Lugo, J. N., Smith, G. D., Morrison, J. B., and White, J. (2013). Deletion of PTEN produces deficits in conditioned fear and increases fragile X mental retardation protein. Learn. Mem. 20, 670–673. doi: 10.1101/lm.032839.113
Lunardi, P., Sachser, R. M., Sierra, R. O., Pedraza, L. K., Medina, C., de la Fuente, V., et al. (2018). Effects of hippocampal LIMK inhibition on memory acquisition, consolidation, retrieval, reconsolidation, and extinction. Mol. Neurobiol. 55, 958–967. doi: 10.1007/s12035-016-0361-x
Malinow, R., and Malenka, R. C. (2002). AMPA receptor trafficking and synaptic plasticity. Annu. Rev. Neurosci. 25, 103–126. doi: 10.1146/annurev.neuro.25.112701.142758
Malleret, G., Haditsch, U., Genoux, D., Jones, M. W., Bliss, T. V., Vanhoose, A. M., et al. (2001). Inducible and reversible enhancement of learning, memory, and long-term potentiation by genetic inhibition of calcineurin. Cell 104, 675–686. doi: 10.1016/s0092-8674(02)08015-7
Man, H. Y., Sekine-Aizawa, Y., and Huganir, R. L. (2007). Regulation of α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptor trafficking through PKA phosphorylation of the Glu receptor 1 subunit. Proc. Natl. Acad. Sci. U S A 104, 3579–3584. doi: 10.1073/pnas.0611698104
Mansuy, I. M., Mayford, M., Jacob, B., Kandel, E. R., and Bach, M. E. (1998). Restricted and regulated overexpression reveals calcineurin as a key component in the transition from short-term to long-term memory. Cell 92, 39–49. doi: 10.1016/s0092-8674(00)80897-1
Martin, S. J., Grimwood, P. D., and Morris, R. G. (2000). Synaptic plasticity and memory: an evaluation of the hypothesis. Annu. Rev. Neurosci. 23, 649–711. doi: 10.1146/annurev.neuro.23.1.649
Martin-Soelch, C., Linthicum, J., and Ernst, M. (2007). Appetitive conditioning: neural bases and implications for psychopathology. Neurosci. Biobehav. Rev. 31, 426–440. doi: 10.1016/j.neubiorev.2006.11.002
Mauk, M. D., and Ohyama, T. (2004). Extinction as new learning versus unlearning: considerations from a computer simulation of the cerebellum. Learn. Mem. 11, 566–571. doi: 10.1101/lm.83504
Mayford, M., Bach, M. E., Huang, Y. Y., Wang, L., Hawkins, R. D., and Kandel, E. R. (1996). Control of memory formation through regulated expression of a CaMKII transgene. Science 274, 1678–1683. doi: 10.1126/science.274.5293.1678
Meng, Y., Takahashi, H., Meng, J., Zhang, Y., Lu, G., Asrar, S., et al. (2004). Regulation of ADF/cofilin phosphorylation and synaptic function by LIM-kinase. Neuropharmacology 47, 746–754. doi: 10.1016/j.neuropharm.2004.06.030
Meng, Y., Zhang, Y., Tregoubov, V., Janus, C., Cruz, L., Jackson, M., et al. (2002). Abnormal spine morphology and enhanced LTP in LIMK-1 knockout mice. Neuron 35, 121–133. doi: 10.1016/s0896-6273(02)00758-4
Merlo, E., Freudenthal, R., Maldonado, C., and Romano, A. (2005). Activation of the transcription factor NF-kappa B by retrieval is required for long-term memory reconsolidation. Learn. Mem. 12, 23–29. doi: 10.1101/lm.82705
Merlo, E., Milton, A. L., and Everitt, B. J. (2018). A novel retrieval-dependent memory process revealed by the arrest of ERK1/2 activation in the basolateral amygdala. J. Neurosci. 38, 3199–3207. doi: 10.1523/JNEUROSCI.3273-17.2018
Merlo, E., Milton, A. L., Goozee, Z. Y., Theobald, D. E., and Everitt, B. J. (2014). Reconsolidation and extinction are dissociable and mutually exclusive processes: behavioral and molecular evidence. J. Neurosci. 34, 2422–2431. doi: 10.1523/JNEUROSCI.4001-13.2014
Merlo, E., and Romano, A. (2008). Memory extinction entails the inhibition of the transcription factor NF-kappa B. PLoS One 3:e3687. doi: 10.1371/journal.pone.0003687
Miller, S. G., and Kennedy, M. B. (1986). Regulation of brain type II Ca2+/calmodulin-dependent protein kinase by autophosphorylation: a Ca2+-triggered molecular switch. Cell 44, 861–870. doi: 10.1016/0092-8674(86)90008-5
Muly, E. C., Senyuz, M., Khan, Z. U., Guo, J. D., Hazra, R., and Rainnie, D. G. (2009). Distribution of D1 and D5 dopamine receptors in the primate and rat basolateral amygdala. Brain Struct. Funct. 213, 375–393. doi: 10.1007/s00429-009-0214-8
Nabavi, S., Fox, R., Proulx, C. D., Lin, J. Y., Tsien, R. Y., and Malinow, R. (2014). Engineering a memory with LTD and LTP. Nature 511, 348–352. doi: 10.1038/nature13294
Nader, K., Schafe, G. E., and Le Doux, J. E. (2000). Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature 406, 722–726. doi: 10.1038/35021052
Nijholt, I. M., Ostroveanu, A., Scheper, W. A., Penke, B., Luiten, P. G., Van der Zee, E. A., et al. (2008). Inhibition of PKA anchoring to A-kinase anchoring proteins impairs consolidation and facilitates extinction of contextual fear memories. Neurobiol. Learn. Mem. 90, 223–229. doi: 10.1016/j.nlm.2008.03.008
Nishijima, S., and Maruyama, I. N. (2017). Appetitive olfactory learning and long-term associative memory in caenorhabditis elegans. Front. Behav. Neurosci. 11:80. doi: 10.3389/fnbeh.2017.00080
Omkumar, R. V., Kiely, M. J., Rosenstein, A. J., Min, K. T., and Kennedy, M. B. (1996). Identification of a phosphorylation site for calcium/calmodulindependent protein kinase II in the NR2B subunit of the N-methyl-D-aspartate receptor. J. Biol. Chem. 271, 31670–31678. doi: 10.1074/jbc.271.49.31670
Ou, L. C., and Gean, P. W. (2006). Regulation of amygdala-dependent learning by brain-derived neurotrophic factor is mediated by extracellular signal-regulated kinase and phosphatidylinositol-3-kinase. Neuropsychopharmacology 31, 287–296. doi: 10.1038/sj.npp.1300830
Pagani, M. R., Oishi, K., Gelb, B. D., and Zhong, Y. (2009). The phosphatase SHP2 regulates the spacing effect for long-term memory induction. Cell 139, 186–198. doi: 10.1016/j.cell.2009.08.033
Paul, S., Olausson, P., Venkitaramani, D. V., Ruchkina, I., Moran, T. D., Tronson, N., et al. (2007). The striatal-enriched protein tyrosine phosphatase gates long-term potentiation and fear memory in the lateral amygdala. Biol. Psychiatry 61, 1049–1061. doi: 10.1016/j.biopsych.2006.08.005
Pavlov, I. P., and Anrep, G. V. (1927). Conditioned Reflexes; An Investigation of the Physiological Activity of the Cerebral Cortex. London: Oxford University Press: Humphrey Milford.
Pedreira, M. E., and Maldonado, H. (2003). Protein synthesis subserves reconsolidation or extinction depending on reminder duration. Learn. Mem. 38, 863–869. doi: 10.1016/s0896-6273(03)00352-0
Pedreira, M. E., Pérez-Cuesta, L. M., and Maldonado, H. (2004). Mismatch between what is expected and what actually occurs triggers memory reconsolidation or extinction. Learn. Mem. 11, 579–585. doi: 10.1101/lm.76904
Pelkey, K. A., Askalan, R., Paul, S., Kalia, L. V., Nguyen, T. H., Pitcher, G. M., et al. (2002). Tyrosine phosphatase STEP is a tonic brake on induction of long-term potentiation. Neuron 34, 127–138. doi: 10.1016/s0896-6273(02)00633-5
Price, C. J., Kim, P., and Raymond, L. A. (1999). D1 dopamine receptor-induced cyclic AMP-dependent protein kinase phosphorylation and potentiation of striatal glutamate receptors. J. Neurochem. 73, 2441–2446. doi: 10.1046/j.1471-4159.1999.0732441.x
Raman, I. M., Tong, G., and Jahr, C. E. (1996). β-adrenergic regulation of synaptic NMDA receptors by cAMP-dependent protein kinase. Neuron 16, 415–421. doi: 10.1016/s0896-6273(00)80059-8
Rodrigues, S. M., Farb, C. R., Bauer, E. P., LeDoux, J. E., and Schafe, G. E. (2004). Pavlovian fear conditioning regulates Thr286 autophosphorylation of Ca2+/calmodulin-dependent protein kinase II at lateral amygdala synapses. J. Neurosci. 24, 3281–3288. doi: 10.1523/JNEUROSCI.5303-03.2004
Romano, A., Freudenthal, R., Merlo, E., and Routtenberg, A. (2006). Evolutionarily-conserved role of the NF-kappaB transcription factor in neural plasticity and memory. Eur. J. Neurosci. 24, 1507–1516. doi: 10.1111/j.1460-9568.2006.05022.x
Rossato, J. I., Bevilaqua, L. R., Lima, R. H., Medina, J. H., Izquierdo, I., and Cammarota, M. (2006). On the participation of hippocampal p38 mitogen-activated protein kinase in extinction and reacquisition of inhibitory avoidance memory. Neuroscience 143, 15–23. doi: 10.1016/j.neuroscience.2006.07.025
Sananbenesi, F., Fischer, A., Wang, X., Schrick, C., Neve, R., Radulovic, J., et al. (2007). A hippocampal Cdk5 pathway regulates extinction of contextual fear. Nat. Neurosci. 10, 1012–1019. doi: 10.1038/nn1943
Santini, E., Ge, H., Ren, K., Peña de Ortiz, S., and Quirk, G. J. (2004). Consolidation of fear extinction requires protein synthesis in the medial prefrontal cortex. J. Neurosci. 24, 5704–5710. doi: 10.1523/JNEUROSCI.0786-04.2004
Schafe, G. E., Atkins, C. M., Swank, M. W., Bauer, E. P., Sweatt, J. D., and LeDoux, J. E. (2000). Activation of ERK/MAP kinase in the amygdala is required for memory consolidation of pavlovian fear conditioning. J. Neurosci. 20, 8177–8187. doi: 10.1523/JNEUROSCI.20-21-08177.2000
Schafe, G. E., and LeDoux, J. E. (2000). Memory consolidation of auditory pavlovian fear conditioning requires protein synthesis and protein kinase A in the amygdala. J. Neurosci. 20:RC96. doi: 10.1523/JNEUROSCI.20-18-j0003.2000
Schiff, H. C., Johansen, J. P., Hou, M., Bush, D. E., Smith, E. K., Klein, J. E., et al. (2017). β-adrenergic receptors regulate the acquisition and consolidation phases of aversive memory formation through distinct, temporally regulated signaling pathways. Neuropsychopharmacology 42, 895–903. doi: 10.1038/npp.2016.238
Schwaerzel, M., Heisenberg, M., and Zars, T. (2002). Extinction antagonizes olfactory memory at the subcellular level. Neuron 35, 951–960. doi: 10.1016/s0896-6273(02)00832-2
Shalin, S. C., Zirrgiebel, U., Honsa, K. J., Julien, J. P., Miller, F. D., Kaplan, D. R., et al. (2004). Neuronal MEK is important for normal fear conditioning in mice. J. Neurosci. Res. 75, 760–770. doi: 10.1002/jnr.20052
Sherrin, T., Blank, T., Hippel, C., Rayner, M., Davis, R. J., and Todorovic, C. (2010). Hippocampal c-Jun-N-terminal kinases serve as negative regulators of associative learning. J. Neurosci. 30, 13348–13361. doi: 10.1523/JNEUROSCI.3492-10.2010
Sindreu, C. B., Scheiner, Z. S., and Storm, D. R. (2007). Ca2+ -stimulated adenylyl cyclases regulate ERK-dependent activation of MSK1 during fear conditioning. Neuron 53, 79–89. doi: 10.1016/j.neuron.2006.11.024
Skeberdis, V. A., Chevaleyre, V., Lau, C. G., Goldberg, J. H., Pettit, D. L., Suadicani, S. O., et al. (2006). Protein kinase A regulates calcium permeability of NMDA receptors. Nat. Neurosci. 9, 501–510. doi: 10.1038/nn1664
Snyder, G. L., Fienberg, A. A., Huganir, R. L., and Greengard, P. (1998). A dopamine/D1 receptor/protein kinase A/dopamine- and cAMP-regulated phosphoprotein (Mr 32 kDa)/protein phosphatase-1 pathway regulates dephosphorylation of the NMDA receptor. J. Neurosci. 18, 10297–10303. doi: 10.1523/JNEUROSCI.18-24-10297.1998
Sperow, M., Berry, R. B., Bayazitov, I. T., Zhu, G., Baker, S. J., and Zakharenko, S. S. (2012). Phosphatase and tensin homologue (PTEN) regulates synaptic plasticity independently of its effect on neuronal morphology and migration. J. Physiol. 590, 777–792. doi: 10.1113/jphysiol.2011.220236
Szapiro, G., Vianna, M. R., McGaugh, J. L., Medina, J. H., and Izquierdo, I. (2003). The role of NMDA glutamate receptors, PKA, MAPK, and CAMKII in the hippocampus in extinction of conditioned fear. Hippocampus 13, 53–58. doi: 10.1002/hipo.10043
Tingley, W. G., Ehlers, M. D., Kameyama, K., Doherty, C., Ptak, J. B., Riley, C. T., et al. (1997). Characterization of protein kinase A and protein kinase C phosphorylation of the N-methyl-D-aspartate receptor NR1 subunit using phosphorylation site-specific antibodies. J. Biol. Chem. 272, 5157–5166. doi: 10.1074/jbc.272.8.5157
Todd, T. P., Vurbic, D., and Bouton, M. E. (2014). Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning. Neurobiol. Learn. Mem. 108, 52–64. doi: 10.1016/j.nlm.2013.08.012
Tully, T., and Quinn, W. G. (1985). Classical conditioning and retention in normal and mutant Drosophila melanogaster. J. Comp. Physiol. A 157, 263–277. doi: 10.1007/bf01350033
Vanhaesebroeck, B., Guillermet-Guibert, J., Graupera, M., and Bilanges, B. (2010). The emerging mechanisms of isoform-specific PI3K signalling. Nat. Rev. Mol. Cell Biol. 11, 329–341. doi: 10.1038/nrm2882
Venkitaramani, D. V., Moura, P. J., Picciotto, M. R., and Lombroso, P. J. (2011). Striatal-enriched protein tyrosine phosphatase (STEP) knockout mice have enhanced hippocampal memory. Eur. J. Neurosci. 33, 2288–2298. doi: 10.1111/j.1460-9568.2011.07687.x
Vianna, M. R., Igaz, L. M., Coitinho, A. S., Medina, J. H., and Izquierdo, I. (2003). Memory extinction requires gene expression in rat hippocampus. Neurobiol. Learn. Mem. 79, 199–203. doi: 10.1016/s1074-7427(03)00003-0
Walsh, K. H., Das, R. K., Saladin, M. E., and Kamboj, S. K. (2018). Modulation of naturalistic maladaptive memories using behavioural and pharmacological reconsolidation-interfering strategies: a systematic review and meta-analysis of clinical and ‘sub-clinical’ studies. Psychopharmacology 235, 2507–2527. doi: 10.1007/s00213-018-4983-8
Wang, Y., Cheng, A., and Mattson, M. P. (2006). The PTEN phosphatase is essential for long-term depression of hippocampal synapses. Neuromolecular Med. 8, 329–336. doi: 10.1385/nmm:8:3:329
Wang, H., Ferguson, G. D., Pineda, V. V., Cundiff, P. E., and Storm, D. R. (2004). Overexpression of type-1 adenylyl cyclase in mouse forebrain enhances recognition memory and LTP. Nat. Neurosci. 7, 635–642. doi: 10.1038/nn1248
Wang, J. H., and Kelly, P. T. (1996). The balance between postsynaptic Ca2+-dependent protein kinase and phosphatase activities controlling synaptic strength. Learn. Mem. 3, 170–181. doi: 10.1101/lm.3.2-3.170
Wang, J. H., and Kelly, P. T. (1997). Postsynaptic calcineurin activity downregulates synaptic transmission by weakening intracellular Ca2+ signaling mechanisms in hippocampal CA1 neurons. J. Neurosci. 17, 4600–4611. doi: 10.1523/JNEUROSCI.17-12-04600.1997
Wang, P., Mei, F., Hu, J., Zhu, M., Qi, H., Chen, X., et al. (2017). PTENα modulates CaMKII signaling and controls contextual fear memory and spatial learning. Cell Rep. 19, 2627–2641. doi: 10.1016/j.celrep.2017.05.088
Wang, Y. T., and Salter, M. W. (1994). Regulation of NMDA receptors by tyrosine kinases and phosphatases. Nature 369, 233–235. doi: 10.1038/369233a0
Wei, F., Qiu, C. S., Liauw, J., Robinson, D. A., Ho, N., Chatila, T., et al. (2002). Calcium calmodulin-dependent protein kinase IV is required for fear memory. Nat. Neurosci. 5, 573–579. doi: 10.1038/nn855
Winder, D. G., Mansuy, I. M., Osman, M., Moallem, T. M., and Kandel, E. R. (1998). Genetic and pharmacological evidence for a novel, intermediate phase of long-term potentiation suppressed by calcineurin. Cell 92, 25–37. doi: 10.1016/s0092-8674(00)80896-x
Wolfman, C., Fin, C., Dias, M., Bianchin, M., Da Silva, R. C., Schmitz, P. K., et al. (1994). Intrahippocampal or intraamygdala infusion of KN62, a specific inhibitor of calcium/calmodulin-dependent protein kinase II, causes retrograde amnesia in the rat. Behav. Neural Biol. 61, 203–205. doi: 10.1016/s0163-1047(05)80001-9
Wu, C. L., Xia, S., Fu, T. F., Wang, H., Chen, Y. H., Leong, D., et al. (2007). Specific requirement of NMDA receptors for long-term memory consolidation in Drosophila ellipsoid body. Nat. Neurosci. 10, 1578–1586. doi: 10.1038/nn2005
Yan, X., Zhang, B., Lu, W., Peng, L., Yang, Q., Cao, W., et al. (2017). Increased Src family kinase activity disrupts excitatory synaptic transmission and impairs remote fear memory in forebrain Shp2-deficient mice. Mol. Neurobiol. 54, 7235–7250. doi: 10.1007/s12035-016-0222-7
Yang, H., Hou, H., Pahng, A., Gu, H., Nairn, A. C., Tang, Y. P., et al. (2015). Protein phosphatase-1 inhibitor-2 is a novel memory suppressor. J. Neurosci. 35, 15082–15087. doi: 10.1523/JNEUROSCI.1865-15.2015
Yang, C. H., Huang, C. C., and Hsu, K. S. (2006). Novelty exploration elicits a reversal of acute stress-induced modulation of hippocampal synaptic plasticity in the rat. J. Physiol. 577, 601–615. doi: 10.1113/jphysiol.2006.120386
Yokoyama, M., Suzuki, E., Sato, T., Maruta, S., Watanabe, S., and Miyaoka, H. (2005). Amygdalic levels of dopamine and serotonin rise upon exposure to conditioned fear stress without elevation of glutamate. Neurosci. Lett. 379, 37–41. doi: 10.1016/j.neulet.2004.12.047
Zhang, B., Du, Y. L., Lu, W., Yan, X. Y., Yang, Q., Yang, W., et al. (2016). Increased activity of src homology 2 domain containing phosphotyrosine phosphatase 2 (Shp2) regulates activity-dependent AMPA receptor trafficking. J. Biol. Chem. 291, 18856–18866. doi: 10.1074/jbc.M116.714501
Keywords: associative memory, acquisition, consolidation, extinction, kinase, phosphatase
Citation: Pagani MR and Merlo E (2019) Kinase and Phosphatase Engagement Is Dissociated Between Memory Formation and Extinction. Front. Mol. Neurosci. 12:38. doi: 10.3389/fnmol.2019.00038
Received: 25 September 2018; Accepted: 31 January 2019;
Published: 20 February 2019.
Edited by:
Oliver Stork, Universitätsklinikum Magdeburg, GermanyReviewed by:
Kasia Radwanska, Nencki Institute of Experimental Biology (PAS), PolandBarbara A. Sorg, Washington State University, United States
Copyright © 2019 Pagani and Merlo. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Emiliano Merlo, ZW1pbWVybG9AZ21haWwuY29t
ZW00NTRAY2FtLmFjLnVr
ZS5tZXJsb0BzdXNzZXguYWMudWs=
† These authors have contributed equally to this work
‡ Present address: Emiliano Merlo, School of Psychology, University of Sussex, Falmer, United Kingdom