- 1Allen Institute for Brain Science, Seattle, WA, United States
- 2Centro Interdisciplinario de Neurociencia de Valparaíso, Facultad de Ciencias, Universidad de Valparaíso, Valparaíso, Chile
- 3Centro de Neurología Traslacional, Facultad de Medicina, Universidad de Valparaíso, Valparaíso, Chile
- 4Mind Brain Institute, Johns Hopkins University, Baltimore, MD, United States
Neuromodulation can profoundly impact the gain and polarity of postsynaptic changes in Hebbian synaptic plasticity. An emerging pattern observed in multiple central synapses is a pull–push type of control in which activation of receptors coupled to the G-protein Gs promote long-term potentiation (LTP) at the expense of long-term depression (LTD), whereas receptors coupled to Gq promote LTD at the expense of LTP. Notably, coactivation of both Gs- and Gq-coupled receptors enhances the gain of both LTP and LTD. To account for these observations, we propose a simple kinetic model in which AMPA receptors (AMPARs) are trafficked between multiple subcompartments in and around the postsynaptic spine. In the model AMPARs in the postsynaptic density compartment (PSD) are the primary contributors to synaptic conductance. During LTP induction, AMPARs are trafficked to the PSD primarily from a relatively small perisynaptic (peri-PSD) compartment. Gs-coupled receptors promote LTP by replenishing peri-PSD through increased AMPAR exocytosis from a pool of endocytic AMPAR. During LTD induction AMPARs are trafficked in the reverse direction, from the PSD to the peri-PSD compartment, and Gq-coupled receptors promote LTD by clearing the peri-PSD compartment through increased AMPAR endocytosis. We claim that the model not only captures essential features of the pull–push neuromodulation of synaptic plasticity, but it is also consistent with other actions of neuromodulators observed in slice experiments and is compatible with the current understanding of AMPAR trafficking.
Introduction
Organisms learn about their environment from experiences that are rewarding, aversive, or salient. At an elementary level, learning is thought to result from changes in the strength of specific synaptic connections, changes which in most cases are determined by local patterns of neural activity in a Hebbian manner, which is long-term potentiation (LTP) when pre-synaptic and post-synaptic activities correlate; and long-term depression (LTD) when they do not correlate (Malenka and Nicoll, 1999; Malenka and Bear, 2004). These local synaptic changes, in turn, are subordinated to global behavioral states somehow via the action of the long-range and diffusely projecting monoaminergic and cholinergic neuromodulatory systems. Hence, understanding the neuromodulation of Hebbian plasticity is central to understanding the mechanisms of learning.
Neuromodulators can activate multiple G-protein coupled receptors (GPCRs) to affect Hebbian plasticity in multiple ways. Hebbian plasticity is initiated by the intracellular Ca2+ signal that ensues the activation of postsynaptic NMDA-receptors and/or metabotropic glutamate receptors (mGluRs) and voltage-gated Ca2+channels. When the magnitude of this Ca2+signal exceeds a certain LTD-threshold, it selectively activates phosphatases that promote the removal of AMPA receptors (AMPAR) out of the synapse, and when it exceeds a larger LTP-threshold the Ca2+ signal promotes the activation of kinases and the incorporation of AMPARs into the synapse (Malenka and Nicoll, 1999; Shouval et al., 2002; Malenka and Bear, 2004). A wealth of studies has reported that neuromodulators affect this Ca2+ signal directly by acting on NMDARs for example, or indirectly by modulating cellular and/or circuit excitability (Faber et al., 2008; Pawlak et al., 2010; Tritsch and Sabatini, 2012; Edelmann and Lessmann, 2013; Meunier et al., 2017; Bari et al., 2020; Fernandez de Sevilla et al., 2021; Lutzu and Castillo, 2021). On the other hand, multiple mechanisms for the expression of NMDA-dependent Hebbian plasticity have been identified. These include the direct exchange of AMPAR between the synapse and internal compartments via exocytosis in LTP, for example (Lledo et al., 1998; Ahmad et al., 2012; Wu et al., 2017), changes in AMPAR unitary conductance (Park et al., 2021), and lateral diffusion of surface AMPARs and their trapping at postsynaptic density compartment (PSD) site, in case of LTP, and their release from the PSD, in the case of LTD (Oh et al., 2006; Derkach et al., 2007; Makino and Malinow, 2009; Newpher and Ehlers, 2009; Choquet, 2018; Diering and Huganir, 2018). These are complex processes that involve AMPAR phosphorylation at specific sites, interactions with multiple synaptic proteins, and possibly transient insertion of calcium-permeable AMPARs (Nicoll, 2017; Buonarati et al., 2019; Purkey and Dell'Acqua, 2020). The recruitment of these mechanisms in different synapses likely varies depending on experimental conditions like the induction protocols used. Hence, like the role of transient insertion of calcium-permeable AMPARs, the contribution of these mechanisms to LTP/D expression is still under debate. In consequence, although neuromodulation also occurs at this stage (Huang et al., 2012), the exact mechanisms are less understood than in the case of neuromodulation of the induction of plasticity.
Despite the diverse receptor targets of neuromodulators, results from several studies are roughly consistent with a simple rule, which is the pull–push regulation of LTP and LTD by receptors coupled to the G-proteins Gs and Gq. According to this rule, Gs-coupled receptors like the D1- dopaminergic receptor or the β-adrenoreceptor, which stimulate cAMP production, tend to promote LTP, but often at the expense of LTD (Thomas et al., 1996; Katsuki et al., 1997; Mockett et al., 2007; Seol et al., 2007; Lin et al., 2008; Huang et al., 2012; Nguyen and Gelinas, 2018; Brzosko et al., 2019). Conversely, Gq-coupled receptors that stimulate the phospholipase C cascade, like the α1-adrenoreceptor or the M1 cholinergic receptor, tend to promote LTD at the expense of LTP (Choi et al., 2005; Seol et al., 2007; Takamatsu et al., 2008; Huang et al., 2012; Hulme et al., 2012). In a previous study examining this pull–push regulation, we showed that it occurs at the level of the expression of plasticity. We also observed that while Gs-coupled receptors inhibit LTD and Gq-coupled receptors inhibit LTP when stimulated individually, and when acting together, they enhance the gain of both LTP and LTD (Seol et al., 2007; Huang et al., 2012). To account for these intriguing interactions between GPCRs, we propose a simple kinetic model in which AMPAR are trafficked in and out of the synapse through perisynaptic (peri-PSD) compartments of limited size (which models the presence of a limited amount of structural anchoring proteins). In the model, the expression of LTP and LTD is limited by the occupancy of AMPARs at the small perisynaptic compartments. GPCRs, in turn, regulate the LTP/D expression by controlling the filling of these perisynaptic compartments. We surmise that the described model captures several essential features of the data observed in the visual cortex and its application could be extended to neuromodulation in other structures.
Results
The trafficking model for the pull–push neuromodulation of Hebbian plasticity is illustrated in Figure 1. Essentially, it involves AMPAR trafficking between four saturable membrane compartments and one non-saturable internal endocytic compartment (endo). AMPARs in the PSD contribute to the synaptic conductance, and they can be trafficked to and from small peri-PSD compartments (PeriIN, PeriOut), which do not contribute to the synaptic responses. The model also features the neuromodulation of a direct exchange between the endocytic compartment and unanchored (UA) freely moving AMPARs, a fraction of which contribute to synaptic responses. This was a necessary minimal assumption to model the conspicuous, yet transient changes in synaptic responses induced by GPCR agonists alone (Huang et al., 2012).
Figure 1. Trafficking model of neuromodulation of Hebbian plasticity. AMPA receptors (red) at the synapse are either anchored at the postsynaptic density compartment (PSD) and in two close compartments (PeriIN, PeriOut), or unanchored. (A) Traffic between these synaptic compartments and with an endoplasmatic compartment (Endo) is low at rest (thin arrows). (B) Traffic between PSD and P-In, P-Out increases during long-term potentiation (LTP; left) and long-term depression (LTD; right) induction (thick arrows). (C) Activation of Gs increases traffic out of the Endo toward the synapse saturating both P-In and P-Out, thus preventing LTD. (D) Activation of Gq increases traffic out of the synapse toward the Endo compartment depleting both P-In and P-Out, thus preventing LTP. (E) Activation of both Gs and Gq increases the exchange between the synaptic and the Endo compartments, thus enabling/facilitating both, LTP and LTD.
We assume that at rest traffic between all the compartments is slow. LTP induction temporarily and selectively increases the traffic rate of AMPARs from the PeriIN to the PSD compartment, thus increasing synaptic conductance (Figure 1B left). Conversely, LTD induction temporarily increases the rate of traffic out of the PSD to empty slots in the PeriOut compartment, thus reducing synaptic conductance (Figure 1B right). We also assume that the PeriIN and PeriOut compartments have limited capacity. Consequently, LTP and LTD are constrained by the occupancy of these compartments. LTP would be limited by the number of AMPARs anchored at PeriIN and LTD by the number of empty slots at PeriOut.
The key feature of the model is that GPCRs control the expression of LTP and LTD by determining the occupancy of the PeriIN and PeriOut compartments. Activation of GPCRs increases AMPAR traffic of the endocytic compartment with the two perisynaptic compartments and with the UA pool of AMPARs. Gs-coupled receptors increase exocytosis to the PeriIN, the UA AMPARs, and to a lesser extent the PeriOut compartments (Figure 1C). Gq-coupled receptors increase the endocytosis from the PeriOut, the UA AMPARs, and to a lesser extent the PeriIN compartments (Figure 1D). Thus, activation of Gs-coupled receptors would prevent LTD by saturating the PeriOut compartment (Figure 1C), whereas Gq activation would deplete the PeriIN compartment and prevent LTP (Figure 1D). The coactivation of Gs- and Gq-coupled receptors would saturate the PeriIN and deplete the PeriOut compartments because of their differential effects on the exchange between the endo and perisynaptic compartments, thus enabling the expression of both LTP and LTD.
The central motivation for the trafficking model outlined above was a study that examined in slices how agonists for β- and α-adrenergic receptors (respectively, coupled to Gs and Gq) affect LTP and LTD induced by pairing conditioning. The study showed that, indeed, activation of β-adrenoreceptors promotes LTP at the expense of LTD, activation of α-adrenoreceptors promotes LTP at the expense of LTD, and, importantly, activation of both together (β- and α-adrenoreceptors) promote both LTP and LTD. We asked, therefore, whether with reasonable assumptions, the trafficking could account for that experimental data on neuromodulation of LTP and LTD. The equations governing the AMPAR trafficking between compartments used in the fitting and the values of the constants and parameters are detailed in the Materials and Methods section. Briefly, the rates of trafficking to and from the PSD compartments during LTP and LTD were assumed to depend on kinases and phosphatases activated by Ca influx during the pairing conditioning, whereas the movement of unanchored AMPARs was assumed limited by lateral diffusion.
To test the model, we first optimized parameters to fit the time course and magnitude of the reported changes in synaptic responses after LTP or LTD induction and after activation of β-and/or α-adrenoreceptors separately. Then we tested the ability of the model to reproduce the interactions between LTP/D and β-and/or α-adrenoreceptors. In the experimental study, the noradrenergic agonists were applied for 10 min, whereas LTP/D were induced with a 2-min pairing of synaptic activation with postsynaptic depolarization delivered by the end of the agonist application (Huang et al., 2012). Parameters optimized included the synaptic size of the compartment, the exchange rates after LTP/D, and the GPCRs activation. The optimization aimed to fit the results reported in Figure 1 of Huang et al. (2012), which capture the essence of the pull–push nature of the neuromodulation of LTP/D. As shown in Figure 2, with adequate parameters and initial values, the changes in synaptic conductance calculated with the model (thick black lines) fit the experimental data (gray circles) in each of the five conditions. Note that in the model LTP and β-adrenoreceptor activation, both potentiate the synaptic response, but through different mechanisms (increasing AMPAR at the PSD or the UA ones) and with opposite effects on the PeriIN compartments. LTP depletes the PeriIN compartment whereas the β-adrenoreceptor saturates it (Figures 2B,D). Conversely, LTD and α-adrenoreceptor activation both depress the synaptic response by reducing PSD-anchored and UA AMPARs, respectively, but with opposite effects on the occupancy of the PeriOut compartment (Figures 2C,E). On the other hand, coactivation of β- and α-adrenoreceptors modestly affect the synaptic responses, as their effects on the unanchored AMPAR pool cancel out; yet they saturate the PeriIN and deplete the PeriOut compartments (Figure 2F).
Figure 2. Simulation of how long-term potentiation (LTP)/long-term depression (LTD) induction and the stimulation of Gs and Gq-coupled receptors change the occupancy of the modeled AMPA receptor (AMPAR) compartments. (A) Color conventions of the various synaptic compartment described in the remaining panels. Also included are gray circles representing actual synaptic response data from Huang et al. (2012). (B) An LTP-induction protocol (vertical gray bar) transiently increases AMPAR traffic onto the postsynaptic density compartment (PSD)95 from the PeriIN compartment, depleting it, but without affecting the PeriOut compartment. This results in a net increase in synaptic conductance with a time course, comparable with changes reported in Huang et al. (2012). Left Y-axis: occupancy of synaptic compartments; right Y-axis: normalized synaptic response. (C) An LTD protocol (vertical gray bar) transiently increases traffic out of the PSP onto the PeriOut compartment, filling it up, and reducing synaptic conductance. (D) Stimulation of Gs-coupled receptors (horizontally striped bar) increases AMPAR trafficking from the endosomatic compartment into all but the PSD synaptic compartments causing a transient increase in synaptic conductance. (E) Stimulation of Gq-coupled receptors (vertically striped bar) increases AMPAR trafficking to the endosomatic compartment from all but the P synaptic compartments causing a transient decrease in synaptic conductance compartments. (F) Stimulation of Gs-and Gq-coupled receptors (checkered bar) increases AMPAR trafficking (in and out) between the endosomal and all but the PDS95 synaptic compartments. This fills up the PeriIN compartment, depletes the PeriOut compartment, and results in a modest transient increase in synaptic conductance.
Subsequently, we checked whether the model accounts for the interactions between LTP/D and the neuromodulators. Indeed, the principal motivation for building the trafficking model was to account that while the activation of β- and α-adrenoreceptors individually prevent LTD and LTP, respectively, together they promote LTP and LTD. In the slice experiments, LTP and LTD were attempted at the end of the 10-min application of the neuromodulators (Huang et al., 2012). In the model, we used that timing sequence, and importantly we used the same values for parameters and constants optimized above in Figure 2. As shown in Figure 3, there was a clear concordance between the outcomes predicted by the model and the experimental data, both in the magnitude and time course of the changes in synaptic response. Like the activation of β- and α-adrenoreceptors in the slice, in the model Gs activation allows LTP and prevents LTD by saturating the perisynaptic compartments (Figures 3A,D), Gq activation allows LTD and prevents LTP by depleting the perisynaptic compartments (Figures 3B,E), and the coactivation of Gq and GS allows both LTP and LTD (Figures 3C,F).
Figure 3. Simulation of how Gs- and Gq-coupled receptors affect the induction of long-term potentiation (LTP) and long-term depression (LTD) by filling and depleting AMPA receptor synaptic compartments. The upper row shows the effects on LTP; the lower row, the effect on LTD. Color conventions of compartments as in Figure 2. PeriIN: green; PeriOut: blue; Non-anchored: brown; postsynaptic density compartment: red; Synaptic conductance: black; actual data from Huang et al. (2012): gray circles. Left column (A,B) shows that Gs-GPCR stimulation (horizontally striped bar) fills up the PeriIN and PeriOut compartments, barely affecting the induction (gray vertical bar) of LTP (A), but preventing the induction of LTD (B). The middle column (C,D) shows that Gq-GPCR stimulation (vertically striped bar) depletes both the PeriIN and the PeriOut compartments, preventing the induction of LTP (C) without affecting the induction of LTD (D). The right column (E,F) shows that co-stimulating Gs- and Gq-GPCRs fills up and depletes the PeriIN and the PeriOut compartments, respectively, allowing the induction of both LTP (E) and LTD (F).
Finally, we sought experimental support for the idea, central to the model, that neuromodulators can affect perisynaptic AMPARs. To that end, we studied in hippocampal slices the CA3 → CA1 synapses, where perisynaptic AMPAR responses can be revealed and quantified by increasing glutamate spillover (Megill et al., 2015) via blocking glutamate uptake with the inhibitor TBOA (see methods). Bath-applied TBOA increases the amplitude and duration of the synaptic responses, reflecting the recruitment of extrasynaptic AMPARs. In the experimental design, we also exploited the previous observation that activation of β- and α-adrenoreceptors have lasting, “priming,” effects on LTP and LTD (Huang et al., 2012) that are consistent with lasting changes in the occupancy of the perisynaptic compartments. Thus, we asked how priming with noradrenergic agonists alters the effects of TBOA on synaptic responses recorded extracellularly as field potentials (FP) in CA1. As shown in Figure 4A, in the hippocampus, a 10-min pretreatment with the β-adrenergic agonist isoproterenol (Iso: 10 μM) increased the enhancements of the FP induced by bath-applied TBOA (10 μM); conversely, the α-adrenergic agonist methoxamine (Mtx:10 μM) reduced the TBOA-induced FP enhancement. An ANOVA test (F2[2, 26] = 11.22; p = 0.0003) followed by Dunnett's post-hoc test confirmed the significance of the differences in the slopes measured 10–15 min after TBOA application. These results are consistent with a scenario in which β-and α-adrenoreceptors, respectively, increase and reduce the pool of extrasynaptic AMPARs. In the visual cortex, on the other hand, TBOA does not affect the synaptic response magnitude, responses collected in the −5 to 0 min interval prior to TBOA application, were comparable with those collected in the 25–30 min interval post TBOA application (paired t-test: p = 0.9616; Figure 4B). This might reflect a smaller capacity of the perisynaptic compartments or a larger distance from the synapse in the visual cortex (see section Discussion).
Figure 4. Evidence for an adrenergic modulation of a perisynaptic pool of AMPA receptors (AMPARs). (A) In SC-CA1 synapses of the hippocampus bath application of a glutamate uptake blocker (T-BOA: 10 μM. green box) enhances the synaptic responses (black symbols). Pretreating the slices with the agonist for β-adrenergic receptors (coupled to Gs) isoproterenol (Iso: 10 μM for 10 min) potentiates the effects of T-BOA. In contrast, pretreating with an agonist for the a1 adrenergic receptor (coupled to Gq) methoxamine (Mtx: 5 μM for 10 min) reduces the enhancement induced by T-BOA. (B) In the visual cortex, T-BOA does not affect synaptic responses suggesting that the pool of perisynaptic AMPARsis too small to be detected. Traces in (A,B) are averages of 10 consecutive responses recorded 10 min. before (B) and 10 min. after (A) the addition of T-BOA. Each symbol in (A,B) represents data normalized as % of pre-TBOA baseline and averaged over 1 min.
Discussion
G-protein coupled receptors can facilitate and suppress LTP and LTD in a pull–push manner (Huang et al., 2012). To account for these opposite effects, we developed a simple model where neuromodulators modify the occupancy of two small and saturable perisynaptic compartments that limit the AMPAR traffic in and out of the synapse. This action at the expression level is sufficient to account for the suppression of LTP and LTD by Gs and Gq-coupled receptors, and their paradoxical synergy when simultaneously activated. Note that although GPCRs do affect Ca2+ signaling and the kinases and phosphatases involved in LTP/LTD induction (Pawlak et al., 2010; Tritsch and Sabatini, 2012; O'Dell et al., 2015; Meunier et al., 2017; Bari et al., 2020; Fernandez de Sevilla et al., 2021; Lutzu and Castillo, 2021), these actions are not required for the model to work. Indeed, for simplicity, they were not considered in this model. This contrasts with previous models explaining the facilitation of LTP and LTD induction in terms of changes in the kinase and phosphatase signaling pathways (Jedrzejewska-Szmek et al., 2017; Blackwell et al., 2019; Maki-Marttunen et al., 2020). We surmise that the two types of models, those focusing on the facilitation of induction via changes in kinases and phosphatases and this one focusing on the suppression of the expression via modulation AMPAR trafficking, are complementary and necessary for a comprehensive understanding of the neuromodulation of Hebbian plasticity.
Experimental evidence indicates that GPCRs can regulate LTP and LTD at the expression level independently of the well-documented facilitation of LTP and LTD induction. First, we have shown that the suppression of LTP and LTD by GPCRs is independent of changes in NMDAR activation and cell excitability (Huang et al., 2012). Second, stimulation of GPCRs and LTP/D induction can be dissociated in time. A brief GPCR stimulation epoch can prime the facilitation/suppression of LTP/D elicited even hours later (Tenorio et al., 2010; Huang et al., 2012; Hulme et al., 2012). GPCRs can also act retroactively after plasticity has been induced (Brzosko et al., 2015, 2017, 2019) or attempted (Yagishita et al., 2014; He et al., 2015; Fisher et al., 2017; Shindou et al., 2019). The trafficking model is well-suited to reproduce these temporal features of plasticity neuromodulation. GPCR-induced changes in perisynaptic compartment occupancy and its effect on LTP/D will tend to persist because AMPAR exchange is very slow at rest, following GPCR stimulation at rest. For example, a persistent saturation of these compartments after a brief and strong β-adrenergic stimulation would result in a lasting priming of LTP and lasting suppression of LTD (Huang et al., 2012). Conversely, a lasting depletion of these compartments after α-adrenergic or M1-muscarinic activation would result in the lasting priming of LTD and suppression of LTP (Huang et al., 2012). On the other hand, the retroactive actions of GPCRs, particularly the transformation of silent synaptic eligibility traces onto LTP and LTD, might reflect the combination of residual kinases/phosphatase activity and GPCR-induced changes in the occupancy of the perisynaptic compartments. In sum, the mechanistic dissociation of the induction (NMDAR activation, kinases/phosphatase activities) and the expression of plasticity (AMPAR modification and trafficking) provides a reasonable basis to account for defining temporal features of its neuromodulation.
As mentioned in the introduction, several distinct mechanisms for the expression of postsynaptic Hebbian plasticity have been identified, including lateral diffusion of AMPAR to and from the synapse, direct exchange with internal compartments, and changes in the unitary conductance of AMPAR; yet their relative contribution to LTP/D in different synapses remain unclear. Our model of pull–push neuromodulation, based on data from layer 4 → Layer 2/3 cortical synapses, is congruent with lateral diffusion only. How a pull–push neuromodulation could be implemented in the scenario of direct exo- and endocytosis or how GPCRs could affect changes in AMPAR unitary conductance in a pull–push manner remains to be explored, but it is not excluded as a possibility by our model. Our model also features the distinct assumption that AMPAR exchange to and from the PSD is channeled via two perisynaptic compartments whose occupancy, in turn, is controlled by GPCRs and constrains LTP and LTD. We arrived at this two compartments assumption due to the difficulty of fully modeling the simultaneous facilitation of LTP and LTD with a single compartment when Gs and Gq are coactivated. This is because facilitation of LTP by Gs-GPCRs would require saturating the single compartment whereas facilitation of LTD by Gq-GPCRs would require the depletion of that compartment. Simultaneous activation of Gs-GPCRs and Gq-GPCRs experimentally led to the facilitation of both LTP and LTD, and a parsimonious explanation involves the separation of these compartments. We did not explore other more complicated possibilities, for example, combining a single perisynaptic compartment with more complex schemes of trafficking signaling. The exact nature of these two hypothesized compartments and how GPCRs could control their occupancy remain open questions. A likely candidate mechanism for the occupancy and trafficking control could be the phosphorylation of a distinct constellation of sites in the AMPARs (Diering et al., 2016). In the few cases examined, different GPCRs phosphorylate different subsets of these sites (Hu et al., 2007; Seol et al., 2007; Huang et al., 2014), which in turn would be in tune with the notion of a “phosphorylation code” for AMPAR trafficking (Diering and Huganir, 2018).
Concerning the existence of two perisynaptic compartments, we note that the idea is consistent with the observation of a discrete and defined perisynaptic locus for endocytosis during LTD (Lu et al., 2007). Also consistent with the model are the results of Figure 4 showing that in the hippocampal slices GPCRs can control bidirectionally perisynaptic AMPARs revealed by blocking glutamate uptake. In visual cortical slices, blocking glutamate uptake did not reveal perisynaptic AMPARs, raising the intriguing possibility that the capacity of these perisynaptic compartments is smaller in cortical synapses than in hippocampal slices or that they are farther away from the synapse.
Finally, the trafficking model for the pull–push neuromodulation makes clear testable predictions. Indeed, a validating aspect of the model was that the values for constants and parameters obtained by fitting the LTP/LTD and Gs/Gq data independently predicted the effects of coactivating Gs and Gq on LTP/D. In Ca1, where the opposite modulation of LTP and LTD by individual GCPRs is well-documented (Katsuki et al., 1997; Mockett et al., 2007; Huang et al., 2012), the model predicts that the coactivation of Gs-GCPR and Gq-GCPR would promote both LTP at LTD. In addition, in CA1 and the visual cortex, the exposure to Gs-GCPR agonists can prime LTP facilitation and LTD suppression for an extended time (Huang et al., 2012). The model predicts that if priming reflects persistent saturation of perisomatic compartments then LTP facilitation and LTD suppression should decay at the same pace. In sum, we surmise that ours is a simple model that accounts for defining features of the pull–push neuromodulation of Hebbian plasticity and makes predictions that can be tested experimentally.
Materials and Methods
Slice Experiments
Experiments were performed according to the guidelines for the use of animals approved by the Ethics and Animal Care Committee of Universidad de Valparaíso (BEA064-2015) and the IACUC of Johns Hopkins University (MO14M404). Acute hippocampal or cortical slices were prepared from 1-month-old C57/BL6 mice as previously described (Huang et al., 2012; Ardiles et al., 2014). Briefly, each mouse was sacrificed by decapitation, following an overdose of isoflurane. Hippocampi were rapidly removed and sectioned into 350 μm slices using oxygenated ice-cold dissection buffer [composed of (in mm) 212.7 sucrose, 2.6 KCl, 1.23 NaH2PO4, 26 NaHCO3, 10 dextrose, 3 MgCl2, and 1 CaCl2] and recovered at room temperature in artificial CSF [ACSF; composed of (in mm) 124 NaCl, 5 KCl, 1.25 NaH2PO4, 26 NaHCO3, 10 dextrose, 1.5 MgCl2, and 2.5 CaCl2]. All recordings were done in a submersion recording chamber perfused with ACSF (29–30°C, 2 ml/min) bubbled with 95% O2/5% CO2. For FP recordings, synaptic responses were delivered through a bipolar glass stimulating electrode placed to activate the Schaffer collaterals with a 0.2-ms duration pulse (baseline stimulation at 0.0333 Hz) and recorded from the dendritic field of CA1. EPSCs in layer 2/3 pyramidal cells evoked by layer 4 stimulation were recorded as in Huang et al. (2012). Synaptic responses were digitized and stored online using Igor Pro software (WaveMetrics). To evaluate the neuromodulatory effect of Gs and Gq adrenoceptors, after 15 min of stable baseline, slices were superfused for 10 min with adrenergic agonists isoproterenol (Iso; 10 μm) and methoxamine (Mtx; 5 μm). Then 10 μm dl-threo-β-benzyloxyaspartic acid (TBOA, Tocris Biosciences), a competitive blocker of glutamate transporters, was used to induce spillover of glutamate and to reveal the activity of perisynaptic AMPARs. In these experiments, CA3 was cut away during dissection, and high divalents were added to the ACSF (4 mM MgCl2 and 4 mM CaCl2). Isolated AMPAR-mediated responses were evoked in the presence of 100 μM D,L-APV, and 2.5 μM gabazine. To prevent oxidation, isoproterenol and methoxamine were prepared freshly in ASCF containing sodium ascorbate (40 μM). FP slopes were measured and data are expressed as means ± SEM. All FP and EPSC data had a normal distribution as confirmed by D'Agostino–Pearson normality test. ANOVA and t-test were performed in Prism.
Model
Three sets of equations describing the traffic of AMPARs between the PSD, PeriIN, PeriOut, UA, and Endo compartments and the occupancy of PSD, PeriIN, and PeriOut are described below. The set of equations represent three-time intervals, which are modulation, induction, and after induction. The dynamic equations are the same in the three-time intervals but differ in the constants used. The final values for the dynamics in one interval are used as the initial condition for the subsequent interval. The initial condition for the first interval is computed from the analytical solution of the dynamics reaching equilibrium at rest. The suffix A for each compartment denotes sites with anchored AMPAR, the suffix F denotes free sites; thus A plus F represents the total size of each compartment, which is constant in time during our simulations. Values of parameters and constants were chosen to fit the results of Figure 1 in Huang et al. (2012) and are indicated after the equations. Note that in that study, the induction protocols for Figure 1 were aimed at eliciting maximal plasticity; hence the rates of LTP and LTD, represented by Kin and PP, respectively are not affected by the neuromodulators. The *model was written in Mathematica, and the code is available upon request.
Dynamical Equations
The first four equations represent the dynamics of the occupancy of the compartments. The next two equations represent normalized dynamics of the concentrations of kinases and phosphatases. These equations and parameters are identical during the modulation and induction. After induction, the equations are the same, but some of the parameters change. The parameters that change have an index M in the above equations and use the same parameter name without M (see the section Parameter Description) after the induction.
While the dynamical equations are kept general, allowing transitions between multiple compartments, it should be noted that several of these transition constants are zero in the model which reproduces well the observed data.
Initial Conditions
For the modulation period, the initial conditions start from the equilibrium value of the solution for the equations after induction.
For the induction period, the initial conditions are the end of the modulation period with an added step increase for the normalized kinases and phosphatases in the PeriIN and PeriOut compartments (KinPeriINInd, PpPeriOutInd).
For the after-induction period, the initial conditions are the end of the induction period.
Weight
The simulated weight represents the concentration of bound AMPAR in the PSD and the UA compartments. The weight is smoothed with an exponential kernel with time constant tau.
Parameters
It should be noted that given the complexity of the model compared with the number of experimental observations an automatic parameter tuning could not be performed. Therefore, it is important to view these parameters as a possible explanation for the observed data, and not necessarily the only explanation for the observed data. While this is a significant limitation of the current model, we believe the model offers an important conceptual description of the phenomenology, and more precise estimates of the large number of parameters involved would require a vast array of measurements of the biochemical processes involved.
The modulation period lasts 9 min, induction 2, and the total simulation time is 50 min. The unit of time used is minutes.
The total sizes of different compartments are normalized relative to the size of the PSD compartment (TPsd = 1). For the recorded data, there was no clear need to differentiate their respective sizes, and they were all simulated to be equal and quite a bit smaller than the PSD (TAU = TPeriIn = TPeriOut = 0.2).
The rare constants are normalized such that the free AMPAR concentration is 1. While the equations are written in general for the movement of the AMPAR between compartments, the constants characterizing the movement from PeriIn to PSD and PSD to PeriOut are the only non-zero constants (kPeriINPsd = 0.001, kPsdPeriOut = 0.004). Both are very slow, requiring hours to reach equilibrium occupancy (i.e., for the synapse to revert to its background state), and the out rate is higher, resulting in an equilibrium state which is biased toward the PSD anchoring, options being mostly free.
Following LTP or LTD induction, these rates change significantly. They change by a multiplicative factor (KinPeriIN and PpPeriOut), which is time-dependent and abstractly approximates the effects of kinases and phosphatases. These multiplicative factors are computed in the last two dynamic equations. Their values are defined to be normalized to their resting values (the equilibrium solution is defined to be 1 for these variables). Following an LTP induction, KinPeriIn is increased by a factor of KinPeriINInd = 1,000 and reverts to equilibrium with a time constant of kKin = 1/(4 min), while PpPeriOut increases by a factor of PpPeriOutInd = 400 and reverts back to equilibrium with a time constant of kPp = 1/(10 min). The movement to PeriIN and PeriOut compartments is subject to saturation, with saturation half-activations km2Kin = 0.1 and km2Pp = 0.1, which were kept fix at half the size of the Peri compartments.
Lastly, without modulation, the rates from and to the Peri compartments to the Endo(somal) compartment are fixed at 1/(50 min) and from UA to and from Endo at 1/(20 min). Application of beta-agonists leads to an increase of movement from Endo PeriIn by a factor of 100, to PeriOut by a factor of 10, and to UA by a factor of 4.5. Application of alpha agonists leads to an increase in movement to Endo from PeriOut by a factor of 100, from PeriIn by a factor of 10, and from UA by a factor of 2.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The animal study was reviewed and approved by Ethics and Animal Care Committee of Universidad de Valparaíso (BEA064-2015).
Author Contributions
SM and AK developed the model and wrote the manuscript. SM implemented the model. AA, AP, and AK designed the slice experiments. AA conducted the experiments. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by grant R01EY012124 to AK, who was also supported by the NIH grant P01 AG009973. AP was supported by grant MILENIO ICM-ANID P09-022-F and AA by grant FONDECYT 1201342.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The authors thank Dr. Hey-Kyoung Lee for the helpful comments.
References
Ahmad, M., Polepalli, J. S., Goswami, D., Yang, X., Kaeser-Woo, Y. J., Sudhof, T. C., et al. (2012). Postsynaptic complexin controls AMPA receptor exocytosis during LTP. Neuron 73, 260–267. doi: 10.1016/j.neuron.2011.11.020
Ardiles, A. O., Flores-Munoz, C., Toro-Ayala, G., Cardenas, A. M., Palacios, A. G., Munoz, P., et al. (2014). Pannexin 1 regulates bidirectional hippocampal synaptic plasticity in adult mice. Front. Cell Neurosci. 8:326. doi: 10.3389/fncel.2014.00326
Bari, B. A., Chokshi, V., and Schmidt, K. (2020). Locus coeruleus-norepinephrine: basic functions and insights into Parkinson's disease. Neural Regen. Res. 15, 1006–1013. doi: 10.4103/1673-5374.270297
Blackwell, K. T., Salinas, A. G., Tewatia, P., English, B., Hellgren Kotaleski, J., and Lovinger, D. M. (2019). Molecular mechanisms underlying striatal synaptic plasticity: relevance to chronic alcohol consumption and seeking. Eur. J. Neurosci. 49, 768–783. doi: 10.1111/ejn.13919
Brzosko, Z., Mierau, S. B., and Paulsen, O. (2019). Neuromodulation of spike-timing-dependent plasticity: past, present, and future. Neuron 103, 563–581. doi: 10.1016/j.neuron.2019.05.041
Brzosko, Z., Schultz, W., and Paulsen, O. (2015). Retroactive modulation of spike timing-dependent plasticity by dopamine. eLife 4:e09685. doi: 10.7554/eLife.09685.017
Brzosko, Z., Zannone, S., Schultz, W., Clopath, C., and Paulsen, O. (2017). Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation. eLife 6:e27756. doi: 10.7554/eLife.27756.020
Buonarati, O. R., Hammes, E. A., Watson, J. F., Greger, I. H., and Hell, J. W. (2019). Mechanisms of postsynaptic localization of AMPA-type glutamate receptors and their regulation during long-term potentiation. Sci. Signal. 12:eaar6889. doi: 10.1126/scisignal.aar6889
Choi, S., Chang, J., Jiang, B., Seol, G. H., Min, S. S., Han, J. S., et al. (2005). Multiple receptors coupled to PLC gate LTD in visual cortex. J. Neurosci. 25, 11433–11443. doi: 10.1523/JNEUROSCI.4084-05.2005
Choquet, D. (2018). Linking nanoscale dynamics of AMPA receptor organization to plasticity of excitatory synapses and learning. J. Neurosci. 38, 9318–9329. doi: 10.1523/JNEUROSCI.2119-18.2018
Derkach, V. A., Oh, M. C., Guire, E. S., and Soderling, T. R. (2007). Regulatory mechanisms of AMPA receptors in synaptic plasticity. Nat. Rev. Neurosci. 8, 101–113. doi: 10.1038/nrn2055
Diering, G. H., Heo, S., Hussain, N. K., Liu, B., and Huganir, R. L. (2016). Extensive phosphorylation of AMPA receptors in neurons. Proc. Natl. Acad. Sci. U.S.A. 113, E4920–4927. doi: 10.1073/pnas.1610631113
Diering, G. H., and Huganir, R. L. (2018). The AMPA receptor code of synaptic plasticity. Neuron 100, 314–329. doi: 10.1016/j.neuron.2018.10.018
Edelmann, E., and Lessmann, V. (2013). Dopamine regulates intrinsic excitability thereby gating successful induction of spike timing-dependent plasticity in CA1 of the hippocampus. Front. Neurosci. 7:25. doi: 10.3389/fnins.2013.00025
Faber, E. S., Delaney, A. J., Power, J. M., Sedlak, P. L., Crane, J. W., and Sah, P. (2008). Modulation of SK channel trafficking by beta adrenoceptors enhances excitatory synaptic transmission and plasticity in the amygdala. J. Neurosci. 28, 10803–10813. doi: 10.1523/JNEUROSCI.1796-08.2008
Fernandez de Sevilla, D., Nunez, A., and Buno, W. (2021). Muscarinic receptors, from synaptic plasticity to its role in network activity. Neuroscience 456, 60–70. doi: 10.1016/j.neuroscience.2020.04.005
Fisher, S. D., Robertson, P. B., Black, M. J., Redgrave, P., Sagar, M. A., Abraham, W. C., et al. (2017). Reinforcement determines the timing dependence of corticostriatal synaptic plasticity in vivo. Nat. Commun. 8:334. doi: 10.1038/s41467-017-00394-x
He, K., Huertas, M., Hong, S. Z., Tie, X., Hell, J. W., Shouval, H., et al. (2015). Distinct eligibility traces for LTP and LTD in cortical synapses. Neuron 88, 528–538. doi: 10.1016/j.neuron.2015.09.037
Hu, H., Real, E., Takamiya, K., Kang, M. G., Ledoux, J., Huganir, R. L., et al. (2007). Emotion enhances learning via norepinephrine regulation of AMPA-receptor trafficking. Cell 131, 160–173. doi: 10.1016/j.cell.2007.09.017
Huang, S., Rozas, C., Trevino, M., Contreras, J., Yang, S., Song, L., et al. (2014). Associative Hebbian synaptic plasticity in primate visual cortex. J. Neurosci. 34, 7575–7579. doi: 10.1523/JNEUROSCI.0983-14.2014
Huang, S., Trevino, M., He, K., Ardiles, A., Pasquale, R., Guo, Y., et al. (2012). Pull-push neuromodulation of LTP and LTD enables bidirectional experience-induced synaptic scaling in visual cortex. Neuron 73, 497–510. doi: 10.1016/j.neuron.2011.11.023
Hulme, S. R., Jones, O. D., Ireland, D. R., and Abraham, W. C. (2012). Calcium-dependent but action potential-independent BCM-like metaplasticity in the hippocampus. J. Neurosci. 32, 6785–6794. doi: 10.1523/JNEUROSCI.0634-12.2012
Jedrzejewska-Szmek, J., Luczak, V., Abel, T., and Blackwell, K. T. (2017). beta-adrenergic signaling broadly contributes to LTP induction. PLoS Comput. Biol. 13:e1005657. doi: 10.1371/journal.pcbi.1005657
Katsuki, H., Izumi, Y., and Zorumski, C. F. (1997). Noradrenergic regulation of synaptic plasticity in the hippocampal CA1 region. J. Neurophysiol. 77, 3013–3020. doi: 10.1152/jn.1997.77.6.3013
Lin, Y. W., Yang, H. W., Min, M. Y., and Chiu, T. H. (2008). Inhibition of associative long-term depression by activation of beta-adrenergic receptors in rat hippocampal CA1 synapses. J. Biomed. Sci. 15, 123–131. doi: 10.1007/s11373-007-9205-z
Lledo, P. M., Zhang, X., Sudhof, T. C., Malenka, R. C., and Nicoll, R. A. (1998). Postsynaptic membrane fusion and long-term potentiation. Science 279, 399–403. doi: 10.1126/science.279.5349.399
Lu, J., Helton, T. D., Blanpied, T. A., Racz, B., Newpher, T. M., Weinberg, R. J., et al. (2007). Postsynaptic positioning of endocytic zones and AMPA receptor cycling by physical coupling of dynamin-3 to Homer. Neuron 55, 874–889. doi: 10.1016/j.neuron.2007.06.041
Lutzu, S., and Castillo, P. E. (2021). Modulation of NMDA receptors by G-protein-coupled receptors: role in synaptic transmission, plasticity and beyond. Neuroscience 456, 27–42. doi: 10.1016/j.neuroscience.2020.02.019
Maki-Marttunen, T., Iannella, N., Edwards, A. G., Einevoll, G. T., and Blackwell, K. T. (2020). A unified computational model for cortical post-synaptic plasticity. eLife 9:e55714. doi: 10.7554/eLife.55714.sa2
Makino, H., and Malinow, R. (2009). AMPA receptor incorporation into synapses during LTP: the role of lateral movement and exocytosis. Neuron 64, 381–390. doi: 10.1016/j.neuron.2009.08.035
Malenka, R. C., and Bear, M. F. (2004). LTP and LTD: an embarrassment of riches. Neuron 44, 5–21. doi: 10.1016/j.neuron.2004.09.012
Malenka, R. C., and Nicoll, R. A. (1999). Long-term potentiation–a decade of progress? Science 285, 1870–1874. doi: 10.1126/science.285.5435.1870
Megill, A., Tran, T., Eldred, K., Lee, N. J., Wong, P. C., Hoe, H. S., et al. (2015). Defective age-dependent metaplasticity in a mouse model of Alzheimer's disease. J. Neurosci. 35, 11346–11357. doi: 10.1523/JNEUROSCI.5289-14.2015
Meunier, C. N., Chameau, P., and Fossier, P. M. (2017). Modulation of synaptic plasticity in the cortex needs to understand all the players. Front. Synaptic Neurosci. 9:2. doi: 10.3389/fnsyn.2017.00002
Mockett, B. G., Guevremont, D., Williams, J. M., and Abraham, W. C. (2007). Dopamine D1/D5 receptor activation reverses NMDA receptor-dependent long-term depression in rat hippocampus. J. Neurosci. 27, 2918–2926. doi: 10.1523/JNEUROSCI.0838-06.2007
Newpher, T. M., and Ehlers, M. D. (2009). Spine microdomains for postsynaptic signaling and plasticity. Trends Cell Biol. 19, 218–227. doi: 10.1016/j.tcb.2009.02.004
Nguyen, P. V., and Gelinas, J. N. (2018). Noradrenergic gating of long-lasting synaptic potentiation in the hippocampus: from neurobiology to translational biomedicine. J. Neurogenet. 32, 171–182. doi: 10.1080/01677063.2018.1497630
Nicoll, R. A. (2017). A brief history of long-term potentiation. Neuron 93, 281–290. doi: 10.1016/j.neuron.2016.12.015
O'Dell, T. J., Connor, S. A., Guglietta, R., and Nguyen, P. V. (2015). beta-Adrenergic receptor signaling and modulation of long-term potentiation in the mammalian hippocampus. Learn Mem. 22, 461–471. doi: 10.1101/lm.031088.113
Oh, M. C., Derkach, V. A., Guire, E. S., and Soderling, T. R. (2006). Extrasynaptic membrane trafficking regulated by GluR1 serine 845 phosphorylation primes AMPA receptors for long-term potentiation. J. Biol. Chem. 281, 752–758. doi: 10.1074/jbc.M509677200
Park, P., Georgiou, J., Sanderson, T. M., Ko, K. H., Kang, H., Kim, J. I., et al. (2021). PKA drives an increase in AMPA receptor unitary conductance during LTP in the hippocampus. Nat. Commun. 12:413. doi: 10.1038/s41467-020-20523-3
Pawlak, V., Wickens, J., Kirkwood, A., and Kerr, J. (2010). Timing is not everything: neuromodulation opens the STDP gate. Front. Synaptic Neurosci. 2:146. doi: 10.3389/fnsyn.2010.00146
Purkey, A. M., and Dell'Acqua, M. L. (2020). Phosphorylation-dependent regulation of Ca(2+)-permeable AMPA receptors during hippocampal synaptic plasticity. Front. Synaptic Neurosci. 12:8. doi: 10.3389/fnsyn.2020.00008
Seol, G. H., Ziburkus, J., Huang, S., Song, L., Kim, I. T., Takamiya, K., et al. (2007). Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity. Neuron 55, 919–929. doi: 10.1016/j.neuron.2007.08.013
Shindou, T., Shindou, M., Watanabe, S., and Wickens, J. (2019). A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum. Eur. J. Neurosci. 49, 726–736. doi: 10.1111/ejn.13921
Shouval, H., Bear, M., and Cooper, L. (2002). A unified model of NMDA receptor-dependent bidirectional synaptic plasticity. Proc. Natl. Acad. Sci. U.S.A. 99, 10831–10836. doi: 10.1073/pnas.152343099
Takamatsu, I., Iwase, A., Ozaki, M., Kazama, T., Wada, K., and Sekiguchi, M. (2008). Dexmedetomidine reduces long-term potentiation in mouse hippocampus. Anesthesiology 108, 94–102. doi: 10.1097/01.anes.0000296076.04510.e1
Tenorio, G., Connor, S. A., Guevremont, D., Abraham, W. C., Williams, J., O'Dell, T. J., et al. (2010). ‘Silent' priming of translation-dependent LTP by ss-adrenergic receptors involves phosphorylation and recruitment of AMPA receptors. Learn Mem. 17, 627–638. doi: 10.1101/lm.1974510
Thomas, M. J., Moody, T. D., Makhinson, M., and O'Dell, T. J. (1996). Activity-dependent beta-adrenergic modulation of low frequency stimulation induced LTP in the hippocampal CA1 region. Neuron 17, 475–482. doi: 10.1016/S0896-6273(00)80179-8
Tritsch, N. X., and Sabatini, B. L. (2012). Dopaminergic modulation of synaptic transmission in cortex and striatum. Neuron 76, 33–50. doi: 10.1016/j.neuron.2012.09.023
Wu, D., Bacaj, T., Morishita, W., Goswami, D., Arendt, K. L., Xu, W., et al. (2017). Postsynaptic synaptotagmins mediate AMPA receptor exocytosis during LTP. Nature 544, 316–321. doi: 10.1038/nature21720
Keywords: G-protein coupled receptor, pull-push, long-term potentiation, long-term depression, cortex
Citation: Mihalas S, Ardiles A, He K, Palacios A and Kirkwood A (2021) A Multisubcellular Compartment Model of AMPA Receptor Trafficking for Neuromodulation of Hebbian Synaptic Plasticity. Front. Synaptic Neurosci. 13:703621. doi: 10.3389/fnsyn.2021.703621
Received: 30 April 2021; Accepted: 05 July 2021;
Published: 11 August 2021.
Edited by:
P. Jesper Sjöström, McGill University, CanadaReviewed by:
Mohiuddin Ahmad, University of Oklahoma Health Sciences Center, United StatesJason D. Shepherd, The University of Utah, United States
Copyright © 2021 Mihalas, Ardiles, He, Palacios and Kirkwood. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alfredo Kirkwood, kirkwood@jhu.edu