- 1School of Automation, Central South University, Changsha, China
- 2Institute of Physiology and Psychology, School of Marxism, Changsha University of Science and Technology, Changsha, China
Metabolic energy can be used as a unifying principle to control neuronal activity. However, whether and how metabolic energy alone can determine the outcome of synaptic plasticity remains unclear. This study proposes a computational model of synaptic plasticity that is completely determined by energy. A simple quantitative relationship between synaptic plasticity and postsynaptic potential energy is established. Synaptic weight is directly proportional to the difference between the baseline potential energy and the suprathreshold potential energy and is constrained by the maximum energy supply. Results show that the energy constraint improves the performance of synaptic plasticity and avoids setting the hard boundary of synaptic weights. With the same set of model parameters, our model can reproduce several classical experiments in homo- and heterosynaptic plasticity. The proposed model can explain the interaction mechanism of Hebbian and homeostatic plasticity at the cellular level. Homeostatic synaptic plasticity at different time scales coexists. Homeostatic plasticity operating on a long time scale is caused by heterosynaptic plasticity and, on the same time scale as Hebbian synaptic plasticity, is caused by the constraint of energy supply.
Introduction
Although the brain accounts for only 2% of body mass, it consumes 20% of the resting metabolic energy produced by the whole body (Attwell and Laughlin, 2001; Harris et al., 2012). Within the brain, neurons utilize 75–80% of this energy, and the remainder is used by the neighboring glial cells. Housekeeping tasks use 25% of the total neuronal energy. Maintaining resting membrane potential (15%), firing action potentials (16%), and synaptic transmission (44%) compose the energetically most expensive processes (Harris et al., 2012; Howarth et al., 2012). Thus, the majority of energy used by neurons is locally consumed at the synapse. In addition to the energetic costs of neural computation and transmission, experimental evidence indicates that synaptic plasticity is metabolically demanding (Mery and Kawecki, 2005; Jaumann et al., 2013; Placais and Preat, 2013; Placais et al., 2017). The energy cost of synaptic plasticity is estimated based on the neurophysiological and proteomic data of rat brains depending on the level of protein phosphorylation; this cost constitutes a small fraction of the energy used for fast excitatory synaptic transmission, which is typically 4.0–11.2% (Karbowski, 2019). However, the quantitative relationship between the changes in synaptic weights (potentiation or depression) and energy consumption remains unclear.
Considering the consistency of corresponding experiments, a large number of synaptic plasticity models have been established. These models are mainly biophysical models based on calcium hypothesis (Shouval et al., 2002; Graupner and Brunel, 2012) and phenomenological models based on pre- and post-synaptic spikes or voltage (Bienenstock et al., 1982; Pfister and Gerstner, 2006; Clopath et al., 2010). Although these models are successful in experimental reproduction, they ignore the role of metabolic energy. Growing evidence suggests that metabolic energy may be a unifying principle governing neuronal activities (Laughlin, 2001; Niven and Laughlin, 2008; Hasenstaub et al., 2010; Yu and Yu, 2017), thereby naturally leading people to focus on the relationship between metabolic energy and synaptic plasticity in recent years. Sacramento et al. (2015) showed that unbalanced synaptic plasticity rules can lead to sparse connectivity and energy-efficient computation. Li and van Rossum (2020) assumed that the metabolic energy for every modification of a synaptic weight is proportional to the amount of change, regardless of whether this is positive or negative. They proposed a synaptic caching algorithm based on this assumption. The proposed algorithm can enhance energy efficiency manifold by precisely balancing labile forms of synaptic plasticity with many stable forms. However, energy is expressed by synaptic weights in these studies. Whether synaptic plasticity can be fully quantified by energy remains unclear.
Potential energy is stored in transmembrane ion gradients. When postsynaptic neurons are stimulated by external stimuli (such as synaptic input), the changes in gating state, channel conductance, and current are driven by the energy stored in the Na+ and K+ gradients, and no adenosine triphosphate (ATP) is consumed in this process. These gradients and stored potential energy are partially depleted and must be actively restored. The change in postsynaptic potential energy indirectly reflects the consumption or supply of metabolic energy because the active recovery of potential energy needs ATP. In this study, we express the postsynaptic potential energy as the integral of the product of postsynaptic membrane potential and the postsynaptic membrane current density on stimulation time. The potential energy with membrane potential lower than a certain threshold is called subthreshold potential energy. The part with membrane potential greater than the threshold is called suprathreshold potential energy. The baseline potential energy is the result of downscaling the amplitude of the subthreshold potential energy. The synaptic weights are expressed by a simple linear relationship between the subthreshold potential energy and the suprathreshold potential energy and are constrained by the energy supply. The simulation results show that the model can reproduce a series of classic synaptic plasticity experiments, which indicate that our model is feasible.
Results
Construction of Synaptic Plasticity Model
Our model uses postsynaptic potential energy to express the change in synaptic weights. Postsynaptic potential energy P is the integral of the product of postsynaptic membrane potential Vm and postsynaptic membrane current density Im to stimulation time t, that is, P = ∫ Vm Im dt. To explain more clearly how the model works, we divide the operation process of the model into four stages at each time step (Figure 1A). In stage (1), if no stimulation occurs, the postsynaptic neuron is in a resting state. At this time, postsynaptic potential energy P is the resting state potential energy Prest. Taking the resting state potential energy as the reference point of potential energy, let P = Prest = 0. In stage (2), stimulation causes potential energy P to deviate from the resting state potential energy. Potential energy P after stimulation is separated into two parts. The first part is called subthreshold potential energy Psub, and its membrane potential Vm is less than the threshold potential Vth. The second part is called suprathreshold potential energy Psup, and its membrane potential Vm is greater than Vth. Thus, P = Psub + Psup. In stage (3), the subthreshold potential energy is multiplied by a constant Ar between zero and one, which is called the baseline coefficient, and the baseline potential energy Pbas is obtained. Thus, Pbas = Ar Psub. In stage (4), we assume that the change in synaptic weights is proportional to the difference between the baseline potential energy and the suprathreshold potential energy and then test the rationality of this hypothesis by comparing it with a series of synaptic plasticity experimental results. Therefore, the change in synaptic weight ΔW is expressed as follows:
Figure 1. Model schematic. The height of the bars represents the amplitude of different potential energy (P, Psub, Psup, etc.). P is the change value relative to Prest. Because we assume that Prest is 0, we call P the potential energy. (A) Mathematical expression of synaptic plasticity Model; (B) calculation of synaptic weights when the baseline potential energy is greater than the suprathreshold potential energy. In the resting state, the potential energy of the postsynaptic membrane is assumed to be zero. The potential energy P of the postsynaptic membrane is lower than that of the resting state. Thus, P < Prest is negative. Subthreshold potential energy Psub and suprathreshold potential energy Psup are negative. Baseline coefficient Ar is greater than zero, so baseline potential energy Pbas has the same sign as subthreshold potential energy Psub and is also negative. Here, Pbas > Psup, and the synaptic weight increases; (C) calculation of synaptic weights when Pbas < Psup. Similar to that in (B), the synaptic weight decreases at this time because Pbas < Psup; (D) calculation of synaptic weight when the amplitude of potential energy P exceeds energy supply S at every time step. The amplitude of P is adjusted to the maximum potential energy Pmax, which is the same as S. Assuming that the membrane potential is greater than the threshold potential, the amplitude of Psup is reduced. The amplitude of Psub is reduced if the membrane potential is less than the threshold potential. Thus, Psub + Psup = P = Pmax.
where A is a positive constant, which represents the linear transformation between potential energy and synaptic weight and is called the amplitude coefficient (equivalent to the learning rate). The synaptic weights increase when the baseline potential energy is greater than the suprathreshold potential energy (Figure 1B). The synaptic weights decrease when the baseline potential energy is less than the suprathreshold potential energy (Figure 1C). The synaptic weights do not change when they are the same.
We assume that the amplitude of postsynaptic potential energy P cannot be greater than the maximum energy supply S because the change in potential energy is constrained by energy supply. Unless otherwise specified, the energy supply in this study represents the maximum energy supply that can be provided. We call the maximum potential energy Pmax where its amplitude is the same as energy supply S, but the sign is consistent with potential energy P. Then, Pmax = S sign (P), where sign is the sign function, and |P| ≤ S and |P| ≤ |Pmax|. Given that the dynamic characteristics of energy supply are unclear, we propose a simple formula for calculating the energy supply with time
where t is the time of stimulation, and τ is the time constant of energy supply which is usually much larger than the membrane time constant (Attwell and Laughlin, 2001). R is equivalent to the total energy supply of synapses per unit time, which is a constant and is called the rate of energy supply. S0 is the minimum energy supply to maintain the normal function of neurons, which is a constant greater than zero and equivalent to the energy supply in the resting state. The formula represents the maximum energy that can be provided at time t by multiplying Rt of the energy supply linearly increasing with time and a damping factor Sdamp = e−t/τ, which decreases exponentially with time. S = S0 at t = 0 or t → ∞, the energy supply is minimum, and the energy supply is maximum at t = τ.
Some researches showed that the relationship between Na/K pump current and intracellular sodium ion concentration and ATP concentration can be expressed by the Hill equation (Figure 4 in Despa and Bers, 2003; Figures 2, 10 in Glitsch, 2001). Therefore, many scholars take the intracellular sodium ion concentration as the measurement of energy consumption (Hasenstaub et al., 2010). The concentration of sodium ions in stimulated neurons increases from the concentration in the resting state to a peak (at the end of stimulation) and then returns to the concentration in the resting state due to the action of the ion pump. The changes in postsynaptic membrane potential and ionic current caused by spikes in neurons also have the characteristics of first rising and then returning to the original position with time, which is usually described in the exponential form of t e−t/τ (Gerstner, 1995; Bohte et al., 2002). Given this, we also use this exponential form to describe the kinetics of intracellular sodium ions as an expression of energy consumption or energy supply. A similar exponential expression has also been successfully applied in the constraints of metabolic energy on the synaptic connection (Yuan et al., 2018).
Potential energy P is adjusted to Pmax if its amplitude exceeds energy supply S (Figure 1D) so that its amplitude is equal to energy supply S. This adjustment results in a decrease in the amplitude of suprathreshold potential energy Psup or subthreshold potential energy Psub so that their sum is equal to Pmax. The subthreshold potential energy is adjusted, and the suprathreshold potential energy remains unchanged when the membrane potential at time t is smaller than the threshold potential. The suprathreshold potential energy is adjusted, and the subthreshold potential energy remains unchanged when the membrane potential at time t is greater than the threshold potential. The adjustment of subthreshold potential energy causes the amplitude of baseline potential energy Pbas to change in the same proportion (as shown in the next section). The specific implementations of Equations (1) and (2) and Figure 1 are shown in the section Methods.
Determination of Model Parameters
In accordance with Equations (1) and (2), the model includes six parameters, namely, amplitude coefficient A, baseline coefficient Ar, threshold potential Vth, energy supply rate R, minimum energy supply S0, and time constant of energy supply τ. For the frequency-dependent pairing protocol used by Sjöström et al. (2001), we chose the final parameter by trial and error. We simulated and tested 27 sets of parameters R = 100, 150,200, τ = 1, 2, 3 and S0= 10, 20, and 30, respectively. By comparing the simulation results with the results of synaptic plasticity experiment, the parameter set which is most consistent with the experimental results was selected: A = 0.02, Ar = 0.2, Vth = −60 mV, R = 175 fJ/(μm2 s), τ = 2 s, S0 = 25 fJ/μm2. In the next section, we introduce several classical experimental protocols of synaptic plasticity and illustrate how our model reproduces these different experimental results with the same set of parameters through potential energy and energy supply.
Reproduction of the Experimental Results of Homosynaptic Plasticity
Nineteen distal and proximal compartments (magenta, Figure 2A) were simulated in the basal dendrites of the L5 pyramidal neuron model. We followed two different experimental protocols on homosynaptic plasticity to compare our model with the experimental data. The first protocol was the classical spike-timing-dependent plasticity (Markram et al., 1997; Bi and Poo, 1998; Sjöström et al., 2001). Each distal and proximal compartments were connected to one synapse. Postsynaptic spikes were induced by the injection of 1 nA and 3 ms current pulses into the soma of postsynaptic neurons. The initial synaptic weights were set to 0.5. For the study of spike frequency dependence, pairs of pre–post (Figure 2B) or post–pre (Figure 2C) spikes separated by 10 ms were repeated five times at different frequencies of 5 Hz up to 50 Hz with steps of 5 Hz and for 0.1 Hz. For the study of spike timing dependence (Figure 3A), pairs of pre–post or post–pre spikes at 20 Hz were repeated five times for different time intervals Δt (1, 2.5, 5, 7.5, 10, 12.5, 15, 17.5, and 20 ms). The computational results (weights and potential energy) repeated five times were multiplied by a scaling factor of 12 (60/5) to mimic 60 pairs of presynaptic and postsynaptic spikes in the experimental protocols of Sjöström et al. (2001). The study of Sjöström et al. (2001) focused on the weight change as a function of the frequency for a fixed Δt in this pairing protocol. The second protocol was synaptic afferent where only presynaptic spikes were induced (Bliss and Lømo, 1973; Dudek and Bear, 1992). To test our model on a consistent set of data, we took the measurements of Dudek and Bear (1992) in this study because sufficient quantitative information can be found in their study. Each distal and proximal compartments were connected to one synapse. The activation of the synapse connected to each compartment consisted of 20 pulses delivered by a Poisson process at input frequencies ranging from 1 to 50 Hz (1, 3, 5, 10, 20, 30, 40, and 50 Hz) (Figure 3B).
Figure 2. Reproducing the pairing experiment of spike frequency dependence. (A) Action potentials in the soma are paired with either proximal or distal (magenta) synaptic activations on a thin basal branch of the L5 pyramidal neuron. (B,C) Potential energy (top), the potential energy of baseline and suprathreshold (middle), and weight (bottom) change as a function of pairing repetition frequency using pairings with a time delay Δt of +10 ms (pre–post, B) and −10 ms (post–pre, C). Dots with errors (bottom) represent the experimental data from Sjöström et al. (2001). The lines (solid and dashed) and the shaded regions are the mean and standard deviation (SD), respectively, and overall proximal and distal compartments (magenta) shown in (A). The black and blue lines (solid and dashed) represent the computational results with and without energy supply constraints, respectively. For clarity, the SDs of the potential energy with constraints (black lines, top), baseline and suprathreshold energy (middle), and weights without constraints (blue lines, bottom) are not shown.
Figure 3. Reproducing the time-dependent pairing and synaptic afferent experiments. The lines (solid and dashed) and the shaded regions are the mean and SD, respectively, and overall proximal and distal compartments (magenta) shown in Figure 2A. The black and blue lines (solid and dashed) represent the computational results with and without energy supply constraints, respectively; (A) potential energy (top), the potential energy of baseline and suprathreshold (middle), and weight (bottom) change for different time intervals Δt between pre- and postsynaptic firing using 60 pre–post pairs at 20 Hz. Dots with errors (bottom) represent the experimental data from Sjöström et al. (2001); (B) potential energy (top), the potential energy of baseline and suprathreshold (middle), and weight (bottom) change for the synaptic afferent protocol. Dots with errors (bottom) represent the experimental data from Dudek and Bear (1992).
For the frequency-dependent pairing protocol without energy supply constraints, the amplitude of postsynaptic potential energy decreased with the increase in spike frequency (blue solid lines; top; Figures 2B,C); this finding is consistent with the calculation results of the relationship between metabolic energy and frequency in neurons (Yi et al., 2016). With the decrease in spike frequency, the time of stimulation increased gradually. Increasing cases were found, where the amplitude of postsynaptic potential energy without energy constraint (named as unconstrained energy) exceeded that of the maximum potential energy Pmax (blue shaded area under the red dotted line; top; Figures 2B,C). The unconstrained energy with amplitude greater than that of Pmax was adjusted to the same as Pmax to obtain the postsynaptic potential energy with energy supply constraints (named as constrained energy) (black solid lines; top; Figures 2B,C). The amplitudes of unconstrained energy in all postsynaptic compartments were greater than the amplitudes of Pmaxwhen the frequency was <10 Hz. At this time, the amplitudes adjusted were the largest, resulting in the overlap between the constrained energy and Pmax. The adjustment of potential energy reduced the amplitude of baseline potential energy Pbas and suprathreshold potential energy Psup (from blue dashed and solid lines to the black dashed and solid lines, respectively; middle; Figures 2B,C), especially when the frequency was 0.1 Hz. The weights without energy constraints (blue solid lines; bottom; Figures 2B,C) were adjusted to a biologically reasonable range due to the limitation of energy supply. The adjusted synaptic weights were in good agreement with the experimental data (black solid lines; bottom; Figures 2B,C).
For the time-dependent pairing protocol (Figure 3A), the stimulation time of different pairing time intervals is the same because the spike frequency was fixed at 20 Hz. Thus, the maximum potential energy does not change with the time interval (red dashed lines; top; Figure 3A). Similar to the analysis in the previous section, the unconstrained energy with amplitude greater than Pmax was adjusted the same as Pmax. The amplitude of constrained energy (black solid lines; top; Figure 3A) was smaller than that of the unconstrained energy (blue solid lines; top; Figure 3A). These adjustments led to the corresponding changes in the baseline potential energy and suprathreshold potential energy (middle; Figure 3A) and made the synaptic plasticity constrained by energy supply more consistent with the experimental results than that without energy supply constraint (bottom; Figure 3A).
In the synaptic afferent protocol (Figure 3B), increasing cases were found, where the amplitude of postsynaptic potential energy without energy constraint exceeded that of Pmax, when the input frequency was <5 Hz. The adjustment of this unconstrained energy to the maximum potential energy led to the gradual approaching and overlapping of the constrained energy and the maximum potential energy (top; Figure 3B). If the amplitude of unconstrained energy is less than that of maximum potential energy, the constrained and unconstrained variables (i.e., potential energy, baseline and suprathreshold potential energy, and weights) should overlap because it is unnecessary to adjust the potential energy. However, the constrained and unconstrained variables did not overlap when the frequency was >5 Hz although the amplitude of unconstrained energy (blue solid lines; top; Figure 3B) was less than that of the maximum potential energy (red dashed lines; top; Figure 3B). This phenomenon was because all the calculation results in this study were the values at the end of stimulation. However, the adjustment of potential energy was conducted at every moment from the beginning to the end of stimulation (section Methods). These results indicated that before the end of stimulation, the unconstrained energy was adjusted several times because the amplitude exceeded that of the maximum potential energy. During the stimulation, the main adjustment was reflected in the suprathreshold potential energy if the input frequency was >5 Hz. However, the baseline potential energy was mainly adjusted if the input frequency was <5 Hz (middle, Figure 3B). The computational results showed that our model can quantitatively reproduce the results of the synaptic afferent experiment (bottom, Figure 3B).
Reproduction of Mexican Cap-Like Heterosynaptic Long-Term Depression
Heterosynaptic plasticity can be induced at synapses that are inactive during the induction of homosynaptic plasticity (Chistiakova et al., 2015; Zenke et al., 2017). High-frequency afferent tetanization induces a Mexican hat-like profile of response amplitude changes: Homosynaptic long-term potentiation (LTP) at stimulated inputs is surrounded by heterosynaptic long-term depression (LTD) (White et al., 1990; Royer and Paré, 2003). Each compartment on the thin basal branch of the L5 pyramidal neuron model is connected to two synapses. The initial synaptic weights were set to 0.5. To reproduce the heterosynaptic LTD, we used a similar protocol to that of Royer and Paré (2003). Homosynaptic LTP was induced with high-frequency stimuli (HFS) at the synapses connected to each distal or proximal compartment. HFS consisted of four series of 10 trains separated by 0.3 s, where each train consisted of 10 shocks (Poisson process) at 100 Hz. Each basal dendrite was divided into seven sites to compare with the experimental results. Site 0 was a compartment corresponding to homosynaptic LTP (magenta dots; Figure 4). Other compartments connected by heterosynapses were divided into six sites in accordance with the distance from site 0 (cyan dots; Figure 4). The value in each site (such as potential energy, weight, etc.) was the average for the values of all compartments in the site.
Figure 4. Reproducing a Mexican hat-like heterosynaptic LTD. The black and blue lines (solid and dashed) represent the computational results with and without energy supply constraints, respectively; (A,B) schematic (A) of homosynaptic (magenta) and heterosynaptic (cyan) connected sites on the branch and the corresponding computational results (B) when stimulating the proximal synapses of a dendrite branch; (C,D) same as (A,B), but for distal stimulation; (E,F) all stimulated sites (E) and the corresponding computational results (F). The lines (solid and dashed) and the shaded regions are the mean and SD, respectively, and overall proximal and distal compartments (magenta) shown in (E). Dot line with errors (bottom, F) represents the experimental data from Royer and Paré (2003). For clarity, the SDs of the potential energy with constraints (black lines, top), baseline and suprathreshold energy (middle), and weights without constraints (blue lines, bottom) are not shown.
Homosynaptic LTP was induced in the synapses at the stimulation site, and heterosynaptic LTD (bottom, Figures 4B,D) occurred in the non-activated synapses of the same branch when HFS was performed at the proximal (Figure 4A) or distal (Figure 4C) in a thin branch. The statistical results for proximal and distal stimulation in all basal branches (Figure 4E) showed that the heterosynaptic LTD decreased with the increase in distance from the stimulus site whereas homosynaptic LTP was induced. This Mexican hat-like heterosynaptic plasticity was in good agreement with the experimental results (bottom, Figure 4F). For heterosynaptic sites (sites 1–6), the amplitudes of unconstrained energy were always lower than that of the maximum potential energy. Therefore, the maximum potential energy did not have a constraining effect, which results in the overlap of constrained and unconstrained potential energy (top; Figures 4B,D,F). The homosynaptic LTP increases unlimitedly if it was not constrained by energy. This condition was because the unconstrained energy with amplitude greater than the maximum potential energy was not adjusted, and the difference between the baseline and suprathreshold potential energy was extremely large (middle; Figures 4B,D,F). The energy constraint made the postsynaptic potential energy equal to the maximum potential energy, thereby reducing the difference between the baseline and suprathreshold potential energy and controlling the homosynaptic LTP in a biologically reasonable range (bottom; Figures 4B,D,F). Although the sites of hetero LTD were more than that of homosynaptic LTP, the amplitude of homosynaptic LTP was larger than that of heterosynaptic LTD by comparing homosynaptic LTP and heterosynaptic LTD. As shown in the top panel of Figures 4B,D,F, the difference in the maximum potential energy was due to the different signs of the corresponding potential energy, and their energy supply was the same.
Discussion
We presented a computational model of synaptic plasticity completely determined by energy and established a simple quantitative relationship between synaptic plasticity and postsynaptic potential energy. The synaptic weight is directly proportional to the difference between the baseline and suprathreshold potential energy and is constrained by the maximum energy supply. Considering that the dynamic characteristics of energy supply are unclear, we proposed a simple dynamic equation of energy supply and provided the upper limit of the amplitude of postsynaptic potential energy. The constraint of energy supply improves the performance of synaptic plasticity and avoids setting the hard boundary of synaptic weights. In the classical frequency-dependent pairing protocol, six parameters of the model were determined by trial and error. With such a set of parameters, our model reproduced several experimental results of homosynaptic plasticity and the Mexican hat-like heterosynaptic LTD, showing that our model can unify the homo- and heterosynaptic plasticity.
Quantitative Relationship Between Synaptic Plasticity and Metabolic Energy
The absolute value of potential energy can be regarded as the metabolic energy consumed because it restores postsynaptic potential energy to the resting state. Our model assumes that the synaptic weight is proportional to the difference between the baseline and suprathreshold potential energy and is constrained by the maximum energy supply. The model can reproduce a series of experimental results of homo- and heterosynaptic plasticity, which shows that our hypothesis is feasible. Can metabolic energy replace potential energy to express this linear relationship? If the potential energy, baseline, and suprathreshold potential energy are all negative, the absolute value of the baseline potential energy is called the baseline metabolic energy. The absolute value of the suprathreshold potential energy is called the suprathreshold metabolic energy. If the baseline or suprathreshold potential energy is a constant that does not change with time, then Li and van Rossum's (2020) hypothesis that metabolic energy is directly proportional to the change in synaptic weight is correct. The linear relationship between synaptic weights and metabolic energy is only valid in some cases.
Interaction Mechanism Between Hebbian and Homeostatic Synaptic Plasticity
At present, the biological significance of Hebbian synaptic plasticity (positive feedback) and homeostatic synaptic plasticity (negative feedback) remains controversial. Specifically, how these opposing forms of plasticity that share common downstream mechanisms work in the same networks, neurons, and synapses remain unclear (Turrigiano et al., 1998; Feldman, 2002; Turrigiano and Nelson, 2004; Swanwick et al., 2006; Rannals and Kapur, 2011). In recent years, these conditions have been discussed extensively by leading experts in the field (Vitureira and Goda, 2013; Fox and Stryker, 2017; Keck et al., 2017; Yee et al., 2017). One view is that homeostatic plasticity operates on a long time scale and does not interfere with synaptic changes induced by Hebbian plasticity (Turrigiano, 2012; Tononi and Cirelli, 2014; Hengen et al., 2016). Another view is that Hebbian and homeostatic synaptic mechanisms may be parallel; thus, they can interfere with each other in the same synaptic subset (Desai et al., 2002; Kim and Tsien, 2008; Keck et al., 2011; Vlachos et al., 2013; Frank, 2014; Li et al., 2014). Based on observing the existence of fast and input-specific homeostatic mechanisms, a signal pathway-based model was proposed to adjust the balance between Hebbian and homeostatic synaptic plasticity. The model was used to explain the interaction mechanism between Hebbian and homeostatic plasticity on the same time scale (Galanis and Vlachos, 2020).
Our model can integrate the two different viewpoints and give a unified explanation. The homeostatic synaptic plasticity at different time scales coexists. First, we believe that the homeostatic plasticity operating on a long time scale is caused by heterosynaptic plasticity. Our simulation showed that the amplitude of heterosynaptic LTD is extremely small, especially under high-frequency tetanic stimulation (bottom; Figures 4B,D,F). This condition indicates that the changes in heterosynaptic plasticity caused by normal neural activities are extremely small or difficult to confirm under the Hebbian time scale. Experiencing a longer stimulation than the Hebbian time scale is necessary before these changes can be evident. This heterosynaptic plasticity accumulated over a long period becomes homeostatic plasticity on a long time scale. Second, homeostatic synaptic plasticity on the same time scale as Hebbian synaptic plasticity is caused by the constraint of energy supply. The synaptic strength does not increase continuously under high-frequency stimulation nor does it decrease unlimitedly under low-frequency stimulation due to the constrained energy (bottom; Figures 2, 3B). On the contrary, the amplitude of synaptic enhancement or inhibition is reduced to match the energy supply because the energy supply gradually decreases after the time of stimulation is greater than its time constant (Equation 2). The final result is a homeostatic synaptic plasticity parallel to the Hebbian time scale. We propose a unified mechanism for the interaction between Hebbian and homeostatic synaptic plasticity based on the above analysis. The homeostatic homo- and heterosynaptic plasticity coexist with homo- and heterosynaptic plasticity. The time scale of homeostatic homosynaptic plasticity is the same as that of homosynaptic plasticity (i.e., Hebbian synaptic plasticity), which is rapid and input-specific and is caused by the limitation of energy supply. The homeostatic heterosynaptic plasticity has a long time scale, which is caused by the long-term accumulation of heterosynaptic plasticity. Although we do not fully understand the molecular mechanism of heterosynaptic plasticity and energy supply and the actual energy supply dynamics, we believe that the analysis of this mechanism from the cellular level is still valuable.
Limitations of Our Approach
First, our synaptic plasticity model can reproduce a series of classical synaptic plasticity experiments using a detailed biophysical model of a single pyramidal neuron. Although the feasibility of the model can be confirmed, further examining the consistency between the model and the experimental results under many stimulation protocols is necessary. Second, in our model parameters, the threshold potential Vm of −60 mV corresponds to the leakage potential EL (section Methods) in the biophysical model of neurons. The baseline coefficient Ar of 0.2 indicates that the baseline potential energy is one-fifth of the subthreshold potential energy. Whether the two parameters are universal for different neuron models and their biophysical significance remains unclear. Third, the proposed dynamic equation of energy supply (Equation 2) is not supported by experimental data. Can the equation be used as a theoretical prediction to guide future experiments? Can different dynamic equations supported by experiments achieve the same effect of energy constraint in our model? These questions are worthy of further exploration. Finally, the interaction between Hebbian and homeostatic plasticity for large-scale neural networks has an important influence on the learning and memory ability of neural networks. We did not study the validity and scalability of the model in the neural network environment, especially in large-scale neural networks, which is an important direction of our future work.
Methods
Model of Neuron and Synapse
All simulations in this study were conducted on Brian 2 neuron simulator in Python (Goodman and Brette, 2009). We used the model and parameters of the biophysical neurons and synapses developed by Bono and Clopath (2017) on Brian 2. The implementation of the pyramidal neuron and synaptic model completely adopted the codes posted by Bono and Clapath on ModelDB (https://senselab.med.yale.edu/modeldb/). Given that L5 and L2/3 pyramidal neuron models are found to have similar results, we only conducted simulation studies on synaptic plasticity in L5 pyramidal neurons (Bono and Clopath, 2017). L5 pyramidal neurons are composed of a spherical soma, an axon, and many dendrite branches, with a total of 1,181 compartments. The leakage potential EL and resting potential of each compartment are −60 and −69 mV, respectively. Following codes of the neuron and synaptic model of Bono and Clopath (https://senselab.med.yale.edu/modeldb/), we can obtain the membrane potential Vm and membrane current density Im of each compartment under any stimulation protocol. The unit of membrane potential is mV, and the unit of membrane current density is ampere/meter2, abbreviated as A/m2. We chose the unit of membrane current density as pA/μm2 equivalent to A/m2 because the geometric size of neurons in Brian 2 is usually expressed in μm.
Synaptic Plasticity
The variables in Brian 2 simulator are usually expressed and calculated in the form of differential equations. Thus, our synaptic plasticity model needs to be realized in the form of differential equations.
The energy supply (Equation 2) is calculated using two differential equations. The differential equation of exponential decay factor Sdamp = e−t/τ is expressed as dSdamp/dt = –Sdamp/τ with an initial value of one. The part of energy supply that increases linearly with time, Slin = R t, is expressed as dSlin/dt = R, and the initial value is zero. Therefore, the energy supply of t is S = Sdamp Slin + S0.
Postsynaptic potential energy P is expressed as the integration of postsynaptic unit membrane power to time and is constrained by energy supply. The differential expression is as follows:
where sign (·) is a symbolic function. The value of the function is −1 when the parameter is negative and is 1 when the parameter is positive. The value of this function is 0 when it is equal to 0. The unit of P is fJ/μm2, that is, 10−15 J/μm2, and the initial value is 0. The unit of S and S0 is the same as that of P, and the unit of R is fJ/(μm2 s).
Following the definition and considering the limitation of energy supply, the differential forms of baseline potential energy and suprathreshold potential energy are expressed in Vm and Im as follows:
where Θ(·) is the Heaviside step function. The function value is zero when the parameter is negative; otherwise, it is one. The initial values of baseline potential energy Pbasand suprathreshold potential energy Psup are zero.
After substituting Equations (4) and (5) into Equation (1), the differential form of synaptic weights can be expressed completely as follows:
where Φ(Vm – Vth) denotes that if Vm < Vth, then Φ(Vm – Vth) = Ar, otherwise Φ(Vm – Vth) = −1.
The pseudocodes of our synaptic plasticity model is described in Python as follows:
######################################################
###### Codes of parameter setting and variable initialization for synaptic plasticity model
if “data from Sjöström”: # in fig2b and fig3a
Ascale = 60/5
else:
Ascale = 1
A = 0.02 # amplitude coefficient
Ar = 0.2 # baseline coefficient
Vth = −60 *mV # threshold potential
R = 175 # dimensionless-energy-supply rate
τ = 2 *second # time constant of energy supply
S0 = 25 # dimensionless-minimum-energy supply
W = 0.5 # initial weights of all synapses with energy supply constraints
Sdamp = 1 # initial Sdamp of all synapses
Slin = 0 # initial Slin of all synapses
P = 0, Pbas = 0, Psup = 0 # initial P, Pbas, and Psup of all synapses with energy supply constraints
W' = 0.5 # initial weights of all synapses without energy supply constraints
P' = 0, P'bas = 0, P'sup = 0 # initial P, Pbas, and Psup of all synapses without energy supply constraints
###### The main codes of our model
dSdamp/dt = - Sdamp/τ # differential form of equation Sdamp = e−t/τ
dSlin/dt = R/second # differential form of equation Slin = R t
dP/dt = sign(Slin+S0-abs(P))* Vm *Im1 /mV /second
# codes of Equation 3, dP/dt = Vm Imsign(S – |P|), Im1 is dimensionless Im
dW/dt = sign(Slin+S0-abs(P))*A*((Vm < Vth) - (Vm≥Vth)) *Im1 /mV /mV /second
# codes of Equation 6, dW/dt = A Vm Im Φ(Vm – Vth) sign(S – |P|)
dPbas/dt = sign(Slin+S0-abs(P))* (Vm < Vth)* Im1 /mV /mV /second
# codes of Equation 4, dPbas /dt = Ar Vm Im Θ(Vth – Vm) sign(S – |P|)
dPsup/dt = sign(Slin+S0-abs(P))* (Vm≥Vth)* Im1 /mV /mV /second
# codes of Equation 5, dPsup /dt = Vm Im Θ(Vm – Vth) sign(S – |P|)
dP′/dt = Im1 /mV /second
# codes of Equation 3 without energy supply constraints, dP/dt = Vm Im
dW′/dt = A*((Vm < Vth) - (Vm≥Vth)) *Im1 /mV /mV /second
# codes of Equation 6 without energy supply constraints, dW′/dt = A Vm Im Φ(Vm – Vth)
d/dt = (Vm < Vth)* Im1 /mV /mV /second
# codes of Equation 4 without energy supply constraints, d /dt = Ar Vm Im Θ(Vth – Vm)
d/dt = (Vm≥Vth)* Im1 /mV /mV /second
# codes of Equation 4 without energy supply constraints, dP'sup /dt = Vm Im Θ(Vm – Vth)
######################################################
Data Availability Statement
Publicly available datasets were analyzed in this study. This data can be found at: https://github.com/HWChenCSU/energy-determinant-plasticity.
Author Contributions
HC designed the study, designed and implemented the models, and wrote the manuscript. LX analyzed the model and participated in discussions. YW and HZ discussed the results and commented on the manuscript. All authors contributed to the article and approved the submitted version.
Funding
HC was supported by the Natural Science Foundation of Hunan Province (Grant Number 2021JJ30863).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Attwell, D., and Laughlin, S. B. (2001). An energy budget for signaling in the grey matter of the brain. J. Cerebral Blood Flow Metab. 21, 1133–1145. doi: 10.1097/00004647-200110000-00001
Bi, G., and Poo, M. (1998). Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J. Neurosci. 18, 10464–10472. doi: 10.1523/JNEUROSCI.18-24-10464.1998
Bienenstock, E. L., Cooper, L. N., and Munro, P. W. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2, 32–48. doi: 10.1523/JNEUROSCI.02-01-00032.1982
Bliss, T. V. P., and Lømo, T. (1973). Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. J. Physiol. 232, 331–356. doi: 10.1113/jphysiol.1973.sp010273
Bohte, S. M., Kok, J. N., and La Poutre, H. (2002). Error-backpropagation in temporally encoded networks of spiking neurons. Neurocomputing 48, 17–37. doi: 10.1016/S0925-2312(01)00658-0
Bono, J., and Clopath, C. (2017). Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level. Nat. Commun. 8, 706. doi: 10.1038/s41467-017-00740-z
Chistiakova, M., Bannon, N. M., Chen, J. Y., Bazhenov, M., and Volgushev, M. (2015). Homeostatic role of heterosynaptic plasticity: models and experiments. Front. Comput. Neurosci. 9, 89. doi: 10.3389/fncom.2015.00089
Clopath, C., Büsing, L., Vasilaki, E., and Gerstner, W. (2010). Connectivity reflects coding: a model of voltage-based STDP with homeostasis. Nat. Neurosci. 13, 344–352. doi: 10.1038/nn.2479
Desai, N. S., Cudmore, R. H., Nelson, S. B., and Turrigiano, G. G. (2002). Critical periods for experience-dependent synaptic scaling in visual cortex. Nat. Neurosci. 5, 783–789. doi: 10.1038/nn878
Despa, S., and Bers, D. M. (2003). Na/K pump current and [Na]i in rabbit ventricular myocytes: local [Na]i depletion and Na buffering. Biophys. J. 84, 4157–4166. doi: 10.1016/S0006-3495(03)75140-6
Dudek, S. M., and Bear, M. F. (1992). Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade. Proc. Natl. Acad. Sci. U.S.A. 89, 4363–4367. doi: 10.1073/pnas.89.10.4363
Feldman, D. E. (2002). Synapses, scaling and homeostasis in vivo. Nat. Neurosci. 5, 712–714. doi: 10.1038/nn0802-712
Fox, K., and Stryker, M. (2017). Integrating Hebbian and homeostatic plasticity: introduction. Philos. Trans. R. Soc. B Biol. Sci. 372, 20160413. doi: 10.1098/rstb.2016.0413
Frank, C. A. (2014). Homeostatic plasticity at the Drosophila neuromuscular junction. Neuropharmacology 78, 63–74. doi: 10.1016/j.neuropharm.2013.06.015
Galanis, C., and Vlachos, A. (2020). Hebbian and homeostatic synaptic plasticity-Do alterations of one reflect enhancement of the other? Front. Cell. Neurosci. 14, 50. doi: 10.3389/fncel.2020.00050
Gerstner, W. (1995). Time structure of the activity in neural network models. Phys. Rev. 51, 738. doi: 10.1103/PhysRevE.51.738
Glitsch, H. G. (2001). Electrophysiology of the sodium-potassium-ATPase in cardiac cells. Physiol. Rev. 81, 1791–1826. doi: 10.1152/physrev.2001.81.4.1791
Goodman, D., and Brette, R. (2009). The Brian simulator. Front. Neurosci. 3, 192–197. doi: 10.3389/neuro.01.026.2009
Graupner, M., and Brunel, N. (2012). Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location. Proc. Natl. Acad. Sci. U.S.A. 109, 3991–3996. doi: 10.1073/pnas.1109359109
Harris, J. J., Jolivet, R., and Attwell, D. (2012). Synaptic energy use and supply. Neuron 75, 762–777. doi: 10.1016/j.neuron.2012.08.019
Hasenstaub, A., Otte, S., Callaway, E., and Sejnowski, T. J. (2010). Metabolic cost as a unifying principle governing neuronal biophysics. Proc. Natl. Acad. Sci. U.S.A. 107, 12329–12334. doi: 10.1073/pnas.0914886107
Hengen, K. B., Torrado Pacheco, A., Mcgregor, J. N., Van Hooser, S. D., and Turrigiano, G. G. (2016). Neuronal firing rate homeostasis is inhibited by sleep and promoted by wake. Cell 165, 180–191. doi: 10.1016/j.cell.2016.01.046
Howarth, C., Gleeson, P., and Attwell, D. (2012). Updated energy budgets for neural computation in the neocortex and cerebellum. J. Cerebral Blood Flow Metab. 32, 1222–1232. doi: 10.1038/jcbfm.2012.35
Jaumann, S., Scudelari, R., and Naug, D. (2013). Energetic cost of learning and memory can cause cognitive impairment in honeybees. Biol. Lett. 9, 20130149. doi: 10.1098/rsbl.2013.0149
Karbowski, J. (2019). Metabolic constraints on synaptic learning and memory. J. Neurophysiol. 122, 1473–1490. doi: 10.1152/jn.00092.2019
Keck, T., Scheuss, V., Jacobsen, R. I., Wierenga, C. J., Eysel, U. T., Bonhoeffer, T., et al. (2011). Loss of sensory input causes rapid structural changes of inhibitory neurons in adult mouse visual cortex. Neuron 71, 869–882. doi: 10.1016/j.neuron.2011.06.034
Keck, T., Toyoizumi, T., Chen, L., Doiron, B., Feldman, D. E., Fox, K., et al. (2017). Integrating Hebbian and homeostatic plasticity: the current state of the field and future research directions. Philos. Trans. R. Soc. B Biol. Sci. 372, 20160158. doi: 10.1098/rstb.2016.0158
Kim, J., and Tsien, R. W. (2008). Synapse-specific adaptations to inactivity in hippocampal circuits achieve homeostatic gain control while dampening network reverberation. Neuron 58, 925–937. doi: 10.1016/j.neuron.2008.05.009
Laughlin, S. B. (2001). Energy as a constraint on the coding and processing of sensory information. Curr. Opin. Neurobiol. 11, 475–480. doi: 10.1016/S0959-4388(00)00237-3
Li, H. L., and van Rossum, M. C. W. (2020). Energy efficient synaptic plasticity. Elife 9, e50804. doi: 10.7554/eLife.50804
Li, L., Gainey, M. A., Goldbeck, J. E., and Feldman, D. E. (2014). Rapid homeostasis by disinhibition during whisker map plasticity. Proc. Natl. Acad. Sci. U.S.A. 111, 1616–1621. doi: 10.1073/pnas.1312455111
Markram, H., Lübke, J., Frotscher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic AP and EPSP. Science 275, 213–215. doi: 10.1126/science.275.5297.213
Mery, F., and Kawecki, T. J. (2005). A cost of long-term memory in Drosophila. Science 308, 1148. doi: 10.1126/science.1111331
Niven, J. E., and Laughlin, S. B. (2008). Energy limitation as a selective pressure on the evolution of sensory systems. J. Exp. Biol. 211, 1792–1804. doi: 10.1242/jeb.017574
Pfister, J. P., and Gerstner, W. (2006). Triplets of spikes in a model of spike timing dependent plasticity. J. Neurosci. 26, 9673–9682. doi: 10.1523/JNEUROSCI.1425-06.2006
Placais, P. Y., de Tredern, É., Scheunemann, L., Trannoy, S., Goguel, V., Han, K. A., et al. (2017). Upregulated energy metabolism in the Drosophila mushroom body is the trigger for long-term memory. Nat. Commun. 8, 11510. doi: 10.1038/ncomms15510
Placais, P. Y., and Preat, T. (2013). To favor survival under food shortage, the brain disables costly memory. Science 339, 440–442. doi: 10.1126/science.1226018
Rannals, M. D., and Kapur, J. (2011). Homeostatic strengthening of inhibitory synapses is mediated by the accumulation of GABA(A) receptors. J. Neurosci. 31, 17701–17712. doi: 10.1523/JNEUROSCI.4476-11.2011
Royer, S., and Paré, D. (2003). Conservation of total synaptic weight through balanced synaptic depression and potentiation. Nature 422, 518–522. doi: 10.1038/nature01530
Sacramento, J., Wichert, A., and van Rossum, M. C. W. (2015). Energy efficient sparse connectivity from imbalanced synaptic plasticity rules. PLoS Comput. Biol. 11, e1004265. doi: 10.1371/journal.pcbi.1004265
Shouval, H. Z., Bear, M. F., and Cooper, L. N. (2002). A unified model of NMDA receptor-dependent bidirectional synaptic plasticity. Proc. Natl. Acad. Sci. U.S.A. 99, 10831–10836. doi: 10.1073/pnas.152343099
Sjöström, P. J., Turrigiano, G. G., and Nelson, S. B. (2001). Rate, timing, and cooperativity jointly determine cortical synaptic plasticity. Neuron 32, 1149–1164. doi: 10.1016/S0896-6273(01)00542-6
Swanwick, C. C., Murthy, N. R., and Kapur, J. (2006). Activity-dependent scaling of GABAergic synapse strength is regulated by brain-derived neurotrophic factor. Mol. Cell. Neurosci. 31, 481–492. doi: 10.1016/j.mcn.2005.11.002
Tononi, G., and Cirelli, C. (2014). Sleep and the price of plasticity: from synaptic and cellular homeostasis to memory consolidation and integration. Neuron 81, 12–34. doi: 10.1016/j.neuron.2013.12.025
Turrigiano, G. (2012). Homeostatic synaptic plasticity: local and global mechanisms for stabilizing neuronal function. Cold Spring Harb. Perspect. Biol. 4, a005736. doi: 10.1101/cshperspect.a005736
Turrigiano, G. G., Leslie, K. R., Desai, N. S., Rutherford, L. C., and Nelson, S. B. (1998). Activity-dependent scaling of quantal amplitude in neocortical neurons. Nature 391, 892–896. doi: 10.1038/36103
Turrigiano, G. G., and Nelson, S. B. (2004). Homeostatic plasticity in the developing nervous system. Nat. Rev. Neurosci. 5, 97–107. doi: 10.1038/nrn1327
Vitureira, N., and Goda, Y. (2013). The interplay between Hebbian and homeostatic synaptic plasticity. J. Cell Biol. 203, 175–186. doi: 10.1083/jcb.201306030
Vlachos, A., Ikenberg, B., Lenz, M., Becker, D., Reifenberg, K., Bas-Orth, C., et al. (2013). Synaptopodin regulates denervation-induced homeostatic synaptic plasticity. Proc. Natl. Acad. Sci. U.S.A. 110, 8242–8247. doi: 10.1073/pnas.1213677110
White, G., Levy, W. B., and Steward, O. (1990). Spatial overlap between populations of synapses determines the extent of their associative interaction during the induction of long-term potentiation and depression. J. Neurophysiol. 64, 1186–1198. doi: 10.1152/jn.1990.64.4.1186
Yee, A. X., Hsu, Y. T., and Chen, L. A. (2017). Metaplasticity view of the interaction between homeostatic and Hebbian plasticity. Philos. Trans. R. Soc. B Biol. Sci. 372, 20160155. doi: 10.1098/rstb.2016.0155
Yi, G. S., Wang, J., Li, H. Y., Wei, X. L., and Deng, B. (2016). Metabolic energy of action potentials modulated by spike frequency adaptation. Front. Neurosci. 10, 534. doi: 10.3389/fnins.2016.00534
Yu, L., and Yu, Y. (2017). Energy-efficient neural information processing in individual neurons and neuronal networks. J. Neurosci. Res. 95, 2253–2266. doi: 10.1002/jnr.24131
Yuan, Y., Huo, H., Zhao, P., Liu, J., Liu, J., Xing, F., et al. (2018). Constraints of metabolic energy on the number of synaptic connections of neurons and the density of neuronal networks. Front. Comput. Neurosci. 12, 91. doi: 10.3389/fncom.2018.00091
Keywords: computational model, synaptic plasticity, metabolic energy, homeostatic plasticity, homo- and heterosynaptic plasticity
Citation: Chen H, Xie L, Wang Y and Zhang H (2022) Postsynaptic Potential Energy as Determinant of Synaptic Plasticity. Front. Comput. Neurosci. 16:804604. doi: 10.3389/fncom.2022.804604
Received: 29 October 2021; Accepted: 13 January 2022;
Published: 17 February 2022.
Edited by:
Vito Di Maio, Institute of Applied Sciences and Intelligent Systems (ISASI), ItalyReviewed by:
Suhita Nadkarni, Indian Institute of Science Education and Research, Pune, IndiaXiaoli Li, Beijing Normal University, China
Weiqin Tong, Shanghai University, China
Copyright © 2022 Chen, Xie, Wang and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Huanwen Chen, aHdjaGVuJiN4MDAwNDA7Y3N1LmVkdS5jbg==