- 1Instituto Federal de Goiás, Goiânia, Brazil
- 2Universidade Federal de Goias, School of Electrical, Mechanical and Computer Engineering, Goiânia, Brazil
- 3Imaging Research Center, Hospital Israelita Albert Einstein, São Paulo, Brazil
- 4Instituto Federal Goiano, Trindade, Brazil
- 5Universidade Federal de Goias, Institute of Biological Sciences, Goiânia, Brazil
Dysfunction in fear and stress responses is intrinsically linked to various neurological diseases, including anxiety disorders, depression, and Post-Traumatic Stress Disorder. Previous studies using in vivo models with Immediate-Extinction Deficit (IED) and Stress Enhanced Fear Learning (SEFL) protocols have provided valuable insights into these mechanisms and aided the development of new therapeutic approaches. However, assessing these dysfunctions in animal subjects using IED and SEFL protocols can cause significant pain and suffering. To advance the understanding of fear and stress, this study presents a biologically and behaviorally plausible computational architecture that integrates several subregions of key brain structures, such as the amygdala, hippocampus, and medial prefrontal cortex. Additionally, the model incorporates stress hormone curves and employs spiking neural networks with conductance-based integrate-and-fire neurons. The proposed approach was validated using the well-established Contextual Fear Conditioning paradigm and subsequently tested with IED and SEFL protocols. The results confirmed that higher intensity aversive stimuli result in more robust and persistent fear memories, making extinction more challenging. They also underscore the importance of the timing of extinction and the significant influence of stress. To our knowledge, this is the first instance of computational modeling being applied to IED and SEFL protocols. This study validates our computational model's complexity and biological realism in analyzing responses to fear and stress through fear conditioning, IED, and SEFL protocols. Rather than providing new biological insights, the primary contribution of this work lies in its methodological innovation, demonstrating that complex, biologically plausible neural architectures can effectively replicate established findings in fear and stress research. By simulating protocols typically conducted in vivo-often involving significant pain and suffering-in an insilico environment, our model offers a promising tool for studying fear-related mechanisms. These findings support the potential of computational models to reduce the reliance on animal testing while setting the stage for new therapeutic approaches.
1 Introduction
Fear and stress drive adaptive behavior in response to environmental challenges. The activation of fear and stress responses triggers a cascade of autonomic and endocrine changes, significantly impacting learning and memory processes, as shown in seminal neurology and psychology research (Squire, 1987, 2009; McGaugh, 2013). The effects of these changes depend on their timing relative to the learning process (Drexler et al., 2019).
Pavlovian fear conditioning has become an essential tool for investigating cognitive paradigms in both human and animal research. This methodology has significantly enhanced our understanding of the physiological basis of fear and has applications in preclinical models of neuropathologies and clinical research (Chang et al., 2009). Through pre-training, post-training, and pre-test manipulations, Pavlovian fear conditioning provides insights into the complexities of memory acquisition, consolidation, and retrieval (LeDoux, 2000; Maren, 2011).
Fear conditioning involves associating a neutral stimulus or context with an unconditioned stimulus (US), resulting in the neutral stimulus acquiring aversive properties and becoming a conditioned stimulus (CS). This process elicits conditioned responses (CR), a well-documented phenomenon (Ehrlich et al., 2009). Additionally, extinction is introduced as a context-dependent learning form, describing the reduction of conditioned responses when the CS is presented without the US, leading to the suppression, but not erasure, of the memory (Turnock and Becker, 2008; Chang and Liang, 2017).
The efficacy of Pavlovian fear conditioning depends on the strength of the conditioned-unconditioned stimulus pairing and can be reversed during extinction processes. These limitations pose challenges in elucidating the mechanisms underlying stress and anxiety, affecting the development of effective behavioral therapies for related disorders (Maren et al., 2013; LeDoux, 2014; Maren and Holmes, 2016; Bennett et al., 2019). Consequently, stress models such as Immediate Extinction Deficit (IED) and Stress-Enhanced Fear Learning (SEFL) have been developed to understand stress's influence on fear memory.
The Stress-Enhanced Fear Learning (SEFL) model aims to enhance our understanding of disorders like Post-Traumatic Stress Disorder (PTSD). It focuses on how traumatic experiences affect learning responses, such as freezing in rats exposed to shocks in various contexts (Rau et al., 2005). This model emphasizes sensitization and generalization in fear learning following trauma (Long and Fanselow, 2012).
In contrast, the Immediate Extinction Deficit (IED) model investigates how stress affects the ability to “unlearn” fear. It shows that animals exposed to extinction training shortly after conditioning exhibit different recovery patterns depending on the training's timing (Kim et al., 2010; Maren, 2014). This model underlines the impact of timing on extinction learning effectiveness.
The need to develop more effective treatments for neurological diseases related to fear and stress drives the search for a deeper understanding of these mechanisms. Conventional in vivo experiments provide valuable information but face significant limitations, including ethical concerns and the risk of causing trauma or exacerbating preexisting conditions. This highlights the need for new approaches and technologies. In this context, stress models and computational tools are valuable resources, allowing detailed analysis of the neural mechanisms associated with fear and stress. Computational modeling, in particular, enables the simulation and understanding of the complex dynamics between fear, stress, and related disorders (Yamamori and Robinson, 2023).
Despite biological and cognitive differences between rodents and humans, using a rodent neural architecture is justified by the extensive research in the literature, facilitating comparisons with preexisting models and providing a robust foundation for validation and further insights (Morén, 2001; Moustafa et al., 2009; John et al., 2013; Pendyam et al., 2013; Feng et al., 2016; Li, 2017; Mattera et al., 2020; Khalid et al., 2020; Turnock and Becker, 2008; Chang and Liang, 2017; McGaugh, 2015; Okon-Singer et al., 2015; Li, 2017; Kahana, 2020).
Thus, this study aims to develop a biologically and behaviorally plausible computational framework based on a rodent brain to analyze responses to fear and stress through fear conditioning, IED, and SEFL approaches. The primary goal is to construct a computational model representing the neural properties of critical brain structures involved in fear processing, including subregions of the amygdala, hippocampus, prefrontal cortex, nucleus reuniens, and dynamic stress hormone responses. By incorporating greater structural complexity and specific synaptic parameters, this approach seeks to validate the model's robustness through its ability to replicate established findings in the literature. We conducted experiments to assess the model's capability to reflect physiological and behavioral characteristics, ultimately establishing a credible foundation for future in silico studies that can potentially reduce animal testing needs.
2 Methods
2.1 Model overview
The proposed architecture integrates several subregions of crucial brain structures, such as the amygdala, hippocampus, medial prefrontal cortex, and nucleus reuniens. The model was developed based on rats' neurobiological parameters, ensuring that all data regarding neural architecture, synaptic weights, signal propagation, and other variables are consistent with studies in this species. This choice aligned the model with widely used fear conditioning protocols, such as Contextual Fear Conditioning, SEFL, and IED, which traditionally employ rats.
Furthermore, it proposes an innovative computational model incorporating stress hormone curves and utilizing firing neural networks with conductance-based integrating and firing neurons. We employed the well-established paradigm of Contextual Fear Conditioning for model initial validation. Subsequently, we used the IED and SEFL protocols to evaluate the model's applicability in studying disorders related to fear and stress.
A graphical representation of the model's architecture is presented in Figure 1. The detailed parameters of the model, including the configuration of the integrate-and-fire (IF) neurons, the synaptic weights, and the input connections for each implemented neuronal cluster, are documented below.
Figure 1. Architecture of the proposed model. Red rectangles and lines represent inhibitory connections, green rectangles and lines represent excitatory connections, blue lines represent stress responses, and dotted lines represent plastic connections. In addition to the elucidated information within the text, pertinent details regarding the number of neurons, connections, and referenced works for each region utilized in the proposed model are provided throughout the text.
The amygdala plays a fundamental role in forming and extinction fear memory, acting as a key processing center for CS−US stimuli and integrating sensory information to influence executive, motor, and memory functions (Akirav and Maroun, 2007; Carrere and Alexandre, 2015). Its sensory input region, the lateral amygdala (LA), receives projections from various cortices, including auditory, visual, gustatory, olfactory, and somatosensory, and is crucial for responding to both conditioned (CS) and unconditioned stimuli (US) (Connor and Gould, 2016).
In the LA, excitatory neurons (LA) coexist with inhibitory neurons containing somatostatin (LASOM), parvalbumin (LAPV), and cholecystokinin (LACCK). The LA neurons, receiving both CS and US inputs, play a pivotal role in encoding fear memories, while LAPV and LACCK modulate these responses through their inhibitory projections (Duvarci and Pare, 2014; Kim et al., 2013; Bennett et al., 2019).
The medial central amygdala (CeM) orchestrates the behavioral, autonomic, and endocrine responses associated with fear, receiving inputs from the LA through various pathways. These include the basal amygdala (BA) pathway, critical for transmitting LA activity to CeM (Pape and Pare, 2010; Asede et al., 2015; Pare and Duvarci, 2012), and the intercalated inhibitory cells, which modulate fear responses during both acquisition and extinction phases (Duvarci and Pare, 2014; Oliva et al., 2018). The lateral nucleus of the amygdala (LA) neurons excite neurons within the basolateral nucleus (BA), which are divided into two distinct sub-populations: one associated with fear acquisition (BAF) and the other with extinction (BAE) (Herry et al., 2008). Also within the basolateral region are inhibitory neurons containing parvalbumin (BAPV) and cholecystokinin (BACCK). Additionally, the lateral subdivision of the central amygdala (CeL) regulates the output of CeM cells, influenced by both US and LA projections (Ciocchi et al., 2010; Mattera et al., 2020; Haubensak et al., 2010; Duvarci and Pare, 2014).
Another critical region of the fear circuit is the medial prefrontal cortex (mPFC). Studies indicate that fear memory extinction requires plasticity in the mPFC and the amygdala (Akirav and Maroun, 2007). The mPFC can modulate the expression of previously learned fear bidirectionally, i.e., it performs coordinated action by integrating several mnemonic inputs and up-down regulation of specific brain circuits (Gilmartin et al., 2014).
The medial prefrontal cortex (mPFC) also contributes significantly to the fear circuit, modulating the expression of learned fear through its connections with the amygdala (Gilmartin et al., 2014; Akirav and Maroun, 2007). The infralimbic (IL) and prelimbic (PL) cortices are integral components of the mPFC, crucial for both the formation and extinction of fear memories. While the PL primarily contributes to fear acquisition, the IL is primarily involved in fear extinction (Marek et al., 2018b). Additionally, they exert top-down regulation on the fear response (Sierra-Mercado et al., 2011; Bennett and Lagopoulos, 2018; Marcus et al., 2020).
Furthermore, the hippocampus and the entorhinal cortex (EC) are integral for contextual fear memory processing, communicating through both the trisynaptic (TSP) and monosynaptic (MSP) pathways. These regions send emotion-related information to the amygdala and mPFC, influencing the encoding and recall of emotional memories (Schapiro et al., 2017; O'Reilly and Norman, 2002; Ketz et al., 2013; Tse et al., 2007; Maren et al., 2013; OReilly et al., 2014).
The nucleus reuniens (RE) connects cortical structures and the hippocampus, significantly influencing contextual fear learning and memories (Bokor et al., 2002; Vertes, 2006). Inactivation of the RE affects acquiring and retrieving these memories, while projections from the medial prefrontal cortex (mPFC) to the RE are essential for inhibiting fear after extinction (Ramanathan et al., 2018).
2.2 Spiking neural networks
The cells of the proposed model use mainly Integrated and Fire (IF) type neurons based on conductance to express the firing dynamics coming from each network layer (Destexhe, 1997). The IF artificial neuron is a model capable of expressing the dynamics of the Spiking Neural Network (SNN), which describes mathematically the properties of biological neurons that generate electrical potential through the cell membrane caused by the change in the conductance of the receptor channel in the presynaptic region (Destexhe, 1997; Gerstner et al., 2014; Raudies and Hasselmo, 2014; Rezaei et al., 2020).
The IF model analyzes neuron action potential propagation through a time-dependent current. When the potential reaches a certain established threshold, it triggers spikes, instantly raising the potential before it returns to its resting value (Abbott, 1999). According to the model, the membrane potential is given by:
The input current Isyn drives the membrane, modeled using capacitance C with potential Vi, through the leakage conductance channel gleak, where E represents the synaptic conductance reversal equilibrium potential. The index i represents the ith modeled region. The term η represents small fluctuations in the membrane potential and is a random variable η ϵN(μ, σ), extracted from the Gaussian distribution N with mean value μ and standard deviation σ.
The synaptic current is modeled as the ohmic conductance gsyn multiplied by the driving force, which is the difference between the membrane potential Vi and the reversal equilibrium potential of the synaptic conductance Esyn (Destexhe, 1997).
Including the excitatory electrical conductivities, gE, and inhibitory electrical conductivities, gI, and considering the membrane potential about the τ refractory period, the membrane potential is given by:
when . Furthermore, it has different values for each type of neuron. EE represents the excitatory reversal equilibrium potential, and EI is the inhibitory potential.
When the membrane potential reaches the membrane potential threshold, the neuron fires rise to the peak potential, Vth, and then returns to the resting potential.
To update the synaptic weights of IF, we used Spike Time Dependent Plasticity (STDP), an adapted form of Hebbian learning, and frequently implemented in SNN. In the biological context, synaptic plasticity is divided into Long Term Potentiation (LTP) and Long Term Depression (LTD), where LTP represents the changes when a synaptic increase occurs and LTD, a decrease in synaptic gain. STDP suggests that synaptic efficacy increases when presynaptic peaks occur milliseconds before postsynaptic peaks. Likewise, the efficacy decreases when postsynaptic peaks occur before presynaptic peaks (Gupta and Long, 2009).
The model uses a learning mechanism based on physiological data to analyze forwarding and backward temporal order repetition. The weight adaptation is given by:
Δt = (tpre−tpos) and the relative time between the presynaptic and postsynaptic peak, wherein positive Δt represents LTP and negative, LTD. ωmin and ωmax refer to lower and upper bounds of the dynamic range of weights and the time constants τω, τ+ and τ− are weight adaptation and LTP and LTD learning curve, respectively. Finally, A+ and A− represent amplitude for depression and synaptic potentiation. In a computational model, A+ is three times greater than A−.
The existing physiological evidence justifies STDP, showing that LTD is necessary for context-based learning (Raudies and Hasselmo, 2014). This method effectively defines time intervals and peak frequencies within the current Theta phase oscillation ranges, observed in coding and evocation processes in the hippocampus and the amygdala.
2.3 Sparsity
In our model, sparsity refers to the number of neurons remaining active within a given layer, controlled by the k-Winner Take All (k-WTA) function. This function limits the number of active neurons by applying a global inhibitory value across the entire layer, allowing only the top k neurons with the highest excitation levels to remain active while suppressing the others. As activity flows through the layers, excitatory and inhibitory weights (ωexc and ωinib) interact to regulate this process, with the k-WTA function enhancing inhibition by activating the most substantial peaks and preventing other neurons from firing (Smith, 2020).
This sparsity mechanism is represented by generating a pulse of current I based on the k-WTA function:
This approach results in a distributed activation in layers such as those in the hippocampus, where a subset of neurons remains active rather than just a single dominant neuron. The degree of sparsity in these layers can vary based on the model's stress level, with higher stress potentially leading to a more significant proportion of active neurons. Conversely, only the most active neuron is triggered in layers focusing on a single dominant signal. This approach mirrors natural neural systems, where only a select group of neurons respond robustly to specific inputs, ensuring that only the most relevant signals propagate through the network while balancing excitatory and inhibitory activity.
2.4 Neuromodulation
In response to a stressful event, the body activates the sympathetic nervous system and the hypothalamic-pituitary-adrenal (HPA) axis, triggering a cascade of biochemical reactions to handle the situation (Drexler et al., 2019; Grzelka et al., 2017). This response prepares the body for immediate action and medium-term adjustment, which is necessary to cope with stress's physiological and psychological impact.
During the stress response, neurotransmitters and hormones play essential roles in modulating neural activity. They enhance the organism's readiness and reactivity and regulate processes related to memory and learning, which are critical in forming fear responses (Krugers et al., 2012; Wolf, 2017). The interaction between these neurotransmitters and hormones allows the brain to process the stressful event and adjust neural activity according to the intensity and duration of the stimulus.
The main agents involved in the stress response include norepinephrine and corticosteroids. Norepinephrine primarily acts as a neurotransmitter in the brain, quickly affecting neural circuits to intensify alertness and immediate readiness. In contrast, corticosteroids function as longer-acting hormones that gradually modulate neural activity (Joëls et al., 2006; Taborsky et al., 2020). This temporal difference allows norepinephrine and corticosteroids to work together to adapt the organism to stress: norepinephrine impacts the initial response of arousal and vigilance, while corticosteroids contribute to stress regulation and long-term memory consolidation.
To model neuromodulation in this study, we used simplified response equations and curves for norepinephrine and corticosteroids following a stressful event, based on the foundational work of Krugers et al. (2012) and Wolf (2017). Figure 2 illustrates these levels, with adjustments made to capture each hormone's distinct temporal patterns and intensity levels: norepinephrine rises quickly to support immediate alertness, while corticosteroids increase gradually to sustain a prolonged regulatory effect. Although simplified, these curves capture the primary trends in hormonal response timing and progression, providing a practical yet realistic approach to modeling neuromodulatory effects.
Figure 2. Neuroendocrine responses to stress. Noradrenaline (NE) levels increase until approximately twenty minutes and decrease until sixty minutes. Corticosteroid levels also increase exponentially and return to baseline after one to 2 h. The x-axis specifies the time in minutes.
The action potential of layers with neurotransmitter interference is multiplied by a value representing the tonic level β.
To illustrate the impact of NE-influenced neuromodulation on the PL and IL regions, all inputs are scaled by the factor β. Thus, the input Ij is determined as follows:
where Iinf is the hormonal influence.
To represent the influence of corticosteroids in the CA1 region and the consequent increase in the firing of neurons, the percentage of the sparseness of the CA1 region may vary from 10%, standard value, to 50%, saturation value at 40 min after the stressful situation.
2.5 Experimental design
Each experiment is divided into several groups, each performing a specific set of tasks. The timing of behavioral episodes is divided into several phases. In each phase, different initial stimuli trigger unique behaviors or reactions. Furthermore, several cycles of repetition of these behaviors or reactions may occur within each phase. The Table 1 details the correlation between the expressions, the number of cycles and their input stimuli.
Before initiating any experiment, we establish the computational model's initial configuration through a simulation in the “Home” environment. This process is essential to ensure the neural network's dynamic equilibrium and to prevent any bias in the experimental responses. During this initial phase, we calibrate the synaptic weights, which are adopted as baseline parameters for all subsequent experiments. The simulation in the “Home” environment continues until the output of the central nucleus of the amygdala (CeM) stabilizes below 10% for ten consecutive cycles. This procedure ensures that the network has achieved a state of consistency and robustness, allowing experiments to be conducted with the assurance that the baseline freezing behavior has been adequately controlled and stabilized.
We initialize neurons with a resting potential of −70 × 10−3V, and adjust the membrane potential at each cycle as previously described. After completing the final phase of each experiment, we analyze neuronal activity in the CeM to interpret the network's prediction.
We initiate stress cycles after fifteen cycles of fear acquisition. We selected this threshold of 15 cycles based on baseline factors to activate the norepinephrine and corticosteroid response curves, establishing a reasonable timeframe for stress hormones to begin interacting with the fear acquisition process. Given the various approaches for modeling fear acquisition and transitioning to stress, we chose the 15-cycle mark to introduce stress cycles in a way that reflects a plausible temporal dynamic between fear and stress mechanisms. We adjust stress levels according to Equations 7, 8.
The developed computational model incorporates shock intensity as a configurable variable, enabling the simulation of different levels of unconditioned stimulus (US) intensity by practices observed in behavioral studies. This parameterization allows for replicating variations in behavioral responses found in in vivo experiments.
Additionally, the model maintains a fixed time interval between shocks to ensure consistency in timing during each acquisition phase. The unconditioned stimulus (US) is applied in 2, 000 of the total 8, 000 iterations per phase, ensuring a uniform application of the stimuli. This stringent control of the interval between shocks reflects standard practices in in vivo experiments. Standardizing time between stimuli is essential to minimize variations that may interfere with behavioral responses.
To represent the propagation of the shock effect, the initial current in the sensory layers was set to 1.00nA, ensuring the proper transmission of the stimulus. Additionally, the synaptic current is reduced at a rate of 0.01nA per subsequent layer, simulating the decay of shock intensity as the stimulus progresses through the neural circuit, similar to what occurs in biological systems.
Parameters for configuring the IF neuron include the membrane capacitance (C) set to 5.5pF, and the membrane conductance (Gl) set to 10nS, ensuring that the time constant (τ) is maintained at 0.5ms. The peak potential (Vpico) is set to 0mV. The time interval and step for simulation of the computational model were defined to keep the network frequency close to 8 Hz, representing Theta oscillation. Thus, the time varies close to 125 ms. Each analysis is performed with an interval between 0 and 4, 000 ms and τ = 0.5 ms, resulting in 8, 000 cycles.
Synaptic weights must be modified until the network is appropriately converging to perform all training and testing. They are randomly initialized within the range of values determined by normal distribution, with standard deviation (σ) being 0.3 and mean (μ). Table 2 presents neurons number, connection, mean of the normal distribution, and the design references in each region used on the proposed model.
Table 2. Neurons number, connection, mean of the normal distribution, and the design references in each region used on the proposed model.
The STDP synaptic modification rule is used in weights between the layers and the relative time between these layers' presynaptic and postsynaptic peaks. The values needed to parameterize the STDP equation are as follows: the time constant for weight adaptation is 10 τ, the time constant for long-term potentiation (LTP) is 10 τ+, and the time constant for long-term depression (LTD) is 0 τ−. The amplitude for LTP is 1.2 A+, and the amplitude for LTD is -0.4 A−.
The k-WTA function is used to determine hippocampal sparsity in the proposed model. The subregion DG receives 30% of the EC, CA3 receives 5% of the DG, and, finally, CA1 receives between 50% and 100%, in cases of stress elevation. CA3's recurring network is fully wired to help link parts of representation and retrieve patterns from memory. CA1 receives fully connected projection from CA3, and ECV has 50% sparsity.
Table 3 presents all input connections for each group of neurons used in the proposed model. Efforts were made to keep all values low while considering the proportional differences in neuron counts reported in the literature for various brain regions in rats (Boss et al., 1987; Gabbott et al., 1997; O'Reilly and Rudy, 2001; Maier and West, 2003; Chareyron et al., 2011). This approach maintains a realistic ratio of neurons across layers, ensuring both computational efficiency and biological plausibility.
3 Results
In this section, we expose the results achieved through the application of the proposed methodology, focusing on the evaluation of the neural network through models of contextual fear conditioning (CFC), immediate extinction deficit (IED), and stress-enhanced fear learning (SEFL).
3.1 Experimental consistency and data representation
To ensure the reliability of our experimental outcomes, we rigorously conducted mean and convergence analyses to determine the optimal number of repetitions for each condition, confirming that the observed patterns remained consistent and stable across trials. These analyses also helped establish the minimum number of repetitions required to produce consistent results (Note: Graphs illustrating these analyses are not included in this document). Using the well-known Contextual Fear Conditioning (CFC) paradigm, we observed that the graphical representations of the mean, boxplot, and confidence intervals of the means per number of repetitions began to converge from the fifteenth repetition. At this stage, the confidence intervals stabilized within an upper and lower limit of 5%. Consequently, a minimum of fifteen replicates was deemed sufficient to produce reliable and representative results for the experiments conducted in this study.
We visualize the data using boxplots, which effectively summarize the response distributions within each group. The boxplot format highlights central tendency and variability, allowing straightforward comparison across conditions. In these boxplots, the red “+” symbols indicate outliers-values that fall outside the expected range for each group. This visualization approach underscores the overall trends in the data and provides a solid basis for visually assessing group differences without the immediate need for statistical significance testing.
3.2 Contextual fear conditioning
This experiment consists of three phases: Phase CFC 1, all groups were exposed to five cycles in AX+ for fear acquisition. Phase CFC 2 fifteen cycles of BX− for fear extinction. Phase CFC 3, Group 1, was reintroduced to AX− to assess fear renewal and Group 2 to BX− to assess repetition of extinction. This experiment analyses the process of fear extinction and examines the means of fear renewal after extinction. Table 4 details each step and Figure 3 outlines the maximum freezing level obtained for each phase.
Figure 3. Average level of freezing (%) for Contextual Fear Conditioning: The Figure illustrates the sequential protocol of (CFC 1) fear acquisition, (CFC 2) fear extinction, (CFC 3) renewal, and repetition of fear extinction. In Phase CFC 1, the acquisition occurs for AX+. In Phase CFC 2, Context “B” for extinction is introduced, denoted as BX−. In Phase CFC 3, Group 1 presents renewal and Group 2 with repetition of extinction.
The figure illustrates the average freezing levels (%) across different phases of Contextual Fear Conditioning (CFC). In CFC 1, fear acquisition occurs with high freezing levels, indicating successful learning. In CFC 2, the introduction of a different context for extinction shows a gradual decrease in freezing, demonstrating effective fear extinction. CFC 3 presents two groups: Group 1 presents some fear renewal when the original context is reintroduced, while Group 2 exhibits further reduced freezing levels with repeated extinction. This reduction in freezing is attributed to continued extinction sessions, which result in the CeM receiving more inhibitory than excitatory signals, effectively suppressing the fear response.
The proposed neural architecture and computational modeling enable verifying that the extinction phase is essential to attenuate the association between context and fear, indicating that extinction reduces the existing fear response and makes it difficult to reactivate fear in the same context.
3.3 Fear response at different shock magnitudes during the acquisition phase
The following study investigates the mechanisms underlying the fear response at different shock magnitudes (SM) during the acquisition phase. Specifically, exploring the role of intensity in the conditioned stimulus-unconditioned stimulus (CS-US) pairing provides valuable information about how different threat levels modulate the fear response.
For the simulation, each group, respectively, receives 1, 10, 20, and 30 shocks at the acquisition phase (Phase SM 1). The experiment features fifteen extinction cycles in Phase SM 2. Table 5 and Figure 4 present details of the experiments.
Figure 4. Average freezing level (%) for fear responses at different magnitudes during the acquisition phase. The Figure presents a simulation that captures fear responses at different magnitudes during the acquisition phase. In Phase SM-1, three distinct groups are subjected to different intensities of electric shock in AX+: (A) Group 1 receives a two shocks, (B) Group 2 receives ten shocks, (C) Group 3 receives twenty shocks, and (D) Group 4, thirty shocks. The simulation advances to Phase SM-2 with fifteen cycles in BX−.
This experiment demonstrates that when subjecting animals to shocks of low magnitude, as observed in groups that receive up to two shocks, the intensity may not be sufficient to establish a lasting aversive memory linked to the context or conditioned stimulus. Consequently, these animals demonstrate reduced fear retention.
The results suggest that after administering ten or more shocks, there is already a significant increase in fear retention, as evidenced by higher freezing responses. This marks a tipping point where the intensity and frequency of the unconditioned stimulus (the shocks) begin to consolidate a stronger aversive memory. Consequently, animals exhibit higher freezing rates during extinction, indicating substantial fear retention. Notably, after fifteen cycles, the stress response involving noradrenaline and corticosteroid levels, as described in the Neuromodulation section, becomes fully activated. These hormonal changes reinforce the established fear response, impacting the behaviors observed in Groups 2, 3, and 4 by enhancing alertness and stress regulation over time.
3.4 Stress-enhanced fear learning
Based on the SEFL model, the following experiment investigates the induction of fear learning by stress. During Phase SEFL 1, Group 1, and Group 2 undergo 15 cycles in A, and Group 3 and Group 4 undergo fifteen cycles in A+. In Phase SEFL 2, Group 1, and Group 3 experience a cycle in B, and Group 2 and Group 4 are exposed to a cycle in B+. In Phase SEFL 3, all groups go through a cycle in B. The specific details of the experiment are elucidated in Table 6, while Figure 5 presents the collected data.
Figure 5. Average level of freezing (%) for fear responses obtained for SEFL. (A) Group 1 goes through Phase SEFL 1, fifteen cycles in A, in Phase SEFL 2, one cycle in B, and in Phase SEFL 3, one cycle in B. (B) Group 2 proceeds with Phase SEFL 1, fifteen cycles in A, Phase SEFL 2, one cycle in B+, and Phase SEFL 3, one cycle in B. (C) Group 3 experiences Phase SEFL 1, fifteen cycles in A+, Phase SEFL 2, one cycle in B, and Phase SEFL 3, one cycle in B. (D) Group 4 undergoes Phase SEFL 1, fifteen cycles at A+, Phase SEFL 2, one cycle at B+, and Phase SEFL 3, one cycle at B.
The experiment reveals different results for each group studied, indicating variations in behavior and response to fear. Group 1 shows no significant changes in its behavior, suggesting a stable response to the experimental conditions. Group 2, on the other hand, exhibits higher freezing levels, a reaction that intensifies after being subjected to a shock in Context B.
Group 3 demonstrates a mild freezing reaction during the testing phase, which is notable considering that the shocks occurred in a context different from that used for testing. This analysis suggests a possible generalization of fear to different contexts.
Group 4 presents a significantly higher level of freezing. This group experienced a previous trauma in Context A and was likewise subjected to a shock in Context B the day before the test. This Group suggests that pre-existing fear, when combined with additional trauma, may result in a more pronounced fear response.
3.5 Shock stress must precede fear conditioning
This experiment analyzed whether previous and prolonged exposure to stress can increase fear responses. In Phase SS 1, all groups were inserted into Context B, with Group 3 and Group 4 receiving a shock. In Phase SS 2, Group 2 and Group 4 receive fifteen shocks in Context A, while Group 1 and Group 3 remain in context A. In Phase SS 3, all groups were submitted to Context B only once, and finally, in Phase SS 4, all groups are inserted into Context A.
The specific details of the experiment are elucidated in Table 7, while Figure 6 presents the collected data.
Figure 6. Average level of freezing (%) for fear responses obtained for “Shock stress (SS) must precede fear conditioning.” All groups undergo testing in Context B in Phase SS 3 and Context A in Phase SS 4. (A) Group 1 goes through Phase SS 1, one cycle in Context B, and Phase SS 2, 15 cycles in Context A. (B) Group 2 undergoes Phase SS 1, one cycle in Context B, and 15 cycles with shock in Context A. (C) Group 3 proceeds with Phase SS 1, one shock in Context B, and Phase SS 2, 15 cycles in Context A. (D) Group 4 experiences Phase SS 1, one shock in Context B, and Phase SS 2, 15 shocks in Context A.
In this study, it was possible to observe that prolonged exposure to aversive stimuli, such as shocks, can increase an organism's tendency to develop more intense fear responses in future situations. Previous traumatic experiences amplify the learning process related to fear.
Data analysis revealed that, in animals subjected to a single shock in Context B, the fear reaction levels, measured through immobility behavior, were consistent regardless of having previously been exposed to multiple shocks in Context A. On the other hand, those who did not experience shocks in Context A presented minimal fear reactions in Context B. Experimental subjects who faced 15 shocks in Context A showed a high freezing reaction in this Context. However, this reaction was not altered by what occurred in Context B.
These results suggest that although previous traumatic experiences influence fear sensitivity, the specific fear response is more closely linked to the specific context where the aversive stimulus is experienced than to aversive experiences in different contexts.
3.6 Immediate Extinction Deficit
This experiment is based on the IED model and is used to analyze whether the timing of extinction influences the magnitude of fear in the fear retention phase. The experiment is divided into four groups: (1) immediate extinction, (2) delayed extinction, (3) immediate non-extinction, and (4) delayed non-extinction. Phase IED 1, all groups are exposed five times to Context AX+ to acquire fear. Phase IED 2, Group 1 undergoes five cycles in Context BX− 15 minutes after acquisition, while Group 2 receives the same five cycles in Context BX− but only 24 hours after acquisition. Group 3 goes through five cycles in Context B 15 minutes after acquisition, and Group 4 experiences the same five cycles in Context B, but 24 h after acquisition. After 48 hours of acquisition, all groups are exposed to three cycles in Context CX−. Table 8 presents the experiments related to the model, and Figure 7 presents the collected data.
Figure 7. Average freezing level (%) for IED model. This experiment establishes the core parameters, centering on fear acquisition and extinction. It contrasts fear responses among (A) immediate, (B) delayed, (C) non-immediate, and (D) non-delayed extinction groups.
The IED model is critical for studying how the timing of fear extinction after its acquisition affects the longevity and magnitude of the fear response during subsequent retention tests. This insight is crucial for understanding potential therapeutic applications for conditions such as post-traumatic stress disorder, where fear memories can be persistently atypical or easily reactivated.
In our experiment, we observed that the average results between the groups were quite similar. However, we identified that Group 1 and Group 3 had a more significant freezing average than the other groups when placed in CX−. In this situation, the attempt at early extinction may interfere with the ability of the extinction memory to predominate over the fear memory. Furthermore, IED appears to be caused by a general fear response that does not depend on the specific environment where the animal learned the fear. Interestingly, Group 3 showed significantly lower freezing relative to the other groups.
By analyzing this and other experiments, it can be suggested that the stress caused by aversive stimuli during the acquisition of fear is the main cause of variations in how fear extinction occurs. Consequently, these variations can be attenuated by reducing the initially induced fear, either by performing fewer fear tests or by reducing the strength of the aversive stimuli. IED appears to be caused by a general fear response that does not depend on the specific environment where the animal learned the fear.
4 Discussion
Exposure therapy is essential in the treatment of psychiatric disorders. However, it faces the challenge of the fragile inhibitory memory of fear extinction, susceptible to relapses under stress or in the face of traumatic triggers. This fragility highlights the importance of reinforcing these inhibitory memories to reduce the risk of relapse and improve long-term therapeutic results. Consequently, it is vital to develop and refine experimental models that capture the complexity of the clinical scenario, enabling a deeper understanding of these disorders (Maren et al., 2013; Dunsmoor and Kroes, 2019; Sperandeo, 2013; Eichenbaum, 2000; Preston and Eichenbaum, 2013).
Consequently, our work developed a biologically and behaviorally plausible computational framework based on a rodent brain to analyze neural mechanisms related to fear and stress. The proposed architecture includes interactions between the amygdala, medial prefrontal cortex, nucleus reuniens, and hippocampus, incorporating data on stress hormones and how they directly affect these processes.
The model provides a structured framework to simulate and analyze distinct aspects of fear conditioning, IED, and SEFL. For fear conditioning, the model captures how the intensity and timing of aversive stimuli consolidate fear memories, influencing the retention and extinction of fear responses. Regarding IED, the model demonstrates how immediate extinction sessions post-fear acquisition can lead to generalized fear responses due to insufficient memory consolidation, highlighting the timing-dependent vulnerability of fear memory. For SEFL, the model simulates the sensitization process, where prior exposure to stress enhances fear learning in subsequent encounters, reflecting how repeated aversive experiences solidify fear memory networks and increase resistance to extinction. These mechanisms, simulated within the model, offer insights into the neural and hormonal pathways influencing each of these fear-related processes.
The selection of rats as the basis for the computational modeling in this study was grounded in the predominance of this species in fear conditioning protocols, such as Contextual Fear Conditioning, Stress-Enhanced Fear Learning (SEFL), and Immediate Extinction Deficit (IED). Rats possess complex brain structures and fear responses that closely resemble those observed in humans, making them ideal for detailed investigations of mechanisms related to fear and stress. Their use in these protocols ensures high biological fidelity, reinforcing the validity of the computational model for exploring experimental hypotheses and investigating behavioral dynamics with precision. Thus, choosing rats ensures the robustness and applicability of the model's results for studies simulating behavioral processes in fear contexts.
During the development of this study, extensive analyses and interpretations of computational simulations and biological modeling in existing literature were conducted. These analyses covered various aspects of fear reactions, stress, and their interrelationships, forming the basis of the proposed architecture. Previous models cited in this study, including those by Moustafa et al. (2009); John et al. (2013); Pendyam et al. (2013); Turnock and Becker (2008); Moustafa et al. (2013); Carrere and Alexandre (2015); Okon-Singer et al. (2015); Feng et al. (2016); Li (2017); Chang and Liang (2017); Mattera et al. (2020); Khalid et al. (2020); Kahana (2020), provided a crucial knowledge base for our experiments and performance of the model.
Our model aligns closely with established findings in the scientific literature on the neurobiology of fear and its extinction. It emphasizes the amygdala's pivotal role, particularly its lateral region (LA), as a central hub in processing conditioned and unconditioned stimuli, in agreement with studies by Akirav and Maroun (2007) and Carrere and Alexandre (2015). The LA's extensive projections from sensory and associational cortices underscore its function as a primary site for encoding fear associations. Through this, the model reflects a current understanding that the LA is crucial for forming initial fear memories and plays a significant role in modulating the extinction process, as pathways within the amygdala are modified through repeated exposure to conditioned stimuli without reinforcement.
Furthermore, our model recognizes the central medial amygdala (CeM) as essential in orchestrating behavioral, autonomic, and endocrine responses associated with fear, which aligns with findings by Pape and Pare (2010) and Asede et al. (2015). The CeM's output pathways influence brainstem structures that regulate physiological responses to fear, connecting emotional processing with somatic and autonomic functions. This integration within the model supports the CeM's role in coordinating complex behavioral responses, a process that becomes especially relevant when considering heightened responses under stress.
The medial prefrontal cortex (mPFC) is another crucial component in our model, aligning with studies by Gilmartin et al. (2014) and Duvarci and Pare (2014). The mPFC's modulatory influence on fear expression is modeled to reflect its dual role in both inhibiting and facilitating fear responses, depending on contextual cues and learning stages. The mPFC's role in top-down regulation of the amygdala, particularly in extinguishing learned fear responses, is central to understanding adaptive responses and preventing generalized fear. This aspect of the model highlights how changes in mPFC activity can shift fear expression, a particularly relevant mechanism for therapeutic approaches targeting maladaptive fear.
Additionally, the model incorporates the hippocampus and entorhinal cortex, which are crucial for encoding and retrieving contextual fear memories. This inclusion aligns with research by Schapiro et al. (2017) and Maren et al. (2013), emphasizing the hippocampus's role in distinguishing between safe and threatening contexts. By accurately encoding environmental cues, the hippocampus enables differentiating responses based on context, which is essential for adaptive fear regulation. The entorhinal cortex facilitates this process by relaying spatial and contextual information to the hippocampus, further refining the response based on situational factors.
Our model also integrates the nucleus reuniens, which links cortical structures with the hippocampus and influences contextual fear learning and memory consolidation, as described in studies by Ramanathan et al. (2018). The nucleus reuniens uniquely integrates prefrontal inputs with hippocampal outputs, enhancing the model's capacity to simulate how contextual information modulates fear responses.
Finally, our model considers the activation of the sympathetic nervous system and the hypothalamic-pituitary-adrenal (HPA) axis in response to stressful events, in line with research by Drexler et al. (2019) and Grzelka et al. (2017). By incorporating hormonal responses, such as the release of corticosteroids and catecholamines, the model reflects the impact of stress on brain function, neuronal activity, and memory processing. Corticosteroids, in particular, are modeled to modulate synaptic plasticity, affecting how fear memories are consolidated and later retrieved. Catecholamines, such as norepinephrine, are included to capture their role in heightening arousal and alertness during fearful encounters. Together, these hormonal pathways interact with neural circuits to produce a multidimensional response to fear and stress, emphasizing the complexity of the extinction process and underscoring the intricate balance between physiological, neural, and hormonal influences in fear regulation.
4.1 Comparison with other models
In recent years, several computational models of different types have been proposed to study fear conditioning and extinction. Given the large output, this work focuses explicitly on models that closely align with the goals outlined by our research and that share similarities with the architecture we propose.
Firstly, among the computational works found and compatible with our work, none of them present tests for understanding stress (Moustafa et al., 2009; John et al., 2013; Turnock and Becker, 2008; Moustafa et al., 2013; Mattera et al., 2020; Khalid et al., 2020). However, each of them has critical objectives for fear literature. Like the works presented, our work can simulate conditioning, extinction, reacquisition, and fear renewal.
A distinction between our study and other works in the literature lies in the scope of the simulated brain regions and their objectives. Moustafa et al. (2009)'s study focuses on an update of a hippocampal model by Gluck and Myers (1993), adopting Hebbian learning and realistic stimulus representations. While Moustafa offers valuable insights into hippocampal learning and memory, our work encompasses a broader range of brain regions and interactions, providing a more holistic understanding of neural circuits. John et al. (2013) explores the hippocampus and prefrontal cortex interaction in regulating motivated behavior, focusing on contextual modulation and behavioral adaptation. While this model highlights the importance of memory and cognition, our study delves into the integration of additional regions and hormonal influence, which is crucial to understanding fear and stress.
Our computational model provides insights into the dynamics of aversive stimuli and their impact on fear acquisition and extinction. A critical factor is the intensity of the aversive stimulus in forming fear memory. We confirmed that higher intensity stimuli forge more robust and persistent fear memories, complicating the extinction process and aligning with previous findings (Rau et al., 2005). Additionally, the timing of post-acquisition extinction sessions is recognized as essential, as shown in studies by Kim et al. (2010) and Maren (2014). Immediate extinction following exposure may lead to greater fear generalization, suggesting that a consolidation period is necessary for fear memory to stabilize, enabling successful extinction effectively. Conversely, the absence of an extinction intervention reinforces the fear memory, strengthening the conditioned response.
The effects of stimulus intensity and extinction timing on fear memory have been extensively documented in the conditioning literature. High-intensity stimuli create more persistent fear memories that are harder to extinguish (Davis et al., 2000; Rescorla and Heth, 1975). Timing studies further demonstrate that immediate extinction can lead to generalized fear due to insufficient consolidation of fear memory (Quirk and Mueller, 2008; Maren and Holmes, 2016). Recent research also emphasizes the importance of precise timing, showing that interventions like vagus nerve stimulation must be carefully timed to enhance fear extinction in animal models (Souza et al., 2022). In addition, psychophysiological studies in humans confirm that intense stimuli produce more resilient fear memories, while appropriately timed extinction sessions improve fear reduction outcomes (Miller et al., 2023). These findings underscore the need to consider stimulus intensity and extinction timing in experimental designs investigating fear conditioning and extinction.
These results are significant in the context of cognitive disorders and illnesses, supporting the notion that stressful experiences exacerbate susceptibility to such conditions. This highlights the need for intervention strategies considering the intensity and timing of aversive stimuli. Through comparative analysis and results obtained in stress contexts, this study paves the way for developing new experiments that explore the interactions between fear and stress in the proposed neural architecture, enhancing significant advances in the field.
4.2 Limitations
The current model requires further refinement, including analyses of neuronal distribution across brain layers, precise determinations of synaptic weights (inhibitory and excitatory), and assessments of neuromodulatory changes. These steps are essential for a more detailed understanding of the neural mechanisms influencing emotional and cognitive disorders.
Another approach to enhancing the model would be to develop methods that capture individual variability in fear and stress responses. While our model primarily focuses on general mechanisms, it does not address how variations in biological responses, such as corticosteroid levels, may lead to different behavioral outcomes. Including such individual variability in future models could provide a more nuanced representation and enable predictions that account for individual biological and environmental differences.
5 Conclusion
The results of this study provide significant insights into the dynamics of fear acquisition, extinction, and reacquisition, as well as the differential impacts of stress on these processes. Through “Contextual Fear Conditioning” experiments, we demonstrate the intricate mechanisms by which fear memories are formed, extinguished, and potentially reactivated. Variations in fear responses due to different experimental conditions, such as the number of shock exposures and the timing of extinction protocols, underscore the complexity of emotional memory processes in the brain.
Our model allows us to carry out tests with the “Immediate Extinction Deficit” experiment, which confirms that the moment of fear extinction is crucial to determine the persistence and intensity of fear memories. This has profound implications for understanding the treatment of anxiety-related disorders, where the timing of therapeutic interventions can play a critical role in their effectiveness.
Furthermore, testing the model in the “Stress-Enhanced Fear Learning” experiment confirms the significant role of pre-existing stress in enhancing fear memory formation. This observation is particularly relevant in the context of stress disorders, suggesting that prior exposure to stress may exacerbate fear responses in subsequent fear-inducing situations.
The study also highlights the need for personalized approaches in therapeutic interventions for conditions related to fear and stress. Understanding individual variability in response to fear and stress, as indicated by our experiments' varying levels of freezing behavior, is crucial for developing more targeted and effective treatments.
These results contribute to a deeper understanding of the neurobiological underpinnings of fear and stress responses. They pave the way for future research, particularly in exploring the potential of personalized therapy in treating anxiety disorders and PTSD and in understanding the broader implications of stress on cognitive and emotional health. Integrating these findings into clinical practice could significantly increase the effectiveness of treatments for a wide range of psychological conditions related to fear and stress.
Data availability statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Author contributions
BF: Conceptualization, Formal analysis, Methodology, Software, Validation, Writing – original draft, Writing – review & editing. GF: Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing. MC: Formal analysis, Supervision, Validation, Writing – original draft, Writing – review & editing. RL: Formal analysis, Supervision, Validation, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. The authors thank the Federal University of Goiás, Goiânia, Brazil, for covering the article processing charge, and the Federal Institute of Goiás, Senador Canedo, Brazil, for granting a leave of absence to BF, which was instrumental in developing this article as part of her doctoral studies. This work was supported by CNPq, Brazil (406765/2021-9, 407075/2018-6, and 406048/2018-5). MC was grateful for the Career Development Grant support from the International Society of Neurochemistry.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Abbott, L. F. (1999). Lapicques introduction of the integrate-and-fire model neuron (1907). Brain Res. Bull. 50, 303–304. doi: 10.1016/S0361-9230(99)00161-6
Akirav, I., and Maroun, M. (2007). The role of the medial prefrontal cortex-amygdala circuit in stress effects on the extinction of fear. Neural Plast. 2007:030873. doi: 10.1155/2007/30873
Amano, T., Unal, C. T., and Paré, D. (2010). Synaptic correlates of fear extinction in the amygdala. Nat. Neurosci. 13:489. doi: 10.1038/nn.2499
Asede, D., Bosch, D., Lüthi, A., Ferraguti, F., and Ehrlich, I. (2015). Sensory inputs to intercalated cells provide fear-learning modulated inhibition to the basolateral amygdala. Neuron 86, 541–554. doi: 10.1016/j.neuron.2015.03.008
Bennett, M., and Lagopoulos, J. (2018). Stress, Trauma and Synaptic Plasticity. Cham: Springer. doi: 10.1007/978-3-319-91116-8
Bennett, M. R., Arnold, J., Hatton, S. N., and Lagopoulos, J. (2017). Regulation of fear extinction by long-term depression: the roles of endocannabinoids and brain derived neurotrophic factor. Behav. Brain Res. 319, 148–164. doi: 10.1016/j.bbr.2016.11.029
Bennett, M. R., Farnell, L., Gibson, W. G., and Lagopoulos, J. (2019). A model of amygdala function following plastic changes at specific synapses during extinction. Neurobiology of stress 10:100159. doi: 10.1016/j.ynstr.2019.100159
Blair, H. T., Schafe, G. E., Bauer, E. P., Rodrigues, S. M., and LeDoux, J. E. (2001). Synaptic plasticity in the lateral amygdala: a cellular hypothesis of fear conditioning. Learn. Memory 8, 229–242. doi: 10.1101/lm.30901
Bokor, H., Csáki, Á., Kocsis, K., and Kiss, J. (2002). Cellular architecture of the nucleus reuniens thalami and its putative aspartatergic/glutamatergic projection to the hippocampus and medial septum in the rat. Eur. J. Neurosci. 16, 1227–1239. doi: 10.1046/j.1460-9568.2002.02189.x
Boss, B. D., Turlejski, K., Stanfield, B. B., and Cowan, W. M. (1987). On the numbers of neurons on fields ca1 and ca3 of the hippocampus of sprague-dawley and wistar rats. Brain Res. 406, 280–287. doi: 10.1016/0006-8993(87)90793-1
Bouton, M. E., Maren, S., and McNally, G. P. (2021). Behavioral and neurobiological mechanisms of pavlovian and instrumental extinction learning. Physiol. Rev. 101, 611–681. doi: 10.1152/physrev.00016.2020
Carrere, M., and Alexandre, F. (2015). A pavlovian model of the amygdala and its influence within the medial temporal lobe. Front. Syst. Neurosci. 9:41. doi: 10.3389/fnsys.2015.00041
Chang, C.-H., Knapska, E., Orsini, C. A., Rabinak, C. A., Zimmerman, J. M., and Maren, S. (2009). Fear extinction in rodents. Curr. Protocols Neurosci. 47, 8–23. doi: 10.1002/0471142301.ns0823s47
Chang, S.-D., and Liang, K. (2017). The hippocampus integrates context and shock into a configural memory in contextual fear conditioning. Hippocampus 27, 145–155. doi: 10.1002/hipo.22679
Chareyron, L. J., Banta Lavenex, P., Amaral, D. G., and Lavenex, P. (2011). Stereological analysis of the rat and monkey amygdala. J. Compar. Neurol. 519, 3218–3239. doi: 10.1002/cne.22677
Cho, J.-H., Deisseroth, K., and Bolshakov, V. Y. (2013). Synaptic encoding of fear extinction in mpfc-amygdala circuits. Neuron 80, 1491–1507. doi: 10.1016/j.neuron.2013.09.025
Ciocchi, S., Herry, C., Grenier, F., Wolff, S. B., Letzkus, J. J., Vlachos, I., et al. (2010). Encoding of conditioned fear in central amygdala inhibitory circuits. Nature 468, 277–282. doi: 10.1038/nature09559
Connor, D. A., and Gould, T. J. (2016). The role of working memory and declarative memory in trace conditioning. Neurobiol. Learn. Mem. 134, 193–209. doi: 10.1016/j.nlm.2016.07.009
Courtin, J., Chaudun, F., Rozeske, R. R., Karalis, N., Gonzalez-Campo, C., Wurtz, H., et al. (2014). Prefrontal parvalbumin interneurons shape neuronal activity to drive fear expression. Nature 505, 92–96. doi: 10.1038/nature12755
Cummings, K. A., and Clem, R. L. (2020). Prefrontal somatostatin interneurons encode fear memory. Nat. Neurosci. 23, 61–74. doi: 10.1038/s41593-019-0552-7
Davis, M., Falls, W. A., and Gewirtz, J. (2000). “Neural systems involved in fear inhibition: Extinction and conditioned inhibition,” in Contemporary Issues in Modeling Psychopathology (Cham: Springer), 113–141. doi: 10.1007/978-1-4757-4860-4_8
Destexhe, A. (1997). Conductance-based integrate-and-fire models. Neural Comput. 9, 503–514. doi: 10.1162/neco.1997.9.3.503
Dolleman-van der Weel, M. J., Griffin, A. L., Ito, H. T., Shapiro, M. L., Witter, M. P., Vertes, R. P., et al. (2019). The nucleus reuniens of the thalamus sits at the nexus of a hippocampus and medial prefrontal cortex circuit enabling memory and behavior. Learn. Memory 26, 191–205. doi: 10.1101/lm.048389.118
Drexler, S. M., Merz, C. J., Jentsch, V. L., and Wolf, O. T. (2019). How stress and glucocorticoids timing-dependently affect extinction and relapse. Neurosci. Biobehav. Rev. 98, 145–153. doi: 10.1016/j.neubiorev.2018.12.029
Dunsmoor, J. E., and Kroes, M. C. (2019). Episodic memory and pavlovian conditioning: ships passing in the night. Curr. Opin. Behav. Sci. 26, 32–39. doi: 10.1016/j.cobeha.2018.09.019
Duvarci, S., and Pare, D. (2014). Amygdala microcircuits controlling learned fear. Neuron 82, 966–980. doi: 10.1016/j.neuron.2014.04.042
Ehrlich, I., Humeau, Y., Grenier, F., Ciocchi, S., Herry, C., and Lüthi, A. (2009). Amygdala inhibitory circuits and the control of fear memory. Neuron 62, 757–771. doi: 10.1016/j.neuron.2009.05.026
Eichenbaum, H. (2000). A cortical-hippocampal system for declarative memory. Nat. Rev. Neurosci. 1, 41–50. doi: 10.1038/35036213
Feng, F., Samarth, P., Paré, D., and Nair, S. S. (2016). Mechanisms underlying the formation of the amygdalar fear memory trace: a computational perspective. Neuroscience 322, 370–376. doi: 10.1016/j.neuroscience.2016.02.059
Gabbott, P., Warner, T., and Busby, S. (2006). Amygdala input monosynaptically innervates parvalbumin immunoreactive local circuit neurons in rat medial prefrontal cortex. Neuroscience 139, 1039–1048. doi: 10.1016/j.neuroscience.2006.01.026
Gabbott, P. L., Dickie, B. G., Vaid, R. R., Headlam, A. J., and Bacon, S. J. (1997). Local-circuit neurones in the medial prefrontal cortex (areas 25, 32 and 24b) in the rat: morphology and quantitative distribution. J. Compar. Neurol. 377, 465–499. doi: 10.1002/(SICI)1096-9861(19970127)377:4<465::AID-CNE1>3.0.CO;2-0
Gerstner, W., Kistler, W. M., Naud, R., and Paninski, L. (2014). Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition. Cambridge: Cambridge University Press. doi: 10.1017/CBO9781107447615
Gilmartin, M. R., Balderston, N. L., and Helmstetter, F. J. (2014). Prefrontal cortical regulation of fear learning. Trends Neurosci. 37, 455–464. doi: 10.1016/j.tins.2014.05.004
Gluck, M. A., and Myers, C. E. (1993). Hippocampal mediation of stimulus representation: a computational theory. Hippocampus. 3, 491–516. doi: 10.1002/hipo.450030410
Grzelka, K., Kurowski, P., Gawlak, M., and Szulczyk, P. (2017). Noradrenaline modulates the membrane potential and holding current of medial prefrontal cortex pyramidal neurons via β1-adrenergic receptors and hcn channels. Front. Cell. Neurosci. 11:341. doi: 10.3389/fncel.2017.00341
Gupta, A., and Long, L. N. (2009). “Hebbian learning with winner take all for spiking neural networks,” in 2009 International Joint Conference on Neural Networks (IEEE), 1054–1060. doi: 10.1109/IJCNN.2009.5178751
Haubensak, W., Kunwar, P. S., Cai, H., Ciocchi, S., Wall, N. R., Ponnusamy, R., et al. (2010). Genetic dissection of an amygdala microcircuit that gates conditioned fear. Nature 468, 270–276. doi: 10.1038/nature09553
Herry, C., Ciocchi, S., Senn, V., Demmou, L., Müller, C., and Lüthi, A. (2008). Switching on and off fear by distinct neuronal circuits. Nature 454, 600–606. doi: 10.1038/nature07166
Hoover, W. B., and Vertes, R. P. (2007). Anatomical analysis of afferent projections to the medial prefrontal cortex in the rat. Brain Struct. Funct. 212, 149–179. doi: 10.1007/s00429-007-0150-4
Joëls, M., Pu, Z., Wiegert, O., Oitzl, M. S., and Krugers, H. J. (2006). Learning under stress: how does it work? Trends Cogn. Sci. 10, 152–158. doi: 10.1016/j.tics.2006.02.002
John, Y. J., Bullock, D., Zikopoulos, B., and Barbas, H. (2013). Anatomy and computational modeling of networks underlying cognitive-emotional interaction. Front. Hum. Neurosci. 7:101. doi: 10.3389/fnhum.2013.00101
Kahana, M. J. (2020). Computational models of memory search. Annu. Rev. Psychol. 71, 107–138. doi: 10.1146/annurev-psych-010418-103358
Ketz, N., Morkonda, S. G., and O'Reilly, R. C. (2013). Theta coordinated error-driven learning in the hippocampus. PLoS Comput. Biol. 9:e1003067. doi: 10.1371/journal.pcbi.1003067
Khalid, M., Wu, J., M, Ali, T., Ameen, T., Moustafa, A. A., Zhu, Q., et al. (2020). Cortico-hippocampal computational modeling using quantum neural networks to simulate classical conditioning paradigms. Brain Sci. 10:431. doi: 10.3390/brainsci10070431
Kim, D., Paré, D., and Nair, S. S. (2013). Mechanisms contributing to the induction and storage of pavlovian fear memories in the lateral amygdala. Learn. Memory 20, 421–430. doi: 10.1101/lm.030262.113
Kim, S. C., Jo, Y. S., Kim, I. H., Kim, H., and Choi, J.-S. (2010). Lack of medial prefrontal cortex activation underlies the immediate extinction deficit. J. Neurosci. 30, 832–837. doi: 10.1523/JNEUROSCI.4145-09.2010
Krabbe, S., Gründemann, J., and Lüthi, A. (2018). Amygdala inhibitory circuits regulate associative fear conditioning. Biol. Psychiatry 83, 800–809. doi: 10.1016/j.biopsych.2017.10.006
Krugers, H. J., Karst, H., and Joels, M. (2012). Interactions between noradrenaline and corticosteroids in the brain: from electrical activity to cognitive performance. Front. Cell. Neurosci. 6:15. doi: 10.3389/fncel.2012.00015
LeDoux, J. E. (2000). Emotion circuits in the brain. Annu. Rev. Neurosci. 23, 155–184. doi: 10.1146/annurev.neuro.23.1.155
LeDoux, J. E. (2014). Coming to terms with fear. Proc. Nat. Acad. Sci. 111, 2871–2878. doi: 10.1073/pnas.1400335111
Li, G. (2017). “Computational models of the amygdala in acquisition and extinction of conditioned fear,” in The Amygdala-Where Emotions Shape Perception, Learning and Memories (IntechOpen). doi: 10.5772/67834
Li, H., Penzo, M. A., Taniguchi, H., Kopec, C. D., Huang, Z. J., and Li, B. (2013). Experience-dependent modification of a central amygdala fear circuit. Nat. Neurosci. 16, 332–339. doi: 10.1038/nn.3322
Long, V. A., and Fanselow, M. S. (2012). Stress-enhanced fear learning in rats is resistant to the effects of immediate massed extinction. Stress 15, 627–636. doi: 10.3109/10253890.2011.650251
Maier, S. E., and West, J. R. (2003). Alcohol and nutritional control treatments during neurogenesis in rat brain reduce total neuron number in locus coeruleus, but not in cerebellum or inferior olive. Alcohol 30, 67–74. doi: 10.1016/S0741-8329(03)00096-X
Marcus, D. J., Bedse, G., Gaulden, A. D., Ryan, J. D., Kondev, V., Winters, N. D., et al. (2020). Endocannabinoid signaling collapse mediates stress-induced amygdalo-cortical strengthening. Neuron 105, 1062–1076. doi: 10.1016/j.neuron.2019.12.024
Marek, R., Jin, J., Goode, T. D., Giustino, T. F., Wang, Q., Acca, G. M., et al. (2018a). Hippocampus-driven feed-forward inhibition of the prefrontal cortex mediates relapse of extinguished fear. Nat. Neurosci. 21, 384–392. doi: 10.1038/s41593-018-0073-9
Marek, R., Xu, L., Sullivan, R. K., and Sah, P. (2018b). Excitatory connections between the prelimbic and infralimbic medial prefrontal cortex show a role for the prelimbic cortex in fear extinction. Nat. Neurosci. 21, 654–658. doi: 10.1038/s41593-018-0137-x
Maren, S. (2011). Seeking a spotless mind: extinction, deconsolidation, and erasure of fear memory. Neuron 70, 830–845. doi: 10.1016/j.neuron.2011.04.023
Maren, S. (2014). Nature and causes of the immediate extinction deficit: a brief review. Neurobiol. Learn. Mem. 113:19–24. doi: 10.1016/j.nlm.2013.10.012
Maren, S., and Holmes, A. (2016). Stress and fear extinction. Neuropsychopharmacology 41, 58–79. doi: 10.1038/npp.2015.180
Maren, S., Phan, K. L., and Liberzon, I. (2013). The contextual brain: implications for fear conditioning, extinction and psychopathology. Nat. Rev. Neurosci. 14, 417–428. doi: 10.1038/nrn3492
Mattera, A., Pagani, M., and Baldassarre, G. (2020). A computational model integrating multiple phenomena on cued fear conditioning, extinction, and reinstatement. Front. Syst. Neurosci. 14:569108. doi: 10.3389/fnsys.2020.569108
McGaugh, J. L. (2013). Making lasting memories: Remembering the significant. Proc. Natl. Acad. Sci. 110, 10402–10407. doi: 10.1073/pnas.1301209110
McGaugh, J. L. (2015). Consolidating memories. Annu. Rev. Psychol. 66, 1–24. doi: 10.1146/annurev-psych-010814-014954
Miller, D. B., Rassaby, M. M., Wen, Z., and Milad, M. R. (2023). “Pavlovian conditioning and extinction methods for studying the neurobiology of fear learning in ptsd,” in Translational Methods for PTSD Research (Springer), 97–115. doi: 10.1007/978-1-0716-3218-5_5
Morén, C. B. J. (2001). Emotional learning: a computational model of the amygdala. Cybern. Syst. 32, 611–636. doi: 10.1080/01969720118947
Moustafa, A. A., Gilbertson, M. W., Orr, S. P., Herzallah, M. M., Servatius, R. J., and Myers, C. E. (2013). A model of amygdala-hippocampal-prefrontal interaction in fear conditioning and extinction in animals. Brain Cogn. 81, 29–43. doi: 10.1016/j.bandc.2012.10.005
Moustafa, A. A., Myers, C. E., and Gluck, M. A. (2009). A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning. Brain Res. 1276, 180–195. doi: 10.1016/j.brainres.2009.04.020
Okon-Singer, H., Hendler, T., Pessoa, L., and Shackman, A. J. (2015). The neurobiology of emotion-cognition interactions: fundamental questions and strategies for future research. Front. Hum. Neurosci. 9:58. doi: 10.3389/978-2-88919-528-2
Oliva, V., Cartoni, E., Latagliata, E. C., Puglisi-Allegra, S., and Baldassarre, G. (2018). Interplay of prefrontal cortex and amygdala during extinction of drug seeking. Brain Struct. Funct. 223, 1071–1089. doi: 10.1007/s00429-017-1533-9
OReilly, R. C., Bhattacharyya, R., Howard, M. D., and Ketz, N. (2014). Complementary learning systems. Cogn. Sci. 38, 1229–1248. doi: 10.1111/j.1551-6709.2011.01214.x
O'Reilly, R. C., and Norman, K. A. (2002). Hippocampal and neocortical contributions to memory: advances in the complementary learning systems framework. Trends Cogn. Sci. 6, 505–510. doi: 10.1016/S1364-6613(02)02005-3
O'Reilly, R. C., and Rudy, J. W. (2001). Conjunctive representations in learning and memory: principles of cortical and hippocampal function. Psychol. Rev. 108:311. doi: 10.1037//0033-295X.108.2.311
Pape, H.-C., and Pare, D. (2010). Plastic synaptic networks of the amygdala for the acquisition, expression, and extinction of conditioned fear. Physiol. Rev. 90, 419–463. doi: 10.1152/physrev.00037.2009
Pare, D., and Duvarci, S. (2012). Amygdala microcircuits mediating fear expression and extinction. Curr. Opin. Neurobiol. 22, 717–723. doi: 10.1016/j.conb.2012.02.014
Pendyam, S., Bravo-Rivera, C., Burgos-Robles, A., Sotres-Bayon, F., Quirk, G. J., and Nair, S. S. (2013). Fear signaling in the prelimbic-amygdala circuit: a computational modeling and recording study. J. Neurophysiol. 110, 844–861. doi: 10.1152/jn.00961.2012
Pitkänen, A., Stefanacci, L., Farb, C. R., Go, G.-G., Ledoux, J. E., and Amaral, D. G. (1995). Intrinsic connections of the rat amygdaloid complex: projections originating in the lateral nucleus. J. Compar. Neurol. 356, 288–310. doi: 10.1002/cne.903560211
Preston, A. R., and Eichenbaum, H. (2013). Interplay of hippocampus and prefrontal cortex in memory. Curr. Biol. 23, R764-R773. doi: 10.1016/j.cub.2013.05.041
Quirk, G. J., and Mueller, D. (2008). Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology 33, 56–72. doi: 10.1038/sj.npp.1301555
Ramanathan, K. R., Jin, J., Giustino, T. F., Payne, M. R., and Maren, S. (2018). Prefrontal projections to the thalamic nucleus reuniens mediate fear extinction. Nat. Commun. 9, 1–12. doi: 10.1038/s41467-018-06970-z
Rau, V., DeCola, J. P., and Fanselow, M. S. (2005). Stress-induced enhancement of fear learning: an animal model of posttraumatic stress disorder. Neurosci. Biobehav. Rev. 29, 1207–1223. doi: 10.1016/j.neubiorev.2005.04.010
Raudies, F., and Hasselmo, M. E. (2014). A model of hippocampal spiking responses to items during learning of a context-dependent task. Front. Syst. Neurosci. 8:178. doi: 10.3389/fnsys.2014.00178
Rescorla, R. A., and Heth, C. D. (1975). Reinstatement of fear to an extinguished conditioned stimulus. J. Exper. Psychol. 1:88. doi: 10.1037//0097-7403.1.1.88
Rezaei, H., Aertsen, A., Kumar, A., and Valizadeh, A. (2020). Facilitating the propagation of spiking activity in feedforward networks by including feedback. PLoS Comput. Biol. 16:e1008033. doi: 10.1371/journal.pcbi.1008033
Rhomberg, T., Rovira-Esteban, L., Vikór, A., Paradiso, E., Kremser, C., Nagy-Pál, P., et al. (2018). Vasoactive intestinal polypeptide-immunoreactive interneurons within circuits of the mouse basolateral amygdala. J. Neurosci. 38, 6983–7003. doi: 10.1523/JNEUROSCI.2063-17.2018
Romanski, L. M., Clugnet, M.-C., Bordi, F., and LeDoux, J. E. (1993). Somatosensory and auditory convergence in the lateral nucleus of the amygdala. Behav. Neurosci. 107:444. doi: 10.1037//0735-7044.107.3.444
Savander, V., Miettinen, R., Ledoux, J., and Pitkänen, A. (1997). Lateral nucleus of the rat amygdala is reciprocally connected with basal and accessory basal nuclei: a light and electron microscopic study. Neuroscience 77, 767–781. doi: 10.1016/S0306-4522(96)00513-1
Schapiro, A. C., Turk-Browne, N. B., Botvinick, M. M., and Norman, K. A. (2017). Complementary learning systems within the hippocampus: a neural network modelling approach to reconciling episodic memory with statistical learning. Philos. Trans. R. Soc. B 372:20160049. doi: 10.1098/rstb.2016.0049
Sierra-Mercado, D., Padilla-Coreano, N., and Quirk, G. J. (2011). Dissociable roles of prelimbic and infralimbic cortices, ventral hippocampus, and basolateral amygdala in the expression and extinction of conditioned fear. Neuropsychopharmacology 36, 529–538. doi: 10.1038/npp.2010.184
Smith, J. E. (2020). A neuromorphic paradigm for online unsupervised clustering. arXiv preprint arXiv:2005.04170.
Sotres-Bayon, F., Sierra-Mercado, D., Pardilla-Delgado, E., and Quirk, G. J. (2012). Gating of fear in prelimbic cortex by hippocampal and amygdala inputs. Neuron 76, 804–812. doi: 10.1016/j.neuron.2012.09.028
Souza, R. R., Powers, M. B., Rennaker, R. L., McIntyre, C. K., Hays, S. A., and Kilgard, M. P. (2022). Timing of vagus nerve stimulation during fear extinction determines efficacy in a rat model of ptsd. Sci. Rep. 12;16526. doi: 10.1038/s41598-022-20301-9
Sperandeo, M. L. A. (2013). Memória do medo condicionado ao contexto: alterações por inibição da síntese proteica ou por bloqueio de receptores de glutamato do tipo nmda no hipocampo. Doctoral dissertation.
Squire, L. R. (2009). Memory and brain systems: 1969-2009. J. Neurosci. 29, 12711–12716. doi: 10.1523/JNEUROSCI.3575-09.2009
Stefanacci, L., Farb, C. R., Pitkänen, A., Go, G., Ledoux, J. E., and Amaral, D. G. (1992). Projections from the lateral nucleus to the basal nucleus of the amygdala: a light and electron microscopic pha-l study in the rat. J. Compar. Neurol. 323, 586–601. doi: 10.1002/cne.903230411
Taborsky, B., English, S., Fawcett, T. W., Kuijper, B., Leimar, O., McNamara, J. M., et al. (2020). Towards an evolutionary theory of stress responses. Trends Ecol. Evolut. 36, 39–48. doi: 10.1016/j.tree.2020.09.003
Tierney, P. L., Dégenétais, E., Thierry, A.-M., Glowinski, J., and Gioanni, Y. (2004). Influence of the hippocampus on interneurons of the rat prefrontal cortex. Eur. J. Neurosci. 20, 514–524. doi: 10.1111/j.1460-9568.2004.03501.x
Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., et al. (2007). Schemas and memory consolidation. Science 316, 76–82. doi: 10.1126/science.1135935
Turnock, M., and Becker, S. (2008). A neural network model of hippocampal-striatal-prefrontal interactions in contextual conditioning. Brain Res. 1202, 87–98. doi: 10.1016/j.brainres.2007.06.078
Varela, C., Kumar, S., Yang, J., and Wilson, M. A. (2014). Anatomical substrates for direct interactions between hippocampus, medial prefrontal cortex, and the thalamic nucleus reuniens. Brain Struct. Funct. 219, 911–929. doi: 10.1007/s00429-013-0543-5
Vertes, R. P. (2004). Differential projections of the infralimbic and prelimbic cortex in the rat. Synapse 51, 32–58. doi: 10.1002/syn.10279
Vertes, R. P. (2006). Interactions among the medial prefrontal cortex, hippocampus and midline thalamus in emotional and cognitive processing in the rat. Neuroscience 142, 1–20. doi: 10.1016/j.neuroscience.2006.06.027
Vogel, E., Krabbe, S., Gründemann, J., Cusulin, J. I. W., and Lüthi, A. (2016). Projection-specific dynamic regulation of inhibition in amygdala micro-circuits. Neuron 91, 644–651. doi: 10.1016/j.neuron.2016.06.036
Wang, N., Ge, F., Cui, C., Li, Y., Sun, X., Sun, L., et al. (2018). Role of glutamatergic projections from the ventral ca1 to infralimbic cortex in context-induced reinstatement of heroin seeking. Neuropsychopharmacology 43, 1373–1384. doi: 10.1038/npp.2017.279
Wolf, O. T. (2017). Stress and memory retrieval: mechanisms and consequences. Curr. Opin. Behav. Sci. 14, 40–46. doi: 10.1016/j.cobeha.2016.12.001
Wolff, S. B., Gründemann, J., Tovote, P., Krabbe, S., Jacobson, G. A., Müller, C., et al. (2014). Amygdala interneuron subtypes control fear learning through disinhibition. Nature 509, 453–458. doi: 10.1038/nature13258
Keywords: computational modeling, neural architecture, contextual fear conditioning, fear extinction, stress models, stress-enhanced fear learning (SEFL), Immediate Extinction Deficit (IED), biologically plausible models
Citation: Furriel BCRS, Furriel GP, Cunha Xavier Pinto M and Lemos RP (2024) Computational modeling of fear and stress responses: validation using consolidated fear and stress protocols. Front. Syst. Neurosci. 18:1454336. doi: 10.3389/fnsys.2024.1454336
Received: 25 June 2024; Accepted: 26 November 2024;
Published: 24 December 2024.
Edited by:
Jacqueline Rose, Western Washington University, United StatesReviewed by:
David V. C. Brito, University of Algarve, PortugalJulia A. Chester, Purdue University, United States
Copyright © 2024 Furriel, Furriel, Cunha Xavier Pinto and Lemos. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Brunna Carolinne Rocha Silva Furriel, YnJ1bm5hLnNpbHZhJiN4MDAwNDA7aWZnLmVkdS5icg==