Andy Sivils
John Q. Wang
Xiang-Ping Chu- Department of Biomedical Sciences, School of Medicine, University of Missouri-Kansas City, Kansas City, MO, United States
A biological reward system is integral to all animal life and humans are no exception. For millennia individuals have investigated this system and its influences on human behavior. In the modern day, with the US facing an ongoing epidemic of substance use without an effective treatment, these investigations are of paramount importance. It is well known that basal ganglia contribute to rewards and are involved in learning, approach behavior, economic choices, and positive emotions. This review aims to elucidate the physiological role of striatonigrostriatal (SNS) spirals, as part of basal ganglia circuits, in this reward system and their pathophysiological role in perpetuating addiction. Additionally, the main functions of neurotransmitters such as dopamine and glutamate and their receptors in SNS circuits will be summarized. With this information, the claim that SNS spirals are crucial intermediaries in the shift from goal-directed behavior to habitual behavior will be supported, making this circuit a viable target for potential therapeutic intervention in those with substance use disorders.
Introduction
Addiction is defined as a “chronic, relapsing disorder characterized by compulsive drug seeking, continued use despite harmful consequences, and long-lasting changes in the brain” (Goldstein and Volkow, 2011; Koob, 2021; National Institute on Drug Abuse, 2021). Initially, these behaviors of consumption are motivated by the experience of a reward. Clinically, disorder is noted when that consumption continues in the face of negative results with concomitant reductions in the individual’s quality of life (American Psychiatric Association, 2013). In other words, when the reward stops outweighing the objective costs of the action, addiction begins.
According to the Centers for Disease Control and Prevention (CDC), the United States is experiencing a drug overdose epidemic (Centers for Disease Control and Prevention, 2021). A total of 128 people die every day from a drug overdose, and the number of drug overdoses in 2018 was four times the number in 1999 (Centers for Disease Control and Prevention, 2021). Strikingly, drug overdose is now the leading cause of injury-related death (Brooks, 2020). These data underscore the importance for continued research investigating the mechanisms that lead to this deadly disease. In addition to the concern based on the rising number of fatalities, there is not standard therapeutic treatment for addiction that is effective. Project MATCH was a multi-scale clinical trial designed to test a series of hypotheses on how patient-treatment interactions relate to outcomes (Mattson et al., 1993). In the data from Project MATCH, correlations between treatment attendance and outcome were small—accounting for only 3% of the variance (Cutler and Fishbain, 2005). In order to better delineate the mechanisms that underpin the development of addiction, new treatment opportunities are critical for therapeutic discovery, which would address this important issue.
Contemporary neuroscience has made great progress in describing the reward system affected in those with addiction (Lüscher et al., 2020). It is generally accepted that Pavlovian and instrumental learning mechanisms, which are supported by basal ganglia and limbic system neural connections, overpower natural prefrontal inhibition and lead to the reduction in behavioral control observed in patients with addiction (Belin et al., 2009; Koob, 2021). It is thought that the transition from healthy consumption to pathology is facilitated by neural circuitry changes within the basal ganglia network (Alexander et al., 1986), which is organized into parallel cortico-striato-pallido-cortical loops (Alexander and Crutcher, 1990; Everitt and Robbins, 2005; Everitt and Robbins, 2016; Florio et al., 2018). Within this circuitry, the ventral striatum (VS) is pinned as the major interface between emotion, motivation, and action—a major component of the ventral medial striatum (VMS) being the nucleus accumbens (NAc) (Mogenson et al., 1980; Scofield et al., 2016). In fact, all drugs of abuse commonly impact the NAc by mostly increasing its dopaminergic and/or glutamatergic transmission (Chiara and Imperato, 1988; Liu and Kaeser, 2019; Buck et al., 2021). This region is split into a core and shell, and the core is specifically noted to potentiate Pavlovian-instrumental transfer which is the basic mechanism of stimuli associated with reward altering motivational salience and operant behavior (Everitt and Robbins, 2005; Meredith et al., 2008).
If a person experienced a reward and wanted to change their behavior to increase the amount of reward they experienced, there wouldn’t be a problem. Where the issue would, and does, arise is whenever the drive to achieve that reward becomes habitual past the point of rational decision making. Here, there is nuance within the dorsal striatum (DS) (Belin et al., 2009; Redgrave et al., 2010). It is noted that the dorsomedial striatum (DMS) regulates goal-directed processing while the dorsolateral striatum (DLS) regulates habitual control (Belin et al., 2009; Redgrave et al., 2010). These individual subsystems of the striatum facilitate different levels of learning and behavior, with goal-directed behavior eventually turning into habitual control with enough stimulus over time (Belin et al., 2009; Redgrave et al., 2010).
Importantly, dopaminergic transmission within the striato-nigro-striatal (SNS) ascending spirals come from the brainstem to the NAc and reach to the more dorsal regions of the striatum, influencing these shifts from action-outcome to stimulus-response processing (Haber et al., 2000; Belin et al., 2009; Bamford et al., 2018). For example, the successful operation of Pavlovian instrumental transfer has been reported to depend upon the DLS, but not the DMS (Corbit and Janak, 2007; Belin et al., 2009). Without these SNS spirals, evidence suggests that individuals would not be able to transition from goal directed behavior to habitual control like is seen in the common example of driving the same route to work each day (Yin and Knowlton, 2006). Thus, further summary of the anatomy and function of these spirals is worthy of review.
SNS Circuit
The anatomy of the SNS spirals is complicated due to the nature of the brain region they are within, and their connections to different tissues within said region (Haber et al., 2000). That region is the basal ganglia, which had its functions first examined at the beginning of 20th century due to clinical observations of patients with lesions (Redgrave et al., 2010; Lanciego et al., 2012). These investigations eventually led to the classification of the basal ganglia, which includes the DS, VS, globus pallidus, substantia nigra (SN), ventral tegmental area (VTA), and subthalamic nuclei if reciprocally connected regions are accounted for (Packard and Knowlton, 2002). Originally, all these basal ganglia components were considered to function mainly as a way station for motor movement. Information would pass from the cortex, through the basal ganglia, and then back to the cortex to either produce or inhibit actions (Packard and Knowlton, 2002). As the century progressed, the basal ganglia began to be seen as something more than a motor function area. With new neuronal tracing techniques perfected by Nauta and Gygax (1954) and Packard and Knowlton (2002) in the mid-1950s, further specifications within the basal ganglia became apparent.
Research since the 1980s has expanded on this understanding to include a variety of loops that the basal ganglia participate in, many of which are not related to motor function (Lanciego et al., 2012). The basal ganglia loops relevant to this review are the ones that have an influence on goal-directed behavior and transitions to habitual control. Namely, there are three basal ganglia-cortical networks: 1) goal loop, 2) associative loop, and 3) motor loop (Figure 1; Mannella et al., 2016). First, the “goal loop” which is composed of loops involving the ventral basal ganglia (containing the NAc) and the prefrontal cortex (PFC) (Yin and Knowlton, 2006; Baldassarre et al., 2013; Mannella et al., 2016). The second, the “associative loop” which is composed of dorsomedial basal ganglia (containing the DMS) and posterior parietal cortex (PPC) (Yin and Knowlton, 2006; Baldassarre et al., 2013; Fiore et al., 2014; Mannella et al., 2016). The third, the “motor loop” which is composed of the dorsolateral basal ganglia (containing the DLS) and motor cortex (Yin and Knowlton, 2006; Baldassarre et al., 2013; Fiore et al., 2014; Mannella et al., 2016). This basic basal ganglia architecture creates the framework for assessing potential goal values, selecting them, and taking actions to pursue said goals (Belin et al., 2009; Passingham and Wise, 2012; Mannella et al., 2013, 2016; Mannella and Baldassarre, 2015). The question of where stimuli are initially associated with valence is answered in the amygdala complex (AC) (Mannella et al., 2016).
Figure 1. Organization of the Basal Ganglia Loops Involved in Goal-Directed Behavior. The transition of information, via the neurotransmission of relevant anatomical regions, flows from the right to the left and leads to action. Stimuli, creating an internal state of reward, come from the four listed brain regions below (the SNpc, VTA, and BLA/IC). The “goal loop” shows the interaction between the ventral basal ganglia (which contains the NAc) and the prefrontal cortex. The “associative loop” shows the interaction between the dorsomedial basal ganglia (which contains the DMS) and the PPC/PFC. The “motor loop” shows the interaction between the dorsolateral basal ganglia (which contains the DLS) and the motor cortex. BLA, basolateral amygdala; DLS, dorsolateral striatum; DMS, dorsomedial striatum; IC, insular cortex; NAc, nucleus accumbens; PFC, prefrontal cortex; PPC, posterior parietal cortex; SNpc, substantial nigra pars compacta; VTA, ventral tegmental area.
The AC, which includes more than 10 different nuclei, is the main anatomically relevant structure in the representation of stimuli and reward values, and the association of these values with internal body states (Sah et al., 2003; Mannella et al., 2016). Specifically, the basolateral amygdala (BLA) is notable in its contribution to reward processing as evidenced by experimentation assessing instrumental devaluation effects (IDEs) (West et al., 2012; Mannella et al., 2016). IDEs are measured whenever a mouse, or other experimental participant, presses two different levers for two distinct rewards over three phases. In the “instrumental phase” the mouse simply presses the levers and receives the rewards. In the “satiation phase” the mouse is given an excess of one of the rewards. In the crucial third phase, the “devaluation test,” the mouse is again given the two levers, but they are in extinction where no reward is given. IDE is observed when the mouse presses the lever associated with the scarce reward more than the satiated reward during this test (Mannella et al., 2016). IDE is thus a fair assessment for analyzing reward processing and goal-directed behavior.
When the BLA is transiently inactivated during the satiation stage, evidence shows that IDE disappears, but if it is inactivated after the satiation phase IDE remains (West et al., 2012). The gustatory region of the insular cortex (IC) is tightly connected to the BLA, and similarly is suggested to play a role in reward value registration and storage (Parkes and Balleine, 2013). It is currently posited that the BLA is needed for updating incentive values during satiation, and that the IC is needed for storage and retrieval of values during the crucial third phase devaluation test (Parkes and Balleine, 2013; Mannella et al., 2016). Connections between these two regions are not well understood, and thus the regions are referenced as a unit in their role of sending experienced, and then predicted, outcome values to the basal ganglia for goal selection, action, and motivation (Mannella et al., 2016).
The major recipient of these signals is the NAc (Mannella et al., 2016). Specifically, the NAc serves as a bridge for information from the BLA/IC to the ventromedial PFC (vmPFC) (Zahm, 2000). Whenever the NAc is lesioned IDE is prevented, as seen when the BLA/IC are lesioned (Corbit et al., 2001). This situates the basic entrance of reward value and stimuli information into the reward processing network as a simple two-step process from the BLA/IC to the NAc. In addition to that, a parallel network involving dopaminergic transmission from the VTA to the NAc carries information regarding the value of rewards (Mannella et al., 2016). Once that information is in the NAc, it is now within the aforementioned “goal loop.” From here, this portion of the basal ganglia sends signals to the ventral basal ganglia, then to the PFC, where signals are sent to the “associative loop” and reciprocally back to the NAc (Mannella et al., 2016). Importantly, NAc-PFC connections are where goals are differentially activated and action is thus biased (Mannella et al., 2013, 2016). This differential activation is mediated by the representation of internal states and reward values mediated by the BLA/IC-NAc and VTA-NAc connections (Cardinal et al., 2002; Passingham and Wise, 2012; Mannella et al., 2016).
For the selection, comparison, and motivation of goals to take place, the information from the “goal loop” must get to the associated loop, and to the “motor loop,” allowing IDE to take place. As previously mentioned, NAc lesions before or after learning prevent IDE from taking place. Intriguingly, when the prelimbic cortex, which exists within the mPFC and is referred to as prelimbic cortex (PL), is lesioned IDE is only prevented if those lesions take place before learning (Corbit and Balleine, 2003; Ostlund and Balleine, 2008; Tran-Tu-Yen et al., 2009). This suggests that information from the “goal loop” is transferred to motor and associative loops via some other pathway that links the NAc with those respective brain regions. In other words, reward values that need to be stored and processed in order to inform new behavior can be fed into the decision-making system without the participation of the PL, if the PL is present for the initial experience. After that, the information can travel through other neural pathways and behavior can be influenced without participation of the PL. The SNS spirals are excellent candidates for this function (Mannella et al., 2016).
These spirals involve the VMS, the central striatum (CS), the DLS, and the dopaminergic neuronal projections of the VTA and substantia nigra pars compacta (SNpc) (Fudge and Haber, 2000; Haber et al., 2000; Haber, 2003). Each spiral is made of three SN components: a ventral component that receives a specific striatonigral projection but does not contain a reciprocal nigrostriatal projection, a central component that contains nigrostriatal and striatonigral reciprocal projections, and a dorsal component of just a nigrostriatal projection (Fudge and Haber, 2000; Haber et al., 2000; Haber, 2003). Each of these three components exists at each striatal position, within the VMS, CS, and DLS (Fudge and Haber, 2000; Haber et al., 2000; Haber, 2003). Thus, one can imagine a series of nine individual locations. These locations are separated into three groups, with each group containing one recipient area, one receiving and sending area, and one sending area. Information travels from one area to the next through these individual regions, ventral to dorsal and medial to lateral, and constitutes the SNS spiral network (Figure 2; Fudge and Haber, 2000; Haber et al., 2000; Haber, 2003).
Figure 2. Model of the SNS Spirals and the Transmission of Information Within Them. The lower left dopaminergic projections from the VTA synapse in the NAc. NAc neurons then project back to a more dorsal region of the VTA. This pattern repeats in a ventral → dorsal and medial → lateral gradient from lower left to upper right. These spirals are posited to mediate the transition from action-outcome processing of novel stimuli to the habituation processing that occurs with repeated stimuli. DLS, dorsolateral striatum; DMS, dorsomedial striatum; NAc, nucleus accumbens; SN, substantia nigra; VTA, ventral tegmental area.
These SNS spirals are proposed to operate by taking information from the NAc (a major component of the VMS) to the DMS (a major component of the CS) and then to the DLS of the associative and motor loops, respectively (Mannella et al., 2016). These connections interact with the VTA and SNpc, respectively (Mannella et al., 2016). This interface between midbrain areas, like the VTA and SNpc, and striatal areas, like the NAc, DMS, and DLS, encompasses the dopaminergic transmission of these spiral networks (Haber et al., 2000). The overall function of these spirals is suggested to be transferring goal values from the NAc to the DMS and the DLS, importantly without the involvement of the PL. This affords the basal ganglia an intrasystem mechanism for comparing and selecting goals without the involvement of the PL after learning has already taken place. In essence, these spirals are suggested to help the shift from action-outcome based processing of the DMS to stimulus-response based processing of the DLS without prelimbic cortical influence.
Neurotransmitter Systems Related to SNS Spirals
Dopamine
There are five dopamine receptors in the brain, D1–D5, which are categorized into D1-like and D2-like groups (Beaulieu et al., 2014; Misganaw, 2021). The D1-like receptors include D1 and D5, while the D2-like include D2–4 (Beaulieu et al., 2014). Dopamine projections come mainly from the VTA and SN (Beaulieu et al., 2014; Baik, 2020). The mesolimbic dopamine pathway is made up of dopaminergic projections from the VTA to the NAc (Cheron and Kerchove d’Exaerde, 2021). This midbrain to striatal pathway is a centerpiece to drugs of abuse, with virtually every abused drug stimulating dopaminergic transmission from the VTA to the NAc (Chiara and Imperato, 1988; Pontieri et al., 1996; Tanda et al., 1997). Not only that, but it is a component of the SNS spirals (Haber et al., 2000). The NAc shell projects to the VTA and the VTA projects back to the NAc shell and NAc core (NAcc) (Haber et al., 2000; Belin and Everitt, 2008).
These striatal projections to the midbrain are predominantly GABAergic, likely targeting GABA-B receptors (Edwards et al., 2017). In contrast, the VTA interneurons primarily target GABA-A receptors (Edwards et al., 2017). Interestingly, baclofen is a GABA-B receptor agonist that has been shown to reduce cue-associated cocaine craving and use in humans (Vocci and Elkashef, 2005; Young et al., 2014). It is suggested that this mechanism of SNS spiral pharmacologic intervention via GABA-B agonism from the striatum to the midbrain is what accounts for the observed therapeutic benefits (Edwards et al., 2017).
95% of the striatum’s projecting neurons are medium spiny neurons (MSNs) which are either D1 or D2 based on their genetic expression (Gerfen and Surmeier, 2011). More than just a large population, evidence shows that goal-direct learning differentially increases the activity of direct pathway D1 MSNs in IDE experiments (Shan et al., 2014). These changes were observed specifically in the DMS (Shan et al., 2014). The indirect pathway D2 MSNs did not experience that same increase in activity with the goal-directed behavior (Shan et al., 2014). Further inquiry into changes in synaptic plasticity, as measured by AMPA/NMDA ratio, showed sharp contrast between the increased ratio found in D1 MSNs in the DMS and the reduced ratio in D1 MSNs in the DLS (Shan et al., 2014). While these findings emphasize dopamine’s role in the striatum, particularly when it comes to goal-directed learning, recent research has delineated the influence of dopamine transmission on reward prediction error (RPE) (Lerner et al., 2021).
RPE is the error, or difference, in experienced vs. expected reward that an animal receives after a certain behavior and it was first hypothesized to be facilitated by dopaminergic transmission in 1997 (Schultz et al., 1997). Recent experiments utilizing optogenetic inhibition of VTA dopamine neurons revealed that these neurons encode the RPE alone, not the actual prediction itself (Maes et al., 2020). Interestingly, investigation into the mechanism with which dopaminergic neurons in the midbrain store RPE suggests that a distributional approach is taken (Dabney et al., 2020). In other words, rather than having each neuron register the same mean RPE, individual neurons will have variously pessimistic and optimistic RPEs for the brain to capture the full probability distribution to assist the learning process (Dabney et al., 2020). Other research suggests that the relative and total values, the predictions themselves, are maintained in the mPFC projections to the DMS, which coincides with other findings regarding the involvement of the DMS in goal-directed behavior (Bari et al., 2019).
Further underscoring the influence of dopamine in SNS spirals, disconnecting the NAcc from the DLS via the unilateral and bilateral blockade of dopamine receptors decreased cocaine-seeking behavior in rats (Vanderschuren et al., 2005; Belin and Everitt, 2008). One way the brain maintains motivation for rewards is the utilization of dopamine “ramps” (Lerner et al., 2021). These dopamine ramps consist of increased dopamine activity as an animal approaches their reward, serving to motivate the behavior even further (Lerner et al., 2021). The phenomenon has been observed in the VTA, ventral striatum, and DMS with the majority occurring during instrumental rather than Pavlovian tasks (Kim et al., 2020; Lerner et al., 2021). Not surprisingly, evidence shows relatively less ramping activity in the DLS, which has been shown to be more closely related to habitual rather than goal-directed behavior (Howe et al., 2013; Seiler et al., 2020).
All these findings together place dopamine firmly in the center of the striatal and midbrain connections involved in SNS spirals which relate to goal-directed behavior. Dopamine is the neurotransmitter with which the midbrain modulates the striatum within this circuit (Volkow and Morales, 2015). However, many other neuron types exist within or affect the striatum, including glutamate, gamma-aminobutyric acid (GABA), acetylcholine (ACh), serotonin, cannabinoid, protons, and others (Pettibone et al., 1978; Volkow and Morales, 2015). These other neurotransmitter systems play roles in the many functions of the striatum, one of which is the mediation of motor movement (Packard and Knowlton, 2002). The two most notable circuits related to this function are the direct and indirect motor pathways (Figure 3; Purves and Williams, 2001).
Figure 3. Visualization of the Indirect and Direct Motor Pathways. This diagram shows both the indirect and direct motor pathways, with the indirect motor pathways on top and the direct motor pathway below. The green arrows represent excitatory glutamate transmission, and the red lines represent inhibitory GABA transmission. The net effect of the indirect path is inhibition, while the net effect of the direct pathway is excitation. The striatum thus plays an important role in motor movement as well as decision making.
Glutamate and Gamma-Aminobutyric Acid
These two pathways are born out of medium spiny projection neurons from the striatum and are purported to have opposing effects on movement (Cui et al., 2013; Wang et al., 2015). Glutamate and GABA are the main excitatory and inhibitory neurotransmitters in the brain, respectively (Nahar et al., 2021; Niedzielska-Andres et al., 2021). The direct pathway’s striatal neurons receive excitatory glutamate transmission from the cortex, then send inhibitory GABAergic transmission to the globus pallidus internal segment (Knierim, 2020). That segment then sends inhibitory GABAergic transmission to the thalamus, which finally sends excitatory glutamatergic transmission back to the cerebral cortex (Knierim, 2020). The net effect of the direct pathway is disinhibition, or excitation, of movement via glutamate and GABA.
The indirect pathway similarly begins with excitatory glutamate transmission from the cerebral cortex via glutamate to the striatum, which then transmits inhibitory GABAergic transmission to the globus pallidus external segment (Knierim, 2020). Here, the external segment sends inhibitory GABAergic transmission to the subthalamic nuclei which themselves send excitatory glutamatergic transmission to the globus pallidus internal segment (Knierim, 2020). Finally, the internal segment similarly sends inhibitory GABAergic transmission to the thalamus, which transmits glutamatergic excitatory signals to the cerebral cortex (Knierim, 2020). The net effect of the indirect pathway is inhibition, via glutamate and GABA transmission.
These two pathways together facilitate motor learning, and this portion of their activity is most relevant to this review. In order to propagate a specific motor routine, the direct pathway must be increased while the indirect pathway has to be suppressed (Purves and Williams, 2001; Reiner et al., 2010). Driving to a new job would occur with concomitant direct pathway activation, and indirect pathway suppression. Where that drive to work becomes habitual, allowing the driver to zone out on the way home from a long day, is where the SNS spirals and dopaminergic transmission likely make an impact (Reiner et al., 2010).
A substantial collection of evidence supports the conclusion that dopamine signals interact with these motor systems to reward specific actions, like driving the correct route and successfully making it to work on time. Thus, this sculpts the striatal neurons during motor movement (Satoh et al., 2003; Graybiel, 2005; Reiner et al., 2010). In fact, dopamine receptor type one (D1) dependent long-term potentiation (LTP) has been demonstrated in direct pathway neurons, further supporting the idea that dopamine transmission interacts with glutamate and GABA transmission in the reward-based learning of behaviors (Kreitzer and Malenka, 2008; Shen et al., 2008; Reiner et al., 2010).
Outside of motor involvement, evidence suggests that GABA and other neurotransmitters have demonstrable influences within the striatonigral and nigrostriatal systems. Research involving the injection of kainic acid, a substance that is neurotoxic to striatal cholinergic and GABAergic nerves while leaving nigrostriatal dopaminergic nerve projections intact, reduces feeding and drinking in mice (Schwarcz and Coyle, 1977; Pettibone et al., 1978). This suggests that ACh and GABA neurons have an influence on behavior outside of dopaminergic signals (Schwarcz and Coyle, 1977; Pettibone et al., 1978). More recent evidence shows that these GABAergic MSNs modulate the midbrain neurons within the SNS circuit, influencing behavior (Yager et al., 2018; Yang et al., 2018). This provides the next phase of the SNS spiral after having been affected by the dopaminergic midbrain projections.
Acetylcholine
The striatum is one of the most ACh dense regions of the brain (Izzo and Bolam, 1988). Striatal ACh is predominantly from intrastriatal cholinergic interneurons (ChIN), but there are two external sources in the pedunculopontine and laterodorsal tegmental nuclei (Dautan et al., 2014; Abudukeyoumu et al., 2018; Lindroos and Kotaleski, 2020). These ChINs synapse onto the MSNs of the indirect and direct pathways (Abudukeyoumu et al., 2018). Input from these neurons is neuromodulatory in nature, often working in tandem with the modulatory dopamine transmission (Lindroos and Kotaleski, 2020). Fast scan voltammetry showed that simultaneous activation of ChINs led to an increase in striatal dopamine release (Cachope and Cheer, 2014). Additionally, endogenous release of ACh has been observed to directly increase striatal dopamine release (Cachope et al., 2012). Functionally, this interneuron ACh transmission has been posited as a switch between two modes of dopamine transmission, its action as learning stimulus and as a motivational cue (Berke, 2018). In regard to motor activity, both ACh and dopamine are necessary for the induction of locomotion (Zucca et al., 2018).
The striatum itself was discovered to contain two complementary chemical compartments with unique genetic expression, striosomes and the surrounding matrix (Graybiel and Ragsdale, 1978; Herkenham and Pert, 1981; Graybiel and Hickey, 1982; Crittenden and Graybiel, 2011). The striosomes were shown to have reduced cholinesterase activity in adult humans, rhesus monkeys, and cats (Graybiel and Ragsdale, 1978; Crittenden and Graybiel, 2011). These acetylcholinesterase-poor striosomes were found to have over 40 different enriched genes, including being enkephalin-rich, while the matrix regions were found to have over 20 different uniquely enriched genes (Graybiel and Hickey, 1982; Crittenden and Graybiel, 2011). These genetic differences have clinical correlates in disease, where the striosome to matrix ratio of immediate early gene (IEG) induction increases in cocaine and psychomotor stimulant addiction in monkeys and rats, respectively (Hurd and Herkenham, 1993; Moratalla et al., 1996; Crittenden and Graybiel, 2011). Importantly, evidence suggests that striosomes contain the only striatal neurons that project to the SNpc, underpinning their involvement in SNS spirals (Gerfen, 1984; Jiménez-Castellanos and Graybiel, 1989; Tokuno et al., 2002; Crittenden and Graybiel, 2011; Fujiyama et al., 2011). Thus, ACh plays an important role in modulating striatal neurons as they participate in the greater SNS circuit.
Opioids
Related to the acetylcholinesterase-poor quality of striosomes is their enkephalin-rich quality, and the role of opioids in the striatum in general. While glutamate and GABA are the principal molecules of the motor pathways, with dopamine involved in the learning component of motor activity, endogenous opioids are paired co-transmitters in the respective direct and indirect pathway (Steiner and Gerfen, 1998; Hearing, 2019; Koob, 2020). Specifically, D1 receptor expressing cells of the direct pathway express dynorphin while D2 expressing cells of the indirect pathway express enkephalin (Steiner and Gerfen, 1998). Interestingly, neurons that express both substance P and enkephalin have been found in the striatum, with a higher proportion in the striosome regions (Besson et al., 1990; Wang et al., 2007). Following suit with the impression that SNS spirals are significant, co-expression of substance P and enkephalin are found in the SNpc, but not in the substantial nigra pars reticulata (SNr), globus pallidus internus (GPi), or globes pallidus externes (GPe) (Wang et al., 2006). This insinuates that a unique set of D1 and D2 expressing neurons exist in the striatum, and that a unique set of opioid expressing neurons are evident in the SNpc projection component of the SNS spirals. Recent evidence examining opioid expressing neurons in the SNS circuit found that roughly 50% of GABA neurons in the SNr have μ-opioid receptors (MORs) which, when activated, lead to the disinhibition of SNpc DA neurons and the processing of reward with drugs like heroin (Galaj and Xi, 2021). However, because the opioid and dopamine receptors are subject to expression change based on the experience of the being, further investigation is needed to examine this possibility (Steiner and Gerfen, 1998; Crittenden and Graybiel, 2011; Hearing, 2019).
Serotonin
Another neurotransmitter system which plays an important role in the striatum is serotonin (5-HT) (Bonsi et al., 2007; Robbins et al., 2019; Tong et al., 2020). Patients with Parkinson’s disease have shown proportional decreases in 5-HT transmission to the decrease in dopamine transmission, insinuating an involvement in the motor and affective activity (Sandyk and Fisher, 1988; Halliday et al., 1990). In addition, the use of selective serotonin reuptake inhibitors (SSRIs), namely for the treatment of depression, has been associated with movement symptoms like tremor, parkinsonism, and dystonia (Leo, 1996; Caley, 1997). Interestingly, serotonergic transmission is excitatory to the ChINs (Bianchi et al., 1989; Bonsi et al., 2007). This relationship between serotonin and ACh, paired with ACh density in striosomes that are involved in SNS spirals, sheds light on a potential relationship with yet another neurotransmitter system and the striatonigrostriatal pathways.
Cannabinoids
Cannabinoid receptors play a significant role in the striatal system (Piomelli et al., 1999). In fact, there are twice as many cannabinoid receptors as D1 dopamine receptors and 12 times as many MORs in the striatum (Herkenham et al., 1991; Sim et al., 1996; Piomelli et al., 1999). Due to their interactions with the motor system, various cannabinoids like cannabidiol (CBD) have been shown to reduce seizure frequency in those with refractory epileptic encephalopathies (Morano et al., 2020). Outside of their influence on motor activity, cannabinoids have been shown to influence learning, habit formation, and addiction as well (Lovinger et al., 2010; Hoffman and Lupica, 2012; Davis et al., 2018). Functionally, endocannabinoids signal retrogradely via suppression of synaptic transmission through presynaptic G-protein coupled receptors (GPCR) like the cannabinoid-1 receptor (CB1-R) (Davis et al., 2018).
Within the striatal circuitry, these CB1-Rs modify dopamine signaling (Covey et al., 2017; Mateo et al., 2017; Davis et al., 2018). Interestingly, these receptors are found in a density gradient from least, ventromedial, to most, dorsolateral (Julian et al., 2003; Waes et al., 2012; Davis et al., 2018). This neuroanatomical layout matches data regarding CB1-Rs and their influence on behavior, specifically regarding transitions from goal-directed to habitual behavior (Yin et al., 2004; Hilário, 2007; Davis et al., 2018). Strikingly, this evidence is paired with further findings that show enrichments of CB1-Rs in striosome compartments within the striatum (Herkenham et al., 1991; Julian et al., 2003; Martín et al., 2007; Lovinger et al., 2010; Davis et al., 2018). Together, these data suggest that CB1-Rs play an important role in the SNS circuit via their influence on dopamine signaling (Guegan et al., 2015). These studies suggest that endogenous cannabinoids play a significant role within the striatum, within the transition to habitual behavior from goal-directed processing and are again found at higher densities in striosomal pockets like that of ACh.
Proton
Recently, protons have been identified as a neurotransmitter in the brain (Du et al., 2014). After their release during neurotransmission, protons (e.g., pH drops) bind to their postsynaptic receptors named acid-sensing ion channels (ASICs) (Waldmann et al., 1997; Krishtal, 2015; Gobetto et al., 2021; Rook et al., 2021). These receptors are derived from the greater degenerin/epithelial sodium ion channel family, which mediate sodium influx across membranes in a voltage-insensitive manner largely responsible for neurological and psychological functions (Waldmann et al., 1997; Gründer and Pusch, 2015; Cheng et al., 2018; Vullo and Kellenberger, 2020). The ASIC1a, ASIC2a, and ASIC2b subtypes are found predominantly in the brain, with the ASIC1a subtype being the most densely populated in the striatum (Biagini et al., 2001; Alvarez de la Rosa et al., 2003; Wemmie et al., 2003; Jiang et al., 2009; Suman et al., 2010; Price et al., 2014; Krishtal, 2015).
Studies from our laboratory demonstrated that ASIC1a receptors were up-regulated in the mouse striatum but not in the mPFC in response to repeated cocaine exposure (Zhang et al., 2009). We also found similar results using amphetamine rather than cocaine in rats. The ASIC1a receptors were up-regulated after chronic amphetamine exposure in the rat striatum but not in the mPFC (Suman et al., 2010). The data also showed a reduction of ASIC2 expression in the mPFC (Suman et al., 2010). Further, we examined the behavior changes by repeated cocaine administration in ASIC1a and ASIC2 knockout (KO) mice. Behavioral sensitization to cocaine was seen in wild-type (WT) and ASIC1a KO mice, but not in ASIC2 KO mice (Jiang et al., 2013). Additionally, in ASIC1a KO mice, cocaine induced significantly fewer motor responses at varying doses compared to WT and ASIC2 KO mice (Jiang et al., 2013). Studies from other laboratories also revealed that ASIC1a in the amygdala and NAc contributes to cocaine addiction (Kreple et al., 2014; Gutman et al., 2020). Further examination of densities of these receptors in striosomes could provide more insight into their function. Together, these observations suggest that ASIC receptors help facilitate the process of reward and have an important relationship with the striatal architecture reviewed here.
The involvement of dopamine, glutamate, GABA, ACh, dynorphin, enkephalin, serotonin, cannabinoids, and protons in the striatal system alludes to the complex nature of the striatum and the SNS spirals themselves. An in-depth review of each one of these neurotransmitter systems and their impact on the reciprocal connections of the midbrain and striatum would be valuable additions to scientific literature. In the case of this review, a surface-level inquiry into each is sufficient to emphasize the point that SNS spirals are playing an elaborate role in the motor, goal-oriented, and habitual behavior mediated by the SNS network.
Striato-Nigro-Striatal Spirals and Addiction
As mentioned earlier, drugs of abuse facilitate dopaminergic transmission from the VTA to the NAc (Chiara and Imperato, 1988). The NAc then participates in the SNS spirals where information is transferred from the goal loop, to the associative loop, and then to the motor loop. Specifically, neurological activity during goal-directed behavior pairs with activity in the DMS, while habitual behavior pairs with activity in the DLS (Belin et al., 2009; Redgrave et al., 2010). This process of transfer from goal to habit vaguely mirrors the experience of a first-time reward becoming an inherent desire, like trying your favorite ice cream for the first-time and eventually having that flavor come to mind every time you think of ice cream. But this isn’t specific to addiction, and instead is an essential component of human life.
Further underlying this tenant that the DLS facilitates habitual behavior, and the DMS facilitates goal-directed behavior, is the fact that goal-directed behavior is retained after lesions to the DLS (Yin, 2004; Yin et al., 2004; Yin and Knowlton, 2006; Rossi and Yin, 2012; Lipton et al., 2019). Expectedly, lesions to the DMS lead to the early formation of habitual behavior considering the DLS is preserved (Yin et al., 2005; Yin and Knowlton, 2006; Lipton et al., 2019). These foundational findings inspired more investigation, leading to the observation of unique patterns of activity in the DLS (Lipton et al., 2019). Researchers found that a mouse running a maze will have a high level of neural activity in the striatum the first time, but over multiple attempts activity in the brain, specifically in the DLS, begins to maximize at the beginning and end of runs (Jog, 1999; Barnes et al., 2005; Thorn et al., 2010; Smith and Graybiel, 2013; Graybiel and Grafton, 2015). Activity during the run decreases, sometimes reaching levels even lower than pre-run baselines (Lovinger et al., 2010). Experiments have also observed this phenomenon in lever-pressing tasks and in macaque monkeys during well-learned motor skills (Fujii, 2003; Jin and Costa, 2010; Martiros et al., 2018). This is termed task-bracketing.
The mechanism of how the SNS circuit relates to task-bracketing is an important open question. One group examined this observed striatal firing pattern and aimed to distinguish it from motor cortex firing patterns that may have explained the striatal activity (Martiros et al., 2018). Their findings showed that striatal projecting neurons and fast spiking interneurons (FSI) in the DLS have unique activity compared to the motor cortex, and are key to habitual behaviors (Martiros et al., 2018). These interneurons are the same GABAergic interneurons within the SNS circuit that mediate transitions of information within the striatum (Haber et al., 2000). Another study used chemogenetic inhibition of these FSI and found that disruption of their activity reduced the ability to express habitual behavior (Ohare et al., 2017). The authors clarified that these interneurons are important because of their specific influence on striatal output properties and their long-lasting changes in excitability following habituation (Ohare et al., 2017). Findings in Martiros et al. (2018) and Cunningham et al. (2021) distinguished this task-bracketing from the actual reward processing of correct lever presses and suggested instead that this firing pattern in the DLS is a neuronal representation of successful past behaviors. This theoretical framework aligns with previous statements regarding the SNS circuit’s role in shifting activity from goal-directed behavior to habitual behavior with past actions as reference points.
The question then arises, if the task-bracketing activity pattern in the DLS represents past actions with their paired outcomes, how is the SNS circuit posited to facilitate the transfer from NAc to DLS activity. One study examined this directly using reversible neurotransmission blockade (RNB) of D1 or D2 MSNs in the NAc, DMS, and DLS via tetanus neurotoxin in mice (Macpherson and Hikida, 2018). They found that NAc D1 RNB mice had reduced Pavlovian approaches to conditioned stimuli, while NAc D2 RNB, DMS, and DLS RNB mice did not (Macpherson and Hikida, 2018). Specifically, the authors stated, “blockade of neurotransmission in NAc D1 MSNs appears to reduce the transference of incentive salience from the liquid reward to the conditioned stimulus.” These data support the position that early in the SNS circuit, midbrain projections to DA MSNs in the NAc must be activated for incentive salience to be transferred to conditioned stimuli (Macpherson and Hikida, 2018). One could then hypothesize that SNS spirals are necessary pieces of the neural framework which allows for conditioning, and eventually habituation (Flagel et al., 2010; Peak et al., 2018; Lipton et al., 2019). With NAc activation, NAc reciprocal projections to the VTA and SNpc modulate neurons which project to the more dorsal striatum (Haber et al., 2000; Mannella et al., 2016). Thus, the continuous activation of VTA and SNpc DA neurons, via the SNS circuit, help to facilitate habituation which at least in part is represented by DLS task-bracketing activity (Mannella et al., 2016; Martiros et al., 2018; Cunningham et al., 2021).
A notable contrast to the task-bracketing observed in the DLS is the almost exactly opposite pattern evident in the DMS (Julian et al., 2003). Here, neural activity is enhanced during the middle of an action in comparison to the beginning and end, especially during novel activities (Yin et al., 2009; Thorn et al., 2010; Gremel and Costa, 2013; Martiros et al., 2018; Lipton et al., 2019). Overtime, as the task-bracketing of the DLS occurs, this DMS phenomenon fades away (Yin et al., 2009; Gremel and Costa, 2013; Martiros et al., 2018; Lipton et al., 2019). Viewing these neural activation schemes as mutually exclusive isn’t entirely accurate. More evidence suggests that these two firing patterns either cooperate or compete with one another for dominance over behavior (Daw et al., 2005; Yin and Knowlton, 2006; Bradfield and Balleine, 2013; Gremel and Costa, 2013; Kupferschmidt et al., 2017; Robbins and Costa, 2017; Lipton et al., 2019). When the DLS is intentionally inactivated after habitual behavior has been established, goal-directed behavior is reestablished (Yin and Knowlton, 2006). This can be utilized in some sense to improve learning in early training via optogenetic silencing or DLS lesions (Bradfield and Balleine, 2013; Bergstrom et al., 2018). These experimental observations further underscore the importance of this transition from goal-directed to habitual behavior.
Studies specific to addiction have substantiated these conclusions (Corbit, 2018; Lipton et al., 2019). This path of goal directed DMS activity to habitual DLS activity continues to show up in experimentation. In the beginning of consumption, drug-seeking is found to be goal-directed and mediated by the DMS amongst a larger network (Corbit et al., 2012; Murray et al., 2014; Lipton et al., 2019). Intriguingly, inactivation of the DLS in cocaine addicted rats discontinues punishment-resistant seeking of drug-predicting cues (Jonkman et al., 2012; Lipton et al., 2019). Additionally, rats that are trained to press levers for a cocaine reward will minimize their lever pressing following dopamine antagonists in the DMS during the beginning of the learning process, or in the DLS during the over-training component of the experiment (Vanderschuren et al., 2005; Murray et al., 2012; Lipton et al., 2019). This same experiment modality was replicated with lidocaine induced DLS inactivation (Zapata et al., 2010; Lipton et al., 2019). Alcohol was also found to disinhibit the spiny projection neurons in the DLS, which could serve as a conduit for the transfer from goal-directed to habitual use (Wilcox et al., 2013; Patton et al., 2015; Lipton et al., 2019). Additionally, DLS activity has been found to be imperative for habitual heroin seeking in rats (Hodebourg et al., 2019; Lipton et al., 2019). In total, there is sufficient evidence to defend the claim that addiction is built on neural circuitry that involves a transfer of activity from the DMS to the DLS.
If this DLS-mediated habitual behavior was extinguishable with ease, addiction might not be the problem it is today. However, even in devaluation experiments which can make the reward essentially unpalatable, there are no observed changes to the task-bracketing activity in the DLS (Smith and Graybiel, 2013; Graybiel and Grafton, 2015). In order to remove this task-bracketing activity in the DLS, the reward would have to be entirely removed, and even then, when it is reintroduced or cues are presented, the same activity resumes (Graybiel and Grafton, 2015). Projections to the striatum are not solely responsible for this formidable DLS activity, the intrastriatal SNS components play an active role as well. These connections, components of the SNS spirals like the previously mentioned ChINs and related striosomes, are integral (Smith and Graybiel, 2013; Atallah et al., 2014; Graybiel and Grafton, 2015). All together, these findings suggest that some neural circuits, likely including SNS spirals, facilitate this transfer from goal-directed to habitual processing and sustain it over time.
Though these striatal changes in activity that take place during habituation are significant, concomitant changes in SN and VTA neurons in addiction must also be observed. The substantia nigra pars reticulata (SNpr) has GABAergic neurons which form reciprocal connections with SNpc DA neurons (Galaj and Xi, 2021). A recent study found that roughly 50% of GABA neurons in this region have MORs which, when activated, lead to the disinhibition of SNpc DA neurons and the processing of reward with drugs like heroin (Galaj and Xi, 2021). Optogenetic stimulation of these SNr neurons, or of the SNpc DA neurons directly, leads to rewarding effects (Galaj et al., 2020). Interestingly, high frequency deep brain stimulation (DBS) of the SNpr of rats blocked drug-primed reinstatement and manifested the extinction of methamphetamine-induced conditioned place preference (CPP) (Zhang et al., 2021). DBS, however, did not reduce the rewarding effects of methamphetamine administration (Zhang et al., 2021). The authors suggested that the DBS promoted extinction and prevented drug-primed reinstatement via induction of LTP within the SNpr that decreased activity in the dorsal striatum (Zhang et al., 2021). Zhang et al. (2021) go on to say “thus, modulating the activity of SNpr may regulate addiction by affecting striatum activity.” These data correspond with the previous point that the DLS is a center point of habituation, and earlier portions of the SNS circuit are involved in the preceding goal-directed reward processing (Lipton et al., 2019).
Another recent study showed that optogenetic stimulation of SNpc DA neurons produced real-time place preference and optical intracranial self-administration (iOCSS) in TH-cre and DAT-cre mice at similar levels as VTA DA neurons (Galaj et al., 2020; Galaj and Xi, 2021). In fact, inhibition of SNpc DA neurons or VTA DA neurons can induce aversion (Ilango et al., 2014; Galaj et al., 2020). Interestingly, even the removal of aversive stimuli leads to very different SNpc activity depending on whether these changes occur during learning or habituation (Diao et al., 2021). VTA DA neurons have been found to increase their firing rate following chronic morphine treatment (Simmons et al., 2019). Cocaine administration increases the AMPA/NMDA ratio in VTA DA neurons that project to either the NAc core or shell but not in those VTA DA neurons projecting to the PFC (Lammel et al., 2011). These data show the importance of midbrain DA neurons projecting to the striatum, and the changes that occur during the pathology of addiction. Integration of these two midbrain regions in addiction is posited to take place via dendrodentritic DA connections, activity in the rostromedial tegmental nucleus, or via activity in the striatum (Galaj and Xi, 2021). It is this review’s position that the striatum is the most influential of the three.
To underscore that position, further evidence suggests that changes in striatal neurons coincide with these relevant midbrain changes. Decreasing activity of direct pathway GABAergic MSNs reduced drug-seeking in a high-risk mouse phenotype during cue-induced reinstatement, without altering behavior in a low-risk phenotype (Yager et al., 2018). Optogenetic stimulation of terminals in the VTA which came from the lateral shell of the NAc successfully induced a potent reward response, which the authors attribute to disinhibition via these striatal neurons (Yang et al., 2018). With even one use of morphine, CB1-R KO mice had increased total dendritic spine density in the NAc shell and core suggesting both a regulatory role for CB1-R and distinguished striatal MSN changes with substance abuse (Guegan et al., 2015). More than just one exposure, repeated administration of morphine to establish CPP is prevented by the downregulation or antagonism of D1 dopamine receptor containing MSNs in the NAc and is perpetuated with agonism (Hearing et al., 2016; Kobrin et al., 2017; Thompson et al., 2021). There are even notable differences in how NAc MSNs are modified by cocaine and opioid use and their respective withdrawals (Graziane et al., 2016). Importantly, NAc MSNs are modified in both cases. Again, these data show that these neurons, which project to the midbrain, are changed in the pathology of addiction. This further situates the SNS circuit as a major pathway in the pathology of addiction.
Discussion
This review sought to examine the neurobiology of SNS spirals and their relation to addiction. The anatomy and function of the basal ganglia which itself contains these spirals, other neurotransmitter systems’ interaction with these spirals, and specific experimental findings related to addiction were explored. Together, these pieces of evidence support the claim that SNS spirals are central to the transition from goal-directed to habitual behavior. A clinically relevant example is the transition from substance use to addiction.
In a very basic analogy, it was found that the dopaminergic transmission of reward can be likened to the money made by a company. The chief executive officer (CEO), or the PFC, is happy to make as much money as possible considering that is their responsibility to the company. Certain behaviors, like being socially accepted or rejected, can reduce or increase the amount of dopamine transmitted and money made. Through the factories of deeper brain components like the VTA, SNpc, and BLA/IC, these reward signals are profitably produced. Middle managers in the striatum receive information regarding the productivity of the various factories within the company, and associate values with specific behaviors. The CEO then receives a summary revenue report via projections from the striatum to the PFC.
Overtime, well-intentioned hard working middle managers decide that the CEO need not be bothered with information regarding well known profitable tasks. So, they take matters into their own hands and reduce the workload for their boss by utilizing SNS spirals. They transfer activity from the NAc and DMS centric domain to the DLS centric domain using the SNS spirals. Unknown to the middle managers and factories of the deeper brain networks, those previously fruitful actions land the CEO in hot water in the world of human affairs. With a new desire to avoid punishment, the CEO calls the middle managers and explains a discontinuation of the old money-making strategies. However, due to the determined work ethic of his trusted employees, his orders are not followed. After all, the middle managers ask themselves, how could we possibly stop our most profitable revenue stream after some seemingly mild resistance? Thus, the DLS task-bracketing remains formidable, even following executively mandated abstinence, and is at the ready following the proper cues. This can persist to such a degree that the CEO is eventually left out of company decisions altogether, and a coup d’état of sorts via SNS spirals leads to the deeper brain networks running the company. The harrowing struggles of addiction may surface, but a determined and mislead vision of metaphoric wealth will drive the reorganized institution into the ground one dopamine burst at a time (Figure 4).
Figure 4. The left of the model shows anatomic labels. The “CEO” of the prefrontal cortex (PFC), the “middle managers” of the striatum, and the “factories” of the midbrain. In normal physiology, dopaminergic projections from the midbrain make their way to the striatum (represented by a thin black arrow). Further striatal activity facilitates this information getting to the PFC. Activity then flows back, and a general processing of rewards takes place. With novel substance use, a much larger dopaminergic transmission (represented by a thicker black arrow in the center column) flows to the striatum; the company makes more money than usual. The middle managers (in the striatum) are informed of the increase in profit from their factories. The PFC again is influenced by this transmission, the CEO learns of this new profitable venture, and a person experiences it. With repeated substance use, habituation takes place, the SNS spirals shift from ventral to dorsal and from medial to lateral utilizing the NAc, DMS, and then the DLS. The middle managers believe that this profitable venture is what’s best for the company regardless of the CEO’s protestations and decide to manage the factories on their own. CEO, chief executive officer; DLS, dorsolateral striatum; DMS, dorsomedial striatum; NAc, nucleus accumbens; PFC, prefrontal cortex; The first businessman icon was downloaded from Flaticon, the second businessman icon was created by Mundo from Noun Project.
While this analogy is incomplete and inaccurate at certain levels of detail, the general principle is sound. The PFC and the person who suffers from the disease of addiction lose much of their ability to choose to engage in the increasingly harmful behavior. It is the duty of science, and of humanity, to reduce those suffering by making use of the evidence we find. Therefore, therapeutic efforts targeted at these spirals and their facilitation of habituation should be sought. In fact, some researchers have already made use of contemporary technology like DBS to depotentiate excitatory synaptic inputs on dopamine D1 receptors, which mimics the practice of optogenetic metabotropic glutamate receptor-dependent normalization of synaptic transmission (Creed et al., 2015; Lüscher et al., 2015). While this won’t be sufficient to treat the pandemic facing the US and other parts of the world, a resilient and compassionate effort can be founded on this information.
Author Contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work, and approved it for publication.
Funding
The work was supported by grant from American Heart Association (19AIREA34470007) to X-PC.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We thank Thea Voutritisas for her help in the figure design in this manuscript. We also thank BioRender.com for the use of their software in the creation of all figures in the manuscript.
References
Abudukeyoumu, N., Hernandez-Flores, T., Garcia-Munoz, M., and Arbuthnott, G. W. (2018). Cholinergic modulation of striatal microcircuits. Eur. J. Neurosci. 49, 604–622. doi: 10.1111/ejn.13949
Alexander, G. E., and Crutcher, M. D. (1990). Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trend Neurosci. 13, 266–271. doi: 10.1016/0166-2236(90)90107-l
Alexander, G. E., DeLong, M. R., and Strick, P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu. Rev. Neurosci. 9, 357–381. doi: 10.1146/annurev.ne.09.030186.002041
Alvarez de la Rosa, D., Krueger, S. R., Kolar, A., Shao, D., Fitzsimonds, R. M., and Canessa, C. M. (2003). Distribution, subcellular localization and ontogeny of ASIC1 in the mammalian central nervous system. J. Physiol. 546, 77–87. doi: 10.1113/jphysiol.2002.030692
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders: DSM-5. Arlington, VA: American Psychiatric Press.
Atallah, H., Mccool, A., Howe, M., and Graybiel, A. (2014). Neurons in the ventral striatum exhibit cell-type-specific representations of outcome during learning. Neuron 82, 1145–1156. doi: 10.1016/j.neuron.2014.04.021
Baik, J. (2020). Stress and the dopaminergic reward system. Exp. Mol. Med. 52, 1879–1890. doi: 10.1038/s12276-020-00532-4
Baldassarre, G., Mannella, F., Fiore, V. G., Redgrave, P., Gurney, K., and Mirolli, M. (2013). Intrinsically motivated action–outcome learning and goal-based action recall: a system-level bio-constrained computational model. Neural Netw. 41, 168–187. doi: 10.1016/j.neunet.2012.09.015
Bamford, N. S., Wightman, R. M., and Sulzer, D. (2018). Dopamine’s effects on corticostriatal synapses during reward-based behaviors. Neuron 97, 494–510. doi: 10.1016/j.neuron.2018.01.006
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., and Cohen, J. Y. (2019). Stable representations of decision variables for flexible behavior. Neuron 103, 922.e7–933.e7. doi: 10.1016/j.neuron.2019.06.001
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., and Graybiel, A. M. (2005). Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437, 1158–1161. doi: 10.1038/nature04053
Beaulieu, J., Espinoza, S., and Gainetdinov, R. R. (2014). Dopamine receptors - IUPHAR Review 13. Br. J. Pharmacol. 172, 1–23. doi: 10.1111/bph.12906
Belin, D., and Everitt, B. J. (2008). Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron 57, 432–441. doi: 10.1016/j.neuron.2007.12.019
Belin, D., Jonkman, S., Dickinson, A., Robbins, T. W., and Everitt, B. J. (2009). Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behav. Brain Res. 199, 89–102. doi: 10.1016/j.bbr.2008.09.027
Berke, J. D. (2018). What does dopamine mean? Nat. Neurosci. 21, 787–793. doi: 10.1038/s41593-018-0152-y
Bergstrom, H. C., Lipkin, A. M., Lieberman, A. G., Pinard, C. R., Gunduz-Cinar, O., Brockway, E. T., et al. (2018). Dorsolateral striatum engagement interferes with early discrimination learning. Cell Rep. 23, 2264–2272. doi: 10.1016/j.celrep.2018.04.081
Besson, M., Graybiel, A., and Quinn, B. (1990). Co-expression of neuropeptides in the cats striatum: an immunohistochemical study of substance P, dynorphin B and enkephalin. Neuroscience 39, 33–58. doi: 10.1016/0306-4522(90)90220-x
Biagini, G., Babinski, K., Avoli, M., Marcinkiewicz, M., and Séguéla, P. (2001). Regional and subunit-specific downregulation of acid-sensing ion channels in the pilocarpine model of epilepsy. Neurobiol. Dis. 8, 45–58. doi: 10.1006/nbdi.2000.0331
Bianchi, C., Siniscalchi, A., and Beani, L. (1989). Effect of 5-hydroxytryptamine on [3H]-acetylcholine release from guinea-pig striatal slices. Br. J. Pharmacol. 97, 213–221. doi: 10.1111/j.1476-5381.1989.tb11944.x
Bonsi, P., Cuomo, D., Ding, J., Sciamanna, G., Ulrich, S., Tscherter, A., et al. (2007). Endogenous serotonin excites striatal cholinergic interneurons via the activation of 5-HT 2C, 5-HT6, and 5-HT7 serotonin receptors: implications for extrapyramidal side effects of serotonin reuptake inhibitors. Neuropsychopharmacology 32, 1840–1854. doi: 10.1038/sj.npp.1301294
Bradfield, L. A., and Balleine, B. W. (2013). Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination. J. Exp. Psychol. Anim. Behav. Process. 39, 2–13. doi: 10.1037/a0030941
Brooks, M. (2020). Drug Overdose Now Leading Cause of Injury-Related Deaths. Available online at: https://www.medscape.com/viewarticle/846636 (accessed January 14, 2021).
Buck, S. A., Torregrossa, M. M., Logan, R. W., and Freyberg, Z. (2021). Roles of dopamine and glutamate co-release in the nucleus accumbens in mediating the actions of drugs of abuse. FEBS J. 288, 1462–1474. doi: 10.1111/febs.15496
Cachope, R., and Cheer, J. F. (2014). Local control of striatal dopamine release. Front. Behav. Neurosci. 8:188. doi: 10.3389/fnbeh.2014.00188
Cachope, R., Mateo, Y., Mathur, B., Irving, J., Wang, H., Morales, M., et al. (2012). Selective activation of cholinergic interneurons enhances accumbal phasic dopamine release: setting the tone for reward processing. Cell Rep. 2, 33–41. doi: 10.1016/j.celrep.2012.05.011
Caley, C. F. (1997). Extrapyramidal reactions and the selective serotonin-reuptake inhibitors. Ann. Pharmacother. 31, 1481–1489. doi: 10.1177/106002809703101208
Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321–352. doi: 10.1016/s0149-7634(02)00007-6
Centers for Disease Control and Prevention (2021). Available online at: https://www.cdc.gov/injury/features/prescription-drug-overdose/ (accessed Octomber 18, 2021).
Cheng, Y., Jiang, B., and Chen, C. (2018). Acid-sensing ion channels: dual function proteins for chemo-sensing and mechano-sensing. J. Biomed. Sci. 25:46. doi: 10.1186/s12929-018-0448-y
Cheron, J., and Kerchove d’Exaerde, A. (2021). Drug addiction: from bench to bedside. Transl. Psychiatry 11:424. doi: 10.1038/s41398-021-01542-0
Chiara, G. D., and Imperato, A. (1988). Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. Proc. Natl. Acad. Sci. U.S.A. 85, 5274–5278. doi: 10.1073/pnas.85.14.5274
Corbit, L. H. (2018). Understanding the balance between goal-directed and habitual behavioral control. Curr. Opin. Behav. Sci. 20, 161–168. doi: 10.1016/j.cobeha.2018.01.010
Corbit, L. H., and Balleine, B. W. (2003). The role of prelimbic cortex in instrumental conditioning. Behav. Brain Res. 146, 145–157. doi: 10.1016/j.bbr.2003.09.023
Corbit, L. H., and Janak, P. H. (2007). Inactivation of the lateral but not medial dorsal striatum eliminates the excitatory impact of pavlovian stimuli on instrumental responding. J. Neurosci. 27, 13977–13981. doi: 10.1523/jneurosci.4097-07.2007
Corbit, L. H., Muir, J. L., and Balleine, B. W. (2001). The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J. Neurosci. 21, 3251–3260. doi: 10.1523/jneurosci.21-09-03251.2001
Corbit, L. H., Nie, H., and Janak, P. H. (2012). Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol. Psychiatry 72, 389–395. doi: 10.1016/j.biopsych.2012.02.024
Covey, D. P., Mateo, Y., Sulzer, D., Cheer, J. F., and Lovinger, D. M. (2017). Endocannabinoid modulation of dopamine neurotransmission. Neuropharmacology 124, 52–61. doi: 10.1016/j.neuropharm.2017.04.033
Creed, M., Pascoli, V. J., and Lüscher, C. (2015). Refining deep brain stimulation to emulate optogenetic treatment of synaptic pathology. Science 347, 659–664. doi: 10.1126/science.1260776
Crittenden, J. R., and Graybiel, A. M. (2011). Basal ganglia disorders associated with imbalances in the striatal striosome and matrix compartments. Front. Neuroanat. 5:59. doi: 10.3389/fnana.2011.00059
Cui, G., Jun, S. B., Jin, X., Pham, M. D., Vogel, S. S., Lovinger, D. M., et al. (2013). Concurrent activation of striatal direct and indirect pathways during action initiation. Nature 494, 238–242. doi: 10.1038/nature11846
Cunningham, P. J., Regier, P. S., and Redish, A. D. (2021). Dorsolateral striatal task-initiation bursts represent past experiences more than future action plans. J. Neurosci. 41, 8051–8064. doi: 10.1523/jneurosci.3080-20.2021
Cutler, R. B., and Fishbain, D. A. (2005). Are alcoholism treatments effective? The Project MATCH data. BMC Public Health 5:75. doi: 10.1186/1471-2458-5-75
Dabney, W., Kurth-Nelson, Z., Uchida, N., Starkweather, C. K., Hassabis, D., Munos, R., et al. (2020). A distributional code for value in dopamine-based reinforcement learning. Nature 577, 671–675. doi: 10.1038/s41586-019-1924-6
Dautan, D., Huerta-Ocampo, I., Witten, I. B., Deisseroth, K., Bolam, J. P., Gerdjikov, T., et al. (2014). A major external source of cholinergic innervation of the striatum and nucleus accumbens originates in the brainstem. J. Neurosci. 34, 4509–4518. doi: 10.1523/jneurosci.5071-13.2014
Davis, M. I., Crittenden, J. R., Feng, A. Y., Kupferschmidt, D. A., Naydenov, A., Stella, N., et al. (2018). The cannabinoid-1 receptor is abundantly expressed in striatal striosomes and striosome-dendron bouquets of the substantia nigra. PLoS One 13:e0191436. doi: 10.1371/journal.pone.0191436
Daw, N. D., Niv, Y., and Dayan, P. (2005). Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704–1711. doi: 10.1038/nn1560
Diao, Z., Yao, L., Cheng, Q., Wu, M., Di, Y., Qian, Z., et al. (2021). Correction to: involvement of midbrain dopamine neuron activity in negative reinforcement learning in mice. Mol. Neurobiol. [Epub ahead of print]. doi: 10.1007/s12035-021-02573-w
Du, J., Reznikov, L. R., Price, M. P., Zha, X. M., Lu, Y., Moninger, T. O., et al. (2014). Protons are a neurotransmitter that regulates synaptic plasticity in the lateral amygdala. Proc. Natl. Acad. Sci. U.S.A. 111, 8961–8966. doi: 10.1073/pnas.1407018111
Edwards, N. J., Tejeda, H. A., Pignatelli, M., Zhang, S., Mcdevitt, R. A., Wu, J., et al. (2017). Circuit specificity in the inhibitory architecture of the VTA regulates cocaine-induced behavior. Nat. Neurosci. 20, 438–448. doi: 10.1038/nn.4482
Everitt, B. J., and Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8, 1481–1489. doi: 10.1038/nn1579
Everitt, B. J., and Robbins, T. W. (2016). Drug addiction: updating actions to habits to compulsions ten years on. Ann. Rev. Psychol. 67, 23–50. doi: 10.1146/annurev-psych-122414-033457
Fiore, V. G., Sperati, V., Mannella, F., Mirolli, M., Gurney, K., Friston, K., et al. (2014). Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot. Front. Psychol. 5:124. doi: 10.3389/fpsyg.2014.00124
Flagel, S. B., Clark, J. J., Robinson, T. E., Mayo, L., Czuj, A., Willuhn, I., et al. (2010). A selective role for dopamine in stimulus–reward learning. Nature 469, 53–57. doi: 10.1038/nature09588
Florio, T. M., Scarnati, E., Rosa, I., Di Censo, D., Ranieri, B., Cimini, A., et al. (2018). The basal ganglia: more than just a switching device. CNS Neurosci. Ther. 24, 677–684. doi: 10.1111/cns.12987
Fudge, J., and Haber, S. (2000). The central nucleus of the amygdala projection to dopamine subpopulations in primates. Neuroscience 97, 479–494. doi: 10.1016/s0306-4522(00)00092-0
Fujii, N. (2003). Representation of action sequence boundaries by macaque prefrontal cortical neurons. Science 301, 1246–1249. doi: 10.1126/science.1086872
Fujiyama, F., Sohn, J., Nakano, T., Furuta, T., Nakamura, K. C., Matsuda, W., et al. (2011). Exclusive and common targets of neostriatofugal projections of rat striosome neurons: a single neuron-tracing study using a viral vector. Eur. J. Neurosci. 33, 668–677. doi: 10.1111/j.1460-9568.2010.07564.x
Galaj, E., Han, X., Shen, H., Jordan, C., He, Y., Humburg, B., et al. (2020). Dissecting the role of GABA neurons in the VTA versus SNr in opioid reward. J. Neurosci. 40, 8853–8869. doi: 10.1523/JNEUROSCI.0988-20.2020
Galaj, E., and Xi, Z. (2021). Progress in opioid reward research: from a canonical two-neuron hypothesis to two neural circuits. Pharmacol. Biochem. Behav. 200:173072. doi: 10.1016/j.pbb.2020.173072
Gerfen, C. R. (1984). The neostriatal mosaic: compartmentalization of corticostriatal input and striatonigral output systems. Nature 311, 461–464. doi: 10.1038/311461a0
Gerfen, C. R., and Surmeier, D. J. (2011). Modulation of striatal projection systems by dopamine. Ann. Rev. Neurosci. 34, 441–466. doi: 10.1146/annurev-neuro-061010-113641
Gobetto, M. N., González-Inchauspe, C., and Uchitel, O. D. (2021). Histamine and corticosterone modulate acid sensing ion channels (ASICs) dependent long-term potentiation at the mouse anterior cingulate cortex. Neuroscience 460, 145–160. doi: 10.1016/j.neuroscience.2021.01.022
Goldstein, R. Z., and Volkow, N. D. (2011). Dysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications. Nat. Rev. Neurosci. 12, 652–669. doi: 10.1038/nrn3119
Graybiel, A. M. (2005). The basal ganglia: learning new tricks and loving it. Curr. Opin. Neurobiol. 15, 638–644. doi: 10.1016/j.conb.2005.10.006
Graybiel, A. M., and Grafton, S. T. (2015). The striatum: where skills and habits meet. Cold Spring Harb. Perspect. Biol. 7:a021691. doi: 10.1101/cshperspect.a021691
Graybiel, A. M., and Hickey, T. L. (1982). Chemospecificity of ontogenetic units in the striatum: demonstration by combining [3H] thymidine neuronography and histochemical staining. Proc. Natl. Acad. Sci. U.S.A. 79, 198–202. doi: 10.1073/pnas.79.1.198
Graybiel, A. M., and Ragsdale, C. W. (1978). Histochemically distinct compartments in the striatum of human, monkeys, and cat demonstrated by acetylthiocholinesterase staining. Proc. Natl. Acad. Sci. U.S.A. 75, 5723–5726. doi: 10.1073/pnas.75.11.5723
Graziane, N. M., Sun, S., Wright, W. J., Jang, D., Liu, Z., Huang, Y. H., et al. (2016). Opposing mechanisms mediate morphine- and cocaine-induced generation of silent synapses. Nat. Neurosci. 19, 915–925. doi: 10.1038/nn.4313
Gremel, C. M., and Costa, R. M. (2013). Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nat. Commun. 4:2264. doi: 10.1038/ncomms3264
Gründer, S., and Pusch, M. (2015). Biophysical properties of acid-sensing ion channels (ASICs). Neuropharmacology 94, 9–18. doi: 10.1016/j.neuropharm.2014.12.016
Guegan, T., Cebrià, J. P., Maldonado, R., and Martin, M. (2015). Morphine-induced locomotor sensitization produces structural plasticity in the mesocorticolimbic system dependent on CB1-R activity. Addict. Biol. 21, 1113–1126. doi: 10.1111/adb.12281
Gutman, A. L., Cosme, C. V., Noterman, M. F., Worth, W. R., Wemmie, J. A., and LaLumiere, R. T. (2020). Overexpression of ASIC1A in the nucleus accumbens of rats potentiates cocaine-seeking behavior. Addict. Biol. 25:e12690. doi: 10.1111/adb.12690
Haber, S. N. (2003). The primate basal ganglia: parallel and integrative networks. J. Chem. Neuroanat. 26, 317–330. doi: 10.1016/j.jchemneu.2003.10.003
Haber, S. N., Fudge, J. L., and Mcfarland, N. R. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369–2382. doi: 10.1523/jneurosci.20-06-02369.2000
Halliday, G., Blumbergs, P., Cotton, R., Blessing, W., and Geffen, L. (1990). Loss of brainstem serotonin- and substance P-containing neurons in Parkinson’s disease. Brain Res. 510, 104–107. doi: 10.1016/0006-8993(90)90733-r
Hearing, M. (2019). Prefrontal-accumbens opioid plasticity: implications for relapse and dependence. Pharmacol. Res. 139, 158–165. doi: 10.1016/j.phrs.2018.11.012
Hearing, M. C., Jedynak, J., Ebner, S. R., Ingebretson, A., Asp, A. J., Fischer, R. A., et al. (2016). Reversal of morphine-induced cell-type–specific synaptic plasticity in the nucleus accumbens shell blocks reinstatement. Proc. Natl. Acad. Sci. U.S.A. 113, 757–762. doi: 10.1073/pnas.1519248113
Herkenham, M., Lynn, A., Johnson, M., Melvin, L., Costa, B. D., and Rice, K. C. (1991). Characterization and localization of cannabinoid receptors in rat brain: a quantitative in vitro autoradiographic study. J. Neurosci. 11, 563–583. doi: 10.1523/jneurosci.11-02-00563.1991
Herkenham, M., and Pert, C. B. (1981). Mosaic distribution of opiate receptors, parafascicular projections and acetylcholinesterase in rat striatum. Nature 291, 415–418. doi: 10.1038/291415a0
Hilário, M. R. (2007). Endocannabinoid signaling is critical for habit formation. Front. Integr. Neurosci. 1:6. doi: 10.3389/neuro.07.006
Hodebourg, R., Murray, J. E., Fouyssac, M., Puaud, M., Everitt, B. J., and Belin, D. (2019). Heroin seeking becomes dependent on dorsal striatal dopaminergic mechanisms and can be decreased by N-acetylcysteine. Eur. J. Neurosci. 50, 2036–2044. doi: 10.1111/ejn.13894
Hoffman, A. F., and Lupica, C. R. (2012). Synaptic targets of 9-tetrahydrocannabinol in the central nervous system. Cold Spring Harb. Perspect. Med. 3:a012237. doi: 10.1101/cshperspect.a012237
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E., and Graybiel, A. M. (2013). Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500, 575–579. doi: 10.1038/nature12475
Hurd, Y. L., and Herkenham, M. (1993). Molecular alterations in the neostriatum of human cocaine addicts. Synapse 13, 357–369. doi: 10.1002/syn.890130408
Ilango, A., Kesner, A. J., Keller, K. L., Stuber, G. D., Bonci, A., and Ikemoto, S. (2014). Similar roles of substantia nigra and ventral tegmental dopamine neurons in reward and aversion. J. Neurosci. 34, 817–822. doi: 10.1523/jneurosci.1703-13.2014
Izzo, P. N., and Bolam, J. P. (1988). Cholinergic synaptic input to different parts of spiny striatonigral neurons in the rat. J. Comp. Neurol. 269, 219–234. doi: 10.1002/cne.902690207
Jiang, Q., Li, M. H., Papasian, C. J., Branigan, D., Xiong, Z. G., Wang, J. Q., et al. (2009). Characterization of acid-sensing ion channels in medium spiny neurons of mouse striatum. Neuroscience 162, 55–66. doi: 10.1016/j.neuroscience.2009.04.029
Jiang, Q., Wang, C., Fibuch, E., Wang, J., and Chu, X. P. (2013). Differential regulation of locomotor activity to acute and chronic cocaine administration by acid-sensing ion channel 1a and 2 in adult mice. Neuroscience 246, 170–178. doi: 10.1016/j.neuroscience.2013.04.059
Jiménez-Castellanos, J., and Graybiel, A. (1989). Compartmental origins of striatal efferent projections in the cat. Neuroscience 32, 297–321. doi: 10.1016/0306-4522(89)90080-8
Jin, X., and Costa, R. M. (2010). Start/stop signals emerge in nigrostriatal circuits during sequence learning. Nature 466, 457–462. doi: 10.1038/nature09263
Jog, M. S. (1999). Building neural representations of habits. Science 286, 1745–1749. doi: 10.1126/science.286.5445.1745
Jonkman, S., Pelloux, Y., and Everitt, B. J. (2012). Differential roles of the dorsolateral and midlateral striatum in punished cocaine seeking. J. Neurosci. 32, 4645–4650. doi: 10.1523/jneurosci.0348-12.2012
Julian, M., Martin, A., Cuellar, B., Fonseca, F. R., Navarro, M., Moratalla, R., et al. (2003). Neuroanatomical relationship between type 1 cannabinoid receptors and dopaminergic systems in the rat basal ganglia. Neuroscience 119, 309–318. doi: 10.1016/s0306-4522(03)00070-8
Kim, H. R., Malik, A. N., Mikhael, J. G., Bech, P., Tsutsui-Kimura, I., Sun, F., et al. (2020). A unified framework for dopamine signals across timescales. Cell 183, 1600–1616. doi: 10.1016/j.cell.2020.11.013
Knierim, J. (2020). Basal Ganglia (Section 3, Chapter 4) Neuroscience Online: An Electronic Textbook for the Neurosciences: Department of Neurobiology and Anatomy - The University of Texas Medical School at Houston. Available online at: https://nba.uth.tmc.edu/neuroscience/m/s3/chapter04.html (accessed May 25, 2021).
Kobrin, K. L., Arena, D. T., Heinrichs, S. C., Nguyen, O. H., and Kaplan, G. B. (2017). Dopamine D1 receptor agonist treatment attenuates extinction of morphine conditioned place preference while increasing dendritic complexity in the nucleus accumbens core. Behav. Brain Res. 322, 18–28. doi: 10.1016/j.bbr.2017.01.011
Koob, G. F. (2020). Neurobiology of opioid addiction: opponent process, hyperkatifeia, and negative reinforcement. Biol. Psychiatry 87, 44–53. doi: 10.1016/j.biopsych.2019.05.023
Koob, G. F. (2021). Drug addiction: hyperkatifeia/negative reinforcement as a framework for medications development. Pharmacol. Rev. 73, 163–201. doi: 10.1124/pharmrev.120.000083
Kreitzer, A. C., and Malenka, R. C. (2008). Striatal plasticity and basal ganglia circuit function. Neuron 60, 543–554. doi: 10.1016/j.neuron.2008.11.005
Kreple, C. J., Lu, Y., Taugher, R. J., Schwager-Gutman, A. L., Du, J., Stump, M., et al. (2014). Acid-sensing ion channels contribute to synaptic transmission and inhibit cocaine-evoked plasticity. Nat. Neurosci. 17, 1083–1091. doi: 10.1038/nn.3750
Krishtal, O. (2015). Receptor for protons: first observations on acid sensing ion channels. Neuropharmacology 94, 4–8. doi: 10.1016/j.neuropharm.2014.12.014
Kupferschmidt, D. A., Juczewski, K., Cui, G., Johnson, K. A., and Lovinger, D. M. (2017). Parallel, but dissociable, processing in discrete corticostriatal inputs encodes skill learning. Neuron 96, 476.e5–489.e5. doi: 10.1016/j.neuron.2017.09.040
Lammel, S., Ion, D. I., Roeper, J., and Malenka, R. C. (2011). Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 70, 855–862. doi: 10.1016/j.neuron.2011.03.025
Lanciego, J. L., Luquin, N., and Obeso, J. A. (2012). Functional neuroanatomy of the basal ganglia. Cold Spring Harb. Perspect. Med. 2:a009621. doi: 10.1101/cshperspect.a009621
Leo, R. J. (1996). Movement disorders associated with the serotonin selective reuptake inhibitors. J. Clin. Psychiatry 57, 449–454. doi: 10.4088/jcp.v57n1002
Lerner, T. N., Holloway, A. L., and Seiler, J. L. (2021). Dopamine, updated: reward prediction error and beyond. Curr. Opin. Neurobiol. 67, 123–130. doi: 10.1016/j.conb.2020.10.012
Lindroos, R., and Kotaleski, J. H. (2020). Predicting complex spikes in striatal projection neurons of the direct pathway following neuromodulation by acetylcholine and dopamine. Eur. J. Neurosci. 53, 2117–2134. doi: 10.1111/ejn.14891
Lipton, D. M., Gonzales, B. J., and Citri, A. (2019). Dorsal striatal circuits for habits, compulsions and addictions. Front. Syst. Neurosci. 13:28. doi: 10.3389/fnsys.2019.00028
Liu, C., and Kaeser, P. S. (2019). Mechanisms and regulation of dopamine release. Curr. Opin. Neurobiol. 57, 46–53. doi: 10.1016/j.conb.2019.01.001
Lovinger, D. M., Davis, M. I., and Costa, R. M. (2010). “Endocannabinoid Signaling in the Striatum,” in The Handbook of Basal Ganglia Structure and Function, ed. S. Tseng (Amsterdam: Elsevier), 167–186. doi: 10.1016/b978-0-12-374767-9.00009-3
Lüscher, C., Pascoli, V., and Creed, M. (2015). Optogenetic dissection of neural circuitry: from synaptic causalities to blue prints for novel treatments of behavioral diseases. Curr. Opin. Neurobiol. 35, 95–100. doi: 10.1016/j.conb.2015.07.005
Lüscher, C., Robbins, T. W., and Everitt, B. J. (2020). The transition to compulsion in addiction. Nat. Rev. Neurosci. 21, 247–263. doi: 10.1038/s41583-020-0289-z
Macpherson, T., and Hikida, T. (2018). Nucleus accumbens dopamine D1-receptor-expressing neurons control the acquisition of sign-tracking to conditioned cues in mice. Front. Neurosci. 12:418. doi: 10.3389/fnins.2018.00418
Maes, E. J., Sharpe, M. J., Usypchuk, A. A., Lozzi, M., Chang, C. Y., Gardner, M. P. H., et al. (2020). Causal evidence supporting the proposal that dopamine transients function as temporal difference prediction errors. Nat. Neurosci. 23, 176–178. doi: 10.1038/s41593-019-0574-1
Mannella, F., and Baldassarre, G. (2015). Selection of cortical dynamics for motor behaviour by the basal ganglia. Biol. Cybern. 109, 575–595. doi: 10.1007/s00422-015-0662-6
Mannella, F., Gurney, K., and Baldassarre, G. (2013). The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis. Front. Behav. Neurosci. 7:135. doi: 10.3389/fnbeh.2013.00135
Mannella, F., Mirolli, M., and Baldassarre, G. (2016). Goal-directed behavior and instrumental devaluation: a neural system-level computational model. Front. Behav. Neurosci. 10:181. doi: 10.3389/fnbeh.2016.00181
Martín, A. B., Fernandez-Espejo, E., Ferrer, B., Gorriti, M. A., Bilbao, A., Navarro, M., et al. (2007). Expression and function of CB1 receptor in the rat striatum: localization and effects on D1 and D2 dopamine receptor-mediated motor behaviors. Neuropsychopharmacology 33, 1667–1679. doi: 10.1038/sj.npp.1301558
Martiros, N., Burgess, A. A., and Graybiel, A. M. (2018). Inversely active striatal projection neurons and interneurons selectively delimit useful behavioral sequences. Curr. Biol. 28, 560.e5–573.e5. doi: 10.1016/j.cub.2018.01.031
Mateo, Y., Johnson, K. A., Covey, D. P., Atwood, B. K., Wang, H., Zhang, S., et al. (2017). Endocannabinoid actions on cortical terminals orchestrate local modulation of dopamine release in the nucleus accumbens. Neuron 96, 1112.e5–1126.e5. doi: 10.1016/j.neuron.2017.11.012
Mattson, M., Allen, J., Miller, W., Hester, R., Connors, G., Rychtarik, R., et al. (1993). Project MATCH: rationale, and methods for a multisite clinical trial matching patients to alcoholism treatment. Alcohol Clin. Exp. Res. 17, 1130–1145. doi: 10.1111/j.1530-0277.1993.tb05219.x
Meredith, G. E., Baldo, B. A., Andrezjewski, M. E., and Kelley, A. E. (2008). The structural basis for mapping behavior onto the ventral striatum and its subdivisions. Brain Struct. Funct. 213, 17–27. doi: 10.1007/s00429-008-0175-3
Misganaw, D. (2021). Heteromerization of dopaminergic receptors in the brain: pharmacological implications. Pharmacol. Res. 170:105600. doi: 10.1016/j.phrs.2021.105600
Mogenson, G., Jones, D., and Yim, C. (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69–97. doi: 10.1016/0301-0082(80)90018-0
Morano, A., Fanella, M., Albini, M., Cifelli, P., Palma, E., Giallonardo, A. T., et al. (2020). Cannabinoids in the treatment of epilepsy: current status and future prospects. Neuropsychiatri. Dis. Treat. 16, 381–396. doi: 10.2147/ndt.s203782
Moratalla, R., Elibol, B., Vallejo, M., and Graybiel, A. M. (1996). Network-level changes in expression of inducible fos–jun proteins in the striatum during chronic cocaine treatment and withdrawal. Neuron 17, 147–156. doi: 10.1016/s0896-6273(00)80288-3
Murray, J. E., Belin, D., and Everitt, B. J. (2012). Double dissociation of the dorsomedial and dorsolateral striatal control over the acquisition and performance of cocaine seeking. Neuropsychopharmacology 37, 2456–2466. doi: 10.1038/npp.2012.104
Murray, J. E., Dilleen, R., Pelloux, Y., Economidou, D., Dalley, J. W., Belin, D., et al. (2014). Increased impulsivity retards the transition to dorsolateral striatal dopamine control of cocaine seeking. Biol. Psychiatry 76, 15–22. doi: 10.1016/j.biopsych.2013.09.011
Nahar, L., Delacroix, B. M., and Nam, H. W. (2021). The role of parvalbumin interneurons in neurotransmitter balance and neurological disease. Front. Psychiatry 12:679960. doi: 10.3389/fpsyt.2021.679960
National Institute on Drug Abuse (2021). Available online at: https://archives.drugabuse.gov/publications/media-guide/science-drug-use-addiction-basics (accessed October 25, 2021).
Nauta, W. J., and Gygax, P. A. (1954). Silver impregnation of degenerating axons in the central nervous system: a modified technic. Stain Technol. 29, 91–93. doi: 10.3109/10520295409115448
Niedzielska-Andres, E., Pomierny-Chamioło, L., Andres, M., Walczak, M., Knackstedt, L. A., Filip, M., et al. (2021). Cocaine use disorder: a look at metabotropic glutamate receptors and glutamate transporters. Pharmacol. Ther. 221:107797. doi: 10.1016/j.pharmthera.2020.107797
Ohare, J. K., Li, H., Kim, N., Gaidis, E., Ade, K., Beck, J., et al. (2017). Striatal fast-spiking interneurons selectively modulate circuit output and are required for habitual behavior. eLife 6:e26231. doi: 10.7554/elife.26231
Ostlund, S. B., and Balleine, B. W. (2008). Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J. Neurosci. 28, 4398–4405. doi: 10.1523/jneurosci.5472-07.2008
Packard, M. G., and Knowlton, B. J. (2002). Learning and memory functions of the basal ganglia. Annu. Rev. Neurosci. 25, 563–593. doi: 10.1146/annurev.neuro.25.112701.142937
Parkes, S. L., and Balleine, B. W. (2013). Incentive memory: evidence the basolateral amygdala encodes and the insular cortex retrieves outcome values to guide choice between goal-directed actions. J. Neurosci. 33, 8753–8763. doi: 10.1523/jneurosci.5071-12.2013
Passingham, R. E., and Wise, S. P. (2012). The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight. New York: Oxford University Press.
Patton, M. H., Roberts, B. M., Lovinger, D. M., and Mathur, B. N. (2015). Ethanol disinhibits dorsolateral striatal medium spiny neurons through activation of a presynaptic delta opioid receptor. Neuropsychopharmacology 41, 1831–1840. doi: 10.1038/npp.2015.353
Peak, J., Hart, G., and Balleine, B. W. (2018). From learning to action: the integration of dorsal striatal input and output pathways in instrumental conditioning. Eur. J. Neurosci. 49, 658–671. doi: 10.1111/ejn.13964
Pettibone, D., Kaufman, N., Scally, M., Meyer, E., Ulus, I., and Lytle, L. D. (1978). Striatal nondopaminergic neurons: possible involvement in feeding and drinking behavior. Science 200, 1175–1177. doi: 10.1126/science.653362
Piomelli, D., Giuffrida, A., Parsons, L., Fonseca, F. R., and Navarro, M. (1999). Dopamine activation of endogenous cannabinoid signaling in dorsal striatum. Nat. Neurosci. 2, 358–363. doi: 10.1038/7268
Pontieri, F. E., Tanda, G., Orzi, F., and Chiara, G. D. (1996). Effects of nicotine on the nucleus accumbens and similarity to those of addictive drugs. Nature 382, 255–257. doi: 10.1038/382255a0
Price, M. P., Gong, H., Parsons, M. G., Kundert, J. R., Reznikov, L. R., Bernardinelli, L., et al. (2014). Localization and behaviors in null mice suggest that ASIC1 and ASIC2 modulate responses to aversive stimuli. Genes Brain Behav. 13, 179–194. doi: 10.1111/gbb.12108
Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M. C., Lehericy, S., Bergman, H., et al. (2010). Goal-directed and habitual control in the basal ganglia: implications for Parkinsons disease. Nat. Rev. Neurosci. 11, 760–772. doi: 10.1038/nrn2915
Reiner, A., Hart, N. M., Lei, W., and Deng, Y. (2010). Corticostriatal projection neurons – dichotomous types and dichotomous functions. Front. Neuroanat. 4:142. doi: 10.3389/fnana.2010.00142
Robbins, T. W., and Costa, R. M. (2017). Habits. Curr. Biol. 27, R1200–R1206. doi: 10.1016/j.cub.2017.09.060
Robbins, T. W., Vaghi, M. M., and Banca, P. (2019). Obsessive-compulsive disorder: puzzles and prospects. Neuron 102, 27–47. doi: 10.1016/j.neuron.2019.01.046
Rook, M. L., Musgaard, M., and MacLean, D. M. (2021). Coupling structure with function in acid-sensing ion channels: challenges in pursuit of proton sensors. J. Physiol. 599, 417–430. doi: 10.1113/JP278707
Rossi, M. A., and Yin, H. H. (2012). Methods for studying habitual behavior in mice. Curr. Protoc. Neurosci. 8:29. doi: 10.1002/0471142301.ns0829s60
Sah, P., Faber, E. S., Armentia, M. L., and Power, J. (2003). The amygdaloid complex: anatomy and physiology. Physiol. Rev. 83, 803–834. doi: 10.1152/physrev.00002.2003
Sandyk, R., and Fisher, H. (1988). Serotonin in involuntary movement disorders. Int. J. Neurosci. 42, 185–208. doi: 10.3109/00207458808991596
Satoh, T., Nakai, S., Sato, T., and Kimura, M. (2003). Correlated coding of motivation and outcome of decision by dopamine neurons. J. Neurosci. 23, 9913–9923. doi: 10.1523/jneurosci.23-30-09913.2003
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. doi: 10.1126/science.275.5306.1593
Schwarcz, R., and Coyle, J. T. (1977). Striatal lesions with kainic acid: neurochemical characteristics. Brain Res. 127, 235–249. doi: 10.1016/0006-8993(77)90538-8
Scofield, M. D., Heinsbroek, J. A., Gipson, C. D., Kupchik, Y. M., Spencer, S., Smith, A. C., et al. (2016). The nucleus accumbens: mechanisms of addiction across drug classes reflect the importance of glutamate homeostasis. Pharmacol. Rev. 68, 816–871. doi: 10.1124/pr.116.012484
Seiler, J. L., Cosme, C. V., Sherathiya, V. N., Bianco, J. M., and Bridgemohan, A. S. (2020). Dopamine signaling in the dorsomedial striatum promotes compulsive behavior. bioRxiv [Preprint]. doi: 10.1101/2020.03.30.016238
Shan, Q., Ge, M., Christie, M. J., and Balleine, B. W. (2014). The acquisition of goal-directed actions generates opposing plasticity in direct and indirect pathways in dorsomedial striatum. J. Neurosci. 34, 9196–9201. doi: 10.1523/jneurosci.0313-14.2014
Shen, W., Flajolet, M., Greengard, P., and Surmeier, D. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848–851. doi: 10.1126/science.1160575
Sim, L. J., Selley, D. E., Xiao, R., and Childers, S. R. (1996). Differences in G-protein activation by μ- and δ-opioid, and cannabinoid, receptors in rat striatum. Eur. J. Pharmacol. 307, 97–105. doi: 10.1016/0014-2999(96)00211-7
Simmons, S. C., Wheeler, K., and Mazei-Robison, M. S. (2019). Determination of circuit-specific morphological adaptations in ventral tegmental area dopamine neurons by chronic morphine. Mol. Brain 12:10. doi: 10.1186/s13041-019-0435-6
Smith, K., and Graybiel, A. (2013). A dual operator view of habitual behavior reflecting cortical and striatal dynamics. Neuron 79, 361–374. doi: 10.1016/j.neuron.2013.05.038
Steiner, H., and Gerfen, C. R. (1998). Role of dynorphin and enkephalin in the regulation of striatal output pathways and behavior. Exp. Brain Res. 123, 60–76. doi: 10.1007/s002210050545
Suman, A., Mehta, B., Guo, M., Chu, X., Fibuch, E. E., Mao, L. M., et al. (2010). Alterations in subcellular expression of acid-sensing ion channels in the rat forebrain following chronic amphetamine administration. Neurosci. Res. 68, 1–8. doi: 10.1016/j.neures.2010.06.001
Tanda, G., Pontieri, F. E., and Chiara, G. D. (1997). Cannabinoid and heroin activation of mesolimbic dopamine transmission by a common μ1 opioid receptor mechanism. Science 276, 2048–2050. doi: 10.1126/science.276.5321.2048
Thompson, B. L., Oscar-Berman, M., and Kaplan, G. B. (2021). Opioid-induced structural and functional plasticity of medium-spiny neurons in the nucleus accumbens. Neurosci. Biobehav. Rev. 120, 417–430. doi: 10.1016/j.neubiorev.2020.10.015
Thorn, C. A., Atallah, H., Howe, M., and Graybiel, A. M. (2010). Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66, 781–795. doi: 10.1016/j.neuron.2010.04.036
Tokuno, H., Chiken, S., Kametani, K., and Moriizumi, T. (2002). Efferent projections from the striatal patch compartment: anterograde degeneration after selective ablation of neurons expressing μ-opioid receptor in rats. Neurosci. Lett. 332, 5–8. doi: 10.1016/s0304-3940(02)00837-6
Tong, J., Meyer, J. H., Boileau, I., Ang, L. C., Fletcher, P. J., Furukawa, Y., et al. (2020). Serotonin transporter protein in autopsied brain of chronic users of cocaine. Psychopharmacology 237, 2661–2671. doi: 10.1007/s00213-020-05562-4
Tran-Tu-Yen, D. A., Marchand, A. R., Pape, J., Scala, G. D., and Coutureau, E. (2009). Transient role of the rat prelimbic cortex in goal-directed behaviour. Eur. J. Neurosci. 30, 464–471. doi: 10.1111/j.1460-9568.2009.06834.x
Vanderschuren, L. J. M. J., Di Ciano, P., and Everitt, B. J. (2005). Involvement of the dorsal striatum in cue-controlled cocaine seeking. J. Neurosci. 25, 8665–8670. doi: 10.1523/jneurosci.0925-05.2005
Vocci, F. J., and Elkashef, A. (2005). Pharmacotherapy and other treatments for cocaine abuse and dependence. Curr. Opin. Psychiatry 18, 265–270. doi: 10.1097/01.yco.0000165596.98552.02
Volkow, N. D., and Morales, M. (2015). The brain on drugs: from reward to addiction. Cell 162, 712–725. doi: 10.1016/j.cell.2015.07.046
Vullo, S., and Kellenberger, S. (2020). A molecular view of the function and pharmacology of acid-sensing ion channels. Pharmacol. Res. 154:104166. doi: 10.1016/j.phrs.2019.02.005
Waes, V. V., Beverley, J. A., Siman, H., Tseng, K. Y., and Steiner, H. (2012). CB1 cannabinoid receptor expression in the striatum: association with corticostriatal circuits and developmental regulation. Front. Pharmacol. 3:21. doi: 10.3389/fphar.2012.00021
Waldmann, R., Champigny, G., Bassilana, F., Heurteaux, C., and Lazdunski, M. (1997). A proton-gated cation channel involved in acid-sensing. Nature 386, 173–177. doi: 10.1038/386173a0
Wang, H., Deng, Y., and Reiner, A. (2007). In situ hybridization histochemical and immunohistochemical evidence that striatal projection neurons co-containing substance P and enkephalin are overrepresented in the striosomal compartment of striatum in rats. Neurosci. Lett. 425, 195–199. doi: 10.1016/j.neulet.2007.08.033
Wang, H., Laverghetta, A., Foehring, R., Deng, Y., Sun, Z., Yamamoto, K., et al. (2006). Single-cell RT-PCR, in situ hybridization histochemical, and immunohistochemical studies of substance P and enkephalin co-occurrence in striatal projection neurons in rats. J. Chem. Neuroanat. 31, 178–199. doi: 10.1016/j.jchemneu.2006.01.003
Wang, K. S., Mcclure, J. P., Alselehdar, S. K., and Kanta, V. (2015). Direct and indirect pathways of the basal ganglia: opponents or collaborators? Front. Neuroanat. 9:20. doi: 10.3389/fnana.2015.00020
Wemmie, J. A., Askwith, C. C., Lamani, E., Cassell, M. D., Freeman, J. H. Jr., and Welsh, M. J. (2003). Acid-sensing ion channel 1 is localized in brain regions with high synaptic density and contributes to fear conditioning. J. Neurosci. 23, 5496–5502. doi: 10.1523/jneurosci.23-13-05496.2003
West, E. A., Forcelli, P. A., Murnen, A. T., Mccue, D. L., Gale, K., and Malkova, L. (2012). Transient inactivation of basolateral amygdala during selective satiation disrupts reinforcer devaluation in rats. Behav. Neurosci. 126, 563–574. doi: 10.1037/a0029080
Wilcox, M. V., Carlson, V. C., Sherazee, N., Sprow, G. M., Bock, R., and Thiele, T. E. (2013). Repeated binge-like ethanol drinking alters ethanol drinking patterns and depresses striatal GABAergic transmission. Neuropsychopharmacology 39, 579–594. doi: 10.1038/npp.2013.230
Yager, L. M., Garcia, A. F., Donckels, E. A., and Ferguson, S. M. (2018). Chemogenetic inhibition of direct pathway striatal neurons normalizes pathological, cue-induced reinstatement of drug-seeking in rats. Addict. Biol. 24, 251–264. doi: 10.1111/adb.12594
Yang, H., Jong, J. W., Tak, Y., Peck, J., Bateup, H. S., and Lammel, S. (2018). Nucleus accumbens subnuclei regulate motivated behavior via direct inhibition and disinhibition of VTA dopamine subpopulations. Neuron 97, 434.e4–449.e4. doi: 10.1016/j.neuron.2017.12.022
Yin, H. H. (2004). Contributions of striatal subregions to place and response learning. Learn. Mem. 11, 459–463. doi: 10.1101/lm.81004
Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464–476. doi: 10.1038/nrn1919
Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2004). Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur. J. Neurosci. 19, 181–189. doi: 10.1111/j.1460-9568.2004.03095.x
Yin, H. H., Knowlton, B. J., and Balleine, B. W. (2005). Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur. J. Neurosci. 22, 505–512. doi: 10.1111/j.1460-9568.2005.04219.x
Yin, H. H., Mulcare, S. P., Hilário, M. R., Clouse, E., Holloway, T., Davis, I. M., et al. (2009). Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat. Neurosci. 12, 333–341. doi: 10.1038/nn.2261
Young, K. A., Franklin, T. R., Roberts, D. C., Jagannathan, K., Suh, J. J., Wetherill, R. R., et al. (2014). Nipping cue reactivity in the bud: baclofen prevents limbic activation elicited by subliminal drug cues. J. Neurosci. 34, 5038–5043. doi: 10.1523/jneurosci.4977-13.2014
Zahm, D. S. (2000). An integrative neuroanatomical perspective on some subcortical substrates of adaptive responding with emphasis on the nucleus accumbens. Neurosci. Biobehav. Rev. 24, 85–105. doi: 10.1016/s0149-7634(99)00065-2
Zapata, A., Minney, V. L., and Shippenberg, T. S. (2010). Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J. Neurosci. 30, 15457–15463. doi: 10.1523/jneurosci.4072-10.2010
Zhang, G., Mao, L., Wang, J. Q., and Chu, X. P. (2009). Upregulation of acid-sensing ion channel 1 protein expression by chronic administration of cocaine in the mouse striatum in vivo. Neurosci. Lett. 459, 119–122. doi: 10.1016/j.neulet.2009.05.013
Zhang, L., Meng, S., Chen, W., Chen, Y., Huang, E., Zhang, G., et al. (2021). High-frequency deep brain stimulation of the substantia nigra pars reticulata facilitates extinction and prevents reinstatement of methamphetamine-induced conditioned place preference. Front. Pharmacl. 12:705813. doi: 10.3389/fphar.2021.705813
Keywords: striatonigrostriatal spirals, addiction, reward system, basal ganglia circuits, neurotransmitter, dopamine, behavior
Citation: Sivils A, Wang JQ and Chu X-P (2021) Striatonigrostriatal Spirals in Addiction. Front. Neural Circuits 15:803501. doi: 10.3389/fncir.2021.803501
Received: 28 October 2021; Accepted: 24 November 2021;
Published: 10 December 2021.
Edited by:
Farzan Nadim, New Jersey Institute of Technology, United StatesReviewed by:
Junichi Yoshida, Albert Einstein College of Medicine, United StatesYan Dong, University of Pittsburgh, United States
Copyright © 2021 Sivils, Wang and Chu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xiang-Ping Chu, Y2h1eEB1bWtjLmVkdQ==