Toshiharu Ichinose
Hiromu Tanimoto
Nobuhiro Yamagata- 1Graduate School of Life Sciences, Tohoku University, Sendai, Japan
- 2Department of Neuroscience of Disease, Center for Transdisciplinary Research, Niigata University, Niigata, Japan
Dopamine modulates a variety of animal behaviors that range from sleep and learning to courtship and aggression. Besides its well-known phasic firing to natural reward, a substantial number of dopamine neurons (DANs) are known to exhibit ongoing intrinsic activity in the absence of an external stimulus. While accumulating evidence points at functional implications for these intrinsic “spontaneous activities” of DANs in cognitive processes, a causal link to behavior and its underlying mechanisms has yet to be elucidated. Recent physiological studies in the model organism Drosophila melanogaster have uncovered that DANs in the fly brain are also spontaneously active, and that this activity reflects the behavioral/internal states of the animal. Strikingly, genetic manipulation of basal DAN activity resulted in behavioral alterations in the fly, providing critical evidence that links spontaneous DAN activity to behavioral states. Furthermore, circuit-level analyses have started to reveal cellular and molecular mechanisms that mediate or regulate spontaneous DAN activity. Through reviewing recent findings in different animals with the major focus on flies, we will discuss potential roles of this physiological phenomenon in directing animal behaviors.
Introduction
Animals need to modify behaviors according not only to the external world but also to their internal states, such as sleep need, hunger, or sexual motivation (Keene et al., 2010; Gorter et al., 2016; Keebaugh et al., 2017). These internal states are encoded in various manners, including ongoing neural activity in the brain. Physiological studies have revealed that these “spontaneously” occurring neural activities often show drastic changes even in the absence of external stimuli (Fox and Raichle, 2007). In this review, we discuss the biological relevance of spontaneous neural activity: how it is regulated and how it modifies behaviors. We define the spontaneous activity as the ongoing neural activity without overt external stimuli, regardless of the properties of the activity, like tonic or burst firing. Activity reflecting self-locomotion is also defined as spontaneous activity in this article.
In mammals, during sleep, electroencephalogram records show characteristic slow waves in the entire cortex (Massimini et al., 2004), which is caused by a spontaneously occurring synchronized neural activity. The slow wave activity is enhanced after sleep deprivation and suppressed after sleep, thereby controlling sleep homeostasis (Tobler and Borbely, 1986; Werth et al., 1996; Finelli et al., 2000; Vyazovskiy et al., 2009). Similar waves also drive rhythmic activity in hippocampus, which is suggested to be critical in memory consolidation (Sirota et al., 2003; Marshall and Born 2007), and a growing number of studies are now revealing how these neural activities occur across various brain regions and how they modify behaviors.
Although many neurotransmitters especially monoamines are reported to control spontaneous activity (Berridge et al., 2012; Dominguez-Lopez et al., 2012; Grace, 2016), we focus on dopaminergic circuits in this review, given converging evidence in identifying spontaneous dopamine signaling as representing states of animals. Dopamine plays a key role in a variety of brain functions such as reward processing, regulation of motivation, or learning and memory (Schultz, 2007). Dopamine functions through both synaptic and volume transmission, thereby enabling it to modulate both intra- and extra- synaptic targets (Rice et al., 2011). Dopamine neurons (DANs) in the midbrain can be characterized by its stimulus-induced phasic firing, the importance of which in behavioral action selection and reward-based learning has been widely acknowledged (Schultz et al., 1997; Tsai et al., 2009; Bromberg-Martin et al., 2010; Cohen et al., 2012; Steinberg et al., 2013; Schultz, 2015). Moreover, a significant number of DANs are known to be spontaneously active (Grace and Bunney, 1984). Studies using microdialysis found that the extracellular dopamine level shows slow fluctuations lasting seconds to minutes without any external stimuli (Schultz, 2007). These dopamine fluctuations are suggested to represent animal states, such as sleep/wake, or motivational state of the animal (Fiorillo et al., 2003; Dahan et al., 2007; Hamid et al., 2016). Dysregulation of dopamine levels causes various mental disorders, suggestive of the crucial role of spontaneously released dopamine in cognition and perception (Krishnan et al., 2007; Cao et al., 2010; Dalley and Roiser, 2012; Chaudhury et al., 2013; Grace, 2016). Although studies in primate and rodent brains have provided us with useful mechanistic insights in spontaneously released dopamine, ultimate behavioral consequences of slow ongoing dopamine activity are less understood due to technical hurdles in achieving non-invasive and precise circuit modulation. In addition, the high-level interconnectivity of the dopaminergic network makes simultaneous manipulation of multiple cells difficult and thus precludes many studies from demonstrating causal relationship.
The brain of the fruit fly Drosophila melanogaster provides useful study cases in this respect. Recent studies clearly go beyond correlating physiological DAN activities and animal states, and have succeeded in examining the effect of spontaneous network activities on behaviors. These include specific DAN types that regulate sleep/wake balance, memory processing, feeding motivation or sexual drive (Berry et al., 2012, 2015; Plaçais et al., 2012; Plaçais and Preat, 2013; Cohn et al., 2015; Musso et al., 2015; Yamagata et al., 2016). Thus, this review mainly focuses on recent achievements mainly in flies, and we discuss potential roles of spontaneous DAN activity and its significance in the regulation of a variety of behaviors.
Sleep and Locomotion
Historical pharmacological studies proved that dopamine determines the arousal level in many animals. For example, methylphenidate and amphetamine, which induce dopamine release, promote arousal in humans and have been used for the treatment of narcolepsy since the 1930s (Billiard, 2008). Consistently, mutant mice with disrupted dopamine transporter (DAT) function, which has a critical role in the reuptake of dopamine, show reduced non-rapid eye movement (non-REM) sleep and increased wakefulness (Wisor et al., 2001). Furthermore, the causal nature of DAN activity in regulating behavioral arousal is gradually being revealed by recent optogenetic studies (Taylor et al., 2016; Oishi et al., 2017).
Results of physiological studies in rodents suggest that spontaneously released dopamine underlies the regulation of the wake-sleep balance. Prominent burst firing of DANs in the ventral tegmental area (VTA) was observed when animals are in REM sleep (Dahan et al., 2007). Activity of dopamine neurons in the ventral periaqueductal gray matter, but not in the VTA or the substantia nigra, is enhanced during wakefulness (Lu et al., 2006). These studies imply that the modulation of arousal is region-specific, but precise circuit level understanding remains to be revealed.
Sleep in Drosophila is defined by prolonged immobility and shows many common features with sleep in humans. Flies subjected to 12 h: 12 h light/dark cycles exhibit behavioral quiescence in >90% of the dark period. Sleep in flies and mammals share many characteristics. Sleeping flies show an increased threshold for sensory stimuli, and sleep deprivation by mechanical stress causes a “rebound” effect. (Hendricks et al., 2000; Shaw et al., 2000). Notably, some somnolytic drugs known to function through the human dopamine system affect Drosophila sleep (McClung and Hirsh, 1998; Bainton et al., 2000; Li et al., 2000; Andretic et al., 2005; Lebestky et al., 2009; Nall et al., 2016). Consistently, a fly strain that was isolated for its short-sleep phenotype was found to have a mutation in DAT, highlighting the importance of dopamine in wake/sleep regulation (Kume et al., 2005).
Until recently, the circuit mechanisms by which dopamine regulates arousal levels have been unknown. Spontaneous activity of specific types of DANs correlates well with the locomotive state of an animal and has a significant role in the regulation of the wake/sleep state (Berry et al., 2015; Cohn et al., 2015). The wake-promoting DANs project their axon terminals to two major neural structures: the dorsal fan-shaped body (dFB) and the mushroom body (MB). Below, we describe recent findings in these neural circuits.
The Dorsal Fan-Shaped Body Circuit
Dopamine released on the dorsal fan-shaped body (dFB) has a central role in the regulation of the sleep-wake balance. A single pair of DANs projecting to the dFB promotes wakefulness, and dopamine receptors are necessary in the dFB neurons to process the waking signal (Liu et al., 2012; Pimentel et al., 2016). Additional physiological experiments revealed that the spontaneous activity of DANs is increased during wakefulness (Liu et al., 2012). In contrast, the downstream dFB neurons are considered sleep-promoting (Donlea et al., 2011, 2014; Ueno et al., 2012), and are inhibited upon dopamine input (Pimentel et al., 2016). Interestingly, the membrane properties of dFB neurons reflect the animal's sleep need: sleep deprivation by continuous mechanical stress lowers the threshold to spike generation and thus increases sleep-inducing dFB neuron excitability (Donlea et al., 2014). This change is controlled by dopamine: sustained artificial activation of the DANs or sustained dopamine application for several minutes shift the states of these neurons from electrically excitable to quiescence (Pimentel et al., 2016). Therefore, spontaneous activity of these DANs regulates present and future sleep/wake balance, depending on the animal's sleep need.
The Mushroom Body Circuit
Besides the importance of the dFB circuit, the MB also has a critical role in the regulation of sleep (Joiner et al., 2006; Pitman et al., 2006). The MB is primarily composed of ~2,000 Kenyon cells (KCs) (Aso et al., 2009), which are presynaptic to ~20 types of mushroom body output neurons (MBONs) (Aso et al., 2014a). There are ~20 types of DANs that innervate the MB, each of which projects to a confined region of the MB, thereby controlling specific segments of the MB neurons and MBONs (Aso et al., 2014a; Hige et al., 2015). These DANs originate mainly from two clusters called PAM and PPL1 (Mao and Davis, 2009).
Berry et al. (2015) demonstrated how specific DANs, which innervate the MB-γ2α'1 compartment and are also called MB-MV1 (just MV1 hereafter; also known as PPL1-γ2α'1, show spontaneous activity that correlates with the locomotive state of the animal; namely, the calcium activity was upregulated during the walking bout (Figure 1A). Similarly, Cohn et al. (2015) found that another DAN type innervating the γ3 compartment, in addition to MV1, becomes also active during a walking bout (Figure 1B). Interestingly, spontaneous activity of DAN types innervating adjacent MB compartments (γ4 and γ5) was conversely shown to be suppressed during walking. Importantly, these DANs also respond to external stimuli such as sugar reward or electric shock in a cell-type specific manner. Therefore, both the internal locomotive state and external stimuli are integrated by the same DANs, each of which modifies a specific subdomain in the MB.
Figure 1. Correlative spontaneous DAN activity with the locomotive state. (A) Correlation between locomotive state and DAN activity. Left: Walking activity of a fly was monitored by observing the rotation of the ball during the calcium imaging of defined DAN types (MV1). Right: Walking activity of a fly (top) and calcium responses of MV1 (bottom). MV1 shows strong activity during walking bout. (B) Correlative and anti-correlative DAN activities with flailing. Left: Calcium responses of different DAN types innervating different MB compartments (γ2-γ5, top), and locomotive activity of a head-fixed fly (bottom). Dashed lines delineate the start and cessation of a single flailing bout. Right: Two activity states of a fly during imaging (still and flail). Modified from Berry et al. (2015) and Cohn et al. (2015) with a permission.
A series of experiments performed by Sitaraman et al. gives a hint of how the wake-promoting DANs exert their function (Aso et al., 2014b; Sitaraman et al., 2015a,b). Artificial activation of specific MBON types (MBON-γ5β'2, -β'2mp, and -γ4>γ1γ2), which have cell-type specific projection patterns, promotes arousal (Aso et al., 2014b; Sitaraman et al., 2015a). Interestingly, these wake-promoting MBON types receive inputs from and are activated by wake-promoting DANs (Sitaraman et al., 2015b). Note that another MBON type (MBON-γ2α'1) in contrast promotes sleep (Aso et al., 2014b; Sitaraman et al., 2015a), although the wake-promoting MV1 project its terminals to the compartment. How MV1 wakes animals has to be answered by future studies. Altogether, DANs seem to control sleep and locomotion by integrating internal states and external stimuli.
Learning and Memory
Motivation and Memory-Guided Behavior
It is widely acknowledged that tonic DAN activity is also involved in motivation. Microdialysis studies have demonstrated that dopamine release in slow temporal scales (tens of minutes) strongly correlates with the behavioral activity of rats (Freed and Yamamoto, 1985). Minute-by-minute dopamine levels in the nucleus accumbens correlate with an amount of reward in time and motivational vigor (Hamid et al., 2016). Sustained and ramping dopamine signaling occurs in mice moving toward predictable reward in tasks involving self-paced behavior (Howe et al., 2013). These observations collectively suggest that spontaneous DAN activity subserves motivational control of both innate and memory-guided behaviors.
How does the spontaneous DAN activity regulate learning? Recent findings in Drosophila give a hint for the mechanism. In flies, appetitive memory trace is thought to be localized at the synapses between Kenyon cells and MBONs (Heisenberg, 2003). The retrieval of this memory is largely dependent on the hunger state of flies (Krashes et al., 2009; Gruber et al., 2013). Krashes et al. (2009) demonstrated that such a hunger regulation is controlled by the activity of a single class of DAN cell type, called MB-MP1 (just MP1 hereafter; also known as PPL1-γ1pedc>α/β). An artificial activation of the MP1 in hungry flies during memory retrieval phase blocked the expression of memory. In contrast, a transient blockade of the same neurons restored memory expression in satiated flies. A follow-up study by the same group showed that the activity of MBONs in the corresponding MB compartment (MBON-γ1pedc>α/β) gates the expression of appetitive memory (Perisse et al., 2016). Therefore the γ1 compartment may have a central role in controlling the memory-based behavior, reflecting the huger motivation. Whether the DAN activity shapes the activity of pre- or post-synapses of the local circuitry between KC and MBON remains to be clarified in future, as both KCs and MBON can be targeted by DANs in the local circuitry of the MB lobe (Takemura et al., 2017).
Acquisition
Besides stimulus-induced burst firing, accumulating physiological evidence revealed that spontaneous DAN activity is suppressed by the presentation of reinforcing stimuli (Brischoux et al., 2009; Matsumoto and Hikosaka, 2009; Fiorillo, 2013). This suppression can trigger memory formation: in mice, it has recently been demonstrated that repeated optogenetic silencing of spontaneous VTA DAN activity can induce place aversion (Danjo et al., 2014). Also in rats, brief suppression of spontaneous DAN activity in the VTA can substitute for negative prediction error (Chang et al., 2016), indicative of an importance of spontaneous dopamine release in reinforcement signaling.
One of the major input sources of inhibitory regulation of VTA DANs is afferents from the rostromedial tegmental nucleus (RMTg) (Jhou et al., 2009; Bourdy and Barrot, 2012; Tan et al., 2012; van Zessen et al., 2012). These GABAergic RMTg neurons receive excitatory inputs from structures implicated in aversive processing (Matsumoto and Hikosaka, 2007; Hong et al., 2011). These anatomical and functional studies in mammals provide a basic explanation for how spontaneous DAN activity can be suppressed (Danjo et al., 2014; Chang et al., 2016). However, the reinforcing property of changes in spontaneous activity of defined DANs is largely unclear.
In Drosophila, distinct DANs consisting of identified cell types mediate positive or negative valences (Aso et al., 2012; Lin et al., 2014; Huetteroth et al., 2015; Yamagata et al., 2015; Aso and Rubin, 2016). It has recently been demonstrated that these valence-encoding DANs are spontaneously active (Berry et al., 2015; Cohn et al., 2015), and are dynamically tuned by external stimuli as well as the behavioral state of an animal (Figure 1). In accordance, PAM-γ3, a class of DANs projecting to the third segment of the MB γ lobe, was shown to have fluctuating baseline activity that is suppressed upon sugar ingestion (Figure 2; Yamagata et al., 2016). Interestingly, this ingestion-induced suppression of PAM-γ3 activity lasted even after the presentation of sugar reward (Figure 2B). Furthermore, transient thermogenetic and optogenetic inactivation of the PAM-γ3 was sufficient to induce appetitive memory while activation induced aversive memory (Yamagata et al., 2016). Thus, these results suggested that the spontaneous activity of PAM-γ3 represents the feeding states and that feeding drives associative memories by changing PAM-γ3 activity states regardless of increase or decrease.
Figure 2. Sucrose reward suppresses the spontaneous activity of PAM-γ3. (A) Representative images of raw fluorescence of GCaMP expressed in the PAM-γ3 DANs (top), baseline activity (middle), and calcium responses to sucrose stimulation (bottom). (B) Time course of the fluorescence signal. The black bar represents the sucrose presentation. Spontaneous DAN activity is suppressed by the sucrose presentation. (C) Average calcium responses to sucrose presentation. Sucrose intake significantly reduces the activity level of PAM-γ3. Modified from Yamagata et al. (2016).
Suppression of PAM-γ3 was mediated by a satiety-signaling neuropeptide, Allatostatin A (AstA) (Hergarden et al., 2012; Hentze et al., 2015; Chen et al., 2016), which is known to be a potent inhibitory neuromodulator (Birgül et al., 1999). AstA expressing neurons innervate dendritic region of the PAM-γ3, which express the AstA cognate receptor DAR-1 (Lenz et al., 2000; Yamagata et al., 2016). In contrast to aversive memory formation by PAM-γ3, activation of AstA neurons induced appetitive memory, suggesting that AstA negatively regulates PAM-γ3 spontaneous activity (Yamagata et al., 2016). Consistent with this hypothesis, down-regulation of DAR-1 expression in PAM-γ3 diminished the feeding-induced suppression of the activity. Altogether, simultaneous recording and genetic manipulation of a DAN population in the fly brain revealed the network dynamics that determines valence (Cohn et al., 2015; Yamagata et al., 2016).
Memory Consolidation
Psychostimulants that augment dopamine signaling are known to facilitate memory consolidation. For example, avoidance learning in rats is enhanced by post-training administration of amphetamine, which increases dopamine signaling (McGaugh and Roozendaal, 2009). Post-training cocaine exposure similarly enhances consolidation of spatial memory in mice (Iniguez et al., 2012). In addition, intrahippocampal application of the D1R agonist at definite post-learning time points converts a rapidly decaying fear LTM into a persistent one (Rossato et al., 2009), suggesting a critical role for dopamine signaling in memory consolidation.
In Drosophila, a functional linkage between spontaneous activity of identified DANs and memory consolidation has been demonstrated. Plaçais et al. (2012) found that two pairs of DANs, MP1 and MV1, exhibit slow Ca2+ oscillations (~0.1 Hz) without external stimuli. In flies, repetitive training of paired presentations of odor cues and electric shocks with intervals (spaced training) is commonly used for the induction of aversive LTM (Tully et al., 1994). The authors found the regularity of slow Ca2+ oscillations to be enhanced after spaced training. Strikingly, suppression of the synaptic transmission of MP1 and MV1 after training diminished the formation of LTM, suggestive of a critical role of the spontaneous activity of specific DANs in memory consolidation. Since spontaneous activity of MP1 is also required for the consolidation of appetitive LTM (Musso et al., 2015), a general role may be imposed for the neural class in consolidating a labile memory into a stable, long-lasting one.
Spontaneous activity of MP1 and MV1 reflects the nutrient condition of an animal. In flies, the formation of aversive LTM depends on the animal's post-learning nutrient state (Hirano et al., 2013; Plaçais and Preat, 2013). This is because LTM formation is energetically costly and thus its induction is inhibited upon energy shortage (Plaçais and Preat, 2013). In accordance, the slow oscillation of MP1 and MV1 occurs only in fed flies after spaced training (Figure 3), which fits with the idea that MP1 mediates hunger motivation (see memory retrieval section). Intriguingly, driving MP1 and MV1 activity in starved flies after learning could still induce aversive LTM at the price of survival duration upon starvation, highlighting an obvious trade-off between survival and LTM formation (Mery and Kawecki, 2005; Plaçais and Preat, 2013). Thus, spontaneous activity of these DANs after memory acquisition can act as a homeostatic feedback mechanism to regulate energy state and memory consolidation.
Figure 3. MV1 and MP1 DAN activity represents nutritive state of a fly. (A) Spontaneous calcium fluctuation of MV1 and MP1 DANs in fed or starved flies after spaced conditioning using electric shocks and odors. Strong calcium oscillation is observed in fed (yellow), but not in starved (green), flies. (B) Average power spectra of the spontaneous DAN activity in fed or starved flies. Fed flies exhibit a characteristic peak, revealing an oscillatory behavior that is absent in starved flies. Modified from Plaçais and Preat (2013) with a permission.
Spontaneous activity of MP1 and MV1 has been implicated also in forgetting of short-lasting aversive memory in flies (Berry et al., 2012, 2015). Artificial activation of those DAN classes after a single training period promoted memory loss (Berry et al., 2012). Conversely, the blockade of these DANs increased the persistence of labile memory. Similar function is also imposed by a neural class belonging to the PAM cluster DANs, called PAM-β'1. Thermal activation of PAM-β'1 after learning promoted aversive memory loss (Shuai et al., 2015). Note that the identical DANs, MP1 and MV1, on one hand consolidate long-term aversive memory (Plaçais et al., 2012), while on the other hand promote forgetting short-lasting memories. Plaçais et al. (2012) showed that the memory component affected by post-training dopamine input is anesthesia-resistant memory. Intriguingly, spontaneous activity of MV1 also reflects the wake/sleep state of flies (see above Berry et al., 2015) while sleep prevents memory forgetting by blocking spontaneous activity of MV1. Given such a tight connection between sleep and mnemonic processes (Dissel et al., 2015; Haynes et al., 2015), it is plausible that the spontaneous activity of MV1 acts as a hub to link internal sleep need and memory maintenance processes.
Also in mammals, accumulating physiological evidence points to the importance of spontaneous firing of DANs in memory consolidation. For instance, spontaneous firing of VTA DANs is increased during REM sleep (Dahan et al., 2007), and is coordinated with quiet wakefulness-associated hippocampal sharp wave-ripples (Gomperts et al., 2015), which is believed to be crucial for memory consolidation (Siegel, 2001). A functional loop between the hippocampus and the VTA dopaminergic neurons was thus suggested to be crucial in post-learning DAN activity (Lisman and Grace, 2005; Gruber et al., 2016), although specific neural circuits still remain to be elucidated.
In Drosophila, a comprehensive anatomical study identified many feedback connections from the MB to DANs through MBONs (Aso et al., 2014a). Thus, reinforcing DANs projecting to the MB may provide an optimal study case to test the importance of the feedback regulation for memory consolidation. We previously found that a single DAN type innervating the α1 compartment (PAM-α1) has a critical role in signaling reward for appetitive LTM (Yamagata et al., 2015). Interestingly, PAM-α1 undergoes the direct recurrent regulation by MBON-α1, which has dendrites in the α1 compartment of the MB (Aso et al., 2014a; Ichinose et al., 2015). Indeed, transient blockade of neuronal components participating in this α1 feedback circuit during conditioning and early memory consolidation phase impaired appetitive LTM (Ichinose et al., 2015). This demonstrated the necessity of this recurrent circuit for LTM formation and consolidation, and suggests coordinated reverberating activity triggered by associative training (Ichinose et al., 2015). Therefore, further studies on direct measurement of post-training spontaneous activity would provide mechanistic insights to behavioral requirements of this circuit. Similar to the feedback loop between PAM-α1 and MBON-α1 for the formation and consolidation of appetitive memory, MP1 and MV1 mediate punitive reinforcement signals and are required for the consolidation of aversive memory (Claridge-Chang et al., 2009; Aso et al., 2012; Plaçais et al., 2012; Aso and Rubin, 2016). Therefore, the functional analysis of analogous recurrent circuits in aversive memory would be informative in examining the importance of this motif of dopaminergic circuits in memory formation/consolidation.
Feeding
Dopamine is heavily involved in controlling feeding behaviors. For instance, dopamine deficient mice exhibit hypophagia, which is restored by the administration of L-DOPA (Zhou and Palmiter, 1995) or genetic rescue of dopamine production by the overexpression of tyrosine hydroxylase (Szczypka et al., 2001). The excitatory orexin inputs from the lateral hypothalamus, a neuroanatomical substrate critical for feeding (Stuber and Wise, 2016), regulate activity of VTA DANs (Aston-Jones et al., 2010). Although a causal link between spontaneous activity of VTA DANs and feeding control has been behaviorally demonstrated (van Zessen et al., 2012), mechanisms by which this activity is translated into feeding behavior are still largely unknown.
In Drosophila, activity of a specific class of DANs, called TH-VUM, innervating the suboesophageal ganglion (SEG), a gustatory center in the insect brain, is reported to control taste sensitivity to sucrose (Marella et al., 2012). Suppression of TH-VUM activity reduced the sensitivity while activation increased it. Strikingly, TH-VUM exhibits spontaneous activity that is upregulated upon starvation, thereby increasing responsiveness of an animal to sugar. Inagaki et al. (2012) demonstrated that starvation-induced dopamine release alters the sensitivity of sugar-sensing gustatory neurons (GRNs). On the other hand, it has been shown that spontaneous activity of a class of neurons releasing octopamine, which is an invertebrate counterpart of noradrenaline (Roeder, 1999), in the SEG, called OA-VL (Busch et al., 2009), confers bitter taste sensitivity to flies (LeDue et al., 2016). In contrast to TH-VUM, the activity of OA-VL potentiates bitter-sensing GRNs and is downregulated by starvation. In this way, starvation modulates basal dopamine and octopamine levels to control sensitivity to sweet and bitter compounds, respectively. Antagonizing activity of OA-VL and TH-VUM may thus coordinate to set a threshold for the acceptance of foods by flies.
Flies sense amino acids in food. Spontaneous activity of DANs in protocerebral posterior medial 2 (PPM2) cluster encode protein hunger (Liu et al., 2017). The activity of these neurons is upregulated after protein deprivation, and is necessary and sufficient for protein preference. Interestingly, these neurons change not only the spontaneous firing rate but also its morphology, resulting in increased number of connections with the downstream target upon amino acid deprivation. In larvae, brain DANs spanning three clusters (DM1, DM2 and DL1) also detect amino acid imbalance to reject essential amino acid-deficient diet (Bjordal et al., 2014), though this occurs based on stimulus induced DAN activity. Taken together, feeding motivation of two of the important nutrient factors, sugar and protein, is separately regulated by different DANs that monitor the need of the animal.
Sex Drive
Drugs targeting the dopamine system are known to have side effects on human sexual behavior. Spontaneous ejaculations have been reported as a side effect in patients taking Aripiprazole, which is a partial agonist of the D2 receptor (EGILmez et al., 2016). Hypersexuality and excessive masturbation in children and spontaneous erections in adults have been reported by patients taking methylphenidate (also known as Ritalin) (Bilgic et al., 2007), which primarily acts as a norepinephrine-dopamine reuptake inhibitor. Although these observations suggest a tight relationship existing between dopamine and sexual behavior (Melis and Argiolas, 1995), a functional link between spontaneous DAN activity and sexual drive has yet to be clarified in mammals.
In Drosophila, dopamine levels modulate both the mating drive of males as well as sexual receptivity of females: dopamine-deficient males and females respectively court and accept males less, which can be restored by L-DOPA administration (Neckameyer, 1998; Liu et al., 2008). Male flies administered methamphetamine show extremely high courtship activity, yet the latency to copulation is increased (Andretic et al., 2005). Mating drive of males is tightly regulated by their reproductive state: repeated mating progressively reduces his sexual vigor (Zhang et al., 2016). Importantly, spontaneous Ca2+ activity in a small subset of DANs that include aSP4 neurons in the PAL cluster are cumulatively decreased by repeated mating (Zhang et al., 2016), indicating that reproductive state is represented by the level of spontaneous activity in them. Another report suggests dopamine production in the yet another class of DANs, called PPL2ab neurons, is critical to maintain courtship activity in aged males (Kuo et al., 2015). Thus, aSP4 and PPL2ab DANs can act cooperatively for the control of sexual vigor in male flies. The target of such a motivational signal can be a group of ~20 Fruitless-expressing neurons per hemisphere called P1 (Zhang et al., 2016). P1 is a male-specific neuronal cluster that has been identified as a putative trigger center for male-type courtship behavior (Kohatsu et al., 2011; Yamamoto and Koganezawa, 2013). In accordance, protocerebral innervations of P1 and aSP4 overlap and form putative synapses (Zhang et al., 2016). Strikingly, knocking down a subtype of dopamine receptor in the P1 significantly attenuates male's courtship behaviors. It is thus conceivable that spontaneous DAN activity modulates the excitability of P1 to control sexual vigor depending on motivational state. Interestingly, this regulatory mechanism of P1 is a reminiscent of sleep/wake control in dFB, activity of which is regulated by spontaneously active DANs that reflect sleep need. Therefore, one of the major functions of spontaneous DAN activity is to represent distinct motivational states and to shape corresponding behavior by modulating the activity of key behavior-executing neurons, such as P1 or dFB.
Detection of Spontaneous DAN Activity
Spontaneous activity of DANs has to be interpreted by receiving neurons through receptors. Dopamine receptors can be grouped into five classes of the guanine nucleotide-binding protein-coupled receptors (GPCRs): D1- to D5-type receptors (D1R–D5R). It is commonly accepted that D1R and D5R mainly recruit the Gαs to stimulate cAMP production by adenylyl cyclase, and D2R, D3R, and D4R the Gαi/o to inhibit (Beaulieu and Gainetdinov, 2011). In mammals, the inhibitory receptors show higher affinity to dopamine than the excitatory ones, and thus are suggested to play the main role in detecting the slow, tonic DAN activity (Grace et al., 2007). These inhibitory receptors are reported to be involved in the detection of wake-promoting dopamine release (Qu et al., 2010) and spontaneous activity of the value coding midbrain DANs (Bromberg-Martin et al., 2010). However, the generality and its intracellular signaling events are largely unknown.
In Drosophila, four dopamine receptors, DopR1 (also known as dDA1, DUMB), Dop2R, DopR2 (also known as DAMB, DopR99B) and DopEcR exist in the genome (Adams et al., 2000). Sequence homology with mammalian dopamine receptors suggests that DopR1 and Dop2R are D1- and D2- like, respectively, and the other two are invertebrate-specific (Mustard et al., 2005). Measurement of DopR2 in Xenopus oocyte suggested it to be excitatory (Reale et al., 1997), but recent studies suggested that it can be variable among cell types (see below). DopEcR increases cAMP upon binding to dopamine, and binds to insect steroid hormone ecdysone in addition (Srivastava et al., 2005). Affinity of these four receptors to dopamine has been respectively measured in vitro but with different cell lines, and never been directly compared. It is thus important to measure the threshold of these receptors for correct interpretation of functional results.
Nonetheless, accumulating behavioral and physiological evidence suggests the critical role of DopR2 in the detection of spontaneous activity of DANs. DopR2 was shown to be critical in regulation of sleep in the dFB (Pimentel et al., 2016), memory maintenance (Berry et al., 2012; Musso et al., 2015; Plaçais et al., 2017), and sex drive (Zhang et al., 2016). We will review these cases one by one.
Exquisite in-vivo electrophysiology experiments demonstrated that DopR2 in the dFB neurons mediates the wake-promoting dopamine signaling (Pimentel et al., 2016). This study further provided unexpected evidence that DopR2 in the dFB neurons employs Gαo and thereby hyperpolarizes the membrane potential through modulating specific K+ channels (Pimentel et al., 2016). These results together with biochemistry experiments in vitro (Han et al., 1996) suggest that the nature of DopR2—excitatory or inhibitory—can be variable among cell types and imply recruitment of different Gα proteins through forming heteromeric receptor complexes.
DopR2 in the MB is also responsible for detecting the spontaneous activity of MV1 or MP1 DANs during memory maintenance (Berry et al., 2012; Musso et al., 2015; Plaçais et al., 2017). It is critical to mediate the forgetting signal of aversive short-term memory (Berry et al., 2012). It detects the nutritive value of sugar reward in appetitive conditioning to consolidate memory (Musso et al., 2015). Furthermore, it triggers energy influx to the MB that is critical for aversive LTM formation after spaced conditioning (see also above) (Plaçais et al., 2017). Strikingly, this receptor is responsible for subcellular modulation of Kenyon cell outputs in the MB lobes (Cohn et al., 2015). Not only in the MB, but also in the lateral accessary lobe DopR2 mediates increased protein feeding after protein deprivation (Liu et al., 2017). Sex drive is also regulated by DopR2 expressed in P1 neurons, which trigger male courtship behaviors (Kimura et al., 2008; Zhang et al., 2016). These studies collectively highlight a wide range of functions controlled by this receptor through detection of ongoing activity of DANs.
Two of the recent studies in Drosophila addressed intracellular signaling molecules that mediate the effect of spontaneous DAN activity (Cervantes-Sandoval et al., 2016; Pimentel et al., 2016). Pimentel et al. (2016) showed that dopamine/DopR2 signaling switches sleep-promoting dFB neurons from the state of excitability to one of quiescence by mobilizing potassium channels to the plasma membrane. This switch is mediated by heterotrimeric G proteins of the Gαo family (Thambi et al., 1989; Pimentel et al., 2016), which deviates from the measurement in the Xenopus oocyte system (Reale et al., 1997). Since individual mammalian GPCRs have been demonstrated to engage multiple G proteins with varying efficacy and kinetics in a cell-specific manner, DopR2 might function as a D2-like receptor under some conditions. Cervantes-Sandoval et al. (2016) described another example of intracellular signaling events in the context of memory forgetting. Upon binding to dopamine, DopR2 activates a small GTPase, Rac1, which had been identified by another group to induce forgetting of memory (Shuai et al., 2010). This activation is mediated by a scaffold protein, Scribbled, which also can activate Pak3 and cofilin, which are key proteins in regulating actin dynamics. Altogether, Rac1, Pak3 and cofilin may thus produce necessary cytoskeletal modifications that underlie neural remodeling and consequential forgetting.
Conclusion
In this article, we have reviewed diverse functions of spontaneous activity of DANs, paying special attention to recent Drosophila studies. Importantly, different internal animal states, e.g., hunger, sleep need, or sexual drive, are represented by different yet partially overlapping DAN cell types. This combinatorial state coding is reminiscent of various reinforcement signals conveyed by different combinations of DANs (Aso et al., 2012; Lin et al., 2014; Huetteroth et al., 2015; Yamagata et al., 2015; Aso and Rubin, 2016). Therefore, regardless of its spontaneous or stimulus-induced origins, activity patterns of different DAN types might together be a key determinant for state-dependent behavior and action selection (Figure 4). Investigation of circuits influencing DAN activities is thus critical for understanding the cellular basis of behavioral and physiological states.
Figure 4. Activity pattern of a single DAN population biases behavioral choice. Particular behavioral responses are preferred when certain combinations of DAN types are spontaneously active. DAN activity reflects the physiological and psychological state of an animal and optimizes behaviors.
In some cases, spontaneous DAN activity functions as an information filter to enable animals to respond differently to the same sensory input, such as food, food-associated cues or potential mating partners, depending on the physiological state (Inagaki et al., 2012; Marella et al., 2012; Kuo et al., 2015; Zhang et al., 2016). Similar function of DANs to bias information flow is observed in mammalian systems (Grace et al., 2007). In addition, the spontaneous activity of specific DAN types controls ongoing spontaneous locomotor activity depending on sleep need (Donlea et al., 2011; Liu et al., 2012; Sitaraman et al., 2015b). Importantly, partially overlapping yet different combinations of DANs have an additional role in memory formation, consolidation and forgetting (Berry et al., 2012; Plaçais et al., 2012; Ichinose et al., 2015; Musso et al., 2015; Shuai et al., 2015; Yamagata et al., 2016), suggestive of the close relationship between sleep and memory formation or maintenance (Berry et al., 2015; Dissel et al., 2015). Taken together, spontaneous DAN activity patterns seem to represent both the past and present states of the animal thereby biasing behavior selection. By exploiting state-of-art genetic techniques, future studies should likely decode how animal behavior is optimized by spontaneous DAN activity.
Author Contributions
TI, HT, and NY wrote the manuscript and designed the figures.
Funding
This work was supported by Grant-in-aid for JSPS research fellow (TI), MEXT/JSPS KAKENHI (16K20919 to TI; 17H04765 to NY; 17H01378, 16H01496, 17H0554 to HT), Naito Foundation (HT), and Uehara Memorial Foundation (HT).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Drs. Ronald L. Davis (Scripps Florida), Vanessa Ruta (The Rockefeller University), Thomas Preat and Pierre-Yves Plaçais (ESPCI Paris) for generously sharing their original figures for the modification and usage in this manuscript. We also thank Dr. Masayuki Koganezawa and Mr. Daniel Rindner (Tohoku University) for critical reading and comments on the manuscripts.
References
Adams, M. D., Celniker, S. E., Holt, R. A., Evans, C. A., Gocayne, J. D., Amanatides, P. G., et al. (2000). The genome sequence of Drosophila melanogaster. Science 287, 2185–2195. doi: 10.1126/science.287.5461.2185
Andretic, R., van Swinderen, B., and Greenspan, R. J. (2005). Dopaminergic modulation of arousal in Drosophila. Curr. Biol. 15, 1165–1175. doi: 10.1016/j.cub.2005.05.025
Aso, Y., Grubel, K., Busch, S., Friedrich, A. B., Siwanowicz, I., and Tanimoto, H. (2009). The mushroom body of adult Drosophila characterized by GAL4 drivers. J. Neurogenet. 23, 156–172. doi: 10.1080/01677060802471718
Aso, Y., Hattori, D., Yu, Y., Johnston, R. M., Iyer, N. A., Ngo, T. T., et al. (2014a). The neuronal architecture of the mushroom body provides a logic for associative learning. eLife 3:e04577. doi: 10.7554/eLife.04577
Aso, Y., Herb, A., Ogueta, M., Siwanowicz, I., Templier, T., Friedrich, A. B., et al. (2012). Three dopamine pathways induce aversive odor memories with different stability. PLoS Genet. 8:e1002768. doi: 10.1371/journal.pgen.1002768
Aso, Y., and Rubin, G. M. (2016). Dopaminergic neurons write and update memories with cell-type-specific rules. eLife 5:e16135. doi: 10.7554/eLife.16135
Aso, Y., Sitaraman, D., Ichinose, T., Kaun, K. R., Vogt, K., Belliart-Guerin, G., et al. (2014b). Mushroom body output neurons encode valence and guide memory-based action selection in Drosophila. eLife 3:e04580. doi: 10.7554/eLife.04580
Aston-Jones, G., Smith, R. J., Sartor, G. C., Moorman, D. E., Massi, L., Tahsili-Fahadan, P., et al. (2010). Lateral hypothalamic orexin/hypocretin neurons: a role in reward-seeking and addiction. Brain Res. 1314, 74–90. doi: 10.1016/j.brainres.2009.09.106
Bainton, R. J., Tsai, L. T., Singh, C. M., Moore, M. S., Neckameyer, W. S., and Heberlein, U. (2000). Dopamine modulates acute responses to cocaine, nicotine and ethanol in Drosophila. Curr. Biol. 10, 187–194. doi: 10.1016/S0960-9822(00)00336-5
Beaulieu, J. M., and Gainetdinov, R. R. (2011). The physiology, signaling, and pharmacology of dopamine receptors. Pharmacol. Rev. 63, 182–217. doi: 10.1124/pr.110.002642
Berridge, C. W., Schmeichel, B. E., and Espana, R. A. (2012). Noradrenergic modulation of wakefulness/arousal. Sleep Med. Rev. 16, 187–197. doi: 10.1016/j.smrv.2011.12.003
Berry, J. A., Cervantes-Sandoval, I., Chakraborty, M., and Ronald Davis, L. (2015). Sleep facilitates memory by blocking dopamine neuron-mediated forgetting. Cell 161, 1656–1667. doi: 10.1016/j.cell.2015.05.027
Berry, J. A., Cervantes-Sandoval, I., Nicholas, E. P., and Davis, R. L. (2012). Dopamine is required for learning and forgetting in Drosophila. Neuron 74, 530–542. doi: 10.1016/j.neuron.2012.04.007
Bilgic, A., Gurkan, K., and Turkoglu, S. (2007). Excessive masturbation and hypersexual behavior associated with methylphenidate. J. Am. Acad. Child Adolesc. Psychiatry 46, 789–790. doi: 10.1097/chi.0b013e318059360a
Billiard, M. (2008). Narcolepsy: current treatment options and future approaches. Neuropsychiatr. Dis. Treat. 4, 557–566. doi: 10.2147/NDT.S484
Birgül, N., Weise, C., Kreienkamp, H. J., and Richter, D. (1999). Reverse physiology in drosophila: identification of a novel allatostatin-like neuropeptide and its cognate receptor structurally related to the mammalian somatostatin/galanin/opioid receptor family. EMBO J. 18, 5892–5900. doi: 10.1093/emboj/18.21.5892
Bjordal, M., Arquier, N., Kniazeff, J., Jean Pin, P., and Léopold, P. (2014). Sensing of amino acids in a dopaminergic circuitry promotes rejection of an incomplete diet in Drosophila. Cell 156, 510–521. doi: 10.1016/j.cell.2013.12.024
Bourdy, R., and Barrot, M. (2012). A new control center for dopaminergic systems: pulling the VTA by the tail. Trends Neurosci. 35, 681–690. doi: 10.1016/j.tins.2012.06.007
Brischoux, F., Chakraborty, S., Brierley, D. I., and Ungless, M. A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. U.S.A. 106, 4894–4899. doi: 10.1073/pnas.0811507106
Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815–834. doi: 10.1016/j.neuron.2010.11.022
Busch, S., Selcho, M., Ito, K., and Tanimoto, H. (2009). A map of octopaminergic neurons in the Drosophila brain. J. Comp. Neurol. 513, 643–667. doi: 10.1002/cne.21966
Cao, J. L., Covington, H. E. III., Friedman, A. K., Wilkinson, M. B., Walsh, J. J., Cooper, D. C., et al. (2010). Mesolimbic dopamine neurons in the brain reward circuit mediate susceptibility to social defeat and antidepressant action. J. Neurosci. 30, 16453–16458. doi: 10.1523/JNEUROSCI.3177-10.2010
Cervantes-Sandoval, I., Chakraborty, M., MacMullen, C., and Ronald Davis, L. (2016). Scribble scaffolds a signalosome for active forgetting. Neuron 90, 1230–1242. doi: 10.1016/j.neuron.2016.05.010
Chang, C. Y., Esber, G. R., Marrero-Garcia, Y., H.-,Yau, J., Bonci, A., and Schoenbaum, G. (2016). Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors. Nat. Neurosci. 19, 111–116. doi: 10.1038/nn.4191
Chaudhury, D., Walsh, J. J., Friedman, A. K., Juarez, B., Ku, S. M., Koo, J. W., et al. (2013). Rapid regulation of depression-related behaviours by control of midbrain dopamine neurons. Nature 493, 532–536. doi: 10.1038/nature11713
Chen, J., Reiher, W., Hermann-Luibl, C., Sellami, A., Cognigni, P., Kondo, S., et al. (2016). Allatostatin a signalling in Drosophila regulates feeding and sleep and is modulated by PDF. PLoS Genet. 12:e1006346. doi: 10.1371/journal.pgen.1006346
Claridge-Chang, A., Roorda, R. D., Vrontou, E., Sjulson, L., Li, H., Hirsh, J., and Miesenbock, G. (2009). Writing memories with light-addressable reinforcement circuitry. Cell 139, 405–415. doi: 10.1016/j.cell.2009.08.034
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B., and Uchida, N. (2012). Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85–88. doi: 10.1038/nature10754
Cohn, R., Morantte, I., and Ruta, V. (2015). Coordinated and compartmentalized neuromodulation shapes sensory processing in Drosophila. Cell 163, 1742–1755. doi: 10.1016/j.cell.2015.11.019
Dahan, L., Astier, B., Vautrelle, N., Urbain, N., Kocsis, B., and Chouvet, G. (2007). Prominent burst firing of dopaminergic neurons in the ventral tegmental area during paradoxical sleep. Neuropsychopharmacology 32, 1232–1241. doi: 10.1038/sj.npp.1301251
Dalley, J. W., and Roiser, J. P. (2012). Dopamine, serotonin and impulsivity. Neuroscience 215, 42–58. doi: 10.1016/j.neuroscience.2012.03.065
Danjo, T., Yoshimi, K., Funabiki, K., Yawata, S., and Nakanishi, S. (2014). Aversive behavior induced by optogenetic inactivation of ventral tegmental area dopamine neurons is mediated by dopamine D2 receptors in the nucleus accumbens. Proc. Natl. Acad. Sci. U.S.A. 111, 6455–6460. doi: 10.1073/pnas.1404323111
Dissel, S., Angadi, V., Kirszenblat, L., Suzuki, Y., Donlea, J., Klose, M., et al. (2015). Sleep restores behavioral plasticity to Drosophila mutants. Curr. Biol. 25, 1270–1281. doi: 10.1016/j.cub.2015.03.027
Dominguez-Lopez, S., Howell, R., and Gobbi, G. (2012). Characterization of serotonin neurotransmission in knockout mice: implications for major depression. Rev. Neurosci. 23, 429–443. doi: 10.1515/revneuro-2012-0044
Donlea, J. M., Pimentel, D., and Miesenbock, G. (2014). Neuronal machinery of sleep homeostasis in Drosophila. Neuron 81, 860–872. doi: 10.1016/j.neuron.2013.12.013
Donlea, J. M., Thimgan, M. S., Suzuki, Y., Gottschalk, L., and Shaw, P. J. (2011). Inducing sleep by remote control facilitates memory consolidation in Drosophila. Science 332, 1571–1576. doi: 10.1126/science.1202249
EGILmez, O., ÇElIK, M., and KalenderoGLu, A. (2016). Spontaneous ejaculations associated with aripiprazole. Aripiprazolle Ilişkili Spontan Ejakülasyonlar. 53, 85–86. doi: 10.5152/npa.2015.9896
Finelli, L. A., Baumann, H., Borbely, A. A., and Achermann, P. (2000). Dual electroencephalogram markers of human sleep homeostasis: correlation between theta activity in waking and slow-wave activity in sleep. Neuroscience 101, 523–529. doi: 10.1016/S0306-4522(00)00409-7
Fiorillo, C. D. (2013). Two dimensions of value: dopamine neurons represent reward but not aversiveness. Science 341, 546–549. doi: 10.1126/science.1238699
Fiorillo, C. D., Tobler, P. N., and Schultz, W. (2003). Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299, 1898–1902. doi: 10.1126/science.1077349
Fox, M. D., and Raichle, M. E. (2007). Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat. Rev. Neurosci. 8, 700–711. doi: 10.1038/nrn2201
Freed, C., and Yamamoto, B. (1985). Regional brain dopamine metabolism: a marker for the speed, direction, and posture of moving animals. Science 229, 62–65. doi: 10.1126/science.4012312
Gomperts, S. N., Kloosterman, F., and Wilson, M. A. (2015). VTA neurons coordinate with the hippocampal reactivation of spatial experience. Elife 4:e05360. doi: 10.7554/eLife.05360
Gorter, J. A., Jagadeesh, S., Gahr, C., Boonekamp, J. J., Levine, J. D., and Billeter, J. C. (2016). The nutritional and hedonic value of food modulate sexual receptivity in Drosophila melanogaster females. Sci. Rep. 6:19441. doi: 10.1038/srep19441
Grace, A. A. (2016). Dysregulation of the dopamine system in the pathophysiology of schizophrenia and depression. Nat. Rev. Neurosci. 17, 524–532. doi: 10.1038/nrn.2016.57
Grace, A. A., and Bunney, B. (1984). The control of firing pattern in nigral dopamine neurons: single spike firing. J. Neurosci. 4, 2866–2876.
Grace, A. A., Floresco, S. B., Goto, Y., and Lodge, D. J. (2007). Regulation of firing of dopaminergic neurons and control of goal-directed behaviors. Trends Neurosci. 30, 220–227. doi: 10.1016/j.tins.2007.03.003
Gruber, F., Knapek, S., Fujita, M., Matsuo, K., Bräcker, L., Shinzato, N., et al. (2013). Suppression of conditioned odor approach by feeding is independent of taste and nutritional value in Drosophila. Curr. Biol. 23, 507–514. doi: 10.1016/j.cub.2013.02.010
Gruber, M. J., Ritchey, M., Wang, S.-F., Manoj Doss, K., and Ranganath, C. (2016). Post-learning hippocampal dynamics promote preferential retention of rewarding events. Neuron 89, 1110–1120. doi: 10.1016/j.neuron.2016.01.017
Hamid, A. A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Vander Weele, C. M., et al. (2016). Mesolimbic dopamine signals the value of work. Nat. Neurosci. 19, 117–126. doi: 10.1038/nn.4173
Han, K.-A., Millar, N. S., Grotewiel, M. S., and Davis, R. L. (1996). DAMB, a novel dopamine receptor expressed specifically in Drosophila mushroom bodies. Neuron 16, 1127–1135. doi: 10.1016/S0896-6273(00)80139-7
Haynes, P. R., Christmann, B. L., and Griffith, L. C. (2015). A single pair of neurons links sleep to memory consolidation in Drosophila melanogaster. eLife 7:4. doi: 10.7554/eLife.03868
Heisenberg, M. (2003). Mushroom body memoir: from maps to models. Nat. Rev. Neurosci. 4, 266–275. doi: 10.1038/nrn1074
Hendricks, J. C., Finn, S. M., Panckeri, K. A., Chavkin, J., Williams, J. A., Sehgal, A., et al. (2000). Rest in Drosophila Is a Sleep-like State. Neuron 25, 129–138. doi: 10.1016/S0896-6273(00)80877-6
Hentze, J. L., Carlsson, M. A., Kondo, S., Nässel, D. R., and Rewitz, K. F. (2015). The neuropeptide allatostatin a regulates metabolism and feeding decisions in Drosophila. Sci. Rep. 5:11680. doi: 10.1038/srep11680
Hergarden, A. C., Tayler, T. D., and Anderson, D. J. (2012). Allatostatin-A neurons inhibit feeding behavior in adult Drosophila. Proc. Natl. Acad. Sci. U.S.A. 109, 3967–3972. doi: 10.1073/pnas.1200778109
Hige, T., Aso, Y., Modi, M. N., Rubin, G. M., and Turner, G. C. (2015). Heterosynaptic plasticity underlies aversive olfactory learning in Drosophila. Neuron 88, 985–998. doi: 10.1016/j.neuron.2015.11.003
Hirano, Y., Masuda, T., Naganos, S., Matsuno, M., Ueno, K., Miyashita, T., et al. (2013). Fasting launches CRTC to facilitate long-term memory formation in Drosophila. Science 339, 443–446. doi: 10.1126/science.1227170
Hong, S., Jhou, T. C., Smith, M., Saleem, K. S., and Hikosaka, O. (2011). Negative reward signals from the lateral habenula to dopamine neurons are mediated by rostromedial tegmental nucleus in primates. J. Neurosci. 31, 11457–11471. doi: 10.1523/JNEUROSCI.1384-11.2011
Howe, M. W., Tierney, P. L., Sandberg, S. G., Phillips, P. E. M., and Graybiel, A. M. (2013). Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500, 575–579. doi: 10.1038/nature12475
Huetteroth, W., Perisse, E., Lin, S., Klappenbach, M., Burke, C., and Waddell, S. (2015). Sweet taste and nutrient value subdivide rewarding dopaminergic neurons in Drosophila. Curr. Biol. 25, 751–758. doi: 10.1016/j.cub.2015.01.036
Ichinose, T., Aso, Y., Yamagata, N., Abe, A., Rubin, G. M., and Tanimoto, H. (2015). Reward signal in a recurrent circuit drives appetitive long-term memory formation. Elife 4:e10719. doi: 10.7554/eLife.10719
Inagaki, H. K., Ben-Tabou de-Leon, S., Wong, A. M., Jagadish, S., Ishimoto, H., Barnea, G., et al. (2012). Visualizing neuromodulation in vivo: TANGO-mapping of dopamine signaling reveals appetite control of sugar sensing. Cell 148, 583–595. doi: 10.1016/j.cell.2011.12.022
Iniguez, S. D., Charntikov, S., Baella, S. A., Herbert, M. S., Bolanos-Guzman, C. A., and Crawford, C. A. (2012). Post-training cocaine exposure facilitates spatial memory consolidation in C57BL/6 mice. Hippocampus 22, 802–813. doi: 10.1002/hipo.20941
Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., and Holland, P. C. (2009). The Rostromedial Tegmental Nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61, 786–800. doi: 10.1016/j.neuron.2009.02.001
Joiner, W. J., Crocker, A., White, B. H., and Sehgal, A. (2006). Sleep in Drosophila is regulated by adult mushroom bodies. Nature 441, 757–760. doi: 10.1038/nature04811
Keebaugh, E. S., Park, J. H., Su, C., Yamada, R., and Ja, W. W. (2017). Nutrition influences caffeine-mediated sleep loss in Drosophila. Sleep 40. doi: 10.1093/sleep/zsx146
Keene, A. C., Duboue, E. R., McDonald, D. M., Dus, M., Suh, G. S., Waddell, S., et al. (2010). Clock and cycle limit starvation-induced sleep loss in Drosophila. Curr. Biol. 20, 1209–1215. doi: 10.1016/j.cub.2010.05.029
Kimura, K., Hachiya, T., Koganezawa, M., Tazawa, T., and Yamamoto, D. (2008). Fruitless and doublesex coordinate to generate male-specific neurons that can initiate courtship. Neuron 59, 759–769. doi: 10.1016/j.neuron.2008.06.007
Kohatsu, S., Koganezawa, M., and Yamamoto, D. (2011). Female contact activates male-specific interneurons that trigger stereotypic courtship behavior in Drosophila. Neuron 69, 498–508. doi: 10.1016/j.neuron.2010.12.017
Krashes, M. J., DasGupta, S., Vreede, A., White, B., Armstrong, J. D., and Waddell, S. (2009). A neural circuit mechanism integrating motivational state with memory expression in Drosophila. Cell 139, 416–427. doi: 10.1016/j.cell.2009.08.035
Krishnan, V., Han, M.-H., Graham, D. L., Berton, O., Renthal, W., Nestler, E. J., et al. (2007). Molecular Adaptations underlying susceptibility and resistance to social defeat in brain reward regions. Cell 131, 391–404. doi: 10.1016/j.cell.2007.09.018
Kume, K., Kume, S., Park, S. K., Hirsh, J., and Jackson, F. R. (2005). Dopamine is a regulator of arousal in the fruit fly. J. Neurosci. 25, 7377–7384. doi: 10.1523/JNEUROSCI.2048-05.2005
Kuo, S. Y., Wu, C. L., Hsieh, M. Y., Lin, C. T., Wen, R. K., Chen, L. C., et al. (2015). PPL2ab neurons restore sexual responses in aged Drosophila males through dopamine. Nat. Commun. 6, 7490. doi: 10.1038/ncomms8490
Lebestky, T., Chang, J. S., Dankert, H., Zelnik, L., Kim, Y. C., Han, K. A., et al. (2009). Two different forms of arousal in Drosophila are oppositely regulated by the dopamine D1 receptor ortholog DopR via distinct neural circuits. Neuron 64, 522–536. doi: 10.1016/j.neuron.2009.09.031
LeDue, E. E., Mann, K., Koch, E., Chu, B., Dakin, R., and Michael Gordon, D. (2016). Starvation-Induced Depotentiation of Bitter Taste in Drosophila. Curr. Biol. 26, 2854–2861. doi: 10.1016/j.cub.2016.08.028
Lenz, C., Sondergaard, L., and Grimmelikhuijzen, C. J. (2000). Molecular cloning and genomic organization of a novel receptor from Drosophila melanogaster structurally related to mammalian galanin receptors. Biochem. Biophys. Res. Commun. 269, 91–96. doi: 10.1006/bbrc.2000.2251
Li, H., Chaney, S., Roberts, I. J., Forte, M., and Hirsh, J. (2000). Ectopic G-protein expression in dopamine and serotonin neurons blocks cocaine sensitization in Drosophila melanogaster. Curr. Biol. 10, 211–214. doi: 10.1016/S0960-9822(00)00340-7
Lin, S., Owald, D., Chandra, V., Talbot, C., Huetteroth, W., and Waddell, S. (2014). Neural correlates of water reward in thirsty Drosophila. Nat. Neurosci. 17, 1536–1542. doi: 10.1038/nn.3827
Lisman, J. E., and Grace, A. A. (2005). The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46, 703–713. doi: 10.1016/j.neuron.2005.05.002
Liu, Q., Liu, S., Kodama, L., Driscoll, M. R., and Wu, M. N. (2012). Two dopaminergic neurons signal to the dorsal fan-shaped body to promote wakefulness in Drosophila. Curr. Biol. 22, 2114–2123. doi: 10.1016/j.cub.2012.09.008
Liu, Q., Tabuchi, M., Liu, S., Kodama, L., Horiuchi, W., Daniels, J., et al. (2017). Branch-specific plasticity of a bifunctional dopamine circuit encodes protein hunger. Science 356, 534–539. doi: 10.1126/science.aal3245
Liu, T., Dartevelle, L., Yuan, C., Wei, H., Wang, Y., Ferveur, J. F., et al. (2008). Increased dopamine level enhances male-male courtship in Drosophila. J. Neurosci. 28, 5539–5546. doi: 10.1523/JNEUROSCI.5290-07.2008
Lu, J., Jhou, T. C., and Saper, C. B. (2006). Identification of wake-active dopaminergic neurons in the ventral periaqueductal gray matter. J. Neurosci. 26, 193–202. doi: 10.1523/JNEUROSCI.2244-05.2006
Mao, Z., and Davis, R. L. (2009). Eight different types of dopaminergic neurons innervate the Drosophila mushroom body neuropil: anatomical and physiological heterogeneity. Front. Neural Circuits 3:5. doi: 10.3389/neuro.04.005.2009
Marella, S., Mann, K., and Scott, K. (2012). Dopaminergic modulation of sucrose acceptance behavior in Drosophila. Neuron 73, 941–950. doi: 10.1016/j.neuron.2011.12.032
Marshall, L., and Born, J. (2007). The contribution of sleep to hippocampus-dependent memory consolidation. Trends Cogn. Sci. 11, 442–450. doi: 10.1016/j.tics.2007.09.001
Massimini, M., Huber, R., Ferrarelli, F., Hill, S., and Tononi, G. (2004). The sleep slow oscillation as a traveling wave. J. Neurosci. 24, 6862–6870. doi: 10.1523/JNEUROSCI.1318-04.2004
Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111–1115. doi: 10.1038/nature05860
Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837–841. doi: 10.1038/nature08028
McClung, C., and Hirsh, J. (1998). Stereotypic behavioral responses to free-base cocaine and the development of behavioral sensitization in Drosophila. Curr. Biol. 8, 109–112. doi: 10.1016/S0960-9822(98)70041-7
McGaugh, J. L., and Roozendaal, B. (2009). Drug enhancement of memory consolidation: historical perspective and neurobiological implications. Psychopharmacology (Berl) 202, 3–14. doi: 10.1007/s00213-008-1285-6
Melis, M. R., and Argiolas, A. (1995). Dopamine and sexual behavior. Neurosci. Biobehav. Rev. 19, 19–38. doi: 10.1016/0149-7634(94)00020-2
Mery, F., and Kawecki, T. J. (2005). A cost of long-term memory in Drosophila. Science 308:1148. doi: 10.1126/science.1111331
Musso, P. Y., Tchenio, P., and Preat, T. (2015). Delayed dopamine signaling of energy level builds appetitive long-term memory in Drosophila. Cell Rep. 10, 1023–1031. doi: 10.1016/j.celrep.2015.01.036
Mustard, J. A., Beggs, K. T., and Mercer, A. R. (2005). Molecular biology of the invertebrate dopamine receptors. Arch. Insect Biochem. Physiol. 59, 103–117. doi: 10.1002/arch.20065
Nall, A. H., Shakhmantsir, I., Cichewicz, K., Birman, S., Hirsh, J., and Sehgal, A. (2016). Caffeine promotes wakefulness via dopamine signaling in Drosophila. Sci. Rep. 6:20938. doi: 10.1038/srep20938
Neckameyer, W. S. (1998). Dopamine modulates female sexual receptivity in Drosophila melanogaster. J. Neurogenet. 12, 101–114. doi: 10.3109/01677069809167259
Oishi, Y., Suzuki, Y., Takahashi, K., Yonezawa, T., Kanda, T., Takata, Y., et al. (2017). Activation of ventral tegmental area dopamine neurons produces wakefulness through dopamine D2-like receptors in mice. Brain Struct. Funct. 222, 2907–2915. doi: 10.1007/s00429-017-1365-7
Perisse, E., Owald, D., Barnstedt, O., Talbot, C. B., Huetteroth, W., and Waddell, S. (2016). Aversive learning and appetitive motivation toggle feed-forward inhibition in the Drosophila mushroom body. Neuron 90, 1086–1099. doi: 10.1016/j.neuron.2016.04.034
Pimentel, D., Donlea, J. M., Talbot, C. B., Song, S. M. A., Thurston, J. F., and Miesenböck, G. (2016). Operation of a homeostatic sleep switch. Nature 536, 333–337. doi: 10.1038/nature19055
Pitman, J. L., McGill, J. J., Keegan, K. P., and Allada, R. (2006). A dynamic role for the mushroom bodies in promoting sleep in Drosophila. Nature 441, 753–756. doi: 10.1038/nature04739
Plaçais, P. Y., de Tredern, E., Scheunemann, L., Trannoy, S., Goguel, V., Han, K. A., et al. (2017). Upregulated energy metabolism in the Drosophila mushroom body is the trigger for long-term memory. Nat. Commun. 8:15510. doi: 10.1038/ncomms.15510
Plaçais, P. Y., and Preat, T. (2013). To favor survival under food shortage, the brain disables costly memory. Science 339, 440–442. doi: 10.1126/science.1226018
Plaçais, P. Y., Trannoy, S., Isabel, G., Aso, Y., Siwanowicz, I., Belliart-Guerin, G., et al. (2012). Slow oscillations in two pairs of dopaminergic neurons gate long-term memory formation in Drosophila. Nat. Neurosci. 15, 592–599. doi: 10.1038/nn.3055
Qu, W. M., Xu, X. H., Yan, M. M., Wang, Y. Q., Urade, Y., and Huang, Z. L. (2010). Essential role of dopamine D2 receptor in the maintenance of wakefulness, but not in homeostatic regulation of sleep, in mice. J. Neurosci. 30, 4382–4389. doi: 10.1523/JNEUROSCI.4936-09.2010
Reale, V., Hannan, F., Hall, L. M., and Evans, P. D. (1997). Agonist-specific coupling of a cloned Drosophila melanogaster D1-like dopamine receptor to multiple second messenger pathways by synthetic agonists. J. Neurosci. 17, 6545–6553.
Rice, M. E., Patel, J. C., and Cragg, S. J. (2011). Dopamine release in the basal ganglia. Neuroscience 198, 112–137. doi: 10.1016/j.neuroscience.2011.08.066
Roeder, T. (1999). Octopamine in invertebrates. Prog Neurobiol 59, 533–561. doi: 10.1016/S0301-0082(99)00016-7
Rossato, J. I., Bevilaqua, L. R., Izquierdo, I., Medina, J. H., and Cammarota, M. (2009). Dopamine controls persistence of long-term memory storage. Science 325, 1017–1020. doi: 10.1126/science.1172545
Schultz, W. (2007). Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259–288. doi: 10.1146/annurev.neuro.28.061604.135722
Schultz, W. (2015). Neuronal reward and decision signals: from theories to data. Physiol. Rev. 95, 853–951. doi: 10.1152/physrev.00023.2014
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. doi: 10.1126/science.275.5306.1593
Shaw, P. J., Cirelli, C., Greenspan, R. J., and Tononi, G. (2000). Correlates of sleep and waking in Drosophila melanogaster. Science 287, 1834–1837. doi: 10.1126/science.287.5459.1834
Shuai, Y., Hirokawa, A., Ai, Y., Zhang, M., Li, W., and Zhong, Y. (2015). Dissecting neural pathways for forgetting in Drosophila olfactory aversive memory. Proc. Natl. Acad. Sci. U.S.A. 112, E6663–E6672. doi: 10.1073/pnas.1512792112
Shuai, Y., Lu, B., Hu, Y., Wang, L., Sun, K., and Zhong, Y. (2010). Forgetting is regulated through Rac activity in Drosophila. Cell 140, 579–589. doi: 10.1016/j.cell.2009.12.044
Siegel, J. M. (2001). The REM sleep-memory consolidation hypothesis. Science 294, 1058–1063. doi: 10.1126/science.1063049
Sirota, A., Csicsvari, J., Buhl, D., and Buzsaki, G. (2003). Communication between neocortex and hippocampus during sleep in rodents. Proc. Natl. Acad. Sci. U.S.A. 100, 2065–2069. doi: 10.1073/pnas.0437938100
Sitaraman, D., Aso, Y., Jin, X., Chen, N., Felix, M., Rubin, G. M., et al. (2015a). Propagation of Homeostatic Sleep Signals by Segregated Synaptic Microcircuits of the Drosophila Mushroom Body. Curr. Biol. 25, 2915–2927. doi: 10.1016/j.cub.2015.09.017
Sitaraman, D., Aso, Y., Rubin, G. M., and Nitabach, M. N. (2015b). Control of sleep by dopaminergic inputs to the Drosophila mushroom body. Front. Neural Circuits 9:73. doi: 10.3389/fncir.2015.00073
Srivastava, D. P., Yu, E. J., Kennedy, K., Chatwin, H., Reale, V., Hamon, M., et al. (2005). Rapid, nongenomic responses to ecdysteroids and catecholamines mediated by a novel Drosophila G-protein-coupled receptor. J. Neurosci. 25, 6145–6155. doi: 10.1523/JNEUROSCI.1005-05.2005
Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K., and Janak, P. H. (2013). A causal link between prediction errors, dopamine neurons and learning. Nat. Neurosci. 16, 966–973. doi: 10.1038/nn.3413
Stuber, G. D., and Wise, R. A. (2016). Lateral hypothalamic circuits for feeding and reward. Nat. Neurosci. 19, 198–205. doi: 10.1038/nn.4220
Szczypka, M. S., Kwok, K., Brot, M. D., Marck, B. T., Matsumoto, A. M., Donahue, B. A., et al. (2001). Dopamine production in the caudate putamen restores feeding in dopamine-deficient mice. Neuron 30, 819–828. doi: 10.1016/S0896-6273(01)00319-1
Takemura, S. Y., Aso, Y., Hige, T., Wong, A., Lu, Z., Xu, C. S., et al. (2017). A connectome of a learning and memory center in the adult Drosophila brain. Elife 6:e26975. doi: 10.7554/eLife.26975
Tan, K. R., Yvon, C., Turiault, M., Julie Mirzabekov, J., Doehner, J., Labouèbe, G., et al. (2012). GABA Neurons of the VTA drive conditioned place aversion. Neuron 73, 1173–1183. doi: 10.1016/j.neuron.2012.02.015
Taylor, N. E., Van Dort, C. J., Kenny, J. D., Pei, J., Guidera, J. A., Vlasov, K. Y., et al. (2016). Optogenetic activation of dopamine neurons in the ventral tegmental area induces reanimation from general anesthesia. Proc. Natl. Acad. Sci. U.S.A. 113, 12826–12831. doi: 10.1073/pnas.1614340113
Thambi, N. C., Quan, F., Wolfgang, W. J., Spiegel, A., and Forte, M. (1989). Immunological and molecular characterization of Go alpha-like proteins in the Drosophila central nervous system. J. Biol. Chem. 264, 18552–18560.
Tobler, I., and Borbely, A. A. (1986). Sleep EEG in the rat as a function of prior waking. Electroencephalogr. Clin. Neurophysiol. 64, 74–76. doi: 10.1016/0013-4694(86)90044-1
Tsai, H.-C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., Deisseroth, K., et al. (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324, 1080–1084. doi: 10.1126/science.1168878
Tully, T., Preat, T., Boynton, S. C., and Del Vecchio, M. (1994). Genetic dissection of consolidated memory in Drosophila. Cell 79, 35–47. doi: 10.1016/0092-8674(94)90398-0
Ueno, T., Tomita, J., Tanimoto, H., Endo, K., Ito, K., Kume, S., et al. (2012). Identification of a dopamine pathway that regulates sleep and arousal in Drosophila. Nat. Neurosci. 15, 1516–1523. doi: 10.1038/nn.3238
van Zessen, R., Phillips, J. L., Budygin, E. A., and Stuber, G. D. (2012). Activation of VTA GABA neurons disrupts reward consumption. Neuron 73, 1184–1194. doi: 10.1016/j.neuron.2012.02.016
Vyazovskiy, V. V., Olcese, U., Lazimy, Y. M., Faraguna, U., Esser, S. K., Williams, J. C., et al. (2009). Cortical firing and sleep homeostasis. Neuron 63, 865–878. doi: 10.1016/j.neuron.2009.08.024
Werth, E., Dijk, D. J., Achermann, P., and Borbely, A. A. (1996). Dynamics of the sleep EEG after an early evening nap: experimental data and simulations. Am. J. Physiol. 271, R501–R510.
Wisor, J. P., Nishino, S., Sora, I., Uhl, G. H., Mignot, E., and Edgar, D. M. (2001). Dopaminergic role in stimulant-induced wakefulness. J. Neurosci. 21, 1787–1794.
Yamagata, N., Hiroi, M., Kondo, S., Abe, A., and Tanimoto, H. (2016). Suppression of dopamine neurons mediates reward. PLoS Biol. 14:e1002586. doi: 10.1371/journal.pbio.1002586
Yamagata, N., Ichinose, T., Aso, Y., Plaçais, P.-Y., Friedrich, A. B., Tanimoto, H., et al. (2015). Distinct dopamine neurons mediate reward signals for short- and long-term memories. Proc. Natl. Acad. Sci. U.S.A. 112, 578–583. doi: 10.1073/pnas.1421930112
Yamamoto, D., and Koganezawa, M. (2013). Genes and circuits of courtship behaviour in Drosophila males. Nat. Rev. Neurosci. 14, 681–692. doi: 10.1038/nrn3567
Zhang, S. X., Rogulja, D., and Michael Crickmore, A. (2016). Dopaminergic circuitry underlying mating drive. Neuron 91, 168–181. doi: 10.1016/j.neuron.2016.05.020
Keywords: spontaneous activity, dopamine, sleep, learning and memory, feeding, sex drive, Drosophila
Citation: Ichinose T, Tanimoto H and Yamagata N (2017) Behavioral Modulation by Spontaneous Activity of Dopamine Neurons. Front. Syst. Neurosci. 11:88. doi: 10.3389/fnsys.2017.00088
Received: 31 July 2017; Accepted: 14 November 2017;
Published: 11 December 2017.
Edited by:
Irina T. Sinakevitch, Arizona State University, United StatesReviewed by:
Divya Sitaraman, University of San Diego, United StatesKazuhiko Kume, Nagoya City University, Japan
Copyright © 2017 Ichinose, Tanimoto and Yamagata. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Nobuhiro Yamagata, yamagata@m.tohoku.ac.jp