Puja K. Parekh
Colleen A. McClung- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
Evidence from clinical and preclinical research provides an undeniable link between disruptions in the circadian clock and the development of psychiatric diseases, including mood and substance abuse disorders. The molecular clock, which controls daily patterns of physiological and behavioral activity in living organisms, when desynchronized, may exacerbate or precipitate symptoms of psychiatric illness. One of the outstanding questions remaining in this field is that of cause and effect in the relationship between circadian rhythm disruption and psychiatric disease. Focus has recently turned to uncovering the role of circadian proteins beyond the maintenance of homeostatic systems and outside of the suprachiasmatic nucleus (SCN), the master pacemaker region of the brain. In this regard, several groups, including our own, have sought to understand how circadian proteins regulate mechanisms of synaptic plasticity and neurotransmitter signaling in mesocorticolimbic brain regions, which are known to be critically involved in reward processing and mood. This regulation can come in the form of direct transcriptional control of genes central to mood and reward, including those associated with dopaminergic activity in the midbrain. It can also be seen at the circuit level through indirect connections of mesocorticolimbic regions with the SCN. Circadian misalignment paradigms as well as genetic models of circadian disruption have helped to elucidate some of the complex interactions between these systems and neural activity influencing behavior. In this review, we explore findings that link circadian protein function with synaptic adaptations underlying plasticity as it may contribute to the development of mood disorders and addiction. In light of recent advances in technology and sophisticated methods for molecular and circuit-level interrogation, we propose future directions aimed at teasing apart mechanisms through which the circadian system modulates mood and reward-related behavior.
Introduction
Biological rhythms are ubiquitous throughout nature and play a pivotal role in helping organisms navigate dynamic environmental conditions to ensure survival and adaptive behaviors (1, 2). These complex systems have emerged as the result of evolutionary mechanisms allowing animals to physiologically and behaviorally entrain to a roughly 24-h day length (3). The basis for this entrainment ability lies in the molecular clock and the concerted function of several rhythmic tissues throughout the body, and particularly within the brain. In the mammalian brain, the suprachiasmatic nucleus (SCN) of the hypothalamus sets rhythms in response to light input through intrinsically photosensitive retinal ganglion cells (ipRGCs), which form the retinohypothalamic tract (4–6). The SCN communicates with subsidiary oscillators throughout the brain and in the periphery via peptide and neurotransmitter signaling to regulate physiology and behavior (7). Molecular clock machinery exists in all cells and is driven by transcriptional-translational feedback loops (TTFLs) in which the activity of individual components is regulated over a diurnal timescale. At the heart of the clock are circadian transcription factors Circadian Locomotor Output Cycles Kaput (CLOCK), the homologous protein Neuronal PAS Domain Protein 2 (NPAS2), and Brain and Muscle Arnt-like Protein 1 (BMAL1) with which CLOCK or NPAS2 heterodimerize to activate the transcription of Period (Per1, Per2, Per3) and Cryptochrome (Cry1, Cry2) genes. In the cytoplasm, PER and CRY proteins are translated and re-enter the nucleus to bind the CLOCK/NPAS2:BMAL1 transcriptional complex, inhibiting it and forming a negative feedback mechanism, which is completed over the course of 1 day (8–11). The clock is further stabilized by the nuclear receptors, Rev-erbα and Rorα/β, which act to inhibit and activate the transcription of Bmal1 and Clock, respectively, through their interaction with ROR elements. Several regulatory kinases, phosphatases, and accessory feedback loops complete the molecular clock adding additional complexity (12–15). Importantly, while participating in hierarchical feedback loops to maintain cellular rhythmicity, circadian transcription factors also regulate the expression of numerous other clock-controlled genes (CCGs). In fact, it is currently estimated that approximately 43% of the mammalian genome is rhythmic and these CCGs are involved in a wide array of physiological functions throughout the body and in the brain (16). In addition to the wide array of physiological and behavioral functions controlled by the circadian clock, the implications for circadian regulation of mood and reward behavior are beginning to be better understood at the molecular level.
Circadian Rhythms and Psychiatric Illness
Circadian disruption appears to be both a symptom and a precipitating feature of some psychiatric conditions. For instance, the “social jet lag hypothesis” suggests that the weekly disturbances in sleep–wake rhythms imposed by work or school obligations, particularly in adolescence, correlate with an evening circadian typology as well as changes in overall well-being and stimulant consumption measured by self-report (17, 18). Sleep problems and seasonal variations in day/light hours can also cause some individuals to experience depression and can lead to self-medication through drug or alcohol abuse (17, 19, 20). Additionally, the “social zeitgeber hypothesis” proposes the idea that mood episodes may occur when disruptions in social routine are experienced, which lead to circadian rhythm and behavioral dysfunctions. Circadian rhythms in the use and sensitivity to several different classes of drugs have been observed as well (21–25). Genome-wide association studies (GWAS) link polymorphisms and other mutations in core circadian genes with seasonal affective disorder (SAD), major depression (MDD), addiction disorders, and bipolar disorder (BD), which is characterized by spontaneous mood cycling through depressive, euthymic, and manic phases (26–29). For a detailed description of known circadian mutations in humans associated with mood disorders, refer to an in-depth review by McCarthy and Welsh (30). A genetic basis for chronotype (preference for morning or evening consolidation of activity) in humans has been suggested by a number of studies as well, with “eveningness” a characteristic of BD in some patients (31–33). Pharmacological therapies for mood-related illnesses such as lithium and agomelatine, an antidepressant, may produce therapeutic effects through their stabilization of circadian rhythms, further highlighting the role of biological clocks in these disorders (34–39). Circadian gene mutation and chronotype can also correlate with an abnormal response to reward. A particular single nucleotide polymorphism (SNP) in the human Period gene, for instance, disrupts prefrontal reward responsivity and cortico-striatal activation following a rewarding stimulus (40, 41). These and other findings suggest an important role for circadian misalignment in the pathophysiology of mood and addiction disorders.
Work in pre-clinical animal models of psychiatric disorders highlights the central role of proper signaling in several key brain regions to maintain biochemical and neurophysiological balance within circuits. Reward circuitry is directly impinged upon by drugs of abuse and is also the main site of dysregulation in some mood disorders including BD (42–45). While direct projection targets of the SCN, including the medial pre-optic area (mPOA) and dorsomedial hypothalamic nucleus (DmH), are not central to the reward circuitry, they may modulate it through indirect neural connections (46). Orexinergic neurons in the DmH, for instance, encode information about arousal, energy balance, and reward, and project to the ventral tegmental area (VTA) a main source of dopamine (DA) in the brain (47–50). The dorsal raphe (DR) nuclei of the midbrain receive direct light input from the circadian visual system and also indirect input from the SCN and are the primary regions containing serotonin (5-HT) neurons in the brain. 5-HT is an important mood-related neurotransmitter (51). The lateral habenula (LHb) in the midbrain also receives direct SCN input and has been shown to be an important inhibitor of DAergic activity in the VTA, thus exerting a more robust influence over mood and reward regulation (52–54). In the traditional view of the reward system, projections between certain regions are highlighted as critical to the expression and maintenance of proper reward sensitivity and behavioral response. Among these are DAergic and GABAergic projections from the VTA and substantia nigra (SN) to the nucleus accumbens (NAc) and dorsal striatum (Str), respectively. The NAc is considered to be an integrator of sensorimotor information with limbic information to gate motivational behavior. Its extensive afferent and efferent connections serve to underscore this function. Chiefly, the NAc receives glutamatergic inputs from the PFC, amygdala (Amy), and hippocampus (Hipp) and provides GABAergic input to the VTA as well as the ventral pallidum (VP). The VTA also sends afferent inputs to the prefrontal cortex (PFC), a major site of executive function and cognitive control over behavior, and in humans, abnormal dopaminergic signaling within the PFC has been correlated with a drug-addicted state (42, 55). Each of these critical extra-SCN brain regions has been shown to maintain rhythms and to express circadian genes and proteins with clock and non-clock regulatory functions (see Figure 1). They therefore control mood and reward behavior through both circuit-level and molecular mechanisms (56–59).
Figure 1. Mesolimbic brain regions display rhythmic patterns in neural activity. The retinohypothalamic tract provides light information and consists of ipRGC projections from the retina to the SCN and DR. The SCN provides direct GABAergic input to the LHb, DmH, mPOA, and the PVT. Reward-related pathways include a dopaminergic projection from the VTA to the NAc and PFC, glutamatergic inputs from the Hipp, Amy and PFC to the NAc and GABAergic output of the NAc to the VP and VTA. Known rhythmic components of neural activity in each of the mood and reward-related extra-SCN brain regions are denoted. ipRGC, intrinsically photosensitive retinal ganglion cells; SCN, suprachiasmatic nucleus; DR, dorsal raphe nuclei; LHb, lateral habenula; DmH, dorsomedial hypothalamus; mPOA, medial pre-optic area; PVT, paraventricular thalamic nucleus; VTA, ventral tegmental area; NAc, nucleus accumbens; PFC, prefrontal cortex; Hipp, hippocampus; Amy, amygdala; VP, ventral pallidum; LC, locus coeruleus; OB, olfactory bulb.
Circadian Rhythms in Neuronal Activity
In SCN neurons and other neuronal populations, the study of circadian regulation of ion channel mechanisms suggests further roles for these systems in neuronal excitability and signaling (11, 60, 61). The SCN is unique in its highly coupled network activity, which allows it to maintain robust endogenous rhythms in constant conditions by linking the molecular clock with machinery that controls cellular excitability (62–64). Insights into these mechanisms come from studies in many model organisms, including Drosophila melanogaster, which have several conserved molecular clock elements. Recent findings by Flourakis and colleagues have uncovered an ionic basis for diurnal rhythms in membrane excitability of central clock neurons, which are tied to the control of morning and evening activity patterns in both flies and rodents. Clock-controlled activity of both a resting sodium leak conductance and resting potassium conductance demonstrate an important link between molecular rhythms and membrane excitability across the light/dark cycle (65). Interestingly, while other studies have focused on circadian transcriptional regulation of ion channel genes themselves, this study finds that CLOCK rhythmically binds and activates transcription of a gene important for the proper axonal localization of a sodium channel that underlies leak conductance (65). This suggests that molecular oscillations can have diverse influences on cellular excitability through direct and indirect means.
Outside of the SCN as well, rhythms in neuronal activity have been observed. While it has long been thought that VTA DA neurons do not have a diurnal rhythm in firing rate, a recent study suggests that this may not be the case as an intra-diurnal rhythmic pattern of VTA DA neuronal activity has been measured in anesthetized rats (66). It is still unclear whether a strong link exists between firing and extracellular release of DA, however, in behaving animals. More work is needed to concretely establish these mechanisms. Additionally, the neuronal activity of the LHb and medial habenula (MHb) show rhythmic oscillation both in vitro and in vivo, and firing rates of neurons in both of these regions are altered in response to retinal illumination in vivo. The LHb maintains endogenous molecular rhythms as well with oscillations in Per2 gene and protein levels across the light/dark cycle. Temporal variation in electrophysiological properties in each of these neuronal populations is absent in mice lacking a functional intracellular molecular clock. These findings support the idea that intrinsic circadian signals can shape the contribution of habenular nuclei to affective and reward behavior (30, 67, 68). Another reward-related region in the thalamus, the paraventricular nucleus (PVT), which sits at the midline and projects to many limbic structures including the NAc, also displays rhythms in activity. The PVT receives input from the SCN and the DmH and has been shown to play a role in the anticipatory locomotor response to food. The firing rate of PVT neurons varies throughout the day with greatest activity seen during the animal’s active phase (69–71). The influence of this small nucleus on reward sensitivity and drug seeking is beginning to be further elucidated (72, 73). Serotonergic neurotransmission, which is critically involved in the regulation of mood behavior, is significantly affected by photoperiod. Day length during development can alter firing properties of serotonin neurons as well as extracellular levels of 5-HT and norepinephrine. These light-induced changes further affect anxiety and depressive-like behavior (74–77). Work from the Aston-Jones lab has provided insights into the circadian regulation of activity of noradrenergic neurons in the locus coeruleus (LC), a key mediator of wakefulness and behavioral arousal. Using single-unit recordings of LC neurons in anesthetized rats, they have demonstrated that the neurons fire significantly faster during the active phase compared with rest phases. Additionally, the diurnal rhythm of noradrenergic neuronal activity correlates with the rhythm of activation of DmH orexin neurons, which project preferentially to the LC (78, 79). These and other studies highlight that important aspects of neuronal activity throughout the brain are under circadian influence and that the rhythmic activity of mood and reward-related regions may be relevant for behavioral outcomes.
Circadian Rhythms are Involved in Synaptic Plasticity Mechanisms
A core mechanistic underpinning of many psychiatric illnesses is aberrant synaptic plasticity both within limbic regions and between cortical and subcortical areas (80–83). DA and glutamate neurotransmission have been implicated by several studies to be involved in the pathophysiology of BD, for instance, causing the disease to be framed by some as a synaptic plasticity-related disorder (84–86). Circadian rhythms in DA, glutamate and GABA levels in the dorsal striatum and NAc have been measured in awake rats, and these rhythms are independent of light in the NAc (87). Manic-like behavior can be modeled in rodents by the disruption of DA uptake mechanisms including dopamine transporter (DAT) pharmacological inhibition and genetic knockdown (88, 89). Additionally, imaging studies point to a decrease in DAT availability in the caudate of untreated BD patients (90). Along with decreased DAT transcript and protein levels in BD post-mortem cortical tissue and the correlation between DAT gene polymorphisms with predisposition to BD, there is strong evidence to support the role of DA homeostatic dysregulation in the disorder (90–93). Deficiency of decision-making seen in patients with BD is attributed in part to lower DAT functioning. This high-reward sensitivity and risk-preference can be measured in humans using the Iowa Gambling Task (IGT). Adaptation of the IGT to assess risk-based decision-making in mice reproduces human results in DAT-impaired conditions (88). Recent pre-clinical work points to a circadian regulation of DAT function in mice. Ferris and colleagues have demonstrated that diurnal variation in DAT activity accounts for rhythms in DA release in the striatum, and they have also shown diurnal oscillations in presynaptic D2 autoreceptor function (94). These findings could help explain how circadian dysregulation might contribute to the mood swings seen in BD patients. Interestingly, mood stabilizing pharmacological agents including valproate appear to have effects on both molecular clock components as well as DAT function and mRNA levels in rodents (95, 96). While many mood-stabilizers are not specific to any particular neurotransmitter system, it is worth noting that some of their targets include DAergic and glutamatergic pathways. DA receptor density changes are somewhat inconsistent; however, glutamatergic abnormalities are more clearly seen in BD patients. Findings have reported reduced levels of ionotropic glutamate receptor α-amino-3-hydroxy-5-methyl-4-isoxazoleproprionic acid (AMPAR) subunits in cortical areas of mood disorder subjects and reduced gene expression of the GluA1 subunit in striatal regions of BD patients (97–99). Additional proteins associated with the structural integrity of the post-synaptic density and proper trafficking of glutamate receptors to the membrane, including the scaffolding protein, PSD-95, and synapse-associated protein 102 (SAP102), have been found to be altered in post-mortem brains of BD patients (100, 101). These alterations may potentially lead to disruptions in excitatory signaling in mesocorticolimbic brain regions affecting mood and reward behavior. A GluA6 mutant mouse model of bipolar mania has also been characterized, as have pharmacological models including ketamine administration (102, 103). Additionally, polymorphisms in N-methyl-d-aspartate (NMDA) glutamate receptor genes correlate with susceptibility to BD (104, 105). Given the importance of DA-GLU interaction at postsynaptic sites for normal synaptic plasticity processes, it will be critical to follow up these findings with functional studies in disease models.
Pre-clinical studies from our own group in a genetic mouse model of circadian disruption, the ClockΔ19 mice, have uncovered additional DAergic genes that are direct transcriptional targets of the core circadian transcription factor, CLOCK. These include tyrosine hydroxylase (TH), the rate-limiting enzyme in DA synthesis, and cholesystekinin (Cck), a peptide negatively associated with DA activity in vivo, which has been implicated in anxiety and drug response (106, 107). In addition to the regulation of DA synthesis and transmission, DA degradation has also been shown to be under circadian control. The clock proteins, PER1 and PER2 are rhythmically expressed in the striatum and Per2 mutation disrupts the rhythmic activity of monoamine oxidase A (MAOA), the critical enzyme involved in DA catabolism (108). Recently, we have also demonstrated that CLOCK regulates the expression of TH by binding enhancer box (E-box) sequences at proximal and distal promoter regions of the gene. Known dopaminergic targets of circadian genes are summarized in Figure 2. In wild-type mice, CLOCK is a negative regulator of TH activation, and the dominant negative CLOCK protein in Clock mutant mice is therefore unable to repress TH transcript and protein levels, which are increased throughout the light/dark cycle. Consequently, extracellular DA levels are also increased in striatal regions in mutants (107). Behaviorally, the mutant mice show robust hypersensitivity to rewarding substances, reduced anxiety and depressive-like behavior and hyperactivity in response to novelty (109–111). The effect of these elevated DA levels on synaptic transmission and efficacy in target regions is being investigated on a functional level. Correlative evidence of circuit-level disruptions in Clock-mutant mice that may be the result of synaptic weight changes in cortico-limbic regions has also been demonstrated. Mutants display a decrease in cross-frequency phase coupling of low-gamma oscillations with delta oscillations within the accumbens corresponding to the time during which they explore open arms in an elevated zero maze (112). This suggests signaling deficits that may contribute to their reduced anxiety-like behavioral phenotype. These deficits may in part be due to altered excitatory drive onto accumbal medium spiny neurons as computational models suggest (112, 113). Interestingly, protein levels of the AMPA receptor subunit, GluA1, and phosphorylated GluA1, are decreased in the NAc of Clock mutants compared with wild-type littermates, indicating a post-synaptic adaptation that may be secondary to the increased DAergic tone in these animals (114). It will have to be determined whether the CLOCK protein directly regulates any aspects of glutamatergic signaling in this region.
Figure 2. Elements of dopaminergic transmission are under direct circadian control. Within the VTA-NAc circuitry, clock genes regulate the transcription of several genes involved in the synthesis, uptake, transmission and degradation of dopamine, including tyrosine hydroxylase (TH), dopamine transporter (DAT), pre-synaptic dopamine type-2 receptor (D2R), dopamine type-3 receptor (D3R), monoamine oxidase A (MAOA), and cholecystokinin (CCK). Within the NAc, diurnal rhythms in levels of the neurotransmitters, dopamine, glutamate, and GABA have been measured as well. The transcription of TH is repressed by the circadian transcription factor, CLOCK, as well as the nuclear receptor, REV-ERBα, which bind to enhancer box (E-Box) and ROR response-element (RRE) sites in the promoter region, respectively.
Transcription factors are important in positive and negative regulation of plasticity-related genes and neuronal activity. The study of this regulation in other models sheds light on how these mechanisms might be occurring to control mood and reward behavior. For instance, social-defeat stress, a validated model of depression in mice, is thought to rely partly on the actions of cAMP response-element binding protein (CREB) to affect excitability of NAc medium spiny neurons, which are integral to affective and reward-related behavior (115). CREB signaling is increased in fibroblasts from BD patients as well (116). Another transcription factor, nuclear factor kappa B (NfκB), which is prominent in the striatum, is involved in reward processing and is increased following repeated cocaine administration (117, 118). Evidence for the positive regulation of NfκB-mediated transcription by CLOCK (independent of BMAL1 binding) indicates that circadian transcription factors can affect the activity of non-circadian transcription factors through protein interactions (119). Genes involved in accessory or stabilizing loops of the molecular clock machinery can also be important for behavior. It has recently been shown that the circadian nuclear receptor, REV-ERBα, which represses the transcription of Bmal1, has a key function in the direct regulation of TH expression in the ventral midbrain as well (120). By competing with the DA neuron-enriched nuclear receptor, NURR1, REV-ERBα is able to contribute to the rhythmicity of the DAergic system and affect mood behavior (120). This further suggests that clock proteins have a role in reward behavior outside of molecular clock functions.
Rhythms in Learning and Structural Plasticity
The effects of circadian disruption on long lasting or homeostatic plasticity in reward and mood-related circuitry need to be further elucidated. Circadian rhythms in learning and memory processes help underscore the importance of these mechanisms for adaptive behavior requiring plasticity. Hippocampal-dependent learning in rodents as measured by the novel-object recognition task fluctuates over a diurnal timescale with performance peaking during the dark (active) phase (121, 122). In diurnal grass rats, long-term retention of reference memory in the Morris Water Maze is highest during the day, which is anti-phase to the performance of nocturnal rats (123). Many studies have found circadian oscillations of hippocampal signaling events in mice, and that these events are required for memory formation and adaptation to novel environments. Bmal1 null mutant mice display impaired contextual fear and spatial memory as well as hyperactivity in novel environments and reduced habituation. Additionally, long-term potentiation (LTP) in hippocampal slices from these mutants is significantly decreased compared with wild-type mice (124, 125). Npas2 mutant mice also show impairments in cued and contextual fear memory (126). Interestingly, daily changes have been demonstrated in the expression of genes encoding synaptic scaffolding proteins and also in the morphology of dendrites themselves. Circadian peaks in the stress hormone, corticosterone (CORT) enhance the formation of spines on pyramidal neurons in the motor cortex of rats (127–129). Functional effects of circadian oscillations on synaptic plasticity in the somatosensory cortex of mice have been examined in constant darkness conditions where the cyclic changes in the density of excitatory synapses on spines were abolished. These findings suggest that the density of excitatory synapses shows daily changes while the density of inhibitory synapses in this cortical region shows circadian changes (130, 131). Recent important work from the laboratory of Takao Hensch demonstrates that the Clock gene regulates critical period plasticity in the primary visual cortex of mice. They have found that CLOCK plays a role in the functional maturation of parvalbumin (PV) neuronal circuits, which comprise a primary source of inhibitory activity in the neocortex (132). A number of psychiatric conditions, including schizophrenia and autism, are characterized by abnormal excitatory/inhibitory balance in cortical circuits, and specifically, reduced functionality of PV interneurons; therefore, clock-mediated regulation of genes controlling synaptic and homeostatic events is of particular interest (133–135).
Outside of the retina and SCN, there are few studies that have systematically examined structural circadian remodeling of synapses in the brain. A small number of studies have demonstrated a circadian regulation of electrical activity in the olfactory bulb (OB) where the functional interaction of AMPARs with connexins to form gap junctions underlies the firing of action potentials. In this region, GluA1 mRNA and protein in particular were found to be strongly rhythmic across 24- and 48-h timescales. These synaptic interactions that govern the circadian synchronization of action potentials in the OB may impact olfactory coding and learning (136, 137). In zebrafish, a diurnal vertebrate model organism, a transparent body offers the unique advantage of visualizing structural plasticity. Synapses on hypocretin neurons important for sleep homeostasis show dynamic diurnal changes in live zebrafish. Rhythmic synaptic density in hypocretin axons is primarily regulated by the circadian clock potentially through transcriptional control of the expression of nptx2b, a gene that is important for AMPA receptor clustering (138, 139). Given the relevance of expression and function of synaptic proteins in disease states, the continued study of possible mechanistic influences of circadian clock elements in these processes will be critical.
Rhythms in Neuroadaptations Associated with Drugs of Abuse
The investigation of neuroadaptations in reward-related brain regions following exposure to addictive substances, including methamphetamine, cocaine, morphine, and alcohol has been a mainstay of addiction research for decades. Many of these adaptations also involve the neuromodulatory effects of DA on glutamatergic and GABAergic synapses to re-wire circuits for abnormal reward learning (80, 140–142). Drugs of abuse can alter rhythmicity of core clock genes, and the activity of these genes can in turn affect the expression of proteins important for plasticity, suggesting a bidirectional relationship between the circadian and reward systems (143–146). Drugs provide potent non-photic entrainment cues affecting behavioral rhythms in a time-of-day dependent manner and potentially acting upon SCN electrical rhythms directly (23, 147, 148). Diurnal variations in amphetamine-induced locomotor activity, conditioned place preference for amphetamine, and the expression of TH mRNA in the VTA and NAc have been observed (149). Mutations of circadian genes, Per1 and Per2 in mice have led to opposing reward phenotypes where mPer1 mutant mice display a lack of cocaine sensitization in response to repeated injections of the drug, while sensitization is robustly increased in mPer2 mutants. Cocaine reward as assessed by place preference showed similar trends in the mutants, respectively. Cocaine-related reward behaviors in C57/BL6J mice are under circadian control and vary by zeitgeber time, highlighting the importance of taking into account diurnal differences in reward response (150). Abnormally increased alcohol consumption in Per2(Brdm1)-mutant mice is associated with altered glutamatergic activity where lower levels of the glutamate transporter gene, Eaat1, lead to increased extracellular levels of glutamate in the brain. Furthermore, acamprosate, a therapeutic agent used to prevent craving and relapse in alcoholic patients, is effective in normalizing glutamate levels and alcohol consumption in mutant mice (151).
Our group has characterized reward-related dysfunction in ClockΔ19 mice including a robust sensitization to cocaine, increased preference for cocaine, and increased goal-directed behavior, and motivation in measures of cocaine self-administration. Additionally, these mice exhibit higher motivation for self-stimulation of the medial forebrain bundle and preference for sucrose and alcohol (109–111). Interestingly, while Npas2 is thought to be a paralog of Clock with high structural and functional homology, Npas2-mutant mice show a decrease in cocaine-conditioned place preference, a measure of reward sensitivity (146, 152, 153). This discrepancy in the role of the two circadian transcription factors in mediating reward response could be due to differential expression of the genes in the brain. Clock is ubiquitously expressed throughout the brain, while Npas2 is highly enriched in the forebrain, including specifically the NAc, and is not expressed in the VTA where Clock is known to be critical for reward behavior (126). Additionally, viral-mediated knockdown of NPAS2 within the NAc itself is sufficient to decrease cocaine preference in C57/BL6 mice. In this brain region, NPAS2 also directly regulates the expression of the DA D3 receptor by binding to a non-canonical E-box sequence in the promoter region of the Drd3 gene. Chronic cocaine administration also increases the expression of Npas2 in the striatum where the gene has been shown to be highly enriched in the D1 DA receptor containing medium spiny neurons (146). The two main subpopulations of MSNs, D1 receptor- and D2 receptor-containing, are differentially involved in reward regulation due to the opposing actions of the receptor types on cellular activity via G-protein signaling mechanisms, and the projection pathways of neurons. D3 receptors have been proposed to play a role in reward seeking potentially through membrane interactions with D1 receptors (154–157). The myriad ways in which clock proteins directly and indirectly mediate drug response potentially through the control of synaptic proteins will have to be investigated further.
Future Directions
As we continue to piece together the mechanisms by which the circadian system regulates neuronal activity, synaptic plasticity, and behavior, it will be valuable to take stock of the variety of techniques available for further interrogation as well as the many outstanding questions. We have uncovered aspects of clock function in core limbic circuitry; however, other brain regions will need to be investigated as well since we know that psychiatric conditions involve disruptions in many mesocorticolimbic structures and pathways. Addiction, for instance, is believed to progress through cascades of dysfunction affecting several brain regions (158). Additionally, the study of other neurotransmitter systems beyond DA in circadian gene models of mood and reward disorders will be important. Mood cycling in BD has been proposed to involve neurotransmitter switching, for instance (159). Recent advances in technology for interrogating circuitry include optogenetics and pharmacogenetics. Beyond the use of traditional opsins that alter neuronal excitability by depolarizing and hyperpolarizing cell membranes (channelrhodopsin and halorhodopsin) a variety of other, sophisticated constructs have been designed to target cellular mechanisms including G-protein signaling (Opto XRs) and designer receptors activated by designer drugs (DREADDs) (160, 161). These tools can be applied in the ongoing effort to understand how direct and indirect SCN projections to mesocorticolimbic areas affect behavior in a regionally and temporally specific manner. The contribution of subsidiary oscillatory networks in extra-SCN regions to behavior can be assessed further by anatomical mapping and pathway-specific manipulations.
As noted by our group and others, clock genes can exert differential effects in extra-SCN brain regions that may have diverse or opposing influences on behavior. The differences in expression of these genes and proteins though they may have overlapping roles in the SCN are important to consider, as the downstream effectors may be cell-type or circuit-specific. Microarray analysis and Chromatin-immunoprecipitation followed by deep sequencing have allowed us to identify several target genes that are bound by circadian transcription factors in normal or altered physiological conditions. These genes can be categorized by their cellular functions and profiles can be made of binding activity across diurnal time scales. Following up these large-scale analyses with reporter gene assays to determine transcriptional activity of circadian proteins is also critical to understand their function. These methods have proven very useful in the identification of clock gene targets that regulate DAergic transmission and post-synaptic activity in the VTA-Str circuitry. Many other genes relevant to synaptic plasticity known to have rhythmic activity can be explored, as some of their protein products are targets of pharmacotherapeutic agents. One promising new advance involves the optical control of transcriptional effectors by custom constructs utilizing cryptochrome proteins. While this TALE-LITE system has primarily been validated in vitro, it holds the potential to be useful for the precise manipulation of circadian transcription factors in key brain regions (162). Altering the rhythmicity of these proteins may provide insights into how their regular function affects cellular and synaptic activity and the consequences of circadian misalignment on these functions. The benefits provided by these approaches extend beyond the traditional use of genetic mutant models and viral-mediated gene transfer though these have proved extremely useful in first characterizations of the effects of circadian disruption on behavior.
While animal models are very valuable, a variety of cell models can be put to use to gain mechanistic information and for the direct translational potential of studying human patient populations. Blood biomarkers, inducible pluripotent stem cells (iPSCs) and skin fibroblasts for instance have yielded a wealth of information about cellular abnormalities in disease states and point to possible further diagnostic measurements (30, 163). Lastly, work over many decades has helped to characterize the electrophysiological properties of SCN neurons and the signaling networks that exist within the nucleus to orchestrate molecular rhythms. However, these same methods can be applied in mesocorticolimbic areas to uncover rhythms in cellular and network activity relevant to behavior. It will be important to continue to directly measure synaptic function at key microcircuits in circadian-mutant models with abnormal mood or reward-related phenotypes, or following circadian misalignment paradigms such as photoperiod manipulation or “shift-work” simulation. Given the regulatory role of clock proteins in activating or repressing transcription of CCGs and the relevance of synaptic plasticity to normal behavior and psychiatric illness, more work is needed to understand the intersection of these systems.
Author Contributions
PP conceptualized and wrote the manuscript. CM provided editorial comments for the manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Funding
Studies from our group were supported by NIDA (DA023988 to CM), NIMH (MH082876 to CM).
References
1. Reppert SM, Weaver DR. Coordination of circadian timing in mammals. Nature (2002) 418:935–41. doi:10.1038/nature00965
2. Antle MC, Silver R. Circadian insights into motivated behavior. Curr Top Behav Neurosci (2015). doi:10.1007/7854_2015_384
3. Schibler U. The daily timing of gene expression and physiology in mammals. Dialogues Clin Neurosci (2007) 9:257–72.
4. Hattar S, Kumar M, Park A, Tong P, Tung J, Yau K-WW, et al. Central projections of melanopsin-expressing retinal ganglion cells in the mouse. J Comp Neurol (2006) 497:326–49. doi:10.1002/cne.20970
5. Schmidt TM, Chen S-KK, Hattar S. Intrinsically photosensitive retinal ganglion cells: many subtypes, diverse functions. Trends Neurosci (2011) 34:572–80. doi:10.1016/j.tins.2011.07.001
6. Panda S, Provencio I, Tu DC, Pires SS, Rollag MD, Castrucci AM, et al. Melanopsin is required for non-image-forming photic responses in blind mice. Science (2003) 301:525–7. doi:10.1126/science.1086179
7. Li J-DD, Hu W-PP, Zhou Q-YY. The circadian output signals from the suprachiasmatic nuclei. Prog Brain Res (2012) 199:119–27. doi:10.1016/B978-0-444-59427-3.00028-9
8. Meijer JH, Schwartz WJ. In search of the pathways for light-induced pacemaker resetting in the suprachiasmatic nucleus. J Biol Rhythms (2003) 18:235–49. doi:10.1177/0748730403018003006
9. Ko CH, Takahashi JS. Molecular components of the mammalian circadian clock. Hum Mol Genet (2006) 15(Spec No 2):R271–7. doi:10.1093/hmg/ddl207
10. Lowrey PL, Takahashi JS. Genetics of circadian rhythms in mammalian model organisms. Adv Genet (2011) 74:175–230. doi:10.1016/B978-0-12-387690-4.00006-4
11. Quintero JE, Kuhlman SJ, McMahon DG. The biological clock nucleus: a multiphasic oscillator network regulated by light. J Neurosci (2003) 23:8070–6.
12. Preitner N, Damiola F, Lopez-Molina L, Zakany J, Duboule D, Albrecht U, et al. The orphan nuclear receptor REV-ERBalpha controls circadian transcription within the positive limb of the mammalian circadian oscillator. Cell (2002) 110:251–60. doi:10.1016/S0092-8674(02)00825-5
13. Lee E, Kim EY. A role for timely nuclear translocation of clock repressor proteins in setting circadian clock speed. Exp Neurobiol (2014) 23:191–9. doi:10.5607/en.2014.23.3.191
14. Lee HM, Chen R, Kim H, Etchegaray J-PP, Weaver DR, Lee C. The period of the circadian oscillator is primarily determined by the balance between casein kinase 1 and protein phosphatase 1. Proc Natl Acad Sci U S A (2011) 108:16451–6. doi:10.1073/pnas.1107178108
15. Ripperger JAA, Albrecht U. REV-ERB-erating nuclear receptor functions in circadian metabolism and physiology. Cell Res (2012) 22:1319–21. doi:10.1038/cr.2012.81
16. Zhang R, Lahens NF, Ballance HI, Hughes ME, Hogenesch JB. A circadian gene expression atlas in mammals: implications for biology and medicine. Proc Natl Acad Sci U S A (2014) 111:16219–24. doi:10.1073/pnas.1408886111
17. Wittmann M, Dinich J, Merrow M, Roenneberg T. Social jetlag: misalignment of biological and social time. Chronobiol Int (2006) 23:497–509. doi:10.1080/07420520500545979
18. Adan A, Archer SN, Hidalgo MP, Di Milia L, Natale V, Randler C. Circadian typology: a comprehensive review. Chronobiol Int (2012) 29:1153–75. doi:10.3109/07420528.2012.719971
19. Hagenauer MH, Lee TM. The neuroendocrine control of the circadian system: adolescent chronotype. Front Neuroendocrinol (2012) 33:211–29. doi:10.1016/j.yfrne.2012.04.003
20. Hasler BP, Clark DB. Circadian misalignment, reward-related brain function, and adolescent alcohol involvement. Alcohol Clin Exp Res (2013) 37:558–65. doi:10.1111/acer.12003
21. Broms U, Kaprio J, Hublin C, Partinen M, Madden PA, Koskenvuo M. Evening types are more often current smokers and nicotine-dependent-a study of Finnish adult twins. Addiction (2011) 106:170–7. doi:10.1111/j.1360-0443.2010.03112.x
22. Ren Z-YY, Zhang X-LL, Liu Y, Zhao L-YY, Shi J, Bao Y, et al. Diurnal variation in cue-induced responses among protracted abstinent heroin users. Pharmacol Biochem Behav (2009) 91:468–72. doi:10.1016/j.pbb.2008.08.023
23. Kosobud AE, Gillman AG, Leffel JK, Pecoraro NC, Rebec GV, Timberlake W. Drugs of abuse can entrain circadian rhythms. ScientificWorldJournal (2007) 7:203–12. doi:10.1100/tsw.2007.234
24. Danel T, Jeanson R, Touitou Y. Temporal pattern in consumption of the first drink of the day in alcohol-dependent persons. Chronobiol Int (2003) 20:1093–102. doi:10.1081/CBI-120025533
25. Gallerani M, Manfredini R, Dal Monte D, Calò G, Brunaldi V, Simonato M. Circadian differences in the individual sensitivity to opiate overdose. Crit Care Med (2001) 29:96–101. doi:10.1097/00003246-200101000-00021
26. Benedetti F, Dallaspezia S, Colombo C, Pirovano A, Marino E, Smeraldi E. A length polymorphism in the circadian clock gene Per3 influences age at onset of bipolar disorder. Neurosci Lett (2008) 445:184–7. doi:10.1016/j.neulet.2008.09.002
27. Kovanen L, Saarikoski ST, Haukka J, Pirkola S, Aromaa A, Lönnqvist J, et al. Circadian clock gene polymorphisms in alcohol use disorders and alcohol consumption. Alcohol Alcohol (2010) 45:303–11. doi:10.1093/alcalc/agq035
28. Mansour HA, Wood J, Logue T, Chowdari KV, Dayal M, Kupfer DJ, et al. Association study of eight circadian genes with bipolar I disorder, schizoaffective disorder and schizophrenia. Genes Brain Behav (2006) 5:150–7. doi:10.1111/j.1601-183X.2005.00147.x
29. Shumay E, Fowler JS, Wang G-JJ, Logan J, Alia-Klein N, Goldstein RZ, et al. Repeat variation in the human PER2 gene as a new genetic marker associated with cocaine addiction and brain dopamine D2 receptor availability. Transl Psychiatry (2012) 2:e86. doi:10.1038/tp.2012.11
30. McCarthy MJ, Welsh DK. Cellular circadian clocks in mood disorders. J Biol Rhythms (2012) 27:339–52. doi:10.1177/0748730412456367
31. Horne JA, Ostberg O. A self-assessment questionnaire to determine morningness-eveningness in human circadian rhythms. Int J Chronobiol (1976) 4:97–110.
32. Zhang L, Evans DS, Raheja UK, Stephens SH, Stiller JW, Reeves GM, et al. Chronotype and seasonality: morningness is associated with lower seasonal mood and behavior changes in the Old Order Amish. J Affect Disord (2015) 174:209–14. doi:10.1016/j.jad.2014.11.039
33. Broms U, Pitkäniemi J, Bäckmand H, Heikkilä K, Koskenvuo M, Peltonen M, et al. Long-term consistency of diurnal-type preferences among men. Chronobiol Int (2014) 31:182–8. doi:10.3109/07420528.2013.836534
34. Etain B, Jamain S, Milhiet V, Lajnef M, Boudebesse C, Dumaine A, et al. Association between circadian genes, bipolar disorders and chronotypes. Chronobiol Int (2014) 31:807–14. doi:10.3109/07420528.2014.906445
35. Konttinen H, Kronholm E, Partonen T, Kanerva N, Männistö S, Haukkala A. Morningness-eveningness, depressive symptoms, and emotional eating: a population-based study. Chronobiol Int (2014) 31:554–63. doi:10.3109/07420528.2013.877922
36. McClung CA. How might circadian rhythms control mood? Let me count the ways. Biol Psychiatry (2013) 74:242–9. doi:10.1016/j.biopsych.2013.02.019
37. Katzenberg D, Young T, Finn L, Lin L, King DP, Takahashi JS, et al. A CLOCK polymorphism associated with human diurnal preference. Sleep (1998) 21:569–76.
38. Soria V, Martínez-Amorós E, Escaramís G, Valero J, Pérez-Egea R, García C, et al. Differential association of circadian genes with mood disorders: CRY1 and NPAS2 are associated with unipolar major depression and CLOCK and VIP with bipolar disorder. Neuropsychopharmacology (2010) 35:1279–89. doi:10.1038/npp.2009.230
39. Mendlewicz J. Disruption of the circadian timing systems: molecular mechanisms in mood disorders. CNS Drugs (2009) 23(Suppl 2):15–26. doi:10.2165/11318630-000000000-00000
40. Hasler BP, Dahl RE, Holm SM, Jakubcak JL, Ryan ND, Silk JS, et al. Weekend-weekday advances in sleep timing are associated with altered reward-related brain function in healthy adolescents. Biol Psychol (2013) 91:334–41. doi:10.1016/j.biopsycho.2012.08.008
41. Forbes EE, Dahl RE, Almeida JR, Ferrell RE, Nimgaonkar VL, Mansour H, et al. PER2 rs2304672 polymorphism moderates circadian-relevant reward circuitry activity in adolescents. Biol Psychiatry (2012) 71:451–7. doi:10.1016/j.biopsych.2011.10.012
42. Russo SJ, Nestler EJ. The brain reward circuitry in mood disorders. Nat Rev Neurosci (2013) 14:609–25. doi:10.1038/nrn3381
43. Van Enkhuizen J, Geyer MA, Minassian A, Perry W, Henry BL, Young JW. Investigating the underlying mechanisms of aberrant behaviors in bipolar disorder from patients to models: rodent and human studies. Neurosci Biobehav Rev (2015) 58:4–18. doi:10.1016/j.neubiorev.2015.08.008
44. Koob GF, Volkow ND. Neurocircuitry of addiction. Neuropsychopharmacology (2010) 35:217–38. doi:10.1038/npp.2009.110
45. Kravitz AV, Tomasi D, LeBlanc KH, Baler R, Volkow ND, Bonci A, et al. Cortico-striatal circuits: novel therapeutic targets for substance use disorders. Brain Res (2015). doi:10.1016/j.brainres.2015.03.048
46. Mendoza J, Challet E. Circadian insights into dopamine mechanisms. Neuroscience (2014) 282C:230–42. doi:10.1016/j.neuroscience.2014.07.081
47. Aston-Jones G, Chen S, Zhu Y, Oshinsky ML. A neural circuit for circadian regulation of arousal. Nat Neurosci (2001) 4:732–8. doi:10.1038/89522
48. Aston-Jones G, Smith RJ, Moorman DE, Richardson KA. Role of lateral hypothalamic orexin neurons in reward processing and addiction. Neuropharmacology (2009) 56(Suppl 1):112–21. doi:10.1016/j.neuropharm.2008.06.060
49. Balcita-Pedicino JJ, Sesack SR. Orexin axons in the rat ventral tegmental area synapse infrequently onto dopamine and gamma-aminobutyric acid neurons. J Comp Neurol (2007) 503:668–84. doi:10.1002/cne.21420
50. De Lecea L. Hypocretins and the neurobiology of sleep-wake mechanisms. Prog Brain Res (2012) 198:15–24. doi:10.1016/B978-0-444-59489-1.00003-3
51. Morin LP. Neuroanatomy of the extended circadian rhythm system. Exp Neurol (2013) 243:4–20. doi:10.1016/j.expneurol.2012.06.026
52. Guilding C, Hughes AT, Piggins HD. Circadian oscillators in the epithalamus. Neuroscience (2010) 169:1630–9. doi:10.1016/j.neuroscience.2010.06.015
53. Bourdy R, Barrot M. A new control center for dopaminergic systems: pulling the VTA by the tail. Trends Neurosci (2012) 35:681–90. doi:10.1016/j.tins.2012.06.007
54. Lecca S, Melis M, Luchicchi A, Muntoni AL, Pistis M. Inhibitory inputs from rostromedial tegmental neurons regulate spontaneous activity of midbrain dopamine cells and their responses to drugs of abuse. Neuropsychopharmacology (2012) 37:1164–76. doi:10.1038/npp.2011.302
55. Edwards S, Koob GF. Neurobiology of dysregulated motivational systems in drug addiction. Future Neurol (2010) 5:393–401. doi:10.2217/fnl.10.14
56. Li JZ, Bunney BG, Meng F, Hagenauer MH, Walsh DM, Vawter MP, et al. Circadian patterns of gene expression in the human brain and disruption in major depressive disorder. Proc Natl Acad Sci U S A (2013) 110:9950–5. doi:10.1073/pnas.1305814110
57. Baltazar RM, Coolen LM, Webb IC. Diurnal rhythms in neural activation in the mesolimbic reward system: critical role of the medial prefrontal cortex. Eur J Neurosci (2013) 38:2319–27. doi:10.1111/ejn.12224
58. Landgraf D, McCarthy MJ, Welsh DK. The role of the circadian clock in animal models of mood disorders. Behav Neurosci (2014) 128:344–59. doi:10.1037/a0036029
59. Logan RW, Edgar N, Gillman AG, Hoffman D, Zhu X, McClung CA. Chronic stress induces brain region-specific alterations of molecular rhythms that correlate with depression-like behavior in mice. Biol Psychiatry (2015) 78:249–58. doi:10.1016/j.biopsych.2015.01.011
60. Kuhlman SJ, McMahon DG. Rhythmic regulation of membrane potential and potassium current persists in SCN neurons in the absence of environmental input. Eur J Neurosci (2004) 20:1113–7. doi:10.1111/j.1460-9568.2004.03555.x
61. Hastings MH, Brancaccio M, Maywood ES. Circadian pacemaking in cells and circuits of the suprachiasmatic nucleus. J Neuroendocrinol (2014) 26:2–10. doi:10.1111/jne.12125
62. Aton SJ, Colwell CS, Harmar AJ, Waschek J, Herzog ED. Vasoactive intestinal polypeptide mediates circadian rhythmicity and synchrony in mammalian clock neurons. Nat Neurosci (2005) 8:476–83. doi:10.1038/nn1419
63. Herzog ED. Neurons and networks in daily rhythms. Nat Rev Neurosci (2007) 8:790–802. doi:10.1038/nrn2215
64. Granados-Fuentes D, Herzog ED. The clock shop: coupled circadian oscillators. Exp Neurol (2013) 243:21–7. doi:10.1016/j.expneurol.2012.10.011
65. Flourakis M, Kula-Eversole E, Hutchison AL, Han TH, Aranda K, Moose DL, et al. A conserved bicycle model for circadian clock control of membrane excitability. Cell (2015) 162:836–48. doi:10.1016/j.cell.2015.07.036
66. Domínguez-López S, Howell RD, López-Canúl MG, Leyton M, Gobbi G. Electrophysiological characterization of dopamine neuronal activity in the ventral tegmental area across the light-dark cycle. Synapse (2014) 68:454–67. doi:10.1002/syn.21757
67. Zhao H, Rusak B. Circadian firing-rate rhythms and light responses of rat habenular nucleus neurons in vivo and in vitro. Neuroscience (2005) 132:519–28. doi:10.1016/j.neuroscience.2005.01.012
68. Sakhi K, Belle MD, Gossan N, Delagrange P, Piggins HD. Daily variation in the electrophysiological activity of mouse medial habenula neurones. J Physiol (2014) 592:587–603. doi:10.1113/jphysiol.2013.263319
69. Kolaj M, Zhang L, Rønnekleiv OK, Renaud LP. Midline thalamic paraventricular nucleus neurons display diurnal variation in resting membrane potentials, conductances, and firing patterns in vitro. J Neurophysiol (2012) 107:1835–44. doi:10.1152/jn.00974.2011
70. Kirouac GJ. Placing the paraventricular nucleus of the thalamus within the brain circuits that control behavior. Neurosci Biobehav Rev (2015) 56:315–29. doi:10.1016/j.neubiorev.2015.08.005
71. Colavito V, Tesoriero C, Wirtu AT, Grassi-Zucconi G, Bentivoglio M. Limbic thalamus and state-dependent behavior: the paraventricular nucleus of the thalamic midline as a node in circadian timing and sleep/wake-regulatory networks. Neurosci Biobehav Rev (2015) 54:3–17. doi:10.1016/j.neubiorev.2014.11.021
72. Dayas CV, McGranahan TM, Martin-Fardon R, Weiss F. Stimuli linked to ethanol availability activate hypothalamic CART and orexin neurons in a reinstatement model of relapse. Biol Psychiatry (2008) 63:152–7. doi:10.1016/j.biopsych.2007.02.002
73. Matzeu A, Zamora-Martinez ER, Martin-Fardon R. The paraventricular nucleus of the thalamus is recruited by both natural rewards and drugs of abuse: recent evidence of a pivotal role for orexin/hypocretin signaling in this thalamic nucleus in drug-seeking behavior. Front Behav Neurosci (2014) 8:117. doi:10.3389/fnbeh.2014.00117
74. Lucas G, Rymar VV, Du J, Mnie-Filali O, Bisgaard C, Manta S, et al. Serotonin(4) (5-HT(4)) receptor agonists are putative antidepressants with a rapid onset of action. Neuron (2007) 55:712–25. doi:10.1016/j.neuron.2007.07.041
75. Anguelova M, Benkelfat C, Turecki G. A systematic review of association studies investigating genes coding for serotonin receptors and the serotonin transporter: I. Affective disorders. Mol Psychiatry (2003) 8:574–91. doi:10.1038/sj.mp.4001328
76. Ciarleglio CM, Resuehr HE, McMahon DG. Interactions of the serotonin and circadian systems: nature and nurture in rhythms and blues. Neuroscience (2012) 197:8–16. doi:10.1016/j.neuroscience.2011.09.036
77. Green NH, Jackson CR, Iwamoto H, Tackenberg MC, McMahon DG. Photoperiod programs dorsal raphe serotonergic neurons and affective behaviors. Curr Biol (2015) 25:1389–94. doi:10.1016/j.cub.2015.03.050
78. González MMM, Aston-Jones G. Circadian regulation of arousal: role of the noradrenergic locus coeruleus system and light exposure. Sleep (2006) 29:1327–36.
79. Gompf HS, Aston-Jones G. Role of orexin input in the diurnal rhythm of locus coeruleus impulse activity. Brain Res (2008) 1224:43–52. doi:10.1016/j.brainres.2008.05.060
80. Lüscher C. Drug-evoked synaptic plasticity causing addictive behavior. J Neurosci (2013) 33:17641–6. doi:10.1523/JNEUROSCI.3406-13.2013
81. Russo SJ, Dietz DM, Dumitriu D, Morrison JH, Malenka RC, Nestler EJ. The addicted synapse: mechanisms of synaptic and structural plasticity in nucleus accumbens. Trends Neurosci (2010) 33:267–76. doi:10.1016/j.tins.2010.02.002
82. Duman RS, Aghajanian GK. Synaptic dysfunction in depression: potential therapeutic targets. Science (2012) 338:68–72. doi:10.1126/science.1222939
83. Duman RS. Neurobiology of stress, depression, and rapid acting antidepressants: remodeling synaptic connections. Depress Anxiety (2014) 31:291–6. doi:10.1002/da.22227
84. Cousins DA, Butts K, Young AH. The role of dopamine in bipolar disorder. Bipolar Disord (2010) 11:787–806. doi:10.1111/j.1399-5618.2009.00760.x
85. Chen G, Henter ID, Manji HK. Presynaptic glutamatergic dysfunction in bipolar disorder. Biol Psychiatry (2010) 67:1007–9. doi:10.1016/j.biopsych.2010.03.027
86. Schloesser RJ, Huang J, Klein PS, Manji HK. Cellular plasticity cascades in the pathophysiology and treatment of bipolar disorder. Neuropsychopharmacology (2008) 33:110–33. doi:10.1038/sj.npp.1301575
87. Castañeda TR, de Prado BM, Prieto D, Mora F. Circadian rhythms of dopamine, glutamate and GABA in the striatum and nucleus accumbens of the awake rat: modulation by light. J Pineal Res (2004) 36:177–85. doi:10.1046/j.1600-079X.2003.00114.x
88. Van Enkhuizen J, Henry BL, Minassian A, Perry W, Milienne-Petiot M, Higa KK, et al. Reduced dopamine transporter functioning induces high-reward risk-preference consistent with bipolar disorder. Neuropsychopharmacology (2015) 39:3112–22. doi:10.1038/npp.2014.170
89. Young JW, van Enkhuizen J, Winstanley CA, Geyer MA. Increased risk-taking behavior in dopamine transporter knockdown mice: further support for a mouse model of mania. J Psychopharmacol (2011) 25:934–43. doi:10.1177/0269881111400646
90. Anand A, Barkay G, Dzemidzic M, Albrecht D, Karne H, Zheng Q-HH, et al. Striatal dopamine transporter availability in unmedicated bipolar disorder. Bipolar Disord (2011) 13:406–13. doi:10.1111/j.1399-5618.2011.00936.x
91. Greenwood TA, Schork NJ, Eskin E, Kelsoe JR. Identification of additional variants within the human dopamine transporter gene provides further evidence for an association with bipolar disorder in two independent samples. Mol Psychiatry (2006) 11(125–133):115. doi:10.1038/sj.mp.4001764
92. Rao JS, Kellom M, Reese EA, Rapoport SI, Kim H-WW. Dysregulated glutamate and dopamine transporters in postmortem frontal cortex from bipolar and schizophrenic patients. J Affect Disord (2012) 136:63–71. doi:10.1016/j.jad.2011.08.017
93. De Bartolomeis A, Buonaguro EF, Iasevoli F, Tomasetti C. The emerging role of dopamine-glutamate interaction and of the postsynaptic density in bipolar disorder pathophysiology: implications for treatment. J Psychopharmacol (2014) 28:505–26. doi:10.1177/0269881114523864
94. Ferris MJ, España RA, Locke JL, Konstantopoulos JK, Rose JH, Chen R, et al. Dopamine transporters govern diurnal variation in extracellular dopamine tone. Proc Natl Acad Sci U S A (2014) 111:E2751–9. doi:10.1073/pnas.1407935111
95. Ralph-Williams RJ, Paulus MP, Zhuang X, Hen R, Geyer MA. Valproate attenuates hyperactive and perseverative behaviors in mutant mice with a dysregulated dopamine system. Biol Psychiatry (2003) 53:352–9. doi:10.1016/S0006-3223(02)01489-0
96. Van Enkhuizen J, Geyer MA, Kooistra K, Young JW. Chronic valproate attenuates some, but not all, facets of mania-like behaviour in mice. Int J Neuropsychopharmacol (2013) 16:1021–31. doi:10.1017/S1461145712001198
97. Beneyto M, Meador-Woodruff JH. Lamina-specific abnormalities of AMPA receptor trafficking and signaling molecule transcripts in the prefrontal cortex in schizophrenia. Synapse (2007) 60:585–98. doi:10.1002/syn.20329
98. Meador-Woodruff JH, Hogg AJ, Smith RE. Striatal ionotropic glutamate receptor expression in schizophrenia, bipolar disorder, and major depressive disorder. Brain Res Bull (2001) 55:631–40. doi:10.1016/S0361-9230(01)00523-8
99. Beneyto M, Meador-Woodruff JH. Lamina-specific abnormalities of NMDA receptor-associated postsynaptic protein transcripts in the prefrontal cortex in schizophrenia and bipolar disorder. Neuropsychopharmacology (2008) 33:2175–86. doi:10.1038/sj.npp.1301604
100. Sans N, Prybylowski K, Petralia RS, Chang K, Wang Y-XX, Racca C, et al. NMDA receptor trafficking through an interaction between PDZ proteins and the exocyst complex. Nat Cell Biol (2003) 5:520–30. doi:10.1038/ncb990
101. Kristiansen LV, Meador-Woodruff JH. Abnormal striatal expression of transcripts encoding NMDA interacting PSD proteins in schizophrenia, bipolar disorder and major depression. Schizophr Res (2005) 78:87–93. doi:10.1016/j.schres.2005.06.012
102. Shaltiel G, Maeng S, Malkesman O, Pearson B, Schloesser RJ, Tragon T, et al. Evidence for the involvement of the kainate receptor subunit GluR6 (GRIK2) in mediating behavioral displays related to behavioral symptoms of mania. Mol Psychiatry (2008) 13:858–72. doi:10.1038/mp.2008.20
103. Ghedim FV, Fraga Dde B, Deroza PF, Oliveira MB, Valvassori SS, Steckert AV, et al. Evaluation of behavioral and neurochemical changes induced by ketamine in rats: implications as an animal model of mania. J Psychiatr Res (2013) 46:1569–75. doi:10.1016/j.jpsychires.2012.08.010
104. Mundo E, Tharmalingham S, Neves-Pereira M, Dalton EJ, Macciardi F, Parikh SV, et al. Evidence that the N-methyl-D-aspartate subunit 1 receptor gene (GRIN1) confers susceptibility to bipolar disorder. Mol Psychiatry (2003) 8:241–5. doi:10.1038/sj.mp.4001218
105. Martucci L, Wong AH, De Luca V, Likhodi O, Wong GW, King N, et al. N-methyl-D-aspartate receptor NR2B subunit gene GRIN2B in schizophrenia and bipolar disorder: polymorphisms and mRNA levels. Schizophr Res (2006) 84:214–21. doi:10.1016/j.schres.2006.02.001
106. Arey RN, Enwright JF, Spencer SM, Falcon E, Ozburn AR, Ghose S, et al. An important role for cholecystokinin, a CLOCK target gene, in the development and treatment of manic-like behaviors. Mol Psychiatry (2014) 19:342–50. doi:10.1038/mp.2013.12
107. Sidor MM, Spencer SM, Dzirasa K, Parekh PK, Tye KM, Warden MR, et al. Daytime spikes in dopaminergic activity drive rapid mood-cycling in mice. Mol Psychiatry (2015). doi:10.1038/mp.2014.167
108. Hampp G, Ripperger JAA, Houben T, Schmutz I, Blex C, Perreau-Lenz S, et al. Regulation of monoamine oxidase A by circadian-clock components implies clock influence on mood. Curr Biol (2008) 18:678–83. doi:10.1016/j.cub.2008.04.012
109. Roybal K, Theobold D, Graham A, DiNieri JA, Russo SJ, Krishnan V, et al. Mania-like behavior induced by disruption of CLOCK. Proc Natl Acad Sci U S A (2007) 104:6406–11. doi:10.1073/pnas.0609625104
110. Ozburn AR, Larson EB, Self DW, McClung CA. Cocaine self-administration behaviors in Clockδ19 mice. Psychopharmacology (2012) 223:169–77. doi:10.1007/s00213-012-2704-2
111. Ozburn AR, Falcon E, Mukherjee S, Gillman A, Arey R, Spencer S, et al. The role of clock in ethanol-related behaviors. Neuropsychopharmacology (2013) 38:2393–400. doi:10.1038/npp.2013.138
112. Dzirasa K, McGarity DL, Bhattacharya A, Kumar S, Takahashi JS, Dunson D, et al. Impaired limbic gamma oscillatory synchrony during anxiety-related behavior in a genetic mouse model of bipolar mania. J Neurosci (2011) 31:6449–56. doi:10.1523/JNEUROSCI.6144-10.2011
113. Wolf JA, Moyer JT, Lazarewicz MT, Contreras D, Benoit-Marand M, O’Donnell P, et al. NMDA/AMPA ratio impacts state transitions and entrainment to oscillations in a computational model of the nucleus accumbens medium spiny projection neuron. J Neurosci (2005) 25:9080–95. doi:10.1523/JNEUROSCI.2220-05.2005
114. Dzirasa K, Coque L, Sidor MM, Kumar S, Dancy EA, Takahashi JS, et al. Lithium ameliorates nucleus accumbens phase-signaling dysfunction in a genetic mouse model of mania. J Neurosci (2011) 30:16314–23. doi:10.1523/JNEUROSCI.4289-10.2010
115. Nestler EJ. Transcriptional mechanisms of drug addiction. Clin Psychopharmacol Neurosci (2013) 10:136–43. doi:10.9758/cpn.2012.10.3.136
116. Gaspar L, van de Werken M, Johansson A-SS, Moriggi E, Owe-Larsson B, Kocks JW, et al. Human cellular differences in cAMP – CREB signaling correlate with light-dependent melatonin suppression and bipolar disorder. Eur J Neurosci (2014) 40:2206–15. doi:10.1111/ejn.12602
117. Ang E, Chen J, Zagouras P, Magna H, Holland J, Schaeffer E, et al. Induction of nuclear factor-kappaB in nucleus accumbens by chronic cocaine administration. J Neurochem (2001) 79:221–4. doi:10.1046/j.1471-4159.2001.00563.x
118. Russo SJ, Wilkinson MB, Mazei-Robison MS, Dietz DM, Maze I, Krishnan V, et al. Nuclear factor kappa B signaling regulates neuronal morphology and cocaine reward. J Neurosci (2009) 29:3529–37. doi:10.1523/JNEUROSCI.6173-08.2009
119. Spengler ML, Kuropatwinski KK, Comas M, Gasparian AV, Fedtsova N, Gleiberman AS, et al. Core circadian protein CLOCK is a positive regulator of NF-κB-mediated transcription. Proc Natl Acad Sci U S A (2012) 109:E2457–65. doi:10.1073/pnas.1206274109
120. Chung S, Lee EJ, Yun S, Choe HK, Park S-BB, Son HJ, et al. Impact of circadian nuclear receptor REV-ERBα on midbrain dopamine production and mood regulation. Cell (2014) 157:858–68. doi:10.1016/j.cell.2014.03.039
121. Smarr BL, Jennings KJ, Driscoll JR, Kriegsfeld LJ. A time to remember: the role of circadian clocks in learning and memory. Behav Neurosci (2014) 128:283–303. doi:10.1037/a0035963
122. Ruby NF, Hwang CE, Wessells C, Fernandez F, Zhang P, Sapolsky R, et al. Hippocampal-dependent learning requires a functional circadian system. Proc Natl Acad Sci U S A (2008) 105:15593–8. doi:10.1073/pnas.0808259105
123. Martin-Fairey CA, Nunez AA. Circadian modulation of memory and plasticity gene products in a diurnal species. Brain Res (2014) 1581:30–9. doi:10.1016/j.brainres.2014.07.020
124. Kondratova AA, Dubrovsky YV, Antoch MP, Kondratov RV. Circadian clock proteins control adaptation to novel environment and memory formation. Aging (2010) 2:285–97.
125. Wardlaw SM, Phan TX, Saraf A, Chen X, Storm DR. Genetic disruption of the core circadian clock impairs hippocampus-dependent memory. Learn Mem (2014) 21:417–23. doi:10.1101/lm.035451.114
126. Garcia JA, Zhang D, Estill SJ, Michnoff C, Rutter J, Reick M, et al. Impaired cued and contextual memory in NPAS2-deficient mice. Science (2000) 288:2226–30. doi:10.1126/science.288.5474.2226
127. Perez-Cruz C, Simon M, Flügge G, Fuchs E, Czéh B. Diurnal rhythm and stress regulate dendritic architecture and spine density of pyramidal neurons in the rat infralimbic cortex. Behav Brain Res (2010) 205:406–13. doi:10.1016/j.bbr.2009.07.021
128. Ikeno T, Weil ZM, Nelson RJ. Timing of light pulses and photoperiod on the diurnal rhythm of hippocampal neuronal morphology of Siberian hamsters. Neuroscience (2014) 270:69–75. doi:10.1016/j.neuroscience.2014.04.002
129. Ikeda M, Hojo Y, Komatsuzaki Y, Okamoto M, Kato A, Takeda T, et al. Hippocampal spine changes across the sleep-wake cycle: corticosterone and kinases. J Endocrinol (2015) 226:M13–27. doi:10.1530/JOE-15-0078
130. Jasinska M, Grzegorczyk A, Jasek E, Litwin JA, Kossut M, Barbacka-Surowiak G, et al. Daily rhythm of synapse turnover in mouse somatosensory cortex. Acta Neurobiol Exp (2014) 74:104–10.
131. Jasinska M, Grzegorczyk A, Woznicka O, Jasek E, Kossut M, Barbacka-Surowiak G, et al. Circadian rhythmicity of synapses in mouse somatosensory cortex. Eur J Neurosci (2015) 42(8):2585–94. doi:10.1111/ejn.13045
132. Kobayashi Y, Ye Z, Hensch TK. Clock genes control cortical critical period timing. Neuron (2015) 86:264–75. doi:10.1016/j.neuron.2015.02.036
133. Eichler SA, Meier JC. E-I balance and human diseases – from molecules to networking. Front Mol Neurosci (2008) 1:2. doi:10.3389/neuro.02.002.2008
134. Zoghbi HY, Bear MF. Synaptic dysfunction in neurodevelopmental disorders associated with autism and intellectual disabilities. Cold Spring Harb Perspect Biol (2012) 4:a009886. doi:10.1101/cshperspect.a009886
135. Gonzalez-Burgos G, Cho RY, Lewis DA. Alterations in cortical network oscillations and parvalbumin neurons in schizophrenia. Biol Psychiatry (2015) 77:1031–40. doi:10.1016/j.biopsych.2015.03.010
136. Corthell JT, Fadool DA, Trombley PQ. Connexin and AMPA receptor expression changes over time in the rat olfactory bulb. Neuroscience (2012) 222:38–48. doi:10.1016/j.neuroscience.2012.06.070
137. Granados-Fuentes D, Saxena MT, Prolo LM, Aton SJ, Herzog ED. Olfactory bulb neurons express functional, entrainable circadian rhythms. Eur J Neurosci (2004) 19:898–906. doi:10.1111/j.0953-816X.2004.03117.x
138. Appelbaum L, Wang G, Yokogawa T, Skariah GM, Smith SJ, Mourrain P, et al. Circadian and homeostatic regulation of structural synaptic plasticity in hypocretin neurons. Neuron (2010) 68:87–98. doi:10.1016/j.neuron.2010.09.006
139. Elbaz I, Foulkes NS, Gothilf Y, Appelbaum L. Circadian clocks, rhythmic synaptic plasticity and the sleep-wake cycle in zebrafish. Front Neural Circuits (2013) 7:9. doi:10.3389/fncir.2013.00009
140. Kauer JA, Malenka RC. Synaptic plasticity and addiction. Nat Rev Neurosci (2007) 8:844–58. doi:10.1038/nrn2234
141. Mazei-Robison MS, Nestler EJ. Opiate-induced molecular and cellular plasticity of ventral tegmental area and locus coeruleus catecholamine neurons. Cold Spring Harb Perspect Med (2012) 2:a012070. doi:10.1101/cshperspect.a012070
142. Lovinger DM, Kash TL. Mechanisms of neuroplasticity and ethanol’s effects on plasticity in the striatum and bed nucleus of the stria terminalis. Alcohol Res (2015) 37:109–24.
143. Uz T, Arslan AD, Kurtuncu M, Imbesi M, Akhisaroglu M, Dwivedi Y, et al. The regional and cellular expression profile of the melatonin receptor MT1 in the central dopaminergic system. Brain Res Mol Brain Res (2005) 136:45–53. doi:10.1016/j.molbrainres.2005.01.002
144. Lynch WJ, Girgenti MJ, Breslin FJ, Newton SS, Taylor JR. Gene profiling the response to repeated cocaine self-administration in dorsal striatum: a focus on circadian genes. Brain Res (2008) 1213:166–77. doi:10.1016/j.brainres.2008.02.106
145. Falcon E, Ozburn A, Mukherjee S, Roybal K, McClung CA. Differential regulation of the period genes in striatal regions following cocaine exposure. PLoS One (2013) 8:e66438. doi:10.1371/journal.pone.0066438
146. Ozburn A, Falcon E, Twaddle A, Nugent A, Gillman A, Spencer S, et al. Direct regulation of diurnal Drd3 expression and cocaine reward by NPAS2. Biol Psychiatry (2015) 77(5):425–33. doi:10.1016/j.biopsych.2014.07.030
147. Gillman AG, Leffel JK, Kosobud AE, Timberlake W. Behavioral characteristics and pharmacological manipulations of a nicotine-entrainable circadian oscillator. Chronobiol Int (2013) 30:855–69. doi:10.3109/07420528.2013.782314
148. Acuna-Goycolea C, Obrietan K, van den Pol AN. Cannabinoids excite circadian clock neurons. J Neurosci (2010) 30:10061–6. doi:10.1523/JNEUROSCI.5838-09.2010
149. Webb IC, Baltazar RM, Wang X, Pitchers KK, Coolen LM, Lehman MN. Diurnal variations in natural and drug reward, mesolimbic tyrosine hydroxylase, and clock gene expression in the male rat. J Biol Rhythms (2010) 24:465–76. doi:10.1177/0748730409346657
150. Abarca C, Albrecht U, Spanagel R. Cocaine sensitization and reward are under the influence of circadian genes and rhythm. Proc Natl Acad Sci U S A (2002) 99:9026–30. doi:10.1073/pnas.142039099
151. Spanagel R, Pendyala G, Abarca C, Zghoul T, Sanchis-Segura C, Magnone MC, et al. The clock gene Per2 influences the glutamatergic system and modulates alcohol consumption. Nat Med (2005) 11:35–42. doi:10.1038/nm1163
152. Reick M, Garcia JA, Dudley C, McKnight SL. NPAS2: an analog of clock operative in the mammalian forebrain. Science (2001) 293:506–9. doi:10.1126/science.1060699
153. DeBruyne JP, Weaver DR, Reppert SM. CLOCK and NPAS2 have overlapping roles in the suprachiasmatic circadian clock. Nat Neurosci (2007) 10:543–5. doi:10.1038/nn1884
154. Nieh EH, Kim S-YY, Namburi P, Tye KM. Optogenetic dissection of neural circuits underlying emotional valence and motivated behaviors. Brain Res (2013) 1511:73–92. doi:10.1016/j.brainres.2012.11.001
155. Sippy T, Lapray D, Crochet S, Petersen CC. Cell-type-specific sensorimotor processing in striatal projection neurons during goal-directed behavior. Neuron (2015) 88(2):298–305. doi:10.1016/j.neuron.2015.08.039
156. Nicola SM, Surmeier J, Malenka RC. Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu Rev Neurosci (2000) 23:185–215. doi:10.1146/annurev.neuro.23.1.185
157. Le Foll B, Di Ciano P. Neuronal circuitry underlying the impact of D3 receptor ligands in drug addiction. Eur Neuropsychopharmacol (2015) 25:1401–9. doi:10.1016/j.euroneuro.2014.08.017
158. Volkow ND, Morales M. The brain on drugs: from reward to addiction. Cell (2015) 162:712–25. doi:10.1016/j.cell.2015.07.046
159. Young JW, Dulcis D. Investigating the mechanism(s) underlying switching between states in bipolar disorder. Eur J Pharmacol (2015) 759:151–62. doi:10.1016/j.ejphar.2015.03.019
160. Berndt A, Deisseroth K. OPTOGENETICS. Expanding the optogenetics toolkit. Science (2015) 349:590–1. doi:10.1126/science.aac7889
161. Urban DJ, Roth BL. DREADDs (designer receptors exclusively activated by designer drugs): chemogenetic tools with therapeutic utility. Annu Rev Pharmacol Toxicol (2015) 55:399–417. doi:10.1146/annurev-pharmtox-010814-124803
162. Konermann S, Brigham MD, Trevino AE, Hsu PD, Heidenreich M, Cong L, et al. Optical control of mammalian endogenous transcription and epigenetic states. Nature (2013) 500:472–6. doi:10.1038/nature12466
Keywords: circadian, synaptic transmission and plasticity, psychiatric disorders, mouse models, reward
Citation: Parekh PK and McClung CA (2016) Circadian Mechanisms Underlying Reward-Related Neurophysiology and Synaptic Plasticity. Front. Psychiatry 6:187. doi: 10.3389/fpsyt.2015.00187
Received: 30 October 2015; Accepted: 21 December 2015;
Published: 12 January 2016
Edited by:
Stephanie Perreau-Lenz, SRI International, USACopyright: © 2016 Parekh and McClung. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Colleen A. McClung, mcclungca@upmc.edu