- 1Dipartimento di Psicologia and Centro “Daniel Bovet”, “Sapienza” University of Rome, Rome, Italy
- 2Fondazione Santa Lucia, IRCCS, Rome, Italy
- 3Dipartimento di Scienze e Tecnologie Biomediche, University of L'Aquila, L'Aquila, Italy
Motivational salience regulates the strength of goal seeking, the amount of risk taken, and the energy invested from mild to extreme. Highly motivational experiences promote highly persistent memories. Although this phenomenon is adaptive in normal conditions, experiences with extremely high levels of motivational salience can promote development of memories that can be re-experienced intrusively for long time resulting in maladaptive outcomes. Neural mechanisms mediating motivational salience attribution are, therefore, very important for individual and species survival and for well-being. However, these neural mechanisms could be implicated in attribution of abnormal motivational salience to different stimuli leading to maladaptive compulsive seeking or avoidance. We have offered the first evidence that prefrontal cortical norepinephrine (NE) transmission is a necessary condition for motivational salience attribution to highly salient stimuli, through modulation of dopamine (DA) in the nucleus accumbens (NAc), a brain area involved in all motivated behaviors. Moreover, we have shown that prefrontal-accumbal catecholamine (CA) system determines approach or avoidance responses to both reward- and aversion-related stimuli only when the salience of the unconditioned stimulus (UCS) is high enough to induce sustained CA activation, thus affirming that this system processes motivational salience attribution selectively to highly salient events.
Incentive Motivation and Mesoaccumbens
In the last two decades motivation theory has reached developments of paramount importance for psychology and neuroscience. Incentive motivation theory was a crucial crossroads along the way the led to such important developments. Incentive motivation concepts rose in the 1960s when several new realizations about brain and motivation led many psychologists and behavioral neuroscientists to reject simple drive and drive-reduction theories. Specific alternative theories were developed in the form of incentive motivation theories (Bolles, 1972; Bindra, 1978; Toates, 1986, 1994; Panksepp, 1998; Berridge, 2001). Three biopsychologists made major incremental contributions to its development. Bolles (1972) proposed that individuals were motivated by incentive expectancies, not by drives or drive reduction. Incentive expectancies, that Bolles called S–S* associations, were essentially learned expectations of a hedonic reward, indistinguishable from cognitive predictions. Accordingly, a predictive neutral stimulus (S), such as a light or a sound, became associated by repeated pairing with a hedonic reward that followed (S*), such as a palatable food. The S caused an expectancy of the S*. The S was, in terms of Pavlovian learning processes, a conditioned stimulus (CS or CS+), and the S* an unconditioned stimulus (UCS).
Bindra (1974, 1978) acknowledged that expectations might well be important to cognitive strategies to obtain the reward, but suggested that a CS for a reward actually evokes the same incentive motivational state normally caused by the reward itself, as a consequence of classical conditioning. The learned association does not simply cause expectation of the reward. It also causes the individual to perceive the CS as a hedonic reward, and lets the CS elicit incentive motivation just as would the original hedonic reward. That means that the CS takes on specific motivational properties that normally belong to the S* itself, and these motivational properties are specifically incentive properties. Note that this was true not only for reward S*, but also for painful S* motivation, that would be based on fear or punishment properties. Toates (1986) modified the Bolles–Bindra views suggesting that physiological depletion states could enhance the incentive value of their goal stimuli. This leads to a multiplicative interaction between physiological deficit and external stimulus, which determined the stimulus' incentive value. However, physiological deficit signals do not drive motivated behavior directly, but they are able to magnify the hedonic impact and incentive value of the actual reward (S*), and also the hedonic/incentive value of predictive stimuli for the reward (CSs). Around 1990 the incentive salience model was proposed (Berridge et al., 1989; Berridge and Valenstein, 1991) that followed Bindra–Toates rules for incentive conditioning but identifies separable brain substrates for “liking” a reward versus “wanting” the same reward. “Liking” is essentially hedonic impact—the brain reaction underlying sensory pleasure-triggered by immediate receipt of reward, for instance, a sweet taste (unconditioned “liking”).
“Wanting,” or incentive salience, is the motivational incentive value of the same reward (Berridge and Robinson, 1998), the incentive motivational value of a stimulus, not its hedonic impact. The important point is that “liking” and “wanting” normally go together, but they can be split apart under certain circumstances, especially by certain brain manipulations. “Liking” without “wanting” can be produced, and so can “wanting” without “liking.”
Motivation can be conceptually described as a continuum along which stimuli can either reinforce or punish responses to other stimuli. Behaviorally, stimuli that reinforce are called rewarding and those that punish aversive (Skinner, 1953). Reward and aversion describe the impact a stimulus has on behavior, and provided of motivational properties, thus able to induce attribution of motivational salience.
The incentive salience model underscored the main role of dopamine (DA) function as brain mechanism of motivational processes. Indeed DA suppression leaves individuals nearly without motivation for any pleasant incentive at all: food, sex, drugs, etc., (Ikemoto and Panksepp, 1999; Naranjo et al., 2001; Berridge, 2004; Salamone et al., 2005). Thus, disruption of mesolimbic DA systems via neurochemical lesions of the DA pathway that projects to nucleus accumbens (NAc) or by receptor-blocking drugs, dramatically reduces incentive salience or “wanting” to eat a tasty reward, but does not reduce affective facial expressions of “liking” for the same reward (Pecina et al., 1997; Berridge and Robinson, 1998).
DA has a crucial role in motivational control. One type of DA neuron encodes motivational value, excited by rewarding events and inhibited by aversive or stressful events (Bromberg-Martin et al., 2010; Cabib and Puglisi-Allegra, 2012, for reviews). These neurons support brain systems for seeking goals, evaluating outcomes, and value learning. Indeed, most DA neurons are activated by reward-predicting stimuli and code bidirectional reward prediction errors (i.e., better than expected/worse than expected) in humans, monkeys, and rats (Ikemoto and Panksepp, 1999; Ikemoto, 2007; Schultz, 2007). Although discrete aversive stimuli such as air puffs, hypertonic saline, and electric shock induce activating responses in a small proportion of DA neurons in awake animals (Guarraci and Kapp, 1999; Joshua et al., 2008; Matsumoto and Hikosaka, 2009), most DA neurons are depressed by aversive stimuli (Ungless et al., 2004; Jhou et al., 2009). This response variability indicates that recorded cells are part of different, independent circuits (Margolis et al., 2006; Ikemoto, 2007; Bromberg-Martin et al., 2010). A second type of DA neuron encodes motivational salience, excited by both rewarding and aversive events (Bromberg-Martin et al., 2010).
Evidences suggest that different groups of DA neurons convey motivational signals in distinct manners (Matsumoto and Hikosaka, 2009) and the mesocorticolimbic DA system may be comprised of distinct circuits, each modified by distinct aspects of motivationally relevant stimuli, based on DA projections to NAc medial shell mediating positive stimuli, on DA projections to mpFC affected by aversive stimuli, and projections to NAc lateral shell affected by both rewarding and aversive stimuli, presumably reflecting saliency (Lammel et al., 2011). It has been shown how the VTA DA neurons may employ the convergent encoding strategy for processing both positive and negative experiences, intimately integrating with cues and environmental context (Wang and Tsien, 2011).
The mesolimbic dopaminergic system, that projects from the ventral tegmental area (VTA) neuronal cell bodies rostrally to the NAc, is a primary link in the reward pathway (Wise, 1996, 2004). However, DA release is not necessary for all forms of reward learning and may not always be “liked” in the sense of causing pleasure, but it is critical for causing goals to become “wanted” in the sense of motivating actions to achieve them (Robinson and Berridge, 1993, 2003; Berridge and Robinson, 1998; Palmiter, 2008).
A line of evidence supporting a role for DA in the motivational properties of stimuli comes from the place-conditioning paradigm (Mucha and Iversen, 1984; van der Kooy, 1987; Carr et al., 1989). This paradigm treats the increase in amount of time spent in an environment that has been paired with an UCS (either drugs or natural reinforces) as an index of the stimulus's reward properties. By contrast, if animals are repeatedly exposed to an environment paired with an aversive stimulus they will avoid the environment. In the first case we speak of conditioned place preference (CPP), in the second of conditioned place aversion (CPA). DA antagonists administered before each conditioning session with amphetamine block amphetamine-conditioned place preferences (Nader et al., 1997 for review). These results are not interpretable in terms of a general learning deficit because animals have been shown to be able to form normal CS-US associations in place conditioning with other US (Shippenberg and Herz, 1988). These findings suggest that normal DA transmission is necessary for the rewarding properties of stimuli to occur.
If the dopaminergic pathway from the VTA to the NAc is a primary link in the pathways mediating the motivational properties of stimuli (Tsai et al., 2009; Adamantidis et al., 2011), then examples of DA-independent reward should be nonexistent. There are a number of examples, however, of stimuli that possess reinforcing properties independent of DA. Thus, behavioral pharmacological experiments indicate that although increasing mesolimbic DA transmission plays an important role in the reinforcing effects of abused substances, there are also DA-independent processes that contribute significantly to the reinforcing effects of these compounds (Joseph et al., 2003; Pierce and Kumaresan, 2006 for review). For instance, DA antagonist pretreatment or 6-OHDA lesions of the NAc have been reported to have no effect on morphine or heroin self-administration (Ettenberg et al., 1982; Pettit et al., 1984; Dworkin et al., 1988), and on ethanol oral self-administration (Rassnick et al., 1993). A lack of dopaminergic involvement in cocaine place preferences (Spyraki et al., 1982; Mackey and van der Kooy, 1985) has been reported following systemic or intra-accumbens administration (Koob and Bloom, 1988; Hemby et al., 1992; Caine and Koob, 1993). Under some conditions, DA-independent opiate place preferences has been demonstrated (Mackey and van der Kooy, 1985; Bechara et al., 1992; Nader et al., 1994). Moreover, DA-deficient mice display a robust conditioned place preference for morphine in specific experimental conditions (Hnasko et al., 2005), and DA is not involved in opiate naive state (Laviolette et al., 2004; Vargas-Perez et al., 2009). A DA-independent reward mechanism for caffeine has been shown (Sturgess et al., 2010).
Dopamine D2 receptor knockout mutation in C57BL/6 mice failed to block ethanol-conditioned place preferences in ethanol-dependent and withdrawn mice (Ting-A-Kee et al., 2009). In a more “naturalistic” conditions operant place conditioning by male chemo-signal in female mice was not affected by D1 or D2 receptor antagonists (Agustin-Pavon et al., 2007). It is worth noting that VTA-mediated but DA-independent positive reinforcement has been demonstrated (Fields et al., 2007).
These examples of DA-independent motivated behavior seriously question the original DA hypothesis that suggested DA is a final common pathway in the processes mediating reinforcement.
Prefrontal-Accumbal Catecholamine System
About a couple of decade ago, research has pointed to prefrontal catecholamine (CA) regulation of mesoaccumbens DA transmission in response to pleasant or aversive stimuli (Le Moal and Simon, 1991). In particular, DA transmission in subcortical structures, such as the NAc, seems to be modulated by the DA mesocortical system in an inhibitory way (Ventura et al., 2004, for review), thus strongly suggesting that the mesoaccumbens DA response is inversely related to the mesocortical DA response.
Mesoaccumbens DA transmission has been suggested to be regulated by prefrontal transmission via glutamatergic projections (Carr and Sesack, 2000, for review), through activation of excitatory prefrontal-cortical projection to the VTA (Sesack and Pickel, 1990), and/or through activation of a corticoaccumbens glutamatergic projection (Taber and Fibiger, 1995). Thus, besides possible direct cortico-accumbal circuit, a cortico-(VTA)- accumbal DA network involving different brain areas, such as amygdala (Jackson and Moghaddam, 2001; Mahler and Berridge, 2011), has been proposed to have an important role on accumbal DA modulation.
In late nineties, a French study (Darracq et al., 1998) showed that prefrontal cortical norepinephrine (NE) had a pivotal role in the increased accumbal DA release induced by systemic amphetamine administration. Till that moment, brain noradrenergic system involvement in behavior control was mostly focused on Locus Coeruleus (LC) functions (Aston-Jones et al., 1999) or on emotional memory regulation by the amygdala (McGaugh, 2006). The pioneer work of Darracq and coworkers, suggested implicitly that DA transmission in the NAc could be controlled by and directly related to NE in the medial prefrontal cortex (mpFC). This view, together with the established inhibitory role of prefrontal DA on dopaminergic activity in the accumbens, suggested a possible opposite action of the two amines in the prefrontal cortex on subcortical DA transmission.
Experimental evidence from our lab on mice of C57BL/6 (C57) and DBA/2 (DBA) inbred strains supported this hypothesis. Comparative studies of neurotransmitter activity and behavior in different genetic backgrounds make available a major strategy for investigating the neural basis of drug effects related to individual differences. Mice of the DBA background have been shown to be poorly responsive to the enhancing extracellular DA induced by the psychostimulant in the NAc (shell) as well as to the stimulating/reinforcing effects of amphetamine, that are dependent on increased accumbal DA release. The opposite occurs in mice of the C57 background, which have been shown to be highly responsive to stimulating/reinforcing effects of amphetamine, as shown by increased locomotor activity or to amphetamine-induced CPP (Zocchi et al., 1998; Cabib et al., 2000). In C57, Amphetanine produces low mpFC DA and high DA in the NAc, the opposite occurs in DBA mice that show lower locomotor activity than C57and no CPP or even CPA. Moreover, selective DA depletion in the mpFC of DBA mice makes this strain similar to highly responsive C57 mice leading to high DA outflow in the NAc and hyper locomotion. Nevertheless, no differences in structure or expression of DA transporter in the NAc between C57 and DBA strains have been reported (Womer et al., 1994). These results showed that the different effects of amphetamine on accumbal DA outflow in the two backgrounds do not depend on differences in DAT related mechanisms. However, microdialysis experiments showed that amphetamine increased NE and DA outflow in the mpFC of C57 and DBA mice in a different way. While C57 showed higher NE increase than DA, DBA mice present an opposite pattern, thus indicating that NE/DA ratio induced by amphetamine is higher in C57 versus DBA. Since DA is inhibitory on DA NAc, while NE was suggested to be enabling (Darracq et al., 1998), we hypothesized that imbalanced NE/DA in the mpFC controlled DA in the NAc and related behavioral outcomes, making the C57 strain more responsive than DBA. Such a hypothesis was confirmed by subsequent experiments showing that selective prefrontal cortical NE depletion abolished the effects of amphetamine on DA in accumbens and CPP in C57 mice (Ventura et al., 2003), while selective prefrontal DA depletion (sparing NE) led to DA outflow in the NAc and behavioral outcomes in DBA mice entirely similar to those of C57 (Ventura et al., 2004, 2005).
These data suggested strongly that DA in the NAc is controlled by prefrontal cortical NE that enables it, and by DA that inhibits it. Moreover, our data indicated that prefrontal NE transmission is critical for attribution of motivational salience, as demonstrated by the impairment of amphetamine-induced CPP in mpFC NE depleted C57 mice (Ventura et al., 2003).
However, evidence in the literature (Ventura et al., 2002 for review) and results on stress obtained in our lab on C57 and DBA mice had shown that this was true also for aversive experiences (restraint, Forced Swimming), at least as far prefrontal DA control over DA in the NAc was concerned. Indeed, we found that restraint stress produced inhibition of mesoaccumbens DA release accompanied by a very fast and strong activation of mesocortical DA metabolism in C57 mice, and the opposite in mice of the DBA strain, showing a genetic control over the balance between mesocortical and mesoaccumbens DA responses to stress (Ventura et al., 2001). Moreover, C57 mice but not mice of the DBA strain showed an extremely high level of immobility on their first experience with the forced swimming test (FST) as well as immediate and strong activation of mesocortical DA metabolism and inhibition of mesoaccumbens DA metabolism and release. In addition, the behavioral and the mesoaccumbens DA responses to FST in C57 mice were reduced and reversed, respectively, by selective dopamine DA depletion in the mpFC (Ventura et al., 2002).
Prefrontal NE transmission was known to play a critical role in regulating many cortical functions, including arousal, attention, motivation, learning, memory, and behavioral flexibility (Sara and Segal, 1991; Tassin, 1998; Feenstra et al., 1999; Arnsten, 2000; Robbins, 2000; Bouret and Sara, 2004; Dalley et al., 2004; Mingote et al., 2004; Tronel et al., 2004; Aston-Jones and Cohen, 2005; Rossetti and Carboni, 2005; Lapiz and Morilak, 2006; van der Meulen et al., 2007; Robbins and Arnsten, 2009). Moreover, both rewarding/reinforcing and aversive stimuli have been shown to increase NE release in pFC (Finlay et al., 1995; Dalley et al., 1996; Goldstein et al., 1996; Jedema et al., 1999; Kawahara et al., 1999; McQuade et al., 1999; Feenstra et al., 2000; Page and Lucki, 2002; Morilak et al., 2005; Feenstra, 2007). These evidences suggested that CA prefrontal transmission could control DA in the accumbens also in stressful conditions, a hypothesis that deserved to be assessed. This was done by two independent laboratories and published in 2007. These studies showed that novel stressful experiences enhance DA release in the NAc through activation of prefrontal cortical alpha-1 adrenergic receptors (ARs) by high levels of released NE (Nicniocaill and Gratton, 2007; Pascucci et al., 2007). Indeed, the experience with a novel stressor promotes a rapid, massive, and transient increase in NE release within the mpFC which parallels the enhancement of mesoaccumbens DA release (Pascucci et al., 2007). A selective depletion of prefrontal cortical NE prevents both the cortical NE response and the increase in accumbal DA, leaving stress-induced enhancement of prefrontal cortical DA release as well as basal CAs levels unaffected (Pascucci et al., 2007). Moreover, applications of the alpha-1 AR selective antagonist benoxathian into the mpFC inhibits stress-induced DA release in the NAc dose-dependently (Nicniocaill and Gratton, 2007). Pascucci et al. (2007) also confirmed that stress-induced enhanced NAc DA release is constrained by activation of mpFC DA. Indeed, either DA depletion (Deutch et al., 1990; Doherty and Gratton, 1996; King et al., 1997; Pascucci et al., 2007) or blockade of D1 receptors by infusion of a selective antagonist in the mpFC (Doherty and Gratton, 1996) enhances stress-induced DA release in the NAc. It is known that DA in the mpFC exerts an inhibitory influence on DA release in the NAc and depletion of mesocortical DA facilitates stress-induced activation of mesoaccumbens DA release (Deutch et al., 1990; Doherty and Gratton, 1996; King et al., 1997). However, our results demonstrated that during novel stressful experiences the mpFC determines mesoaccumbens DA response through the opposing influences of NE and DA. Our data could explain why stress may be involved in different pathological conditions. Indeed, the balanced action of the two CAs in the mpFC may be required for healthy coping, whereas unbalanced action may promote hyper- or hypo-responding by mesoaccumbens DA, leading to different and even opposite behavioral disturbances.
The opposite influence exerted by mpFC NE and DA on DA transmission in the NAc during stressful experiences points to possible opposite modulation of frontal cortical glutamate (GLU) by the two CAs. Since blockade of mpFC alpha-1 ARs or D1 receptors has opposite effects on stress-induced GLU increase (Lupinsky et al., 2010), it is likely that frontal cortical NE and DA exert opposite effects on mpFC output, possibly through glutamatergic stimulation of GABA interneurons in the mpFC (Del Arco and Mora, 1999; Homayoun and Moghaddam, 2007).
The involvement of alpha1-ARs in the prefrontal NE control of DA release in the NAc during stress is consistent with evidence that a sustained increase of prefrontal cortical NE (as the one induced by stress) is capable to activate these low-affinity receptors subtypes, while mild increase is able to activate high affinity alpha2- or beta1- ARs (Ramos and Arnsten, 2007). However, the main role of alpha1-ARs in the mesoaccumbens DA activation by stress or by amphetamine (Darracq et al., 1998; Ventura et al., 2003; Nicniocaill and Gratton, 2007), and the crucial role of prefrontal NE in attribution of motivational salience to stimuli related to amphetamine, as shown by CPP study in the mouse (Ventura et al., 2003), point to a main role of these receptors in motivated behavior and coping. mpFC and NAc receive DA afferents from different populations of VTA DA cells and these are controlled by different circuits (Joel and Weiner, 1997; Carr and Sesack, 2000; Lewis and O'Donnell, 2000; Margolis et al., 2006; Lammel et al., 2008; Tierney et al., 2008). VTA also receives afferents from the central nucleus of amygdala (CeA); the inhibition of CeA, and hence of its inhibitory input to VTA, leads to an increase of NAc DA (Ahn and Phillips, 2003; Phillips et al., 2003a), suggesting that this input is part of a double inhibition mechanism (Fudge and Haber, 2000; Ahn and Phillips, 2002; Floresco et al., 2003; Fudge and Emiliano, 2003). NE afferents in the mpFC originate from the relatively small group of cells of LC (Aston-Jones et al., 1999; Valentino and van Bockstaele, 2001; Berridge and Waterhouse, 2003). LC receives strong convergent projections from the orbito-frontal and cingulate cortex, which have been suggested to drive transitions between phasic and tonic modes in NE neurons to fit the behavioral/cognitive states with environmental conditions (Aston-Jones and Cohen, 2005). LC activity is also modulated by CeA (Curtis et al., 2002) through innervation of the pericoerulear region (Berridge and Waterhouse, 2003) and through the excitatory corticotropin-releasing hormone (Van Bockstaele et al., 2001; Bouret et al., 2003; Jedema and Grace, 2004). NE has different effects on target cortical areas depending on its concentration and on the distribution of alpha1 and alpha2 receptors (Briand et al., 2007; Arnsten, 2009). Indeed, different levels of tonic neuromodulator release affects receptors that are differentially located among cortical layers, so that a neuromodulator may differently affect its target subregions depending on the receptors it activates.
The evidences considered till now indicate that a prefrontal CA system controls DA release in the NAc, a sub-cortical area known to be involved in all motivated behavior, independently of the valence of the stimuli or experiences. Thus, a similar prefrontal-accumbal regulation has been shown for rewarding (amphetamine) or aversive (stress) stimuli. Further studies provided substantial support to this view, through experimental evidences that prefrontal cortical NE is crucial in the effects of other addictive drugs, of palatable food, and of aversive pharmacological or physical stimuli. Moreover, they demonstrated that prefrontal NE through its action on NAc DA is essential in attribution of motivational salience in specific conditions, as it will be shown in the next paragraph.
Prefrontal NE- Accumbal DA in Motivational Salience Attribution to both Appetitive- and Aversion-Related Stimuli
Other addictive drugs, in addition to amphetamine, increase DA release in the NAc through prefrontal NE, as shown by experiments based on intracerebral microdialysis in the mouse and on selective NE depletion in the mpFC. Selective NE depletion was carried-out by the neurotoxin 6-hydroxydopamine and pre-treatment with the selective DA transporter blocker GBR-12909 that produced about 90% NE afferents destruction, with no significant effects on DA. To avoid substantial changes in receptor regulation, neurochemical and behavioral testing were carried out within one week from surgery. Morphine (Ventura et al., 2005), Cocaine (Ventura et al., 2007), ethanol (Ventura et al., 2006, in preparation) have been shown to induce dose-dependent increase of NE in the mpFC and a parallel increase of DA in the NAc. Selective prefrontal NE depletion abolished the outflow increase of both prefrontal NE and DA in the NAc, thus confirming the crucial role of NE in mpFC in accumbal DA activation induced by different classes of drugs of abuse. It is worth noting that all the assessed drugs increased DA outflow in the mpFC, that was not affected by NE depletion. However, one may hypothesize that, based on the known inhibitory role of prefrontal DA on DA release in the NAc observed in animals receiving drugs (e.g., amphetamine) or stress, the failure of DA increase in the NAc of NE mpFC depleted subjects receiving drugs was due to the prevalent inhibitory action of prefrontal DA in the absence of NE. Such a view, would affirm the crucial “promoting” role of prefrontal NE on accumbal DA, pointing, however, to a complementary role of DA in mpFC that would exert an inhibitory role leading to “flatting” accumbal DA when cortical NE is depleted. This possibility was ruled-out by complementary experiments showing that concomitant depletion of NE and DA in mpFC does not change the impaired accumbal DA release in mice receiving AMPH in comparison with animals subjected to selective NE depletion. A body of evidence suggests that DA in the prefrontal cortex is co-released with NE from noradrenergic terminals (Devoto et al., 2001, 2002). Moreover, it has been reported that DA in this brain area is normally cleared by NE transporter (Tanda et al., 1997; Moron et al., 2002). Different set of data obtained in both mice and rats, showed a lack of effects of the NE depletion on basal extracellular DA, suggesting that the likely reduction of DA released from destructed noradrenergic terminals is compensated by augmented availability of DA due to its reduced uptake from these terminals (Ventura et al., 2005; Pascucci et al., 2007). However, NE-depleted mice showed an increase of morphine-induced DA release similar to that exhibited by Sham animals, thus suggesting that prefrontal noradrenergic and dopaminergic projections are functionally uncoupled. In agreement with this observation, selective prefrontal NE depletion in rats did not affect stress-induced DA release and selective DA depletion did not affect stress-induced NE release. Taken together, these data indicate that, in both reinforcing (morphine injection) and aversive (stressful situation) conditions, NE and DA release in the mpFC are independent.
This evidence suggests that NE is a common regulating element responding to different class of stimuli to induce DA activation in the NAc, irrespective of the specific pharmacological or physiological properties of stimuli. Possible network elements have been mentioned before and will be further considered. Here, it is worth to point out that different class of pleasant stimuli as well as aversive experiences such stress are likely to activate a common prefrontal cortical-subcortical network.
The role of mesoccumbens DA system in motivation is well-established. However, whether also a system, involving prefrontal NE and accumbal DA, has a role, needs experimental support. To study incentive learning and incentive motivation, place conditioning is commonly exploited in rats and mice, but in the last species is prevalent since operant procedures that are mostly used for studying drug self-administration in rats, present a number of difficulties in mice. Anyway, this method allows attribution of motivational salience to stimuli related to either pleasant (appetitive) or aversive stimuli (US). In the first case pairings between stimuli and environment (CS) lead to place preference (CPP), while in the second produce place aversion (CPA). The process of attribution of motivational salience is measured by the preference (or the aversion) shown when a subject has to choose between the environment previously paired with the US and a neutral environment (Tzschentke, 1998; Mueller and Stewart, 2000). This method is also useful to assess relapse to previously preference (or aversion) after extinction, and is a choice method in modeling addiction (Lu et al., 2003; Shaham et al., 2003). Indeed, a before mentioned study had shown that selective prefrontal cortical NE depletion besides impairing amphetamine-induced DA outflow increase in the NAc, impaired CPP induced by the stimulant. These effects were not due to motor deficits, or learning impairments, since depleted animals were not different from sham controls in motor behavior, and, most importantly, were able of associative learning as shown by avoidance test (Ventura et al., 2003).
Moreover, these results indicate that intact prefrontal cortical NE is necessary for CPP induced by morphine, cocaine, or ethanol as well as for reinstatement (relapse) of extinguished morphine-induced CPP, and for ethanol intake in a choice test. Thus, they demonstrate that prefrontal NE is crucial for DA release in the NAc induced by addictive drugs and for attribution of motivation salience to drug-related stimuli.
However, the results concerning aversive experiences demonstrate that the noradrenergic control of accumbal DA activation is evident also for stress, suggesting a common network involved in processing both pleasant (rewarding) and aversive stimuli. To assess this hypothesis we planned two experiments. In the first one we observed that a pharmacological aversive stimulus such lithium chloride administered systemically in mice induced a clear-cut increase of NE in the mpFC and DA in the accumbens that was abolished by selective prefrontal NE depletion. Moreover, lithium induced a CPA that was abolished by prefrontal NE depletion, thus confirming that prefrontal NE is crucial for attribution of motivational salience to stimuli related to aversive experience (Ventura et al., 2007).
Next step was suggested by preliminary results obtained when we decided to assess the role of prefrontal-accumbal CA system in attribution of motivational salience to natural non-pharmacological stimuli. Previous data in the literature allowed to hypothesize that appetitive or aversive stimuli produce a graded activation of prefrontal noradrenergic transmission, thus more salient is a stimulus stronger the prefrontal NE release will be (Feenstra et al., 2000; Ventura et al., 2008 for review). If this were the case, then prefrontal NE release could be considered an index of stimuli salience. To further support that prefrontal NE-accumbal DA system is crucial for attribution of motivational salience also for aversive stimuli we used as aversive non-pharmacological experience a stressor (intermittent lights) that could be graded in order to provide parallel effects to those of pleasant (rewarding) stimuli like palatable food before described. In place conditioning preliminary tests, in which the two stressors were compared we observed that they differ in the conditioned aversive effects, the pulsating intermittent lights being more aversive than intermittent non-pulsating lights. This result paralleled the effects of the two aversive conditions on prefrontal cortical NE release. Both lighting conditions increased prefrontal NE release, but pulsating lighting produced more pronounced increase than non-pulsating lighting. Moreover, noradrenergic response in mpFC was paralleled by graded increase of DA in the NAc (Ventura et al., in preparation).
Then, we assessed if appetitive non-pharmacological stimuli, used as US in place conditioning, required intact prefrontal NE-accumbal DA functioning for attribution of motivational salience. We have observed that mice preferred white chocolate (WCh) to Milk (MCh)-chocolate in a free choice test, a preference that was confirmed in a CPP paradigm where mice chose the environment paired with WCh in comparison with that paired to MCh-chocolate. Consistently, intracerebral microdialysis showed that exposure to WCh intake produces a higher NE release in mpFC than MCh (Ventura et al., 2008, in preparation) accompanied by a more sustained DA outflow in the NAc. These results demonstrate that prefrontal NE and accumbal DA respond to different salient stimuli, either pleasant or aversive, in a graded manner.
Incentive motivation theory has pointed to the major role of the motivational status of the organism (hungry, thirsty, tired, alert etc.) when it is confronted with a stimulus or experience. Stress has received much attention in motivation related studies, particularly those concerning addiction models, for neuro-adaptation it can produce in the brain systems involved in the response to drug priming, incentive learning processes, and relapse. We wondered if pre-exposure to stressful experience could affect the “perceived” salience of the stimulus and the response of prefrontal-accumbal CA system, and if such changes could affect attribution of motivational salience in our experimental conditions. We used a food-restriction regimen as chronic stress that was also shown to change the behavioral response to amphetamine and, affect attribution of motivational salience in mice (Cabib et al., 2000; Guarnieri et al., 2011). Food-restriction (FR) led to higher NE release in mpFC and higher DA release in the NAc in comparison with control mice. This increase was similar to that shown by free-fed (Non-FR) mice exposed to WCh, thus showing that the state of the organism, as expected, influenced the response to appetitive stimuli. This effect may be ascribed obviously to the food deprivation that would make it more palatable. However, our data indicate that FR regimen is an environmental condition that affects the perceived salience, independently of food-related mechanism. Indeed, we observed that FR made the effects induced by the less salient stressor (intermittent light) similar to the effects produced in non-FR mice by the more salient stressor (pulsating intermittent light). This means that FR is capable to increase the salience of both pleasant (rewarding; food) and aversive (stressful lighting) stimuli, regardless of hunger-related mechanisms. Note that in additional experiments Sham and NE depleted mice subjected to a different no food-related chronic stressful experience (social isolation) showed similar effects to those of FR animals, thus indicating that the effect of prefrontal NE depletion on MCh-induced CPP cannot be ascribed to the homeostatic response to dietary restriction (Ventura et al., 2008). Food-restriction can also be considered as leading to a generalized drive effect (Niv et al., 2006; Phillips et al., 2007) that would “energize” motivation. This mechanism seems to depend on deprivation states. Our results, however, indicate that a generalized drive effect produced by food-restriction regimen before exposure to specific stimuli affects not only appetitive alimentary stimuli but also aversive stimuli. In fact, aversive effects of intermittent light are stronger in food-restricted than in free-fed mice. Thus, a generalized drive effect should involve common neural mechanisms regulating both appetitive and aversive experiences.
Taken together, these results show that the prefrontal-accumbal CA response is an index of the emotional/motivational impact of differently salient stimuli depending on the stimuli characteristics or on the state of the organism. The graded response of prefrontal NE was in agreement with previous results and suggested to us to ascertain the role of prefrontal-accumbal CA system in attribution of motivational salience related to differently salient stimuli. Using the experimental paradigms of other studies on the same topics, we assessed the effects of selective prefrontal NE depletion on the CA response and on attribution of motivational salience measured by place conditioning. Surprisingly, we observed that NE depletion abolished the increase of prefrontal cortical NE release and of accumbal DA, consistently with previous experiments. However, it prevented place preference (CPP) in animals exposed to WCh and in food-restricted (FR) animals exposed to milk chocolate (MCh; both conditions of high salience) but not in non-FR (Free-fed) animals exposed to MCh (low salience). Moreover, it prevented place aversion (CPA) in animals exposed to intermittent pulsating light (IPL) and in the FR animals exposed to intermittent light (IL; high salience) but not in non FR animals exposed to IL (low salience; Figure 1).
Figure 1. Effects of prefrontal cortical norepinephrine depletion on conditioned place preference (CPP) induced by chocolate (milk chocolate in control, MCh; milk chocolate in food restricted MCh+FR; white chocolate in control, WCh) and conditioned place aversion (CPA) induced by light (intermittent light in control, IL; intermittent light in food restricted, IL+FR; intermittent-pulsating light in control; IPL) [Sham, norepinephrine-depleted in medial prefrontal cortex (mpFC NE Depleted)]. All data are expressed as mean (sec ± SE) time spent in Paired, and Unpaired chambers. *P < 0.05 in comparison with the Unpaired chamber; #P < 0.005 in comparison with the Unpaired chamber (from Ventura et al., 2008, modified).
These results show that that pFC NE depletion affects attribution of motivational salience only when the salience of the UCS is high enough to induce sustained CA activation, thus indicating that prefrontal-accumbal CA system is involved in processing motivational salience attribution selectively when intense motivational salience is processed. Salience refers to the capability of stimuli to be arousing (Horvitz, 2000). Salient stimuli cause the reallocation of available cognitive resources in order to produce an attentional or a behavioral switch (Zink et al., 2006). The more salient the stimulus, the more likely it will lead to an attentional or a behavioral switch. Recent reports in humans have shown that striatum has a major role in prompting the reallocation of resources to salient stimuli (Zink et al., 2003, 2006). However prefrontal cortex, due to its “supervisory” functions, has an unquestionable central role in attentional and motivational processing of salient stimuli.
Moreover, data indicate that ventral striatum (or NAc) and prefrontal cortex constitute a common substrate for processing both rewarding and aversive stimuli (Berridge and Robinson, 1998; Darracq et al., 1998; Becerra et al., 2001; Jensen et al., 2003; Kensinger and Schacter, 2006; Borsook et al., 2007), and neuroimaging studies in humans suggest that different areas of prefrontal cortex (O'Doherty et al., 2001; Small et al., 2001; Killgore et al., 2003; Wang et al., 2004) and of striatum (Jensen et al., 2003; Zink et al., 2006; Borsook et al., 2007) are activated by natural positive or negative salient stimuli. Again, we have previously demonstrated that intact NE prefrontal transmission is necessary for motivational salience attribution to both natural (in food restricted animals) and pharmacological reward related stimuli as well as to pharmacological aversion related stimuli through modulation of DA in NAc (Ventura et al., 2007). Therefore, it is likely that the effects of prefrontal NE depletion on CPP and CPA in animals exposed to highly salient stimuli depend on the impaired response of prefrontal-accumbal CA system, whose activation by unconditioned rewarding and aversive highly salient stimuli is a substrate for motivational salience. However, other brain areas and neurotransmitters are likely to be engaged. Thus, since amygdala is involved in pavlovian conditioning of emotional responses and plays a specific role in modulating memory for arousing experiences (Balleine, 2005; Balleine and Killcross, 2006; McGaugh, 2006), and given the complex anatomical and functional connections between this brain area and prefrontal cortex (Cardinal et al., 2002; Holland and Gallagher, 2004; Roozendaal et al., 2004) a role of a prefrontal cortex-amygdala system in the effects of highly salient stimuli reported here must be considered (Belova et al., 2007).
Conclusions
Attribution of motivational salience is related to the salience of an UCS (Dallman et al., 2003; Pecina et al., 2006). Thus, the more salient an UCS the more likely a neutral (to-be-conditioned) stimulus will be associated with it through motivational salience attribution. Prior experience is a major determinant of the motivational impact of any given stimulus (Borsook et al., 2007) and emotional arousal induced by motivational stimuli increases the attention given to stimuli influencing both the initial perceptual encoding and the consolidation process (Anderson et al., 2006; McGaugh, 2006). We provided evidence that prefrontal-accumbal CA transmission is necessary for motivational salience attribution to both reward- and aversion-related stimuli only under those conditions able to induce stronger increases of CA outflow in response to highly salient unconditioned natural stimuli, independently of valence.
Thus, selective prefrontal NE depletion abolished the place conditioning induced by highly salient stimuli (i.e., WCh and IPL) in control animals and by mildly salient stimuli (i.e., MCh and IL) in stressed groups, but had no significant effects in control animals exposed to mild salient stimuli. These results demonstrate that prefrontal-accumbal CA transmission is necessary for the acquisition of conditioned properties to stimuli paired with highly salient natural rewarding or aversive events in a place-conditioning procedure. Many different factors have major regulatory role in motivated behaviors, including the internal variables of the organism (i.e., motivational state, stress response) and stimulus properties (i.e., salience or intensity), both of which affect motivational salience attribution processes (Berridge and Robinson, 1998; Richard and Berridge, 2011). It has been recently proposed that appetitive and aversive brain systems act in a “congruent manner for processes sensitive to affective intensity (salience) but not valence” (Belova et al., 2007), thus suggesting that a common neural system might be involved in processing stimuli salience, irrespectively of valence. Moreover, arousing pleasant or aversive stimuli that elicit valence-specific responses have been suggested to enhance attention and memory formation through a common, valence-insensitive pathway (Belova et al., 2007) and prefrontal cortex has been involved in processing both rewarding and aversive stimuli (Rolls, 2000; O'Doherty et al., 2001; Killgore et al., 2003; Ventura et al., 2007).
Dopaminergic transmission within NAc is considered to mediate the hedonic impact of reward or some aspects of reward learning (Everitt and Robbins, 2005 for review). Our results, in agreement with a different view (Berridge and Robinson, 1998), show that DA transmission in NAc plays a role in both positively and aversively motivated behavior; most importantly, however, they demonstrate that this motivational process is governed by prefrontal cortical NE.
Norepinephrine in mpFC might activate mesoaccumbens DA release through excitatory prefrontal cortical projection to VTA DA cells (Sesack and Pickel, 1992; Shi et al., 2000) and/or through corticoaccumbal glutamatergic projections (Darracq et al., 2001). Moreover, a role for mpFC projections to the LC in exerting an excitatory influence can be envisaged because this nucleus has been shown to activate VTA DA neurons (Grenhoff et al., 1993; Jodo et al., 1998; Liprando et al., 2004), which could lead to increased DA release in NAc. However, since amygdala is involved in Pavlovian conditioning of emotional responses and plays a specific role in modulating memory for arousing experiences (Balleine and Killcross, 2006; McGaugh, 2006), and given the complex anatomical and functional connections between this brain area and prefrontal cortex (Cardinal et al., 2002; Roozendaal et al., 2004), a role of the prefrontal cortex-amygdala system in the effects of the highly salient stimuli reported here must be considered (Belova et al., 2007; Mahler and Berridge, 2011).
Note that NAc and dopaminergic transmission are considered to play major role in motivation processes besides the role that DA plays in other aspects of incentive motivation and instrumental learning (Salamone et al., 2005). Indeed, based on the view that is doubtful that accumbens DA performs only one function, substantial evidences support the hypothesis that DA is involved in the exertion of effort or effort-related decision-making (Salamone et al., 2007; Bardgett et al., 2009), that is not incompatible with the involvement of this system in instrumental learning, incentive motivation, or pavlovian-instrumental transfer. Animal and human studies seem to converge in that, together with animal studies focused on effort related functions of accumbal DA, clinical findings are consistent with the hypothesis that DA systems are involved in behavioral activation, pointing to a striking similarity between the brain systems implicated in effort-related processes in animals and those involved in energy dysfunctions in humans (Salamone et al., 2007). According to this view NAc functioning is to be considered, along with prefrontal cortex and the amygdala, as a component of the brain circuitry regulating effort-related functions. In this framework, the prefrontal/accumbal CA system we have envisaged may conceivably be a part of a complex network involving cortical and subcortical brain areas involved in regulation of effort-related functions controlling motivation outcomes, and possibly linking salience intensity to effort intensity. In our view the impact of salient stimuli is crucial in the processes that lead to attribution of motivational salience, due to the salience perceived. That means that the impact of stimuli produce an emotional response that tunes the association processes leading to motivation outcome, thus pointing to the basic role of emotional salience as the individual is exposed to the UCS. The prefrontal/accumbal system we propose to control motivational salience processes depending on salience intensity should be considered included in complex networks regulating perceived emotion (Phillips et al., 2003b). Emotion perception, according to the appraisal theories (Arnold, 1960; Lazarus, 1991) has been suggested to stems from three processes: the identification of the emotional significance of a stimulus, the production of an affective state in response to the stimulus, and the regulation of the affective state. As shown by human and animal literature (Phillips et al., 2003b for review), these processes depend on different brain emotional systems involving brain areas including mesencephalic, cortical, and subcortical such as the amygdala, insula, ventral striatum, ventral, and dorsal anterior cingulate gyrus, the septo-hippocampus system, the prefrontal cortex, all characterized by reciprocal functional relationships (Salzman and Fusi, 2010). The septo-hippocampus system has been considered as a general-purpose comparator, with a central role in determining the extent of conflict between different goal-directed behaviors (Gray and McNaughton, 2000). Amygdala has a well-known role in emotion and in memory consolidation processes depending on emotional arousal. Recently a role of this area in decision-making has been envisaged. Indeed, the amygdala can evoke conditioned responses capable of exerting a dominant effect on choice, and perceived emotional values in Pavlovian conditioning are exploited by instrumental (habit-based and goal-directed) learning mechanisms through connectivity with other brain regions such as the striatum and prefrontal cortex (Seymour and Dolan, 2008).
It is worth noting that “values” are affected by the action of stress hormones, such as glucocorticoids, on amygdala, and these effects control memory consolidation pointing to a link between emotional salience and the strength of memories (Roozendaal, 2000; Setlow et al., 2000; McGaugh, 2005). Moreover glucocorticoids have been shown to be biological substrate of reward (Piazza and Le Moal, 1997) and substantial evidences show that they play a role in the modulation of both appetitive and aversive emotional memories indicating that modulation of appetitive and aversive discrete-cue learning may be subserved by a common mechanism (Zorawski and Killcross, 2002).
We have provided evidence that prefrontal-accumbal CA system is involved in processing motivational salience attribution selectively when intense motivational salience is processed, thus pointing to an allegedly different neural system involved in the attribution of motivational salience related to mildly salient stimuli. Our results are consistent with those that had shown DA transmission is not always involved in motivation (Nader et al., 1997, for review). In contrast with the DA hypothesis that is based on a single-system model of reward, a non-deprived/deprived model has been proposed in the late nineties that claims that two separate neurobiological reward systems can be double dissociated, each of which makes a significant contribution to motivated behavior depending on deprivation state. Note that the model is supported by experiments where drug naive animals are considered similar to food-sated (i.e., non-deprived), differently from drug-dependent animals in withdrawal or food-restricted animals that are considered deprived (Nader et al., 1997; Laviolette et al., 2004). The model has two important implications. First, the relationship between the two systems appears to be mutually exclusive. A state of deprivation inhibits the non-deprived system [involving the peduncolo-pontine nucleus (TPP)]. Thus, the differential activation of the two systems is predicated specifically on whether animals are, for instance, in a state of withdrawal or not (Nader et al., 1997). The second implication is that a state of deprivation engages a second neurobiologically distinct motivational system, a component of which is DA.
The obvious question that arises from this model is whether all motivated behaviors can be considered to have a non-deprived and a deprived component. As it was questioned by the proponents (Nader et al., 1997, for review): “Do some stimuli only work through one of the two systems?” Although this discussion is out of the aim of our present work, we can't help noting the parallelism between our findings on prefrontal-accumbal CA system and the non-deprived/deprived system, in that our system is crucial in attribution of motivational salience when the stimuli salience is high and characterized by high emotional impact (either positive or negative). In this case, another system involved in low salience processing is inhibited or “off-line,” and this system that is on-line when low salience is processed (and that we did not envisaged yet), parallels the non-deprived system, characterized by low emotional impact. Our results also suggest strongly that, like suggested for the non-deprived/deprived model, the system processing high salience (prefrontal-accumbal CA system) and the supposed one involved in low salience are mutually exclusive. In terms of the neural dynamics involved in the selective and exclusive engagement of these systems, we can tentatively pose that the graded increase of NE outflow in mpFC depending on low or high salience of stimuli, may involve different AR-subtypes, that, in turn, depending on a given threshold level of released NE, will engage different circuits, and, in the case of high salience, including DA in the NAc. This is the aim of ongoing experiments that will possibly elucidate this critical question.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This research was supported by Ministero della Ricerca Scientifica e Tecnologica (PRIN 2008), Sapienza University (Ricerca, 2010), and Ministero della Salute (Ricerca corrente, 2009–2011).
References
Adamantidis, A. R., Tsai, H. C., Boutrel, B., Zhang, F., Stuber, G. D., Budygin, A., Tourino, C., Bonci, A., Deisseroth, K., and de Lecea, L. (2011). Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward seeking behavior. J. Neurosci. 1, 10829–10835.
Agustin-Pavon, C., Martinez-Ricos, J., Martinez-Garcia, F., and Lanuza, E. (2007). Effects of dopaminergic drugs on innate pheromone-mediated reward in female mice: a new case of dopamine-independent “liking.” Behav. Neurosci. 121, 920–932.
Ahn, S., and Phillips, A. G. (2002). Modulation by central and basolateral amygdalar nuclei of dopaminergic correlates of feeding to satiety in the rat nucleus accumbens and medial prefrontal cortex. J. Neurosci. 22, 10958–10965.
Ahn, S., and Phillips, A. G. (2003). Independent modulation of basal and feeding-evoked dopamine efflux in the nucleus accumbens and medial prefrontal cortex by the central and basolateral amygdalar nuclei in the rat. Neuroscience 116, 295–305.
Anderson, A. K., Wais, P. E., and Gabrieli, J. D. E. (2006). Emotion enhances remembrance of neutral events past. Proc. Natl. Acad. Sci. U.S.A. 103, 1599–1604.
Arnsten, A. F. T. (2000). Through the looking glass: differential noradrenergic modulation of prefrontal cortical function. Neural Plast. 7, 133–146.
Arnsten, A. F. T. (2009). Stress signalling pathways that impair prefrontal cortex structure and function. Nat. Rev. Neurosci. 10, 410–422.
Aston-Jones, G., and Cohen, J. D. (2005). An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Ann. Rev. Neurosci. 28, 403–450.
Aston-Jones, G., Rajkowski, J., and Cohen, J. (1999). Role of locus coeruleus in attention and behavioral flexibility. Biol. Psychiatry 46, 1309–1320.
Balleine, B. W. (2005). Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol. Behav. 86, 717–730.
Balleine, B. W., and Killcross, S. (2006). Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci. 29, 272–279.
Bardgett, M. E., Depenbrock, M., Downs, N., Points, M., and Green, L. (2009). Dopamine modulates effort-based decision-making in rats. Behav. Neurosci. 123, 242–251.
Becerra, L., Breiter, H. C., Wise, R., Gonzalez, R. G., and Borsook, D. (2001). Reward circuitry activation by noxious thermal stimuli. Neuron 32, 927–946.
Bechara, A., Harrington, F., Nader, K., and van der Kooy, D. (1992). The neurobiology of motivation: double dissociation of two motivational mechanisms mediating opiate reward in naive versus drug-dependent animals. Behav. Neurosci. 106, 798–807.
Belova, M. A., Paton, J. J., Morrison, S. A., and Salzman, D. (2007). Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55, 970–984.
Berridge, C. W., and Waterhouse, B. D. (2003). The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res. Brain Res. Rev. 42, 33–84.
Berridge, K. C. (2001). “Reward learning: reinforcement, incentives, and expectations,” in The Psychology of Learning and Motivation, Vol. 40, ed D. L. Medin (New York, NY: Academic Press), 223–278.
Berridge, K. C. (2004). Motivation concepts in behavioral neuroscience. Physiol. Behav. 81, 179–209.
Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Rev. 28, 309–369.
Berridge, K. C., and Valenstein, E. S. (1991). What psychological process mediates feeding evoked by electrical stimulation of the lateral hypothalamus? Behav. Neurosci. 105, 3–14.
Berridge, K. C., Venier, I. L., and Robinson, T. E. (1989). Taste reactivity analysis of 6-hydroxydopamine-induced aphagia: implications for arousal and anhedonia hypotheses of dopamine function. Behav. Neurosci. 103, 36–45.
Bindra, D. (1974). A motivational view of learning, performance, and behavior modification. Psychol. Rev. 81, 199–213.
Bindra, D. (1978). How adaptive behavior is produced: a perceptual-motivation alternative to response reinforcement. Behav. Brain Sci. 1, 41–91.
Borsook, D., Becerra, L., Carlezon, W. A. Jr., Shaw, M., Renshaw, P., Elman, I., and Levine, J. (2007). Reward-aversion circuitry in analgesia and pain: implications for psychiatric disorders. Eur. J. Pain 11, 7–20.
Bouret, S., Duvel, A., Onat, S., and Sara, S. (2003). Phasic activation of locus ceruleus neurons by the central nucleus of the amygdala. J. Neurosci. 23, 3491–3497.
Bouret, S., and Sara, S. J. (2004). Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. Eur. J. Neurosci. 20, 791–802.
Briand, L., Gritton, H., Howe, W. M., Young, D., and Sarter, M. (2007). Modulators in concert for cognition: modulator interactions in the prefrontal cortex. Prog. Neurobiol. 83, 69–91.
Bromberg-Martin, E. S., Matsumoto, M., and Hikosaka, O. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron 68, 815–834.
Cabib, S., Orsini, C., Le Moal, M., and Piazza, P. V. (2000). Abolition and reversal of strain differences in behavioral responses to drug of abuse after a brief experience. Science 289, 463–465.
Cabib, S., and Puglisi-Allegra, S. (2012). The mesoaccumbens dopamine in coping with stress. Neurosci. Biobehav. Rev. 36, 79–89.
Caine, S. B., and Koob, G. F. (1993). Modulation of cocaine self-administration in the rat through D-3 dopamine receptors. Science 260, 1814–1816.
Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321–352.
Carr, D. B., and Sesack, S. R. (2000). Projections from the rat prefrontal cortex to the ventral tegmental area: target specificity in the synaptic associations with mesoaccumbens and mesocortical neurons. J. Neurosci. 20, 3864–3873.
Carr, G. D., Fibiger, H., and Phillips, A. G. (1989). “Conditioned place preference as a measure of drug reward,” in Oxford Reviews in Psychopharmacology, eds J. M. Leibman and S. J. Cooper (Oxford, UK: Oxford University Press), 264–319.
Curtis, A., Bello, N., Connolly, K., and Valentino, R. (2002). Corticotropin-releasing factor neurones of the central nucleus of the amygdala mediate locus coeruleus activation by cardiovascular stress. J. Neuroendocrinol. 14, 667–682.
Dalley, J. W., Cardinal, R. N., and Robbins, T. W. (2004). Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. Neurosci. Biobehav. Rev. 28, 771–784.
Dalley, J. W., Mason, K., and Stanford, S. C. (1996). Increased levels of extracellular noradrenaline in the frontal cortex of rats exposed to naturalistic environmental stimuli: modulation by acute systemic administration of diazepam or buspirone. Psychopharmacology (Berl.) 127, 47–54.
Dallman, M. F., Pecoraro, N., Akana, S. F., La Fleur, S. E., Gomez, F., Houshyar, H., Bell, M. E., Bhatnagar, S., Laugero, K. D., and Manalo, S. (2003). Chronic stress and obesity: a new view of “comfort food”. Proc. Natl. Acad. Sci. U.S.A. 100, 11696–11701.
Darracq, L., Blanc, G., Glowinski, J., and Tassin, J. P. (1998). Importance of the noradrenaline-dopamine coupling in the locomotor activating effects of D-amphetamine. J. Neurosci. 18, 2729–2739.
Darracq, L., Drouin, C., Blanc, G., Glowinski, J., and Tassin, J. P. (2001). Stimulation of metabotropic but not ionotropic glutamatergic receptors in the nucleus accumbens is required for the D-amphetamine-induced release of functional dopamine. Neuroscience 103, 395–403.
Del Arco, A., and Mora, F. (1999). Effects of endogenous glutamate on extracellular concentrations of GABA, dopamine, and dopamine metabolites in the prefrontal cortex of the freely moving rat: involvement of NMDA and AMPA/KA receptors. Neurochem. Res. 24, 1027–1035.
Deutch, A. Y., Clark, W. A., and Roth, R. H. (1990). Prefrontal cortical dopamine depletion enhances the responsiveness of mesolimbic dopamine neurons to stress. Brain Res. 521, 311–315.
Devoto, P., Flore, G., Pani, L., and Gessa, G. L. (2001). Evidence for co-release of noradrenaline and dopamine from noradrenergic neurons in the cerebral cortex. Mol. Psychiatry 6, 657–664.
Devoto, P., Flore, G., Pira, L., Diana, M., and Gessa, G. L. (2002). Co-release of noradrenaline and dopamine in the prefrontal cortex after acute morphine and during morphine withdrawal. Psychopharmacology 160, 220–224.
Doherty, M. D., and Gratton, A. (1996). Medial prefrontal cortical D1 receptor modulation of the meso-accumbens dopamine response to stress: an electrochemical study in freely-behaving rats. Brain Res. 715, 86–97.
Dworkin, S. I., Guerin, G. F., Co, C., Goeders, N. E., and Smith, J. E. (1988). Lack of an effect of 6-hydroxydopamine lesions of the nucleus accumbens on intravenous morphine self-administration. Pharmacol. Biochem. Behav. 30, 1051–1057.
Ettenberg, A., Pettit, H. O., Bloom, F. E., and Koob, G. F. (1982). Heroin and cocaine intravenous self-administration in rats: mediation by separate neural systems. Psychopharmacology 78, 204–209.
Everitt, B. J., and Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 11, 1481–1487.
Feenstra, M. G., Botterblom, M. H., and Mastenbroek, S. (2000). Dopamine and noradrenaline efflux in the prefrontal cortex in the light and dark period: effects of novelty and handling and comparison to the nucleus accumbens. Neuroscience 100, 741–748.
Feenstra, M. G., Teske, G., Botterblom, M. H., and de Bruin, J. P. (1999). Dopamine and noradrenaline release in the prefrontal cortex of rats during classical aversive and appetitive conditioning to a contextual stimulus: interference by novelty effects. Neurosci. Lett. 272, 179–182.
Feenstra, M. G. P. (2007). “Microdialysis of dopamine and norepinephrine during conditioning and operant behaviour,” in Handbook of Microdialysis, vol. 16, eds B. H. C. Westerink and T. I. F. H. Cremers (Amsterdam: Academic Press), 317–350.
Fields, H. L., Hjelmstad, G. O., Margolis, E. B., and Nicola, S. M. (2007). Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci. 30, 289–316.
Finlay, J. M., Zigmond, M. J., and Abercrombie, E. D. (1995). Increased dopamine and norepinephrine release in medial prefrontal cortex induced by acute and chronic stress: effects of diazepam. Neuroscience 64, 619–628.
Floresco, S., West, A., Ash, B., Moore, H., and Grace, A. (2003). Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission. Nat. Neurosci. 6, 968–973.
Fudge, J. L., and Emiliano, A. B. (2003). The extended amygdala and the dopamine system: another piece of the dopamine puzzle. J. Neuropsychiatry Clin. Neurosci. 15, 306–316.
Fudge, J. L., and Haber, S. N. (2000). The central nucleus of the amygdala projection to dopamine subpopulations in primates. Neuroscience 97, 479–494.
Goldstein, L. E., Rasmusson, A. M., Bunney, B. S., and Roth, R. H. (1996). Role of the amygdala in the coordination of behavioral, neuroendocrine, and prefrontal cortical monoamine responses to psychological stress in the rat. J. Neurosci. 16, 4787–4798.
Gray, J. A., and McNaughton, N. (2000). The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septohippocampal System, 2nd edn. Oxford, UK: Oxford University Press.
Grenhoff, J., Nisell, M., Ferre, S., Aston-Jones, G., and Svensson, T. H. (1993). Noradrenergic modulation of midbrain dopamine cell firing elicited by stimulation of the locus coeruleus in the rat. J. Neural Transm. 93, 11–25.
Guarnieri, D. J., Brayton, C. E., Richards, S. M., Maldonado-Aviles, J., Trinko, J. R., Nelson, J., Taylor, J. R., Gourley, S. L., and Dileone, R. J. (2011). Gene profiling reveals a role for stress hormones in the molecular and behavioral response to food restriction. Biol. Psychiatry 71, 358–365.
Guarraci, F. A., and Kapp, B. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res. 99, 169–179.
Hemby, S. E., Jones, G. H., Justice, J. B. Jr., and Neil, D. B. (1992). Conditioned locomotor activity but not conditioned place preference following intra-accumbens infusions of cocaine. Psychopharmacology 106, 330–336.
Hnasko, T. S., Sotak, B. N., and Palmiter, R. D. (2005). Morphine reward in dopamine-deficient mice. Nature 438, 854–857.
Holland, P. C., and Gallagher, M. (2004). Amygdala-frontal interactions and reward expectancy. Curr. Opin. Neurobiol. 14, 148–155.
Homayoun, H., and Moghaddam, B. (2007). NMDA receptor hypofunction produces opposite effects on prefrontal cortex interneurons and pyramidal neurons. J. Neurosci. 27, 11496–11500.
Horvitz, J. C. (2000). Mesolimbo cortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96, 651–656.
Ikemoto, S. (2007). Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res. Rev. 56, 27–78.
Ikemoto, S., and Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Rev. 31, 6–41.
Jackson, M. E., and Moghaddam, B. (2001). Amygdala regulation of nucleus accumbens dopamine output is governed by the prefrontal cortex. J. Neurosci. 21, 676–681.
Jedema, H., and Grace, A. (2004). Corticotropin-releasing hormone directly activates noradrenergic neurons of the locus ceruleus recorded in vitro. J. Neurosci. 24, 9703–9713.
Jedema, H. P., Sved, A. F., Zigmond, M. J., and Finlay, J. M. (1999). Sensitization of norepinephrine release in medial prefrontal cortex: effect of different chronic stress protocols. Brain Res. 830, 211–217.
Jensen, J., McIntosh, A. R., Crawley, A. P., Mikulis, D. J., Remington, G., and Kapur, S. (2003). Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40, 1251–1257.
Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., and Holland, P. C. (2009). The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61, 786–800.
Jodo, E., Chiang, C., and Aston-Jones, G. (1998). Potent excitatory influence of prefrontal cortex activity on noradrenergic locus coeruleus neurons. Neuroscience 83, 63–79.
Joel, D., and Weiner, I. (1997). The connections of the primate subthalamic nucleus: indirect pathways and the open-interconnected scheme of basal ganglia-thalamocortical circuitry. Brain Res. Rev. 23, 62–78.
Joseph, M. H., Datla, K., and Young, A. M. J. (2003). The interpretation of the measurement of nucleus accumbens dopamine by in vivo dialysis: the kick, the craving or the cognition? Neurosci. Biobehav. Rev. 27, 527–541.
Joshua, M., Adler, A., Mitelman, R., Vaadia, E., and Bergman, H. (2008). Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J. Neurosci. 28, 11673–11684.
Kawahara, Y., Kawahara, H., and Westerink, B. H. (1999). Comparison of effects of hypotension and handling stress on the release of noradrenaline and dopamine in the locus coeruleus and medial prefrontal cortex of the rat. Naunyn Schmiedebergs Arch. Pharmacol. 360, 42–49.
Kensinger, E. A., and Schacter, D. L. (2006). Reward circuitry activation by noxious thermal stimuli. J. Neurosci. 26, 2564–2570.
Killgore, W. D. S., Young, A. D., Femia, L. A., Bogorodzki, P., Rogowska, J., and Yurgelun-Todd, D. A. (2003). Cortical and limbic activation during viewing of high- versus low-calorie foods. Neuroimage 19, 1381–1394.
King, D., Zigmond, M. J., and Finlay, J. M. (1997). Effects of dopamine depletion in the medial prefrontal cortex on the stress-induced increase in extracellular dopamine in the nucleus accumbens core and shell. Neuroscience 77, 141–153.
Koob, G. F., and Bloom, F. E. (1988). Cellular and molecular mechanisms of drug dependence. Science 242, 715–723.
Lammel, S., Hetzel, A., Hckel, O., Jones, I., Liss, B., and Roeper, J. (2008). Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron 57, 760–773.
Lammel, S., Ion, D. I., Roeper, J., and Malenka, R. C. (2011). Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron 70, 855–862.
Lapiz, M. D. S., and Morilak, D. A. (2006). Noradrenergic modulation of cognitive function in rat medial prefrontal cortex as measured by attentional set shifting capability. Neuroscience 32, 1000–1010.
Laviolette, S. R., Gallegos, R. A., Henriksen, S. J., and van der Kooy, D. (2004). Opiate state controls bi-directional reward signaling via GABAA receptors in the ventral tegmental area. Nat. Neurosci. 7, 160–169.
Le Moal, M., and Simon, H. (1991). Mesocorticolimbic dopaminergic network: functional and regulatory role. Physiol. Rev. 71, 155–234.
Lewis, B. L., and O'Donnell, P. (2000). Ventral tegmental area afferents to the prefrontal cortex maintain membrane potential ‘up’ states in pyramidal neurons via d(1) dopamine receptors. Cereb. Cortex 10, 1168–1175.
Liprando, L. A., Miner, L. H., Blakely, R. D., Lewis, D. A., and Sesack, S. R. (2004). Ultrastructural interactions between terminals expressing the norepinephrine transporter and dopamine neurons in the rat and monkey ventral tegmental area. Synapse 52, 233–244.
Lu, L., Shepard, J. D., Scott Hall, F., and Shaham, Y. (2003). Effect of environmental stressors on opiate and psychostimulant reinforcement, reinstatement and discrimination in rats: a review. Neurosci. Biobehav. Rev. 27, 457–491.
Lupinsky, D., Moquin, L., and Gratton, A. (2010). Interhemispheric regulation of the medial prefrontal cortical glutamate stress response in rats. J. Neurosci. 30, 7624–7633.
Mackey, W. B., and van der Kooy, D. (1985). Neuroleptics block the positive reinforcing effects of amphetamine but not morphine as measured by place conditioning. Pharmacol. Biochem. Behav. 22, 101–105.
Mahler, S. V., and Berridge, K. C. (2011). What and when to “want”? Amygdala-based focusing of incentive salience upon sugar and sex. Psychopharmacology (Berl.) 221, 407–426.
Margolis, E. B., Lock, H., Chefer, V. I., Shippenberg, T. S., Hjelmstad, G. O., and Fields, H. L. (2006). Kappa opioids selectively control dopaminergic neurons projecting to the prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 103, 2938–2942.
Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837–841.
McGaugh, J. L. (2005). Emotional arousal and enhanced amygdala activity: new evidence for the old perseveration-consolidation hypothesis. Learn. Mem. 12, 77–79.
McGaugh, J. L. (2006). Make mild moments memorable: add a little arousal. Trends Cogn. Sci. 10, 345–347.
McQuade, R., Creton, D., and Stanford, S. C. (1999). Effect of novel environmental stimuli on rat behavior and central noradrenaline function measured by in vivo microdialysis. Psychopharmacology 145, 393–400.
Mingote, S., de Bruin, J. P. C., and Feesntra, M. G. P. (2004). Noradrenaline and dopamine afflux in the prefrontal cortex in relation to appetitive classical conditioning. J. Neurosci. 24, 2475–2480.
Morilak, D. A., Barrera, G., Echevarria, D. J., Garcia, A. S., Hernandez, A., Ma, S., and Petre, C. O. (2005). Role of brain norepinephrine in the behavioral response to stress. Prog. Neuropsychopharmacol. Biol. Psychiatry 29, 1214–1224.
Moron, J. A., Brockington, A., Wise, R. A., Rocha, B. A., and Hope, B. T. (2002). Dopamine uptake through the norepinephrine transporter in brain regions with low levels of the dopamine transporter: evidence from knock-out mouse lines. J. Neurosci. 22, 389–395.
Mucha, R. F., and Iversen, S. D. (1984). Reinforcing properties of morphine and naloxone revealed by conditioned place preferences: a procedural examination. Psychopharmacology 82, 241–247.
Mueller, D., and Stewart, J. (2000). Cocaine-induced conditioned place preference: reinstatement by priming injections of cocaine after extinction. Behav. Brain. Res. 115, 39–47.
Nader, K., Bechara, A., and van der Kooy, D. (1997). Neurobiological constraints of behavioral models of motivation. Annu. Rev. Psychol. 48, 85–114.
Nader, K., Harrington, F., Bechara, A., and van der Kooy, D. (1994). Neuroleptics block high but not low dose heroin place preferences: further evidence for a two system model of motivation. Behav. Neurosci. 108, 1128–1138.
Naranjo, C. A., Tremblay, L. K., and Busto, U. E. (2001). The role of the brain reward system in depression. Prog. Neuropsychopharmacol. Biol. Psychiatry 25, 781–823.
Nicniocaill, B., and Gratton, A. (2007). Medial prefrontal cortical alpha1 adrenoreceptor modulation of the nucleus accumbens dopamine response to stress in Long-Evans rats. Psychopharmacology (Berl.) 191, 835–842.
Niv, Y., Joel, D., and Dayan, P. (2006). A normative perspective on motivation. Trends Cogn. Sci. 10, 375–381.
O'Doherty, J., Kringerlbach, M. L., Rolls, R. T., Hornak, J., and Andrews, C. (2001). Abstract reward and punishment representations in the human orbitofrontal cortex. Nat. Neurosci. 4, 95–102.
Page, M. E., and Lucki, I. (2002). Effects of acute and chronic reboxetine treatment on stress-induced monoamine efflux in the rat frontal cortex. Neuropsychopharmacology 27, 237–247.
Palmiter, R. D. (2008). Dopamine signaling in the dorsal striatum is essential for motivated behaviors: lessons from dopamine-deficient mice. Ann. N.Y. Acad. Sci. 1129, 35–46.
Panksepp, J. (1998). Affective Neuroscience: The Foundations of Human and Animal Emotions. Oxford, UK: Oxford University Press.
Pascucci, T., Ventura, R., Latagliata, E. C., Cabib, S., and Puglisi-Allegra, S. (2007). The medial prefrontal cortex determines the accumbens dopamine response to stress through the opposing influences of norepinephrine and dopamine. Cereb. Cortex 17, 2796–2804.
Pecina, S., Berridge, K. C., and Parker, L. A. (1997). Pimozide does not shift palatability: separation of anhedonia from sensorimotor suppression by taste reactivity. Pharmacol. Biochem. Behav. 58, 801–811.
Pecina, S., Schulkin, J., and Berridge, K. C. (2006). Nucleus accumbens corticotropin releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress? BMC Biol. 13, 8.
Pettit, H. O., Ettenberg, A., Bloom, F. E., and Koob, G. F. (1984). Destruction of dopamine in the nucleus accumbens selectively attenuates cocaine but not heroin self-administration in rats. Psychopharmacology 84, 167–173.
Phillips, A. G., Ahn, S., and Howland, J. G. (2003a). Amygdalar control of the mesocorticolimbic dopamine system: parallel pathways to motivated behavior. Neurosci. Biobehav. Rev. 27, 543–554.
Phillips, M. L., Drevets, W. C., Rauch, S. L., and Lane, R. (2003b). Neurobiology of emotion perception I: the neural basis of normal emotion perception. Biol. Psychiatry 54, 504–514.
Phillips, P. E. M., Walton, M. E., and Jhou, T. C. (2007). Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology 191, 483–495.
Piazza, P. V., and Le Moal, M. (1997). Glucocorticoids as a biological substrate of reward: physiological and pathophysiological implications. Brain Res. Rev. 25, 359–372.
Pierce, R. C., and Kumaresan, V. (2006). The mesolimbic dopamine system: the final common pathway for the reinforcing effect of drugs of abuse? Neurosci. Biobehav. Rev. 30, 215–238.
Ramos, B. P., and Arnsten, A. F. (2007). Adrenergic pharmacology and cognition: focus on the prefrontal cortex. Pharmacol. Ther. 113, 523–536.
Rassnick, S., Stinus, L., and Koob, G. F. (1993). The effects of 6-hydroxydopamine lesions of the nucleus accumbens and the mesolimbic dopamine system on oral self-administration of ethanol in the rat. Brain Res. 623, 16–24.
Richard, J. M., and Berridge, K. C. (2011). Nucleus accumbens dopamine/glutamate interaction switches modes to generate desire versus dread: D(1) alone for appetitive eating but D(1) and D(2) together for fear. J. Neurosci. 31, 12866–12879.
Robbins, T. W. (2000). Chemical neuromodulation of frontal-executive functions in humans and other animals. Exp. Brain Res. 133, 130–138.
Robinson, T. E., and Berridge, K. C. (1993). The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain. Res. Rev. 18, 247–291.
Robbins, T. W., and Arnsten, A. F. (2009). The neuropsychopharmacology of fronto-executive function: monoaminergic modulation. Annu. Rev. Neurosci. 32, 267–287.
Roozendaal, B. (2000). Glucocorticoids and the regulation of memory consolidation. Psycho neuroendocrinology 25, 213–238.
Roozendaal, B., McReynolds, J. R., and McGaugh, J. L. (2004). The basolateral amygdala interacts with the medial prefrontal cortex in regulating glucocorticoid effects on working memory impairment. J. Neurosci. 24, 1385–1392.
Rossetti, Z. L., and Carboni, S. (2005). Noradrenaline and dopamine elevations in the rat prefrontal cortex in spatial working memory. J. Neurosci. 25, 2322–2329.
Salamone, J. D., Correa, M., Farrar, A., and Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191, 461–482.
Salamone, J. D., Correa, M., Mingote, S. M., and Weber, S. M. (2005). Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine. Curr. Opin. Pharmacol. 5, 34–41.
Salzman, D. C., and Fusi, S. (2010). Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annu. Rev. Neurosci. 33, 173–202.
Sara, S. J., and Segal, M. (1991). Plasticity of sensory responses of locus coeruleus neurons in the behaving rat: implications for cognition. Prog. Brain. Res. 88, 571–585.
Sesack, S. R., and Pickel, V. M. (1990). Prefrontal cortical efferents in the rat synapse on unlabeled neuronal targets of catecholamine terminals in the nucleus accumbens septi and on dopamine neurons in the ventral tegmental area. Brain Res. 506, 166–168.
Sesack, S. R., and Pickel, V. M. (1992). Prefrontal cortical efferents in the rat synapse on unlabeled neuronal targets of catecholamine terminals in the nucleus accumbens septi and on dopamine neurons in the ventral tegmental area. J. Comp. Neurol. 320, 145–160.
Setlow, B., Roozendaal, B., and McGaugh, J. L. (2000). Involvement of a basolateral amygdala complex-nucleus accumbens pathway in glucocorticoid-induced modulation of memory consolidation. Eur. J. Neurosci. 12, 367–375.
Shaham, Y., Shalev, U., Lu, L., de Wit, H., and Stewart, J. (2003). The reinstatement model of drug relapse: history, methodology and major findings. Psychopharmacology 168, 3–20.
Shi, W. X., Pun, C. L., Zhang, X. X., Jones, M. D., and Bunney, B. S. (2000). Dual effects of D-amphetamine on dopamine neurons mediated by dopamine and nondopamine receptors. J. Neurosci. 20, 3504–3511.
Shippenberg, T. S., and Herz, A. (1988). Motivational effects of opioids: influence of D1 versus D2 receptor antagonists. Eur. J. Pharmacol. 151, 233–242.
Small, D. M., Zatorre, R. J., Dagher, A., Evans, A. C., and Jones-Gotman, M. (2001). Changes in brain activity related to eating: from pleasure to aversion. Brain 124, 1720–1733.
Spyraki, C., Fibiger, H. C., and Phillips, A. G. (1982). Cocaine-induced place preference conditioning: lack of effects of neuroleptics and 6-hydroxydopamine lesions. Brain Res. 253, 195–203.
Sturgess, J. E., Ting-A-Kee, R. A., Podbielski, D., Sellings, L. H., Chen, J. F., and van der Kooy, D. (2010). Adenosine A1 and A2A receptors are not upstream of caffeine's dopamine D2 receptor-dependent aversive effects and dopamine-independent rewarding effects. Eur. J. Neurosci. 32, 143–154.
Taber, M. T., and Fibiger, H. C. (1995). Electrical stimulation of the prefrontal cortex increases dopamine release in the nucleus accumbens of the rat: modulation by metabotropic glutamate receptors. J. Neurosci. 15, 3896–3904.
Tanda, G., Pontieri, F. E., Frau, R., and Di Chiara, G. (1997). Contribution of blockade of the noradrenaline carrier to the increase of extracellular dopamine in the rat prefrontal cortex by amphetamine and cocaine. Eur. J. Neurosci. 9, 2077–2085.
Tassin, J. P. (1998). Norepinephrine-dopamine interactions in the prefrontal cortex and the ventral tegmental area: relevance to mental diseases. Adv. Pharmacol. 42, 712–716.
Tierney, P. L., Thierry, A. M., Glowinski, J., Deniau, J. M., and Gioanni, Y. (2008). Dopamine modulates temporal dynamics of feedforward inhibition in rat prefrontal cortex in vivo. Cereb. Cortex 18, 2251–2262.
Ting-A-Kee, R., Dockstader, C., Heinmiller, A., Grieder, T., and van der Kooy, D. (2009). GABA(A) receptors mediate the opposing roles of dopamine and the tegmental pedunculopontine nucleus in the motivational effects of ethanol. Eur. J. Neurosci. 29, 1235–1244.
Toates, F. M. (1994). “Comparing motivational systems—an incentive motivation perspective,” in Appetite: Neural and Behavioural Bases, eds C. R. Legg and D. A. Booth (New York, NY: Oxford University Press), 305–327.
Tronel, S., Feenstra, M. G., and Sara, S. J. (2004). Noradrenergic action in prefrontal cortex in the late stage of memory consolidation. Learn. Mem. 11, 453–458.
Tsai, H. C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., and Deisseroth, K. (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324, 1080–1083.
Tzschentke, T. M. (1998). Measuring reward with the conditioned place preference paradigm: a comprehensive review of drug effects, recent progress and new issues. Prog. Neurobiol. 56, 613–672.
Ungless, M. A., Magill, P. J., and Bolam, J. P. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303, 2040–2042.
Valentino, R., and van Bockstaele, E. (2001). Opposing regulation of the locus coeruleus by corticotropin-releasing factor and opioids. potential for reciprocal interactions between stress and opioid sensitivity. Psychopharmacology 158, 331–342.
Van Bockstaele, E., Bajic, D., Proudfit, H., and Valentino, R. (2001). Topographic architecture of stress-related pathways targeting the noradrenergic locus coeruleus. Physiol. Behav. 73, 273–283.
van der Kooy, D. (1987). “Place conditioning: a simple and effective method for assessing the motivational properties of drugs,” in Methods of Assessing the Reinforcing Properties of Drugs of Abuse, ed M. A. Bozarth (New York, NY: Springer-Verlag), 229–240.
van der Meulen, J. A., Joosten, R. N., de Bruin, J. P., and Feenstra, M. G. (2007). Dopamine and noradrenaline efflux in the medial prefrontal cortex during serial reversals and extinction of instrumental goal-directed behavior. Cereb. Cortex 17, 1444–1453.
Vargas-Perez, H., Ting-A-Kee, R., Walton, C. H., Hansen, D. M., Razavi, R., Clarke, L., Bufalino, M. R., Allison, D. W., Steffensen, S. C., and van der Kooy, D. (2009). Ventral Tegmental Area BDNF induces an opiate-dependent-like renard state in naive rats. Science 324, 1732–1734.
Ventura, R., Alcaro, A., Cabib, S., Conversi, D., Mandolesi, L., and Puglisi-Allegra, S. (2004). Dopamine in the medial prefrontal cortex controls genotype-dependent effects of amphetamine on mesoaccumbens dopamine release and locomotion. Neuropsychopharmacology 29, 72–80.
Ventura, R., Alcaro, A., and Puglisi-Allegra, S. (2005). Prefrontal cortical norepinephrine release is critical for morphine-induced reward, reinstatement and dopamine release in the nucleus accumbens. Cereb. Cortex 15, 1877–1886.
Ventura, R., Cabib, S., Alcaro, A., Orsini, C., and Puglisi-Allegra, S. (2003). Norepinephrine in the prefrontal cortex is critical for amphetamine-induced reward and mesoaccumbens dopamine release. J. Neurosci. 23, 1879–1885.
Ventura, R., Cabib, S., and Puglisi-Allegra, S. (2001). Opposite genotype-dependent mesocorticolimbic dopamine response to stress. Neuroscience 104, 627–633.
Ventura, R., Cabib, S., and Puglisi-Allegra, S. (2002). Genetic susceptibility of mesocortical dopamine to stress determines liability to inhibition of mesoaccumbens dopamine and to behavioral ‘despair’ in a mouse model of depression. Neuroscience 115, 999–1007.
Ventura, R., de Carolis, D., Alcaro, A., and Puglisi-Allegra, S. (2006). Ethanol consumption and reward depend on norepinephrine in the prefrontal cortex. Neuroreport 17, 1813–1817.
Ventura, R., Latagliata, E. C., Morrone, C., La Mela, I., and Puglisi-Allegra, S. (2008). Prefrontal norepinephrine determines attribution of “high” motivational salience. PLoS ONE. 3:3044. doi: 10.1371/journal.pone.0003044
Ventura, R., Morrone, C., and Puglisi-Allegra, S. (2007). Prefrontal/accumbal catecholamine system determines motivational salience attribution to both reward- and aversion-related stimuli. Proc. Natl. Acad. Sci. U.S.A. 104, 5181–5186.
Wang, D. V., and Tsien, J. Z. (2011). Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations. PLoS ONE 6:e17047. doi: 10.1371/journal.pone.0017047
Wang, G.-J., Volkow, N. D., Thanos, P. K., and Fowler, J. S. (2004). Similarity between obesity and drug addiction as assessed by neurofunctional imaging: a concept review. J. Addict. Dis. 23, 9–53.
Womer, D. E., Jones, B. C., and Erwin, V. G. (1994). Characterization of dopamine transporter and locomotor effects of cocaine, GBR 12909, epidepride, and SCH 23390 in C57BL and DBA mice. Pharmacol. Biochem. Behav. 48, 327–335.
Zink, C. F., Pagnoni, G., Chappelow, J., Martin-Skurski, M., and Berns, G. S. (2006). Human striatal activation reflects degree of stimulus saliency. Neuroimage 29, 977–983.
Zink, C. F., Pagnoni, G., Martin, M. E., Dhamala, M., and Berns, G. S. (2003). Human striatal sesponse to salient nonrewarding stimuli. J. Neurosci. 23, 8092–8097.
Zocchi, A., Orsini, C., Cabib, S., and Puglisi-Allegra, S. (1998). Parallel strain-dependent effect of amphetamine on locomotor activity and dopamine release in the nucleus accumbens: an in vivo study in mice. Neuroscience 82, 521–528.
Keywords: motivation, emotion, salience, norepinephrine, dopamine, prefrontal cortex, mesoaccumbens
Citation: Puglisi-Allegra S and Ventura R (2012) Prefrontal/accumbal catecholamine system processes high motivational salience. Front. Behav. Neurosci. 6:31. doi: 10.3389/fnbeh.2012.00031
Received: 29 February 2012; Paper pending published: 19 March 2012;
Accepted: 02 June 2012; Published online: 27 June 2012.
Edited by:
Antonella Gasbarri, University of L'Aquila, ItalyReviewed by:
Michel Le Moal, Institute Universitaire de France, FranceMatthijs Feenstra, Netherlands Institute for Neuroscience, Netherlands
Copyright: © 2012 Puglisi-Allegra and Ventura. This is an open-access article distributed under the terms of the Creative Commons Attribution Non Commercial License, which permits non-commercial use, distribution, and reproduction in other forums, provided the original authors and source are credited.
*Correspondence: Stefano Puglisi-Allegra, Dipartimento di Psicologia, Sapienza Università di Roma, Centro Daniel Bovet, via dei Marsi 78, Rome 00185, Italy. e-mail: stefano.puglisi-allegra@uniroma1.it