Anushka B. P. Fernando
Jennifer E. Murray
Amy L. Milton- Department of Psychology, Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, UK
The amygdala has traditionally been associated with fear, mediating the impact of negative emotions on memory. However, this view does not fully encapsulate the function of the amygdala, nor the impact that processing in this structure has on the motivational limbic corticostriatal circuitry of which it is an important structure. Here we discuss the interactions between different amygdala nuclei with cortical and striatal regions involved in motivation; interconnections and parallel circuitries that have become increasingly understood in recent years. We review the evidence that the amygdala stores memories that allow initially motivationally neutral stimuli to become associated through pavlovian conditioning with motivationally relevant outcomes which, importantly, can be either appetitive (e.g. food) or aversive (e.g. electric shock). We also consider how different psychological processes supported by the amygdala such as conditioned reinforcement and punishment, conditioned motivation and suppression, and conditioned approach and avoidance behavior, are not only psychologically but also neurobiologically dissociable, being mediated by distinct yet overlapping neural circuits within the limbic corticostriatal circuitry. Clearly the role of the amygdala goes beyond encoding aversive stimuli to also encode the appetitive, requiring an appreciation of the amygdala's mediation of both appetitive and fearful behavior through diverse psychological processes.
Introduction
The amygdala, an important structure within the limbic forebrain, interacts with both the cortex and the striatum to influence motivated behavior. The amygdala itself has long been associated with emotional processing, particularly the emotion of fear. Monkeys with amygdala damage are typically tame and apparently fearless (Klüver and Bucy, 1939); rats with amygdala lesions do not show fear behavior such as pavlovian conditioned freezing or fear-potentiated startle (see Table 1 for definitions of specialized terms, indicated in italicised text) (Ledoux et al., 1990; Kim et al., 1993; Campeau and Davis, 1995; Maren et al., 1996) and humans with calcification of the amygdala seen in Urbach-Wiethe disease also show deficits in remembering emotionally arousing material (Siebert et al., 2003). However, it has been appreciated since the time of Weiskrantz (1956) that the amygdala is not limited to representing fearful stimuli, but it is also required for the performance of appetitive tasks in which individuals work for rewards such as sex or drugs of abuse (Cador et al., 1989; Everitt et al., 1989; Burns et al., 1993).
Table 1. Definitions of specialized psychological and behavioral terms.
A compelling hypothesis (Ono et al., 1995; Robbins and Everitt, 2002; Balleine and Killcross, 2006) is that the amygdala functions as a memory storage device, encoding the association of initially motivationally neutral environmental stimuli (“cues”) with motivationally relevant outcomes in a pavlovian manner. Therefore, the amygdala can be thought of as associating these pavlovian cues—“conditioned stimuli” (CSs)—with motivationally relevant “unconditioned stimuli” (USs) such as food, sex, or danger. The amygdala is considered a good candidate neural structure for storing these pavlovian memories, as it receives highly processed sensory information (that constitutes a CS) from the sensory cortices, and this converges on the amygdala with other “raw” sensory inputs, such as visceral or gustatory afferents that can represent the outcome or the US (Li et al., 1996; McDonald et al., 1999). This convergence of CS and US information occurs at the level of individual neurons: though neurons within the amygdala are responsive to both unimodal and multimodal stimuli without any prior experience (Bordi and Ledoux, 1994), the number of stimulus-responsive neurons in the amygdala increases following pavlovian training (Uwano et al., 1995), suggesting that synaptic plasticity is occurring at the neuronal level in the amygdala following associative learning. Importantly, electrophysiological studies show that the amygdala responds to CSs that have been associated with either appetitive or aversive outcomes (Paton et al., 2006; Tye and Janak, 2007), supporting the view that the amygdala stores both appetitive and aversive pavlovian “CS-US” memories.
In a complex, naturalistic environment, animals can enhance their chances of obtaining pleasure (i.e. motivationally relevant rewards like food and sex) and avoiding pain and danger by using pavlovian environmental cues to guide behavior. For example, for a rat, associating the smell of cat urine with a fearful motivational state may give the rat an evolutionary selective advantage, namely that it is more likely to avoid environments in which cat urine is present, and so reduce the risk of predation. Representing the emotional and affective value of pavlovian CSs is therefore important from an evolutionary perspective; however, the amygdala does not act alone in this function, but rather interacts with a larger corticostriatal motivational circuit (Cador et al., 1989). The connections between the amygdala and the ventral striatum provide a major route by which the amygdala can affect motivated behavior. The ventral striatum has been hypothesized to represent potential actions within the behavioral repertoire (Liljeholm and O'Doherty, 2012), from which actions can be selected for specific motivated behaviors (for example, food-seeking or mate-seeking behaviors). The amygdala allows pavlovian CSs to influence the selection of actions within the behavioral repertoire; so, for instance, in the presence of a receptive female, a male rat is more likely to engage in courtship behavior than food-seeking. However, the amygdala is not a unitary structure, but is divided into several subnuclei, with major divisions including the central (CeN), basal and lateral (considered here together as the basolateral amygdala, or BLA) and the corticomedial nuclei. These subnuclei are hypothesized to have different functions in representing pavlovian CSs. For the purposes of the current discussion, the most relevant divisions are the CeN and the BLA.
The BLA and CeN are heavily interconnected, forming a circuit through which sensory information about pavlovian CSs can be integrated to produce coordinated emotional responses, including neuroendocrine, autonomic and behavioral responses. However, until relatively recently there has been disagreement regarding the connections between the BLA and CeN; the views essentially being divided between “serial processing” models, in which the BLA controlled the responses of the CeN, which itself formed the “output nucleus” of the amygdala (Ledoux, 2000; Maren, 2001) and “parallel processing” models, in which the BLA and CeN both receive sensory inputs, and can influence different aspects of motivated behavior in parallel (Cardinal et al., 2002a; Everitt et al., 2003; Balleine and Killcross, 2006; Wilensky et al., 2006). The “parallel processing” model has become increasingly accepted in recent years, being supported by behavioral, neuroanatomical and electrophysiological evidence. Thus, we begin by considering the requirement for the BLA and CeN in behavior measured with different psychological tasks that help to dissociate the functions of these nuclei, for appetitive and aversive tasks, and those tasks that depend upon interactions between the appetitive and aversive motivational systems. We then review how the neuroanatomical connections of the CeN and BLA, and the response properties of amygdala neurons, support the parallel model, for both appetitive and aversive CSs.
The Amygdala Stores both Appetitive and Aversive Pavlovian Memories
According to the parallel processing model of amygdala function (Cardinal et al., 2002a; Everitt et al., 2003; Balleine and Killcross, 2006; Wilensky et al., 2006), the BLA and CeN both store pavlovian CS-US memories, but the two nuclei encode different types of information about the CS, and consequently influence behavior in different ways. The BLA, which receives highly processed information from the sensory cortices, is hypothesized to represent the specific affective value of a CS and to influence goal-directed instrumental behavior; supporting a function similar to other areas of cortex. By contrast, the CeN is hypothesized to represent more generalized associations based upon the motivational valence of the reinforcer (Swanson and Petrovich, 1998; Cardinal et al., 2002a) and to influence stimulus-response behavior, similar to regions of the dorsal striatum. Though a pavlovian CS is capable of supporting both CS-specific associations and general associations, these processes can be separated using specific behavioral procedures developed by learning theorists (see Cardinal et al., 2002a; Milton and Everitt, 2010, for review) and these will be discussed in more detail below. As an illustrative example, however, consider work by Corbit and Balleine (2005) investigating conditioned motivation. In this study, rats were trained on an instrumental task to press two different levers for different food outcomes (pellets and sucrose). Subsequently, the same animals were then trained separately on a pavlovian task to associate different auditory stimuli with the pellets and sucrose. The animals were tested for “pavlovian-instrumental transfer” (PIT) by allowing them to press the two levers while the auditory stimuli were presented. In non-lesioned control animals, presentation of the auditory CS associated with sucrose led to a marked increase in pressing the lever associated with sucrose (known as “specific PIT”) and a smaller increase in pressing of the lever associated with pellets (known as “general PIT”). Similar effects were observed with the pellet-associated CS; an increase in responding on both levers, with a greater enhancement in responding on the pellet-associated lever. In amygdala-lesioned animals, behavior was markedly and differentially affected by the subdivision of the amygdala that was lesioned. While animals that received BLA lesions still showed an enhancement in lever pressing in the presence of the auditory stimuli, they did not show the specific enhancement shown by controls (e.g. an increase in pressing the sucrose-associated lever in the presence of the sucrose-CS). Animals with CeN lesions, by contrast, continued to show specific enhancement, but did not show the general increase in lever pressing shown by controls. Thus, by using carefully designed behavioral procedures, it is possible to dissociate the functions of the BLA and CeN.
A number of different psychological processes have been identified by which a pavlovian CS can influence instrumental behavior. In the past, there has been a tendency to separate these processes based upon whether the association is between a CS and an appetitive or aversive reinforcer. When appetitive reinforcers are used, these processes are termed pavlovian conditioned approach (approach toward a pavlovian CS; measured through a procedure known as “autoshaping”), conditioned motivation (the enhancement of instrumental responding by the presentation of a pavlovian CS; measured through PIT as described above) and conditioned reinforcement (the phenomenon by which a pavlovian CS acquires reinforcing properties in its own right; measured using, for example, a procedure known as the acquisition of a new instrumental response for conditioned reinforcement). Other procedures that measure conditioned suppression (a reduction in instrumental responding in the presence of a pavlovian CS previously associated with an aversive outcome) and avoidance (e.g. of a pavlovian CS associated with an aversive outcome), have been developed with aversive stimuli. We suggest that these appetitive and aversive processes are recruiting the same neural circuitry, and it may therefore be more parsimonious to group together appetitively and aversively motivated behavior based on common psychological processes. We suggest that PIT and conditioned suppression are measuring the capacity of a pavlovian CS to enhance (if it is appetitive) or reduce (if it is aversive) previously trained instrumental behavior, and therefore these psychological processes could be grouped together under the term “conditioned motivation.” Conditioned approach and avoidance essentially describe directional behavior to the pavlovian CS (toward or away) and thus we suggest that these terms might be united under the term “conditioned direction.” Finally, pavlovian CSs can become reinforcing in their own right through association with the motivationally relevant US, whether the US is appetitive (so the CS is a “conditioned reinforcer”) or aversive (so the CS is a “conditioned punisher”). Again, we suggest that these are essentially the same psychological process, which could be considered as “conditioned reinforcement” (encompassing both appetitive conditioned reinforcement, and aversive conditioned reinforcement, respectively). These processes differentially depend upon CS-specific and general associations and, therefore, differentially upon the BLA and CeN.
The BLA is Required for Sensory-Specific Associations
The BLA is required for appetitive and aversive conditioned reinforcement
An appetitive conditioned reinforcer is defined as a pavlovian CS, initially of motivationally neutral valence, which acquires reinforcing properties through its association with the US (Mackintosh, 1974). The often-cited human example of an appetitive conditioned reinforcer is money, which has no primary reinforcing value, but because of its previous association with motivationally relevant outcomes (e.g. food) it acquires conditioned affective and reinforcing properties. Money, like all appetitive conditioned reinforcers, will support delays to primary reinforcement (i.e. individuals will work for money over an extended time period in order to save for a particularly expensive purchase) and it will support the acquisition of new instrumental behaviors (i.e. if offered a sufficiently large monetary reward, most individuals would be motivated to acquire a new skill). Appetitive conditioned reinforcement is extremely persistent, and strongly resistant to extinction (Di Ciano and Everitt, 2004); individuals will continue responding for an appetitive conditioned reinforcer long after it was last predictive of the US, and individuals will also continue responding even when the US has itself been devalued (Parkinson et al., 2005).
Appetitive conditioned reinforcement depends upon the BLA, as has been shown in several behavioral tasks that allow conditioned reinforcement to be measured in isolation. The appetitive conditioned reinforcing properties of CSs, associated with appetitive reinforcers, can be assessed using procedures such as second-order schedules (see Everitt and Robbins, 2000, for review), in which long delays to primary reinforcement are supported by the presentation of conditioned reinforcers; learning of this task depends upon the BLA (Burns et al., 1999). Appetitive conditioned reinforcement can also be measured using “the acquisition of a new instrumental response with conditioned reinforcement” procedure (“ANR”; Hyde, 1976), in which individuals are trained first to make an instrumental response for the primary reinforcer and the pavlovian CS, and in a second phase of training are tested on their ability to acquire a novel instrumental response for presentations of the CS alone. Pre-training excitotoxic lesions of the BLA impair the acquisition of responding under second-order schedules for CSs associated with different primary reinforcers, including sex (Cador et al., 1989; Everitt et al., 1989), cocaine (Whitelaw et al., 1996; Arroyo et al., 1998; Goddard and Leri, 2006), and food (Hatfield et al., 1996), and likewise ANR is also impaired by excitotoxic lesions of the BLA in rats (Burns et al., 1993) and monkeys (Parkinson et al., 2001). Reversible lesions, induced by inactivation of the BLA with the glutamate (AMPA) receptor antagonist CNQX, also prevents discriminated responding for a previously amphetamine-associated CS during a test of conditioned reinforcement (Hitchcott and Phillips, 1997). This deficit is also observed with mice lacking AMPA receptors within the BLA (gria1 knockouts), which are impaired on tests of conditioned reinforcement (Mead and Stephens, 2003b). Specifically, BLA lesions appear to prevent the CS from influencing the selection of the appropriate instrumental actions, such that animals without a functioning BLA are unable to use the CS to guide their instrumental action selection, whether that is an increase in lever pressing for a stimulus associated with reward in second-order schedules or ANR, or avoidance of an instrumental response that produces an aversive outcome.
The aversive conditioned reinforcing properties of CSs can be assessed using procedures such as “conditioned punishment” (Killcross et al., 1997a,b), in which an instrumental response is associated with the probabilistic presentation of an aversive event such as an electric footshock paired with a CS. As for appetitive conditioned reinforcement, animals with BLA lesions are also impaired on aversive conditioned reinforcement (Killcross et al., 1997b); BLA-lesioned animals do not bias responding away from a lever associated with electric footshock and an aversive CS, though they still show reduced overall responding on the lever and on a control lever not paired with shock, i.e. intact conditioned suppression (Killcross et al., 1997b; Purgert et al., 2012).
It is worth noting that recent work has begun to dissociate conditioned reinforcement into general and specific forms (see Burke et al., 2007, for details) with both forms being impaired by amygdala lesions. However, though amygdala lesions impaired performance on tasks measuring conditioned reinforcement (Burke et al., 2007), the lesions affected both the CeN and BLA, so on the basis of the evidence currently available it is not possible to attribute general and specific associations to specific amygdala subdivisions in the same manner as for other psychological processes (see below). Overall, the majority of evidence suggests that conditioned reinforcement depends on the BLA.
The BLA is required for specific forms of conditioned motivation
Studies of conditioned motivation are assessed using PIT procedures. There are two versions of PIT tasks—one that does not distinguish between the specific and general forms of conditioned motivation, and one that does. In the simplest form of the task, animals are trained separately on a pavlovian training phase, to associate a CS+ (e.g. a tone) with a reinforcer (e.g. sucrose) and an alternative CS− (e.g. a clicker) with no reinforcement, and on instrumental training, where a response (e.g. lever pressing) produces the sucrose reinforcer. The animals are subsequently tested by allowing them to make the instrumental response (in the absence of the primary sucrose reinforcer) in the presence of the pavlovian CSs for the first time. The alternative version of the task is similar, but allows for the sensory-specific and generalized properties of CSs to be dissociated behaviorally (e.g. as described above for the study by Corbit and Balleine, 2005). The procedure for distinguishing between the sensory-specific and generalized properties of pavlovian CSs relies on associating responses and CSs with specific outcomes: for example, in the first stage of training, one response (e.g. lever pressing) may be associated with a specific outcome (e.g. sucrose) while another response (e.g. chain pulling) is associated with another outcome (e.g. sugar pellets); and in the second stage of training, a CS (e.g. a light) is associated with one outcome (sucrose) while a different CS (e.g. a tone) is associated with the other outcome (pellets). This leads to the formation of two instrumental associations (“lever pressing-sucrose” and “chain pulling-sugar pellets”) and two pavlovian associations (“light-sucrose” and “tone-pellets”). During testing, the animal is allowed to make the instrumental responses in the presence of the pavlovian CSs for the first time, in the absence of the primary reinforcer. Presentation of the CSs typically leads to an enhancement of instrumental responding, which is designated as “pavlovian-instrumental transfer” (PIT), or appetitive conditioned motivation. The presentation of the CSs can produce both “general” and “specific” effects on instrumental responding; the enhancement in instrumental responding produced by the CS associated with the same reinforcer (e.g. the effect of the light on lever pressing, or the tone on chain pulling) is termed “specific” conditioned motivation, and the enhancement in instrumental responding produced by the other CS (e.g. the effect of the light on chain pulling, or the tone on lever pressing) is termed “general” conditioned motivation. It is thought that specific conditioned motivation occurs because the presentation of the CS activates the stored CS-US memory, which in turn activates the response-reinforcer association; general conditioned motivation, by contrast, is thought to reflect a general excitation and facilitatory effect on behavior produced by an appetitive CS.
The BLA is required for specific conditioned motivation. Lesions of the BLA impair the performance of specific PIT (e.g. would impair the capacity of the light to potentiate lever pressing, or the tone to potentiate chain pulling in the example above) without affecting the generalized excitatory properties (e.g. the capacity of the light to potentiate chain pulling, or the tone to potentiate lever pressing) of the reinforcers in rats (Blundell et al., 2001; Corbit and Balleine, 2005) and the BLA is activated when human subjects are performing an outcome-specific PIT task (Prévost et al., 2012). By contrast, the BLA is not required for appetitive PIT (Hall et al., 2001; Holland and Gallagher, 2003) in versions of the task where a CS+ is reinforced and a CS− is not reinforced; in this type of task, the potentiation of instrumental behavior can be supported by the general, non-CS-specific association, which is thought to depend upon the CeN rather than the BLA (see below).
The BLA is required for discriminative conditioned direction
Conditioned direction, particularly appetitive conditioned approach, can also be separated into CS-specific and general forms. Conditioned approach is produced by associating a pavlovian CS, usually with a distinct location for procedures that measure sign-tracking (i.e. a light, rather than an auditory stimulus like a tone, which is more difficult for animals to localize) with a reinforcer. Over time, presentation of the CS elicits either an approach response directed toward the CS—sometimes designated “sign-tracking”—or toward the location in which the reinforcer is delivered—“goal-tracking.” There are individual differences in the propensity to develop sign-tracking and goal-tracking responses, which appear to be correlated with dopaminergic signaling within the limbic corticostriatal circuitry (Flagel et al., 2007). As for PIT, conditioned approach procedures can be adapted to measure specific or general approach. In the general form of the procedure, animals are trained that a CS+ is predictive of reinforcer delivery, while a CS− is not. In the specific form of the procedure, one CS (e.g. a solid light, in one location) is paired with delivery of a specific reinforcer (e.g. sucrose) while another CS (e.g. a flashing light, in a different location) is paired with an alternative reinforcer (e.g. pellets). For both types of procedure, animals are tested on their propensity to approach either the CSs or the location of reinforcer delivery in the absence of primary reinforcement.
Although lesions of the BLA have been shown to leave conditioned approach intact in a number of studies (Hatfield et al., 1996; Parkinson et al., 2000; Cardinal et al., 2002b), these studies all measured generalized approach; therefore, the lack of effect of BLA lesions on this form of conditioned approach is consistent with the hypothesis that the BLA is not required for generalized CS-US associations. The BLA does, however, appear to be necessary for pavlovian conditioned approach toward a specific CS (Ostlund and Balleine, 2008). Animals with BLA lesions show at test indiscriminate approach toward CSs that are predictive of reinforcement, including those for which the reinforcement contingency has been degraded (Ostlund and Balleine, 2008) and BLA lesions also reduce the final rates of responding in conditioned approach procedures (Chang et al., 2012b). One possible explanation for these effects suggests that there is a differential dependence on amygdala subnuclei at different stages of acquisition of conditioned approach. Using the general form of conditioned approach as an example, early in acquisition, animals typically approach both the reinforced CS+ and non-reinforced (control) CS− indiscriminately, before reducing approach to the CS− in the later stages of training. Thus, the early stage of approach training may depend upon the general affective properties of the CSs, while the later stages of training, when animals begin to discriminate between the CS+ and CS−, may be more dependent upon the sensory-specific properties of the CS+ (Chang et al., 2012b). Consistent with this, animals with BLA lesions would be predicted to acquire an indiscriminate approach response, but to be insensitive to devaluation, changes in temporal contiguity, or reinforcement contingency, which is consistent with experimental observations (Ostlund and Balleine, 2008).
Thus, a major function of the BLA can be considered as allowing a specific CS-US association to influence instrumental behavior (Cardinal et al., 2002a). This view accounts for the data reviewed above, and also for the finding that the acquisition of active avoidance responses in which an instrumental response is made in order to avoid a negative outcome (i.e. negative reinforcement) depends upon the BLA (Choi et al., 2010; Lázaro-Muñoz et al., 2010).
The CeN is Required for More Generalized CS Effects on Responding, Including General Conditioned Motivation and Conditioned Direction
In contrast to the BLA, the CeN is hypothesized to reflect more generalized, “excitatory” effects of pavlovian CSs on instrumental responding, and it may also support some simple stimulus-response learning (Cardinal et al., 2002a). It may also encode the “salience” of CSs, determining the amount of attention given to them: CeN lesions reduce orienting responses to a pavlovian CS paired with food, suggesting a reduction in attention to reinforcing stimuli (Gallagher et al., 1990); inactivation of the CeN releases exploratory behavior in the elevated plus maze, which is indicative of reduced attention to the anxiogenic effects of being in the open arms (Moreira et al., 2007); and lesions produce deficits in performance on a 3-choice serial reaction time task consistent with impairments in attentional processing (Holland et al., 2000).
Many studies of amygdala representations of pavlovian CSs have focused on demonstrating a double dissociation in the effects of lesions of the BLA and CeN. Lesions of the CeN neither impair appetitive conditioned reinforcement (Hatfield et al., 1996; Robledo et al., 1996) nor aversive conditioned reinforcement (Killcross et al., 1997b). However, the standard methodology for assessing conditioned reinforcement in isolation (e.g. using ANR) depends upon the sensory-specific properties of the pavlovian CS; therefore, if the hypothesized dissociation between the BLA (specific) and CeN (general) responses is correct then it would not be expected that CeN lesions would produce deficits on these tasks. Whether CeN lesions produce deficits on the versions of the task that allow general and specific conditioned reinforcement to be dissociated (Burke et al., 2007) remains to be investigated.
The CeN is required for general conditioned motivation
As described above, tasks assessing conditioned motivation readily allow for the separation of behavior supported by general and sensory-specific properties of the pavlovian CS. “General PIT,” in which presentations of a CS enhance responding for an affectively consistent, though different, outcome, is impaired by lesions of the CeN (Corbit and Balleine, 2005), as is PIT in which only a single response type is measured, which is likely supported by the general excitatory properties of the CS (Hall et al., 2001; Holland and Gallagher, 2003).
Conditioned suppression procedures measure aversive conditioned motivation with a similar experimental logic to PIT tasks. In conditioned suppression tasks, a CS+ is generally associated with an aversive reinforcer (e.g. an electric footshock) and the capacity of this CS to suppress instrumental responding (e.g. licking at a drinking spout for thirsty rats, or lever pressing for a sucrose reinforcer) is measured during the testing phase. Thus, in the same manner that an appetitive pavlovian CS can potentiate instrumental responding, an aversive pavlovian CS reduces instrumental responding at test. However, tests of conditioned suppression tend to use only a single aversive reinforcer (e.g. footshock) associated with a CS+, rather than having two aversive outcomes associated with different CSs; in this sense, conditioned suppression tasks are most comparable to tests of general PIT. As may be expected from the previous discussion, lesions of the CeN, but not the BLA, impair the capacity of an aversive CS to suppress instrumental responding (Killcross et al., 1997b).
The CeN is required for conditioned direction
Lesions of the CeN impair appetitive conditioned approach or “autoshaping” (Parkinson et al., 2000; Cardinal et al., 2002b; though see Chang et al., 2012a) by preventing animals from acquiring an approach response, namely by preventing animals from learning to approach either CS, while BLA lesions impair discriminative approach as described above. Furthermore, reduced excitatory glutamatergic transmission in the CeN also impairs conditioned approach, as assessed in gria2 knockout mice, which express fewer GluR2-containing AMPA receptors in the CeN (Mead and Stephens, 2003a).
The CeN is also required for aversive conditioned direction (avoidance), which can be assessed using a Sidman active avoidance procedure. In this task, rats are trained to shuttle between two chambers to avoid footshock, leading to competition between the avoidance response (shuttling) and conditioned freezing. In a subpopulation of rats that spent much of the time at test freezing, lesions of the CeN rescued these “poor avoiders” and allowed them to shuttle between chambers to avoid the footshock, suggesting that they had learned the instrumental avoidance contingency, but were unable to express the avoidance response due to competition between engaging in freezing behavior and shuttling (Choi et al., 2010; Lázaro-Muñoz et al., 2010). CeN lesions may therefore either have attenuated the general motivational properties of the US, or prevented the habitual freezing response to the US such that subjects no longer engaged in freezing behavior, and were able to perform the instrumental avoidance response governed by the sensory-specific features of the US (Killcross et al., 1997b; Lázaro-Muñoz et al., 2010).
Amygdala, Striatal and Prefrontal Circuits Supporting Appetitive and Aversive Behaviors
The evidence reviewed above indicates that the BLA and CeN are necessary for the psychological processes by which pavlovian CSs influence instrumental behavior, including conditioned direction, conditioned motivation and conditioned reinforcement. However, the amygdala does not by itself support the complex behaviors supported by these psychological processes; instead, the amygdala constitutes part of a wider network within the corticostriatal circuitry (Figure 1).
Figure 1. An abbreviated diagram of amygdala connectivity with the cortex and striatum; refer to text for details on the functions of these connections. Abbreviations: BLA, basolateral amygdala; CeN, central nucleus of the amygdala; DLS, dorsolateral striatum; DMS, dorsomedial striatum; IC, insular cortex; IL, infralimbic cortex; ITC, intercalated cells; NAcbC, nucleus accumbens core; NAcbSh, nucleus accumbens shell; OFC, orbitofrontal cortex; PL, prelimbic cortex; SN, substantia nigra; VTA, ventral tegmental area. The dashed line indicates weak connectivity.
BLA Projections to the Striatum Support CS Control Over Instrumental Behavior
The BLA projects to both the ventral and medial striatum, including the nucleus accumbens (NAcb) and the dorsomedial striatum (DMS). These glutamatergic projections (Kelley et al., 1982) to both the NAcb and the DMS converge with dopaminergic inputs from the ventral tegmental area (VTA; Floresco et al., 2001; Floresco, 2007). This convergence has been shown to be a requirement for reward-seeking behaviors (Ambroggi et al., 2008) and fearful behaviors (Fadok et al., 2010) that are guided by pavlovian CSs. Furthermore, through reciprocal dopaminergic projections connecting the midbrain to the dorsal striatum (Haber et al., 2000; Belin et al., 2009), the BLA can influence motor output regions of the dorsal striatum.
BLA Connections to the PFC Support Integration of the Affective Value of CSs with Current Motivational State
The BLA has extensive reciprocal projections with the PFC, including afferents to both the prelimbic (PL) and infralimbic (IL) cortices (Krettek and Price, 1977). However, the projections from the PL and IL have distinct effects on amygdala activity and may provide a potential mechanism for balancing the impact of an explicit CS-US association stored in the BLA and the more general excitation evoked by a stimulus maintained by CeN circuitry. Excitatory inputs from the PL project directly onto the BLA (Cassell and Wright, 1986; Vertes, 2004), enhancing BLA activity and BLA-mediated inhibition of CeN outputs (Burgos-Robles et al., 2009) whereas excitatory inputs from the IL to intercalated cells (ITC) between the BLA and CeN (Cassell and Wright, 1986) disinhibit CeN activity modulated by the BLA (Quirk et al., 2003; Li et al., 2011a).
The orbitofrontal cortex (OFC) modulates amygdala activity in terms of current motivational states and goal assessment via its extensive reciprocal connectivity with the BLA (Leichnetz and Astruc, 1975; McDonald, 1991) along with projections to the ITC that are thought to maintain a homeostatic modulation of input to the CeN (Ghashghaei and Barbas, 2002). Functionally, this connectivity between the OFC and the BLA is required for the updating of CS representations; for example, reversal learning (Schoenbaum et al., 2003; Stalnaker et al., 2007) or sensitivity to reinforcer devaluation (Baxter et al., 2000), whether through procedures such as “specific satiety,” in which a reinforcer is devalued immediately before behavioral testing by allowing the animal to consume it ad libitum (Balleine et al., 2003) or through direct devaluation of an oral reinforcer by induction of gastric malaise (Pickens et al., 2003). A more general view suggests that BLA-OFC connectivity is required for new information to influence behavior (Schoenbaum and Esber, 2010).
This has led to the suggestion that BLA neurons, and neurons in the OFC, represent the overall value of the animal's state (Belova et al., 2008). Interestingly, these value coding neurons are not anatomically segregated, but form distinct circuits which are dynamically modulated as the animals use CSs to predict rewarding and aversive outcomes (Herry et al., 2008; Zhang et al., 2013). How these functionally separate but anatomically indistinct populations of neurons interact with the rest of the corticostriatal circuitry requires further investigation.
The CeN is Part of a Circuit by Which Pavlovian CSs Generally Activate Behavior and Support Behavior Based on S-R Associations
As for the BLA, the CeN receives highly processed sensory inputs directly from the thalamus and the cortex (Turner and Herkenham, 1991; McDonald, 1998) in addition to receiving input from the BLA complex via the ITC (Royer et al., 1999; Fudge and Emiliano, 2003) that are modulated by PFC inputs (McDonald et al., 1996; Fisk and Wyss, 1999). The ITC provide a feed-forward network allowing not only excitatory cortical regulation of BLA input onto the CeN (Royer et al., 1999), but also dopaminergic reduction of cortical influence on the ITC (Marowsky et al., 2005). This is provided by the midbrain dopaminergic system that originates in the ventral lateral tegmentum, and traverses the VTA and substantia nigra (SN) with preferential connectivity to the ITC and CeN (Ungerstedt, 1971; Swanson, 1982; Deutch et al., 1988) potentiating the learning of pavlovian CSs (Harmer and Phillips, 1999). Importantly, though the activity of the CeN can be modulated by that of the BLA, the CeN receives and makes projections of its own; it is not simply an output structure for the BLA (Cardinal et al., 2002a; Balleine and Killcross, 2006).
By contrast to the projections of the BLA, the CeN projects to the brainstem and the midbrain, including areas such as the substantia nigra pars compacta (SNc; Lee et al., 2010), the periaqueductal gray (Rizvi et al., 1991), and the hypothalamus (Gray et al., 1989). These connections together are consistent with a role in mediating motor, autonomic, reflexive, and neuroendocrine responses to a pavlovian CS. Though there are no direct projections from the CeN to the striatum (McDonald, 1991), the impact of CeN activity on invigorating more complex behaviors of approach or avoidance (McDannald et al., 2004; Corbit and Balleine, 2005) may be through indirect connectivity with the striatum. Retrograde labeling studies show heavy projections from the medial CeN to the SNc and only limited projections to the VTA (Lee et al., 2010). These CeN projections are primarily targeting the lateral third of the posterior SNc (Zahm et al., 1999; Fudge and Emiliano, 2003), an area with direct dopaminergic connectivity to the dorsolateral striatum (DLS) and only minimal influence on the ventral striatum (Gerfen et al., 1987; Prensa and Parent, 2001). Therefore, in addition to the connections to the DLS via the BLA-NAcbC pathway recruiting reciprocal dopaminergic loops across the midbrain (Haber et al., 2000; Belin et al., 2009), an indirect pathway that utilizes the CeN to SNc to DLS circuitry (Belin et al., 2013) may also influence motor behavior, generally invigorating CS-induced behavior without discrimination between CSs.
At the Systems-Level, there is no Distinction Between Appetitive and Aversive Associations
The amygdala has the appropriate anatomical and neurochemical connections with the striatum and cortex to support its function of storing CS-US associations and modulating reward, reinforcement, and motor processing, independent of the valence of the reinforcer (Figure 1). The BLA and CeN differ in their connectivity in a number of ways that reflect the different functions hypothesized in the parallel processing model: they have different afferent and efferent projections (Pitkänen et al., 1997) though both areas receive highly processed sensory inputs from the cortex and the thalamus (Turner and Herkenham, 1991; Li et al., 1996). Both areas project to the striatum, though the CeN projections are indirect; and both areas have reciprocal innervation with different regions of the prefrontal cortex (PFC). The anatomical circuitry does not distinguish between information about aversive or appetitive CSs; furthermore, evidence from neuronal recordings suggests that highly overlapping populations of neurons encode aversive and appetitive CSs within the amygdala itself.
The “value-coding” neurons found in the amygdala (Belova et al., 2008) are consistent with the view that the BLA and CeN represent sensory-specific and generalized affective representations, respectively. Zhang et al. (2013) observed different responses to CSs and USs in different regions of the amygdala; visual responses to a fixation point in a reversal task and to CSs resulted in more prevalent and faster neuronal responses in the lateral regions of the amygdala, while responses to liquid reward and air puff (multimodal USs) were more evenly distributed through the medial-lateral extent of the amygdala (most likely representing the CeN). Although not completely defined, these results are consistent with the parallel model of amygdala processing (Cardinal et al., 2002a; Everitt et al., 2003; Balleine and Killcross, 2006).
Interactions Between the Aversive and Appetitive Systems
As considered above, the requirement for the BLA and CeN in supporting the processes that underlie conditioned reinforcement, conditioned motivation and conditioned direction appears to be independent of the valence of the reinforcer. It is therefore worth considering whether there is any evidence for separate appetitive and aversive systems within the brain. This question can be approached at multiple levels of analysis, including the psychological, systems and neuronal levels.
Psychological Theories of Appetitive and Aversive Interactions
As previously discussed, the amygdala can represent appetitive and aversive CSs, however, it is difficult to convert an excitor of one motivational system (e.g. a signal that predicts an aversive footshock) into an excitor of the opposite motivational system (e.g. a signal that predicts food reward; Dickinson and Pearce, 1977; Dickinson and Dearing, 1979). According to traditional psychological models, this is due to the inhibitory interactions hypothesized to exist between the appetitive and aversive motivational systems in the brain (Konorski, 1964, 1967). These inhibitory interactions not only allow appetitive and aversive CSs to produce either appetitive or aversive motivational responses, respectively, they also enable another class of stimuli, conditioned inhibitors, to produce equivalent behavior to that seen with the presentation of an excitatory CS of the opposite motivational system. For example, a conditioned inhibitor of fear, referred to as a “safety signal” (Christianson et al., 2012) signals the absence of an aversive event and in doing so inhibits the aversive motivational system; this hypothetically leads to a disinhibition of the appetitive system so that appetitive behavior can be engaged during the safety signal. Thus, studies of conditioned inhibition emphasize the need to consider both motivational systems when attempting to understand how inhibitory associations are processed and highlight the limitations of considering stimuli to be solely within either an appetitive or an aversive domain.
In addition to acting as inhibitors of the aversive motivational system, safety signals may also possess appetitive qualities. The effects of safety signals on instrumental avoidance behavior have suggested that safety signals can act as positive reinforcers (Rescorla and Lolordo, 1965; Weisman and Litner, 1969; Dinsmoor and Sears, 1973; Morris, 1975) indicating that a conditioned inhibitor of fear has appetitive conditioned value. In accordance with its hypothesized function in storing CS-US associations, the amygdala may be a key area in representing the affective value of safety signals. Learning about safety signals induces a long-lasting synaptic depression of fear CS-evoked activity in the lateral amygdala that correlates with behavioral fear reduction (Rogan et al., 2005). However, changes in the spine size of amygdala neurons, indicative of synaptic plasticity and learning, indicate both increases and decreases following fear conditioning and safety conditioning, respectively (Ostroff et al., 2010), suggesting that the BLA is involved in the processing of both conditioned fear excitors and conditioned fear inhibitors—associating CSs with specific motivational outcomes independent of CS valence.
BLA Neuronal Responses to Appetitive and Aversive Stimuli
The BLA is necessary for the control of behavior by specific CSs and enables individuals to use sensory-specific outcomes to guide both instrumental behavior (Balleine et al., 2003; Yun and Fields, 2003) and consummatory behavior, as in the phenomenon of CS-potentiated feeding (Holland and Gallagher, 2003). Electrophysiological studies of amygdala neurons, like the lesion evidence, support the view that the amygdala acts as a CS-US memory storage device within the limbic corticostriatal circuitry. Early studies using single-unit recordings revealed neurons in the amygdala that were activated during motivated behaviors such as eating, drinking and sex (Rolls, 1972). More generally, electrophysiological studies support the hypothesis that the BLA encodes the sensory-specific association of a CS with its affective outcome; the firing of BLA neurons correlates with the coding of the reinforcing and motivational properties of CSs (Tye and Janak, 2007) and, as demonstrated for discriminative fear conditioning, this encoding can be CS-specific (Collins and Paré, 2000). Though correlative, this suggests that neurons within the amygdala can encode “affective value.” “Value-coding” neurons can be operationally defined as neurons that preferentially respond to rewarding or aversive CSs as animals exhibit approach and avoidance behaviors, respectively. Defined in this manner, value-coding neurons have been identified in the primate amygdala using tasks in which reinforcement contingencies were reversed with “positive” and “negative” neurons seen to track value consistently across different sensory events (Paton et al., 2006; Belova et al., 2007; Morrison and Salzman, 2011; Morrison et al., 2011; Barberini et al., 2012; Zhang et al., 2013).
Though there are populations of neurons that respond primarily to appetitive or aversive stimuli (Paton et al., 2006; Belova et al., 2007; Tye and Janak, 2007), single-unit recordings made in the rat BLA suggest that the encoding of appetitive and aversive stimuli can be highly similar. Using a procedure that allowed the parallel investigation of fear, reward, and safety learning in the same animals, Sangha et al. (2013) found different populations of neurons responsive to fear-associated CSs and safety signals, as well as neurons responsive to both safety signals and appetitive CSs. Although behaviorally the rats were able to distinguish the differing cues in this study, there was considerable overlap in neuronal activity, with subsets of neurons responding to all three cues, none of the cues, or only to the fear and reward cue. Rather than necessarily providing evidence for a common appetitive system mediating fear-inhibiting stimuli and rewarding stimuli, this study highlights the complicated nature of circuits within the amygdala that process not only appetitive and aversive associations, but also stimulus saliency and prediction error. The balance of this processing, and its subsequent effects on behavior mediated by the corticostriatal circuitry, requires further investigation.
Beyond Pleasure and Pain: Encoding of Stimulus Salience and Reinforcer Expectation in the Amygdala
The amygdala does not, however, only encode appetitive or aversive associations. Following pavlovian conditioning, some primate amygdala neurons modulate their responses to rewards and aversive stimuli, acting as value coding neurons guiding either appetitively or aversively motivated behavior (Zhang et al., 2013). In other cells, however, effects of expectation on responses were similar for both rewards and punishment, suggesting that some neurons are involved in more arousal-specific responses, reflecting the intensity of activation in the motivational systems rather than the specific valence of a reinforcer. Both valence-specific and arousal-specific neurons in the amygdala were found to be modulated by expectation of reward; initially high levels of firing in these neurons decreased as monkeys learned the CS-US associations, akin to a reduction in a prediction error signal, which aids reinforcement learning through comparison of expected and received reinforcement. Theoretically, the Pearce-Hall model predicts that events will be better attended to, and hence learned about faster, when their consequences are surprising or unexpected (Pearce and Hall, 1980). This is similar to empirical observations in the rat BLA, where responses to reward are also consistent with prediction error signals that follow the Pearce-Hall model, as the same neurons fired whether the reward unexpectedly increased or decreased in value (Roesch et al., 2010). These neuronal responses in the BLA differ to those measured in the striatum, which more closely approximate the Rescorla–Wagner model (Rescorla and Wagner, 1972) in that the activity of neurons was higher when reward was better than expected, but showed suppression when reward was worse than expected (Delgado et al., 2003; O'doherty et al., 2003; Li et al., 2011b). Neurons within the CeN, however, have only been shown to fire specifically to the omission of an expected reward, and no more to the surprising delivery of a reward than to an expected reward (Calu et al., 2010). This is consistent with lesion studies showing that the CeN is critical for allocating attention for increased processing of events after downshifts but not upshifts in reward value (Holland and Gallagher, 1993). The contrasting responses of the BLA and the CeN support the parallel processing model of amygdala function, with neuronal activity in the CeN mirroring the time course and activity of midbrain dopamine neurons. It has been proposed that negative prediction errors signaled by midbrain dopamine neurons may be conveyed to the CeN, which might then activate basal forebrain cholinergic neurons and other attention-related systems for increases in attention after omission of expected events (Calu et al., 2010). Further characterization of the firing of neurons fitted to prediction error learning models within the BLA and CeN, and in structures projecting to and from these amygdala nuclei, may reveal how these two subnuclei process different representations of a CS-US association.
Conclusions
We and others (Killcross et al., 1997b; Cardinal et al., 2002a; Balleine and Killcross, 2006) have argued that the amygdala can be conceptualized as a CS-US memory storage device, storing associations between the motivational and affective value of pavlovian CSs, with the CeN representing the general affective properties of pavlovian CSs, and the BLA representing the sensory-specific properties of the same CS. These different functions of amygdala subdivisions lead to differential involvement in specific behaviors produced by dissociable psychological processes such as conditioned reinforcement, conditioned motivation and conditioned direction. These behaviors are not mediated only by the amygdala, but rather by a complex network involving numerous interactions with the corticostriatal circuitry. Convincing evidence suggests amongst other aspects of associative learning, appetitive-aversive associations are coded at the neuronal level rather than at the substrate level, which is seen not only in the amygdala but also in the OFC (Morrison and Salzman, 2011; Morrison et al., 2011), the striatum (Hikida et al., 2010), the lateral habenula (Matsumoto and Hikosaka, 2007) and the VTA (Kim et al., 2012) suggesting that there is little difference in the processing of appetitive and aversive memories throughout the corticostriatal system. Considering the brain in terms of the psychological constructs and processes encoded and supported by different areas, rather than simply appetitive or aversive associations, may prove more productive in understanding the interactions of the “limbic” corticostriatal circuitry, which allows individuals to both secure pleasure and to avoid pain.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This work was conducted in the Behavioural and Clinical Neuroscience Institute, a joint initiative funded by the UK Medical Research Council (MRC) and the Wellcome Trust, in the Department of Psychology at the University of Cambridge. Anushka B. P. Fernando was supported by an MRC CASE studentship, Jennifer E. Murray was supported by an MRC Programme Grant (no. G1002231), and Amy L. Milton is the Ferreras-Willetts Fellow in Neuroscience at Downing College, Cambridge.
References
Ambroggi, F., Ishikawa, A., Fields, H. L., and Nicola, S. M. (2008). Basolateral amygdala neurons facilitate reward-seeking behavior by exciting nucleus accumbens neurons. Neuron 59, 648–661. doi: 10.1016/j.neuron.2008.07.004
Arroyo, M., Markou, A., Robbins, T. W., and Everitt, B. J. (1998). Acquisition, maintenance and reinstatement of intravenous cocaine self-administration under a second-order schedule of reinforcement in rats: effects of conditioned cues and continuous access to cocaine. Psychopharmacology 140, 331–344. doi: 10.1007/s002130050774
Balleine, B. W., Killcross, A. S., and Dickinson, A. (2003). The effect of lesions of the basolateral amygdala on instrumental conditioning. J. Neurosci. 23, 666–675. Available online at: http://www.jneurosci.org/content/23/2/666.full.pdf+html
Balleine, B. W., and Killcross, S. (2006). Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci. 29, 272–279. doi: 10.1016/j.tins.2006.03.002
Barberini, C. L., Morrison, S. E., Saez, A., Lau, B., and Salzman, C. D. (2012). Complexity and competition in appetitive and aversive neural circuits. Front. Neurosci. 6:170. doi: 10.3389/fnins.2012.00170
Baxter, M. G., Parker, A., Lindner, C. C. C., Izquierdo, A. D., and Murray, E. A. (2000). Control of response selection by reinforcer value requires interaction of amygdala and orbital prefrontal cortex. J. Neurosci. 20, 4311–4319. Available online at: http://www.jneurosci.org/content/20/11/4311.full.pdf+html
Belin, D., Belin-Rauscent, A., Murray, J. E., and Everitt, B. J. (2013). Addiction: failure of control over maladaptive incentive habits. Curr. Opin. Neurobiol. 23, 564–572. doi: 10.1016/j.conb.2013.01.025
Belin, D., Jonkman, S., Dickinson, A., Robbins, T. W., and Everitt, B. J. (2009). Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behav. Brain Res. 199, 89–102. doi: 10.1016/j.bbr.2008.09.027
Belova, M. A., Paton, J. J., Morrison, S. E., and Salzman, C. D. (2007). Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55, 970–984. doi: 10.1016/j.neuron.2007.08.004
Belova, M. A., Paton, J. J., and Salzman, C. D. (2008). Moment-to-moment tracking of state value in the amygdala. J. Neurosci. 28, 10023–10030. doi: 10.1523/JNEUROSCI.1400-08.2008
Blundell, P., Hall, G., and Killcross, S. (2001). Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. J. Neurosci. 21, 9018–9026. Available online at: http://www.jneurosci.org/content/21/22/9018.full.pdf+html
Bordi, F., and Ledoux, J. E. (1994). Response properties of single units in areas of rat auditory thalamus that project to the amygdala. II. Cells receiving convergent auditory and somatosensory inputs and cells antidromically activated by amygdala stimulation. Exp. Brain Res. 98, 275–286. doi: 10.1007/BF00228415
Burgos-Robles, A., Vidal-Gonzalez, I., and Quirk, G. J. (2009). Sustained conditioned responses in prelimbic prefrontal neurons are correlated with fear expression and extinction failure. J. Neurosci. 29, 8474–8482. doi: 10.1523/JNEUROSCI.0378-09.2009
Burke, K. A., Franz, T. M., Miller, D. N., and Schoenbaum, G. (2007). Conditioned reinforcement can be mediated by either outcome-specific or general affective representations. Front. Integr. Neurosci. 1:2. doi: 10.3389/neuro.07.002.2007
Burns, L. H., Everitt, B. J., and Robbins, T. W. (1999). Effects of excitotoxic lesions of the basolateral amygdala on conditional discrimination learning with primary and conditioned reinforcement. Behav. Brain Res. 100, 123–133. doi: 10.1016/S0166-4328(98)00119-3
Burns, L. H., Robbins, T. W., and Everitt, B. J. (1993). Differential effects of excitotoxic lesions of the basolateral amygdala, ventral subiculum and medial prefrontal cortex on responding with conditioned reinforcement and locomotor activity potentiated by intra-accumbens infusions of D-amphetamine. Behav. Brain Res. 55, 167–183. doi: 10.1016/0166-4328(93)90113-5
Cador, M., Robbins, T. W., and Everitt, B. J. (1989). Involvement of the amygdala in stimulus-reward associations: interaction with the ventral striatum. Neuroscience 30, 77–86. doi: 10.1016/0306-4522(89)90354-0
Calu, D. J., Roesch, M. R., Haney, R. Z., Holland, P. C., and Schoenbaum, G. (2010). Neural correlates of variations in event processing during learning in central nucleus of amygdala. Neuron 68, 991–1001. doi: 10.1016/j.neuron.2010.11.019
Campeau, S., and Davis, M. (1995). Involvement of the central nucleus and basolateral complex of the amygdala in fear conditioning measured with fear-potentiated startle in rats trained concurrently with auditory and visual conditioned stimuli. J. Neurosci. 15, 2301–2311.
Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002a). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26, 321–352. doi: 10.1016/S0149-7634(02)00007-6
Cardinal, R. N., Parkinson, J. A., Lachenal, G., Halkerston, K. M., Rudarakanchana, N., Hall, J., et al. (2002b). Effects of selective excitotoxic lesions of the nucleus accumbens core, anterior cingulate cortex, and central nucleus of the amygdala on autoshapig performance in rats. Behav. Neurosci. 116, 553–567. doi: 10.1037/0735-7044.116.4.553
Cassell, M. D., and Wright, D. J. (1986). Topography of projections from the medial prefrontal cortex to the amygdala in the rat. Brain Res. Bull. 17, 321–333. doi: 10.1016/0361-9230(86)90237-6
Chang, S. E., Wheeler, D. S., and Holland, P. C. (2012a). Effects of lesions of the amygdala central nucleus on autoshaped lever pressing. Brain Res. 1450, 49–56. doi: 10.1016/j.brainres.2012.02.029
Chang, S. E., Wheeler, D. S., and Holland, P. C. (2012b). Roles of nucleus accumbens and basolateral amygdala in autoshaped lever pressing. Neurobiol. Learn. Mem. 97, 441–451. doi: 10.1016/j.nlm.2012.03.008
Choi, J.-S., Cain, C. K., and Ledoux, J. E. (2010). The role of amygdala nuclei in the expresion of auditory signaled two-way active avoidance in rats. Learn. Mem. 17, 139–147. doi: 10.1101/lm.1676610
Christianson, J. P., Fernando, A. B. P., Kazama, A. M., Jovanovic, T., Ostroff, L. E., and Sangha, S. (2012). Inhibition of fear by learned safety signals: a mini-symposium review. J. Neurosci. 32, 14118–14124. doi: 10.1523/JNEUROSCI.3340-12.2012
Collins, D. R., and Paré, D. (2000). Differential fear conditioning induces reciprocal changes in the sensory responses of lateral amygdala neurons to the CS+ and CS−. Learn. Mem. 7, 97–103. doi: 10.1101/lm.7.2.97
Corbit, L. H., and Balleine, B. W. (2005). Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J. Neurosci. 25, 962–970. doi: 10.1523/JNEUROSCI.4507-04.2005
Delgado, M. R., Locke, H. M., Stenger, V. A., and Fiez, J. A. (2003). Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn. Affect. Behav. Neurosci. 3, 27–38. doi: 10.3758/CABN.3.1.27
Deutch, A. Y., Goldstein, M., Baldino, F. Jr., and Roth, R. H. (1988). Telencephalic projections of the A8 dopamine cell group. Ann. N.Y. Acad. Sci. 537, 27–50. doi: 10.1111/j.1749-6632.1988.tb42095.x
Di Ciano, P., and Everitt, B. J. (2004). Conditioned reinforcing properties of stimuli paired with self-adminstered cocaine, heroin or sucrose: implications for the persistence of addictive behavior. Neuropharmacology 47, 202–213. doi: 10.1016/j.neuropharm.2004.06.005
Dickinson, A., and Dearing, M. F. (1979). “Appetitive-aversive interactions and inhibitory processes,” in Mechanisms of Learning and Motivation, eds A. Dickinson and R. A. Boakes. (Hillsdale, NJ: Erlbaum), 203–228.
Dickinson, A., and Pearce, J. M. (1977). Inhibitory interactions between appetitive and aversive stimuli. Psychol. Bull. 84, 690–711. doi: 10.1037/0033-2909.84.4.690
Dinsmoor, J. A., and Sears, G. W. (1973). Control of avoidance by a response-produced stimulus. Learn. Motiv. 4, 284–293. doi: 10.1016/0023-9690(73)90018-0
Everitt, B. J., Cador, M., and Robbins, T. W. (1989). Interactions between the amygdala and ventral striatum in stimulus-reward associations: studies using a second-order schedule of sexual reinforcement. Neuroscience 30, 63–75. doi: 10.1016/0306-4522(89)90353-9
Everitt, B. J., Cardinal, R. N., Parkinson, J. A., and Robbins, T. W. (2003). Appetitive behavior: impact of amygdala-dependent mechanisms of emotional learning. Ann. N.Y. Acad. Sci. 985, 233–250. doi: 10.1111/j.1749-6632.2003.tb07085.x
Everitt, B. J., and Robbins, T. W. (2000). Second-order schedules of drug reinforcement in rats and monkeys: measurement of reinforcing efficacy and drug-seeking behaviour. Psychopharmacology 153, 17–30. doi: 10.1007/s002130000566
Fadok, J. P., Darvas, M., Dickerson, T. M. K., and Palmiter, R. D. (2010). Long-term memory for pavlovian fear conditioning requires dopamine in the nucleus accumbens and basolateral amygdala. PLoS ONE 5:e12751. doi: 10.1371/journal.pone.0012751
Fisk, G. D., and Wyss, J. M. (1999). Associational projections of the anterior midline cortex in the rat: intracingulate and retrosplenial connections. Brain Res. 825, 1–13. doi: 10.1016/S0006-8993(99)01182-8
Flagel, S. B., Watson, S. J., Robinson, T. E., and Akil, H. (2007). Individual differences in the propensity to approach signals vs goals promote different adaptations in the dopamine system of rats. Psychopharmacology 191, 599–607. doi: 10.1007/s00213-006-0535-8
Floresco, S. B. (2007). Dopaminergic regulation of limbic-striatal interplay. J. Psychiatry Neurosci. 32, 400–411. Available online at: http://www.cma.ca/multimedia/staticContent/HTML/N0/l2/jpn/vol-32/issue-6/pdf/pg400.pdf
Floresco, S. B., Blaha, C. D., Yang, C. R., and Phillips, A. G. (2001). Modulation of hippocampal and amygdalar-evoked activity of nucleus accumbens neurons by dopamine: cellular mechanisms of input selection. J. Neurosci. 21, 2851–2860. Available online at: http://www.jneurosci.org/content/21/8/2851.full.pdf+html
Fudge, J. L., and Emiliano, A. B. (2003). The extended amygdala and the dopamine system: another piece of the dopamine puzzle. J. Neuropsychiatry Clin. Neurosci. 15, 306–316. doi: 10.1176/appi.neuropsych.15.3.306
Gallagher, M., Graham, P. W., and Holland, P. C. (1990). The amygdala central nucleus and appetitive pavlovian conditioning: lesions impair one class of conditioned behavior. J. Neurosci. 10, 1906–1911. Available online at: http://www.jneurosci.org/content/10/6/1906.long
Gerfen, C. R., Herkenham, M., and Thibault, J. (1987). The neostriatal mosaic: II. Patch- and matrix-directed mesostriatal dopaminergic and non-dopaminergic systems. J. Neurosci. 7, 3915–3934.
Ghashghaei, H. T., and Barbas, H. (2002). Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey. Neuroscience 115, 1261–1279. doi: 10.1016/S0306-4522(02)00446-3
Goddard, B., and Leri, F. (2006). Reinstatement of conditioned reinforcing properties of cocaine-conditioned stimuli. Pharmacol. Biochem. Behav. 83, 540–546. doi: 10.1016/j.pbb.2006.03.015
Gray, T. S., Carney, M. E., and Magnuson, D. J. (1989). Direct projections from the central amygdaloid nucleus to the hypothalamic paraventricular nucleus: possible role in stress-induced adrenocorticotropin release. Neuroendocrinology 50, 433–446. doi: 10.1159/000125260
Haber, S. N., Fudge, J. L., and Mcfarland, N. R. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369–2382. Available online at: http://www.jneurosci.org/content/20/6/2369.full.pdf+html
Hall, J., Parkinson, J. A., Connor, T. M., Dickinson, A., and Everitt, B. J. (2001). Involvement of the central nucleus of the amygdala and nucleus accumbens core in mediating Pavlovian influences on instrumental behaviour. Eur. J. Neurosci. 13, 1984–1992. doi: 10.1046/j.0953-816x.2001.01577.x
Harmer, C. J., and Phillips, G. D. (1999). Enhanced dopamine efflux in the amygdala by a predictive, but not a non-predictive, stimulus: facilitation by prior repeated d-amphetamine. Neuroscience 90, 119–130. doi: 10.1016/S0306-4522(98)00464-3
Hatfield, T., Han, J. S., Conley, M., Gallagher, M., and Holland, P. C. (1996). Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects. J. Neurosci. 16, 5256–5265.
Herry, C., Ciocchi, S., Senn, V., Demmou, L., Müller, C., and Lüthi, A. (2008). Switching on and off fear by distinct neuronal circuits. Nature 454, 600–606. doi: 10.1038/nature07166
Hikida, T., Kimura, K., Wada, N., Funabiki, K., and Nakanishi, S. (2010). Distinct roles of synaptic transmission in direct and indirect striatal pathways to reward and aversive behavior. Neuron 66, 896–907. doi: 10.1016/j.neuron.2010.05.011
Hitchcott, P. K., and Phillips, G. D. (1997). Amygdala and hippocampus control dissociable aspects of drug-associated conditioned rewards. Psychopharmacology 131, 187–195. doi: 10.1007/s002130050283
Holland, P. C., and Gallagher, M. (1993). Amygdala central nucleus lesions disrupt increments, but not decrements, in conditioned stimulus processing. Behav. Neurosci. 107, 246–253. doi: 10.1037/0735-7044.107.2.246
Holland, P. C., and Gallagher, M. (2003). Double dissociation of the effects of lesions of basolateral and central amygdala on conditioned stimulus-potentiated feeding and pavlovian-instrumental transfer. Eur. J. Neurosci. 17, 1680–1694. doi: 10.1046/j.1460-9568.2003.02585.x
Holland, P. C., Han, J.-S., and Gallagher, M. (2000). Lesions of the amygdala central nucleus alter performance on a selective attention task. J. Neurosci. 20, 6701–6706. Available online at: http://www.jneurosci.org/content/20/17/6701.full.pdf+html
Hyde, T. S. (1976). The effect of Pavlovian stimuli on the acquisition of a new response. Learn. Motiv. 7, 223–239. doi: 10.1016/0023-9690(76)90030-8
Kelley, A. E., Domesick, V. B., and Nauta, W. J. (1982). The amygdalostriatal projection in the rat - an anatomical study by anterograde and retrograde tracing methods. Neuroscience 7, 615–630. doi: 10.1016/0306-4522(82)90067-7
Killcross, A. S., Everitt, B. J., and Robbins, T. W. (1997a). Symmetrical effects of amphetamine and alpha-flupenthixol on conditioned punishment and conditioned reinforcement: contrasts with midazolam. Psychopharmacology 129, 141–152. doi: 10.1007/s002130050174
Killcross, S., Robbins, T. W., and Everitt, B. J. (1997b). Different types of fear-conditioned behaviour mediated by separate nuclei within amygdala. Nature 388, 377–380. doi: 10.1038/41097
Kim, J. J., Rison, R. A., and Fanselow, M. S. (1993). Effects of amygdala, hippocampus and periaqueductal gray lesions on short- and long-term contextual fear. Behav. Neurosci. 107, 1093–1098. doi: 10.1037/0735-7044.107.6.1093
Kim, Y., Wood, J., and Moghaddam, B. (2012). Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning. PLoS ONE 7:e29766. doi: 10.1371/journal.pone.0029766
Klüver, H., and Bucy, P. C. (1939). Preliminary analysis of the temporal lobe in monkeys. Arch. Neurol. Psychiatry 42, 979–1000. doi: 10.1001/archneurpsyc.1939.02270240017001
Konorski, J. (1964). Some problems concerning the mechanism of instrumental conditioning. Act Biol. Exp. 24, 59–72.
Konorski, J. (1967). Integrative Activity of the Brain: an Interdisciplinary Approach. Chicago, IL: University of Chicago Press.
Krettek, J. E., and Price, J. L. (1977). Projections from the amygdaloid complex to the cerebral cortex and thalamus in the rat and cat. J. Comp. Neurol. 172, 687–722. doi: 10.1002/cne.901720408
Lázaro-Muñoz, G., Ledoux, J. E., and Cain, C. K. (2010). Sidman instrumental avoidance initially depends on lateral and basal amygdala and is constrained by central amygdala-mediated Pavlovian processes. Biol. Psychiatry 67, 1120–1127. doi: 10.1016/j.biopsych.2009.12.002
Ledoux, J. E. (2000). Emotion circuits in the brain. Annu. Rev. Neurosci. 23, 155–184. doi: 10.1146/annurev.neuro.23.1.155
Ledoux, J. E., Cicchetti, P., Xagoraris, A., and Romanski, L. M. (1990). The lateral amygdaloid nucleus: sensory interface of the amygdala in fear conditioning. J. Neurosci. 10, 1062–1069.
Lee, H. J., Gallagher, M., and Holland, P. C. (2010). The central amygdala projection to the substantia nigra reflects prediction error information in appetitive conditioning. Learn. Mem. 17, 531–538. doi: 10.1101/lm.1889510
Leichnetz, G. R., and Astruc, J. (1975). Efferent connections of the orbitofrontal cortex in the marmoset (Sanguinus oedipus). Brain Res. 2, 169–180. doi: 10.1016/0006-8993(75)90973-7
Li, G., Amano, T., Paré, D., and Nair, S. S. (2011a). Impact of infralimbic inputs on intercalated amygdala neurons: a biophysical modeling study. Learn. Mem. 18, 226–240. doi: 10.1101/lm.1938011
Li, J., Schiller, D., Schoenbaum, G., Phelps, E. A., and Daw, N. D. (2011b). Differential roles of human striatum and amygdala in associative learning. Nat. Neurosci. 14, 1250–1252. doi: 10.1038/nn.2904
Li, X. F., Stutzmann, G. E., and Ledoux, J. E. (1996). Convergent but temporally separated inputs to lateral amygdala neurons from the auditory thalamus and auditory cortex use different postsynaptic receptors: in vivo intracellular and extracellular recordings in fear conditioning pathways. Learn. Mem. 3, 229–242. doi: 10.1101/lm.3.2-3.229
Liljeholm, M., and O'Doherty, J. P. (2012). Contributions of the striatum to learning, motivation, and performance: an associative account. Trends Cogn. Sci. 16, 467–475. doi: 10.1016/j.tics.2012.07.007
Maren, S. (2001). Neurobiology of Pavlovian fear conditioning. Annu. Rev. Neurosci. 24, 897–931. doi: 10.1146/annurev.neuro.24.1.897
Maren, S., Aharonov, G., and Fanselow, M. S. (1996). Retrograde abolition of conditioned fear after excitotoxic lesions in the basolateral amygdala of rats: absence of a temporal gradient. Behav. Neurosci. 110, 718–726. doi: 10.1037/0735-7044.110.4.718
Marowsky, A., Yanagawa, Y., Obata, K., and Vogt, K. E. (2005). A specialized subclass of interneurons mediates dopaminergic facilitation of amygdala function. Neuron 48, 1025–1037. doi: 10.1016/j.neuron.2005.10.029
Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111–1115. doi: 10.1038/nature05860
McDannald, M., Kerfoot, E., Gallagher, M., and Holland, P. C. (2004). Amygdala central nucleus function is necessary for learning but not expression of conditioned visual orienting. Eur. J. Neurosci. 20, 240–248. doi: 10.1111/j.0953-816X.2004.03458.x
McDonald, A. J. (1991). Organization of amygdaloid projections to the prefrontal cortex and associated striatum in the rat. Neuroscience 44, 1–14. doi: 10.1016/0306-4522(91)90247-L
McDonald, A. J. (1998). Cortical pathways to the mammalian amygdala. Prog. Neurobiol. 55, 257–332. doi: 10.1016/S0301-0082(98)00003-3
McDonald, A. J., Mascagni, F., and Guo, L. (1996). Projections of the medial and lateral prefrontal cortices to the amygdala: a Phaseolus vulgaris leucoagglutinin study in the rat. Neuroscience 71, 55–75. doi: 10.1016/0306-4522(95)00417-3
McDonald, A. J., Shammah-Lagnado, S. J., Shi, C., and Davis, M. (1999). Cortical afferents to the extended amygdala. Ann. N.Y. Acad. Sci. 877, 309–338. doi: 10.1111/j.1749-6632.1999.tb09275.x
Mead, A. N., and Stephens, D. N. (2003a). Involvement of AMPA receptor GluR2 subunits in stimulus-reward learning: evidence from glutamate receptor gria2 knock-out mice. J. Neurosci. 23, 9500–9507. Available online at: http://www.jneurosci.org/content/23/29/9500.full.pdf+html
Mead, A. N., and Stephens, D. N. (2003b). Selective disruption of stimulus-reward learning in glutamate receptor gria1 knock-out mice. J. Neurosci. 23, 1041–1048. Available online at: http://www.jneurosci.org/content/23/3/1041.full.pdf+html
Milton, A. L., and Everitt, B. J. (2010). The psychological and neurochemical mechanisms of drug memory reconsolidation: implications for the treatment of addiction. Eur. J. Neurosci. 31, 2308–2319. doi: 10.1111/j.1460-9568.2010.07249.x
Moreira, C. M., Masson, S., Carvalho, M. C., and Brandão, M. L. (2007). Exploratory behaviour of rats in the elevated plus-maze is differentially sensitive to inactivation of the basolateral and central amygdaloid nuclei. Brain Res. Bull. 71, 466–474. doi: 10.1016/j.brainresbull.2006.10.004
Morris, R. G. (1975). Preconditioning of reinforcing properties to an exteroceptive feedback stimulus. Learn. Motiv. 6, 289–298. doi: 10.1016/0023-9690(75)90029-6
Morrison, S. E., Saez, A., Lau, B., and Salzman, C. D. (2011). Different time courses for learning-related changes in amygdala and orbitofrontal cortex. Neuron 71, 1127–1140. doi: 10.1016/j.neuron.2011.07.016
Morrison, S. E., and Salzman, C. D. (2011). Representations of appetitive and aversive information in the primate orbitofrontal cortex. Ann. N.Y. Acad. Sci. 1239, 59–70. doi: 10.1111/j.1749-6632.2011.06255.x
O'doherty, J. P., Dayan, P., Friston, K., Critchley, H., and Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron 38, 329–337. doi: 10.1016/S0896-6273(03)00169-7
Ono, T., Nishijo, H., and Uwano, T. (1995). Amygdala role in conditioned associative learning. Prog. Neurobiol. 46, 401–422. doi: 10.1016/0301-0082(95)00008-J
Ostlund, S. B., and Balleine, B. W. (2008). Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J. Neurosci. 28, 4398–4405. doi: 10.1523/JNEUROSCI.5472-07.2008
Ostroff, L. E., Cain, C. K., Bedont, J., Monfils, M. H., and Ledoux, J. E. (2010). Fear and safety learning differentially affect synapse size and dendritic translation in the lateral amygdala. Proc. Natl. Acad. Sci. 107, 9418–9423. doi: 10.1073/pnas.0913384107
Parkinson, J. A., Crofts, H. S., McGuigan, M., Tomic, D. L., Everitt, B. J., and Roberts, A. C. (2001). The role of the primate amygdala in conditioned reinforcment. J. Neurosci. 21, 7770–7780. Available online at: http://www.jneurosci.org/content/21/19/7770.full.pdf+html
Parkinson, J. A., Robbins, T. W., and Everitt, B. J. (2000). Dissociable roles of the central and basolateral amygdala in appetitive emotional learning. Eur. J. Neurosci. 12, 405–413. doi: 10.1046/j.1460-9568.2000.00960.x
Parkinson, J. A., Roberts, A. C., Everitt, B. J., and Di Ciano, P. (2005). Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus. Q. J. Exp. Psychol. B 58, 19–30. doi: 10.1080/02724990444000023
Paton, J. J., Belova, M. A., Morrison, S. E., and Salzman, C. D. (2006). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature 439, 865–870. doi: 10.1038/nature04490
Pearce, J. M., and Hall, G. (1980). A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol. Rev. 87, 532–552. doi: 10.1037/0033-295X.87.6.532
Pickens, C. L., Saddoris, M. P., Setlow, B., Gallagher, M., Holland, P. C., and Schoenbaum, G. (2003). Different roles for orbitofrontal cortex and basolateral amygdala in a reinforcer devaluation task. J. Neurosci. 23, 11078–11084. Available online at: http://www.jneurosci.org/content/23/35/11078.full.pdf+html
Pitkänen, A., Savander, V., and Ledoux, J. E. (1997). Organization of intra-amygdaloid circuitries in the rat: an emerging framework for understanding functions of the amygdala. Trends Neurosci. 20, 517–523. doi: 10.1016/S0166-2236(97)01125-9
Prensa, L., and Parent, A. (2001). The nigrostriatal pathway in the rat: a single-axon study of the relationship between dorsal and ventral tier nigral neurons and the striosome/matrix striatal compartments. J. Neurosci. 21, 7247–7260. Available online at: http://www.jneurosci.org/content/21/18/7247.full.pdf+html
Prévost, C., Liljeholm, M., Tyszka, J. M., and O'doherty, J. P. (2012). Neural correlates of specific and general pavlovian-to-instrumental transfer within human amygdalar subregions: a high-resolution fMRI study. J. Neurosci. 32, 8383–8390. doi: 10.1523/JNEUROSCI.6237-11.2012
Purgert, R. J., Wheeler, D. S., McDannald, M. A., and Holland, P. C. (2012). Role of amygdala central nucleus in aversive learning produced by shock or by unexpected omission of food. J. Neurosci. 32, 2461–2472. doi: 10.1523/JNEUROSCI.5090-11.2012
Quirk, G. J., Likhtik, E., Pelletier, J. G., and Paré, D. (2003). Stimulation of medial prefrontal cortex decreases the responsiveness of central amygdala output neurons. J. Neurosci. 23, 8800–8807. Available online at: http://www.jneurosci.org/content/23/25/8800.full.pdf+html
Rescorla, R. A., and Lolordo, V. M. (1965). Inhibition of avoidance behavior. J. Comp. Physiol. Psychol. 59, 406–412. doi: 10.1037/h0022060
Rescorla, R. A., and Wagner, A. R. (1972). “A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement,” in Classical Conditioning II: Current Research and Theory, eds A. H. Black and W. F. Prokasy (New York, NY: Appleton-Century-Crofts), 64–99.
Rizvi, T. A., Ennis, M., Behbehani, M. M., and Shipley, M. T. (1991). Connections between the central nucleus of the amygdala and the midbrain periaqueductal gray: topography and reciprocity. J. Comp. Neurol. 303, 121–131. doi: 10.1002/cne.903030111
Robbins, T. W., and Everitt, B. J. (2002). Limbic-striatal memory systems and drug addiction. Neurobiol. Learn. Mem. 78, 625–636. doi: 10.1006/nlme.2002.4103
Robledo, P., Robbins, T. W., and Everitt, B. J. (1996). Effects of excitotoxic lesions of the central amygdaloid nucleus on the potentiation of reward-related stimuli by intra-accumbens amphetamine. Behav. Neurosci. 110, 981–990. doi: 10.1037/0735-7044.110.5.981
Roesch, M. R., Calu, D. J., Esber, G. R., and Schoenbaum, G. (2010). Neural correlates of variations in event processing during learning in basolateral amygdala. J. Neurosci. 30, 2464–2471. doi: 10.1523/JNEUROSCI.5781-09.2010
Rogan, M. T., Leon, K. S., Perez, D. L., and Kandel, E. R. (2005). Distinct neural signatures for safety and danger in the amygdala and striatum of the mouse. Neuron 46, 309–320. doi: 10.1016/j.neuron.2005.02.017
Rolls, E. T. (1972). Activation of amygdaloid neurones in reward, eating and drinking elicited by electrical stimulation of the brain. Brain Res. 45, 365–381. doi: 10.1016/0006-8993(72)90468-4
Royer, S., Martina, M., and Paré, D. (1999). An inhibitory interface gates impulse traffic between the input and output stations of the amygdala. J. Neurosci. 19, 10575–10583.
Sangha, S., Chadick, J. Z., and Janak, P. H. (2013). Safety encoding in the basal amygdala. J. Neurosci. 33, 3744–3751. doi: 10.1523/JNEUROSCI.3302-12.2013
Schoenbaum, G., and Esber, G. R. (2010). How do you (estimate you will) like them apples? Cortical pathways to the mammalian amygdala. Curr. Opin. Neurobiol. 20, 205–211. doi: 10.1016/j.conb.2010.01.009
Schoenbaum, G., Setlow, B., Nugent, S. L., Saddoris, M. P., and Gallagher, M. (2003). Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals. Learn. Mem. 10, 129–140. doi: 10.1101/lm.55203
Siebert, M., Markowitsch, H. J., and Bartel, P. (2003). Amygdala, affect and cognition: evidence from 10 patients with Urbach-Wiethe disease. Brain 126, 2627–2637. doi: 10.1093/brain/awg271
Stalnaker, T. A., Franz, T. M., Singh, T., and Schoenbaum, G. (2007). Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54, 51–58. doi: 10.1016/j.neuron.2007.02.014
Swanson, L. W. (1982). The projections of the ventral tegmental area and adjacent regions: a combined fluorescent retrograde tracer and immunofluorescence study in the rat. Brain Res. Bull. 9, 321–353. doi: 10.1016/0361-9230(82)90145-9
Swanson, L. W., and Petrovich, G. D. (1998). What is the amygdala? Trends Neurosci. 21, 323–331. doi: 10.1016/S0166-2236(98)01265-X
Turner, B. H., and Herkenham, M. (1991). Thalamoamygdaloid projections in the rat: a test of the amygdala's role in sensory processing. J. Comp. Neurol. 313, 295–325. doi: 10.1002/cne.903130208
Tye, K. M., and Janak, P. H. (2007). Amygdala neurons differentially encode motivation and reinforcement. J. Neurosci. 27, 3937–3945. doi: 10.1523/JNEUROSCI.5281-06.2007
Ungerstedt, U. (1971). Stereotaxic mapping of the monoamine pathways in the rat brain. Acta Physiol. Scand. Suppl. 367, 1–48.
Uwano, T., Nishijo, H., Ono, T., and Tamura, R. (1995). Neuronal responsiveness to various sensory stimuli, and associative learning in the rat amygdala. Neuroscience 68, 339–361. doi: 10.1016/0306-4522(95)00125-3
Vertes, R. P. (2004). Differential projections of the infralimbic and prelimbic cortex in the rat. Synapse 51, 32–58. doi: 10.1002/syn.10279
Weiskrantz, L. (1956). Behavioral changes associated with ablation of the amygdaloid complex in monkeys. J. Comp. Physiol. Psychol. 49, 381–391. doi: 10.1037/h0088009
Weisman, R. G., and Litner, J. S. (1969). The course of Pavlovian excitation and inhibition of fear in rats. J. Comp. Physiol. Psychol. 69, 667–672. doi: 10.1037/h0028213
Whitelaw, R. B., Markou, A., Robbins, T. W., and Everitt, B. J. (1996). Excitotoxic lesions of the basolateral amygdala impair the acquisition of cocaine-seeking behaviour under a second-order schedule of reinforcement. Psychopharmacology 127, 213–224.
Wilensky, A. E., Schafe, G. E., Kristensen, M. P., and Ledoux, J. E. (2006). Rethinking the fear circuit: the central nucleus of the amygdala is required for the acquisition, consolidation, and expression of pavlovian fear conditioning. J. Neurosci. 26, 12387–12396. doi: 10.1523/JNEUROSCI.4316-06.2006
Yun, I. A., and Fields, H. L. (2003). Basolateral amygdala lesions impair both cue- and cocaine-induced reinstatement in animals trained on a discriminative stimulus task. Neuroscience 121, 747–757. doi: 10.1016/S0306-4522(03)00531-1
Zahm, D. S., Jensen, S. L., Williams, E. S., and Martin Iii, J. R. (1999). Direct comparison of projections from the central amygdaloid region and nucleus accumbens shell. Eur. J. Neurosci. 11, 1119–1126. doi: 10.1046/j.1460-9568.1999.00524.x
Keywords: amygdala, appetitive and aversive conditioning, memory, pavlovian, corticostriatal pathway
Citation: Fernando ABP, Murray JE and Milton AL (2013) The amygdala: securing pleasure and avoiding pain. Front. Behav. Neurosci. 7:190. doi: 10.3389/fnbeh.2013.00190
Received: 19 July 2013; Accepted: 18 November 2013;
Published online: 06 December 2013.
Edited by:
Rutsuko Ito, University of Toronto, CanadaReviewed by:
Cedric Williams, University of Virginia, USAEddy A. van der Zee, University of Groningen, Netherlands
Copyright © 2013 Fernando, Murray and Milton. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Amy L. Milton, Department of Psychology, University of Cambridge, Downing Site, Cambridge, CB2 3EB, UK e-mail: alm46@cam.ac.uk