Roeland F. Struik
Taco J. De Vries
Jamie Peters- 1Department of Anatomy & Neurosciences, Amsterdam Neuroscience, VU University Medical Center, Amsterdam, Netherlands
- 2Department of Anesthesiology, University of Colorado School of Medicine, Anschutz Medical Campus, Aurora, CO, United States
Retrieval-extinction memory reactivation procedures have been used to prevent the return of learned fear and drug seeking in preclinical models. These procedures first reactivate the original memory with a brief cue exposure (i.e., retrieval) session, and then disrupt memory reconsolidation by conducting extinction training within the reconsolidation window. The original memory is thought to be updated with the new information conveyed by extinction learning, resulting in a persistent therapeutic effect beyond that observed with extinction training alone (i.e., no retrieval). Here, we attempted to replicate the therapeutic effects on cocaine seeking reported by Xue et al. (2012), and extend these findings to nicotine seeking. Rats self-administered either cocaine or nicotine with contingent cues for weeks, and were then divided into two groups. The retrieval group underwent a 10-min retrieval session wherein drug cues were available, but drug was not. Ten minutes later, they were allowed to continue cue extinction training for an additional 60 min. The no retrieval group underwent a contiguous 70-min cue extinction session. These procedures continued for weeks, followed by a test for spontaneous recovery of drug seeking. No group differences were observed on any measure of cocaine seeking, although both groups exhibited extinction and spontaneous recovery. By contrast, for nicotine seeking, the retrieval group exhibited resistance to extinction, an effect that persisted on the spontaneous recovery test. These findings underscore the importance of drug type in the outcome of retrieval-extinction procedures and moreover indicate that retrieval-extinction procedures can be detrimental to nicotine seeking.
Introduction
Cue exposure therapy has been used clinically in the treatment of both pathological fear and substance use disorders (Kaplan et al., 2010). During these behavioral therapy sessions, patients are typically repeatedly presented with visual, auditory, and/or tactile cues associated with the fear or drug memory, and over time learn to dissociate the cues from the feelings/cravings they induce. This learning process is referred to as extinction, and the pathological emotional and/or behavioral response is extinguished through the formation of a novel therapeutic memory trace (Quirk and Mueller, 2007). Unfortunately, extinction therapy has not been very effective on its own, especially for addiction treatment (Niaura et al., 1999; Kantak and Nic Dhonnchadha, 2011; Hone-Blanchet et al., 2014). An alternative approach is to attempt to weaken or erase the original memory associated with conditioned drug cues through a process of reconsolidation blockade (Taylor et al., 2008; Torregrossa and Taylor, 2012).
Reconsolidation is the process whereby memories enter into a labile state upon retrieval, typically by presentation of reminder cues (Schwabe et al., 2014). Once the memory enters this labile state, it is subject to disruption by pharmacological agents such as protein synthesis inhibitors (Nader et al., 2000; Tronson and Taylor, 2007). If the memory is disrupted during this sensitive period, it can be permanently weakened, even erased, along with the pathological behavioral response that is the goal of treatment (Soeter and Kindt, 2011). Unfortunately, protein synthesis inhibitors like anisomycin and related pharmacological tools for reconsolidation blockade cannot be administered systemically in humans due to toxicity, although some success has been demonstrated with the beta adrenergic receptor antagonist propranolol in both fear as well as cocaine and nicotine addiction disorders (Soeter and Kindt, 2010; Otis and Mueller, 2011; Saladin et al., 2013; Xue et al., 2017). Circumventing the need for such pharmacological approaches, Monfils et al. (2009) made a revolutionary discovery that memory reconsolidation could be disrupted by purely behavioral means.
Monfils et al. (2009) demonstrated that simply conducting extinction training, an extended cue exposure session, after brief fear memory retrieval was sufficient to disrupt the fear memory and prevent the return of fear. This procedure is thought to update the original fear memory with the “safety” memory learned during extinction, while the original memory is undergoing reconsolidation (Monfils et al., 2009; Quirk et al., 2010). Since this original report, many others have observed similar therapeutic effects of such retrieval-extinction memory reactivation procedures on fear, including translational work in humans (Quirk et al., 2010; Schiller et al., 2010; Flavell et al., 2011). However, others have reported null effects and/or challenged the notion that reconsolidation is necessary for the observed behavioral outcomes (Chan et al., 2010; Costanzi et al., 2011; Kindt and Soeter, 2013). Corroborating and conflicting reports have been reported for aversive and appetitive behaviors, in both preclinical and clinical settings (Flavell et al., 2011; Ma et al., 2012; Auber et al., 2013; Kredlow et al., 2016; Elsey et al., 2018), making the retrieval-extinction procedure one of the most controversial therapies with high treatment potential for multiple neuropsychiatric disorders.
In a seminal article by Xue et al. (2012), the retrieval-extinction memory reactivation procedure was adapted and applied to preclinical models of drug self-administration. Addiction, unlike fear, develops gradually over a prolonged period of drug exposure. Similarly, extinction learning typically requires repetitive training to extinguish the drug-seeking response. Thus, Xue et al. (2012) conducted daily retrieval-extinction sessions over a period of weeks, each with a brief retrieval (i.e., extinction) session separated from a longer extinction session by a 10 min interval. In cocaine-seeking animals, these procedures successfully facilitated the rate of extinction and reduced cocaine-primed reinstatement, renewal, and spontaneous recovery after a 28-day abstinence period. They also demonstrated that the therapeutic effect on drug-primed reinstatement extended to heroin-seeking animals, and were able to further extend their findings to human heroin users, using a similar 10-min interval between retrieval and extinction of visual heroin cues in a clinical setting (Xue et al., 2012).
Given the striking efficacy of these retrieval-extinction procedures across drug classes and from preclinical to clinical paradigms, we designed experiments with two goals: (1) to replicate these findings in cocaine-seeking animals; and (2) to extend these findings to nicotine-seeking animals. Nicotine conditioned cues are unique in that they are necessary and sufficient to sustain nicotine-seeking, even in the absence of nicotine (Caggiula et al., 2001; Cohen et al., 2005; Liu et al., 2008). Nonetheless, cue-maintained responding of nicotine-seeking can be extinguished and reduces withdrawal-related incubation of craving in preclinical abstinence models (Markou et al., 2018). Thus, retrieval-extinction procedures could be especially beneficial for reducing relapse associated with exposure to nicotine cues. Preliminary success has been reported using retrieval-extinction procedures to reduce nicotine seeking in a preclinical model in rats (Auber et al., 2014), as well as a recent clinical study in human smokers (Germeroth et al., 2017).
Materials and Methods
Subjects
Male Wistar rats (n = 48) obtained from Harlan CPB (Horst, The Netherlands), weighing between 280 and 300 grams on arrival, were housed in a temperature (21 ± 1°C) and humidity-controlled room (55 ± 15%) on a reverse 12 h diurnal schedule (lights off: 07:00; lights on: 19:00). Food and water was available ad libitum in the home cage. All experimental procedures were performed during the dark phase of the cycle. Animals were initially kept in pairs but were housed individually following surgery in Makrolon type III cages. Experiments and procedures were approved by the Animal Experiments Committee of the VU University, Amsterdam, The Netherlands.
Surgery
Intravenous catheter surgeries were performed to allow drug self-administration. Catheters were assembled from a cannula connector pedestal (Plastics One Inc., Minneapolis, MN, USA) connected to a 95 mm silicone catheter (0.3 mm inner diameter × 0.6 mm outer diameter) and a 6 mm protective sleeve of polyethylene tubing (0.75 mm inner diameter × 1.45 mm outer diameter). Following arrival, rats were habituated to the animal facility for 1 week. The surgical procedure was executed as reported previously (De Vries et al., 1999) under isoflurane gas anesthesia. Thirty minutes before surgery, rats were injected with the analgesic Ketofen (5 mg/kg; Merial, Velserbroek, The Netherlands) and the antibiotic Baytril (8.33 mg/kg; Bayer, Mijdrecht, The Netherlands). The local anesthetic 2% Xylocaine with adrenaline (10 mg/kg; Astra Zeneca, Zoetermeer, The Netherlands) was injected in the scalp, after which the skull was exposed and four burr holes were drilled and fitted with jeweler’s screws. Catheter tubing was tunneled from the scalp to an incision above the clavicle, where the catheter was inserted in the jugular vein and fixed in place using sterile sutures. A combination of 0.05 ml taurolidine-citrate solution (TCS; Access Technologies, Skokie, IL, USA) and a polyethylene cap was used to maintain catheter patency during the 1 week minimum period of recovery.
Drugs
Cocaine (cocaine hydrochloride, OPG, Utrecht, The Netherlands) or nicotine (nicotine hydrogen tartrate salt, Sigma, St. Louis, MO, USA) was dissolved in sterile saline, and the pH of the solution was adjusted to 7.4 using sodium hydroxide solution. Both cocaine and nicotine solutions were sterilized through a 0.22 μm filter before self-administration.
Summary of Experimental Timeline
Following at least 1 ‘week of recovery from surgery, rats were trained to self-administer either cocaine or nicotine over a period of 16 sessions (60 min/weekday). Extinction or retrieval-extinction sessions were conducted over a period of 16 days (70 min/weekday). Animals were then placed in their home cage for 34 days of abstinence, followed by a spontaneous recovery test session (60 min).
Drug Self-administration
Rats were allowed to self-administer either cocaine or nicotine inside plexiglass operant chambers housed within sound-attenuating cubicles. Programs were executed using MED-PC hardware and software (Med Associates Inc., St. Albans, VT, USA). These operant chambers contained a fan for ventilation, two nose-poke holes, a red house light, a tone generator, a liquid swivel arm with polyethylene tubing protected by a metal spring and an infusion pump. Responding in the active nose-poke hole resulted in a drug infusion and presentation of a 15-s cue consisting of yellow light inside the nose-poke hole and a 3.5 kHz tone. For 15 s following a nose-poke in the active hole, responding in either the active or inactive nose-poke hole was without consequence (i.e., timeout period). Cocaine (500 μg/kg/infusion) or nicotine (40 μg/kg/infusion) was infused at a rate of 21 μl/s over 2 s. Responding in the inactive nose-poke hole had no effect, but was recorded.
Animals were first trained to self-administer nicotine or cocaine on a FR1 schedule for 10 daily sessions, followed by three sessions on an FR2 and three sessions on an FR4, for a total of 16 nicotine or cocaine self-administration sessions (each 60 min). To reduce cocaine overdose, the maximum number of rewards was set to 60 during the first six cocaine self-administration sessions. Catheter patency was maintained through a daily regimen of flushing catheters with a 0.05 ml solution of heparin (0.25 mg/ml) and gentamicin sulfate salt (0.08 mg/ml). At the end of the self-administration phase, catheter patency was tested by infusing 0.05 ml of the intravenous anesthetic thiopental sodium (50 mg/ml). Two rats were excluded from the cocaine experiment due to failed catheter patency, and one animal was excluded due to cocaine overdose.
Retrieval and Extinction
Twenty-four hours following the final self-administration session, cocaine or nicotine rats were assigned to extinction vs. retrieval-extinction groups (total active and total inactive responding was counterbalanced between groups) and responding was extinguished during 16 daily (weekday) sessions of 70 min. During these sessions, the house light was turned on; cocaine or nicotine was unavailable, but response-contingent drug-conditioned cues were presented on an FR4 schedule of reinforcement. On each training day, the retrieval-extinction group was first placed in the operant chamber for a retrieval session of 10 min (Ret), then returned to their respective home cages for 10 min (Home). Afterward, rats were returned to the operant chamber for an additional 60 min of extinction training (Ext), which concluded the total daily training duration of 70 min. The extinction group was simply placed in the operant chamber for a contiguous 70 min training session without retrieval (No Ret). The first and second training days always occurred consecutively (i.e., no weekend gap). Following 16 training sessions, animals remained in their home cage for 34 days of abstinence.
Spontaneous Recovery
Following 34 days of home-cage abstinence, animals were returned to the operant chamber for a test of spontaneous recovery. This test was performed under extinction conditions (response-contingent drug cues presented on an FR4 schedule, drug unavailable) and lasted 60 min.
Statistical Analyses
Behavioral data were analyzed using two-way repeated measures ANOVAs with experimental group as a between-subject factor and both session and nose poke as a within-subject factor. One cocaine rat was excluded due to high inactive nose pokes (>2 standard deviations from mean) during self-administration. Sidak’s post hoc comparisons were conducted when a significant interaction was observed. In some cases, one-way repeated measures ANOVAs were conducted to determine whether significant extinction occurred (for details, see “Results” section).
Results
Animals Successfully Acquired Nicotine or Cocaine Seeking
Other than drug type, self-administration protocols for nicotine- vs. cocaine-seeking rats were identical. An increasing FR protocol was used to enhance rates of drug seeking and to verify successful acquisition of drug self-administration. Main effects of session were observed for both nicotine (Figure 1A) and cocaine (Figure 1B; nicotine: F(4.71,103.62) = 30.33, p < 0.001; cocaine: F(3.02,54.41) = 13.60, p < 0.001), as well as main effects of nose poke (active vs. inactive; nicotine: F(1,22) = 201.16, p < 0.001; cocaine: F(1,18) = 82.33, p < 0.001), and session * nose poke interactions (nicotine: F(4.68,103.07) = 28.02, p < 0.001; cocaine: F(3.45,62.19) = 16.81, p < 0.001). Whereas active nose pokes increased over sessions, inactive pokes decreased, indicating successful acquisition of drug seeking for both reinforcers. No group differences were detected, indicating that animals were appropriately balanced upon assignment to retrieval vs. no retrieval experimental groups.
Figure 1. Self-administration of nicotine vs. cocaine. Nicotine (A) and cocaine (B) self-administration was conducted in daily sessions over weeks on an increasing FR schedule. Total active (circles) and inactive (triangles) lever presses on each daily session are depicted. Both retrieval (Ret) and no retrieval (No Ret) groups acquired drug seeking over days, and group assignments were appropriately matched on response rates (Nicotine Ret: n = 12; Nicotine No ret: n = 12; Cocaine Ret: n = 11; Cocaine No Ret: n = 9). All data are mean ± SEM.
Both Nicotine and Cocaine Seeking Extinguish Over the Course of Repeated Retrieval
After acquisition of drug self-administration, animals were assigned to experimental groups. The retrieval group underwent the first 10 min of extinction, then returned to the home cage for 10 min, and then completed the last 60 min of extinction. The no retrieval group underwent a contiguous 70 min extinction session. Both groups received response-contingent drug cues on an FR4 schedule, but no drug (for details, see “Materials and Methods” section). Main effects of session were observed for both nicotine (Figure 2A) and cocaine (Figure 2B) during the first 10 min of retrieval or no retrieval (nicotine: F(5.92,130.32) = 29.26, p < 0.001; cocaine: F(4.89,87.95) = 14.74, p < 0.001), indicating successful extinction of drug seeking. Main effects of nose poke (nicotine: F(1,22) = 139.95, p < 0.001; cocaine: F(1,18) = 47.44, p < 0.001) and session * nose poke interactions (nicotine: F(5.23,115.14) = 20.16, p < 0.001; cocaine: F(3.95,71.10) = 7.91, p < 0.001) were observed for both drugs as well. No group differences were detected.
Figure 2. Drug seeking during the first 10 min of retrieval or no retrieval. Nicotine (A) and cocaine (B) seeking during retrieval vs. no retrieval. Total active (circles) and inactive (triangles) lever presses during the first 10 min of each daily retrieval-extinction session are depicted. Both retrieval (Ret) and no retrieval (No Ret) groups exhibited extinction over days, but there were no group differences (Nicotine Ret: n = 12; Nicotine No ret: n = 12; Cocaine Ret: n = 11; Cocaine No Ret: n = 9). All data are mean ± SEM.
Retrieval Impairs Extinction of Nicotine, but Not Cocaine, Seeking
Analyses conducted over the last 60 min of extinction similarly revealed main effects of session for both nicotine (Figure 3A) and cocaine (Figure 3B; nicotine: F(4.71,103.55) = 5.71, p < 0.001; cocaine: F(6.21,111.85) = 9.44, p < 0.001), indicating successful extinction of drug seeking. Main effects of nose poke were found (nicotine: F(1,22) = 96.36, p < 0.001; cocaine: F(1,18) = 107.64, p < 0.001) as well as session * nose poke interactions (nicotine: F(4.77,104.84) = 3.48, p = 0.007; cocaine: F(6.00,107.97) = 6.64, p < 0.001) for both drugs. However, a main effect of group was also detected for nicotine seeking (F(1,22) = 11.42, p = 0.003) as well as a nose poke * group interaction (F(1,22) = 4.42, p = 0.047), indicating nicotine seeking was higher in the retrieval group than in the no retrieval group. To determine whether groups showed equivalent extinction over days, one-way repeated measures ANOVAs were conducted on active nose pokes. A main effect of session was detected in the no retrieval group (F(1,15) = 4.67, p = 0.001), but not the retrieval group (F(1,15) = 1.92, p = 0.150), suggesting that extinction was impaired in the retrieval group.
Figure 3. Drug seeking during the last 60 min of extinction. Nicotine (A) and cocaine (B) seeking during extinction. Total active (circles) and inactive (triangles) lever presses during the last 60 min of each daily extinction session are depicted. Both nicotine and cocaine-seeking animals exhibited extinction over days, but only nicotine-seeking animals showed a main effect of group. Nicotine-seeking in the retrieval (Ret) group was significantly higher than in the no retrieval (No Ret) group (Nicotine Ret: n = 12; Nicotine No ret: n = 12; Cocaine Ret: n = 11; Cocaine No Ret: n = 9). All data are mean ± SEM. **p < 0.01 main effect of group.
Retrieval Promotes Spontaneous Recovery of Nicotine, but Not Cocaine, Seeking
To assess the effects of the retrieval-extinction procedure on spontaneous recovery of drug seeking, the last 60 min of extinction training (on the last extinction session) was compared to responding after 34 days of abstinence during the spontaneous recovery test (also 60 min). Main effects of session were observed for both nicotine (Figure 4A) and cocaine (Figure 4B; nicotine: F(1,22) = 36.39, p < 0.001; cocaine: F(1,18) = 68.39, p < 0.001) as well as main effects of nose poke (nicotine: F(1,22) = 106.11, p < 0.001; cocaine: F(1,18) = 146.99, p < 0.001) and session * nose poke interactions (nicotine: F(1,22) = 34.52, p < 0.001; cocaine: F(1,18) = 71.84, p < 0.001), indicating spontaneous recovery of drug seeking. Additionally, a main effect of group (F(1,22) = 6.66, p = 0.017) and nose poke * group interaction (F(1,22) = 6.35, p = 0.020) was detected for nicotine seeking, indicating nicotine seeking was higher in the retrieval group than in the no retrieval group. No group differences were observed for cocaine. Thus, the retrieval-extinction procedure promoted nicotine seeking during both extinction and spontaneous recovery, but did not alter cocaine seeking.
Figure 4. Spontaneous recovery of drug seeking after abstinence. Nicotine (A) and cocaine (B) seeking at the end of extinction (Ext) training vs. the spontaneous recovery test (Test). Total active (circles) and inactive (triangles) lever presses during the last 60 min of Ext is depicted, next to responding on the 60 min Test. Both cocaine- and nicotine-seeking animals exhibited spontaneous recovery. Nicotine-seeking in the retrieval (Ret) group was significantly higher than in the no retrieval (No Ret) group (Nicotine Ret: n = 12; Nicotine No ret: n = 12; Cocaine Ret: n = 11; Cocaine No Ret: n = 9). All data are mean ± SEM. *p < 0.05 main effect of group.
Discussion
This study revealed a heretofore unreported and paradoxical detrimental effect of retrieval-extinction memory reactivation procedures on extinction of nicotine seeking, concomitant with enhanced spontaneous recovery of nicotine seeking. To our knowledge, this is the first report of detrimental effects using a standard retrieval-extinction procedure on any conditioned behavior. Others have reported null effects of the retrieval-extinction procedure (Chan et al., 2010; Costanzi et al., 2011), similar to our findings on cocaine seeking reported here. Ma et al. (2012) reported detrimental effects of retrieval-extinction on morphine conditioned place preference (i.e., enhanced spontaneous recovery), but only with a very long interval between retrieval and extinction (3 h) which is outside the expected reconsolidation window, and could have interfered with extinction memory consolidation (Tronson and Taylor, 2007; Monfils et al., 2009). Millan et al. (2013) reported enhanced reacquisition of alcohol seeking and increased motivation to seek alcohol under progressive ratio schedules after an inverted extinction-retrieval procedure (i.e., extinction first, then retrieval), but this same procedure also reduced context-induced reinstatement of alcohol seeking (Millan et al., 2013). The latter study underscores the possibility that similar behavioral manipulations can be both therapeutic and detrimental, depending on the outcome measure. Here, we chose to focus on spontaneous recovery of drug seeking because this allowed us to specifically examine the effects of retrieval-extinction on long-term drug seeking triggered by the conditioned drug cues (tone + light). In addition, spontaneous recovery is a commonly used outcome measure for the efficacy of retrieval-extinction procedures (Monfils et al., 2009; Flavell et al., 2011; Ma et al., 2012; Xue et al., 2012; Kredlow et al., 2016).
In this study, we compared behavioral effects of retrieval-extinction procedures using two different reinforcers, nicotine and cocaine. Despite their different pharmacological mechanisms of action, both drugs result in an accumulation of dopamine in the nucleus accumbens during drug exposure, which is thought to underlie their rewarding and reinforcing effects (Balfour et al., 2000; Fadda et al., 2003; Dong et al., 2013). Dopamine is also important for encoding drug-conditioned cue associations, and over time with repeated drug use, these cues acquire incentive salience and the ability to promote, or sustain, drug seeking even under extinction conditions (i.e., when drug is no longer available; Bevins and Palmatier, 2004).
Drug-conditioned cues are essential for memory reactivation during retrieval, and the ability of memory reactivation to trigger reconsolidation is thought to be a critical determinant of retrieval-extinction therapeutic efficacy (Auber et al., 2013; Olshavsky et al., 2013). That is, the reconsolidation process must be initiated during retrieval in order for memory-updating to occur during the subsequent extinction phase (Monfils et al., 2009). The duration of retrieval session (10 min) in the present study was comparable to other studies that have demonstrated therapeutic success with retrieval-extinction procedures (Flavell et al., 2011; Xue et al., 2012). Nonetheless, it is possible that we failed to trigger reconsolidation with our protocol. Given that the ability to induce reconsolidation is inversely related to the strength of the memory trace (Eisenberg et al., 2003; Tronson and Taylor, 2007), the cue memories for cocaine and nicotine might have been particularly strong in our paradigm. Because retrieval-extinction produced an effect, albeit a detrimental one, in nicotine rats, another explanation is that reconsolidation was effectively triggered, and extinction training paradoxically strengthened the retrieved cue memory.
In line with the latter interpretation, retrieval impaired extinction of nicotine seeking. This extinction impairment must be attributed to the retrieval-extinction procedure since extinction success was observed in the contiguous extinction group. Thus, retrieval-extinction induces extinction failure in nicotine rats under these conditions. Why might this occur? There are some notable distinctions in nicotine-conditioned cues that are worth considering. Whereas nicotine alone is a relatively weak reinforcer, it is very effective at enhancing the incentive salience, and reinforcing properties, of cues paired with nicotine (Chaudhri et al., 2006; Caggiula et al., 2009). In rats that acquire nicotine self-administration paired with conditioned cues similar to the ones used in the present study, cessation of the nicotine conditioned-cue availability leads to faster extinction than cessation of nicotine availability (Caggiula et al., 2001). Furthermore, acquisition of nicotine self-administration is impaired if such nicotine conditioned cues are never available (Caggiula et al., 2002; Cohen et al., 2005).
The aforementioned findings have led some to propose that nicotine-seeking behavior is primarily maintained not by nicotine itself but by its ability to enhance the reinforcing properties of both pharmacological and non-pharmacological (i.e., cues) stimuli (Chaudhri et al., 2006; Caggiula et al., 2009). This hypothesis is supported by observations that rats will respond more for cues in the presence of nicotine, even when the cues and nicotine are self-administered on separate levers (Palmatier et al., 2006). Cocaine, by contrast, is a much more powerful primary reinforcer (Risner and Goldberg, 1983), and rats will readily acquire cocaine self-administration in the absence of cocaine-associated cues (Fuchs et al., 2006). The relative importance of the drug-conditioned cues vs. the primary reinforcer (nicotine vs. cocaine) may thus be a key factor in the differences we observed with the retrieval-extinction procedure (Bevins and Palmatier, 2004). The greater ability of nicotine-conditioned cues to sustain nicotine seeking may have resulted in a paradoxical updating of the memory with “sustained seeking” as opposed to “extinction” memory trace.
We observed enhanced spontaneous recovery and impaired extinction after retrieval-extinction procedures in nicotine, but not cocaine rats. It is important to note, however, that the increase in spontaneous recovery may be attributed, at least in part, to the extinction failure induced by retrieval-extinction in nicotine rats. Because we were unable to fully extinguish nicotine seeking after retrieval-extinction, the two experimental groups (Ret vs. No Ret) were tested for spontaneous recovery despite their pre-existing difference in extinction baseline. Additional experiments are necessary to determine whether the Ret group would eventually extinguish nicotine seeking to levels achieved in the No Ret group and if spontaneous recovery would remain elevated in the Ret group under such circumstances. Furthermore, additional studies should extend these findings to other measures of nicotine seeking, such as renewal, reinstatement (e.g., after a nicotine priming injection), and reacquisition of nicotine seeking.
The lack of effect of retrieval-extinction procedures on cocaine seeking differs from that reported by Xue et al. (2012). Retrieval-extinction enhanced the rate of extinction of cocaine seeking, although the magnitude of this effect differed across three independent experiments. In each experiment, however, retrieval-extinction procedures attenuated the reinstatement, renewal, or spontaneous recovery of cocaine seeking. This was in contrast to the complete blockade of cocaine conditioned place preference, which relies on purely Pavlovian drug-cue associations. Indeed, there is some evidence that operant, response-outcome memories may be less prone to undergo reconsolidation (Hernandez and Kelley, 2004). However, even well-trained instrumental behaviors have been shown to undergo reconsolidation (Exton-McGuinness et al., 2014), including nicotine- and cocaine-seeking (Tedesco et al., 2014; Sorg et al., 2015). It is also worth noting that the unconditioned stimulus, nicotine or cocaine itself, can be an effective trigger for reconsolidation (Xue et al., 2017; Zhu et al., 2018), although we did not employ this strategy in the present study. Other potential differences that could account for the apparent discrepancy between this study and Xue et al. (2012) include the cocaine-taking history of the animals, cocaine dose, duration of abstinence, training schedule of reinforcement, and duration of cue presentations and extinction sessions. Clearly, more work is needed to fully understand the boundary conditions limiting the efficacy of retrieval-extinction procedures.
Though the retrieval-extinction procedures used in the present study induced unexpected increases in nicotine seeking, some positive outcomes have been reported using other retrieval-extinction procedures in rats (Auber et al., 2014) and human smokers (Germeroth et al., 2017). In contrast with the present study, which used response-contingent nicotine cues during retrieval in the same context where nicotine was taken, both of the aforementioned studies used non-contingent (i.e., passive) nicotine-cue exposures during the retrieval phase, and retrieval was conducted in a context that was different from the one where nicotine was taken (Auber et al., 2014; Germeroth et al., 2017). Interestingly, Xue et al. (2017) used nicotine (as opposed to nicotine cues) to trigger retrieval and was able to demonstrate reductions in nicotine seeking in rats, as well as nicotine craving in human smokers after disrupting reconsolidation with propranolol. Germeroth et al. (2017) observed both reductions in craving in response to nicotine cues after retrieval-extinction, as well as a reduction in the average number of cigarettes smoked per day over a 2-week and 1-month follow up. However, retrieval-extinction did not alter physiological responses to nicotine cues, relapse, or days abstinent (Germeroth et al., 2017). Thus, certain components of the nicotine memory may be more receptive to retrieval-extinction therapy than others, and the method in which retrieval is triggered may be an important variable. While it may be possible to weaken some aspects of the nicotine memory, our data suggest it is also possible to strengthen nicotine seeking with retrieval-extinction under certain conditions.
These findings add to a growing literature indicating highly variable effects of retrieval-extinction procedures across both preclinical and clinical models (Auber et al., 2013; Kindt and Soeter, 2013; Millan et al., 2013). Future work should continue with a careful examination of the boundary conditions determining the outcome of these memory reactivation procedures, which were originally identified as therapeutic (Monfils et al., 2009; Schiller et al., 2010). We hypothesize that the detrimental effects of retrieval-extinction procedures on nicotine seeking may be due to the fact that nicotine-associated cues are so essential to the reinforcing properties of nicotine, perhaps even more than nicotine itself (Caggiula et al., 2001; Bevins and Palmatier, 2004; Palmatier et al., 2006). Given the high rates of smoking and vaping nicotine amongst people who abuse psychostimulants and other substances (Tzilos et al., 2016; Temple et al., 2017), the implementation of retrieval-extinction procedures in humans should be undertaken with great care.
Data Availability Statement
All datasets generated for this study are included in the manuscript.
Ethics Statement
The animal study was reviewed and approved by the Animal Experiments Committee of the VU University, Amsterdam, The Netherlands.
Author Contributions
RS, JP, and TV designed the experiments, interpreted the data, contributed intellectually to the project, edited and finalized the manuscript. RS and JP drafted the manuscript. RS acquired and analyzed the data.
Funding
This work was supported by Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO) grants 91611035 (Veni) to JP and ZonMW Top grant 91209005 to TV.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Yvar van Mourik, Dustin Schetters, Rob Binnekade, and Josefien DeDoncker for their helpful technical and behavioral support, as well as OPG (Utrecht, The Netherlands) for supplying the cocaine.
References
Auber, A., Muthu Karuppasamy, N. S., Pedercini, M., Bertoglio, D., Tedesco, V., and Chiamulera, C. (2014). The effect of postretrieval extinction of nicotine pavlovian memories in rats trained to self-administer nicotine. Nicotine Tob. Res. 16, 1599–1605. doi: 10.1093/ntr/ntu110
Auber, A., Tedesco, V., Jones, C. E., Monfils, M. H., and Chiamulera, C. (2013). Post-retrieval extinction as reconsolidation interference: methodological issues or boundary conditions? Psychopharmacology 226, 631–647. doi: 10.1007/s00213-013-3004-1
Balfour, D. J., Wright, A. E., Benwell, M. E., and Birrell, C. E. (2000). The putative role of extra-synaptic mesolimbic dopamine in the neurobiology of nicotine dependence. Behav. Brain Res. 113, 73–83. doi: 10.1016/s0166-4328(00)00202-3
Bevins, R. A., and Palmatier, M. I. (2004). Extending the role of associative learning processes in nicotine addiction. Behav. Cogn. Neurosci. Rev. 3, 143–158. doi: 10.1177/1534582304272005
Caggiula, A. R., Donny, E. C., Palmatier, M. I., Liu, X., Chaudhri, N., and Sved, A. F. (2009). The role of nicotine in smoking: a dual-reinforcement model. Nebr. Symp. Motiv. 55, 91–109. doi: 10.1007/978-0-387-78748-0_6
Caggiula, A. R., Donny, E. C., White, A. R., Chaudhri, N., Booth, S., Gharib, M. A., et al. (2001). Cue dependency of nicotine self-administration and smoking. Pharmacol. Biochem. Behav. 70, 515–530. doi: 10.1016/s0091-3057(01)00676-1
Caggiula, A. R., Donny, E. C., White, A. R., Chaudhri, N., Booth, S., Gharib, M. A., et al. (2002). Environmental stimuli promote the acquisition of nicotine self-administration in rats. Psychopharmacology 163, 230–237. doi: 10.1007/s00213-002-1156-5
Chan, W. Y., Leung, H. T., Westbrook, R. F., and McNally, G. P. (2010). Effects of recent exposure to a conditioned stimulus on extinction of Pavlovian fear conditioning. Learn. Mem. 17, 512–521. doi: 10.1101/lm.1912510
Chaudhri, N., Caggiula, A. R., Donny, E. C., Palmatier, M. I., Liu, X., and Sved, A. F. (2006). Complex interactions between nicotine and nonpharmacological stimuli reveal multiple roles for nicotine in reinforcement. Psychopharmacology 184, 353–366. doi: 10.1007/s00213-005-0178-1
Cohen, C., Perrault, G., Griebel, G., and Soubrié, P. (2005). Nicotine-associated cues maintain nicotine-seeking behavior in rats several weeks after nicotine withdrawal: reversal by the cannabinoid (CB1) receptor antagonist, rimonabant (SR141716). Neuropsychopharmacology 30, 145–155. doi: 10.1038/sj.npp.1300541
Costanzi, M., Cannas, S., Saraulli, D., Rossi-Arnaud, C., and Cestari, V. (2011). Extinction after retrieval: effects on the associative and nonassociative components of remote contextual fear memory. Learn. Mem. 18, 508–518. doi: 10.1101/lm.2175811
De Vries, T. J., Schoffelmeer, A. N. M., Binnekade, R., and Vanderschuren, L. J. M. J. (1999). Dopaminergic mechanisms mediating the incentive to seek cocaine and heroin following long-term withdrawal of IV drug self-administration. Psychopharmacology 143, 254–260. doi: 10.1007/s002130050944
Dong, Y., Dani, J. A., and Blakely, R. D. (2013). Choline transporter hemizygosity results in diminished basal extracellular dopamine levels in nucleus accumbens and blunts dopamine elevations following cocaine or nicotine. Alcohol 86, 1084–1088. doi: 10.1016/j.bcp.2013.07.019
Eisenberg, M., Kobilo, T., Berman, D. E., and Dudai, Y. (2003). Stability of retrieved memory: inverse correlation with trace dominance. Science 301, 1102–1104. doi: 10.1126/science.1086881
Elsey, J. W. B., Van Ast, V. A., and Kindt, M. (2018). Human memory reconsolidation: a guiding framework and critical review of the evidence. Psychol. Bull. 144, 797–848. doi: 10.1037/bul0000152
Exton-McGuinness, M. T., Patton, R. C., Sacco, L. B., and Lee, J. L. (2014). Reconsolidation of a well-learned instrumental memory. Learn. Mem. 21, 468–477. doi: 10.1101/lm.035543.114
Fadda, P., Scherma, M., Fresu, A., Collu, M., and Fratta, W. (2003). Baclofen antagonizes nicotine-, cocaine-, and morphine-induced dopamine release in the nucleus accumbens of rat. Synapse 50, 1–6. doi: 10.1002/syn.10238
Flavell, C. R., Barber, D. J., and Lee, J. L. (2011). Behavioural memory reconsolidation of food and fear memories. Nat. Commun. 2:504. doi: 10.1038/ncomms1515
Fuchs, R. A., Branham, R. K., and See, R. E. (2006). Different neural substrates mediate cocaine seeking after abstinence versus extinction training: a critical role for the dorsolateral caudate-putamen. J. Neurosci. 26, 3584–3588. doi: 10.1523/JNEUROSCI.5146-05.2006
Germeroth, L. J., Carpenter, M. J., Baker, N. L., Froeliger, B., LaRowe, S. D., and Saladin, M. E. (2017). Effect of a brief memory updating intervention on smoking behavior: a randomized clinical trial. JAMA Psychiatry 74, 214–223. doi: 10.1001/jamapsychiatry.2016.3148
Hernandez, P. J., and Kelley, A. E. (2004). Long-term memory for instrumental responses does not undergo protein synthesis-dependent reconsolidation upon retrieval. Learn. Mem. 11, 748–754. doi: 10.1101/lm.84904
Hone-Blanchet, A., Wensing, T., and Fecteau, S. (2014). The use of virtual reality in craving assessment and cue-exposure therapy in substance use disorders. Front. Hum. Neurosci. 8:844. doi: 10.3389/fnhum.2014.00844
Kantak, K. M., and Nic Dhonnchadha, B. A. (2011). Pharmacological enhancement of drug cue extinction learning: translational challenges. Ann. N Y Acad. Sci. 1216, 122–137. doi: 10.1111/j.1749-6632.2010.05899.x
Kaplan, G. B., Heinrichs, S. C., and Carey, R. J. (2010). Treatment of addiction and anxiety using extinction approaches: neural mechanisms and their treatment implications. Pharmacol. Biochem. Behav. 97, 619–625. doi: 10.1016/j.pbb.2010.08.004
Kindt, M., and Soeter, M. (2013). Reconsolidation in a human fear conditioning study: a test of extinction as updating mechanism. Biol. Psychol. 92, 43–50. doi: 10.1016/j.biopsycho.2011.09.016
Kredlow, M. A., Unger, L. D., and Otto, M. W. (2016). Harnessing reconsolidation to weaken fear and appetitive memories: a meta-analysis of post-retrieval extinction effects. Psychol. Bull. 142, 314–336. doi: 10.1037/bul0000034
Liu, X., Caggiula, A. R., Palmatier, M. I., Donny, E. C., and Sved, A. F. (2008). Cue-induced reinstatement of nicotine-seeking behavior in rats: effect of bupropion, persistence over repeated tests, and its dependence on training dose. Psychopharmacology 196, 365–375. doi: 10.1007/s00213-007-0967-9
Ma, X., Zhang, J. J., and Yu, L. C. (2012). Post-retrieval extinction training enhances or hinders the extinction of morphine-induced conditioned place preference in rats dependent on the retrieval-extinction interval. Psychopharmacology 221, 19–26. doi: 10.1007/s00213-011-2545-4
Markou, A., Li, J., Tse, K., and Li, X. (2018). Cue-induced nicotine-seeking behavior after withdrawal with or without extinction in rats. Addict. Biol. 23, 111–119. doi: 10.1111/adb.12480
Millan, E. Z., Milligan-Saville, J., and McNally, G. P. (2013). Memory retrieval, extinction, and reinstatement of alcohol seeking. Neurobiol. Learn. Mem. 101, 26–32. doi: 10.1016/j.nlm.2012.12.010
Monfils, M. H., Cowansage, K. K., Klann, E., and LeDoux, J. E. (2009). Extinction-reconsolidation boundaries: key to persistent attenuation of fear memories. Science 324, 951–955. doi: 10.1126/science.1167975
Nader, K., Schafe, G. E., and Le Doux, J. E. (2000). Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature 406, 722–726. doi: 10.1038/35021052
Niaura, R., Abrams, D. B., Shadel, W. G., Rohsenow, D. J., Monti, P. M., and Sirota, A. D. (1999). Cue exposure treatment for smoking relapse prevention: a controlled clinical trial. Addiction 94, 685–695. doi: 10.1046/j.1360-0443.1999.9456856.x
Olshavsky, M. E., Song, B. J., Powell, D. J., Jones, C. E., Monfils, M. H., and Lee, H. J. (2013). Updating appetitive memory during reconsolidation window: critical role of cue-directed behavior and amygdala central nucleus. Front. Behav. Neurosci. 7:186. doi: 10.3389/fnbeh.2013.00186
Otis, J. M., and Mueller, D. (2011). Inhibition of β-adrenergic receptors induces a persistent deficit in retrieval of a cocaine-associated memory providing protection against reinstatement. Neuropsychopharmacology 36, 1912–1920. doi: 10.1038/npp.2011.77
Palmatier, M. I., Evans-Martin, F. F., Hoffman, A., Caggiula, A. R., Chaudhri, N., Donny, E. C., et al. (2006). Dissociating the primary reinforcing and reinforcement-enhancing effects of nicotine using a rat self-administration paradigm with concurrently available drug and environmental reinforcers. Psychopharmacology 184, 391–400. doi: 10.1007/s00213-005-0183-4
Quirk, G. J., and Mueller, D. (2007). Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology 33, 56–72. doi: 10.1038/sj.npp.1301555
Quirk, G. J., Paré, D., Richardson, R., Herry, C., Monfils, M. H., Schiller, D., et al. (2010). Erasing fear memories with extinction training. J. Neurosci. 30, 14993–14997. doi: 10.1523/JNEUROSCI.4268-10.2010
Risner, M. E., and Goldberg, S. R. (1983). A comparison of nicotine and cocaine self-administration in the dog: fixed-ratio and progressive-ratio schedules of intravenous drug infusion. J. Pharmacol. Exp. Ther. 224, 319–326.
Saladin, M. E., Gray, K. M., McRae-Clark, A. L., Larowe, S. D., Yeatts, S. D., Baker, N. L., et al. (2013). A double blind, placebo-controlled study of the effects of post-retrieval propranolol on reconsolidation of memory for craving and cue reactivity in cocaine dependent humans. Psychopharmacology 226, 721–737. doi: 10.1007/s00213-013-3039-3
Schiller, D., Monfils, M. H., Raio, C. M., Johnson, D. C., Ledoux, J. E., and Phelps, E. A. (2010). Preventing the return of fear in humans using reconsolidation update mechanisms. Nature 463, 49–53. doi: 10.1038/nature08637
Schwabe, L., Nader, K., and Pruessner, J. C. (2014). Reconsolidation of human memory: brain mechanisms and clinical relevance. Biol. Psychiatry 76, 274–280. doi: 10.1016/j.biopsych.2014.03.008
Soeter, M., and Kindt, M. (2010). Dissociating response systems: erasing fear from memory. Neurobiol. Learn. Mem. 94, 30–41. doi: 10.1016/j.nlm.2010.03.004
Soeter, M., and Kindt, M. (2011). Disrupting reconsolidation: pharmacological and behavioral manipulations. Learn. Mem. 18, 357–366. doi: 10.1101/lm.2148511
Sorg, B. A., Todd, R. P., Slaker, M., and Churchill, L. (2015). Anisomycin in the medial prefrontal cortex reduces reconsolidation of cocaine-associated memories in the rat self-administration model. Neuropharmacology 92, 25–33. doi: 10.1016/j.neuropharm.2014.12.029
Taylor, J. R., Olausson, P., Quinn, J. J., and Torregrossa, M. M. (2008). Targeting extinction and reconsolidation mechanisms to combat the impact of drug cues on addiction. Neuropharmacology 56, 186–195. doi: 10.1016/j.neuropharm.2008.07.027
Tedesco, V., Mutti, A., Auber, A., and Chiamulera, C. (2014). Nicotine-seeking reinstatement is reduced by inhibition of instrumental memory reconsolidation. Behav. Pharmacol. 25, 725–731. doi: 10.1097/fbp.0000000000000088
Temple, J. R., Shorey, R. C., Lu, Y., Torres, E., Stuart, G. L., and Le, V. D. (2017). E-cigarette use of young adults motivations and associations with combustible cigarette alcohol, marijuana, and other illicit drugs. Am. J. Addict. 26, 343–348. doi: 10.1111/ajad.12530
Torregrossa, M. M., and Taylor, J. R. (2012). Learning to forget: manipulating extinction and reconsolidation processes to treat addiction. Psychopharmacology 226, 659–672. doi: 10.1007/s00213-012-2750-9
Tronson, N. C., and Taylor, J. R. (2007). Molecular mechanisms of memory reconsolidation. Nat. Rev. Neurosci. 8, 262–275. doi: 10.1038/nrn2090
Tzilos, G. K., Reddy, M. K., Caviness, C. M., Anderson, B. J., and Stein, M. D. (2016). Mostly smokers: identifying subtypes of emerging adult substance users. Subst. Use Misuse 51, 1587–1592. doi: 10.1080/10826084.2016.1188956
Xue, Y. X., Deng, J. H., Chen, Y. Y., Zhang, L. B., Wu, P., Huang, G. D., et al. (2017). Effect of selective inhibition of reactivated nicotine-associated memories with propranolol on nicotine craving. JAMA Psychiatry 74, 224–232. doi: 10.1001/jamapsychiatry.2016.3907
Xue, Y. X., Luo, Y. X., Wu, P., Shi, H. S., Xue, L. F., Chen, C., et al. (2012). A memory retrieval-extinction procedure to prevent drug craving and relapse. Science 336, 241–245. doi: 10.1126/science.1215070
Keywords: retrieval-extinction, reconsolidation, spontaneous recovery, nicotine, cocaine, self-administration
Citation: Struik RF, De Vries TJ and Peters J (2019) Detrimental Effects of a Retrieval-Extinction Procedure on Nicotine Seeking, but Not Cocaine Seeking. Front. Behav. Neurosci. 13:243. doi: 10.3389/fnbeh.2019.00243
Received: 16 July 2019; Accepted: 27 September 2019;
Published: 15 October 2019.
Edited by:
Jianfeng Liu, University at Buffalo, United StatesReviewed by:
Timothy J. Jarome, Virginia Tech, United StatesChristina Jennifer Perry, Florey Institute of Neuroscience and Mental Health, Australia
Copyright © 2019 Struik, De Vries and Peters. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jamie Peters, amFtaWUubC5wZXRlcnNAY3VhbnNjaHV0ei5lZHU=
† These authors have contributed equally to this work