Joshua C. Gray1James MacKillop1,2*- 1Department of Psychology, University of Georgia, Athens, GA, USA
- 2Peter Boris Centre for Addictions Research, McMaster University/St. Joseph’s Healthcare Hamilton, Hamilton, ON, Canada
This review evaluates the viability of delayed reward discounting (DRD), an index of how much an individual devalues a future reward based on its delay in time, for genetically-informed drug abuse prevention. A review of the literature suggests that impulsive DRD is robustly associated with drug addiction and meets most of the criteria for being an endophenotype, albeit with mixed findings for specific molecular genetic influences. Several modes of experimental manipulation have been demonstrated to reduce DRD acutely. These include behavioral strategies, such as mindfulness, reward bundling, and episodic future thinking; pharmacological interventions, including noradrenergic agonists, adrenergic agonists, and multiple monoamine agonists; and neuromodulatory interventions, such as transcranial magnetic stimulation and transcranial direct current stimulation. However, the generalization of these interventions to positive clinical outcomes remains unclear and no studies to date have examined interventions on DRD in the context of prevention. Collectively, these findings suggest it would be premature to target DRD for genetically-informed prevention. Indeed, given the evidence of environmental contributions to impulsive DRD, whether genetically-informed secondary prevention would ever be warranted is debatable. Progress in identifying polymorphisms associated with DRD profiles could further clarify the underlying biological systems for pharmacological and neuromodulatory interventions, and, as a qualitatively different risk factor from existing prevention programs, impulsive DRD is worthy of investigation at a more general level as a novel and promising drug abuse prevention target.
Introduction
Excessive use of addictive drugs is both widespread and onerous, contributing to to approximately 22% of deaths and costing more than $500 billion annually in the United States (Mokdad et al., 2004; Uhl and Grow, 2004). A high priority for reducing the burden of addictive disorders is to translate knowledge of the underlying risk factors for addiction into prevention and early intervention approaches. Numerous factors influence the probability of initiation and progression of drug use, but one well established domain is genetic variation, which is estimated to contribute approximately half of the liability for developing drug addiction (Goldman et al., 2005; Agrawal and Lynskey, 2008). From a theoretical perspective, aligning prevention efforts to address genetic risks has very high potential, as it would focus on important etiological variables that are not currently considered from a prevention perspective and would seek to assist individuals who are constitutionally at elevated risk. It would be a form of personalized medicine, but at the level of prevention. Ideally, genetically-informed prevention programming would go one step further and would target the specific ways that genetic variation give rise to drug abuse risk, the biopsychosocial mechanisms of risk. By permitting very early risk identification and the delivery of maximally relevant prevention programming, prevention strategies that are specifically tailored to genetically-influenced risk mechanisms would have the potential to have a major impact.
At a behavioral level, an increasingly well-established risk factor for drug abuse is impulsive decision making, specifically, the propensity to select an immediate reward at the expense of greater future rewards. This form of impulsivity is typically referred to as delayed reward discounting (DRD) or capacity to delay gratification, and has also been increasingly linked to genetic influences. The link to genetics in turn suggests that impulsive DRD may be a viable candidate for genetically-informed prevention. In practice, what this means is that individuals with genetic profiles associated with more impulsive DRD would pre-emptively receive programming to reduce preferences for immediate gratification and, ultimately, to reduce the probability of subsequent drug abuse. This would be a radically different strategy from current prevention efforts and could be very powerful, both for preventing drug abuse and a number of adverse health outcomes. However, it is also lofty prospect that is highly contingent on a number of relationships being empirically robust.
The goal of the current review is to concretely evaluate the existing literature on the prospects of DRD as a genetically-informed prevention target. The review has four goals: (1) to introduce DRD as a behavioral characteristic and review its association with drug abuse; (2) to review the evidence suggesting DRD is an endophenotype (i.e., a genetically-influenced mechanism of risk for addictive disorders); (3) to review candidate intervention approaches for reducing impulsive DRD; (4) to critique the extent to which the preceding sections “connect the dots” to make an compelling argument for such an approach.
Methodology
To conduct our review, we examined the published literature using the Public Library of Medicine (PubMed) and PsychINFO databases. Specifically, we examined individual empirical articles and reviews that addressed DRD in the context of drug abuse, behavioral genetics, and manipulations or interventions that reduce impulsive DRD. The review included studies on DRD in both humans and non-human animals, but, given that DRD is generally independent of other measures of impulsivity (e.g., MacKillop et al., 2014), we did not include studies of other domains. Articles in the two major domains of the study (genetic influences on DRD and strategies for reducing DRD) were critiqued in detail and the accompanying cited works were used to identify other potentially relevant studies. However, a specific search protocol using a discrete set of search terms was not implemented, meaning that this article is more appropriately considered a critical review of the literature, but not a formal systematic review (e.g., Khan et al., 2003).
Delayed Reward Discounting and Drug Abuse
Delayed reward discounting is typically assessed using decision-making tasks posing choices between a smaller monetary reward that is immediately available and a larger delayed reward after an intervening delay. By varying the reward amounts and the delay length, an overall characterization of temporal discounting rates can be generated. Figure 1 provides illustrative discounting temporal discounting curves for $100 available in the future versus smaller amounts available in the present. Quantitative indices of discounting are typically generated either using non-linear regression to derive an individual’s temporal discounting function (i.e., k) or generating the area under the curve (AUC; Myerson et al., 2001). The k index reflects the slope of the hyperbolic discounting function and AUC reflects the overall volume of the discounting curve. The two are strongly inversely correlated; steeper discounting curves have high k values and low AUCs. Both indices have their own advantages and disadvantages, with the primary difference being that k makes implicit assumptions about the hyperbolic form of the discounting function, whereas AUC is theory-free and does not make assumptions about the specific form of the curve (Myerson et al., 2001). Although often administered for hypothetical outcomes, a number of studies suggest that individuals respond similarly on versions of the task in which they are provided with an actual monetary reward based on their responses (Johnson and Bickel, 2002; Madden et al., 2003; Bickel et al., 2009; Lawyer et al., 2011). Furthermore, studies have demonstrated robust test-retest reliability, with comparable stability to personality traits (Beck and Triplett, 2009; Kirby, 2009; Odum, 2011). Money is the most commonly used commodity and has a number of advantages (e.g., generality of relevance, meaningfulness of discrete units), but other commodities, including addictive drugs, can be assessed using DRD paradigms. Indeed, some of the earliest work in this area used the now famous “marshmallow test” in which children choose between one marshmallow immediately available after the experimenter leaves the room or two marshmallows if they wait for the experimenter to return (Metcalfe and Mischel, 1999).
Figure 1. Prototypic hyperbolic delayed reward discounting curves reflecting the discounted subjective value of $100 delayed from 1 day to 1 year The curves reflect the points at which the smaller immediate reward is equal in value to the $100 delayed reward. For example, at a delay of 100 days, $100 has lost ∼50% of its nominal value for the low impulsivity profile and ∼90% of its nominal value for the high impulsivity profile. Figure from MacKillop (2013).
Individuals who strongly prefer immediate over delayed rewards of larger value are said to exhibit impulsive discounting of delayed rewards. Impulsive DRD is associated with earlier age of addiction onset (Dom et al., 2006), dependence on multiple classes of drugs (e.g., tobacco, alcohol, cocaine; MacKillop et al., 2011), and treatment response (MacKillop and Kahler, 2009; Sheffer et al., 2014). Furthermore, a meta-analysis synthesized previous literature on DRD in relation to addictive behavior by comparing levels of DRD between criterion (addicted) groups and control groups (MacKillop et al., 2011), finding consistent evidence of significantly more impulsive DRD in criterion groups, with a medium effect size across studies (d = 0.58).
Although debate has arisen regarding the extent to which DRD is a cause or consequence of addiction (or whether they are both influenced by a third variable), there is increasing evidence that DRD preferences at least partially predates the development of addiction. Two retrospective studies have identified that more impulsive DRD predicts earlier onset of alcohol use (Kollins, 2003) and alcohol use disorder symptoms (Dom et al., 2006). Several subsequent studies have found a link between more impulsive DRD in adolescents and increased substance use and/or misuse over time (Audrain-McGovern et al., 2009; Fernie et al., 2013; Khurana et al., 2013; Kim-Spoon et al., 2014). However, one recent study did not find a consistent connection between DRD and subsequent substance use (Isen et al., 2014). Notably, the null results in this study may be partially attributable to their utilization of an externalizing latent factor that included a broader spectrum of externalizing behaviors than simply drug use and misuse (e.g., disinhibited, delinquent, and aggressive behavior). In sum, DRD is a well-validated behavioral measure of impulsivity, is consistently associated with addictive behavior, and is an etiological risk factor, predating alcohol and tobacco use and misuse.
Delayed Reward Discounting as a Drug Abuse Endophenotype
Although approximately ∼50% of all variance in addictive disorders is genetic risk (Goldman et al., 2005; Agrawal and Lynskey, 2008), little variance has been consistently accounted for by molecular genetic studies. In fact, candidate gene studies (assessing associations with a small number of variants in a limited number of genes) and genome-wide association studies (assessing associations with hundreds of thousands of variants across the genome) have both identified variants which are inconsistently replicated and exhibit small effect sizes (Goldman et al., 2005; Treutlein and Rietschel, 2011). This gap between high levels of heritability and specific variants of inconsistent and small effects is referred to as the “missing heritability problem” (Turkheimer, 2011). Several potential factors contribute to this issue, but perhaps two are most notable: (1) addictive disorders are highly polythetic (i.e., hundreds of combinations of symptoms can produce the same diagnosis); and (2) addictive disorders are “too far” from the genes, meaning that the proximal consequences of genetic variation may be only distantly related to the proximal risk factors for drug abuse. As a result of these obstacles, an endophenotype approach has been proposed, shifting the focus to narrower phenotypes that are putatively determined by a more limited number of genes and are more specifically associated with the disorder of focus. Endophenotypes are also intended to be mechanistically informative about the nature of genetic influences. Given both links to genetics and mechanisms of risk, endophenotypes are the natural intervention targets in the context of genetically-informed prevention.
Importantly, a number of criteria have been increasingly accepted as defining an endophenotype. These comprise evidence of the following: (1) association with the illness, meaning a link with the condition of interest; (2) heritability, meaning evidence that the characteristic is influenced by genetics; (3) state independence, meaning the characteristic is present when the disease is not (and is not simply a symptom of the condition); (4) present in non-affected family members at higher rates than the general population, further indicating its genetic basis; and (5) co-segregation with the psychiatric illness in families, further indicating association (Gottesman and Gould, 2003).
For DRD, the first of these criteria was addressed above, in the links between the behavioral characteristic of DRD and drug abuse. Shifting to the heritability of DRD, there is robust evidence from animal and human studies. Animal studies are particularly useful for assessing heritability of traits because they allow researchers to control all aspects of the environment. The reduction in environmental variability enables isolation of the effects of genetic variability. In animal studies, researchers typically compare behaviors across inbred strains that are isogenic (i.e., entirely or nearly genetically identical; Falconer et al., 1996). In the first rodent study of DRD heritability, approximately 16% of variability in DRD rates was attributable to between-strain differences in mice (Isles et al., 2004). Studies of Lewis and Fischer rodents reared in identical environments also identified systematic differences in discounting across strains that are attributable to genetic differences (Anderson and Woolverton, 2005; Madden et al., 2008; Stein et al., 2012). Finally, in a recent study, the estimated heritability across eight strains was between 43 and 66% (Richards et al., 2013). Overall, these studies largely found robust differences in DRD across rodent strain, suggesting substantial heritability of DRD.
To date, four human studies have assessed the heritability of delay discounting and all four identified evidence of heritability. Early adolescent twins were found to have genetic influences on DRD at ages 12 (30%) and 14 (51%, Anokhin et al., 2011). Additionally, in a sample of 17-year-old twins, strong evidence of heritability was found in two different DRD phenotypes (47–51%, Isen et al., 2014; Sparks et al., 2014). Most recently, Anokhin et al. (2015) assessed DRD in a sample of twins and found significant heritability of both DRD indices (AUC: 46 and 62%; k: 35 and 55% at age 16 and 18 respectively). The trend of increasing genetic influence in later adolescence is likely attributable to ongoing adolescent brain maturation of prefrontal regions implicated in intertemporal choice (Carter et al., 2010; Steinberg, 2010; Peters and Büchel, 2011; Luo et al., 2012). Taken together, both animal and human studies suggest that DRD is heritable and possesses similar rates of heritability as addiction phenotypes (i.e., ∼50%).
In the domain of family history, rodent studies support the presence of elevated levels of DRD in non-affected family members (as compared to the general population). Specifically, three studies to date of alcohol-naïve rodents selectively bred for high- or low-alcohol preference, found that high-alcohol preferring subjects exhibited an increased rate of DRD of sucrose rewards (Wilhelm and Mitchell, 2008; Oberlin and Grahame, 2009; Perkel et al., 2015). Notably, one study did not find a difference in DRD of sucrose rewards between high- and low-alcohol preferring rodents (Wilhelm et al., 2007). Nonetheless, the majority of evidence suggests that heritability for alcohol abuse susceptibility overlaps with heritability for DRD preference, and that in subjects susceptible to alcohol abuse, impulsive DRD is present prior to alcohol exposure.
While human research has been mixed regarding the presence of DRD at elevated rates in non-affected family members, earlier studies suffered from significant methodological issues (most notably, small sample size; e.g., Crean et al., 2002; Petry et al., 2002; Herting et al., 2010). A more recent highly-powered study found that in 298 healthy young adults (age M = 23), those with a family history positive for alcohol or other drug use disorders had higher rates of DRD (Acheson et al., 2011). Furthermore, the study found that impulsive DRD was significantly associated with having more parents and grandparents with alcohol and drug use disorders. Similarly, Dougherty et al. (2014) found that in 386 non-affected youth (ages 10–12), those with family histories of alcohol or other drug use disorders had higher rates of DRD. These findings suggest that in studies with adequate power and a thorough assessment of family history of substance use disorders, there is evidence that non-affected family members of individuals with substance use disorders possess higher rates of DRD than the general population. Similarly, this body of research suggests that given the overlap in heritability of drug abuse and impulsive DRD, there is likely an overlap of specific genetic loci conferring risk for drug abuse and for DRD.
Relatively recent efforts have been made to determine the molecular genetic basis of DRD, primarily within dopaminergic genes. Currently, findings primarily suggest the involvement of the single nucleotide polymorphisms (SNPs) from COMT (rs4680) and ANKK1 (rs1800497), and the exon 3 variable number of tandem repeats (VNTR) polymorphism in DRD4, genes which are all implicated in dopamine neurotransmission (Boettiger et al., 2007; Eisenberg et al., 2007; Paloyelis et al., 2010; Gianotti et al., 2012; Smith and Boettiger, 2012; Gray and MacKillop, 2014). Regarding rs4680, four studies found an association between possession of the G allele and impulsive DRD in adults (Boettiger et al., 2007; Gianotti et al., 2012; Smith and Boettiger, 2012; MacKillop et al., in press), one found an association of A/A with impulsive DRD in young adults (Paloyelis et al., 2010), and another found no association (Gray and MacKillop, 2014). The A/A genotype of rs4680 is associated with a reduction in levels of catechol-O-methyl transferase enzymatic activity (an enzyme implicated in dopamine catabolism), which leads to higher levels of dopamine primarily in the prefrontal cortex (Weinshilboum et al., 1999; Chen et al., 2004; Tunbridge et al., 2004). Gianotti et al. (2012) found that reduced activity in the left dorsal prefrontal cortex (dPFC) during a resting state paradigm mediates the effect of the G allele on impulsive DRD (also see Boettiger et al., 2007). This suggests that the G allele of rs4680 reduces baseline dPFC engagement via reduced dopamine availability, leading to more impulsive decision making. The dPFC does indeed appear to be strongly implicated in impulsive decision making as it is known to impact self-control processes (Gianotti et al., 2009; Knoch et al., 2010) and the dorsolateral prefrontal cortex (dlPFC) has been shown to affect DRD rates when stimulated transcranially (discussed below). Future studies with large healthy populations are required to verify which genotype is of greatest risk and examine moderators (e.g., age effects), as one recent study’s findings suggest a U-shape curve between dopamine levels and DRD performance (i.e., too much or too little dopamine yields impulsive DRD; Smith and Boettiger, 2012). Nonetheless, current research supports a relationship between COMT (rs4680) and DRD rates via dPFC dopamine levels.
The T allele of rs1800497 has been associated with DRD in two studies (Eisenberg et al., 2007; MacKillop et al., in press), and not associated in two others (Kawamura et al., 2013; Gray and MacKillop, 2014). However, considerable heterogeneity in sample demographics (e.g., healthy college students, weekly gamblers, healthy adults) and sample sizes (between 91 and 195 participants) may explain the mixed findings. The role of the rs1800497 SNP is less well understood because it is technically in the ANKK1 gene, near the DRD2 gene. However, rs1800497 is in high linkage disequilibrium with SNPs from multiple genes in this region (NCAM1-TTC12-ANKK1-DRD2, Mota et al., 2012) and is associated with dopamine D2 receptor density (Pohjalainen et al., 1998; Jönsson et al., 1999; Savitz et al., 2013). Regardless of the specific mechanism of influence of rs1800497, its association with dopamine availability and with multiple addictive genotype influences (for a review see Ma et al., 2014) suggests it should be investigated further in relation to DRD rates.
DRD4 VNTR influences intracellular levels of cyclic adenosine monophosphate to primarily impact dopamine response in the prefrontal cortex, however, the specific downstream biochemical impact of different variants of DRD4 VNTR remains relatively unclear (Oak et al., 2000) and recent studies have examined the role of rare variants rather than length of repeats (e.g., Tovo-Rodrigues et al., 2012; Michealraj et al., 2014). DRD4 VNTR and DRD has been explored in several studies, with mixed findings, and appears to have a more context dependent relationship with DRD rates. For example, one study found the combination of the long form of DRD4 VNTR and the T allele of rs1800497 to be associated with significantly higher DRD rates (Eisenberg et al., 2007), and a second study found increased DRD rates in low socioeconomic status (SES) long form carriers versus decreased DRD rates in mid-to-high SES long form carriers (Sweitzer et al., 2013). In addition, studies have reported a direct negative relationship between the long from and decreased DRD rates (Gray and MacKillop, 2014) and no direct association (Eisenberg et al., 2007; Garcia et al., 2010; Paloyelis et al., 2010; Sweitzer et al., 2013). However, the existing studies have varied widely in sample composition (e.g., healthy college students, adolescents with attention deficit hyperactivity disorder [ADHD]) and size (ranging from 68 to 546). It will be important for future studies to continue to explore the potential of DRD4 VNTR as a differential susceptibility gene (see Bakermans-Kranenburg and van Ijzendoorn, 2011) in order to determine whether the relationship between DRD and polymorphisms of varying length or rarity is contingent upon other genes or environmental stressors.
Despite some promising findings regarding the role of COMT, DRD2, and DRD4, the associations require consistent replication and the effect sizes have been relatively small. Nonetheless, current empirical findings and theory suggest a central involvement of dopamine functioning as well as possible interactions among serotonin and dopamine systems on DRD performance (Winstanley et al., 2005; Simon et al., 2013). Greater exploration of other systems related to reward processing as well as genome-wide association studies are a priority for future research. Identification of robust genetic correlates of DRD would provide insights into the neurobiological causes of variation, identifying targets for possible pharmacological and neuromodulatory interventions.
Taken together, DRD is relatively well supported as an endophenotype for addictive disorders, although the identification of specific polymorphisms responsible for variation is nascent. The initial molecular genetic studies suggest that dopamine transmission plays an important role in DRD, yet in almost all cases, the candidate loci were the ‘usual suspects’ (i.e., loci tested most frequently for associations with addictive behavior and other externalizing psychopathology). Future work that establishes the robustness of these findings and expands the genomic perspective will be essential.
Interventions Targeting Delayed Reward Discounting
Several experimental manipulations have been examined for reducing high rates of DRD, and can be broadly classified into three domains: behavioral interventions, pharmacological interventions, and neuromodulatory manipulations using transcranial stimulation of specific brain regions.
Behavioral Interventions
The earliest research exploring the link between distraction and DRD was conducted on preschool age children (3–5 years old) who underwent the aforementioned marshmallow test. In this early work, when encouraged to think of other things or play with toys, the children more frequently waited longer for the delayed reward (Mischel and Ebbesen, 1970; Mischel et al., 1972). Similar findings have been identified in animal studies (Grosch and Neuringer, 1981; Evans and Beran, 2007). This is thought to operate similarly to distraction manipulations that lead to more effective resistance to food or drug cravings in susceptible individuals (e.g., Versland and Rosenberg, 2007; Van Dillen et al., 2013; Murphy and MacKillop, 2014). However, it remains unclear whether distraction techniques can offer long-term (rather than merely temporary) disruption of immediate reward pursuit (see Ashe et al., 2015).
The converse of distraction-based techniques is a mindfulness approach which seeks to encourage non-judgmental and objective monitoring of one’s own thoughts and behaviors in an effort make well considered, unimpulsive decisions (Marlatt, 2002). For example, one study employed a brief 60–90 min training based on Acceptance and Commitment Therapy (Hayes et al., 2011; Morrison et al., 2014). In this training session, subjects discussed internal barriers to healthy decision making with a therapist and engaged in several exercises designed to aid the participant in observing their emotions and learning to act on values rather than feelings. Participants who were engaged in this training procedure exhibited decreases in DRD, whereas waitlist controls did not. Brief mindfulness-based interventions have been adapted for obese individuals and have shown efficacy for reducing DRD of food items (Hendrickson and Rasmussen, 2013). In a similar spirit of priming mindfulness, Berry et al. (2014) found that preemptive and concurrent visual exposure to natural environments (e.g., mountains), led to approximately a 50% reduction in DRD compared to decisions made during exposure to built environments (e.g., buildings) and control environments (e.g., triangles). All of the work in this area has focused on acute outcomes and it will be important for future studies to explore longitudinally how mindfulness training may influence long-term decision making patterns.
Beyond distraction and mindfulness, a wide variety of other behavioral techniques have been applied to reduce impulsive discounting. For example, a small number of early studies employed a fading procedure with pigeons that gradually increased the delay between the small reinforcer and the larger delayed reinforcer, which yielded an increased selection of the delayed reward (Mazur and Logue, 1978; Logue et al., 1984). Similar studies have been conducted primarily in children with conditions associated with impulsivity (e.g., mental retardation, autism, ADHD) and have found reductions in DRD (Schweitzer and Sulzer-Azaroff, 1988; Dixon et al., 1998; Fisher et al., 2000). In the context of these experiments, the participants were offered a small immediate reinforcer or a large reinforcer that was contingent on engagement in a target behavior (e.g., staying seated) for a required duration. The duration for performing the target behavior was gradually increased overtime and the children typically showed increasing ability to maintain this behavior for extended periods of time in order to obtain the larger reinforcer. However, sample sizes ranged from 3 to 6 participants and the applicability of this technique to healthy adolescents (a typical target sample for drug abuse prevention) or substance using adults is relatively low.
Another method of reorienting individuals toward larger delayed rewards is “reward bundling,” or grouping a series of DRD choices into a single decision. For example, for the “reward bundling” condition, one recent study informed participants that if they choose a smaller sooner reward then they will receive that reward every 2 weeks after that for 6–10 weeks, and if they choose a larger delayed reward in 10 days then they will receive that reward every 2 weeks after that for 6–10 weeks (Hofmeyr et al., 2011). This makes theoretical sense, as orienting individuals to considering a series of consequences of a pattern of decision making (as opposed to a consequence derived from a single choice) may increase their consideration of avoiding a sum of reduced rewards by choosing to favor larger greater rewards. For example, if the choice to get intoxicated now at the cost of feeling good tomorrow were to entail commitment to this same choice every day for the next week, the value of the larger delayed reward relative to the smaller sooner reward would presumably increase (Monterosso and Ainslie, 2007). Bundling has been supported empirically by several laboratory studies involving animals and humans (Kirby and Guastello, 2001; Ainslie and Monterosso, 2003; Hofmeyr et al., 2011; Stein et al., 2013). The most recent human study, conducted by Hofmeyr et al. (2011), found that smokers, but not non-smokers, were particularly susceptible to the reward bundling manipulation. This suggests that those who are more susceptible to addictive behavior may be in greater need of and more responsive to interventions that challenge them to consider the long-term aggregation of rewards. Relatedly, a study found that in cocaine and/or alcohol outpatient substance users, an intervention comprised of individual counselor-facilitated training in monthly budgeting, which focused on long term goals and limited short-term spending, led to a decrease in both DRD and cocaine use (Black and Rosen, 2010).
Another strategy for modifying discounting is episodic future thinking, which is a method of increasing future orientation by prompting individuals with autobiographical, emotional, and circumstantial details that are expected to occur at specified delays in the future (Atance and O’Neill, 2001). For example in two fMRI experiments, Peters and Büchel (2010) found that when delays were paired with events the subjects were likely to engage in during that time (e.g., “20€ now or 35€ in 45 days (vacation Paris)”), subjects were more likely to choose the delayed rewards than when rewards were not presented with these tags. This finding has been replicated in three additional studies (Benoit et al., 2011; Daniel et al., 2013a,b). Most recently, a study found that episodic future thinking is not dependent on positive affect induction for its effects rather, even neutral-valenced events shift time perspective to reduce DRD (Lin and Epstein, 2014). Using a conceptually similar strategy, one investigation conducted four studies utilizing virtual reality to display computerized renderings of participants’ future selves, and in all cases they found that those who interacted with their virtual future selves had reduced DRD (Hershfield et al., 2011). This represents a promising method for engaging individuals in greater imagination of their future in order to reduce DRD.
From a more purely cognitive standpoint, a phenomenon that has been demonstrated in several studies is framing effects, or the tendency of DRD to fluctuate in relation to the specific wording of the delay. Read et al. (2005) first demonstrated that when delays are framed as calendar dates (e.g., on December 5), discount rates tend to decrease and the shape of the discount function becomes more linear (less hyperbolic). Other studies have had similar findings (LeBoeuf, 2006; Klapproth, 2012; DeHart and Odum, 2015). Notably, other variables involved in question framing have been shown to either decrease DRD, such as presenting participants with an explicit zero paired with the options (e.g., “[A] $5.00 today and $0 in 26 days OR [B] $0 today and $6.20 in 26 days”; Magen et al., 2008). A common element across all of these formats is that they seem to increase the salience of the delay by framing the specific date (possibly increasing the perceived likelihood of actually receiving the reward; see Patak and Reynolds, 2007), increasing attention to the notion that they will receive “$0” at the delay if they select the immediate reward.
Finally, strengthening the elementary cognitive processes that subserve DRD decision making represents a further strategy for reducing this form of impulsivity. Two studies have been conducted to explore the extent to which working memory training can improve overall executive functioning capabilities as a way to decrease DRD and improve overall decision making capabilities. The first study randomized a small number of individuals (N = 27) into a training condition and a matched control condition (Bickel et al., 2011). The working memory training used a computer program consisting of several challenges (e.g., recalling a sequence of digits forward or backward) administered 4–15 times over the course of approximately 25 days. In the control condition, participants were exposed to the same set of stimuli, but were provided with the answers so that they did not need to engage their working memory. The study found that the working memory training group significantly decreased discounting rates by approximately 50%, whereas the control group exhibited no significant reductions in DRD. A recent study did not replicate the connection between working memory training and reduced DRD in a rodent model (Renda et al., 2015), although major methodological differences were present (e.g., species, type of task, prior substance use). Ameliorating delay discounting via working memory is at an early stage but has considerable promise.
Pharmacological Interventions
Several studies have tested the efficacy of dopamine (DA) agonists (e.g., amphetamine) and DA-norepinephrine (NE) agonists (e.g., methylphenidate) for reducing DRD. Frequently prescribed to individuals with ADHD, amphetamine and methylphenidate are thought to increase executive functioning capacity by facilitating transmission of catecholamines in critical regions (Bidwell et al., 2011). Studies have found that both amphetamine and methylphenidate typically reduce DRD in rat models (Cardinal et al., 2000; Adriani et al., 2004; van Gaalen et al., 2006; Bizot et al., 2011), however, null or even opposite effects have occasionally been detected when varying methodology (e.g., rearing environments, signaled or unsignaled rewards; Cardinal et al., 2000; Perry et al., 2008). Of the human studies that have been conducted, one found that amphetamine decreased DRD in healthy adults (de Wit et al., 2002), and the others found that methylphenidate decreased DRD in a sample of adults with a criminal background (Pietras et al., 2003) and in a sample of children with ADHD (Shiels et al., 2009). Despite the promise of these human studies, the therapeutic use of these substances in reducing DRD must be balanced with their high abuse potential in individuals without ADHD (Kollins, 2007).
Additional compounds have been examined for efficacy in reducing DRD, including compounds with less direct and concentrated effects on DA availability, such as NE agonists (e.g., atomoxetine), adrenergic agonists (e.g., guanfacine), and multiple monoamine agonists (e.g., modafinil; Wilens, 2006). These substances are of particular interest because they uniformly exhibit minimal abuse potential (Malcolm et al., 2002; Muir and Perry, 2010; Upadhyaya et al., 2013). Among these three compounds, atomoxetine has been studied most extensively, but only in rodent models to date. Early research by Robinson et al. (2008) found that atomoxetine significantly decreased several forms of impulsivity, including DRD. Similarly, Bizot et al. (2011) found that subjects given atomoxetine were more likely to select the large but delayed reward. However, other studies have found atomoxetine increased DRD in healthy rodents (Broos et al., 2012), or had no effect on DRD in healthy (Baarendse and Vanderschuren, 2012), spontaneously hypertensive (an animal model for ADHD; Turner et al., 2013), and cocaine-withdrawing rodents (Broos et al., 2014). In the latter study, despite no changes in DRD, the rodents were less likely to readminister cocaine at 1 and 10 days (Broos et al., 2014). Finally, one study found that chronic atomoxetine treatment during adolescence (but not acute atomoxetine in adulthood) led to a stable decrease in DRD when tested in adulthood, suggesting lasting effects of the atomoxetine in the orbitofrontal cortex (Sun et al., 2012).
Early studies testing effects of guanfacine and modafinil on DRD are promising. One study found that intramuscular guanfacine reduced DRD in rhesus monkeys (Kim et al., 2012) and a second found dose-dependent reduction in DRD in rats when guanfacine was administered locally in the ventral hippocampus (Abela and Chudasama, 2014). In a fMRI study on humans, modafinil was found to decrease DRD in alcohol dependent participants, but yielded no change in healthy control subjects, suggesting that modafinil normalizes DRD decision making in alcohol dependent patients (Schmaal et al., 2014). Moreover, reductions in DRD were accompanied by an enhanced functional connectivity between the superior frontal gyrus and ventral striatum, suggesting more prefrontal control over these choices. It will be important for future studies to continue to examine the effects of these medications on DRD, particularly in humans with and without high levels of DRD, to establish the consistent and stable effects.
Neuromodulatory Manipulations
Recent efforts have been made to explore the impact of human non-invasive transcranial brain stimulation on DRD, both through magnetic and direct electrical current stimulation. Transcranial magnetic stimulation (TMS) operates by passing electricity through a coil placed near the region of focus. The resulting magnetic field can be used to temporarily modulate brain activity in nearby regions. One group assessed the effect of dlPFC interruption during a DRD task as well as a single item valuation task (i.e., participants rated the attractiveness of 12 single-options taken from the DRD choice set; Figner et al., 2010). They found that left (but not right) dlPFC inhibition increased impulsive responding on the DRD task, but neither region impacted item valuation on the single item valuation task. This suggests that the left dlPFC is critical to self-control (inhibiting responses for salient immediate rewards) rather than in stimulus value appraisal. However, inhibition of the right dlPFC was observed to reduce impulsive DRD in another study (Cho et al., 2010), but only when participants were exposed to a significantly higher frequency and shorter duration of magnetic stimulation than in the study by Figner et al. (2010). Additionally, a subsequent study using positron emission tomography (PET) found that inhibition of the right dlPFC reduced impulsive DRD rates (reducing impulsivity) and disrupted regional cerebral blood flow (rCBF) in the right dlPFC and right rostral PFC leading to diminished correlations between DRD rates and rCBF of these (and other) prefrontal regions (Cho et al., 2012). This suggests that the neural network underlying impulsive decision making is disrupted by right dlPFC inhibition. Finally, also using PET imaging, stimulation of the medial prefrontal cortex has been found to both reduce DRD rates and reduce the level of synaptic dopamine in the striatum (Cho et al., 2015). This is clearly a mixed literature and discrepancies among these findings will need to be reconciled in future studies.
In contrast to TMS, transcranial direct current stimulation (tDCS) operates by directly passing electrical currents to surface electrodes placed on the scalp proximal to the region(s) of interest. One study found no effect of inhibition of left dlPFC and stimulation of right dlPFC on DRD, but did find that when the right dlPFC is inhibited and the left dlPFC is stimulated, impulsive DRD rates increase (Hecht et al., 2013). A second study also found no effects of left dlPFC inhibition and right dlPFC stimulation (Kekic et al., 2014). Clearly, this work is at an early stage and future research should seek to replicate and clarify these findings. Additional priorities include further exploration of the role of anode/cathode placement, electrode size, and current intensity on DRD rates.
Despite early studies showing promise of non-invasive brain stimulation of the prefrontal cortex in improving impulsive decision making, it will be important for future studies to clarify the ideal tool for stimulation (i.e., TMS or tDCS), frequency and intensity of stimulation, and manipulation of left and right prefrontal areas. Although research is nascent, TMS appears to have support both from aforementioned studies and from interventions for related cognitive functions. For example, a recent meta-analysis assessed the efficacy of TMS and tDCS of the dLPFC to improve working memory performance (Brunoni and Vanderhasselt, 2014), a cognitive function that has been linked to DRD performance (Bickel et al., 2011; Wesley and Bickel, 2014). They found that TMS improved response time and accuracy whereas tDCS improved only response times. Several possible mechanisms may explain differences in effects found such as difference in study design, equivalency of “doses,” and better spatial precision of TMS. In addition to identifying optimal stimulation methodology, it will be important for future studies to explore the potential long term effects of transcranial stimulation treatment for DRD.
Critique of Delayed Reward Discounting as a Genetically-Informed Drug Abuse Prevention Target
In the preceding sections, we reviewed impulsive DRD as a behavioral characteristic, evidence linking it to genetic influences, and evidence that it can be significantly ameliorated using a number of strategies. Here, we consider the assembled findings and the specific question of whether it has promise for genetically-informed drug abuse prevention. To do so, we provide a framework for considering the links that are necessary for coming to that conclusion (Figure 2). The framework is an extension of a previous model for integrating alcohol endophenotypes into treatment development and prospective pharmacotherapies (Ray et al., 2010). As depicted in Figure 2A, we propose that endophenotypes can enhance the prospect of genetically-informed intervention of any kind (prevention or treatment) by identifying genetically-mediated risk mechanisms that both enhance the resolution of risk status and serve as intervention targets. In the first case, endophenotypes (e.g., impulsive DRD) are anticipated to ultimately lead to more reliable identification of risk alleles via more robust relationships with individual genotypes. In the second case, the identification of risk status in the context of a specific mechanism implicitly reveals a candidate intervention target. In other words, endophenotypes have the potential to elucidate both the biological causes of the disorder and provide personalized intervention targets.
Figure 2. A framework for considering developing genetically-informed prevention and treatment. General theoretical framework for an endophenotype approach to addiction genetics, integrating endophenotype-specific treatment approaches (Ray et al., 2010) (A). Specific model of delayed reward discounting (DRD) as an endophenotype of genetic risk for addiction liability (B). Numbers 1–4 reflect the necessary components to establish DRD as a viable genetically-influenced prevention target for drug abuse: (1) a robust relationship between DRD and drug abuse; (2) genetic loci that are reliably associated with delay discounting; (3) possession of risk alleles for DRD risk that are responsible for drug abuse risk; (4) efficacious strategies for reducing impulsive DRD.
Figure 2B lays out the case for DRD, identifying the four links that necessarily comprise an argument for genetically-influenced prevention programming. These can be summarized by the following questions:
(1) Is DRD reliably associated with drug abuse?
(2) Are specific genetic loci reliably associated with DRD?
(3) Are DRD risk alleles also responsible for drug abuse risk?
(4) Are there established strategies for reducing impulsive DRD?
If the empirical support for the links in Figure 2B is reliably present, the case for a genetically-informed DRD prevention strategy would be entirely sound. Where those links are less than robust, however, there remain ambiguities and open questions, and the rationale becomes more debatable.
In light of the preceding sections, it is clear the latter is the case for DRD. In the discounting framework, the strongest link is the first, the association between impulsive DRD and drug abuse. As discussed, this relationship has been observed in an array of different samples with an array of different methods, cross-sectionally and longitudinally. With regard to the genetic linkages (2 and 3), the literature remains at an early stage. As noted earlier, although there is relatively strong evidence that DRD is heritable, there is not a sufficiently strong basis for defining individuals at higher or lower genetic risk based on individual genotypes or multi-locus risk scores at this time. Furthermore, there is very limited evidence that discounting risk alleles indirectly impact addictive behavior; this has only been directly demonstrated in one study (Gray and MacKillop, 2014). Similarly, at the level of link 4, intervention research on DRD remains incipient. Although several methods have been applied to reducing DRD rates, there is limited consensus on the ideal approach or combinations of approaches. Furthermore, many of the methods have not been replicated, examined for prolonged reductions, or tested in adolescent populations that would be most appropriate for drug abuse prevention. Similarly, it is clear is that a number of different strategies are effective under controlled experimental conditions, but not clear which strategies (or package of strategies) will successfully translate from the laboratory to ‘live’ interventions producing long-term changes. In sum, a full implementation of an evidence-based DRD prevention program for individuals who are genetically at-risk for more impulsive discounting (and thereby addictive disorders) is simply not supported by current literature.
Where these links are weakest are the future priorities for the field. Progress in more definitively identifying genetic correlates of DRD is essential. Equally, a leading priority going forward is for pilot research to determine the utility of the discounting reduction strategies in adolescent samples to identify promising strategies for prevention contexts. Such studies would be well-suited to focus on proximal outcomes, most obviously DRD itself, drug-related motivation, and short-term substance abuse outcomes. The basis for presuming downstream positive effects of reducing DRD, of reorienting an individual away from immediate impulses and toward making more future oriented decisions, is a logical step forward. Developing efficacious interventions holds wide implications, not only for addictive disorders, but also more broadly on behaviors such as good nutrition, financial planning, and health maintenance behaviors that impact wide swaths of the general public (Howlett et al., 2008; Bradford, 2010; Epstein et al., 2010).
An important step in the future will be to identify standardized norms for DRD performance. As discounting is typically only assessed in research contexts, there is currently no basis for determining who should be targeted as a result of their DRD performance. In order to provide secondary prevention programming, it is necessary who is and who is not at-risk. The absence of normative data is a prosaic but nonetheless significant impediment to progress in this area.
The final point worthy of discussion is whether targeting discounting based on genetic profiles is a worthwhile undertaking more broadly. Certainly, from the perspective of personalized medicine, optimization of any approach using idiographic data (genetic or otherwise) is desirable. However, given the small and inconsistent relationships between risk alleles and impulsive DRD, as well as the extra step involved in genotyping individuals, a more feasible alternative would be using standardized normative data for risk identification rather than genetic risk profiles. In addition, it is also notable that psychosocial factors, such as early life stress, have also been associated with more impulsive discounting (e.g., Lovallo et al., 2013) and may be useful for risk identification. In other words, at the current time, there is a much stronger rationale for an efficacious DRD prevention program to be deployed for individuals who are in high-risk groups or exhibit DRD rates that significantly deviate from standardized norms than based on genotype. Alternatively, among young adults, the misuse of alcohol, tobacco, and other drugs is so prevalent, indeed almost normative in the case of alcohol, and the links between DRD and diverse forms of externalizing behavior are so robust, that primary prevention (i.e., universal) may be a more appropriate strategy. Intervention matching and secondary prevention are typically assumed to be desirable to maximize impact and efficiency, but, in this case, if an efficacious multi-component impulsive DRD prevention program can be developed, it will be of relevance to the large majority of young adults.
Conclusion
The goal of this review was to evaluate the viability of DRD as a target for addictive disorders from the perspective of genetically-informed drug abuse prevention. A large body of research links impulsive DRD to drug abuse and supports the hypothesis that DRD is an endophenotype for addictive disorders. Additionally, current findings suggest that there are multiple promising methods—behavioral, pharmacological, and neuromodulatory—for acutely reducing DRD. However, the evidence for long-term changes and subsequent salutary health benefits is scant and no studies have directly assessed preventive interventions for impulsive DRD. Although significant gaps in knowledge remain and the wisdom of the long-term goal of genetically-informed drug abuse prevention via DRD is debatable, the current state of the science nonetheless suggests a more cautious conclusion, that impulsive DRD is more generally a promising target for drug abuse prevention and specific empirical investigations in this area are warranted.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors are grateful for funding support from NIH grant P30 DA027827 (JM) and from the Peter Boris Chair in Addictions Research (JM). The authors are also grateful for the editorial input of Max M. Owens.
References
Abela, A. R., and Chudasama, Y. (2014). Noradrenergic α2A-receptor stimulation in the ventral hippocampus reduces impulsive decision-making. Psychopharmacology (Berl.) 231, 521–531. doi: 10.1007/s00213-013-3262-y
Acheson, A., Vincent, A. S., Sorocco, K. H., and Lovallo, W. R. (2011). Greater discounting of delayed rewards in young adults with family histories of alcohol and drug use disorders: studies from the Oklahoma family health patterns project. Alcohol. Clin. Exp. Res. 35, 1607–1613. doi: 10.1111/j.1530-0277.2011.01507.x
Adriani, W., Rea, M., Baviera, M., Invernizzi, W., Carli, M., Ghirardi, O., et al. (2004). Acetyl-L-carnitine reduces impulsive behaviour in adolescent rats. Psychopharmacology (Berl.) 176, 296–304. doi: 10.1007/s00213-004-1892-9
Agrawal, A., and Lynskey, M. T. (2008). Are there genetic influences on addiction: evidence from family, adoption and twin studies. Addiction 103, 1069–1081. doi: 10.1111/j.1360-0443.2008.02213.x
Ainslie, G., and Monterosso, J. R. (2003). Building blocks of self-control: increased tolerance for delay with bundled rewards. J. Exp. Anal. Behav. 79, 37–48. doi: 10.1901/jeab.2003.79-37
Anderson, K. G., and Woolverton, W. L. (2005). Effects of clomipramine on self-control choice in Lewis and Fischer 344 rats. Pharmacol. Biochem. Behav. 80, 387–393. doi: 10.1016/j.pbb.2004.11.015
Anokhin, A. P., Golosheykin, S., Grant, J. D., and Heath, A. C. (2011). Heritability of delay discounting in adolescence: a longitudinal twin study. Behav. Genet. 41, 175–183. doi: 10.1007/s10519-010-9384-7
Anokhin, A. P., Grant, J. D., Mulligan, R. C., and Heath, A. C. (2015). The genetics of impulsivity: evidence for the heritability of delay discounting. Biol. Psychiatry 77, 887–894. doi: 10.1016/j.biopsych.2014.10.022
Ashe, M. L., Newman, M. G., and Wilson, S. J. (2015). Delay discounting and the use of mindful attention versus distraction in the treatment of drug addiction: a conceptual review. J. Exp. Anal. Behav. 103, 234–248. doi: 10.1002/jeab.122
Atance, C. M., and O’Neill, D. K. (2001). Episodic future thinking. Trends Cogn. Sci. 5, 533–539. doi: 10.1016/S1364-6613(00)01804-0
Audrain-McGovern, J., Rodriguez, D., Epstein, L. H., Cuevas, J., Rodgers, K., and Wileyto, E. P. (2009). Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug Alcohol Depend. 103, 99–106. doi: 10.1016/j.drugalcdep.2008.12.019
Baarendse, P. J., and Vanderschuren, L. J. (2012). Dissociable effects of monoamine reuptake inhibitors on distinct forms of impulsive behavior in rats. Psychopharmacology (Berl.) 219, 313–326. doi: 10.1007/s00213-011-2576-x
Bakermans-Kranenburg, M. J., and van Ijzendoorn, M. H. (2011). Differential susceptibility to rearing environment depending on dopamine-related genes: new evidence and a meta-analysis. Dev. Psychopathol. 23, 39–52. doi: 10.1017/S0954579410000635
Beck, R. C., and Triplett, M. F. (2009). Test–retest reliability of a group-administered paper–pencil measure of delay discounting. Exp. Clin. Psychopharmacol. 17, 345–355. doi: 10.1037/a0017078
Benoit, R. G., Gilbert, S. J., and Burgess, P. W. (2011). A neural mechanism mediating the impact of episodic prospection on farsighted decisions. J. Neurosci. 31, 6771–6779. doi: 10.1523/JNEUROSCI.6559-10.2011
Berry, M. S., Sweeney, M. M., Morath, J., Odum, A. L., and Jordan, K. E. (2014). The nature of impulsivity: visual exposure to natural environments decreases impulsive decision-making in a delay discounting task. PLoS ONE 9:e97915. doi: 10.1371/journal.pone.0097915
Bickel, W. K., Pitcock, J. A., Yi, R., and Angtuaco, E. J. C. (2009). Congruence of BOLD response across intertemporal choice conditions: fictive and real money gains and losses. J. Neurosci. 29, 8839–8846. doi: 10.1523/JNEUROSCI.5319-08.2009
Bickel, W. K., Yi, R., Landes, R. D., Hill, P. F., and Baxter, C. (2011). Remember the future: working memory training decreases delay discounting among stimulant addicts. Biol. Psychiatry 69, 260–265. doi: 10.1016/j.biopsych.2010.08.017
Bidwell, L. C., McClernon, F. J., and Kollins, S. H. (2011). Cognitive enhancers for the treatment of ADHD. Pharmacol. Biochem. Behav. 99, 262–274. doi: 10.1016/j.pbb.2011.05.002
Bizot, J.-C., David, S., and Trovero, F. (2011). Effects of atomoxetine, desipramine, d-amphetamine and methylphenidate on impulsivity in juvenile rats, measured in a T-maze procedure. Neurosci. Lett. 489, 20–24. doi: 10.1016/j.neulet.2010.11.058
Black, A. C., and Rosen, M. I. (2010). A money management-based substance use treatment increases valuation of future rewards. Addict. Behav. 36, 125–128. doi: 10.1016/j.addbeh.2010.08.014
Boettiger, C. A., Mitchell, J. M., Tavares, V. C., Robertson, M., Joslyn, G., D’Esposito, M., et al. (2007). Immediate reward bias in humans: fronto-parietal networks and a role for the catechol-O-methyltransferase 158Val/Val. genotype. J. Neurosci. 27, 14383–14391. doi: 10.1523/JNEUROSCI.2551-07.2007
Bradford, W. D. (2010). The association between individual time preferences and health maintenance habits. Med. Decis. Making 30, 99–112. doi: 10.1177/0272989X09342276
Broos, N., Loonstra, R., van Mourik, Y., Schetters, D., Schoffelmeer, A. N., Pattij, T., et al. (2014). Subchronic administration of atomoxetine causes an enduring reduction in context-induced relapse to cocaine seeking without affecting impulsive decision making. Addict. Biol. 20, 714–723. doi: 10.1111/adb.12168
Broos, N., Schmaal, L., Wiskerke, J., Kostelijk, L., Lam, T., Stoop, N., et al. (2012). The relationship between impulsive choice and impulsive action: a cross-species translational study. PLoS ONE 7:e36781. doi: 10.1371/journal.pone.0036781
Brunoni, A. R., and Vanderhasselt, M.-A. (2014). Working memory improvement with non-invasive brain stimulation of the dorsolateral prefrontal cortex: a systematic review and meta-analysis. Brain Cogn. 86, 1–9. doi: 10.1016/j.bandc.2014.01.008
Cardinal, R. N., Robbins, T. W., and Everitt, B. J. (2000). The effects of d-amphetamine, chlordiazepoxide, α-flupenthixol and behavioural manipulations on choice of signalled and unsignaled delayed reinforcement in rats. Psychopharmacology (Berl.) 152, 362–375. doi: 10.1007/s002130000536
Carter, R. M., Meyer, J. R., and Huettel, S. A. (2010). Functional neuroimaging of intertemporal choice models: a review. J. Neurosci. Psychol. Econ. 3, 27–45. doi: 10.1037/a0018046
Chen, J., Lipska, B. K., Halim, N., Ma, Q. D., Matsumoto, M., Melhem, S., et al. (2004). Functional analysis of genetic variation in catechol-O-methyltransferase (COMT): effects on mRNA, protein, and enzyme activity in postmortem human brain. Am. J. Hum. Genet. 75, 807–821. doi: 10.1086/425589
Cho, S. S., Ko, J. H., Pellecchia, G., Van Eimeren, T., Cilia, R., and Strafella, A. P. (2010). Continuous theta burst stimulation of right dorsolateral prefrontal cortex induces changes in impulsivity level. Brain Stimul. 3, 170–176. doi: 10.1016/j.brs.2009.10.002
Cho, S. S., Koshimori, Y., Aminian, K., Obeso, I., Rusjan, P., Lang, A. E., et al. (2015). Investing in the future: stimulation of the medial prefrontal cortex reduces discounting of delayed rewards. Neuropsychopharmacology 40, 546–553. doi: 10.1038/npp.2014.211
Cho, S. S., Pellecchia, G., Ko, J. H., Ray, N., Obeso, I., Houle, S., et al. (2012). Effect of continuous theta burst stimulation of the right dorsolateral prefrontal cortex on cerebral blood flow changes during decision making. Brain Stimul. 5, 116–123. doi: 10.1016/j.brs.2012.03.007
Crean, J., Richards, J. B., and de Wit, H. (2002). Effect of tryptophan depletion on impulsive behavior in men with or without a family history of alcoholism. Behav. Brain Res. 136, 349–357. doi: 10.1016/S0166-4328(02)00132-8
Daniel, T. O., Stanton, C. M., and Epstein, L. H. (2013a). The future is now: comparing the effect of episodic future thinking on impulsivity in lean and obese individuals. Appetite 71, 120–125. doi: 10.1016/j.appet.2013.07.010
Daniel, T. O., Stanton, C. M., and Epstein, L. H. (2013b). The future is now: reducing impulsivity and energy intake using episodic future thinking. Psychol. Sci. 24, 2339–2342. doi: 10.1177/0956797613488780
DeHart, W. B., and Odum, A. L. (2015). The effects of the framing of time on delay discounting. J. Exp. Anal. Behav. 103, 10–21. doi: 10.1002/jeab.125
de Wit, H., Enggasser, J. L., and Richards, J. B. (2002). Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology 27, 813–825. doi: 10.1016/S0893-133X(02)00343-3
Dixon, M. R., Hayes, L. J., Binder, L. M., Manthey, S., Sigman, C., and Zdanowski, D. M. (1998). Using a self-control training procedure to increase appropriate behavior. J. Appl. Behav. Anal. 31, 203–210. doi: 10.1901/jaba.1998.31-203
Dom, G., D’Haene, P., Hulstijn, W., and Sabbe, B. (2006). Impulsivity in abstinent early- and late-onset alcoholics: differences in self-report measures and a discounting task. Addiction 101, 50–59. doi: 10.1111/j.1360-0443.2005.01270.x
Dougherty, D. M., Charles, N. E., Mathias, C. W., Ryan, S. R., Olvera, R. L., Liang, Y., et al. (2014). Delay discounting differentiates pre-adolescents at high and low risk for substance use disorders based on family history. Drug Alcohol Depend. 143, 105–111. doi: 10.1016/j.drugalcdep.2014.07.012
Eisenberg, D. T. A., MacKillop, J., Modi, M., Beauchemin, J., Dang, D., Lisman, S. A., et al. (2007). Examining impulsivity as an endophenotype using a behavioral approach: a DRD2 TaqI A and DRD4 48-bp VNTR association study. Behav. Brain Funct. 3, 2. doi: 10.1186/1744-9081-3-2
Epstein, L. H., Salvy, S. J., Carr, K. A., Dearing, K. K., and Bickel, W. K. (2010). Food reinforcement, delay discounting and obesity. Physiol. Behav. 100, 438–445. doi: 10.1016/j.physbeh.2010.04.029
Evans, T. A., and Beran, M. J. (2007). Chimpanzees use self-distraction to cope with impulsivity. Biol. Lett. 3, 599–602. doi: 10.1098/rsbl.2007.0399
Falconer, D., Mackay, T., and Frankham, R. (1996). Introduction to quantitative genetics. Trends Genet. 12, 280. doi: 10.1016/0168-9525(96)81458-2
Fernie, G., Peeters, M., Gullo, M. J., Christiansen, P., Cole, J. C., Sumnall, H., et al. (2013). Multiple behavioural impulsivity tasks predict prospective alcohol involvement in adolescents. Addiction 108, 1916–1923. doi: 10.1111/add.12283
Figner, B., Knoch, D., and Johnson, E. (2010). Lateral prefrontal cortex and self-control in intertemporal choice. Nat. Neurosci. 13, 538–539. doi: 10.1038/nn.2516
Fisher, W. W., Thompson, R. H., Hagopian, L. P., Bowman, L. G., and Krug, A. (2000). Facilitating tolerance of delayed reinforcement during functional communication training. Behav. Modif. 24, 3–29. doi: 10.1177/0145445500241001
Garcia, J. R., MacKillop, J., Aller, E. L., Merriwether, A. M., Wilson, D. S., and Lum, J. K. (2010). Associations between dopamine D4 receptor gene variation with both infidelity and sexual promiscuity. PLoS ONE 5:e14162. doi: 10.1371/journal.pone.0014162
Gianotti, L. R. R., Figner, B., Ebstein, R. P., and Knoch, D. (2012). Why some people discount more than others: baseline activation in the dorsal PFC mediates the link between COMT genotype and impatient choice. Front. Neurosci. 6:54. doi: 10.3389/fnins.2012.00054
Gianotti, L. R. R., Knoch, D., Faber, P. L., Lehmann, D., Pascual-Marqui, R. D., Diezi, C., et al. (2009). Tonic activity level in the right prefrontal cortex predicts individuals’ risk taking. Psychol. Sci. 20, 33–38. doi: 10.1111/j.1467-9280.2008.02260.x
Goldman, D., Oroszi, G., and Ducci, F. (2005). The genetics of addictions: uncovering the genes. Nat. Rev. Genet. 6, 521–532. doi: 10.1038/nrg1635
Gottesman, I. I., and Gould, T. D. (2003). The endophenotype concept in psychiatry: etymology and strategic intentions. Am. J. Psychiatry 160, 636–645. doi: 10.1176/appi.ajp.160.4.636
Gray, J. C., and MacKillop, J. (2014). Genetic basis of delay discounting in frequent gamblers: examination of a priori candidates and exploration of a panel of dopamine-related loci. Brain Behav. 4, 812–821. doi: 10.1002/brb3.284
Grosch, J., and Neuringer, A. (1981). Self-control in pigeons under the Mischel paradigm. J. Exp. Anal. Behav. 35, 3–21. doi: 10.1901/jeab.1981.35-3
Hayes, S. C., Strosahl, K. D., and Wilson, K. G. (2011). Acceptance and Commitment Therapy, 2nd Edn, The Process and Practice of Mindful Change. New York, NY: Guilford Press.
Hecht, D., Walsh, V., and Lavidor, M. (2013). Bi-frontal direct current stimulation affects delay discounting choices. Cogn. Neurosci. 4, 7–11. doi: 10.1080/17588928.2011.638139
Hendrickson, K. L., and Rasmussen, E. B. (2013). Effects of mindful eating training on delay and probability discounting for food and money in obese and healthy-weight individuals. Behav. Res. Ther. 51, 399–409. doi: 10.1016/j.brat.2013.04.002
Hershfield, H. E., Goldstein, D. G., Sharpe, W. F., Fox, J., Yeykelis, L., Carstensen, L. L., et al. (2011). Increasing saving behavior through age-progressed renderings of the future self. J. Mark. Res. 48, S23–S37. doi: 10.1509/jmkr.48.SPL.S23
Herting, M. M., Schwartz, D., Mitchell, S. H., and Nagel, B. J. (2010). Delay discounting behavior and white matter microstructure abnormalities in youth with a family history of alcoholism. Alcohol. Clin. Exp. Res. 34, 1590–1602. doi: 10.1111/j.1530-0277.2010.01244.x
Hofmeyr, A., Ainslie, G., Charlton, R., and Ross, D. (2011). The relationship between addiction and reward bundling: an experiment comparing smokers and non-smokers. Addiction 106, 402–409. doi: 10.1111/j.1360-0443.2010.03166.x
Howlett, E., Kees, J., and Kemp, E. (2008). The role of self-regulation, future orientation, and financial knowledge in long-term financial decisions. J. Consum. Aff. 42, 223–242. doi: 10.1111/j.1745-6606.2008.00106.x
Isen, J. D., Sparks, J. C., and Iacono, W. G. (2014). Predictive validity of delay discounting behavior in adolescence: a longitudinal twin study. Exp. Clin. Psychopharmacol. 22, 434–443. doi: 10.1037/a0037340
Isles, A. R., Humby, T., Walters, E., and Wilkinson, L. S. (2004). Common genetic effects on variation in impulsivity and activity in mice. J. Neurosci. 24, 6733–6740. doi: 10.1523/JNEUROSCI.1650-04.2004
Johnson, M. W., and Bickel, W. K. (2002). Within-subject comparison of real and hypothetical money rewards in delay discounting. J. Exp. Anal. Behav. 77, 129–146. doi: 10.1901/jeab.2002.77-129
Jönsson, E. G., Nöthen, M. M., Grünhage, F., Farde, L., Nakashima, Y., Propping, P., et al. (1999). Polymorphisms in the dopamine D2 receptor gene and their relationships to striatal dopamine receptor density of healthy volunteers. Mol. Psychiatry 4, 290–296. doi: 10.1038/sj.mp.4000532
Kawamura, Y., Takahashi, T., Liu, X., Nishida, N., Noda, Y., Yoshikawa, A., et al. (2013). Variation in the DRD2 gene affects impulsivity in intertemporal choice. Open J. Psychiatry 3, 26–31. doi: 10.4236/ojpsych.2013.31005
Kekic, M., McClelland, J., Campbell, I., Nestler, S., Rubia, K., David, A. S., et al. (2014). The effects of prefrontal cortex transcranial direct current stimulation (tDCS) on food craving and temporal discounting in women with frequent food cravings. Appetite 78, 55–62. doi: 10.1016/j.appet.2014.03.010
Khan, K. S., Kunz, R., Kleijnen, J., and Antes, G. (2003). Five steps to conducting a systematic review. J. R. Soc. Med. 96, 118–121. doi: 10.1258/jrsm.96.3.118
Khurana, A., Romer, D., Betancourt, L. M., Brodsky, N. L., Giannetta, J. M., and Hurt, H. (2013). Working memory ability predicts trajectories of early alcohol use in adolescents: the mediational role of impulsivity. Addiction 108, 506–515. doi: 10.1111/add.12001
Kim, S., Bobeica, I., Gamo, N. J., Arnsten, A. F. T., and Lee, D. (2012). Effects of α-2A adrenergic receptor agonist on time and risk preference in primates. Psychopharmacology (Berl.) 219, 363–375. doi: 10.1007/s00213-011-2520-0
Kim-Spoon, J., McCullough, M. E., Bickel, W. K., Farley, J. P., and Longo, G. S. (2014). Longitudinal associations among religiousness, delay discounting, and substance use initiation in early adolescence. J. Res. Adolesc. 25, 36–43. doi: 10.1111/jora.12104
Kirby, K. N. (2009). One-year temporal stability of delay-discount rates. Psychon. Bull. Rev. 16, 457–462. doi: 10.3758/PBR.16.3.457
Kirby, K. N., and Guastello, B. (2001). Making choices in anticipation of similar future choices can increase self-control. J. Exp. Psychol. Appl. 7, 154–164. doi: 10.1037/1076-898X.7.2.154
Klapproth, F. (2012). The date-delay framing effect in temporal discounting depends on substance abuse. Behav. Processes 90, 420–423. doi: 10.1016/j.beproc.2012.03.013
Knoch, D., Gianotti, L. R. R., Baumgartner, T., and Fehr, E. (2010). A neural marker of costly punishment behavior. Psychol. Sci. 21, 337–342. doi: 10.1177/0956797609360750
Kollins, S. H. (2003). Delay discounting is associated with substance use in college students. Addict. Behav. 28, 1167–1173. doi: 10.1016/s0306-4603(02)00220-4
Kollins, S. H. (2007). Abuse liability of medications used to treat attention-deficit/hyperactivity disorder (ADHD). Am. J. Addict. 16(Suppl. 1), 35–42. doi: 10.1080/10550490601082775
Lawyer, S. R., Schoepflin, F., Green, R., and Jenks, C. (2011). Discounting of hypothetical and potentially real outcomes in nicotine-dependent and nondependent samples. Exp. Clin. Psychopharmacol. 19, 263–274. doi: 10.1037/a0024141
LeBoeuf, R. A. (2006). Discount rates for time versus dates: the sensitivity of discounting to time-interval description. J. Mark. Res. 43, 59–72. doi: 10.1509/jmkr.43.1.59
Lin, H., and Epstein, L. H. (2014). Living in the moment: effects of time perspective and emotional valence of episodic thinking on delay discounting. Behav. Neurosci. 128, 12–19. doi: 10.1037/a0035705
Logue, A. W., Rodriguez, M. L., Peña-Correal, T. E., and Mauro, B. C. (1984). Choice in a self-control paradigm: quantification of experience-based differences. J. Exp. Anal. Behav. 41, 53–67. doi: 10.1901/jeab.1984.41-53
Lovallo, W. R., Farag, N. H., Sorocco, K. H., Acheson, A., Cohoon, A. J., and Vincent, A. S. (2013). Early life adversity contributes to impaired cognition and impulsive behavior: studies from the Oklahoma Family Health Patterns Project. Alcohol. Clin. Exp. Res. 37, 616–623. doi: 10.1111/acer.12016
Luo, S., Ainslie, G., Pollini, D., Giragosian, L., and Monterosso, J. R. (2012). Moderators of the association between brain activation and farsighted choice. Neuroimage 59, 1469–1477. doi: 10.1016/j.neuroimage.2011.08.004
Ma, Y., Yuan, W., Jiang, X., Cui, W.-Y., and Li, M. D. (2014). Updated findings of the association and functional studies of DRD2/ANKK1 variants with addictions. Mol. Neurobiol. 51, 281–299. doi: 10.1007/s12035-014-8826-2
MacKillop, J. (2013). Integrating behavioral economics and behavioral genetics: delayed reward discounting as an endophenotype for addictive disorders. J Exp Anal Behav 99, 14–31.
MacKillop, J., Amlung, M. T., Few, L. R., Ray, L. A., Sweet, L. H., and Munafo, M. R. (2011). Delayed reward discounting and addictive behavior: a meta-analysis. Psychopharmacology (Berl.) 216, 305–321. doi: 10.1007/s00213-011-2229-0
MacKillop, J., Gray, J. C., Bidwell, L. C., Bickel, W. K, Sheffer, C., and McGeary, J. E. (in press). Genetic influences on delay discounting in smokers: examination of a priori candidates and exploration of dopamine-related haplotypes. Psychopharmacol.
MacKillop, J., and Kahler, C. W. (2009). Delayed reward discounting predicts treatment response for heavy drinkers receiving smoking cessation treatment. Drug Alcohol Depend. 104, 197–203. doi: 10.1016/j.drugalcdep.2009.04.020
MacKillop, J., Miller, J. D., Fortune, E., Maples, J., Lance, C. E., Campbell, W. K., et al. (2014). Multidimensional examination of impulsivity in relation to disordered gambling. Exp. Clin. Psychopharmacol. 22, 176–185. doi: 10.1037/a0035874
Madden, G. J., Begotka, A. M., Raiff, B. R., and Kastern, L. L. (2003). Delay discounting of real and hypothetical rewards. Exp. Clin. Psychopharmacol. 11, 139–145. doi: 10.1037/1064-1297.11.2.139
Madden, G. J., Smith, N. G., Brewer, A. T., Pinkston, J. W., and Johnson, P. S. (2008). Steady-state assessment of impulsive choice in Lewis and Fischer 344 rats: between-condition delay manipulations. J. Exp. Anal. Behav. 90, 333–344. doi: 10.1901/jeab.2008.90-333
Magen, E., Dweck, C. S., and Gross, J. J. (2008). The hidden-zero effect: representing a single choice as an extended sequence reduces impulsive choice. Psychol. Sci. 19, 648–649. doi: 10.1111/j.1467-9280.2008.02137.x
Malcolm, R., Book, S. W., Moak, D., DeVane, L., and Czepowicz, V. (2002). Clinical applications of modafinil in stimulant abusers: low abuse potential. Am. J. Addict. 11, 247–249. doi: 10.1080/10550490290088027
Marlatt, G. A. (2002). Buddhist philosophy and the treatment of addictive behavior. Cogn. Behav. Pract. 9, 44–50. doi: 10.1016/S1077-7229(02)80039-6
Mazur, J. E., and Logue, A. W. (1978). Choice in a ‘self-control’ paradigm: effects of a fading procedure. J. Exp. Anal. Behav. 30, 11–17. doi: 10.1901/jeab.1978.30-11
Metcalfe, J., and Mischel, W. (1999). A hot/cool-system analysis of delay of gratification: dynamics of willpower. Psychol. Rev. 106, 3–19. doi: 10.1037/0033-295X.106.1.3
Michealraj, K. A., Jatana, N., Jafurulla, Narayanan, L., Chattopadhyay, A., and Thelma, B. K. (2014). Functional characterization of rare variants in human dopamine receptor D4 gene by genotype-phenotype correlations. Neuroscience 262, 176–89. doi: 10.1016/j.neuroscience.2013.12.059
Mischel, W., and Ebbesen, E. B. (1970). Attention in delay of gratification. J. Pers. Soc. Psychol. 16, 329–337. doi: 10.1037/h0029815
Mischel, W., Ebbesen, E. B., and Raskoff Zeiss, A. (1972). Cognitive and attentional mechanisms in delay of gratification. J. Pers. Soc. Psychol. 21, 204–218. doi: 10.1037/h0032198
Mokdad, A. H., Marks, J. S., Stroup, D. F., and Gerberding, J. L. (2004). Actual causes of death in the United States, 2000. JAMA 291, 1238–1245. doi: 10.1001/jama.291.10.1238
Monterosso, J., and Ainslie, G. (2007). The behavioral economics of will in recovery from addiction. Drug Alcohol Depend. 90(Suppl. 1), S100–S111. doi: 10.1016/j.drugalcdep.2006.09.004
Morrison, K. L., Madden, G. J., Odum, A. L., Friedel, J. E., and Twohig, M. P. (2014). Altering impulsive decision making with an acceptance-based procedure. Behav. Ther. 45, 630–639. doi: 10.1016/j.beth.2014.01.001
Mota, N. R., Aruajo-Jnr, E. V., Paixao-Cortes, V. R., Bortolini, M. C., and Bau, C. H. D. (2012). Linking dopamine neurotransmission and neurogenesis: the evolutionary history of the NTAD (NCAM1-TTC12-ANKK1-DRD2) gene cluster. Genet. Mol. Biol. 35, 912–918. doi: 10.1590/S1415-47572012000600004
Muir, V. J., and Perry, C. M. (2010). Guanfacine extended-release: in attention deficit hyperactivity disorder. Drugs 70, 1693–1702. doi: 10.2165/11205940-000000000-00000
Murphy, C. M., and MacKillop, J. (2014). Mindfulness as a strategy for coping with cue-elicited cravings for alcohol: an experimental examination. Alcohol. Clin. Exp. Res. 38, 1134–1142. doi: 10.1111/acer.12322
Myerson, J., Green, L., and Warusawitharana, M. (2001). Area under the curve as a measure of discounting. J. Exp. Anal. Behav. 76, 235–243. doi: 10.1901/jeab.2001.76-235
Oak, J. N., Oldenhof, J., and Van Tol, H. H. (2000). The dopamine D4 receptor: one decade of research. Eur. J. Pharmacol. 405, 303–327. doi: 10.1016/S0014-2999(00)00562-8
Oberlin, B. G., and Grahame, N. J. (2009). High-alcohol preferring mice are more impulsive than low-alcohol preferring mice as measured in the delay discounting task. Alcohol. Clin. Exp. Res. 33, 1294–1303. doi: 10.1111/j.1530-0277.2009.00955.x
Odum, A. L. (2011). Delay discounting: I’m a k, you’re a k. J. Exp. Anal. Behav. 96, 427–439. doi: 10.1901/jeab.2011.96-423
Paloyelis, Y., Asherson, P., Mehta, M. A., Faraone, S. V., and Kuntsi, J. (2010). DAT1 and COMT effects on delay discounting and trait impulsivity in male adolescents with attention deficit/hyperactivity disorder and healthy controls. Neuropsychopharmacology 35, 2414–2426. doi: 10.1038/npp.2010.124
Patak, M., and Reynolds, B. (2007). Question-based assessments of delay discounting: do respondents spontaneously incorporate uncertainty into their valuations for delayed rewards? Addict. Behav. 32, 351–357. doi: 10.1016/j.addbeh.2006.03.034
Perkel, J. K., Bentzley, B. S., Andrzejewski, M. E., and Martinetti, M. P. (2015). Delay discounting for sucrose in alcohol-preferring and nonpreferring rats using a sipper tube within-sessions task. Alcohol. Clin. Exp. Res. 39, 232–238. doi: 10.1111/acer.12632
Perry, J. L., Stairs, D. J., and Bardo, M. T. (2008). Impulsive choice and environmental enrichment: effects of d-amphetamine and methylphenidate. Behav. Brain Res. 193, 48–54. doi: 10.1016/j.bbr.2008.04.019
Peters, J., and Büchel, C. (2010). Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron 66, 138–148. doi: 10.1016/j.neuron.2010.03.026
Peters, J., and Büchel, C. (2011). The neural mechanisms of inter-temporal decision-making: understanding variability. Trends Cogn. Sci. 15, 227–239. doi: 10.1016/j.tics.2011.03.002
Petry, N. M., Kirby, K. N., and Kranzler, H. R. (2002). Effects of gender and family history of alcohol dependence on a behavioral task of impulsivity in healthy subjects. J. Stud. Alcohol 63, 83–90.
Pietras, C. J., Cherek, D. R., Lane, S. D., Tcheremissine, O. V., and Steinberg, J. L. (2003). Effects of methylphenidate on impulsive choice in adult humans. Psychopharmacology (Berl.) 170, 390–398. doi: 10.1007/s00213-003-1547-2
Pohjalainen, T., Rinne, J. O., Någren, K., Lehikoinen, P., Anttila, K., Syvälahti, E. K. G., et al. (1998). The A1 allele of the human D2 dopamine receptor gene predicts low D2 receptor availability in healthy volunteers. Mol. Psychiatry 3, 256–260. doi: 10.1038/sj.mp.4000350
Ray, L. A., Mackillop, J., and Monti, P. M. (2010). Subjective responses to alcohol consumption as endophenotypes: advancing behavioral genetics in etiological and treatment models of alcoholism. Subst. Use Misuse 45, 1742–1765. doi: 10.3109/10826084.2010.482427
Read, D., Frederick, S., Orsel, B., and Rahman, J. (2005). Four score and seven years from now: the date/delay effect in temporal discounting. Manag. Sci. 51, 1326–1335. doi: 10.1287/mnsc.1050.0412
Renda, C. R., Stein, J. S., and Madden, G. J. (2015). Working-memory training: effects on delay discounting in male long evans rats. J. Exp. Anal. Behav. 103, 50–61. doi: 10.1002/jeab.115
Richards, J. B., Lloyd, D. R., Kuehlewind, B., Militello, L., Paredez, M., Solberg Woods, L., et al. (2013). Strong genetic influences on measures of behavioral-regulation among inbred rat strains. Genes Brain Behav. 12, 490–502. doi: 10.1111/gbb.12050
Robinson, E. S. J., Eagle, D. M., Mar, A. C., Bari, A., Banerjee, G., Jiang, X., et al. (2008). Similar effects of the selective noradrenaline reuptake inhibitor atomoxetine on three distinct forms of impulsivity in the rat. Neuropsychopharmacology 33, 1028–1037. doi: 10.1038/sj.npp.1301487
Savitz, J., Hodgkinson, C. A., Martin-Soelch, C., Shen, P.-H., Szczepanik, J., Nugent, A. C., et al. (2013). DRD2/ANKK1 Taq1A polymorphism (rs1800497) has opposing effects on D2/3 receptor binding in healthy controls and patients with major depressive disorder. Int. J. Neuropsychopharmacol. 16, 2095–2101. doi: 10.1017/S146114571300045X
Schmaal, L., Goudriaan, A. E., Joos, L., Dom, G., Pattij, T., van den Brink, W., et al. (2014). Neural substrates of impulsive decision making modulated by modafinil in alcohol-dependent patients. Psychol. Med. 44, 2787–2798. doi: 10.1017/S0033291714000312
Schweitzer, J. B., and Sulzer-Azaroff, B. (1988). Self-control: teaching tolerance for delay in impulsive children. J. Exp. Anal. Behav. 50, 173–186. doi: 10.1901/jeab.1988.50-173
Sheffer, C. E., Christensen, D. R., Landes, R., Carter, L. P., Jackson, L., and Bickel, W. K. (2014). Delay discounting rates: a strong prognostic indicator of smoking relapse. Addict. Behav. 39, 1682–1689. doi: 10.1016/j.addbeh.2014.04.019
Shiels, K., Hawk, L. W., Reynolds, B., Mazzullo, R. J., Rhodes, J. D., Pelham, W. E., et al. (2009). Effects of methylphenidate on discounting of delayed rewards in attention deficit/hyperactivity disorder. Exp. Clin. Psychopharmacol. 17, 291–301. doi: 10.1037/a0017259
Simon, N. W., Beas, B. S., Montgomery, K. S., Haberman, R. P., Bizon, J. L., and Setlow, B. (2013). Prefrontal cortical-striatal dopamine receptor mRNA expression predicts distinct forms of impulsivity. Eur. J. Neurosci. 37, 1779–1788. doi: 10.1111/ejn.12191
Smith, C. T., and Boettiger, C. A. (2012). Age modulates the effect of COMT genotype on delay discounting behavior. Psychopharmacology (Berl.) 222, 609–617. doi: 10.1007/s00213-012-2653-9
Sparks, J. C., Isen, J. D., and Iacono, W. G. (2014). Preference on cash-choice task predicts externalizing outcomes in 17-year-olds. Behav. Genet. 44, 102–112. doi: 10.1007/s10519-013-9638-2
Stein, J. S., Pinkston, J. W., Brewer, A. T., Francisco, M. T., and Madden, G. J. (2012). Delay discounting in Lewis and Fischer 344 rats: steady-state and rapid-determination adjusting-amount procedures. J. Exp. Anal. Behav. 97, 305–321. doi: 10.1901/jeab.2012.97-305
Stein, J. S., Smits, R. R., Johnson, P. S., Liston, K. J., and Madden, G. J. (2013). Effects of reward bundling on male rats’ preference for larger-later food rewards. J. Exp. Anal. Behav. 99, 150–158. doi: 10.1002/jeab.11
Steinberg, L. (2010). A behavioral scientist looks at the science of adolescent brain development. Brain Cogn. 72, 160–164. doi: 10.1016/j.bandc.2009.11.003
Sun, H., Cocker, P. J., Zeeb, F. D., and Winstanley, C. A. (2012). Chronic atomoxetine treatment during adolescence decreases impulsive choice, but not impulsive action, in adult rats and alters markers of synaptic plasticity in the orbitofrontal cortex. Psychopharmacology (Berl.) 219, 285–301. doi: 10.1007/s00213-011-2419-9
Sweitzer, M. M., Halder, I., Flory, J. D., Craig, A. E., Gianaros, P. J., Ferrell, R. E., et al. (2013). Polymorphic variation in the dopamine D4 receptor predicts delay discounting as a function of childhood socioeconomic status: evidence for differential susceptibility. Soc. Cogn. Affect. Neurosci. 8, 499–508. doi: 10.1093/scan/nss020
Tovo-Rodrigues, L., Rohde, L. A., Roman, T., Schmitz, M., Polanczyk, G., Zeni, C., et al. (2012). Is there a role for rare variants in DRD4 gene in the susceptibility for ADHD? Searching for an effect of allelic heterogeneity. Mol. Psychiatry 17, 520–526. doi: 10.1038/mp.2011.12
Treutlein, J., and Rietschel, M. (2011). Genome-wide association studies of alcohol dependence and substance use disorders. Curr. Psychiatry Rep. 13, 147–155. doi: 10.1007/s11920-011-0176-4
Tunbridge, E. M., Bannerman, D. M., Sharp, T., and Harrison, P. J. (2004). Catechol-O-methyltransferase inhibition improves set-shifting performance and elevates stimulated dopamine release in the rat prefrontal cortex. J. Neurosci. 24, 5331–5335. doi: 10.1523/JNEUROSCI.1124-04.2004
Turner, M., Wilding, E., Cassidy, E., and Dommett, E. J. (2013). Effects of atomoxetine on locomotor activity and impulsivity in the spontaneously hypertensive rat. Behav. Brain Res. 243, 28–37. doi: 10.1016/j.bbr.2012.12.025
Uhl, G. R., and Grow, R. W. (2004). The burden of complex genetics in brain disorders. Arch. Gen. Psychiatry 61, 223–229. doi: 10.1001/archpsyc.61.3.223
Upadhyaya, H. P., Desaiah, D., Schuh, K. J., Bymaster, F. P., Kallman, M. J., Clarke, D. O., et al. (2013). A review of the abuse potential assessment of atomoxetine: a nonstimulant medication for attention-deficit/hyperactivity disorder. Psychopharmacology (Berl.) 226, 189–200. doi: 10.1007/s00213-013-2986-z
Van Dillen, L. F., Papies, E. K., and Hofmann, W. (2013). Turning a blind eye to temptation: how cognitive load can facilitate self-regulation. J. Pers. 104, 427–443. doi: 10.1037/a0031262
van Gaalen, M. M., van Koten, R., Schoffelmeer, A. N., and Vanderschuren, L. J. (2006). Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol. Psychiatry 60, 66–73. doi: 10.1016/j.biopsych.2005.06.005
Versland, A., and Rosenberg, H. (2007). Effect of brief imagery interventions on craving in college student smokers. Addict. Res. Theory 15, 177–187. doi: 10.1080/16066350701200582
Weinshilboum, R. M., Otterness, D. M., and Szumlanski, C. L. (1999). Methylation pharmacogenetics: catechol O-methyltransferase, thiopurine methyltransferase, and histamine N-methyltransferase. Annu. Rev. Pharmacol. Toxicol. 39, 19–52. doi: 10.1146/annurev.pharmtox.39.1.19
Wesley, M. J., and Bickel, W. K. (2014). Remember the future II: meta-analyses and functional overlap of working memory and delay discounting. Biol. Psychiatry 75, 435–448. doi: 10.1016/j.biopsych.2013.08.008
Wilens, T. E. (2006). Mechanism of action of agents used in attention-deficit/hyperactivity disorder. J. Clin. Psychiatry 67(Suppl. 8), 32–37.
Wilhelm, C. J., and Mitchell, S. H. (2008). Rats bred for high alcohol drinking are more sensitive to delayed and probabilistic outcomes. Genes Brain Behav. 7, 705–713. doi: 10.1111/j.1601-183X.2008.00406.x
Wilhelm, C. J., Reeves, J. M., Phillips, T. J., and Mitchell, S. H. (2007). Mouse lines selected for alcohol consumption differ on certain measures of impulsivity. Alcohol. Clin. Exp. Res. 31, 1839–1845. doi: 10.1111/j.1530-0277.2007.00508.x
Keywords: substance use disorders, drug abuse, addiction, behavior economics, delayed reward discounting, behavioral economics, intertemporal choice
Citation: Gray JC and MacKillop J (2015) Impulsive delayed reward discounting as a genetically-influenced target for drug abuse prevention: a critical evaluation. Front. Psychol. 6:1104. doi: 10.3389/fpsyg.2015.01104
Received: 27 April 2015; Accepted: 17 July 2015;
Published: 01 September 2015.
Edited by:
Jessica McDermott Sales, Emory University, USAReviewed by:
Bernd Figner, Columbia University, USARaffaella Calati, IRCCS Centro San Giovanni di Dio, Fatebenefratelli, Italy
Copyright © 2015 Gray and MacKillop. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: James MacKillop, Department of Psychiatry and Behavioural Neurosciences, Peter Boris Centre for Addictions Research, McMaster University – St Joseph’s Healthcare Hamilton, 100 West 5th Street, Hamilton, ON L8N 3K7, Canada, jmackill@mcmaster.ca