Zsuzsika Sjoerds
Judy Luigjes
Wim van den Brink
Damiaan Denys
Murat Yücel- 1Department of Psychiatry, VU University Medical Center, Amsterdam, Netherlands
- 2Department of Psychiatry, Academic Medical Center, University of Amsterdam, Amsterdam, Netherlands
- 3Brain Imaging Center, Academic Medical Center, University of Amsterdam, Amsterdam, Netherlands
- 4Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- 5Netherlands Institute for Neuroscience, Institute of the Royal Netherlands Academy of Arts and Sciences, Amsterdam, Netherlands
- 6Monash Clinical and Imaging Neuroscience, Monash Biomedical Imaging Facility, School of Psychological Sciences, Monash University, Melbourne, VIC, Australia
Introduction
This Research Topic in Addictive Disorders and Behavioral Dyscontrol, a section of the journal Frontiers in Psychiatry, focuses on motivational mechanisms underlying substance use, abuse, and dependence. This is an important topic in addiction research, since most psychobiological models of drug addiction consider the motivational or reinforcing aspects of drugs to be the central drive for drug use [for an extensive overview of craving and motivation-based addiction models, see a review by Skinner and Aubin (1)]. However, motivational models alone do not seem to fully cover the complexity of addictive behaviors observed in humans, especially in relation to the more chronic, highly relapsing patterns of addiction. In recent years, habit formation theory has become more prominent for explaining the persistent pattern of addiction despite decreasing reinforcing properties of the drug and increasing negative consequences of continued drug use. According to this model, there is a shift from motivated goal-directed behavior toward more automatic and habitual behavior over the course of long-term drug abuse, which is extensively described by Everitt and Robbins (2–4). Within this framework, which is derived primarily from animal studies, habits and goal-directed behaviors (the latter being behavior motivated by the desirability of the goal) are opposing ends of the spectrum. However, human behavior is more complex than observed in laboratory animal settings, as is confirmed by clinical observations, and translation from animal to human behavior remains a challenge. Moreover, motivations and habits could be more intertwined than previously assumed. Therefore, some questions rise considering the construct of habits: is habitual behavior completely devoid of motivational underpinnings (i.e., goal-directedness) or is it possible that motivation still plays a role in habitual behavior? Moreover, is habit a unitary construct or are there different types of habituation? In this article, we present considerations in the context of human addiction and motivation in order to open the discussion toward a more careful consideration of the concept of habit and its role in drug addiction.
Motivation
In most motivational models of addiction, positive reinforcements (or rewards) are highlighted as the initial and primary drive for drug use. To this end, the incentive sensitization model by Robinson and Berridge (5) states that drug cues can attain incentive saliency when repeated exposure to drugs and drug-related cues (such as drug paraphernalia) enhances the memory of the anticipated reward. In other cases, negative reinforcement gains importance when drug intake is reinforced by the avoidance of aversive consequences induced by drug withdrawal, as described by Solomon and colleagues as the opponent-process theory of motivation (6, 7), as well as the concept of “allostatic load,” described by Koob and colleagues in classical avoidance theories (8–11). Together, by including (positive or negative) reinforcement as a central drive for drug abuse, these motivational addiction models imply a high level of goal-directedness.
Habits
Animal lesion and devaluation studies, however, show that over the course of progressive drug use, reinforcing properties of drugs lose their value, and goal-directedness decreases. With decreasing goal-directedness over time, regard for associated outcomes decreases, and drug use behavior is progressively driven by drug-related stimuli only (12–15). This stimulus-driven behavior is often described as habitual behavior and in the context of a drug-taking “habit” it has been operationalized as behavior that has become automatized, highly stimulus bound, inflexible, and insensitive to the associated outcomes (positive or negative) (2, 3, 16). It is the habit formation model, primarily based on rodent studies, that describes this shift from goal-directed toward habitual drug use behavior. This idea of decreasing relevance of reinforcing effects is not new. More than 50 years ago, Chein and colleagues (17) already questioned the notion of addiction as a sole consequence of rewarded behavior. They showed that a large proportion of healthy individuals, who had consumed various drugs, found the effects pleasurable; however, they did not go on to become dependent drug users. Furthermore, they showed that a small percentage of those who were dependent found the initial drug experience unpleasant, but nevertheless went on to become chronic users. Accordingly, the role of craving in addiction does not seem to have a one-on-one relationship with consumption, since craving without consumption can occur, but more importantly, consumption without craving can also occur. Since in motivational drug use models craving plays a major role within a larger goal-directed decision-making framework (18–20), consumption without an internal motivational drive such as craving is not covered by these motivational models of addiction. In other words, the initial importance of the rewarding properties of drugs as is emphasized by several motivational models of addiction does not always appear to be the key drive of ongoing drug use. Therefore, motivation models, although very adequate on many occasions, do not cover all aspects of drug use, especially when it comes to long-term chronic dependence. Applying the habit formation model, albeit in a more refined manner, could offer a solution here.
Although habit formation seems to be a very well suited model to cover aspects of drug addiction that are not enclosed in motivational models, some further considerations are required in order to improve the translation of this animal-based model to the human equivalent of addictive behavior. The seemingly simple stimulus–response contingencies described in the habit formation model are mainly based on experiments with lever-pressing rats. However, in its current form, the habit formation model represents habitual behavior as a singular construct opposing goal-directed behavior, which may be too simplistic for encompassing more complex human habitual patterns, which may be intertwined with motivational drives in some occasions. Note that we do not question the increasing role of habituation in addiction outlined by this model and do stress the important contribution it has made to our understanding of chronic relapsing drug use. In fact, some recent human neurobiological studies also indicate the presence of habit formation and its associated neural shift from ventral to dorsolateral striatum in chronic drug dependent patients (21, 22). However, the question is whether complex human behavior can be sufficiently explained by simple stimulus–response actions as described in the current habit formation model. Perhaps a next step involving a more nuanced concept of habituation may improve the model for translation to human behavior.
Different Types of Habit
Patient self-reports confirm that rewarding or pleasurable properties of drugs play a decreasing role over the course of long-term addiction (23). After repeating the same behavior (or sequence of behaviors) over many years, habituation undeniably becomes more relevant, and stronger associations develop between various stimuli and linked responses. However, there may be different types of habituation: for example, imagine that a patient who has been abstinent for months is visiting an old and familiar drinking companion. He has been in the house of his friend where they used to drink many times before. The patient suddenly finds himself walking to the fridge of his friend’s kitchen to take a beer. This behavior seems to be based on a stimulus (S) – response (R) contingency (S: house of friend; R: taking and drinking a beer). The behavior may be the result of a “simple” (or motor) habit without the co-occurrence of any specific thought, feeling or urge (such as subjective craving), in the same way other people may automatically wash their hands after going to the bathroom. In these types of habits, the role of goal-directedness at the time of performing the behavior is likely to be absent. Alternatively, the (habitual) behavior could also be the result of an underlying (motivational) urge such as increased craving elicited by the environment of his friend’s house in which he used to drink. In this latter scenario, craving modulates the S–R connection. One could argue that when craving modulates the S–R connection, the drinking can still be a “habitual” response to craving. However, in contrast to a simple S–R contingency, behavior that is modulated by craving or any other emotional/motivational state seems at least partly goal-directed (i.e., to reduce craving). In this situation, outcome devaluation (i.e., craving reduction) is expected to influence the behavior, and therefore the behavior would not be habitual according to the dichotomy of goal-directed versus habitual behavior (24). Nevertheless, the stimulus-driven and repetitive nature of this reaction to an emotional or motivational state may result in a behavioral sequence that resembles “simple” S–R (motor) habits in other aspects: in both cases with repetition over time less alternative responses seem available and the behavior becomes less flexible and more persistent. It becomes more and more difficult to adapt the behavior, even if it leads to undesirable consequences. As behavior that leads to craving-relief can be considered a form of positive reinforcement, negative reinforcement is also an important motivational drive underlying addictive behavior. Compulsive behavior refers to a repeated response pattern to a negative emotional state (e.g., tension, anxiety, or withdrawal) leading to undesirable long-term consequences (Luigjes and colleagues, in preparation). Compulsivity has been defined as the urge to carry out the act; in the experience of the individual that particular act “has to” be performed (25). Contrarily, simple S–R (motor) habits are characterized by direct S–R contingencies without modulation by urges, thoughts or feelings, but are rather driven by direct motor-schemes. In the literature, the concept of habit is frequently used interchangeably or in combination with compulsivity (e.g., “addiction as a maladaptive compulsive habit” or “compulsive drug seeking”) to indicate a persistent use of drugs in the face of negative consequences (26). It is our view that compulsive behavior can be related to motivational habits, but that it is distinct from motor habits. Yet, both compulsivity and motor habits are likely to play a role in addiction. Other motivational mechanisms related to persistent drug use, such as attentional bias and approach bias, may also drive the onset of habitual behavior in a less conscious and more implicit manner, and could therefore also contribute to motivational habits as proposed before.
Conclusion
In conclusion, habits have been studied in animals and healthy volunteers [see Table 1 for examples of paradigms applied in (healthy) human studies on habits, and for a recent, more complete overview, see Ref. (27)], but very little is known about pathological/maladaptive forms of habit formation such as in addiction, and currently no gold standard for the study of habits in addictive disorders is available. Addiction is a multi-faceted and complicated series of processes, and in clinical practice simple S–R contingencies and S–R connections modulated by motivational states may often co-occur and may be difficult to disentangle from each other. Nevertheless, in our scientific endeavors, we need to better understand addiction and deconstruct its constituent and complex behavioral expressions into more precise and generalizable scientific models. To this end, we need to be more precise in classifying behaviors and develop a more refined definition of habit formation. It may be an oversimplification to only think of habitual addictive behavior as “simple” S–R contingencies. Moreover, even in non-addictive habitual behavior, goal-directedness and volition may still have some relevance. If both simple S–R contingencies and repetitive response patterns to emotional/motivational states are referred to as habits (which is the case for e.g., compulsive behavior) it may be useful to distinguish different kinds of habits: motivational habits (comprising an emotional/compulsive drive) versus motor habits. In order to improve our understanding of these processes, a more comprehensive investigation of habitual addictive behaviors is warranted in order to determine the underlying mechanisms and possible differences between patients with an addiction and patients with other disorders also associated with compulsive or habitual behavior, such as patients with an obsessive–compulsive disorder and patients with impulse control disorders (28). Both motivational and motor types of habituation may take a more prominent role in regulating drug use during the progression from early to chronic forms of addiction (2, 3, 29). Moreover, motor habits that directly result from stimuli in the environment may need a different therapeutic approach than habits resulting from a reactive pattern to motivational/emotional states. We expect, as a result of these developments in research, that staging and profiling will become paramount in future treatment of addiction (30). As a next step in addiction research, we recommend the development of a more refined conceptualization and improved measurement of habits in addictive behavior based on a closer examination of the potential motivational underpinnings associated with habitual, automatic patterns in long-term drug addiction.
Table 1. Examples of paradigms used to measure habit-related constructs in humans.
References
1. Skinner MD, Aubin HJ. Craving’s place in addiction theory: contributions of the major models. Neurosci Biobehav Rev (2010) 34(4):606–23. doi: 10.1016/j.neubiorev.2009.11.024
2. Everitt BJ, Robbins TW. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci (2005) 8(11):1481–9. doi:10.1038/nn1579
3. Everitt BJ, Belin D, Economidou D, Pelloux Y, Dalley JW, Robbins TW. Review. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philos Trans R Soc Lond B Biol Sci (2008) 363(1507):3125–35. doi:10.1098/rstb.2008.0089
4. Everitt BJ, Robbins TW. From the ventral to the dorsal striatum: devolving views of their roles in drug addiction. Neurosci Biobehav Rev (2013) 37(9 Pt A):1946–54. doi:10.1016/j.neubiorev.2013.02.010
5. Robinson TE, Berridge KC. The neural basis of drug craving: an incentive-sensitization theory of addiction. Brain Res Brain Res Rev (1993) 18(3):247–91. doi:10.1016/0165-0173(93)90013-P
6. Solomon RL. The opponent-process theory of acquired motivation: the costs of pleasure and the benefits of pain. Am Psychol (1980) 35(8):691–712. doi:10.1037/0003-066X.35.8.691
7. Solomon RL, Corbit JD. An opponent-process theory of motivation. II. Cigarette addiction. J Abnorm Psychol (1973) 81(2):158–71. doi:10.1037/h0034534
8. Ahmed SH, Koob GF. Transition from moderate to excessive drug intake: change in hedonic set point. Science (1998) 282(5387):298–300. doi:10.1126/science.282.5387.298
9. Koob GF, Le Moal M. Drug addiction, dysregulation of reward, and allostasis. Neuropsychopharmacology (2001) 24(2):97–129. doi:10.1016/S0893-133X(00)00195-0
10. Koob GF, Le Moal M. Review. Neurobiological mechanisms for opponent motivational processes in addiction. Philos Trans R Soc Lond B Biol Sci (2008) 363(1507):3113–23. doi:10.1098/rstb.2008.0094
11. Koob GF, Markou A, Weiss F, Schulteis G. Opponent process and drug dependence: neurobiological mechanisms. Semin Neurosci (1993) 5:351–8. doi:10.1016/S1044-5765(05)80043-0
12. Zapata A, Minney VL, Shippenberg TS. Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J Neurosci (2010) 30(46):15457–63. doi:10.1523/JNEUROSCI.4072-10.2010
13. Corbit LH, Nie H, Janak PH. Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol Psychiatry (2012) 72(5):389–95. doi:10.1016/j.biopsych.2012.02.024
14. Robbins TW, Everitt BJ. Drug addiction: bad habits add up. Nature (1999) 398(6728):567–70. doi:10.1038/19208
15. Dickinson A, Wood N, Smith JW. Alcohol seeking by rats: action or habit? Q J Exp Psychol B (2002) 55(4):331–48. doi:10.1080/0272499024400016
16. Tiffany ST. A cognitive model of drug urges and drug-use behavior: role of automatic and nonautomatic processes. Psychol Rev (1990) 97(2):147–68. doi:10.1037/0033-295X.97.2.147
17. Chein I. The Road to H: Narcotics, Delinquency, and Social Policy. New York: Basic Books (1964).
18. Cox WM, Klinger E. A motivational model of alcohol use. J Abnorm Psychol (1988) 97(2):168–80. doi:10.1037/0021-843X.97.2.168
19. Breiner MJ, Stritzke WG, Lang AR. Approaching avoidance. A step essential to the understanding of craving. Alcohol Res Health (1999) 23(3):197–206.
21. Sjoerds Z, de Wit S, van den Brink W, Robbins TW, Beekman AT, Penninx BW, et al. Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol dependent patients. Transl Psychiatry (2013) 17(3):e337. doi:10.1038/tp.2013.107
22. Vollstadt-Klein S, Wichert S, Rabinstein J, Buhler M, Klein O, Ende G, et al. Initial, habitual and compulsive alcohol use is characterized by a shift of cue processing from ventral to dorsal striatum. Addiction (2010) 105(10):1741–9. doi:10.1111/j.1360-0443.2010.03022.x
23. Kennett J, Matthews S, Snoek A. Pleasure and addiction. Front Psychiatry (2013) 4:117. doi:10.3389/fpsyt.2013.00117
24. de Wit S, Dickinson A. Associative theories of goal-directed behaviour: a case for animal-human translational models. Psychol Res (2009) 73(4):463–76. doi:10.1007/s00426-009-0230-6
25. Denys D. Compulsivity and free will. CNS Spectr (2013). doi:10.1017/S1092852913000412. [Epub ahead of print].
26. Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ. High impulsivity predicts the switch to compulsive cocaine-taking. Science (2008) 320(5881):1352–5. doi:10.1126/science.1158136
27. Dolan RJ, Dayan P. Goals and habits in the brain. Neuron (2013) 80(2):312–25. doi:10.1016/j.neuron.2013.09.007
28. Fontenelle LF, Oostermeijer S, Harrison BJ, Pantelis C, Yucel M. Obsessive-compulsive disorder, impulse control disorders and drug addiction: common features and potential treatments. Drugs (2011) 71(7):827–40. doi:10.2165/11591790-000000000-00000
29. Vanderschuren LJMJ, Everitt BJ. Drug seeking becomes compulsive after prolonged cocaine self-administration. Science (2004) 305(5686):1017–9. doi:10.1126/science.1098975
30. van den Brink W, Schippers G. Stagering en profilering bij verslaving. Tijdschr Psychiatr (2012) 54(11):941–8.
31. Gluck MA, Bower GH. From conditioning to category learning: an adaptive network model. J Exp Psychol Gen (1988) 117(3):227–47. doi:10.1037/0096-3445.117.3.227
32. Knowlton BJ, Squire LR, Gluck MA. Probabilistic classification learning in amnesia. Learn Mem (1994) 1(2):106–20.
33. Knowlton BJ, Mangels JA, Squire LR. A neostriatal habit learning system in humans. Science (1996) 273(5280):1399–402. doi:10.1126/science.273.5280.1399
34. Foerde K, Knowlton BJ, Poldrack RA. Modulation of competing memory systems by distraction. Proc Natl Acad Sci U S A (2006) 103(31):11778–83. doi:10.1073/pnas.0602659103
35. Bayley PJ, Frascino JC, Squire LR. Robust habit learning in the absence of awareness and independent of the medial temporal lobe. Nature (2005) 436(7050):550–3. doi:10.1038/nature03857
36. Valentin VV, Dickinson A, O’Doherty JP. Determining the neural substrates of goal-directed learning in the human brain. J Neurosci (2007) 27(15):4019–26. doi:10.1523/JNEUROSCI.0564-07.2007
37. Schwabe L, Wolf OT. Stress prompts habit behavior in humans. J Neurosci (2009) 29(22):7191–8. doi:10.1523/JNEUROSCI.0979-09.2009
38. Schwabe L, Tegenthoff M, Hoffken O, Wolf OT. Simultaneous glucocorticoid and noradrenergic activity disrupts the neural basis of goal-directed action in the human brain. J Neurosci (2012) 32(30):10146–55. doi:10.1523/JNEUROSCI.1304-12.2012
39. Hogarth L, Attwood AS, Bate HA, Munafo MR. Acute alcohol impairs human goal-directed action. Biol Psychol (2012) 90(2):154–60. doi:10.1016/j.biopsycho.2012.02.016
40. Tricomi E, Balleine BW, O’Doherty JP. A specific role for posterior dorsolateral striatum in human habit learning. Eur J Neurosci (2009) 29(11):2225–32. doi:10.1111/j.1460-9568.2009.06796.x
41. de Wit S, Corlett PR, Aitken MR, Dickinson A, Fletcher PC. Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J Neurosci (2009) 29(36):11330–8. doi:10.1523/JNEUROSCI.1639-09.2009
42. Gillan CM, Papmeyer M, Morein-Zamir S, Sahakian BJ, Fineberg NA, Robbins TW, et al. Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. Am J Psychiatry (2011) 168(7):718–26. doi:10.1176/appi.ajp.2011.10071062
43. de Wit S, Watson P, Harsay HA, Cohen MX, van de Vijver I, Ridderinkhof KR. Corticostriatal connectivity underlies individual differences in the balance between habitual and goal-directed action control. J Neurosci (2012) 32(35):12066–75. doi:10.1523/JNEUROSCI.1088-12.2012
44. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ. Model-based influences on humans’ choices and striatal prediction errors. Neuron (2011) 69(6):1204–15. doi:10.1016/j.neuron.2011.02.027
45. Glascher J, Daw N, Dayan P, O’Doherty JP. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron (2010) 66(4):585–95. doi:10.1016/j.neuron.2010.04.016
46. Wunderlich K, Smittenaar P, Dolan RJ. Dopamine enhances model-based over model-free choice behavior. Neuron (2012) 75(3):418–24. doi:10.1016/j.neuron.2012.03.042
47. Smittenaar P, FitzGerald TH, Romei V, Wright ND, Dolan RJ. Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron (2013) 80(4):914–9. doi:10.1016/j.neuron.2013.08.009
Keywords: habits, habit formation, motivation, addiction, goal-directed behavior
Citation: Sjoerds Z, Luigjes J, van den Brink W, Denys D and Yücel M (2014) The role of habits and motivation in human drug addiction: a reflection. Front. Psychiatry 5:8. doi: 10.3389/fpsyt.2014.00008
Received: 14 November 2013; Accepted: 14 January 2014;
Published online: 29 January 2014.
Edited by:
Janna Cousijn, University of Amsterdam, NetherlandsReviewed by:
Maartje Luijten, Radboud University Nijmegen, NetherlandsCopyright: © 2014 Sjoerds, Luigjes, van den Brink, Denys and Yücel. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: sjoerds.zs@gmail.com