Abstract
Background
The balance between goal-directed behavior and habits has been hypothesized to be biased toward the latter in individuals with cocaine use disorder (CUD), suggesting possible neurochemical changes in the putamen, which may contribute to their compulsive behavior.
Methods
We assessed habitual behavior in 48 patients with CUD and 42 healthy control participants using a contingency degradation paradigm and the Creature of Habit Scale. In a subgroup of this sample (CUD: n = 21; control participants: n = 22), we also measured glutamate and glutamine concentrations in the left putamen using ultra-high-field (7T) magnetic resonance spectroscopy. We hypothesized that increased habitual tendencies in patients with CUD would be associated with abnormal glutamatergic metabolites in the putamen.
Results
Compared with their non–drug-using peers, patients with CUD exhibited greater habitual tendencies during contingency degradation, which correlated with increased levels of self-reported daily habits. We further identified a significant reduction in glutamate concentration and glutamate turnover (glutamate-to-glutamine ratio) in the putamen in patients with CUD, which was significantly related to the level of self-reported daily habits.
Conclusions
Patients with CUD exhibit enhanced habitual behavior, as assessed both by questionnaire and by a laboratory paradigm of contingency degradation. This automatic habitual tendency is related to a reduced glutamate turnover in the putamen, suggesting a dysregulation of habits caused by chronic cocaine use.
Keywords: 7T magnetic resonance spectroscopy, Cocaine use disorder, Contingency degradation, Creature of Habit Scale, Glutamate-to-glutamine ratio
Drug addiction is widely regarded as a chronically relapsing disorder, characterized by persistent drug- seeking despite the harm it causes and the declining pleasure gained from drug use (1). This behavioral profile plausibly reflects dysregulation between goal-directed actions [subserved by ventromedial frontostriatal, especially caudate, circuits (2)] and stimulus-driven habits (underpinned by premotor to posterior putamen corticostriatal loops). Growing evidence suggests that stimulant drug exposure causes neuroplasticity in corticostriatal circuits implicated in distinct associative learning mechanisms, leading to impaired action-outcome learning (3), narrowing of goals (4), and enhanced stimulus-driven habits (5, 6, 7). There is evidence of NMDA receptor involvement in the cortico-dorsolateral striatum of rats in habit learning (10, 8, 9), and behavioral training enhances glutamatergic neurotransmission in the same region (11), which is homologous with the human putamen. Drug-induced changes in glutamatergic inputs to the dorsolateral striatum have been linked with the development of automatic habits that persist even in the face of negative consequences (12,13). At present, it is still unclear how the preclinical evidence translates to humans, i.e., whether patients with cocaine use disorder (CUD) exhibit increased habitual behaviors and whether these are related to glutamatergic abnormalities in the human putamen, a key region implicated in habit formation (2,14).
A predominance of the habit system can be tested experimentally by manipulations that either render goal-directed actions meaningless (i.e., by disrupting the perceived causal relationship or contingency between the action and the outcome) or make the outcome undesirable (i.e., by devaluing the outcome). As habits are affected by neither manipulation, individuals with a strong habit system would continue responding irrespective of these manipulations. We have recently shown that appetitive instrumental performance in patients with CUD was indeed unaffected by outcome devaluation, pointing toward strengthening of the appetitive habit system (15). However, patients with CUD in this study also showed significant deficits in reward-based learning (16), suggesting impairments in reinforcement learning or a lack of motivation, which may invalidate the devaluation test. Thus, further evidence is needed to confirm an appetitive habit bias in patients with CUD using an experimental paradigm that does not manipulate outcome value, such as contingency degradation.
If CUD is associated with increased habit formation, one would expect this to be reflected also in patients’ daily habits. Contrary to experimentally induced habits, habitual responses in daily life have often been practiced over prolonged periods. Although these behaviors may have initially been goal directed, through repetition they become autonomous of the goal, so that entering the associated environment is sufficient to trigger the behavior. The Creature of Habit Scale (COHS) (17,18) measures aspects of these daily habits, both involuntary actions triggered by certain environments (automaticity) and sequential actions led by order and regularity (routines).
Habits are subserved by different networks from goal-directed actions, involving sensorimotor regions of the striatum (putamen) and connected sensory and motor cortices (19). Specifically, the putamen has been shown to play a critical role in the automatization of behavior and habit formation (14). While dopamine plays a key role during acute drug exposure, neuroadaptive changes in the glutamate system may be critical for the development of compulsive drug seeking (20). There is growing preclinical evidence suggesting cocaine-induced alterations in other neurotransmitter systems, including glutamate (21,22) and GABA (gamma-aminobutyric acid) (23,24), which may underlie the formation of maladaptive habits (25). There appears to be conflicting evidence on changes of these neurotransmitters in cocaine-addicted humans. While some studies suggest either increased (26) or decreased (27,28) cortical levels, subcortical levels of glutamate were either unchanged (29) or reduced (30). These inconsistencies may result from interactions between dopamine and glutamate (31), possibly reflecting individual differences in striatal dopamine depletion due to varying degrees of cocaine use in the samples studied (31). Moreover, glutamate, glutamine, and GABA levels are difficult to differentiate using magnetic resonance spectroscopy (MRS) at lower field strengths (1.5T or 3T) because of their overlapping spectra (32,33).
The aim of this study was threefold: 1) to provide complementary evidence for increased habit formation in patients with CUD using a contingency degradation paradigm, which, to the best of our knowledge, has not yet been used in humans with CUD; 2) to evaluate the relationship between experimentally induced habits and self-reported habitual tendencies; and 3) to both quantify glutamate, glutamine, and GABA concentration in the putamen using ultra-high-field MRS and establish their relationship with habitual tendencies. We hypothesized that patients with CUD would show increased habitual tendencies, as measured both objectively by a contingency degradation paradigm and by self-report. We further hypothesized that increased habitual tendencies are associated with altered concentrations of glutamate and GABA metabolites in the putamen.
Methods and Materials
Participants
In light of the predominance of male cocaine users (34), we recruited 90 men from the community by advertisement and word of mouth. A total of 48 individuals had a history of chronic cocaine use, satisfying the DSM-5 (1) criteria for moderate/severe CUD, whereas the remaining 42 individuals were healthy and without a personal history of substance use disorder (see Table 1 for participant characteristics). Exclusion criteria for all volunteers included a lifetime history of a psychotic disorder, neurological illness or traumatic head injury, and insufficient proficiency in English. All participants were screened for current psychiatric disorders using the Mini-International Neuropsychiatric Inventory (35) and completed the COHS (17,18) to measure routine and automatic behaviors and the Obsessive-Compulsive Inventory-Revised (36) to measure compulsive tendencies. Before testing, all participants were breathalyzed to confirm sobriety and urine samples were tested for undeclared drugs; all samples provided by control participants were drug negative, whereas all samples provided by patients with CUD tested positive for cocaine. All participants provided written informed consent and received monetary compensation for their participation in the study, as approved by the Cambridge Research Ethics Committee.
Table 1.
Demographics | Control Group | Cocaine Group | Group Comparison |
|
---|---|---|---|---|
t90, Fisher’s Exact | p Value | |||
Behavioral Data | ||||
Sample size, n | 42 | 48 | – | – |
Age, years | 40.2 ± 12.5 | 40.4 ± 9.1 | −0.1 | .937 |
Handedness, right/left/ambidextrous, n | 38/3/1 | 40/7/1 | 1.4 | .661 |
Education, years | 15.7 ± 2.7 | 11.0 ± 1.5 | 10.3 | <.001 |
Routine behavior, COHS score | 54.5 ± 10.3 | 54.3 ± 9.8 | 0.1 | .913 |
Automaticity, COHS score | 30.3 ± 7.3 | 39.2 ± 7.0 | −5.9 | <.001 |
Compulsivity, OCI-R score | 8.8 ± 6.0 | 18.4 ± 11.7 | −5.0 | <.001 |
Alcohol use, AUDIT score | 3.4 ± 1.7 | 4.3 ± 5.8 | −0.9 | .353 |
Drug use, DAST-20 score | 0.1 ± 0.3 | – | – | – |
Neuroimaging Data | ||||
Sample size, n | 22 | 21 | – | – |
Age, years | 38.4 ± 11.2 | 41.5 ± 10.6 | −0.95 | .347 |
Handedness, right/left/ambidextrous, n | 19/2/1 | 17/3/1 | 0.6 | .778 |
Education, years | 15.9 ± 2.6 | 11.0 ± 1.5 | −1.8 | <.001 |
Routine behavior, COHS score | 56.5 ± 9.7 | 55.4 ± 10.8 | 0.3 | .734 |
Automaticity, COHS score | 31.0 ± 8.1 | 41.5 ± 7.3 | −4.4 | <.001 |
Compulsivity, OCI-R score | 7.4 ± 5.6 | 17.7 ± 11.1 | −3.8 | <.001 |
Alcohol use, AUDIT score | 2.9 ± 1.6 | 4.8 ± 6.1 | −1.3 | .191 |
Drug use, DAST-20 score | 0.0 ± 0.2 | – | – | – |
Values are presented as mean ± SD except where noted.
AUDIT, Alcohol Use Disorders Identification Test; COHS, Creature of Habit Scale; DAST-20, 20-item Drug Abuse Screening Test; MRS, magnetic resonance spectroscopy; OCI-R, Obsessive-Compulsive Inventory-Revised.
Patients with CUD had been actively using cocaine for an average of 13 years (SD ±7.7), and most (87%) were using the drug on a daily basis. Patients with CUD reported moderate-to-high levels of cocaine-related compulsivity [Obsessive-Compulsive Drug Use Scale (37), mean (SD) = 33.9 (±10.0)]. None of the healthy volunteers satisfied criteria for substance use disorder, nor were they taking prescribed or illicit drugs on a regular basis, as reflected by low scores on the Alcohol Use Disorders Identification Test (38) and 20-item Drug Abuse Screening Test (39) and drug-negative urine screens on the testing day.
Behavioral Measures
First, we assessed participants’ sensitivity to monetary reward by asking them to rate on a visual analog scale (0 = never, 100 = always) how often they would pick up a 20 pence coin lying on the street (Figure 1B). We then administered a modified version of the contingency degradation task previously used by Vaghi et al. (40), which consists of 8 blocks of 120 unsignaled, 1-second trials. Participants were presented with a picture of a white vase on the computer screen, which could be filled with flowers by button press. In 60% of trials, the button press also led to a financial reward, as a 20 pence coin and the message “You win!” appeared next to the flowers on the screen for 500 ms (Figure 1A). This action-outcome contingency was established over the first 3 blocks (nondegradation)—a duration sufficient in humans to induce habits (41)—before in block 4 the contingency was partially degraded by superimposing free rewards in 30% of trials (partial degradation) and then fully degraded in block 5, when free rewards were provided at the same rate as action-contingent rewards (full degradation). In block 6, the initial action-outcome contingencies of 60% were reinstated before they were partially degraded in block 7 and fully degraded in block 8. An overview of the conditions and contingencies is shown in Table 2. Participants were informed that sometimes when they press the button they will win money, but at other times nothing will happen. After each block, participants were asked to indicate on a continuous scale how likely their actions were associated with a reward (0 = never, 100 = always). Key outcome variables were the response rate per condition and the causality judgments of button presses leading to rewards.
Table 2.
Block Number | Condition | P (20p Received Following Action) | P (20p Received Following No Action) | ΔP (Programmed Contingency) |
---|---|---|---|---|
1 | Nondegraded | 0.60 | 0.00 | 0.60 |
2 | Nondegraded | 0.60 | 0.00 | 0.60 |
3 | Nondegraded | 0.60 | 0.00 | 0.60 |
4 | Partially degraded | 0.60 | 0.30 | 0.30 |
5 | Fully degraded | 0.60 | 0.60 | 0.00 |
6 | Nondegraded | 0.60 | 0.00 | 0.60 |
7 | Partially degraded | 0.60 | 0.30 | 0.30 |
8 | Fully degraded | 0.60 | 0.60 | 0.00 |
Neuroimaging Measures
After completion of the behavioral task, half of the sample (22 control, 21 CUD) underwent whole-brain T1-weighted MR and single-voxel proton MRS scanning at the Wolfson Brain Imaging Centre, University of Cambridge (United Kingdom) using a 7T Magnetom-Terra scanner (Siemens, Erlangen, Germany). Only participants without MR contraindications such as metal implants, tattoos, or claustrophobia were invited for the scan, but they did not differ from the rest of the sample on any demographic or behavioral variables (Table S1). The scanner was equipped with a single-channel transmit, 32-channel receive array head coil (Nova Medical, Carson, CA).
T1-weighted images were acquired with a 0.75-mm isotropic resolution three-dimensional 2-image magnetization prepared rapid acquisition gradient-echo (3D-MP2RAGE) sequence (42) (echo time/repetition time = 1.99/4300 ms, inversion time = 840/2370 ms, flip angles = 5/6°, acceleration factor = 3, bandwidth = 250 Hz/px, total acquisition time = 8 min 50 s). A 16 × 16 × 35 mm3 voxel was placed manually over the left putamen using anatomical landmarks (Figure S1), as this region has previously been linked with increased volume in patients with CUD (43, 44, 45, 46). Spectra were acquired using a short-echo semi-LASER sequence (47,48) (repetition time/echo time = 5000/26 ms, 64 repetitions) with FASTESTMAP shimming (49) and with variable power radiofrequency pulses with optimized relaxation delays water suppression calibration (50).
FSL was used to assess the structural MR images. T1 images were brain extracted using the FSL Brain Extraction Tool (51). A study-specific gray matter template was created by iterative nonlinear registration of participants’ gray matter images to the gray matter ICBM-152 template. All images were registered to the study-specific template, modulated using Jacobian warp fields (52), concatenated into a four-dimensional image, and smoothed with a kernel of full-width-half-measure of 3 mm. Mean gray matter volumes for the putamen in each participant were calculated by summing the gray matter values over the relevant segments of the Harvard-Oxford atlas.
The 64 individual spectral transients from each participant were saved separately and corrected for effects of eddy currents, frequency, and phase shifts using MRspa (Dinesh Deelchand, University of Minnesota, Minneapolis, MN; www.cmrr.umn.edu/downloads/mrspa). Metabolites between 0.5 and 4.2 parts per million (including glutamate, glutamine, and GABA) were quantified using LCModel (version 6.2-3) (53) with water scaling and a simulated basis set that included experimentally acquired macromolecule spectra. Molecules were water scaled using unsuppressed water spectra acquired before and after the 64 repetitions, assuming no cerebrospinal fluid content in the voxel.
Statistical Analysis
Demographic and behavioral data were analyzed using SPSS version 25 (IBM Corp., Armonk, NY). Differences between conditions were analyzed using repeated-measures analysis of covariance models with level of contingency degradation (none/partial/full) as the within-subject factor and group (control/CUD) as the between-subject factor. Mean years of education were included as a covariate to control for differences in educational achievements between the groups. Where assumptions of heterogeneity of covariance were violated, degrees of freedom were corrected using the Greenhouse-Geisser approach. Group differences of questionnaire data, rating scores, and metabolite concentrations were determined using univariate and multivariate analysis of variance models, respectively. All statistical tests were two-tailed and the significance level was set at .05.
Results
Demographics and Questionnaire Data
As shown in Table 1, the groups were matched on age, handedness, and sensitivity to the 20 pence reward value, but patients with CUD had spent less time in full-time education. As years of education were correlated with the response latencies (r = .463, p = .002), they were included as a covariate in the analysis. In terms of habitual tendencies (as measured by COHS), patients with CUD reported to engage in daily routines to the same degree as control participants (F1,88 = 0.01, p = .913) but scored significantly higher on automaticity than control participants (F1,88 = 54.5, p < .001) the longer they had been using cocaine (r = .33, p = .02) (Figure 2B). Pathological habits, as measured by the Obsessive-Compulsive Inventory-Revised scale, were also increased in patients with CUD compared with control participants (t72.09 = −4.97, p < .001).
Behavioral Results
In line with our principal behavioral prediction, we found a significant main effect of contingency degradation on response rate (F1.6,138.5 = 5.1, p = .012), indicating that both groups were able to respond according to the action-outcome association (see also Figure S2). Although response rates declined following contingency degrading, the overall decline was less steep in patients with CUD than in control participants, as reflected by a significant group-by-contingency interaction (F1.6,138.5 = 4.9, p = .014). As shown in Figure 1C, control participants reduced their responses as a function of degradation, but patients with CUD did not. Furthermore, the increased response rate in the fully degraded condition of patients with CUD was associated with the duration of cocaine use (r = −3.1, p = .042) (Figure 2A). Notably, response rates between the nondegraded and partially degraded conditions did not differ between the groups (F1,87 = 0.6, p = .813). This response pattern was also mirrored by the group-by-contingency interaction in participants’ causality judgments (F1.6,140 = 3.3, p = .048) (Figure 1D), suggesting that even on the fully degraded trials, patients with CUD were following their perceived causal beliefs. Indeed, participants’ response rates and their subjective awareness of causality were highly correlated (partially degraded: r = .37, p < .001; fully degraded: r = .51, p < .001).
We also calculated a ratio score for the two conditions (partially degraded and fully degraded contingencies) to test our hypothesis of strong habitual control in CUD patients. As shown in Figure 3A, in the fully degraded condition, the ratio scores differed significantly between the groups (F1,87 = 4.8, p = .031), as a quarter of patients with CUD (25%) exhibited a habitual strategy (i.e., a ratio value ≤ 0.5) compared with 7% of the control group (Fisher’s exact p = .026). This goal-to-habit ratio correlated with participants’ self-reported automaticity (r = −.23, p = .029) (Figure 3B) but not with obsessive-compulsive behavior (r = −.01, p = .371). The ratio scores of the partially degraded condition were not significantly different between the two groups (F1,87 = 0.02, p = .898).
Neuroimaging Results
The demographics and questionnaire scores of the two subgroups undergoing MR scanning are shown in Table 1. The groups did not differ on putamen volume (t41 = 0.40, p = .692), which is why we did not include volume as a covariate in the analysis. Two MRS spectra of patients with CUD were excluded because of poor quality. As shown in Figure 4D, the groups differed significantly in glutamate concentration (F1,39 = 4.6, p = .039; d = 0.64) and the glutamate-to-glutamine ratio (F1,39 = 4.9, p = .033; d = 0.69). Concentrations of glutamine (F1,39 = 0.6, p = .437; d = 0.24) and GABA (F1,39 = 0.4, p = .514; d = 0.21) were not significantly different between groups. These results were not explained by differences in scan quality; water linewidth, signal to noise, and metabolite Cramér-Rao lower bound were not different between the two groups (Table S2). The glutamate-to-glutamine ratio correlated with self-reported automaticity in both groups; i.e., higher automaticity levels in patients with CUD were associated with a lower glutamate-to-glutamine ratio (r = .5, p = .034) (Figure 4B); this relationship was not seen in the control group (r = .1, p = .623) (Figure 4A), but the correlation strength did not significantly differ between the groups (z = −1.25, p = .106). There was also no relationship between these metabolites and contingency degradation performance, the duration of cocaine use, or the number of tobacco cigarettes smoked (all p > .1). Putamen volume was not associated with glutamate-to-glutamine ratio, behavioral performance, or self-reported automaticity (all p > .1).
Discussion
A key finding of this study is that patients with CUD had no problems learning action-outcome associations (Figure S2), but they failed to adjust their responses when the relationship between their actions and the consequences was fully degraded. This increased response tendency is indicative of habitual control and was more pronounced the longer patients with CUD had been using cocaine. Although habits have often been considered to be the product of overtraining, and in this respect, the training in this study may appear rather short, recent evidence contradicts the necessity of overtraining (18,41,54). Increased habitual tendencies were also reflected by levels of automatic behavior patterns in their daily lives reported by patients with CUD, which were most evident the longer they had been using cocaine. These automatic behavioral patterns were associated with reduced glutamate turnover in the putamen, a key region implicated in habit formation. Our results provide compelling evidence for increased habitual tendencies in CUD and show, to the best of our knowledge, for the first time a link in humans between increased habitual tendencies and abnormal glutamate metabolites, indicating possibly altered glutamate neurotransmission in the habit pathway in patients with CUD.
Causal Beliefs and Instrumental Actions in CUD Unaffected by Full Contingency Degradation
Consistent with our hypothesis, we observed in patients with CUD greater habitual responding during contingency degradation than their non–drug-using peers. As shown in Figure 1C, in the nondegraded condition, all participants performed the instrumental action (pressing the button to obtain a financial reward), suggesting that they established a causal representation between their performance and the rewarding outcome (Figure 1D). Only when the action-outcome contingency was completely decoupled, i.e., when rewards became available irrespective of instrumental actions, did the response rate in control participants decline significantly, as well as their beliefs in the consequences of their actions. In patients with CUD, however, instrumental performance was insensitive to this manipulation, as they appeared unable to update the previously learned action-outcome association and thus continued to believe in the effectiveness of their actions. Their unfailing belief in their actions cannot be attributed to a misunderstanding of the task but reflects their lack of awareness of the disruption of the established action-outcome contingency. This is indicative of habitual control (55) and may suggest that the goal-directed system of patients with CUD was no longer in charge of their behavior but had deferred control to the habit system. A similar, albeit not identical, profile has also been observed in patients with obsessive-compulsive disorder (40), further supporting the notion of a habit bias being characteristic for disorders of compulsion. Moreover, the relationship between the continued responses of patients with CUD following the breakdown of the action-outcome association and the duration of their cocaine use concurs with a large body of preclinical research indicating that stimulant drugs facilitate habit formation (6,7,12,56).
Partial degradation of the action-outcome contingency was, in both groups, insufficient to change their causal beliefs and their instrumental actions significantly. Given that contingency information is calculated through the overall probability of an action producing an outcome (57,58), it is possible that the higher likelihood of obtaining a reward following the instrumental action than following a nonaction led participants not to change their behavior significantly. Only when this contingency was completely disrupted did healthy individuals adjust their behavior and beliefs accordingly (40,59, 60, 61), but patients with CUD failed to do so (Figure 1).
Putative Neural Correlates of Contingency Degradation Performance
Sensitivity to action-outcome contingencies involves a number of brain regions including the ventromedial prefrontal cortex for encoding outcome value (62,63), the caudate nucleus and perigenual anterior cingulate cortex for detecting the causal relationship between actions and outcomes (64, 65, 66), and the dorsal hippocampus for encoding the instrumental contingency (67). The dorsolateral putamen has been shown to prevent regular updates about contingency information, thereby facilitating the formation of habits (63,68,69) and supporting the hypothesis that a strong habit system relies on the putamen (70,71). Here, we found no evidence that changes in the putamen are implicated in contingency degradation performance, but the impairment of patients with CUD in detecting changes in the action-outcome relationship and their unawareness of these changes may point toward deficits in the perigenual anterior cingulate cortex (64). Prior research has shown that ventromedial prefrontal cortex lesions impair individuals’ ability to establish awareness about causal action-outcome contingencies, but these deficits alone are insufficient to impair participants’ ability to adjust their behavior when these contingencies break down (60).
Abnormal Glutamate Turnover Predicts Self-reported Habits in Patients With CUD
In keeping with our previous work suggesting modulatory effects of stimulant drug exposure on automatic, environmentally triggered behavior (17), patients with CUD in this study reported engaging in such behavior to a significantly greater extent than their non–drug-using peers. Moreover, the high levels of automaticity of patients with CUD were significantly correlated not only with their duration of cocaine use but also with their reduced glutamate-to-glutamine ratio in the putamen (Figure 4B). This ratio may reflect the operation of a key mechanism to regulate the concentration of extracellular glutamate that protects the brain from overexcitation. Thus, whenever glutamate is released by neurons during neurotransmission, it is rapidly taken up by surrounding astroglia and converted into its inactive form of glutamine before it is released again into the synaptic cleft and taken up by neurons to be synthesized into glutamate (72). Stimulant drugs have been shown to acutely increase glutamate levels and turnover (12,73), but regular drug use impairs glutamate homeostasis by altering glial-neuronal interactions (74). The glutamate-to-glutamine ratio is therefore an important indicator, reflecting not only glutamate turnover rate but also the activity of glutamate-releasing neurons (75). The reduced glutamate-to-glutamine cycle, as seen in our patients with CUD, may thus point toward an impaired neuron-astrocyte crosstalk, which leads to diminished glutamate turnover in the putamen and may facilitate automated habits (Figure 4).
The significant reduction in glutamate concentration in the putamen and the low glutamate turnover in patients with CUD is in keeping with previously published findings in CUD, suggesting a substantial downregulation of glutamate neurotransmission, including widespread reduction in glutamate receptors (29,76,77) and low glutamate concentrations (27,30). To the best of our knowledge, our study is the first to show in humans a link between abnormal glutamate turnover and increased automatic habits. We acknowledge that our data may be at odds with preclinical research in two respects: 1) that enhanced corticodorsolateral striatal glutamate neurotransmission is associated with habit learning (11) and 2) that stimulant drugs acutely increase rather than decrease glutamate signaling in the putamen (12), which has been linked with synaptic reorganization and accelerated formation of habits (12). However, long-term cocaine use downregulates both the dopamine (78) and glutamate systems (29), which interact to produce reduced striatal glutamate concentration (31), as seen here. These changes likely impair the regulation of habits by top-down mechanisms of inhibitory control (79), normally mediated by excitatory frontostriatal projections (79,80).
Despite the significant reduction in the glutamate-to-glutamine ratio in patients with CUD, their glutamine levels were not measurably different from control participants (Figure 4). Glutamine serves as a precursor not only for glutamate but also for GABA (81), which was not measurably altered in the putamen of patients with CUD. The selective decline in glutamate concentration may suggest cocaine-induced impairments in glutamate synthesis, possibly through expression and activity of the enzyme glutaminase (82).
Preclinical studies show that the glutamate transporter is generally downregulated in the striatum, at least following exposure to prolonged access to cocaine (excepting the nucleus accumbens shell region) (83,84), and that fewer synapses are unsheathed by astroglia, although this has only to date been investigated in the nucleus accumbens core (85). Moreover, restoring glutamate homeostasis with N-acetylcysteine can recover goal-directed from habitual behavior (56) and rescue cocaine-induced reductions in GLT-1 proteins resulting from intravenous cocaine self-administration in the dorsolateral striatum as well as the nucleus accumbens core (86).
Strengths, Weaknesses, and Wider Implications
The strengths of the study include the assessment of habits both objectively using a contingency degradation paradigm and subjectively by self-report in a large sample and the significant correlation between the two (Figure 3B). We successfully circumvented potential shortcomings associated with the use of outcome devaluation paradigms in CUD by manipulating the action-outcome contingency rather than the outcome, which is especially difficult to manipulate for outcomes such as drugs and generally works best for outcomes such as food. However, both paradigms, contingency degradation and outcome devaluation, are widely considered the gold standard of testing habits, and our findings are consistent with prior work (4,7,15,17,56). Other paradigms, such as the two-stage decision-making task or pavlovian-to-instrumental transfer procedures, may not be comparable, thus explaining some apparent inconsistencies in the literature. For example, increased habitual responding following outcome devaluation has been reported both in healthy individuals under the acute influence of alcohol (87) and in patients with alcohol use disorder (63) but not using the two-stage decision-making task (88) or a pavlovian-to-instrumental transfer paradigm (89). A variety of measures and experimental paradigms is thus warranted to understand the interplay between goal-directed and habitual control in health and disease.
Metabolic measurements were obtained at ultra-high-field strength (7T), which allowed us to measure concentrations separately from their precursors, i.e., providing information not only about glutamate turnover but also about glutamate synthesis. The inclusion in the study of just male patients with CUD who were actively using cocaine may limit the generalizability of our findings to women with CUD and individuals in recovery. Limitations further include the lack of functional brain data such as resting-state or task-related activation to evaluate the functional implications of glutamate concentration and the restriction of metabolic measurements to just the putamen. We are also unable to determine the precise cortical (or thalamic) origin of the apparent reduction of glutamate transmission. In light of the performance of patients with CUD during contingency degradation—a task that requires monitoring of reinforcement contingencies—measuring glutamate concentration in the caudate nucleus and perigenual anterior cingulate cortex would be of particular interest. It is possible, for example, that a general reduction in glutamate transmission in the caudate may impair goal-directed behavior, which would then indirectly increase habitual control (55). Our findings may have possible therapeutic implications, prior work having shown that N-acetylcysteine normalizes glutamate concentrations in the dorsal anterior cingulate cortex (26) and can remediate relapse to drug taking in rodents (17). However, whether it could restore the balance between goal-directed and habitual behavior is as yet unclear.
These results add to the growing evidence indicating that cocaine addiction has profound effects on corticostriatal glutamate neurotransmission (90) associated with enhanced habitual tendencies, which may exacerbate compulsive drug-seeking behaviors.
Acknowledgments and Disclosures
This work was funded by the Wellcome Trust (Grant No. 105602/z/14/z [to KDE]) and financially supported by the National Institute for Health Research Cambridge Biomedical Research Centre, Alexander von Humboldt Fellowship for senior researchers (Grant No. GBR 1202805 HFST-E [to KDE]), Holt Fellowship (to AGM), Human Frontier Science Program Fellowship (Grant No. LT000751/2019-L [to MMV]), a 2019 NARSAD Young Investigator Grant (Grant No. 28751 [to MMV]) from the Brain and Behavior Research Foundation, British Academy Visiting Fellowship (Grant No. VF1∖102524 [to TLW]), and Senior Wellcome Trust Award (Grant No. 104631/z/14/z [to TWR]).
We thank all participants for their contributions to this study and particularly those who aided with recruitment. We also thank Eva Groot and Ibtisam Abdi for their help with data collection. We are grateful to Roderick Lumsden and Chun Meng for assistance with programming and the setting up of the neuroimaging protocol, respectively. We also thank Dinesh Deelchand at the University of Minnesota for allowing us to use his MRSpa software and providing the basis set for the MRS analysis. The MRS package was developed by Gulin Oz and Dinesh Deelchand and provided by the University of Minnesota under a C2P agreement.
TWR discloses consultancy with Cambridge Cognition, Greenfield Bioventures, Heptares, Arcadia, and Takeda; he receives research grants from Shionogi and GlaxoSmithKline, royalties for the Cambridge Neuropsychological Test Automated Battery from Cambridge Cognition, and editorial honoraria from Springer Verlag and Elsevier. All other authors report no biomedical financial interests or potential conflicts of interest.
Footnotes
Supplementary material cited in this article is available online at https://doi.org/10.1016/j.biopsych.2020.12.009.
Supplementary Material
References
- 1.American Psychiatric Association . American Psychiatric Association; Washington, DC: 2013. Diagnostic and Statistical Manual of Mental Disorders: DSM-5. [Google Scholar]
- 2.Balleine B.W., O’Doherty J.P. Human and rodent homologies in action control: Corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology. 2010;35:48–69. doi: 10.1038/npp.2009.131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Schoenbaum G., Setlow B. Cocaine makes actions insensitive to outcomes but not extinction: Implications for altered orbitofrontal-amygdalar function. Cereb Cortex. 2005;15:1162–1169. doi: 10.1093/cercor/bhh216. [DOI] [PubMed] [Google Scholar]
- 4.Breedon J.R., Ziauddeen H., Stochl J., Ersche K.D. Feeding the addiction: Narrowing of goals to habits. Eur Neuropsychopharmacol. 2021;42:110–114. doi: 10.1016/j.euroneuro.2020.11.002. [DOI] [PubMed] [Google Scholar]
- 5.Zapata A., Minney V.L., Shippenberg T.S. Shift from goal-directed to habitual cocaine seeking after prolonged experience in rats. J Neurosci. 2010;30:15457–15463. doi: 10.1523/JNEUROSCI.4072-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Nelson A., Killcross S. Amphetamine exposure enhances habit formation. J Neurosci. 2006;26:3805–3812. doi: 10.1523/JNEUROSCI.4305-05.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Schmitzer-Torbert N., Apostolidis S., Amoa R., O’Rear C., Kaster M., Stowers J., Ritz R. Post-training cocaine administration facilitates habit learning and requires the infralimbic cortex and dorsolateral striatum. Neurobiol Learn Mem. 2015;118:105–112. doi: 10.1016/j.nlm.2014.11.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Packard M.G. Glutamate infused posttraining into the hippocampus or caudate-putamen differentially strengthens place and response learning. Proc Natl Acad Sci U S A. 1999;96:12881–12886. doi: 10.1073/pnas.96.22.12881. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Corbit L.H., Nie H., Janak P.H. Habitual responding for alcohol depends upon both AMPA and D2 receptor signaling in the dorsolateral striatum. Front Behav Neurosci. 2014;8:301. doi: 10.3389/fnbeh.2014.00301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Goodman J., Ressler R.L., Packard M.G. Enhancing and impairing extinction of habit memory through modulation of NMDA receptors in the dorsolateral striatum. Neuroscience. 2017;352:216–225. doi: 10.1016/j.neuroscience.2017.03.042. [DOI] [PubMed] [Google Scholar]
- 11.Yin H.H., Mulcare S.P., Hilário M.R.F., Clouse E., Holloway T., Davis M.I. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci. 2009;12:333–341. doi: 10.1038/nn.2261. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Furlong T.M., Corbit L.H., Brown R.A., Balleine B.W. Methamphetamine promotes habitual action and alters the density of striatal glutamate receptor and vesicular proteins in dorsal striatum. Addict Biol. 2018;23:857–867. doi: 10.1111/adb.12534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Jedynak J.P., Uslaner J.M., Esteban J.A., Robinson T.E. Methamphetamine-induced structural plasticity in the dorsal striatum. Eur J Neurosci. 2007;25:847–853. doi: 10.1111/j.1460-9568.2007.05316.x. [DOI] [PubMed] [Google Scholar]
- 14.Yin H.H., Knowlton B.J., Balleine B.W. Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci. 2004;19:181–189. doi: 10.1111/j.1460-9568.2004.03095.x. [DOI] [PubMed] [Google Scholar]
- 15.Ersche K.D., Gillan C.M., Jones P.S., Williams G.B., Ward L.H.E., Luijten M. Carrots and sticks fail to change behavior in cocaine addiction. Science. 2016;352:1468–1471. doi: 10.1126/science.aaf3700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Lim T.V., Cardinal R.N., Savulich G., Jones P.S., Moustafa A.A., Robbins T.W., Ersche K.D. Impairments in reinforcement learning do not explain enhanced habit formation in cocaine use disorder. Psychopharmacology (Berl) 2019;236:2359–2371. doi: 10.1007/s00213-019-05330-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Ersche K.D., Lim T.V., Ward L.H.E., Robbins T.W., Stochl J. Creature of Habit: A self-report measure of habitual routines and automatic tendencies in everyday life. Pers Individ Dif. 2017;116:73–85. doi: 10.1016/j.paid.2017.04.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Ersche K.D., Ward L.H.E., Lim T.V., Lumsden R.J., Sawiak S.J., Robbins T.W., Stochl J. Impulsivity and compulsivity are differentially associated with automaticity and routine on the Creature of Habit Scale. Pers Individ Dif. 2019;150:109493. doi: 10.1016/j.paid.2019.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ashby F.G., Turner B.O., Horvitz J.C. Cortical and basal ganglia contributions to habit learning and automaticity. Trends Cogn Sci. 2010;14:208–215. doi: 10.1016/j.tics.2010.02.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Yin H.H., Knowlton B.J., Balleine B.W. Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur J Neurosci. 2005;22:505–512. doi: 10.1111/j.1460-9568.2005.04219.x. [DOI] [PubMed] [Google Scholar]
- 21.Liu X., Jensen J.E., Gillis T.E., Zuo C.S., Prescot A.P., Brimson M. Chronic cocaine exposure induces putamen glutamate and glutamine metabolite abnormalities in squirrel monkeys. Psychopharmacology (Berl) 2011;217:367–375. doi: 10.1007/s00213-011-2292-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Kalivas P.W. Glutamate systems in cocaine addiction. Curr Opin Pharmacol. 2004;4:23–29. doi: 10.1016/j.coph.2003.11.002. [DOI] [PubMed] [Google Scholar]
- 23.Centonze D., Picconi B., Baunez C., Borrelli E., Pisani A., Bernardi G., Calabresi P. Cocaine and amphetamine depress striatal GABAergic synaptic transmission through D2 dopamine receptors. Neuropsychopharmacology. 2002;26:164–175. doi: 10.1016/S0893-133X(01)00299-8. [DOI] [PubMed] [Google Scholar]
- 24.Jiao D., Liu Y., Li X., Liu J., Zhao M. The role of the GABA system in amphetamine-type stimulant use disorders. Front Cell Neurosci. 2015;9:162. doi: 10.3389/fncel.2015.00162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Gerdeman G.L., Partridge J.G., Lupica C.R., Lovinger D.M. It could be habit forming: Drugs of abuse and striatal synaptic plasticity. Trends Neurosci. 2003;26:184–192. doi: 10.1016/S0166-2236(03)00065-1. [DOI] [PubMed] [Google Scholar]
- 26.Schmaal L., Veltman D.J., Nederveen A., van den Brink W., Goudriaan A.E. N-acetylcysteine normalizes glutamate levels in cocaine-dependent patients: A randomized crossover magnetic resonance spectroscopy study. Neuropsychopharmacology. 2012;37:2143–2152. doi: 10.1038/npp.2012.66. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Yang S., Salmeron B.J., Ross T.J., Xi Z.X., Stein E.A., Yang Y. Lower glutamate levels in rostral anterior cingulate of chronic cocaine users—A (1)H-MRS study using TE-averaged PRESS at 3T with an optimized quantification strategy. Psychiatry Res. 2009;174:171–176. doi: 10.1016/j.pscychresns.2009.05.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Ke Y., Streeter C.C., Nassar L.E., Sarid-Segal O., Hennen J., Yurgelun-Todd D.A. Frontal lobe GABA levels in cocaine dependence: A two-dimensional, J-resolved magnetic resonance spectroscopy study. Psychiatry Res. 2004;130:283–293. doi: 10.1016/j.pscychresns.2003.12.001. [DOI] [PubMed] [Google Scholar]
- 29.Martinez D., Slifstein M., Nabulsi N., Grassetti A., Urban N.B.L., Perez A. Imaging glutamate homeostasis in cocaine addiction with the metabotropic glutamate receptor 5 positron emission tomography radiotracer [(11)C]ABP688 and magnetic resonance spectroscopy. Biol Psychiatry. 2014;75:165–171. doi: 10.1016/j.biopsych.2013.06.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Engeli E.J.E., Zoelch N., Hock A., Nordt C., Hulka L.M., Kirschner M. Impaired glutamate homeostasis in the nucleus accumbens in human cocaine addiction [published online ahead of print Jun 29] Mol Psychiatry. 2020 doi: 10.1038/s41380-020-0828-z. [DOI] [PubMed] [Google Scholar]
- 31.Caravaggio F., Nakajima S., Plitman E., Gerretsen P., Chung J.K., Iwata Y., Graff-Guerrero A. The effect of striatal dopamine depletion on striatal and cortical glutamate: A mini-review. Prog Neuropsychopharmacol Biol Psychiatry. 2016;65:49–53. doi: 10.1016/j.pnpbp.2015.08.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Tkác I., Oz G., Adriany G., Uğurbil K., Gruetter R. In vivo 1H NMR spectroscopy of the human brain at high magnetic fields: metabolite quantification at 4T vs. 7T. Magn Reson Med. 2009;62:868–879. doi: 10.1002/mrm.22086. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Terpstra M., Ugurbil K., Gruetter R. Direct in vivo measurement of human cerebral GABA concentration using MEGA-editing at 7 Tesla. Magn Reson Med. 2002;47:1009–1012. doi: 10.1002/mrm.10146. [DOI] [PubMed] [Google Scholar]
- 34.European Monitoring Centre for Drugs and Drug Addiction . EMCDDA; Lisbon, Portugal: 2006. A Gender Perspective on Drug Use and Responding to Drug Problems. [Google Scholar]
- 35.Sheehan D.V., Lecrubier Y., Sheehan K.H., Amorim P., Janavs J., Weiller E. The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(suppl 20):22–33. quiz 34. [PubMed] [Google Scholar]
- 36.Foa E.B., Huppert J.D., Leiberg S., Langner R., Kichic R., Hajcak G., Salkovskis P.M. The Obsessive-Compulsive Inventory: Development and validation of a short version. Psychol Assess. 2002;14:485–496. [PubMed] [Google Scholar]
- 37.Franken I.H.A., Hendriksa V.M., van den Brink W. Initial validation of two opiate craving questionnaires: The Obsessive Compulsive Drug Use Scale and the Desires for Drug Questionnaire. Addict Behav. 2002;27:675–685. doi: 10.1016/s0306-4603(01)00201-5. [DOI] [PubMed] [Google Scholar]
- 38.Saunders J.B., Aasland O.G., Babor T.F., de la Fuente J.R., Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT)—WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption--II. Addiction. 1993;88:791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. [DOI] [PubMed] [Google Scholar]
- 39.Skinner H.A. The Drug Abuse Screening Test. Addict Behav. 1982;7:363–371. doi: 10.1016/0306-4603(82)90005-3. [DOI] [PubMed] [Google Scholar]
- 40.Vaghi M.M., Cardinal R.N., Apergis-Schoute A.M., Fineberg N.A., Sule A., Robbins T.W. Action-outcome knowledge dissociates from behavior in obsessive-compulsive disorder following contingency degradation. Biol Psychiatry Cogn Neurosci Neuroimaging. 2019;4:200–209. doi: 10.1016/j.bpsc.2018.09.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.de Wit S., Kindt M., Knot S.L., Verhoeven A.A.C., Robbins T.W., Gasull-Camos J. Shifting the balance between goals and habits: Five failures in experimental habit induction. J Exp Psychol Gen. 2018;147:1043–1065. doi: 10.1037/xge0000402. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Marques J.P., Kober T., Krueger G., van der Zwaag W., Van de Moortele P.F., Gruetter R. MP2RAGE, a self bias-field corrected sequence for improved segmentation and T1-mapping at high field. Neuroimage. 2010;49:1271–1281. doi: 10.1016/j.neuroimage.2009.10.002. [DOI] [PubMed] [Google Scholar]
- 43.Ersche K.D., Barnes A., Jones P.S., Morein-Zamir S., Robbins T.W., Bullmore E.T. Abnormal structure of frontostriatal brain systems is associated with aspects of impulsivity and compulsivity in cocaine dependence. Brain. 2011;134:2013–2024. doi: 10.1093/brain/awr138. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Ersche K.D., Jones P.S., Williams G.B., Turton A.J., Robbins T.W., Bullmore E.T. Abnormal brain structure implicated in stimulant drug addiction. Science. 2012;335:601–604. doi: 10.1126/science.1214463. [DOI] [PubMed] [Google Scholar]
- 45.Ersche K.D., Acosta-Cabronero J., Jones P.S., Ziauddeen H., van Swelm R.P.L., Laarakkers C.M.M. Disrupted iron regulation in the brain and periphery in cocaine addiction. Transl Psychiatry. 2017;7 doi: 10.1038/tp.2016.271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Ersche K.D., Hagan C.C., Smith D.G., Jones P.S., Calder A.J., Williams G.B. In the face of threat: Neural and endocrine correlates of impaired facial emotion recognition in cocaine dependence. Transl Psychiatry. 2015;5 doi: 10.1038/tp.2015.58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Oz G., Tkáč I. Short-echo, single-shot, full-intensity proton magnetic resonance spectroscopy for neurochemical profiling at 4T: Validation in the cerebellum and brainstem. Magn Reson Med. 2011;65:901–910. doi: 10.1002/mrm.22708. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Deelchand D.K., Adanyeguh I.M., Emir U.E., Nguyen T.M., Valabregue R., Henry P.G. Two-site reproducibility of cerebellar and brainstem neurochemical profiles With short-echo, single-voxel MRS at 3T. Magn Reson Med. 2015;73:1718–1725. doi: 10.1002/mrm.25295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Gruetter R., Tkác I. Field mapping without reference scan using asymmetric echo-planar techniques. Magn Reson Med. 2000;43:319–323. doi: 10.1002/(sici)1522-2594(200002)43:2<319::aid-mrm22>3.0.co;2-1. [DOI] [PubMed] [Google Scholar]
- 50.Tkác I., Starcuk Z., Choi I.Y., Gruetter R. In vivo 1H NMR spectroscopy of rat brain at 1 ms echo time. Magn Reson Med. 1999;41:649–656. doi: 10.1002/(sici)1522-2594(199904)41:4<649::aid-mrm2>3.0.co;2-g. [DOI] [PubMed] [Google Scholar]
- 51.Smith S.M. Fast robust automated brain extraction. Hum Brain Mapp. 2002;17:143–155. doi: 10.1002/hbm.10062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Good C.D., Johnsrude I.S., Ashburner J., Henson R.N.A., Friston K.J., Frackowiak R.S. A voxel-based morphometric study of ageing in 465 normal adult human brains. Neuroimage. 2001;14:21–36. doi: 10.1006/nimg.2001.0786. [DOI] [PubMed] [Google Scholar]
- 53.Provencher S.W. Estimation of metabolite concentrations from localized in vivo proton NMR spectra. Magn Reson Med. 1993;30:672–679. doi: 10.1002/mrm.1910300604. [DOI] [PubMed] [Google Scholar]
- 54.Hardwick R.M., Forrence A.D., Krakauer J.W., Haith A.M. Time-dependent competition between goal-directed and habitual response preparation. Nat Hum Behav. 2019;3:1252–1262. doi: 10.1038/s41562-019-0725-0. [DOI] [PubMed] [Google Scholar]
- 55.Robbins T.W., Costa R.M. Habits. Curr Biol. 2017;27:R1200–R1206. doi: 10.1016/j.cub.2017.09.060. [DOI] [PubMed] [Google Scholar]
- 56.Corbit L.H., Chieng B.C., Balleine B.W. Effects of repeated cocaine exposure on habit learning and reversal by N-acetylcysteine. Neuropsychopharmacology. 2014;39:1893–1901. doi: 10.1038/npp.2014.37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Pérez O.D., Soto F.A. Evidence for a dissociation between causal beliefs and instrumental actions. Q J Exp Psychol (Hove) 2020;73:495–503. doi: 10.1177/1747021819899808. [DOI] [PubMed] [Google Scholar]
- 58.Wasserman E.A., Chatlosh D.L., Neunaber D.J. Perception of causal relations in humans: Factors affecting judgments of response-outcome contingencies under free-operant procedures. Learn Motiv. 1983;14:406–432. [Google Scholar]
- 59.Chatlosh D.L., Neunaber D.J., Wasserman E.A. Response-outcome contingency: Behavioral and judgmental effects of appetitive and aversive outcomes with college-students. Learn Motiv. 1985;16:1–34. [Google Scholar]
- 60.O’Callaghan C., Vaghi M.M., Brummerloh B., Cardinal R.N., Robbins T.W. Impaired awareness of action-outcome contingency and causality during healthy ageing and following ventromedial prefrontal cortex lesions. Neuropsychologia. 2019;128:282–289. doi: 10.1016/j.neuropsychologia.2018.01.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Shanks D.R., Dickinson A. Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Mem Cognit. 1991;19:353–360. doi: 10.3758/bf03197139. [DOI] [PubMed] [Google Scholar]
- 62.O’Doherty J.P. Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann N Y Acad Sci. 2011;1239:118–129. doi: 10.1111/j.1749-6632.2011.06290.x. [DOI] [PubMed] [Google Scholar]
- 63.Sjoerds Z., de Wit S., van den Brink W., Robbins T.W., Beekman A.T., Penninx B.W., Veltman D.J. Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients. Transl Psychiatry. 2013;3:e337. doi: 10.1038/tp.2013.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Jackson S.A.W., Horst N.K., Pears A., Robbins T.W., Roberts A.C. Role of the perigenual anterior cingulate and orbitofrontal cortex in contingency learning in the marmoset. Cereb Cortex. 2016;26:3273–3284. doi: 10.1093/cercor/bhw067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Tanaka S.C., Balleine B.W., O’Doherty J.P. Calculating consequences: Brain systems that encode the causal effects of actions. J Neurosci. 2008;28:6750–6755. doi: 10.1523/JNEUROSCI.1808-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Tricomi E.M., Delgado M.R., Fiez J.A. Modulation of caudate activity by action contingency. Neuron. 2004;41:281–292. doi: 10.1016/s0896-6273(03)00848-1. [DOI] [PubMed] [Google Scholar]
- 67.Corbit L.H., Ostlund S.B., Balleine B.W. Sensitivity to instrumental contingency degradation is mediated by the entorhinal cortex and its efferents via the dorsal hippocampus. J Neurosci. 2002;22:10976–10984. doi: 10.1523/JNEUROSCI.22-24-10976.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Yin H.H., Knowlton B.J., Balleine B.W. Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav Brain Res. 2006;166:189–196. doi: 10.1016/j.bbr.2005.07.012. [DOI] [PubMed] [Google Scholar]
- 69.Tricomi E., Balleine B.W., O’Doherty J.P. A specific role for posterior dorsolateral striatum in human habit learning. Eur J Neurosci. 2009;29:2225–2232. doi: 10.1111/j.1460-9568.2009.06796.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Knowlton B.J., Patterson T.K. Habit formation and the striatum. In: Clark R.E., Martin S., editors. Behavioral Neuroscience of Learning and Memory. Springer; Cham: 2016. pp. 275–295. [Google Scholar]
- 71.Singer H.S. Motor control, habits, complex motor stereotypies, and Tourette syndrome. Ann N Y Acad Sci. 2013;1304:22–31. doi: 10.1111/nyas.12281. [DOI] [PubMed] [Google Scholar]
- 72.Sonnewald U., Schousboe A. Introduction to the glutamate-glutamine cycle. Adv Neurobiol. 2016;13:1–7. doi: 10.1007/978-3-319-45096-4_1. [DOI] [PubMed] [Google Scholar]
- 73.White T.L., Monnig M.A., Walsh E.G., Nitenson A.Z., Harris A.D., Cohen R.A. Psychostimulant drug effects on glutamate, Glx, and creatine in the anterior cingulate cortex and subjective response in healthy humans. Neuropsychopharmacology. 2018;43:1498–1509. doi: 10.1038/s41386-018-0027-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Scofield M.D., Heinsbroek J.A., Gipson C.D., Kupchik Y.M., Spencer S., Smith A.C. The nucleus accumbens: Mechanisms of addiction across drug classes reflect the importance of glutamate homeostasis. Pharmacol Rev. 2016;68:816–871. doi: 10.1124/pr.116.012484. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Smith J.E., Koves T.R., Co C. Brain neurotransmitter turnover rates during rat intravenous cocaine self-administration. Neuroscience. 2003;117:461–475. doi: 10.1016/s0306-4522(02)00819-9. [DOI] [PubMed] [Google Scholar]
- 76.Smart K., Scala S.G., El Mestikawy S., Benkelfat C., Leyton M. Cocaine addiction and mGluR5: Recent advances from behavioral and positron emission tomography studies. In: Preedy V.R., editor. The Neuroscience of Cocaine. Academic Press; New York: 2017. pp. 269–278. [Google Scholar]
- 77.Milella M.S., Marengo L., Larcher K., Fotros A., Dagher A., Rosa-Neto P. Limbic system mGluR5 availability in cocaine dependent subjects: A high-resolution PET [(11)C]ABP688 study. Neuroimage. 2014;98:195–202. doi: 10.1016/j.neuroimage.2014.04.061. [DOI] [PubMed] [Google Scholar]
- 78.Martinez D., Greene K., Broft A., Kumar D., Liu F., Narendran R. Lower level of endogenous dopamine in patients with cocaine dependence: Findings from PET imaging of D(2)/D(3) receptors following acute dopamine depletion. Am J Psychiatry. 2009;166:1170–1177. doi: 10.1176/appi.ajp.2009.08121801. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Bogdanov M., Timmermann J.E., Gläscher J., Hummel F.C., Schwabe L. Causal role of the inferolateral prefrontal cortex in balancing goal-directed and habitual control of behavior. Sci Rep. 2018;8:9382. doi: 10.1038/s41598-018-27678-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Ersche K.D., Meng C., Ziauddeen H., Stochl J., Williams G.B., Bullmore E.T., Robbins T.W. Brain networks underlying vulnerability and resilience to drug addiction. Proc Natl Acad Sci U S A. 2020;117:15253–15261. doi: 10.1073/pnas.2002509117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Reubi J.C., Van Der Berg C., Cuénod M. Glutamine as precursor for the GABA and glutamate trasmitter pools. Neurosci Lett. 1978;10:171–174. doi: 10.1016/0304-3940(78)90030-7. [DOI] [PubMed] [Google Scholar]
- 82.Blanco E., Campos-Sandoval J.A., Palomino A., Luque-Rojas M.J., Bilbao A., Suárez J. Cocaine modulates both glutaminase gene expression and glutaminase activity in the brain of cocaine-sensitized mice. Psychopharmacology (Berl) 2012;219:933–944. doi: 10.1007/s00213-011-2418-x. [DOI] [PubMed] [Google Scholar]
- 83.Kalivas P.W. The glutamate homeostasis hypothesis of addiction. Nat Rev Neurosci. 2009;10:561–572. doi: 10.1038/nrn2515. [DOI] [PubMed] [Google Scholar]
- 84.Fouyssac M., Belin D. Beyond drug-induced alteration of glutamate homeostasis, astrocytes may contribute to dopamine-dependent intrastriatal functional shifts that underlie the development of drug addiction: A working hypothesis. Eur J Neurosci. 2019;50:3014–3027. doi: 10.1111/ejn.14416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Scofield M.D., Li H., Siemsen B.M., Healey K.L., Tran P.K., Woronoff N. Cocaine self-administration and extinction leads to reduced glial fibrillary acidic protein expression and morphometric features of astrocytes in the nucleus accumbens core. Biol Psychiatr. 2016;80:207–215. doi: 10.1016/j.biopsych.2015.12.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Ducret E., Puaud M., Lacoste J., Belin-Rauscent A., Fouyssac M., Dugast E. N-acetylcysteine facilitates self-imposed abstinence after escalation of cocaine intake. Biol Psychiatry. 2016;80:226–234. doi: 10.1016/j.biopsych.2015.09.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Hogarth L., Attwood A.S., Bate H.A., Munafò M.R. Acute alcohol impairs human goal-directed action. Biol Psychol. 2012;90:154–160. doi: 10.1016/j.biopsycho.2012.02.016. [DOI] [PubMed] [Google Scholar]
- 88.Sebold M., Deserno L., Nebe S., Schad D.J., Garbusow M., Hägele C. Model-based and model-free decisions in alcohol dependence. Neuropsychobiology. 2014;70:122–131. doi: 10.1159/000362840. [DOI] [PubMed] [Google Scholar]
- 89.van Timmeren T., Quail S.L., Balleine B.W., Geurts D.E.M., Goudriaan A.E., van Holst R.J. Intact corticostriatal control of goal-directed action in alcohol use disorder: A pavlovian-to-instrumental transfer and outcome-devaluation study. Sci Rep. 2020;10:4949. doi: 10.1038/s41598-020-61892-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Schmidt H.D., Pierce R.C. Cocaine-induced neuroadaptations in glutamate transmission: Potential therapeutic targets for craving and addiction. Ann N Y Acad Sci. 2010;1187:35–75. doi: 10.1111/j.1749-6632.2009.05144.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.