Abstract
Background
The notion that substance use can induce symptoms of depression and anxiety is influential in clinical practice, however questions remain about the empirical support for this hypothesis.
Methods
We analysed mental health and substance dependence screening records for 280 outpatients in addictions treatment. Item-level data for depression (PHQ-9), anxiety (GAD-7), severity of dependence (SDS) and self-reported weekly substance use were studied using factor analysis and correlations. Symptom-level associations between substance use and psychological distress symptoms were examined after controlling for underlying levels of psychopathology.
Results
We obtained a two-factor solution accounting for approximately 48 % of total variance. Depression and anxiety symptoms loaded onto a single psychopathology factor. Severity of dependence (SDS) and substance use measures loaded onto a distinct but correlated factor. After controlling for latent levels of psychopathology, the only remaining symptom-level associations were impaired concentration linked to cannabis use and irritability linked to alcohol use. Dependence (SDS) was prominently associated with depressive rumination, and negatively correlated with residual anxiety symptoms related to substance use (e.g., craving).
Conclusions
Overall, this analysis supports a psychological understanding of comorbidity; with dependence, craving, negative reinforcement and rumination as key variables.
Keywords: Depression, Anxiety, Alcohol, Drugs, Addiction
Background
Substance use disorders and common mental disorders (CMD) such as depression and anxiety often co-exist. This finding is consistent across epidemiological surveys conducted in the general population [1–4] and in clinical samples [5–7]. Many have interpreted this common overlap in disorders as evidence that substance use can induce or mimic depressive and anxiety symptoms. The notion of substance induced disorders has a firmly anchored place in diagnostic manuals [8, 9], structured assessment interviews [10–12] and clinical practice guidelines in the addictions field [13–15]. An illustrative example of the reification of this assumption is offered by Raimo and Schuckit who assert that –when assessing alcohol users– “unless independent major depressive syndromes are clearly established, it is assumed that the only depressive episodes that have been experienced were likely to be substance induced” [16], p. 935.
Although the substance induced hypothesis continues to influence current clinical practice, there is some contention about its empirical foundations. More recent epidemiological surveys [17, 18] found that substance induced depression and anxiety disorders are less common than expected (≤10 % of cases in clinical samples, and <1 % in the general population). Several clinical reports have noted that substance users’ psychological distress symptoms remitted after a brief period of observation, typically within less than a month [19–21]. Such reports are taken to indicate that a reduction of psychoactive substance use may account for improved psychological state, but they do not account for or rule out the possible influence of other ‘third’ or potentially mediating variables. For example, large cross-sectional and longitudinal surveys have demonstrated that this combination of disorders appears to be mostly prominent in people who meet criteria for alcohol or substance dependence, rather than in those with less chronic or episodic substance use [22, 23]. This raises questions about whether there is indeed a causal relationship between levels of substance use and symptoms of CMD. An alternative possibility is that substance dependence as a psychological and behavioural syndrome may be associated with CMD, irrespective of the level of consumption. Severity of dependence is known to correlate with level of substance use and psychopathology; however symptoms of dependence can nevertheless be present in abstainers [24].
Furthermore, most studies in this area examine associations at the level of syndromes or disorders, which could possibly mask specific symptom-level relationships and could also introduce artificial relationships because of double counting of symptoms [25]. For instance, in a recent study, severity of dependence has been found to correlate with several symptoms of depression and anxiety, whereas only few CMD symptoms were correlated with level of substance use and abstainers were just as likely to have a CMD diagnosis compared to users [26]. Symptom-level associations such as these have rarely been examined, and until such studies proliferate the debate about causal links will probably continue unabated.
In the present paper, we examine the relationships between substance use, severity of dependence and CMD at the level of symptoms and latent dimensions of psychopathology. The main aims of this study were to determine the factor structure of a battery of measures covering the above domains in a clinical sample, and to describe and interpret the patterns of symptom-level associations.
Methods
Design and context
This paper presents factor analyses and correlations based on pooled data from two prior studies that applied a mental health screening strategy in addiction services [27, 28]. Both studies recruited patients accessing community based alcohol, drug and rehabilitation teams in a large city in the north of England. These were multi-disciplinary teams offering access to medical (e.g., opiate substitute treatment) and psychosocial input to minimise harms associated with substance use and to support access to housing, social care, training, peer mentorship and employment opportunities. Interventions offered by these services were consistent with national guidelines for the management of substance use disorders [29, 30].
Both studies purposefully aimed to screen patients at various stages of their contact with addiction services (range of months in treatment = 0–70), which would ensure results were less likely to be confounded by the acute distress typically observed in new patients. Both studies enlisted the support of drug and alcohol workers to screen participants, and applied methods to minimise selection bias (database searches, use of appointment and reminder systems to prompt clinicians to contact potential participants). Both studies applied the same patient reported outcome measures (PROMs) to identify patients with CMD. Further details of the primary studies and recruitment methods can be found in the source publications.
Informed consent was provided by all participants across both studies to use their anonymous data as part of research, and ethical approval was provided by the University of York [reference: RGC/03.07.09] and the English National Health Service Research Ethics Committee [REC reference: 12/YH/0096].
Psychometric measures and screening strategy
Four PROMs were applied to screen for substance use, dependence and symptoms of common mental health problems.
Addiction related measures
The Treatment Outcomes Profile (TOP) is a twenty-item measure covering four domains: substance use, injecting risk behaviour, crime and health & social functioning [31]. The measure is based on the timeline follow-back method [32]; which prompts respondents to recall the average quantity and frequency of substances used during the last 4 weeks. The TOP has been reported to have adequate sensitivity (0.57–0.89) and specificity (0.85–0.92) compared to independent drug toxicology tests.
The Severity of Dependence Scale (SDS) is a measure of psychological dependence, capturing aspects of compulsive substance use, concern over use and degree of control over use [33]. This five-item questionnaire yields a total score between 0 and 15, where scores above 10 are indicative of severe dependence. The SDS has been extensively validated as a reliable screening tool for dependence on a variety of substances including alcohol, heroin, crack, cannabis and other illicit and prescription drugs [34–38]. Patients in the source studies were asked to complete the SDS measure only for their primary substance of concern (most frequently used and/or the index substance for which they sought treatment in the case of abstainers). The internal reliability (Cronbach’s alpha) estimate for the SDS in the study sample was α = .85.
Common mental disorder (CMD) related measures
The PHQ-9 is a nine-item questionnaire based on diagnostic criteria for major depression, which renders a severity score between 0 and 27 [39]. The PHQ-9 has been validated as a reliable case-finding tool for clinically significant depression symptoms in substance users based on a cut-off score ≥12, with 81 % sensitivity and 75 % specificity [27]. Cronbach’s alpha for PHQ-9 in this study sample was α = .83.
The GAD-7 questionnaire [40] was used to assess severity of anxiety symptoms, with scores ranging between 0 and 21, where a score ≥9 indicates the likely presence of an anxiety disorder with 80 % sensitivity and 86 % specificity [41]. Cronbach’s alpha for GAD-7 in this study sample was α = .88.
The TOP questionnaire cited above also contains a single item psychological health scale (TOP-4a), which asks respondents to rate their psychological wellbeing on a scale of 0 (poor) to 20 (good). A cut-off score ≤12 on the TOP-4a has been found to have adequate sensitivity (83 %) and specificity (71 %) to detect a probable diagnosis of a CMD [42].
Sample characteristics
A total of 280 screening records were included in this study. Most respondents were white British (80.3 %) males (74.5 %), with a mean age of 36.74 (SD = 7.18; range = 23 – 60). The majority (97.1 %) were prescribed opiate substitute medication, but less than half (40.7 %) were prescribed antidepressants. The most commonly used substances in this sample were alcohol (47.1 % of users), heroin (42.9 %), cannabis (23.9 %), crack (23.2 %), benzodiazepines (6.4 %), cocaine (3.6 %), and amphetamines (2.1 %). Approximately 47.5 % were polysubstance users, 17.5 % reported intravenous use, and 17.5 % reported being currently abstinent for at least a month. Weekly substance use estimates are presented in Table 1 for the four most commonly used substances (alcohol, heroin, cannabis and crack). Mean scores for PROMs were SDS = 7.08 (SD = 4.69); PHQ-9 = 13.58 (SD = 6.14); GAD-7 = 10.28 (SD = 5.58); TOP-4a = 9.95 (SD = 4.29). According to mental health measures, 61.8 % had clinically significant depression (PHQ-9) symptoms, 59.2 % had clinically significant anxiety (GAD-7) symptoms, and 73.5 % were likely to meet criteria for a CMD (TOP-4a).
Table 1.
QF measures | Distribution of cases across quintile levels of substance use | |||||||
---|---|---|---|---|---|---|---|---|
Substances | Mean | SD | Range | Non-user | Light | Moderate | Frequent | Heavy |
Alcohol (u) | 40.43 | 53.72 | 1 – 252 | 136 | 32 | 19 | 21 | 24 |
Heroin (g) | 0.91 | 1.51 | 0.01 – 10.50 | 148 | 35 | 10 | 22 | 17 |
Cannabis (j) | 16.65 | 16.25 | 1 – 70 | 188 | 11 | 13 | 13 | 7 |
Crack (g) | 0.47 | 0.68 | 0.02 – 3.50 | 191 | 13 | 9 | 10 | 9 |
Notes: QF quantity x frequency per week; alcohol measured in units (u); heroin and crack measured in grams (g); cannabis measured in joints (j)
Statistical analyses
Consistent with the aims of this study, statistical analyses were performed in 3 stages focusing on (1) describing the sample, (2) undertaking factor analyses, and (3) exploring associations between screening domains. The following analyses were performed with IBM SPSS 22 and FACTOR 9.3.1.
Descriptive statistics are reported for demographic characteristics, and mean levels of substance use, severity of dependence, depression and anxiety symptoms. To enhance the precision of substance use information gathered by the TOP questionnaire, we calculated quantity x frequency (QF) measures by multiplying the average amount of use in a typical day by the number of days used in the last week. This method is likely to reduce recall bias and has been used in prior correlational studies [43]. Given the sample size limits, QF measures were only derived for the 4 most commonly used substances: alcohol, heroin, crack, cannabis.
Two datasets including all items (N = 26) across PHQ-9, GAD-7, SDS, TOP-4a and QF measures were used for factor analyses. Dataset A included 232 (82.9 %) cases with complete data on all items. Dataset B included all cases (N = 280), where missing items were imputed using an expectation-maximization procedure [44].
Conventional analyses were used to empirically evaluate the adequacy of the dataset for factor analysis; these included the Kaiser-Meyer-Olkin (KMO) test and Bartlett’s test of sphericity. Since we analysed ordinal questionnaire responses, polychoric correlations were used to determine the degree of relationship between the individual items. In contrast to Pearson correlations, polychoric correlations assume a monotone relationship between two variables and the response categories are not assumed to be equidistant across items [45]. Since the QF data were highly skewed and not of the same magnitude across the four different substances, we transformed them into 5 ordinal variables. The new variables differentiate between zero (abstainers) versus four increasing levels of consumption (4 quartile levels of substance use displayed in Table 1). This transformation is clinically meaningful, the responses are scaled on a similar metric to each other, and therefore it enabled us to analyse these variables together with the items of the other clinical measures [46].
Our a priori assumptions were that we would find multiple correlated factors: SDS, a single factor for CMD symptoms, and 3 factors for QF measures (one for alcohol, one for cannabis, and one for heroin and crack given this common polysubstance use pattern). Based on this rationale, we performed factor analysis based on unweighted least squares, with promin rotation [47]. Next, we applied Parallel Analysis (PA) [48] and the Hull method [49] to empirically determine how many factors optimally explained the variability in the data. While parallel analysis determines the number of factors that extract more variability than expected in a structurally similar set of random data, the Hull Method determines a solution balancing complexity (degrees of freedom of a solution) and fit to the data (comparative fit index). This analysis strategy was initially performed in dataset A, and replicated in dataset B as a sensitivity analysis.
Finally, we examined item-level correlations between the domains of substance use and CMD symptoms in dataset A. These were carried out as partial correlations controlling for the CMD latent dimension scores derived from the factor analysis. The rationale for this was to investigate whether any associations between substance use and CMD symptoms remain after controlling for psychopathology. In a second step, these partial correlations additionally controlled for the potential influence of 'recent quitters' who abstained during 4 weeks and may be displaying atypical levels of distress [50]. Instances with discrepant results between steps 1 and 2 of analysis prompted us to investigate possible non-linear associations graphically (using error bars) and statistically (using polynomial analysis of variance equations).
Results
Factor analysis
Assumption testing
The suitability of applying factor analysis with the set of 26 variables in dataset A was confirmed by Bartlett’s test of sphericity, which was non-significant (approximate x2 = 2524.8, df = 325, p < .001). In addition, the overall KMO measure of sampling adequacy was 0.90, indicating excellent factorability.
Factor structure
In contrast to our expectations, both selection criteria suggested a two factor solution: Two inter-correlated (r = .45) latent factors accounted for 47.5 % of variance in the dataset (35.1 % and 12.4 %, respectively). After promin rotation, factor 1 included item TOP-4a and all items from PHQ-9 and GAD-7 (loadings = .50 − .93), thus representing a latent CMD factor. TOP-4a was negatively correlated (−.50) with factor 1, since a higher score on this measure indicates better psychological wellbeing. Factor 2 included all SDS items (loadings = .61 − .90), plus QF measures for heroin (.53) and crack use (.36), representing a substance use and dependence (SUD) dimension. QF measures for alcohol (factor 1 loading = .02, factor 2 = .16) and cannabis (factor 1 loading = −.11, factor 2 = .17) were excluded from the final rotated solution, given their weak correlations which were smaller than the conventional cut-off of .30.
Repeating these series of analyses in sample B led to similar results. A two factor solution with the same item loading structure explained 48.2 % of variance (factor 1 = 35.5 %, factor 2 = 12.7 %) and the inter-factor correlation was .43. Therefore, missing data items were unlikely to influence the results of the analysis. The final rotated solutions attained in both samples are displayed in Table 2.
Table 2.
Sample A (N = 232) | Sample B (N = 280) | ||||||
---|---|---|---|---|---|---|---|
Inter-factors correlation = .45 | Inter-factors correlation = .43 | ||||||
Item | Description | Factor 1 (CMD) | Factor 2 (SUD) | Communality | Factor 1 (CMD) | Factor 2 (SUD) | Communality |
Alcohol QF | Alcohol quantity x frequency of use (last week) | – | – | .03 | – | – | .02 |
Heroin QF | Heroin quantity x frequency of use (last week) | .53 | .27 | .56 | .28 | ||
Crack QF | Crack quantity x frequency of use (last week) | .36 | .11 | .39 | .14 | ||
Cannabis QF | Cannabis quantity x frequency of use (last week) | – | – | .03 | – | – | .02 |
TOP4a | Self-rated psychological wellbeing | -.50 | .25 | -.54 | .27 | ||
PHQ1 | Loss of interest and pleasure | .53 | .33 | .59 | .37 | ||
PHQ2 | Depressed mood | .80 | .63 | .82 | .63 | ||
PHQ3 | Disrupted sleeping patterns | .54 | .28 | .58 | .31 | ||
PHQ4 | Lethargy | .58 | .34 | .57 | .31 | ||
PHQ5 | Disruptions in appetite | .52 | .32 | .54 | .32 | ||
PHQ6 | Depressive rumination | .57 | .58 | .61 | .60 | ||
PHQ7 | Disrupted concentration | .61 | .33 | .67 | .39 | ||
PHQ8 | Psychomotor deficits or agitation | .55 | .37 | .59 | .40 | ||
PHQ9 | Suicidal ideation | .61 | .45 | .62 | .48 | ||
GAD1 | Feelings of anxiety and nervousness | .79 | .58 | .81 | .62 | ||
GAD2 | Impaired control over worry | .93 | .74 | .88 | .70 | ||
GAD3 | Generalised worry about different things | .83 | .62 | .82 | .62 | ||
GAD4 | Trouble relaxing | .84 | .62 | .86 | .66 | ||
GAD5 | Restlessness | .68 | .50 | .69 | .51 | ||
GAD6 | Irritability | .55 | .37 | .57 | .40 | ||
GAD7 | Fear | .73 | .56 | .63 | .46 | ||
SDS1 | Impaired control over substance use | .90 | .76 | .88 | .74 | ||
SDS2 | Worry about missing a dose of substance use | .78 | .58 | .76 | .55 | ||
SDS3 | Worry about substance use | .87 | .78 | .87 | .79 | ||
SDS4 | Wish to stop substance use | .83 | .62 | .84 | .64 | ||
SDS5 | Difficulty in abstaining from substance use | .61 | .41 | .62 | .41 |
Notes: Factor loadings smaller than cut-off of .30 were omitted. Sample A included all cases with complete data on all items. Sample B applied multivariate imputation of missing data items. Variance explained by the factor solution was 47.5 % in sample A and 48.2 % in Sample B
Partial correlations controlling for level of (latent) CMD psychopathology
Figure 1 displays network plots of item-level partial correlations from the two steps of analysis; where solid and dashed lines represent positive and negative correlations respectively. We observed small residual correlations between PHQ-9 and GAD-7 items after partialling out the shared CMD factor which explained a large proportion of variance in both measures. However, contrary to our expectations, we noted several negative partial correlations between these measures in both steps of analysis (r = −.13 to–.28).
All SDS items were significantly correlated with PHQ-9 item 6 (depressive rumination; r = −.19 − .31) and negatively correlated (r = −.13 to–.22) with GAD7 items 1 (anxiety), 2 (uncontrollable worry), 4 (trouble relaxing), and 5 (restlessness). All SDS items were correlated with heroin use (r = .16 − .29), although item 5 (difficulty abstaining) was no longer significant in the second step of analysis after controlling for abstainers.
Alcohol use was correlated with GAD-7 item 6 (irritability; r = .14) although this relationship was not significant after controlling for abstainers. After closer examination, we found that a v-shaped non-linear equation offered an adequate fit to this relationship; F (4, 227) = 4.17, p < .01, weighted quadratic term p < .01. Heroin use was negatively correlated (r = −.15) with GAD-7 item 2 (uncontrollable worry), but this was not significant at step 2. A non-linear equation did not improve model fit for this relationship; F (4, 227) = 0.30, p = .88. Crack use was negatively correlated (r = −.15 to–.17) with GAD-7 item 3 (generalised worry). Cannabis use was correlated (r = .19– .22) with PHQ–9 item 7 (disrupted concentration). As expected, heroin and crack use were significantly correlated (r = .37 − .40). After controlling for abstainers, we observed negative correlations between alcohol and crack use (r = −.19), and heroin and cannabis use (r = −.20). In these inter-substance correlations, the more appropriate analysis was step 2, since logically we are investigating likelihood of poly-use for those who actively use substances. Figure 2 displays significant non-linear associations between alcohol with irritability (GAD-7 tem 6, r = −.19) and with difficulty abstaining (SDS item 5, r = −.19).
Discussion
Main findings
This study presents a detailed examination of symptom-level associations between common mental disorders (CMD), substance use and severity of dependence. To our knowledge, such analyses are rare [26], and offer novel information to validate theories about comorbidity and psychopathological processes. Consistent with the wider literature cited above, we found significant and moderate correlations between psychopathology and severity of dependence in a clinical sample of drug and alcohol users, although these were distinct and separate dimensions. Factor analyses indicated that depression and anxiety symptoms loaded onto a single underlying dimension, which converges with prior studies [51, 52]. Substance use and severity of dependence were strongly associated and mapped onto a single dimension. After controlling for patients’ level of psychopathology represented by their CMD factor scores, we found evidence of statistically significant albeit small correlations between substance use and psychological distress at the level of individual symptoms. In what follows, we describe these patterns of associations and offer a theoretical interpretation of the findings.
The most prominent association pattern was that between severity of dependence (SDS) with depressive rumination, and its negative correlation with feelings of anxiety, uncontrollable worry, restlessness and inability to relax. This inverse pattern may explain the unexpected residual negative correlations between depression and anxiety symptoms (after partialling out their shared psychopathology). We note that these residual anxiety symptoms are similar to the phenomenology of craving and withdrawal [8, 9]. Further supporting evidence was found in the partial correlations (controlling for psychopathology) between worry about missing a dose (of substance use) and psychomotor agitation, impaired control over substance use and inability to relax, and the finding that heavier heroin and crack users were less prone to worry. It is plausible that more severely dependent respondents were compulsively using substances in a way that mitigated such feelings of restlessness and craving, but this ultimately resulted in negative bouts of rumination, which in turn exacerbated wider aspects of depressive mood.
This deduction from our findings fits within a wider body of research. For example, Franken et al. [53] carried out a factor analysis of two opiate craving questionnaires in a sample of 102 addiction service users and described a 3-factor solution covering aspects of ‘desire and intention to use’ , ‘negative reinforcement’ and ‘control’. The strongest inter-factor correlation (r = .39) indicated that ‘desire to use’ substances was driven by a need to suppress worry, tension and thoughts about life problems (‘negative reinforcement’). Furthermore, items from the ‘control’ factor were negatively associated with items from the other 2 domains. Craving is also known to be associated with biased attention to environmental cues related to substance use [54], which may partly explain the experience of uncontrollable worry (about substance use). On the other hand, perseverant negative thinking (rumination) is often associated with depression [55–57] and has been described as a transdiagnostic factor underlying several mental disorders [58]. Rumination has been found to predict the onset of depressive symptoms in non-clinical samples [59–61], and it appears to maintain symptoms of low mood and anxiety in depressed patients [62].
Moreover, we found that two of the substance use measures (heroin and alcohol) were correlated with loss of control over substance use. This is consistent with research indicating that alcohol impairs inhibitory control [63, 64], although this is less evident for opiates [64] and instead may reflect a psychological aspect of lower perceived control over heroin use. Cannabis use was correlated with impaired concentration, which reflects the expected psychoactive effects of this substance [65]. Although robust quantitative research for cannabis-induced neurocognitive deficits is still scarce, there is some evidence that cannabis use impairs the ability to learn and recall new information [66].
A particularly interesting pattern of non-linear associations were found for alcohol use (Fig. 2). Moderate drinkers had lower mean scores for feelings of irritability compared to non-drinkers and heavy/severe users. In addition, light drinkers reported lower levels of perceived difficulty in abstaining compared to non-drinkers and moderate to severe drinkers. Non-linear associations between alcohol and psychological distress have been reported in numerous studies [50, 67–72]. These studies model associations based on aggregated scores, which may mask more specific symptom-level patterns. The ‘stress buffer’ theory [73] seems like a plausible explanation for our findings, suggesting that a moderate dose of alcohol use may mitigate feelings of psychological distress [74]. Still, at higher doses, alcohol may provide less protection from irritability once inhibitory control declines, often giving way to overt aggression particularly in men with heightened irritability [75]. An alternative explanation may be that the findings are confounded by other sample characteristics [76], for instance more well-adjusted respondents may cluster in the ‘moderate group’. This latter explanation seems less probable, given that moderate drinkers seem less resilient in their efforts to abstain from alcohol use (as shown in Fig. 1, panel a).
Strengths and limitations
An important limitation is the relatively small sample size by comparison to epidemiological studies in this area. Our sample size was adequately powered to undertake factor analysis based on Bryant and Yarnold’s criteria [77], which would require 5 respondents per item (N = 130). Still, we note that there are divergent views about sample size calculations for factor analysis, and others suggest a minimum of 500 participants [78]. Other considerations to note about the generalizability of these findings concern the outpatient setting, with a majority of respondents whose primary reason for treatment related to opiate use. Although nearly half of all respondents reported using alcohol, and some at a very severe level, we noted that alcohol use was weakly correlated with only 2 SDS items, and did not load onto factor 2. It may be that including more participants from alcohol detox or inpatient settings could render different patterns of correlation. It is also possible that the method of administration of the SDS measure may have influenced the strength of correlations. SDS was rated for the primary substance of concern, which in some cases could have been a substance other than alcohol (e.g., heroin), and this may have therefore impacted on the strength of observed correlations between alcohol use and SDS. Finally, we also note that the cross-sectional nature of these data limit the possibility of making more certain claims about casual relationships. Our deductions from this sample should therefore be taken as a preliminary investigation of functional links between aspects of psychopathology and addictive behaviours, awaiting further validation in prospective studies with mediational tests.
Considerations for practice and research
The emerging literature on comorbidity suggests that substance induced depression and anxiety symptoms are relatively uncommon, though they may be more conspicuous in addiction treatment settings. Our findings show that after factoring out general psychological distress, essentially no specific covariance between substance use patterns and psychological distress items remains. This is strong evidence that general psychological distress is a moderator of the relationship, but it is unclear from the current study in which direction the causal arrow points.
From this perspective, the common practice of assuming that most CMD symptoms are drug-induced is ethically questionable, especially if such practices hamper timely diagnosis and access to mental healthcare. Psychometrically adequate screening methods are available to detect CMD in substance users [27, 41, 79, 80], but these methods are not consistently implemented in routine practice. Based on our symptom-level correlations, we propose that diagnostic results may perhaps be enhanced by applying a repeated screening method after a month of watchful wait for heavy cannabis users who show signs of severe disruption to concentration, and heavy drinkers who show increased signs of irritability and hyper-arousal. Residual anxiety symptoms that may reflect craving/withdrawal phenomena should be carefully distinguished from generalised anxiety disorder, possibly by supplementing screening measures with probing questions or interviews. The training of addiction treatment professionals [81, 82] in the application of such screening methods may be an important focus of future dissemination studies and policies.
Conclusion
After controlling for latent levels of psychopathology, we found little evidence of associations between symptoms of depression/anxiety with substance use. The only significant symptom-level associations were impaired concentration linked to cannabis use and irritability linked to alcohol use. Severity of dependence –a psychological construct– is prominently associated with depressive rumination, and negatively correlated with residual anxiety symptoms related to substance use (e.g., craving). Overall, this analysis supports a psychological understanding of comorbidity; with dependence, craving, negative reinforcement and rumination as key variables.
Abbreviations
CMD, common mental disorders; GAD-7, generalized anxiety disorder questionnaire (7-item anxiety scale); PHQ-9, patient health questionnaire (9-item depression scale); PROMs, patient reported outcome measures; QF, quantity x frequency (of substance use); SDS, severity of dependence scale; TOP, Treatment Outcomes Profile questionnaire
Acknowledgements
We thank Stuart Gore for his contribution to the co-ordination of screening and data collection as part of the COBID Trial (ISRCTN26937594).
Funding
The primary studies were funded by St. Anne’s Community Services and Leeds Community Healthcare NHS Trust, Leeds, United Kingdom. The funding sources had no influence in the design or the decision to publish the study.
Availability of data and materials
Access to data can be requested by contacting the corresponding author.
Authors’ contributions
All authors contributed to the conception of the study. JD and JB conducted statistical analyses and led on drafting the manuscript. All authors contributed to interpretation and discussion of results and approved the final version of the manuscript.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. The primary studies that generated data for the current investigation were approved by research ethics committees at the University of York (Ref: RGC/03/07/2009) and the English National Health Service (REC Ref: 12/YH/0096). The authors had permission to access and pool the datasets to perform secondary analyses.
Contributor Information
Jaime Delgadillo, Phone: +44 01904 32 1633, Email: jaime.delgadillo@nhs.net.
Jan R. Böhnke, Email: jan.boehnke@york.ac.uk
Elizabeth Hughes, Email: E.C.Hughes@hud.ac.uk.
Simon Gilbody, Email: simon.gilbody@york.ac.uk.
References
- 1.Burns L, Teesson M. Alcohol use disorders comorbid with anxiety, depression and drug use disorders. Findings from the Australian National Survey of Mental Health and Well Being. Drug Alcohol Depend. 2002;68:299–307. doi: 10.1016/S0376-8716(02)00220-X. [DOI] [PubMed] [Google Scholar]
- 2.Merikangas KR, Mehta RL, Molnar BE, Walters EE, Swendsen JD, Aguilar-Gaziola S, et al. Comorbidity of substance use disorders with mood and anxiety disorders: results of the International Consortium in Psychiatric Epidemiology. Addict Behav. 1998;23:893–907. doi: 10.1016/S0306-4603(98)00076-8. [DOI] [PubMed] [Google Scholar]
- 3.Regier DA, Farmer ME, Rae DS, Locke BZ, Keith SJ, Judd LL, et al. Comorbidity of mental disorders with alcohol and other drug abuse: Results from the Epidemiological Catchment Area study. JAMA. 1990;264:2511–2518. doi: 10.1001/jama.1990.03450190043026. [DOI] [PubMed] [Google Scholar]
- 4.Swedensen JD, Merikangas KR, Canino GJ, Kessler RC, Rubio-Stipec M, Angst J. The comorbidity of alcoholism with anxiety and depressive disorders in four geographic communities. Compr Psychiatry. 1998;9:176–184. doi: 10.1016/s0010-440x(98)90058-x. [DOI] [PubMed] [Google Scholar]
- 5.Bergman HC, Harris M. Substance abuse among young adult chronic patients. Psychosoc Rehabil J. 1985;9:49–54. doi: 10.1037/h0099162. [DOI] [Google Scholar]
- 6.Marsden J, Gossop M, Stewart D, Rolfe A, Farrell M. Psychiatric symptoms among clients seeking treatment for drug dependence: Intake data from the National Treatment Outcome Research Study. Br J Psychiatry. 2000;176:285–289. doi: 10.1192/bjp.176.3.285. [DOI] [PubMed] [Google Scholar]
- 7.Weaver T, Madden P, Charles V, Stimson G, Renton A, Tyrer P, et al. Comorbidity of substance misuse and mental illness in community mental health and substance misuse services. Br J Psychiatry. 2003;183:304–313. doi: 10.1192/bjp.183.4.304. [DOI] [PubMed] [Google Scholar]
- 8.American Psychiatric Association . Diagnostic and statistical manual of mental disorders: DSM-IV-TR. Washington, DC: APA; 2000. [Google Scholar]
- 9.World Health Organization . International Statistical Classification of Diseases and Related Health Problems, Tenth Revision. Geneva: WHO; 1992. [PubMed] [Google Scholar]
- 10.Bucholz KK, Cadoret R, Cloninger CR, Dinwiddie SH, Hesselbrock VM, Nurnberger JI, Jr, et al. A new, semi-structured psychiatric interview for use in genetic linkage studies: a report on the reliability of the SSAGA. J Stud Alcohol. 1994;55:149–158. doi: 10.15288/jsa.1994.55.149. [DOI] [PubMed] [Google Scholar]
- 11.Grant BF, Dawson D. The Alcohol Use Disorder and Associated Disabilities Interview Schedule-IV (AUDADIS-IV) Rockville, MD: National Institute on Alcohol Abuse and Alcoholism; 2000. [Google Scholar]
- 12.Hasin DS, Trautman KD, Endicott J. Psychiatric research interview for substance and mental disorders: phenomenologically based diagnosis in patients who abuse alcohol or drugs. Psychopharmacol Bull. 1998;34:3–8. doi: 10.1097/JCP.0000000000000075. [DOI] [PubMed] [Google Scholar]
- 13.Center for Substance Abuse Treatment . Substance Abuse Treatment for Persons With Co-Occurring Disorders. Treatment Improvement Protocol (TIP) Series 42. DHHS Publication No. (SMA) 05–3922. Rockville, MD: Substance Abuse and Mental Health Services Administration (SAMHSA); 2005. [PubMed] [Google Scholar]
- 14.Haber P, Lintzeris N, Proude EM, Lopatko O. Guidelines for the treatment of alcohol problems. Sydney: Department of Health and Ageing; 2009. [Google Scholar]
- 15.Pilling S, Yesufu-Udechuku A, Taylor C, Drummond C. Diagnosis, assessment, and management of harmful drinking and alcohol dependence: summary of NICE guidance. BMJ. 2011;342:d700. doi: 10.1136/bmj.d700. [DOI] [PubMed] [Google Scholar]
- 16.Raimo EB, Schuckit MA. Alcohol dependence and mood disorders. Addict Behav. 1998;23:933–946. doi: 10.1016/S0306-4603(98)00068-9. [DOI] [PubMed] [Google Scholar]
- 17.Grant BF, Stinson FS, Dawson DA, Chou SP, Dufour MC, Compton W, et al. Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders. Results from the National Epidemiologic Survey on Alcohol and Related Conditions. Arch Gen Psychiatry. 2004;61:807–816. doi: 10.1001/archpsyc.61.8.807. [DOI] [PubMed] [Google Scholar]
- 18.Torrens M, Gilchrist G, Domingo-Salvany A. Psychiatric comorbidity in illicit drug users: Substance-induced versus independent disorders. Drug Alcohol Depend. 2011;113:147–156. doi: 10.1016/j.drugalcdep.2010.07.013. [DOI] [PubMed] [Google Scholar]
- 19.Brown SA, Inaba RK, Gillin C, Schuckit MA, Stewart MA, Irwin MR. Alcoholism and affective disorder: Clinical course and depressive symptoms. Am J Psychiatry. 1995;152:45–52. doi: 10.1176/ajp.152.1.45. [DOI] [PubMed] [Google Scholar]
- 20.Brown SA, Schuckit MA. Changes in depression among abstinent alcoholics. J Stud Alcohol. 1988;49:412–417. doi: 10.15288/jsa.1988.49.412. [DOI] [PubMed] [Google Scholar]
- 21.Kosten TR, Kleber HD. Differential diagnosis of psychiatric comorbidity in substance abusers. J Subst Abuse Treat. 1988;5:201–206. doi: 10.1016/0740-5472(88)90042-6. [DOI] [PubMed] [Google Scholar]
- 22.Boschloo L, Vogelzangs N, van den Brink W, Smit JH, Veltman DJ, Beekman ATF, et al. Alcohol use disorders and the course of depressive and anxiety disorders. Br J Psychiatry. 2012;200:476–484. doi: 10.1192/bjp.bp.111.097550. [DOI] [PubMed] [Google Scholar]
- 23.Kessler RC, Crum RM, Warner LA, Nelson CB, Schulenberg J, Anthony JC. Lifetime co-occurrence of DSM-III-R alcohol abuse and dependence with other psychiatric disorders in the national comorbidity survey. Arch Gen Psychiatry. 1997;54:313–321. doi: 10.1001/archpsyc.1997.01830160031005. [DOI] [PubMed] [Google Scholar]
- 24.Skinner HA, Allen BA. Alcohol dependence syndrome: Measurement and validation. J Abnorm Psychol. 1982;91:199–209. doi: 10.1037/0021-843X.91.3.199. [DOI] [PubMed] [Google Scholar]
- 25.Böhnke JR, Croudace TJ. Factors of psychological distress: Clinical value, measurement substance, and methodological artefacts. Soc Psychiatry Psychiatr Epidemiol. 2015;50:515–524. doi: 10.1007/s00127-015-1022-5. [DOI] [PubMed] [Google Scholar]
- 26.Delgadillo J, Godfrey C, Gilbody S, Payne S. Depression, anxiety and comorbid substance use: association patterns in outpatient addictions treatment. Ment Health Subst Use. 2013;6:59–75. doi: 10.1080/17523281.2012.660981. [DOI] [Google Scholar]
- 27.Delgadillo J, Payne S, Gilbody S, Godfrey C, Gore S, Jessop D, et al. How reliable is depression screening in alcohol & drug users? A validation of brief and ultra-brief questionnaires. J Affect Disord. 2011;134:266–271. doi: 10.1016/j.jad.2011.06.017. [DOI] [PubMed] [Google Scholar]
- 28.Delgadillo J, Gore S, Ali S, Ekers D, Gilbody S, Gilchrist G, et al. Feasibility randomized controlled trial of cognitive and behavioral interventions for depression symptoms in patients accessing drug and alcohol treatment. J Subst Abuse Treat. 2015;55:6–14. doi: 10.1016/j.jsat.2015.02.008. [DOI] [PubMed] [Google Scholar]
- 29.Department of Health (UK . Drug Misuse and Dependence: UK Guidelines on Clinical Management. London: Department of Health (England), the Scottish Government, Welsh Assembly Government and Northern Ireland Executive; 2007. [Google Scholar]
- 30.National Institute for Health and Care Excellence. Alcohol use disorders: diagnosis, assessment and management of harmful drinking and alcohol dependence. NICE Clinical Guideline 115; 2011. [PubMed]
- 31.Marsden J, Farrell M, Bradbury C, Dale-Perera A, Eastwood B, Roxburgh M, et al. Development of the treatment outcomes profile. Addiction. 2008;103:1450–1460. doi: 10.1111/j.1360-0443.2008.02284.x. [DOI] [PubMed] [Google Scholar]
- 32.Fals-Stewart W, O’Farrell TJ, Freitas TT, McFarlin SK, Rutigliano P. The timeline followback reports of psychoactive substance use by drug-abusing patients: Psychometric properties. J Consult Clin Psychol. 2000;68:134–144. doi: 10.1037/0022-006X.68.1.134. [DOI] [PubMed] [Google Scholar]
- 33.Gossop M, Darke S, Griffiths P, Hando J, Powis B, Hall W, et al. The Severity of Dependence Scale (SDS): Psychometric properties of the SDS in English and Australian samples of heroin, cocaine and amphetamine users. Addiction. 1995;90:607–614. doi: 10.1111/j.1360-0443.1995.tb02199.x. [DOI] [PubMed] [Google Scholar]
- 34.Castillo II, Saiz FG, Rojas OL, Vazquez MAL, Lerma JMJ. Estimation of cutoff for the severity of dependence scale (SDS) for opiate dependence by ROC analysis. Actas Esp Psiquiatr. 2010;38:270–277. [PubMed] [Google Scholar]
- 35.Kaye S, Darke S. Determining a diagnostic cut-off on the severity of dependence scale (SDS) for cocaine dependence. Addiction. 2002;97:727–731. doi: 10.1046/j.1360-0443.2002.00121.x. [DOI] [PubMed] [Google Scholar]
- 36.Lawrinson P, Copeland J, Gerber S, Gilmour S. Determining a cut-off on the severity of dependence scale (SDS) for alcohol dependence. Addict Behav. 2007;32:1474–1479. doi: 10.1016/j.addbeh.2006.09.005. [DOI] [PubMed] [Google Scholar]
- 37.Martin G, Copeland J, Gates P, Gilmour S. The severity of dependence scale (SDS) in an adolescent population of cannabis users: Reliability, validity and diagnostic cut-off. Drug Alcohol Depend. 2006;83:90–93. doi: 10.1016/j.drugalcdep.2005.10.014. [DOI] [PubMed] [Google Scholar]
- 38.Swift W, Copeland J, Hall W. Choosing a diagnostic cut-off for cannabis dependence. Addiction. 1998;93:1681–1692. doi: 10.1046/j.1360-0443.1998.931116816.x. [DOI] [PubMed] [Google Scholar]
- 39.Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Spitzer R, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch Intern Med. 2006;66:1092–1097. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 41.Delgadillo J, Payne S, Gilbody S, Godfrey C, Gore S, Jessop D, et al. Brief case finding tools for anxiety disorders: Validation of GAD-7 and GAD-2 in addictions treatment. Drug Alcohol Depend. 2012;125:37–42. doi: 10.1016/j.drugalcdep.2012.03.011. [DOI] [PubMed] [Google Scholar]
- 42.Delgadillo J, Payne S, Gilbody S, Godfrey C. Psychometric properties of the Treatment Outcomes Profile (TOP) psychological health scale. Ment Health Subst Use. 2013;6:140–149. doi: 10.1080/17523281.2012.693521. [DOI] [Google Scholar]
- 43.Hartka E, Johnstone B, Leino EV, Motoyoshi M, Temple MT, Fillmore KM. A meta-analysis of depressive symptomatology and alcohol consumption over time. Br J Addict. 1991;86:1283–1298. doi: 10.1111/j.1360-0443.1991.tb01704.x. [DOI] [PubMed] [Google Scholar]
- 44.Schafer JL, Olsden MK. Multiple imputation for multivariate missing-data problems: A data analyst's perspective. Multivariate Behav Res. 1998;33:545–571. doi: 10.1207/s15327906mbr3304_5. [DOI] [PubMed] [Google Scholar]
- 45.Wirth RJ, Edwards MC. Item factor analysis: Current approaches and future directions. Psychol Methods. 2007;12:58–79. doi: 10.1037/1082-989X.12.1.58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.James AIW, Böhnke JR, Young AW, Lewis GJ. Modelling verbal aggression, physical aggression and inappropriate sexual behaviour after acquired brain injury. P Roy Soc B – Biol Sci. 2015;282:1811. doi: 10.1098/rspb.2015.0711. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Lorenzo-Seva U. Promin: a method for oblique factor rotation. Multivariate Behav Res. 1999;34:347–365. doi: 10.1207/S15327906MBR3403_3. [DOI] [Google Scholar]
- 48.Horn J. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–185. doi: 10.1007/BF02289447. [DOI] [PubMed] [Google Scholar]
- 49.Lorenzo-Seva U, Timmerman ME, Kiers HAL. The Hull method for selecting the number of common factors. Multivariate Behav Res. 2011;46:340–364. doi: 10.1080/00273171.2011.564527. [DOI] [PubMed] [Google Scholar]
- 50.Power C, Rodgers B, Hope S. U-shaped relation for alcohol consumption and health in early adulthood and implications for mortality (research letter) Lancet. 1998;352:877. doi: 10.1016/S0140-6736(98)23937-7. [DOI] [PubMed] [Google Scholar]
- 51.Böhnke JR, Lutz W, Delgadillo J. Negative affectivity as a transdiagnostic factor in patients with common mental disorders. J Affect Disord. 2014;166:270–278. doi: 10.1016/j.jad.2014.05.023. [DOI] [PubMed] [Google Scholar]
- 52.Fairhurst C, Böhnke JR, Gabe R, Croudace TJ, Tober G, Raistrick D. Factor analysis of treatment outcomes from a UK specialist addiction service: Relationship between the Leeds Dependence Questionnaire, Social Satisfaction Questionnaire and 10-item Clinical Outcomes in Routine Evaluation. Drug Alcohol Rev. 2014;33:643–650. doi: 10.1111/dar.12146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Franken IHA, Hendriks VM, van den Brink W. Initial validation of two opiate craving questionnaires: The Obsessive Compulsive Drug Use Scale and the Desires for Drug Questionnaire. Addict Behav. 2002;27:675–685. doi: 10.1016/S0306-4603(01)00201-5. [DOI] [PubMed] [Google Scholar]
- 54.Field M, Munafò MR, Franken IHA. A meta-analytic investigation of the relationship between attentional bias and subjective craving in substance abuse. Psychol Bull. 2009;135:589–607. doi: 10.1037/a0015843. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Mor N, Winquist J. Self-focused attention and negative affect: A meta-analysis. Psychol Bull. 2002;128:638–662. doi: 10.1037/0033-2909.128.4.638. [DOI] [PubMed] [Google Scholar]
- 56.Nolen-Hoeksema S. The role of rumination in depressive disorders and mixed anxiety/depressive symptoms. J Abnorm Psychol. 2000;109:504–511. doi: 10.1037/0021-843X.109.3.504. [DOI] [PubMed] [Google Scholar]
- 57.Watkins E. Constructive and unconstructive repetitive thought. Psychol Bull. 2008;134:163–206. doi: 10.1037/0033-2909.134.2.163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Harvey A, Watkins E, Mansell W, Shafran R. Cognitive behavioural processes across psychological disorders: A transdiagnostic approach to research and treatment. Oxford, UK: Oxford University Press; 2004. [Google Scholar]
- 59.Nolen-Hoeksema S, Morrow J, Fredrickson BL. Response styles and the duration of episodes of depressed mood. J Abnorm Psychol. 1993;102:20–28. doi: 10.1037/0021-843X.102.1.20. [DOI] [PubMed] [Google Scholar]
- 60.Rood L, Roelofs J, Bögels SM, Nolen-Hoeksema S, Schouten E. The influence of emotion-focused rumination and distraction on depressive symptoms in non-clinical youth: A meta-analytic review. Clin Psychol Rev. 2009;29:607–616. doi: 10.1016/j.cpr.2009.07.001. [DOI] [PubMed] [Google Scholar]
- 61.Spasojevic J, Alloy LB. Rumination as a common mechanism relating depressive risk factors to depression. Emotion. 2001;1:25–37. doi: 10.1037/1528-3542.1.1.25. [DOI] [PubMed] [Google Scholar]
- 62.Kuehner C, Weber I. Responses to depression in unipolar depressed patients: an investigation of Nolen-Hoeksema’s response styles theory. Psychol Med. 1999;29:1323–1333. doi: 10.1017/S0033291799001282. [DOI] [PubMed] [Google Scholar]
- 63.Field M, Wiers RW, Christiansen P, Fillmore MT, Verster JC. Acute alcohol effects on inhibitory control and implicit cognition: Implications for loss of control over drinking. Alcohol Clin Exp Res. 2010;34:1346–1352. doi: 10.1111/j.1530-0277.2010.01218.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Smith JL, Mattick RP, Jamadar SD, Iredale JM. Deficits in behavioural inhibition in substance abuse and addiction: A meta-analysis. Drug Alcohol Depend. 2014;145:1–33. doi: 10.1016/j.drugalcdep.2014.08.009. [DOI] [PubMed] [Google Scholar]
- 65.Ashton CH. Pharmacology and effects of cannabis: a brief review. Br J Psychiatry. 2001;178:101–106. doi: 10.1192/bjp.178.2.101. [DOI] [PubMed] [Google Scholar]
- 66.Grant I, Gonzalez R, Carey CL, Natarajan L, Wolfson T. Non-acute (residual) neurocognitive effects of cannabis use: A meta-analytic study. J Int Neuropsychol Soc. 2003;9:679–689. doi: 10.1017/S1355617703950016. [DOI] [PubMed] [Google Scholar]
- 67.Alati R, Lawlor DA, Najman JM, Williams GM, Bor W, O’Callaghan M. Is there really a “J-shaped” curve in the association between alcohol consumption and symptoms of depression and anxiety? Findings from the Mater-University Study of Pregnancy and its outcomes. Addiction. 2005;100:643–651. doi: 10.1111/j.1360-0443.2005.01063.x. [DOI] [PubMed] [Google Scholar]
- 68.Caldwell TM, Rodgers B, Jorm AF, Christensen H, Jacomb PA, Korten AE, Lynskey MT. Patterns of association between alcohol consumption and symptoms of depression and anxiety in young adults. Addiction. 2002;97:583–594. doi: 10.1046/j.1360-0443.2002.00092.x. [DOI] [PubMed] [Google Scholar]
- 69.France C, Lee C, Powers J. Correlates of depressive symptoms in a representative sample of young Australian women. Aust Psychol. 2004;39:228–237. doi: 10.1080/00050060412331295054. [DOI] [Google Scholar]
- 70.Manninen L, Poikolainen K, Vartiainen E, Laatikainen T. Heavy drinking occasions and depression. Alcohol Alcohol. 2006;41:293–299. doi: 10.1093/alcalc/agh246. [DOI] [PubMed] [Google Scholar]
- 71.Rodgers B, Parslow R, Degenhardt L. Affective disorders, anxiety disorders and psychological distress in non-drinkers. J Affect Disord. 2007;99:165–172. doi: 10.1016/j.jad.2006.09.006. [DOI] [PubMed] [Google Scholar]
- 72.Skogen JC, Harvey SB, Henderson M, Stordal E, Mykletun A. Anxiety and depression among abstainers and low-level alcohol consumers. The Nord-Trøndelag health study. Addiction. 2009;104:1519–1529. doi: 10.1111/j.1360-0443.2009.02659.x. [DOI] [PubMed] [Google Scholar]
- 73.Peele S, Brodsky A. Exploring psychological benefits associated with moderate alcohol use: A necessary corrective to assessments of drinking outcomes? Drug Alcohol Depend. 2000;60:221–247. doi: 10.1016/S0376-8716(00)00112-5. [DOI] [PubMed] [Google Scholar]
- 74.Neff JA, Husaini BA. Life events, drinking patterns and depressive symptomatology. J Stud Alcohol. 1982;43:301–318. doi: 10.15288/jsa.1982.43.301. [DOI] [PubMed] [Google Scholar]
- 75.Giancola PR. Irritability, acute alcohol consumption and aggressive behavior in men and women. Drug Alcohol Depend. 2002;68:263–274. doi: 10.1016/S0376-8716(02)00221-1. [DOI] [PubMed] [Google Scholar]
- 76.El-Guebaly N. Investigating the association between moderate drinking and mental health. Ann Epidemiol. 2007;17:S55–S62. doi: 10.1016/j.annepidem.2007.01.013. [DOI] [Google Scholar]
- 77.Bryant FB, Yarnold PR. Principal components analysis and exploratory and confirmatory factor analysis. In: Reading and Understanding Multivariate Statistics (eds LG Grimm, RR Yarnold). Wasjington, DC: American Psychological Association; 1995. p.99–136.
- 78.Comrey AL, Lee HB. A first course in factor analysis. Hillsdale: L. Erlbaum Associates; 1992. [Google Scholar]
- 79.Hides L, Lubman DI, Devlin H, Cotton S, Aitken C, Gibbie T, et al. Reliability and validity of the Kessler 10 and Patient Health Questionnaire among injecting drug users. Aust N Z J Psychiatry. 2007;41:166–168. doi: 10.1080/00048670601109949. [DOI] [PubMed] [Google Scholar]
- 80.Lee N, Jenner L. Development of the PsyCheck screening tool: an instrument for detecting common mental health conditions among substance use treatment clients. Ment Health Subst Use. 2010;3:56–65. doi: 10.1080/17523280903527158. [DOI] [Google Scholar]
- 81.Hides L, Lubman DI, Elkins K, Catania LS, Rogers N. Feasibility and acceptability of a mental health screening tool and training programme in the youth alcohol and other drug (AOD) sector. Drug Alcohol Rev. 2007;26:509–515. doi: 10.1080/09595230701499126. [DOI] [PubMed] [Google Scholar]
- 82.Lee N, Jenner L, Baker A, Ritter A, Hides L, Norman J, et al. Screening and intervention for mental health problems in alcohol and other drug settings: Can training change practitioner behaviour? Drug Educ Prev Polic. 2011;18:157–160. doi: 10.3109/09687631003727847. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Access to data can be requested by contacting the corresponding author.