Highlights
-
•
We studied the extent that cigarette smoking predicts level of cannabis addiction.
-
•
We tested whether cigarette smoking mediates the effect of cannabis use on dependence.
-
•
We interviewed 298 cannabis and tobacco users, of which 65 were followed up.
-
•
Cigarette smoking accounted for 29% of the variance in cannabis dependence.
-
•
Cigarette smoking mediated the relationship between cannabis use and dependence.
Keywords: Cannabis, Tobacco, Addiction, United Kingdom, Longitudinal, Dependence, Co-morbidity
Abstract
Aims
To determine the degree to which cigarette smoking predicts levels of cannabis dependence above and beyond cannabis use itself, concurrently and in an exploratory four-year follow-up, and to investigate whether cigarette smoking mediates the relationship between cannabis use and cannabis dependence.
Methods
The study was cross sectional with an exploratory follow-up in the participants’ own homes or via telephone interviews in the United Kingdom. Participants were 298 cannabis and tobacco users aged between 16 and 23; follow-up consisted of 65 cannabis and tobacco users. The primary outcome variable was cannabis dependence as measured by the Severity of Dependence Scale (SDS). Cannabis and tobacco smoking were assessed through a self-reported drug history.
Results
Regression analyses at baseline showed cigarette smoking (frequency of cigarette smoking: B = 0.029, 95% CI = 0.01, 0.05; years of cigarette smoking: B = 0.159, 95% CI = 0.05, 0.27) accounted for 29% of the variance in cannabis dependence when controlling for frequency of cannabis use. At follow-up, only baseline cannabis dependence predicted follow-up cannabis dependence (B = 0.274, 95% CI = 0.05, 0.53). At baseline, cigarette smoking mediated the relationship between frequency of cannabis use and dependence (B = 0.0168, 95% CI = 0.008, 0.288) even when controlling for possible confounding variables (B = 0.0153, 95% CI = 0.007, 0.027).
Conclusions
Cigarette smoking is related to concurrent cannabis dependence independently of cannabis use frequency. Cigarette smoking also mediates the relationship between cannabis use and cannabis dependence suggesting tobacco is a partial driver of cannabis dependence in young people who use cannabis and tobacco.
1. Introduction
Together, cannabis and tobacco are two of the world's most used drugs, and despite their unique smoking relationship, relatively little is known about their combined effects. The high prevalence of cannabis use amongst young people in the UK is a growing concern. However, many daily cannabis users do not develop dependence. Prospective studies of the likelihood of developing a Cannabis Use Disorder (CUD) have investigated predictors of dependence amongst cannabis users (Swift et al., 2000; van der Pol et al., 2013) with baseline severity of dependence acting as a main predictor of dependence at one-year follow-up (Swift et al., 2000). However, there are a host of other factors which have been considered predictors of developing a CUD, for example; age of onset (Chen et al., 2005), gender (Coffey et al., 2000; von Sydow et al., 2002), impulsivity (Swift et al., 2008), mental health problems (Wittchen et al., 2007) and early onset of continued tobacco smoking (Coffey et al., 2000; Prince van Leeuwen et al., 2014; von Sydow et al., 2002). More recently, van der Pol et al. (2013) investigated a population of high risk young adult cannabis users and found that recent negative life events and social support factors such as living alone were more predictive of CUD then cannabis exposure variables suggesting the existing literature on the aetiology of cannabis use disorder is limited.
Relatively, tobacco is more harmful than cannabis (Nutt et al., 2010) and the majority of tobacco smokers are indeed nicotine dependent. The gateway hypothesis posits that tobacco acts as a gateway drug to the use of cannabis (Kandel et al., 1992). However, there is strong evidence for the ‘reverse gateway’ whereby cannabis smoking predicts tobacco onset (Patton et al., 2005). Several lines of investigation give weight to the hypothesised association between cannabis use and tobacco smoking. Firstly, there is evidence to suggest both nicotine and cannabis affect similar mesolimbic dopaminergic pathways suggesting overlapping mechanism in addiction (David et al., 2005; Filbey et al., 2009). Secondly, there are shared genetic (Agrawal et al., 2008, 2010), temperamental (Brook et al., 2010; Creemers et al., 2009) and psychological factors (Brook et al., 2010) that have been associated with the use of both drugs. Finally, both substances are smoked and often concurrently, such that cross-sensitisation to each substance might occur, with tobacco directly enhancing the subjective effect of cannabis (Agrawal and Lynskey, 2009; Baggio et al., 2013; Ream et al., 2008). As nicotine is more addictive than cannabis, tobacco smoking may be a primary driver of continued use and relapse in co-dependent users.
About 90% of cannabis users also identify as cigarette smokers (Agrawal et al., 2012), however, this exists as a complicated relationship given that increased cigarette smoking may substitute for reduced cannabis consumption (Allsop et al., 2014) and vice versa. Users of both drugs report more severe symptoms of CUD (Peters et al., 2012). Half of adults seeking treatment for CUD also smoke cigarettes and treatment outcomes for those using both cannabis and tobacco, in comparison to cannabis alone, are poor (Agrawal et al., 2009). Moreover, relative to those with a CUD, those with co-occurring nicotine dependence show poorer psychiatric and psychosocial outcomes (Peters et al., 2014; Ramo et al., 2013). In a recent controlled laboratory study, Haney et al. (2012) found that the strongest predictor of relapse in cannabis dependent individuals was their cigarette smoking status. Further, cigarette smoking ad libitum or after a short period of abstinence were both associated with relapse to cannabis use thus ruling out acute nicotine exposure or conditioned motivation (i.e., transfer) effects. This study suggests that cigarette smoking alongside cannabis use may confer a greater dependence syndrome and therefore a greater likelihood to relapse.
To understand the factors involved in the maintenance of substance use, such that prevention strategies are better informed, longitudinal designs of the use of both drugs are essential, especially during the critical period of adolescence. The present study aimed to investigate the degree to which cigarette smoking predicts the level of cannabis dependence above and beyond cannabis use itself, both at baseline, and in an exploratory four-year follow-up in a sample of young cannabis and tobacco users. Cigarette smoking at baseline, independently of smoking cannabis, is hypothesised to contribute to CUD concurrently and at follow up. Moreover, following previous research (Haney et al., 2012) we aimed to investigate if the effects of cannabis use on cannabis dependence are mediated by tobacco smoking using a multiple mediator model.
2. Methods
2.1. Design and participants
2.1.1. Baseline
A sample of 298 cannabis users who also used tobacco (≥1 day/month) were selected from a sample comprising of over 400 recreational (1–24 days/month) and daily (≥25 days/month) users aged 16–23 years old, as described elsewhere (Freeman et al., 2014; Morgan et al., 2012). Inclusion criteria were (a) to speak English fluently, (b) not to have learning impairments, (c) to have no history of psychotic illnesses and (d) normal or corrected-to-normal vision. All participants provided written, informed consent. Participants could also consent to be contacted for further studies and provided contact details as such. The study was approved by the UCL Ethics Committee and its aims were supported by the UK Home Office.
2.1.2. Procedure
Baseline measures were collected in participants’ homes as part of a larger study investigating acute cannabis effects. Participants were required to abstain from all recreational drugs including alcohol for 24 h before each test day. Demographic information, a drug history and assessment of CUD, via the Severity of Dependence Scale (SDS; Gossop et al., 1995), were completed while participants were abstinent. Participants’ past use of cannabis and tobacco were assessed using a semi-structured, questionnaire-based interview which included the following questions: (a) when did you last use tobacco? (b) For how many years have you smoked tobacco? (YEARS-TOB) (c) In a typical month, how many days do you use tobacco? (DAYS-TOB) (d) How many cigarettes do you smoke per day? (e) When did you last use cannabis? (f) For how many years have you used cannabis? (g) In a typical month, how many days do you use cannabis? (DAYS-CANNABIS) (h) How long does it take you to smoke an eighth (3.5 g)?
Participants were assessed for cannabis dependence using the SDS which is five-item questionnaire focusing on ‘loss of control’ or ‘psychological dependence’ in relation to cannabis use. It has good and well-established psychometric properties and was found to be of equal utility in diagnosing cannabis dependence in comparison to more formal diagnostic assessments (Swift et al., 1998). A score of three on the SDS indicates cannabis dependence (Swift et al., 1998). The following measures were also administered; (a) the Wechsler Test of Adult Reading (WTAR; Wechsler, 2001) which is a measure of premorbid verbal intelligence (IQ) and consists of 50 irregularly spelt words. Scores range from 0 to 50; (b) the Schizotypal Personality Questionnaire (SPQ; Raine, 1991) which is a 74-item questionnaire where higher scores indicate a greater schizotypal personality disorder severity; (c) the State-Trait Anxiety Inventory (STAI; Spielberger, 1983), only the 20 items from the trait scale were administered with higher scores reflecting greater trait anxiety; (d) the Barratt Impulsiveness Scale (BIS-11; Patton et al., 1995) which is a 30 item questionnaire describing common impulsive behaviours, high scores reflect greater impulsivity; (e) the Beck Depression Inventory (BDI; Beck et al., 1961) which is a 21 item questionnaire indexing depression over the past week (a score of 10 indicates mild depression) and (f) the Childhood Trauma Questionnaire (CTQ; Bernstein et al., 2003) which is a 28 item questionnaire assessing history of abuse.
2.2. Follow up
At follow-up, four years later, we attempted to re-contact the 341 participants who gave consent and invited them to participate in a semi-structured telephone interview (see Fig. 1 for participant flow diagram). The final sample consisted of 65 cannabis and tobacco smokers.
Participants were recruited through a preliminary email requesting their participation. All participants gave informed consent by telephone and were entered into a prize draw to win a tablet computer for participating. Telephone interviews were conducted between October and December 2013. Demographics, a drug history and the SDS, to reassess participants for CUD, identical to the baseline assessments, were collected.
2.3. Statistical analysis
All analyses were conducted in IBM Statistical Package for Social Sciences (SPSS), V.21. Assumptions of no perfect multicollinearity (no rs ≥ 0.8), linearity, normally distributed errors and homoscedasticity were not violated. Correlations were conducted between cannabis dependence, predictors and possible confounders. At baseline, linear regression was used to assess the predictive relationship of cannabis variables on cannabis dependence. Tobacco smoking variables were added to the regression model to establish whether they could explain significant additional variance in CUD. Questionnaire measures that correlated strongly with cannabis dependence were then added to the model and finally variables that were not found to be significant as regression coefficients were removed generating the most parsimonious model (accounting for the greatest amount of variance with the least number of variables). Those predictors were then used to predict cannabis dependence in the follow up data. Unstandardised B coefficients are presented with 2 decimal places.
We used PROCESS for Statistical Package for Social Sciences (SPSS) version 21 (Hayes, 2013; Preacher and Hayes, 2008). Multiple mediation analyses were conducted on a priori hypotheses. We tested the possible indirect effects of DAYS-CANNABIS on CANNABIS DEPENDENCE (SDS score) through tobacco smoking variables (YEARS-TOB + DAYS-TOB) in a multiple mediator model whist controlling for confounding variables in the baseline data. This method parses the relationship between a predictor and an outcome into ‘indirect’ and ‘direct’ effects. Indirect effects occur when the predictor influences the outcome variable through another mediator variable. Multiple mediators have a combined and a specific (individual) contribution to the relationship between a predictor and outcome. In contrast, ‘direct effects’ between the predictor and outcome are statistically independent of this mediating relationship. For all analyses we used bias corrected 95% confidence intervals (CI) which resulted from bootstrapping of 10,000 samples. An effect is deemed significant when the B lies within CIs that do not cross zero.
2.4. Missing data
For 4 participants, single questionnaire items for the SPQ (5 individual responses missing in total) were replaced with the mean of the subscale. SPQ data was missing for 11 participants. For 8 participants, single questionnaire items for the BIS (10 items in total) were replaced with the mean. For the STAI, 7 items in total were replaced with the mean. Thus, a total of 0.05% of the baseline data was replaced with mean scores.
3. Results
3.1. Baseline demographics
Participants in this study (N = 298; 71% male) were on average 20.55 ± 1.67 years old with 14.47 ± 1.94 total years in education. Their mean score on the BDI was 7.27 ± 6.67 with a range of 0–40 (normative values; 6.25 ± 4.00 (Crawford et al., 2011)), 44 participants (4.69%) scored >14 (mild depression), STAI 39.41 ± 9.02 (normative values; 36.44 ± 10.93 (Crawford et al., 2011)), BIS 70.73 ± 9.84 (normative values; 64.2 ± 10.70 (Spinella, 2007)), WTAR 41.93 ± 6.80, CTQ 37.09 ± 10.04 (normative values; 98.63 ± 29.13 (Paivio and Cramer, 2004)) SPQ (N = 287) 17.67 ± 10.70 (normative values; 26.9 ± 11.00 (Raine, 1991)). 139 (46.6%) participants met criteria for cannabis dependence (score ≥3 on the SDS) at baseline.
3.2. Follow up demographics
The follow up sample (N = 65; 69.2% male) were a mean (SD) age of 24.66 ± 2.07. 26.2% (N = 17) met the criteria for cannabis dependence at follow-up (further details of baseline demographics for this group can be found in Table 3). In comparison to the 233 who were not followed up, the 65 who were did not differ significantly on age, gender, primary study variables or smoking characteristics suggesting that the baseline demographics of the follow up group are equivalent to the baseline group who were not followed up.
Table 3.
Baseline |
Follow up | |||||
---|---|---|---|---|---|---|
SDS | DAYS-CANNABIS | DAYS-TOB | YEARS-TOB | BDI | SDS | |
Baseline | ||||||
SDS | 1.00 | 0.57*** | 0.42** | 0.29* | 0.12 | 0.37** |
DAYS-CANNABIS | 1.00 | 0.39** | 0.29* | 0.14 | 0.26* | |
DAYS-TOB | 1.00 | 0.31* | 0.14 | 0.23 | ||
YEARS-TOB | 1.00 | −0.07 | 0.09 | |||
BDI | 1.00 | 0.37** | ||||
Follow-up SDS | 1.00 | |||||
M | 2.80 | 19.25 | 23.53 | 5.25 | 6.51 | 1.40 |
SD | 2.64 | 10.63 | 9.93 | 2.31 | 5.59 | 2.29 |
p < .05.
p < .01.
p < .001.
3.3. Correlations of primary baseline variables (Table 1)
Table 1.
SDS | Time to smoke 3.5 g | DAYS-CANNABIS | Years cannabis used | Cannabis last used (days) | DAYS-TOB | YEARS-TOB | Tobacco last used (days) | Cigarettes per day | |
---|---|---|---|---|---|---|---|---|---|
SDS | 1.00 | −0.19** | 0.50*** | 0.14* | −0.25*** | 0.30*** | 0.26*** | 0.00 | 0.20** |
Time to smoke 3.5 g | 1.00 | −0.40*** | −0.04 | 0.18** | −0.11 | 0.00 | 0.01 | −0.08 | |
DAYS-CANNABIS | 1.00 | 0.13* | −0.46*** | 0.33*** | 0.18** | 0.01 | 0.24*** | ||
Years cannabis used | 1.00 | −0.17** | 0.13* | 0.59*** | 0.09 | 0.16** | |||
Cannabis last used (days) | 1.00 | −0.16 | −0.07 | −0.02 | −0.10 | ||||
DAYS-TOB | 1.00 | 0.24*** | −0.18** | 0.44*** | |||||
YEARS-TOB | 1.00 | −0.09 | 0.19** | ||||||
Tobacco last used (days) | 1.00 | −0.09 | |||||||
Cigarettes per day | 1.00 | ||||||||
M | 2.85 | 8.51 | 18.50 | 4.94 | 3.76 | 23.61 | 4.70 | 20.10 | 7.17 |
SD | 2.73 | 15.00 | 10.68 | 2.34 | 6.05 | 10.01 | 2.53 | 111.85 | 5.86 |
p < .05.
p < .01.
p < .001.
Correlations were conducted between the outcome variable of SDS score (cannabis dependence), predictors and possible confounders (Table 1). SDS correlated positively with scores on the BDI (r = 0.690, p = 0.003). SDS correlated weakly with the WTAR (r = −0.16, p = 0.004) and also weakly with scores on the SPQ (r = 0.133, p = 0.024) but not on the STAI (r = 0.090, p = 0.133) or BIS (r = 0.090, p = 0.110). BIS scores correlated with cigarettes per day (r = 0.166, p = 0.004) and days per month cannabis use (r = 0.153, p = 0.008).
3.4. Regression analysis (Table 2)
Table 2.
B | BCa 95% CI (lower, upper) |
p | |
---|---|---|---|
Cannabis only | |||
R2 = 0.246, p < 0.001 | |||
Constant | 0.221 | −0.65, 1.11 | 0.632 |
Time to smoke 3.5 g | 0.001 | −0.02, 0.23 | 0.929 |
DAYS-CANNABIS | 0.120 | 0.09, 0.15 | <0.001 |
years cannabis used | 0.090 | −0.03, 0.21 | 0.144 |
cannabis last used | −0.012 | −0.06, 0.03 | 0.537 |
Cannabis + tobacco | |||
R2 = 0.285, F = 23.93, p < 0.001 | |||
Constant | −0.400 | −1.34, 0.51 | 0.415 |
Time to smoke 3.5 g | −0.002 | −0.02, 0.18 | 0.866 |
DAYS-CANNABIS | 0.101 | 0.07, 0.13 | <0.001 |
Years cannabis used | −0.054 | −0.18, 0.09 | 0.407 |
Cannabis last used | −0.020 | −0.07, 0.03 | 0.321 |
DAYS-TOB | 0.031 | 0.00, 0.06 | 0.020 |
YEARS-TOB | 0.197 | 0.06, 0.32 | 0.003 |
Tobacco last used | 0.001 | 0.00, 0.03 | 0.174 |
Cigarettes per day | 0.010 | −0.04, 0.07 | 0.728 |
Cannabis, tobacco + confounders | |||
R2 = 0.304, F = 12.52, p < 0.001 | |||
Constant | 0.560 | −1.30, 2.30 | 0.552 |
Time to smoke 3.5 g | −0.001 | −0.02, 0.02 | 0.934 |
DAYS-CANNABIS | 0.098 | 0.07, 0.13 | <0.001 |
Years cannabis used | −0.022 | −0.15, 0.11 | 0.766 |
Cannabis last used | −0.023 | −0.07, 0.03 | 0.363 |
DAYS-TOB | 0.030 | 0.00, 0.06 | 0.057 |
YEARS-TOB | 0.175 | 0.04, 0.31 | 0.012 |
Tobacco last used | 0.001 | −0.05, 0.05 | 0.488 |
Cigarettes per day | 0.010 | −0.07, 0.01 | 0.984 |
WTAR | −0.029 | 0.01, 0.40 | 0.160 |
BDI | −0.046 | 0.00, 0.09 | 0.033 |
Most efficient model | |||
R2 = 0.295, F = 30.72, p < 0.001 | |||
Constant | −0.933 | −1.62, −0.28 | 0.008 |
DAYS-CANNABIS | 0.107 | 0.08, 0.13 | <0.001 |
DAYS-TOB | 0.029 | 0.01, 0.05 | 0.010 |
YEARS-TOB | 0.159 | 0.05, 0.27 | 0.006 |
BDI | 0.050 | 0.01, 0.10 | 0.020 |
3.4.1. Cannabis only model
This model predicted 24.6% of the variance in cannabis dependence. Cannabis dependence score was significantly predicted by DAYS-CANNABIS. Cannabis dependence scores increased by 0.12 units for every extra day of cannabis use per month. Time to smoke an eighth, years of cannabis use and days since last cannabis use were not predictive of cannabis dependence.
3.4.2. Cannabis + tobacco model
When tobacco variables are added to regression model, the model predicted 28.5% of the variance in cannabis dependence (R2 change = 0.038, F change(4,298) = 3.880, p = 0.004). DAYS-CANNABIS remained a significant predictor of cannabis dependence with dependence scores increasing 0.1 units for every extra day per month. YEARS-TOB was predictive of cannabis dependence. For every additional year of tobacco smoking, cannabis dependence scores increased 0.197 units. DAYS-TOB was a significant predictor of cannabis dependence; scores increased by 0.031 units for every additional day of tobacco use per month. Time to smoke an eighth, years cannabis smoked and days since last cannabis use were not predictive of cannabis dependence.
3.4.3. Cannabis, tobacco + confounders model
Variables that correlated strongly with cannabis dependence scores were added to the regression model. BDI score significantly predicted cannabis dependence. For every unit increase on the BDI, cannabis dependence scores increased by 0.046 units. As such the model predicted 30.4% of the variance in cannabis dependence scores (R2 change = 0.019, F change(2,287) = 3.955, p = 0.020).
3.5. Most efficient model
When redundant predictors were removed from the analysis, the model predicated 29.5% of the variance in cannabis dependence, which is not significantly different from model 3 (cannabis, tobacco + confounders) which includes cannabis, tobacco and potential confounders (R2 change = 0.090, F change(4,293) = 0.008, p = 0.750). DAYS-CANNABIS remained the most important predictor of cannabis dependence, followed by YEARS-TOB, DAYS-TOB and BDI score. In this model, r = 0.54 for the most efficient model which is considered a large effect size (Cohen, 1988).
3.6. Exploratory regression analysis
Demographic variables were added to the most efficient given the associations between these variables and CUD (as sex differences have been reported in relation to abuse related effects; Cooper and Haney, 2014). When gender is added to this model, the model predicts 29.6% of the variance in cannabis dependence (R2 change = 0.010, F change(1,292) = 0.180, p = 0.670).
Age was then added to the most efficient model (without gender). This model accounts for 30.7% of the variance in cannabis dependence (R2 change = 0.011, F change(1,292) = 4.740, p = 0.030). The addition of Age (B = 0.198, 95% BCI = 0.037, 0.368) correlated highly with the variable YEARS-TOB, which was no longer significant when age was added (B = 0.096, 95% BCI = −0.035, −0.223).
Finally, scores on the CTQ were added to the regression model. This model accounted for 28.7% in the variance of cannabis dependence (R2 change = 0.001, F change(1,278) = 0.440, p = 0.510).
3.7. Exploratory follow-up analysis
3.7.1. Regression at follow-up (Table 4)
Table 4.
B | BCa 95% CI (lower, upper) |
p | |
---|---|---|---|
Most efficient model | |||
R2 = 0.139, F = 1.85, p < 0.135 | |||
Constant | −0.708 | −2.25, 0.59 | 0.409 |
DAYS-CANNABIS | 0.039 | −0.03, 0.10 | 0.164 |
DAYS-TOB | 0.010 | −0.04, −0.06 | 0.748 |
YEARS-TOB | 0.042 | −0.19, 0.28 | 0.741 |
BDI | 0.137 | −0.44, 0.32 | 0.265 |
Most efficient model accounting for baseline dependence | |||
R2 = 0.266, F = 3.264, p < 0.013 | |||
Constant | −0.361 | −1.88, 0.94 | 0.668 |
DAYS-CANNABIS | 0.008 | −0.06, 0.07 | 0.770 |
DAYS-TOB | −0.006 | −0.51, 0.04 | 0.852 |
YEARS-TOB | 0.014 | −0.21, 0.25 | 0.910 |
BDI | 0.138 | −0.05, 0.32 | 0.294 |
Baseline SDS | 0.274 | 0.05, 0.53 | 0.023 |
3.7.1.1. Most efficient model
The significant predictors in the baseline regression (Table 2) were used to predict cannabis dependence at follow-up, 4 years later. This was to gage whether the same factors that predict dependence at baseline can predict dependence at follow up. Means, standard deviations and correlation coefficients of these variables can be found in Table 3. This model predicted 18.5% of the variance in dependence at follow-up. DAYS-CANNABIS, DAYS-TOB and YEARS-TOB and BDI score were not significant predictors of cannabis dependence at follow up.
3.7.2. Most efficient model accounting for baseline cannabis dependence
Baseline cannabis dependence was added to the model stated above. As a result, cannabis dependence became the only significant predictor of predicted cannabis dependence at follow-up (R2 change = 0.062, p < 0.031). This model predicted 24.8% of the variance in dependence at follow-up.
3.8. Multiple mediation analysis (Fig. 2)
As a result of DAYS-TOB and YEARS-TOB being significant predictors of baseline cannabis dependence in the linear regression (Table 2), these variables were used a mediators in a multiple mediator model to discern if the relationship between cannabis use (DAYS-CANNABIS) and cannabis dependence (SDS score) was mediated by concurrent tobacco use.
A bias-corrected and accelerated bootstrapped multiple mediation model confirmed the presence of a combined indirect effect of DAYS-CANNABIS on cannabis dependence through YEARS-TOB + DAYS-TOB (B = 0.017, 95% CI = 0.008, 0.288), with significant, specific indirect effects through YEARS-TOB (B = 0.007 95% CI = 0.002, 0.016) and DAYS-TOB (B = 0.010, 95% CI = 0.003, 0.020) (product of paths a and b in Fig. 2). This model accounted for 28% of the variance in cannabis dependence, whereas the direct effect of DAYS-CANNABIS on CANNABIS DEPENDENCE, accounted for 23% (direct B = 0.108, 95% CI = 0.008, −0.028). Pairwise comparison between specific indirect effects was not significant (B = −0.003, 95% CI = −0.014, 0.008) suggesting that both YEARS-TOB and DAYS-TOB are not statistically different from each other i.e. have equal importance in mediating this relationship. The direct route (c and c′) suggests that when taking into account the mediating role of tobacco smoking, DAYS-CANNABIS is still significant.
3.9. Influence of confounds
Given that both BDI and WTAR correlated with dependence at baseline, these were added as covariates into the above analysis. As such this model predicted 30% of the variance in cannabis dependence. The indirect effect of DAYS-CANNABIS on CANNABIS DEPENDENCE through YEARS-TOB and DAYS-TOB whilst controlling for BDI and WTAR was significant (B = 0.015, 95% CI = 0.007, 0.027) with specific indirect effects through YEARS-TOB (B = 0.007, 95% CI = 0.002, 0.015), and DAYS-TOB (B = 0.009, 95% CI = 0.003, 0.018), with no significant difference between DAYS-TOB and YEARS-TOB. The direct effect of DAYS-CANNABIS on CANNABIS DEPENDENCE when controlling for these covariates is still significant (B = 0.105, 95% CI = 0.078, 0.131).
4. Discussion
The main aim of this study was to investigate the role of cigarette smoking on cannabis dependence, above and beyond the effects of cannabis exposure, in a sample of young cannabis and tobacco co-users. We conducted an exploratory follow-up of these users four years later with a 27% response rate of which 70% of individuals had smoked cannabis and tobacco at baseline. The 65 participants that were followed up were equivalent in demographics and smoking behaviour to those who were not followed up, at baseline. We hypothesised that cigarette smoking would predict CUD, at both time points. We also investigated whether the effects of cannabis use on cannabis dependence were mediated by cigarette smoking.
Cigarette smoking at baseline was predictive of CUD at baseline when controlling for cannabis use variables in young people who smoke cannabis and tobacco. The most efficient model accounted for 30% of the variance in cannabis dependence which is considered to be a large effect size as R > 0.5 (Cohen, 1988). However, this seems no longer the case four years later, where only baseline CUD predicted follow-up CUD, accounting for almost 25% of the variance and replicating previous findings (Swift et al., 2000). When we investigated how cigarette smoking predicted concurrent CUD; we found that cigarette smoking (years of cigarette smoking and days per month cigarette smoking) mediated the relationship between cannabis use and cannabis dependence suggesting a role of tobacco use in the pathogenesis of CUD in cannabis and tobacco users. We also found these effects to be robust when controlling for depression and premorbid IQ (which were found to be comparable to normative values). Although causality cannot be assumed in this cross-sectional analysis, these results suggest that cigarette smoking may enhance the dependence-forming effects of cannabis. Alternatively, our results may suggest that CUD (as measured by the SDS) may capture some aspects of nicotine dependence in a subset of young people with CUD. As such, this research supplements previous epidemiological research that stresses the predictive ability of tobacco smoking in developing CUDs (Coffey et al., 2000; Prince van Leeuwen et al., 2014; von Sydow et al., 2002).
Our results, based in a naturalistic setting, parallel results from a recent controlled lab study that found cannabis users who smoke cigarettes are more likely to relapse in comparison to those who do not smoke cigarettes, perhaps as a result of this indirect pathway (de Dios et al., 2009; Haney et al., 2012). As such, reducing cannabis dependence might be facilitated by helping individuals quit cigarette smoking (Macleod et al., 2004). We were able to account for about 30% of the variance in CUD from four predictor variables. However, CUD is a complex disorder and causality cannot be determined from one factor. There are many other factors that can predict CUD that were beyond the scope of the current study but have interesting implications. For example, a recent study by van der Pol et al. (2013) found that current problems (such as living alone, coping motives for cannabis use and negative life events) were better predictors of cannabis dependence in young adults than cannabis exposure itself. As a result of this study, we included demographics and scores on the CTQ to our most efficient model, however these did not account for a significant proportion of variance to be included in the final model or in the mediation analysis. It is clear that CUD is a complex disorder that has many predictors and vulnerability factors that were not included in the model.
In the past, regular cigarette smoking would precede cannabis use (Kandel et al., 1992). This sequence in drug use seems to be tapering off, for example, around 1 in 5 young cannabis users have never smoked a cigarette (Suris et al., 2007). Interestingly, both cannabis and tobacco smoking were initiated 4.9 and 4.7 years previously, respectively, at the baseline visit, suggesting simultaneous age of onset in the current study. Therefore, these results do not speak to sequential use as on average the sample initiated both substances at the same time.
Stricter tobacco laws in some countries have altered perceptions such that cigarette smoking is considered a more risky behaviour than previously. In 2013, for the first time, tobacco smoking prevalence was estimated to be below 20% in the UK (Brown and West, 2014). In comparison, cannabis use has become normal and perceptions of regular cannabis use as a risky behaviour are at an all-time low (Johnston et al., 2013) with risk perception inversely related to prevalence of cannabis use (Kleber and Dupont, 2012). This may be due to the shifting landscape and debate over legalisation of both medical and recreational marijuana in states such as Colorado, California and Washington in the United States as well as countries such as Uruguay and the Netherlands (Volkow et al., 2014). As a result, whilst tobacco smoking decreases generally, it is possible that tobacco use will also increase indirectly over time due to increased cannabis use (Patton et al., 2005). Our findings are timely because they suggest tobacco may be involved in the pathogenesis of CUD, a possible risk factor of legalisation.
Our results may be a product of the common liability to the use of cannabis and tobacco including such risk factors like shared genetic and temperamental factors (Agrawal et al., 2008, 2010; Brook et al., 2010; Creemers et al., 2009). For example, recent research shows that nicotine dependence was associated stronger with lifetime CUD for females than males (Blanco et al., 2014). Moreover, Cooper and Haney (2014) have recently demonstrated that whilst subjective effects are equal across genders, females report more abuse related effects. Thus, an interesting analysis would be to investigate whether the mediators suggested in the present study, were stronger in females than males however, given that the sample was 71% male, this was not possible. Demographic variables were instead added to the most efficient model and we found that gender and age did not predict cannabis dependence after accounting for cannabis and tobacco use. Our results may also be a product of the common route of administration (Agrawal and Lynskey, 2009) where inhalation of one substance may sensitise an individual to the inhalation of another substance.
4.1. Strengths and limitations
This study has several strengths including a relatively large sample size of 298 young cannabis and tobacco users assessed in their own homes. Moreover, we used continuous variables to index both cannabis and tobacco smoking making it possible to assess the relationship between drug use variables at varying levels of severity (Ramo et al., 2013). This study also suffers from several limitations. First, within our exploratory follow-up sample we had a modest response from 65 participants. This may have reduced the power to detect a possible true effect of baseline cannabis use on future dependence (for example, surprisingly, days of cannabis use per month at baseline were not associated with cannabis dependence at follow up) and therefore these exploratory follow-up results should be interpreted with caution until they can be replicated with a greater sample size. Moreover, we were unable to control for the simultaneous use of cannabis and tobacco (joints) as the route of administration and as a necessity our sample is limited those who only smoke cannabis and tobacco. These results should be interpreted within their self-reported context. Finally, the multiple mediation analysis was conducted on cross sectional data and therefore the existence and direction of causality cannot be discerned.
4.2. Conclusions
In light of the medicalisation and legalisation of marijuana, research on cannabis and tobacco use is essential. In a naturalistic study of cannabis and tobacco co-users, baseline cigarette smoking (frequency and years) predicts cannabis dependence concurrently when controlling for frequency of cannabis use; however this was no longer the case four years later. At baseline, cigarette smoking mediated the relationship between cannabis use and cannabis dependence, even when controlling for psychological and demographic correlates that might explain this relationship. This suggests that cigarette smoking enhances vulnerability to the harmful effects of cannabis.
Role of funding source
Funding for this study was provided by the Medical Research Council. The MRC had no further role in study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the paper for publication.
Contributors
Authors H.V.C. and C.J.M. designed the study. Author C.H. managed literature searches and summaries of previous related work. Authors G.L., T.P.F., N.D.S. and G.G. undertook data collection. C.H., N.D.S., T.P.F., C.J.F., and R.K.D. undertook the statistical analysis, and authors C.H. and N.D.S. wrote the first draft of the manuscript. All authors contributed to and have approved the final manuscript.
Conflict of interest
All authors declare that they have no conflicts of interest.
References
- Agrawal A., Budney A.J., Lynskey M.T. The co-occurring use and misuse of cannabis and tobacco: a review. Addiction. 2012;107:1221–1233. doi: 10.1111/j.1360-0443.2012.03837.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Agrawal A., Lynskey M.T. Tobacco and cannabis co-occurrence: does route of administration matter? Drug Alcohol Depend. 2009;99:240–247. doi: 10.1016/j.drugalcdep.2008.08.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Agrawal A., Lynskey M.T., Madden P.A., Pergadia M.L., Bucholz K.K., Heath A.C. Simultaneous cannabis and tobacco use and cannabis-related outcomes in young women. Drug Alcohol Depend. 2009;101:8–12. doi: 10.1016/j.drugalcdep.2008.10.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Agrawal A., Lynskey M.T., Pergadia M.L., Bucholz K.K., Heath A.C., Martin N.G., Madden P.A. Early cannabis use and DSM-IV nicotine dependence: a twin study. Addiction. 2008;103:1896–1904. doi: 10.1111/j.1360-0443.2008.02354.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Agrawal A., Silberg J.L., Lynskey M.T., Maes H.H., Eaves L.J. Mechanisms underlying the lifetime co-occurrence of tobacco and cannabis use in adolescent and young adult twins. Drug Alcohol Depend. 2010;108:49–55. doi: 10.1016/j.drugalcdep.2009.11.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Allsop D.J., Dunlop A.J., Saddler C., Rivas G.R., McGregor I.S., Copeland J. Changes in cigarette and alcohol use during cannabis abstinence. Drug Alcohol Depend. 2014;138:54–60. doi: 10.1016/j.drugalcdep.2014.01.022. [DOI] [PubMed] [Google Scholar]
- Baggio S., Deline S., Studer J., Mohler-Kuo M., Daeppen J.-B., Gmel G. Routes of administration of cannabis used for nonmedical purposes and associations with patterns of drug use. J. Adolesc. Health. 2013;54:235–240. doi: 10.1016/j.jadohealth.2013.08.013. [DOI] [PubMed] [Google Scholar]
- Barratt E.S. Barratt-Psychiatry Medical Branch; University of Texas: 1975. Barratt Impulsiveness Scale. [Google Scholar]
- Beck A.T., Ward C.H., Mendelson M., Mock J., Erbaugh J. An inventory for measuring depression. Arch. Gen. Psychiatry. 1961;4:561. doi: 10.1001/archpsyc.1961.01710120031004. [DOI] [PubMed] [Google Scholar]
- Bernstein D.P., Stein J.A., Newcomb M.D., Walker E., Pogge D., Ahluvalia T., Stokes J., Handelsman L., Medrano M., Desmond D., Zule W. Development and validation of a brief screening version of the Childhood Trauma Questionnaire. Child Abuse Negl. 2003;27:169–190. doi: 10.1016/s0145-2134(02)00541-0. [DOI] [PubMed] [Google Scholar]
- Blanco C., Rafful C., Wall M.M., Ridenour T.A., Wang S., Kendler K.S. Towards a comprehensive developmental model of cannabis use disorders. Addiction. 2014;109:284–294. doi: 10.1111/add.12382. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brook J.S., Lee J.Y., Finch S.J., Brown E.N. Course of comorbidity of tobacco and marijuana use: psychosocial risk factors. Nicotine Tob. Res. 2010;12:474–482. doi: 10.1093/ntr/ntq027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brown J., West R. Smoking prevalence in England is below 20% for the first time in 80 years. BMJ. 2014;348 doi: 10.1136/bmj.g1378. [DOI] [PubMed] [Google Scholar]
- Chen C.-Y., O’Brien M.S., Anthony J.C. Who becomes cannabis dependent soon after onset of use? Epidemiological evidence from the United States: 2000–2001. Drug Alcohol Depend. 2005;79:11–22. doi: 10.1016/j.drugalcdep.2004.11.014. [DOI] [PubMed] [Google Scholar]
- Coffey C., Lynskey M., Wolfe R., Patton G. Initiation and progression of cannabis use in a population-based Australian adolescent longitudinal study. Addiction. 2000;95:1679–1690. doi: 10.1046/j.1360-0443.2000.951116798.x. [DOI] [PubMed] [Google Scholar]
- Cohen J. 2nd ed. Erlbaum; Hillsdale, NJ: 1988. Statistical Power Analysis for the Behavioral Sciences. [Google Scholar]
- Cooper Z.D., Haney M. Investigation of sex-dependent effects of cannabis in daily cannabis smokers. Drug Alcohol Depend. 2014;136:85–91. doi: 10.1016/j.drugalcdep.2013.12.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crawford J., Cayley C., Lovibond P.F., Wilson P.H., Hartley C. percentile norms and accompanying interval estimates from an Australian general adult population sample for self-report mood scales (BAI, BDI, CRSD, CES-D, DASS, DASS-21, STAI-X, STAI-Y, SRDS, and SRAS) Australian Psychol. 2011;46:3–14. [Google Scholar]
- Creemers H.E., Korhonen T., Kaprio J., Vollebergh W.A., Ormel J., Verhulst F.C., Huizink A.C. The role of temperament in the relationship between early onset of tobacco and cannabis use: the TRAILS study. Drug Alcohol Depend. 2009;104:113–118. doi: 10.1016/j.drugalcdep.2009.04.010. [DOI] [PubMed] [Google Scholar]
- David S.P., Munafò M.R., Johansen-Berg H., Smith S.M., Rogers R.D., Matthews P.M., Walton R.T. Ventral striatum/nucleus accumbens activation to smoking-related pictorial cues in smokers and nonsmokers: a functional magnetic resonance imaging study. Biol. Psychiatry. 2005;58:488–494. doi: 10.1016/j.biopsych.2005.04.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Dios M.A., Vaughan E.L., Stanton C.A., Niaura R. Adolescent tobacco use and substance abuse treatment outcomes. J. Subst. Abuse Treat. 2009;37:17–24. doi: 10.1016/j.jsat.2008.09.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Filbey F.M., Schacht J.P., Myers U.S., Chavez R.S., Hutchison K.E. Marijuana craving in the brain. Proc. Natl. Acad. Sci. U. S. A. 2009;106:13016–13021. doi: 10.1073/pnas.0903863106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Freeman T.P., Morgan C.J., Hindocha C., Schafer G., Das R.K., Curran H.V. Just say ‘know’: how do cannabinoid concentrations influence users’ estimates of cannabis potency and the amount they roll in joints. Addiction. 2014;109:1686–1694. doi: 10.1111/add.12634. [DOI] [PubMed] [Google Scholar]
- Gossop M., Darke S., Griffiths P., Hando J., Powis B., Hall W., Strang J. The Severity of Dependence Scale (SDS): psychometric properties of the SDS in English and Australian samples of heroin, cocaine and amphetamine users. Addiction. 1995;90:607–614. doi: 10.1046/j.1360-0443.1995.9056072.x. [DOI] [PubMed] [Google Scholar]
- Haney M., Bedi G., Cooper Z.D., Glass A., Vosburg S.K., Comer S.D., Foltin R.W. Predictors of marijuana relapse in the human laboratory: robust impact of tobacco cigarette smoking status. Biol. Psychiatry. 2012;173:242–248. doi: 10.1016/j.biopsych.2012.07.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hayes A.F. Guilford Press; New York: 2013. Introduction to Mediation, Moderation, and Conditional Process Analyses: A Regression Based Approach. [Google Scholar]
- Johnston L., O’Malley P., Bachman J., Schulenberg J. Institute for Social Research, The University of Michigan; Ann Arbor: 2013. Monitoring the Future National Results on Drug Use: 2012 Overview, Key Findings on Adolescent Drug Use. [Google Scholar]
- Kandel D.B., Yamaguchi K., Chen K. Stages of progression in drug involvement from adolescence to adulthood: further evidence for the gateway theory. J. Stud. Alcohol Drugs. 1992;53:447. doi: 10.15288/jsa.1992.53.447. [DOI] [PubMed] [Google Scholar]
- Kleber H.D., Dupont R.L. Physicians and medical marijuana. Am. J. Psychiatry. 2012;169:564–568. doi: 10.1176/appi.ajp.2012.12030373. [DOI] [PubMed] [Google Scholar]
- Macleod J., Oakes R., Copello A., Crome I., Egger M., Hickman M., Oppenkowski T., Stokes-Lampard H., Smith G.D. Psychological and social sequelae of cannabis and other illicit drug use by young people: a systematic review of longitudinal, general population studies. Lancet. 2004;363:1579–1588. doi: 10.1016/S0140-6736(04)16200-4. [DOI] [PubMed] [Google Scholar]
- Morgan C., Gardener C., Schafer G., Swan S., Demarchi C., Freeman T., Warrington P., Rupasinge I., Ramoutar A., Tan N., Wingham G., Lewis S., Curran H.V. Sub-chronic impact of cannabinoids in street cannabis on cognition, psychotic-like symptoms and psychological well-being. Psychol. Med. 2012;42:391–400. doi: 10.1017/S0033291711001322. [DOI] [PubMed] [Google Scholar]
- Nutt D.J., King L.A., Phillips L.D. Drug harms in the UK: a multicriteria decision analysis. Lancet. 2010;376:1558–1565. doi: 10.1016/S0140-6736(10)61462-6. [DOI] [PubMed] [Google Scholar]
- Patton J.H., Stanford M.S., Barratt E.S. Factor structure of the Barratt Impulsiveness Scale. J. Clin. Psychol. 1995;51:768–774. doi: 10.1002/1097-4679(199511)51:6<768::aid-jclp2270510607>3.0.co;2-1. [DOI] [PubMed] [Google Scholar]
- Patton G.C., Coffey C., Carlin J.B., Sawyer S.M., Lynskey M. Reverse gateways? Frequent cannabis use as a predictor of tobacco initiation and nicotine dependence. Addiction. 2005;100:1518–1525. doi: 10.1111/j.1360-0443.2005.01220.x. [DOI] [PubMed] [Google Scholar]
- Paivio S.C., Cramer K.M. Factor structure and reliability of the Childhood Trauma Questionnaire in a Canadian undergraduate student sample. Child Abuse Negl. 2004;28:889–904. doi: 10.1016/j.chiabu.2004.01.011. [DOI] [PubMed] [Google Scholar]
- Peters E.N., Budney A.J., Carroll K.M. Clinical correlates of co-occurring cannabis and tobacco use: a systematic review. Addiction. 2012;107:1404–1417. doi: 10.1111/j.1360-0443.2012.03843.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peters E.N., Schwartz R.P., Wang S., O’Grady K.E., Blanco C. Psychiatric, psychosocial, and physical health correlates of co-occurring cannabis use disorders and nicotine dependence. Drug Alcohol Depend. 2014;134:228–234. doi: 10.1016/j.drugalcdep.2013.10.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Preacher K.J., Hayes A.F. Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behav. Res. Methods. 2008;40:879–891. doi: 10.3758/brm.40.3.879. [DOI] [PubMed] [Google Scholar]
- Prince van Leeuwen A., Creemers H.E., Verhulst F.C., Vollebergh W.A., Ormel J., Oort F., Huizink A.C. Legal substance use and the development of a DSM-IV cannabis use disorder during adolescence: the TRAILS study. Addiction. 2014;109:303–311. doi: 10.1111/add.12346. [DOI] [PubMed] [Google Scholar]
- Raine A. The SPQ. Schizophr. Bull. 1991;17:555–564. doi: 10.1093/schbul/17.4.555. [DOI] [PubMed] [Google Scholar]
- Ramo D.E., Delucchi K.L., Hall S.M., Liu H., Prochaska J.J. Marijuana and tobacco co-use in young adults: patterns and thoughts about use. J. Stud. Alcohol Drugs. 2013;74:301. doi: 10.15288/jsad.2013.74.301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ream G.L., Benoit E., Johnson B.D., Dunlap E. Smoking tobacco along with marijuana increases symptoms of cannabis dependence. Drug Alcohol Depend. 2008;95:199–208. doi: 10.1016/j.drugalcdep.2008.01.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spielberger C.D. Wiley and Sons; New York: 1983. Manual for the State-Trait Anxiety Inventory STAI (Form Y) (“Self-Evaluation Questionnaire”) [Google Scholar]
- Suris J., Akre C., Berchtold A., Jeannin A., Michaud P.-A. Some go without a cigarette: characteristics of cannabis users who have never smoked tobacco. Arch. Pediatr. Adolesc. Med. 2007;161:1042–1047. doi: 10.1001/archpedi.161.11.1042. [DOI] [PubMed] [Google Scholar]
- Spinella M. Normative data and a short form of the Barratt Impulsiveness Scale. Int. J. Neurosci. 2007;117:359–368. doi: 10.1080/00207450600588881. [DOI] [PubMed] [Google Scholar]
- Swift W., Copeland J., Hall W. Choosing a diagnostic cut-off for cannabis dependence. Addiction. 1998;93:1681–1692. doi: 10.1046/j.1360-0443.1998.931116816.x. [DOI] [PubMed] [Google Scholar]
- Swift W., Coffey C., Carlin J.B., Degenhardt L., Patton G.C. Adolescent cannabis users at 24 years: trajectories to regular weekly use and dependence in young adulthood. Addiction. 2008;103:1361–1370. doi: 10.1111/j.1360-0443.2008.02246.x. [DOI] [PubMed] [Google Scholar]
- Swift W., Hall W., Copeland J. One year follow-up of cannabis dependence among long-term users in Sydney, Australia. Drug Alcohol Depend. 2000;59:309–318. doi: 10.1016/s0376-8716(99)00131-3. [DOI] [PubMed] [Google Scholar]
- van der Pol P., Liebregts N., de Graaf R., Korf D.J., van den Brink W., van Laar M. Predicting the transition from frequent cannabis use to cannabis dependence: a three-year prospective study. Drug Alcohol Depend. 2013;133:352–359. doi: 10.1016/j.drugalcdep.2013.06.009. [DOI] [PubMed] [Google Scholar]
- Volkow N.D., Baler R.D., Compton W.M., Weiss S.R. Adverse health effects of marijuana use. N. Engl. J. Med. 2014;370:2219–2227. doi: 10.1056/NEJMra1402309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- von Sydow K., Lieb R., Pfister H., Höfler M., Wittchen H.-U. What predicts incident use of cannabis and progression to abuse and dependence? A 4-year prospective examination of risk factors in a community sample of adolescents and young adults. Drug Alcohol Depend. 2002;68:49–64. doi: 10.1016/s0376-8716(02)00102-3. [DOI] [PubMed] [Google Scholar]
- Wechsler D. Psychological Corporation; Washington, DC: 2001. Wechsler Test of Adult Reading: WTAR. [Google Scholar]
- Wittchen H.-U., Fröhlich C., Behrendt S., Günther A., Rehm J., Zimmermann P., Lieb R., Perkonigg A. Cannabis use and cannabis use disorders and their relationship to mental disorders: a 10-year prospective-longitudinal community study in adolescents. Drug Alcohol Depend. 2007;88:S60–S70. doi: 10.1016/j.drugalcdep.2006.12.013. [DOI] [PubMed] [Google Scholar]