Abstract
Background and Objectives
Cannabis is the most widely used illicit substance worldwide, with an estimated 160 million users. Among adolescents, rates of cannabis use are increasing, while the perception of detrimental effects of cannabis use is declining. Difficulty with memory is one of the most frequently noted cognitive deficits associated with cannabis use, but little data exists exploring how well users can identify their own memory deficits, if present.
Methods
The current secondary analysis sought to characterize objective verbal and visual memory performance via a neurocognitive battery in cannabis-dependent adolescents enrolled in a pharmacotherapeutic cannabis cessation clinical trial (N=112) and compare this to a single self-reported item assessing difficulties with memory loss. Exploratory analyses also assessed dose-dependent effects of cannabis on memory performance.
Results
A small portion of the study sample (10%) endorsed a “serious problem” with memory loss. Those participants reporting “no problem” or “serious problem” scored similarly on visual and verbal memory tasks on the neurocognitive battery. Exploratory analyses suggested a potential relationship between days of cannabis use, amount of cannabis used, and gender with memory performance.
Conclusions and Scientific Significance
This preliminary and exploratory analysis suggests that a sub-set of cannabis users may not accurately perceive difficulties with memory. Further work should test this hypothesis with the use of a control group, comprehensive self-reports of memory problems, and adult populations that may have more years of cannabis use and more severe cognitive deficits.
Keywords: adolescents, cannabis, memory, cognition, neurocognitive testing
Introduction
Cannabis is the most widely used illicit substance worldwide, with an estimated 160 million users.1 Within the United States (US), cannabis use among adolescents is increasing, while the perception of the harmful effects of cannabis is declining.2 Cannabis use is typically initiated during adolescence or young adulthood (18.4 years old)3, and often persists into adulthood. Despite public perception of general safety, myriad problems are associated with early initiation of regular cannabis use, including higher incidence of cannabis dependence;4 neurocognitive deficits;5–7 adverse influence on relationships, employment, and mental health;8,9 and progression to the use of tobacco.10 It has been suggested that adolescents may be more vulnerable to neurocognitive deficits and alterations in brain structure and function associated with cannabis use compared to adults, due to their ongoing neurodevelopment. 7,11 Further, recent work is investigating the potential link between cannabis-related brain structure abnormalities and cognitive decrements.12
Memory impairment is potentially the most frequently noted cognitive deficit associated with cannabis use. A number of studies assessing memory function in cannabis users have shown deficits associated with chronic use.13–20 Two of those studies reported on verbal learning and memory among adolescent cannabis users and found impaired memory performance among cannabis users and dose-dependent effects of cannabis on performance.18,20 While adolescent and adult data strongly suggest memory impairment in cannabis users, the perception of that impairment by the user is not well understood. Agreement between self-reported memory difficulties and objective, neurocognitive assessments has not been extensively explored in the literature. One study with aircraft pilots in a flight simulator showed that cognitive impairment was accurately perceived during acute cannabis intoxication, but impairment was not perceived 24 hours later, even in the presence of continued performance deficits.21 It may be that cannabis users are not accurately identifying cognitive difficulties, thus biasing their own self-reports. The ability to accurately perceive cognitive difficulties is an important issue that warrants study, especially in adolescents, who are at a critical juncture in their educational and vocational training and advancement.
The current study is an exploratory secondary analysis that assessed memory in cannabis-dependent adolescents enrolled in cannabis cessation clinical trial. Memory performance was characterized using objective and subjective measures. Visual and verbal memory was assessed through a computerized neurocognitive battery (CNS Vital Signs).22 Visual and verbal memory tasks are recognition-based, rather than recall-based, and are meant to more closely mimic memory impairments experienced during daily activities. Self-reported memory difficulties were rated via one item on The Marijuana Problem Scale (MPS).23–25 Self-reported ratings of memory loss were compared to objective performance on visual and verbal memory tasks to determine if participants could accurately recognize and report any memory difficulties. Also, dose-dependent relationships between cannabis use characteristics and memory performance were explored. Based on previous research, it was expected that participants would show deficits in memory compared to previously determined age-matched control values22, and that there would be a dose-dependent influence of cannabis use on memory performance. It was also predicted that participants would not accurately self-report their own memory difficulties. The current study did not include a control group and was not powered to test memory impairments specifically, so all analyses were exploratory in nature.
Methods
Participants and Procedures
Data for this secondary analysis came from a double-blind, placebo-controlled trial of N-acetylcysteine (NAC) for cannabis cessation in treatment-seeking adolescents.26 Study participants, aged 15–21, who met criteria for cannabis dependence and had no other current clinically significant psychiatric or co-occurring substance use disorder (excluding tobacco) were enrolled (N=116 in the parent trial). Participants were excluded from the study if they were taking medications that may interfere with study medication, currently enrolled in treatment for cannabis dependence, or if they were pregnant or breastfeeding. Participants were randomized to receive active medication (NAC, 1200 mg twice daily) or matched placebo for 8 weeks. Abstinence from cannabis was the primary outcome measure in the parent trial. All memory assessments reported in this analysis were completed prior to randomization. Further details of the study can be found elsewhere.26
Measures
Participants completed the self-reported MPS scale23–25 during the screening visit (prior to cannabis cessation), which assesses difficulties associated with cannabis use. Specifically, the questionnaire asks participants to indicate how much of a problem a particular item has been over the past 30 days. Participants rated 19 items on an ordinal scale (0=no problem, 1=minor problem, 2=serious problem), which results in a total summed score (0–19). This questionnaire has shown excellent internal consistency (α=0.86).27 Out of 19 items, one item assesses problems with memory (i.e., “memory loss”). While it is not standard practice to assess individual items from the MPS, we were specifically interested in the perception of memory difficulties, though we recognize this as a study limitation.
At screening, participants also completed the CNS Vital Signs, which is a computerized neurocognitive battery of performance tests that assesses subtle changes in mental acuity, learning and memory, psychomotor speed, complex attention, impulsivity, planning and sequencing.22 Verbal and visual memory tests from this battery are adaptations of the Rey Auditory Verbal Learning Test and the Rey Visual Design Learning Test28, which is presented with standardized instructions29 and was adapted for computer delivery.22 In the verbal task, 15 words are presented, and participants are asked to remember those words (separated by 2 seconds). Then, 30 words are presented with the original 15 words randomly interspersed. The participant pushes the space bar when they see a word they recognize from the previous list (immediate condition). After 20 minutes, the participant is asked again to respond when they see one of the original 15 words (delay condition). In the visual task, participants are asked to remember 15 geometric shapes and the procedures are similar to those described for the verbal task. Scoring includes correct “hits” and “passes” for the immediate and delayed condition. Verbal and visual memory tasks yield scores that are summed to generate a composite memory score that captures recognition, not recall, through immediate and delayed conditions. This score can range from 60 to 120, with 100 (SD=15) being average for adolescents and young adults.22
Recency of cannabis use prior to the screening visit was captured via the Timeline Follow-Back30 adapted for cannabis use. Approximately 64% of the sample endorsed using cannabis the day prior to the screening assessment. If participants had appeared impaired at screening or reported using cannabis earlier that day, they would not have been consented at that time. Therefore, all memory measurements completed at screening were taken approximately 12–24+ hours since their last cannabis use episode (as determined by self-report).
Additional questions were asked at the screening visit to assess cannabis use history (i.e., years of cannabis use and number of prior quit attempts) and current use patterns (days of use in the past 30 and grams used per day). Days of use (out of the last 30) was determined via responses on the Timeline Follow-Back instrument30. Participants were also asked to estimate the quantity of cannabis they purchase at a time and how many days that typically lasts (over the past 30 days). This provided an estimate of grams used per day.
Statistical Analyses
For the current analysis, there was insufficient data for four participants, resulting in a sample of N= 112. Standard descriptive statistics were used to summarize demographic, clinical, and cannabis use characteristics for those enrolled in the parent trial, both in the aggregate and categorized by responses on the memory loss item of the MPS (0, 1, or 2). To screen for potentially confounding factors between self-reported and objective memory difficulties, Pearson chi-squared tests (or Fisher’s exact tests, in cases where expected cell counts were too small) were used to compare MPS memory loss groups on categorical and grouped-continuous demographic and lifetime cannabis use measures. Similarly, a one-way ANOVA test was used to compare mean number of days of cannabis use (out of 30) and Marijuana Craving Questionnaire total score (MCQ)31 across self-reported memory loss groups.
Verbal and visual memory scores from the neurocognitive battery were compared across MPS memory loss groups with the use of Kruskal-Wallis tests, owing to the non-normal residuals when performing parametric one-way ANOVA tests. Further between-group analyses were conducted with Steel-Dwass tests32, which is the nonparametric version of Tukey’s HSD post-hoc test.
In order to build a model for predicting verbal and visual memory scores, a linear model was assumed using the memory loss score from the MPS as the response variable and the full set of candidate predictors as explanatory variables, consisting of: age, gender, cigarette smoker, days of cannabis use (out of the past 30), urinary cannabinoid level, grams of cannabis used per day (past 30 days), MCQ score, modified Fagerström Tolerance Questionnaire total score (FTND)33, race (grouped: Caucasian vs. non-Caucasian), education (grouped: some college vs. no college), years of cigarette use, and years of cannabis use. A minimum Bayesian Information Criterion (BIC) stopping rule was used with a backward direction stepwise routine. Thus, the algorithm successively removed variables from the full model and updated the model’s BIC value until no further removals could decrease the BIC any further. The remaining variables then comprised the selected model.
Results
Sample Characteristics
Demographic and cannabis use characteristics are shown in Table 1 for all participants included in the current analysis, and separated by responses on the memory loss item of the MPS. Out of the 112 participants, 11 (10%) reported experiencing “serious” memory loss problems, while 54 (48%) reported a “minor problem” and 47 (42%) reported having “no problem” with memory loss. Generally, participants had an average (SD) age of 18.9 (1.5) years, 73% were male, and 74% were currently enrolled in school.
Table 1.
Marijuana Problem Scale – Memory Loss | ||||
---|---|---|---|---|
Overall (N=112) |
No problem (N=47) |
Minor problem (N=54) |
Serious problem (N=11) |
|
Mean ± SD | Mean ± SD | Mean ± SD | Mean ± SD | |
Age | 18.9 ± 1.5 | 18.8 ± 1.6 | 19.0 ± 1.5 | 18.7 ± 1.7 |
Male % | 73.2 | 80.9 | 72.2 | 45.5 |
Enrolled in School % | 74.1 | 76.6 | 68.5 | 90.9 |
Years Smoking Cannabis | 4.2 ± 1.8 | 3.9 ± 1.7 | 4.3 ± 1.8 | 4.6 ± 2.7 |
# of Quit Attempts | 2.4 ± 3.4 | 1.8 ± 3.4 | 3.1 ± 3.7 | 2.0 ± 2.5 |
Days of Cannabis Use (out of 30) | 22.7 ± 7.3 | 23.2 ± 6.8 | 22.2 ± 7.8 | 23.5 ± 6.6 |
Grams/day of Cannabis | 1.9 ± 3.3 | 1.8 ± 4.1 | 1.9 ± 2.9 | 2.0 ± 1.7 |
Marijuana Craving Questionnaire Total (out of 84) | 47.5 ± 14.6 | 45.9 ± 13.5 | 47.1 ± 14.9 | 55.5 ± 16.4 |
Tests of association between the demographic and cannabis use characteristics in Table 1 and self-reported memory loss produced statistically insignificant results. The chi-squared tests found no significant association between self-reported memory loss and gender χ2(2, N = 112) = 5.75, p = .0565; enrollment in school χ2(2, N = 112) = 2.65, p = .266; and grams/day of cannabis (grouped) χ2(2, N = 112) = 2.28, p = .320. Likewise, there was no significant association in the Fisher exact tests between self-reported memory loss and age (p = .957); years smoking cannabis (p = .868); and number of quit attempts (p = .145). The means of days of cannabis use (out of 30) and MCQ total were not significantly different between the memory-loss groups, with test results of F(2, 107) = 0.26, p = 0.772 and F(2, 107) = 1.95, p = 0.147, respectively.
Memory Comparisons
Mean verbal and visual memory standardized scores and 95% confidence intervals (CI) derived via the CNS Vital Signs neurocognitive battery for all participants across memory impairment categories are listed in Table 2. Comparisons between groups revealed significant differences between the verbal and visual memory scores among the MPS groups (p = <0.0081 and p = <0.0041, respectively). Participants reporting minor problems with memory performed better on average on both verbal and visual memory compared to those reporting no problem. Those participants reporting serious memory issues performed worse on average than the other groups.
Table 2.
MPS memory group | Verbal Memory Mean (SD) |
Verbal Memory 95% CI |
Visual Memory Mean (SD) |
Visual Memory 95% CI |
---|---|---|---|---|
No problem | 92.7 (25.7) | 84.7 – 100.7 | 93.1 (15.7) | 88.2 – 98.0 |
Minor problem | 103.7 (17.09) | 99.02 – 108.5 | 102.2 (12.8) | 98.6 – 105.9 |
Serious problem | 80.2 (25.4) | 62.0 – 98.4 | 91.3 (10.6) | 83.2 – 99.4 |
Post-hoc comparisons between memory difficulty groups showed a significant difference between those reporting “minor problem” and “serious problem” (Z = −2.69, p = .020) in verbal memory scores, but no differences between those reporting “no problem” and “minor problem” (Z = 2.16, p = .079) or between those reporting “no problem” and “serious problem” (Z = −1.46, p = .308). Likewise, there was a significant difference in visual memory scores between those reporting “minor problem” and “serious problem” (Z = −2.51, p = .032), but there was also a significant difference between those reporting “no problem” and “minor problem” (Z = 2.78, p = <.015). Similar to the verbal memory scores, there was no significant difference between those reporting “no problem” and “serious problem” (Z = -0.38, p = .922).
Predictors of Visual and Verbal Performance
The relevant values for the selected regression models for verbal and visual memory are summarized in Table 3. The stepwise variable selection routine produced a model with gender and days of cannabis use in the past 30 days (and an intercept) predicting verbal memory. The BIC value for this model was 418.249. For visual memory, the best model included gender, days of cannabis used, grams of cannabis used per day, education, and years of cigarette use. The final BIC value was 367.35. It should be emphasized that these results are exploratory in nature and should be interpreted with caution.
Table 3.
Verbal Memory | ||||||
---|---|---|---|---|---|---|
Source | df | Sum of Squares |
Mean Squares |
F Ratio | p-value | R2 |
Model | 2 | 909.21 | 454.61 | 0.86 | 0.4260 | 0.0171 |
Error | 99 | 52,282.27 | 528.10 | |||
Total | 101 | 53,191.48 | ||||
Visual Memory | ||||||
Source | df |
Sum of Squares |
Mean Squares |
F Ratio | p-value | R2 |
Model | 5 | 2,507.04 | 501.41 | 2.54 | 0.0337 | 0.1237 |
Error | 90 | 17,758.53 | 197.32 | |||
Total | 95 | 20,265.58 |
Discussion
Cannabis-dependent adolescents enrolled in a cannabis cessation trial generally self-reported mild or no memory impairment (48% and 42%, respectively). Participants who reported “minor” problems with memory loss performed better on average on objective tasks than all other participants, and slightly above the normative values found for healthy individuals in this age group (mean=100, SD=15).22 Those participants reporting “no problem” with memory loss scored lower on average compared to those reporting a “minor problem”, and their scores were not significantly different from those reporting a “serious problem” with memory loss. Those reporting a “serious problem” also scored the lowest on average on the neurocognitive battery for memory, and compared to normative values22 were more than one standard deviation from the mean for verbal memory. These results suggest that the majority of participants categorized themselves somewhat inconsistently on the MPS when compared to objective, neurocognitive tasks. Participants reporting “minor” problems demonstrated the strongest performance on the memory tasks. This finding may suggest that these participants may be more likely to recognize or remember difficulties, leading to some endorsement of problems with cannabis, but objectively are not experiencing cognitive deficits. Most notably and of greater concern is that participants reporting “no problem” were not classifying themselves correctly and appeared to have memory deficits when compared to other participants in this trial and normative scores for their age group.
Predictive variables of memory performance were examined using a stepwise variable selection routine, and found that gender and days of cannabis use in the past 30 days were significant predictors of both verbal and visual memory deficits. Frequency of use seems relevant for the prediction of cognitive deficits, which is consistent with some previous literature.13,34,35 For visual memory deficits, several additional variables emerged, such as grams of cannabis used, education, and years of cigarette use. Gender also emerged as a predictor for memory score in the current study. This result should be interpreted cautiously as the majority of study participants were male (73%), but it does represent and interesting and noteworthy finding. There is some evidence to suggest gender differences in cannabis-related cognitive effects,13,36 and a recent study found a relationship between more cannabis use and poorer episodic memory in females compared to males.37 It may be that frequency of cannabis use and gender should be considered and explored in future research on neurocognitive deficits related to cannabis use.
Some participants in this study appear to recognize their memory difficulties, which may have therapeutic significance. Those individuals who recognize difficulties in cognitive performance related to cannabis use may be more motivated to decrease their use or quit. Of more concern are those individuals who reported “no problem” with memory, while objective tests revealed that they did exhibit slight memory deficits. A substantial portion of the study sample (42%) was not accurately recognizing these deficits. For these individuals, discussion of their objective measures of memory impairment compared to normative controls might be used to enhance motivation to decrease cannabis use. This suggests that the MPS may be useful in categorizing memory difficulties for some individuals, and a comprehensive treatment should include memory improvement strategies or cognitive training.
There are several limitations to the current analysis that should be noted. First, the MPS only contained one item that assessed memory loss issues. Analysis of a single item is not standard practice in the literature, but the current analysis was meant to be exploratory in the assessment of objective and subjective memory comparisons. A more thorough assessment of self-reported memory and associated difficulties will be necessary for adequate comparisons with neurocognitive batteries. Second, this study did not assess other cognitive domains, which are also likely to be affected by cannabis use and should be explored in future studies along with corresponding self-reports of cognitive performance. Third, this study did not include a control group of non-cannabis matched adolescents. Therefore, memory performance among the current study sample can only be compared to age-matched non-cannabis using controls from previous studies.22 Fourth, the MPS relies on the accurate reporting and perception of memory issues in the patient, and does not differentiate between retrospective, prospective, short- or long-term memory difficulties. Only 11 participants in the current study reported a “serious problem” with memory, which may have biased the neurocognitive results for that group, and may not accurately capture performance among this group. Fifth, the collected neurocognitive data does not account for baseline levels of performance prior to the initiation of cannabis use. However, these data can be compared to normative data for healthy controls for the same test batter in similar age groups22, which aids in assessing deficits. Finally, estimates of cannabis use were not all obtained through validated methods (i.e., grams used per day). Future studies assessing estimates of cannabis use as predictors should include detailed and validated measures of self-report to account for quantity, potency, and sharing of cannabis among users. It may be wise for future studies to assess several domains of cognitive functioning, as well comprehensive assessments of memory, including both recognition and recall (immediate and delayed conditions).
This preliminary and exploratory post-hoc analysis seems to suggest discrepancies between subjective and objective assessments of memory performance in a sub-set of cannabis-dependent adolescents. While deficits may be subtle among adolescents and young adults, these deficits may worsen with continued cannabis use. Those participants who do not endorse any deficits may require additional assessment and intervention. Future studies should compare both comprehensive self-report and objective batteries of memory performance to assess accurate perception of deficits, if present, and should pay special attention to potential gender differences in cannabis use and performance. These assessments could then be utilized as diagnostic tools to identify areas for improvement, gauge progress throughout a treatment episode, educate participants regarding their neurocognitive performance, and motivate a cessation attempt. Furthermore, specific attention must be paid to cannabis-dependent adolescents with compromised memory function who do not recognize this impairment. These individuals may need to be specifically targeted for cessation in addition to cognitive training to maximize their likelihood of long-term abstinence from cannabis.
Acknowledgements
This work was supported by the National Institutes of Drug Abuse (Bethesda, MD) under grant R01DA026777 (Kevin M. Gray). Effort to conduct this secondary analysis was supported by grants from the National Institutes of Drug Abuse (Bethesda, MD); K01DA036739 (Erin A. McClure), K12DA031794 (Kathleen T. Brady), U01DA031779 (Kevin M. Gray), and U10DA013727 (Kathleen T. Brady).
The authors wish to thank Mr. Alan Boyd, CEO of CNS Vital Signs and developer of the CNS Vital Signs Battery, for assistance with the analyses and interpretation of the neurocognitive data. We also thank Brian Poterfield, PharmD, for his analyses of the data and the clinical research team at the Medical University of South Carolina, including Christine Horne and Sarah Farber.
Footnotes
Declaration of Interest: The authors report no conflicts of interest. The authors alone are responsible for the content and writing of this paper.
References
- 1.United Nations Office on Drugs and Crime. World drug report. 2010 [Google Scholar]
- 2.Johnston LD, O'Malley PM, Bachman JG, Schulenberg JE. Monitoring the future national results on drug use: 2012 Overview, Key Findings on Adolescent Drug Use. Ann Arbor, MI: Institute for Social Research, University of Michigan; 2013. [Google Scholar]
- 3.Substance Abuse and Mental Health Services Administration. Results from the 2011 National Survey on Drug Use and Health: Summary of National Findings. Rockville, MD: U.S.: Department of Health and Human Services, Substance Abuse and Mental Health Services Administration; 2012. [Google Scholar]
- 4.Chen CY, Anthony JC. Possible age-associated bias in reporting of clinical features of drug dependence: epidemiological evidence on adolescent-onset marijuana use. Addiction (Abingdon, England) 2003;98(1):71–82. doi: 10.1046/j.1360-0443.2003.00237.x. [DOI] [PubMed] [Google Scholar]
- 5.Jacobus J, Bava S, Cohen-Zion M, Mahmood O, Tapert SF. Functional consequences of marijuana use in adolescents. Pharmacology, biochemistry, and behavior. 2009;92(4):559–565. doi: 10.1016/j.pbb.2009.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Meier MH, Caspi A, Ambler A, et al. Persistent cannabis users show neuropsychological decline from childhood to midlife. Proceedings of the National Academy of Sciences of the United States of America. 2012;109(40):E2657–E2664. doi: 10.1073/pnas.1206820109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Jager G, Ramsey NF. Long-term consequences of adolescent cannabis exposure on the development of cognition, brain structure and function: an overview of animal and human research. Current drug abuse reviews. 2008;1(2):114–123. doi: 10.2174/1874473710801020114. [DOI] [PubMed] [Google Scholar]
- 8.Budney AJMBAVR. Health consequences of marijuana use. In: Brick J, editor. Handbook of the Medical Consequences of Drug Abuse. Binghamton, NY: Haworth Press; 2008. pp. 171–218. [Google Scholar]
- 9.Rey JM, Martin A, Krabman P. Is the party over? Cannabis and juvenile psychiatric disorder: the past 10 years. Journal of the American Academy of Child and Adolescent Psychiatry. 2004;43(10):1194–1205. doi: 10.1097/01.chi.0000135623.12843.60. [DOI] [PubMed] [Google Scholar]
- 10.Patton GC, Coffey C, Carlin JB, Sawyer SM, Lynskey M. Reverse gateways? Frequent cannabis use as a predictor of tobacco initiation and nicotine dependence. Addiction (Abingdon, England) 2005;100(10):1518–1525. doi: 10.1111/j.1360-0443.2005.01220.x. [DOI] [PubMed] [Google Scholar]
- 11.Schweinsburg AD, Brown SA, Tapert SF. The influence of marijuana use on neurocognitive functioning in adolescents. Current drug abuse reviews. 2008;1(1):99–111. doi: 10.2174/1874473710801010099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Smith MJ, Cobia DJ, Wang L, et al. Cannabis-related working memory deficits and associated subcortical morphological differences in healthy individuals and schizophrenia subjects. Schizophrenia bulletin. 2014 Mar;40(2):287–299. doi: 10.1093/schbul/sbt176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Pope HG, Jr, Yurgelun-Todd D. The residual cognitive effects of heavy marijuana use in college students. JAMA : the journal of the American Medical Association. 1996;275(7):521–527. [PubMed] [Google Scholar]
- 14.Bolla KI, Brown K, Eldreth D, Tate K, Cadet JL. Dose-related neurocognitive effects of marijuana use. Neurology. 2002;59(9):1337–1343. doi: 10.1212/01.wnl.0000031422.66442.49. [DOI] [PubMed] [Google Scholar]
- 15.Grant I, Gonzalez R, Carey CL, Natarajan L, Wolfson T. Non-acute (residual) neurocognitive effects of cannabis use: a meta-analytic study. Journal of the International Neuropsychological Society : JINS. 2003;9(5):679–689. doi: 10.1017/S1355617703950016. [DOI] [PubMed] [Google Scholar]
- 16.Battisti RA, Roodenrys S, Johnstone SJ, Respondek C, Hermens DF, Solowij N. Chronic use of cannabis and poor neural efficiency in verbal memory ability. Psychopharmacology. 2010;209(4):319–330. doi: 10.1007/s00213-010-1800-4. [DOI] [PubMed] [Google Scholar]
- 17.Solowij N, Battisti R. The chronic effects of cannabis on memory in humans: a review. Current drug abuse reviews. 2008;1(1):81–98. doi: 10.2174/1874473710801010081. [DOI] [PubMed] [Google Scholar]
- 18.Solowij N, Jones KA, Rozman ME, et al. Verbal learning and memory in adolescent cannabis users, alcohol users and non-users. Psychopharmacology. 2011;216(1):131–144. doi: 10.1007/s00213-011-2203-x. [DOI] [PubMed] [Google Scholar]
- 19.Solowij N, Stephens RS, Roffman RA, et al. Cognitive functioning of long-term heavy cannabis users seeking treatment. JAMA : the journal of the American Medical Association. 2002;287(9):1123–1131. doi: 10.1001/jama.287.9.1123. [DOI] [PubMed] [Google Scholar]
- 20.Harvey MA, Sellman JD, Porter RJ, Frampton CM. The relationship between non-acute adolescent cannabis use and cognition. Drug Alcohol Rev. 2007 May;26(3):309–319. doi: 10.1080/09595230701247772. [DOI] [PubMed] [Google Scholar]
- 21.Yesavage JA, Leirer VO, Denari M, Hollister LE. Carry-over effects of marijuana intoxication on aircraft pilot performance: a preliminary report. Am J Psychiatry. 1985 Nov;142(11):1325–1329. doi: 10.1176/ajp.142.11.1325. [DOI] [PubMed] [Google Scholar]
- 22.Gualtieri CT, Johnson LG. Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists. 2006;21(7):623–643. doi: 10.1016/j.acn.2006.05.007. [DOI] [PubMed] [Google Scholar]
- 23.Stephens RS, Roffman RA, Curtin L. Comparison of extended versus brief treatments for marijuana use. Journal of consulting and clinical psychology. 2000;68(5):898–908. [PubMed] [Google Scholar]
- 24.Stephens RS, Roffman RA, Simpson EE. Treating adult marijuana dependence: a test of the relapse prevention model. Journal of consulting and clinical psychology. 1994;62(1):92–99. doi: 10.1037//0022-006x.62.1.92. [DOI] [PubMed] [Google Scholar]
- 25.Stephens RS, Roffman RA, Simpson EE. Adult marijuana users seeking treatment. Journal of consulting and clinical psychology. 1993;61(6):1100–1104. doi: 10.1037//0022-006x.61.6.1100. [DOI] [PubMed] [Google Scholar]
- 26.Gray KM, Carpenter MJ, Baker NL, et al. A double-blind randomized controlled trial of N-acetylcysteine in cannabis-dependent adolescents. The American Journal of Psychiatry. 2012;169(8):805–812. doi: 10.1176/appi.ajp.2012.12010055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Buckner JD, Keough ME, Schmidt NB. Problematic alcohol and cannabis use among young adults: the roles of depression and discomfort and distress tolerance. Addictive behaviors. 2007 Sep;32(9):1957–1963. doi: 10.1016/j.addbeh.2006.12.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Rey A. L’examen clinique en psychologie. Paris: Presses Universitaires de France; 1964. [Google Scholar]
- 29.Lezak MD, Howieson DB, Loring DW. Neuropsychological assessment. 4th ed. Oxford: Oxford University Press; 2004. [Google Scholar]
- 30.Sobell LC, Sobell MB, Leo GI, Cancilla A. Reliability of a timeline method: assessing normal drinkers' reports of recent drinking and a comparative evaluation across several populations. British journal of addiction. 1988;83(4):393–402. doi: 10.1111/j.1360-0443.1988.tb00485.x. [DOI] [PubMed] [Google Scholar]
- 31.Heishman SJ, Evans RJ, Singleton EG, Levin KH, Copersino ML, Gorelick DA. Reliability and validity of a short form of the Marijuana Craving Questionnaire. Drug and alcohol dependence. 2009;102(1–3):35–40. doi: 10.1016/j.drugalcdep.2008.12.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Steel RGD. A Rank Sum Test for Comparing All Pairs of Treatments. Technometrics. 1960;2(2):197–207. [Google Scholar]
- 33.Heatherton TF, Kozlowski LT, Frecker RC, Fagerstrom KO. The Fagerstrom Test for Nicotine Dependence: a revision of the Fagerstrom Tolerance Questionnaire. British journal of addiction. 1991;86(9):1119–1127. doi: 10.1111/j.1360-0443.1991.tb01879.x. [DOI] [PubMed] [Google Scholar]
- 34.Pope HG, Jr, Gruber AJ, Hudson JI, Huestis MA, Yurgelun-Todd D. Neuropsychological performance in long-term cannabis users. Archives of General Psychiatry. 2001;58(10):909–915. doi: 10.1001/archpsyc.58.10.909. [DOI] [PubMed] [Google Scholar]
- 35.Solowij N. Cannabis and cognitive functioning. Cambridge: Cambridge University Press; 1998. [Google Scholar]
- 36.Pope HG, Jr, Gruber AJ, Hudson JI, Cohane G, Huestis MA, Yurgelun-Todd D. Early-onset cannabis use and cognitive deficits: what is the nature of the association? Drug and alcohol dependence. 2003;69(3):303–310. doi: 10.1016/s0376-8716(02)00334-4. [DOI] [PubMed] [Google Scholar]
- 37.Crane NA, Schuster RM, Gonzalez R. Preliminary evidence for a sex-specific relationship between amount of cannabis use and neurocognitive performance in young adult cannabis users. J Int Neuropsychol Soc. 2013 Oct;19(9):1009–1015. doi: 10.1017/S135561771300088X. [DOI] [PMC free article] [PubMed] [Google Scholar]