Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2023 Jun 1.
Published in final edited form as: J Am Geriatr Soc. 2022 Mar 2;70(6):1657–1660. doi: 10.1111/jgs.17720

Electronic Health Record Data May Lead to Underestimates of Cannabis Use—Especially Among Older Populations

Joseph J Palamar 1, Austin Le 1,2
PMCID: PMC9177566  NIHMSID: NIHMS1781759  PMID: 35234290

Javanbakht et al. published an important paper in this issue of the Journal of the American Geriatrics Society (JAGS) that estimated prevalence of current cannabis use among older adults within a large healthcare system in Los Angeles, California.1

The authors should be commended for appropriately noting many of the limitations of utilizing a data source derived from self-report. We hope to expand this discussion by further considering the potential limitations associated with utilizing data from electronic health records.

In this study, patients were asked about substance use via face-to-face interviews during their annual physical exam visits with medical staff. They were first asked if they had used any substance from a list of over thirty drugs that included cannabis; those who answered affirmatively regarding any use were subsequently queried about “current” use of said drugs in an open-ended manner. While validated drug screenings are most ideal,2 asking about drug use in any systematic manner is more advantageous than not. However, it is worth noting that asking one overall question about drug use that then leads to specific follow-up questions if answered affirmatively (i.e., gate questions) tends to underestimate the specific behaviors of concern.3,4

An additional consideration that can lead to underestimation of prevalence is the manner through which self-reported responses are obtained. It has been demonstrated that participants are more likely to underreport drug use during face-to-face interviews (as compared to surveys),5 especially if not conducted in a private setting (e.g., away from others, such as family members).6 While the authors reasonably put forth that the legalization of recreational cannabis in their study location may have been associated with destigmatized reporting of its use, we would implore caution—the direct probing of use between provider and patient in this study may in fact offset any potential reduction in stigma surrounding use owing to the recent legality of use. Please note that considerations surrounding stigma are further discussed below.

Current use in this study was commonly defined by medical staff as use within the past 1–3 months. The varying time frames adopted by staff and patients alike is problematic. In the existing literature, current use is typically defined as past-month use.7 The authors correctly note that this is a limitation that may, in part, contribute to underestimation of prevalence of use among patients who use infrequently, but most of their discussion then focuses on limited recall of infrequent events. Indeed, this is a valid point, though we would like to add that less recent use is associated with infrequent use. Specifically, as shown in Figure 1, among noninstitutionalized adults in the United States (US) in 2019 (data from the National Survey on Drug Use and Health [NSDUH]7), past-month cannabis users were much more likely to engage in higher frequency use than those engaging in past-year but not past-month use (p<.001). As such, we believe that the small window period adopted in this study is more likely to detect past-month users (who are more likely to be frequent users) as opposed to less frequent users (who are more likely to underreport use).

Figure 1.

Figure 1.

Frequency of cannabis use in relation to recency of use among noninstitutionalized individuals in the United States, 2019

The authors also mention that self-reported cannabis use typically has a high concordance with biospecimen test results, but it should be noted that in two of the studies cited by the authors,8,9 older patients were more likely to test positive after having not reported cannabis use. In addition, it has been shown that the prevalence of recanting, which is defined as the subsequent denial of previously self-reported use of a drug on a follow-up survey,10 can increase with age. In fact, adults of ages 45–64 at baseline in one study were found to be at over twice the odds of recanting cannabis and “hard” drug use compared to those of ages 25–44, with prevalence of recanting reaching 30% at 10 years following the initial survey.11 This further suggests that self-report tends to be less reliable in older populations.

As noted by the authors, other limitations include a reluctance to report or ask about cannabis use due to perceived stigma associated with use. As they thoughtfully point out, liberalized cannabis laws in California have indeed led to lower levels of disapproval toward use.12 However, we feel it is imperative to note that overall disapproval remains high among older populations in the US. As shown in Figure 2, among noninstitutionalized adults in the US in 2019 (data from the NSDUH7), disapproval (and strong disapproval) significantly increase with age, with over half (52.7%) of adults ages ≥65 expressing disapproval towards adults trying cannabis (p<.001). This is important to consider because people who stigmatize drug use are more likely to recant use,13 as earlier discussed, and those who are more disapproving of cannabis use are less likely to use,14 or perhaps less likely to report use.

Figure 2.

Figure 2.

Disapproval towards cannabis use according to age among noninstitutionalized adults in the United States, 2019

Finally, we must recognize that utilizing electronic health record databases can have its own limitations. Selection bias is a particular issue when there are factors that lead to systematic under-enrollment according to specific patient characteristics.15 For example, if people who use cannabis are more or less likely to have annual physical examinations, then electronic medical record data may not be representative of the overall population. Furthermore, not only are people of certain demographics more likely to visit the hospital,16 but people with health conditions may be more likely to visit hospitals more often or have more complete records (e.g., regarding prescription orders).17 Not only can this bias results, but more visits is likely associated with increases in the likelihood of reporting recent drug use as well. Even when the majority of physicians probe for and record drug use during medical visits,18,19 a sizeable portion of patients may still be unaccounted for. Physicians may also be less likely to ask older patients in particular about drug use given a relatively low prevalence of use.

Ultimately, we would like to commend the authors for presenting their findings in this issue of JAGS. Health implications of cannabis use is a topical issue and use among older populations is certainly an important one to consider in public health. Bringing attention towards the need for routine cannabis-related screening among older adults in primary care settings appears beneficial, but interpretation of these findings should take into account a more expansive discussion of the study limitations.

Acknowledgments

J. Palamar is funded by the National Institutes of Health (NIH) (R01DA044207).

Role of funding source

Research reported in this publication was supported by the National Institute on Drug Abuse of the National Institutes of Health under Award Number R01DA044207. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Disclosures:

Conflict of Interest

This project was funded by the National Institutes of Health (R01DA044207). The funding organization had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. Dr. Palamar has consulted for Alkermes. The authors have no other potential conflicts to declare.

References

  • 1.Javanbakht M, Takada S, Akabike W, Shoptaw S, Gelberg L. Cannabis use and prescription medication use among older adults in a large healthcare system in Los Angeles, CA 2019–2020 Journal of the American Geriatrics Society. 2022; in press [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.McNeely J, Adam A. New York State Department of Health AIDS Institute Clinical Guidelines. In: Substance Use Screening and Risk Assessment in Adults. Baltimore (MD): Johns Hopkins University. [Google Scholar]
  • 3.Barber ME, Marzuk PM, Leon AC, Portera L. Gate questions in psychiatric interviewing: the case of suicide assessment. J Psychiatr Res. 2001;35(1):67–69. [DOI] [PubMed] [Google Scholar]
  • 4.Palamar JJ, Acosta P, Calderon FF, Sherman S, Cleland CM. Assessing self-reported use of new psychoactive substances: The impact of gate questions. Am J Drug Alcohol Abuse. 2017;43(5):609–617. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Tourangeau R, Yan T. Sensitive questions in surveys. Psychol Bull. 2007;133(5):859–883. [DOI] [PubMed] [Google Scholar]
  • 6.Substance Abuse Mental Health Services Administration. CBHSQ Methodology Report. In: Comparing and Evaluating Youth Substance Use Estimates from the National Survey on Drug Use and Health and Other Surveys. Rockville (MD): Substance Abuse and Mental Health Services Administration (US); 2012. [PubMed] [Google Scholar]
  • 7.Substance Abuse and Mental Health Services Administration. Key substance use and mental health indicators in the United States: Results from the 2019 National Survey on Drug Use and Health. Rockville, MD: Center for Behavioral Health Statistics and Quality;2020. [Google Scholar]
  • 8.Nordeck CD, Gryczynski J, O’Grady KE, et al. Comparison of timeline follow-back self-report and oral fluid testing to detect substance use in adult primary care patients. Drug Alcohol Depend. 2020;209:107939. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Sharma G, Oden N, VanVeldhuisen PC, Bogenschutz MP. Hair analysis and its concordance with self-report for drug users presenting in emergency department. Drug Alcohol Depend. 2016;167:149–155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Palamar JJ, Le A, Acosta P, Cleland CM. Consistency of self-reported drug use among electronic dance music party attendees. Drug Alcohol Rev. 2019;38(7):798–806. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Jensen HAR, Karjalainen K, Juel K, Ekholm O. Consistency in Adults’ Self-Reported Lifetime Use of Illicit Drugs: A Follow-Up Study Over 13 Years. J Stud Alcohol Drugs. 2018;79(3):490–494. [PubMed] [Google Scholar]
  • 12.Miech RA, Johnston L, O’Malley PM, Bachman JG, Schulenberg J, Patrick ME. Trends in use of marijuana and attitudes toward marijuana among youth before and after decriminalization: the case of California 2007–2013. Int J Drug Policy. 2015;26(4):336–344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Ensminger ME, Juon HS, Green KM. Consistency between adolescent reports and adult retrospective reports of adolescent marijuana use: explanations of inconsistent reporting among an African American population. Drug Alcohol Depend. 2007;89(1):13–23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Keyes KM, Schulenberg JE, O’Malley PM, et al. The social norms of birth cohorts and adolescent marijuana use in the United States, 1976–2007. Addiction. 2011;106(10):1790–1800. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Tripepi G, Jager KJ, Dekker FW, Zoccali C. Selection bias and information bias in clinical research. Nephron Clin Pract. 2010;115(2):c94–99. [DOI] [PubMed] [Google Scholar]
  • 16.Romo ML, Chan PY, Lurie-Moroni E, et al. Characterizing Adults Receiving Primary Medical Care in New York City: Implications for Using Electronic Health Records for Chronic Disease Surveillance. Prev Chronic Dis. 2016;13:E56. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Rusanov A, Weiskopf NG, Wang S, Weng C. Hidden in plain sight: bias towards sick patients when sampling patients with sufficient electronic health record data for research. BMC Med Inform Decis Mak. 2014;14:51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.McNeely J, Adam A, Rotrosen J, et al. Comparison of Methods for Alcohol and Drug Screening in Primary Care Clinics. JAMA Netw Open. 2021;4(5):e2110721. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Harris BR, Yu J. Attitudes, perceptions and practice of alcohol and drug screening, brief intervention and referral to treatment: a case study of New York State primary care physicians and non-physician providers. Public Health. 2016;139:70–78. [DOI] [PubMed] [Google Scholar]

RESOURCES