Skip to main content
PMC home page
International Journal of Methods in Psychiatric Research logoLink to International Journal of Methods in Psychiatric Research
. 2010 Mar 10;19(2):74–87. doi: 10.1002/mpr.302

Estimated drug use based on direct questioning and open‐ended questions: responses in the 2006 National Survey on Drug Use and Health

Larry A Kroutil 1,✉, Michael Vorburger 2, Jeremy Aldworth 1, James D Colliver 3
PMCID: PMC6878274  PMID: 20222148

Abstract

Substance use surveys may use open‐ended items to supplement questions about specific drugs and obtain more exhaustive information on illicit drug use. However these questions are likely to underestimate the prevalence of use of specific drugs. Little is known about the extent of such underestimation or the groups most prone to under‐reporting. Using data from the 2006 National Survey on Drug Use and Health (NSDUH), a civilian, non‐institutionalized population survey of persons aged 12 or older in the United States, we compared drug use estimates based on open‐ended questions with estimates from a new set of direct questions that occurred later in the interview. For these drugs, estimates of lifetime drug use based on open‐ended questions often were at least seven times lower than those based on direct questions. Among adults identified in direct questions as substance users, lower educational levels were consistently associated with non‐reporting of use in the open‐ended questions. Given NSDUH's large annual sample size (∼67  000 interviews), combining data across future survey years could increase our understanding of characteristics associated with non‐reporting of use in open‐ended questions and allow drug use trends to be extrapolated to survey years in which only open‐ended question data are available. Copyright © 2010 John Wiley & Sons, Ltd.

Keywords: drug prevalence, open‐ended questions, direct questions, underestimation

Full Text

The Full Text of this article is available as a PDF (190.4 KB).

REFERENCES

  1. Allred I., Frick G.G., Myers S., Packer L., Suresh P., Wayne K., Witt M., Caspar R., Lessler J.T., O'Reilly J., Penne M., Thissen R., Wickelgren M. (1997) 1997 National Household Survey on Drug Abuse: Electronic Instruments Field Test Analysis Report: Field Test 1: Fall 1996, Research Triangle Institute. Prepared for Substance Abuse and Mental Health Services Administration, Office of Applied Studies, Deliverable No. 11, Contract No. 283‐96‐0001.
  2. American Psychiatric Association . (1994) Diagnostic and Statistical Manual of Mental Disorders, 4th edition, American Psychiatric Association. [Google Scholar]
  3. Aquilino W.S., LoSciuto L.A. (1990) Effects of interview mode on self‐reported drug use. Public Opinion Quartely, 54, 362–395. [Google Scholar]
  4. Baddeley A. (1979) The limitations of human memory: Implications for the design of retrospective surveys In: The Recall Method in Social Surveys (eds Moss L, Goldstein H.), Studies in Education (new series) 9, pp. 13–30, University of London Institute of Education. [Google Scholar]
  5. Caspar R.A., Couper M.P. (1997) Using keystroke files to assess respondent difficulties with an audio‐CASI instrument In: 1997 Proceedings of the American Statistical Association, Survey Research Methods Section, pp. 239–244, American Statistical Association. [Google Scholar]
  6. DeNavas‐Walt C., Proctor B.D., Smith J. (2007) Income, Poverty, and Health Insurance Coverage in the United States: 2006, US Census Bureau, Current Population Reports, P‐60‐233, US Government Printing Office.
  7. Epstein J.F., Barker P.R., Kroutil L.A. (2001) Mode effects in self‐reported mental health data. Public Opinion Quarterly, 65, 529–549, DOI: 10.1086/323577. [Google Scholar]
  8. Fieller E.C. (1940) The biological standardization of insulin. Journal of the Royal Statistical Society, 7(Supplement), 1–64. [Google Scholar]
  9. Gfroerer J., Eyerman J., Chromy J. (eds). (2002) Redesigning an Ongoing National Household Survey: Methodological Issues, DHHS Publication No. SMA 03–3768, Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
  10. Gfroerer J., Penne M., Pemberton M., Folsom R. (2003) Substance abuse treatment need among older adults in 2020: The impact of the aging baby‐boom cohort. Drug and Alcohol Dependence, 69, 127–135, DOI: 10.1016/S0376‐8716(02)00307‐1. [DOI] [PubMed] [Google Scholar]
  11. Graubard B.I., Korn E.L. (1999) Predictive margins with survey data. Biometrics, 55, 652–659, DOI: 10.1111/j.0006‐341X.1999.00652.x. [DOI] [PubMed] [Google Scholar]
  12. Harrison L.D., Martin S.S., Enev T., Harrington D. (2007) Comparing Drug Testing and Self‐report of Drug Use among Youths and Young Adults in the General Population, DHHS Publication No. SMA 07‐4249, Methodology Series M–7, Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
  13. Holbrook A., Cho Y.I., Johnson T. (2006) The impact of question and respondent characteristics on comprehension and mapping difficulties. Public Opinion Quarterly, 70, 565–595, DOI: 10.1093/poq/nfl027. [Google Scholar]
  14. Hser Y. (1997) Self‐reported drug use: Results of selected empirical investigations of validity In: The Validity of Self‐Reported Drug Use: Improving the Accuracy of Survey Estimates (eds Harrison L, Hughes A.), NIH Publication No. 97‐4147, NIDA Research Monograph 167, pp. 320–343, National Institute on Drug Abuse. [PubMed] [Google Scholar]
  15. Hser Y.‐I., Anglin M.D., Chou C.‐P. (1992) Reliability of retrospective self‐report by narcotics addicts. Psychological Assessment, 4, 207–213. [Google Scholar]
  16. Johnston L.D., O'Malley P.M., Bachman J.G., Schulenberg J.E. (2007) Monitoring the Future National Results on Adolescent Drug Use: Overview of Key Findings, 2006, NIH Publication No. 07–6202, National Institute on Drug Abuse. [Google Scholar]
  17. Kennet J., Gfroerer J. (eds). (2005) Evaluating and Improving Methods Used in the National Survey on Drug Use and Health, DHHS Publication No. SMA 05‐4044, Methodology Series M–5, Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
  18. Kroutil L.A., Handley W. (2008) 2006 National Survey on Drug Use and Health: General Principles and Procedures for Editing Drug Use Data in the 2006 NSDUH Computer‐Assisted Interview, RTI International. Prepared for Substance Abuse and Mental Health Services Administration, Contract No. 283‐2004‐00022, Deliverable No. 39.
  19. Kroutil L.A., Van Brunt D.L., Herman‐Stahl M.A., Heller D.C., Bray R.M., Penne M.A. (2006) Nonmedical use of prescription stimulants in the United States. Drug and Alcohol Dependence, 84, 135–143, DOI: 10.1016/j.drugalcdep.2005.12.011. [DOI] [PubMed] [Google Scholar]
  20. Means B., Nigam A., Zarrow M., Loftus E.F., Donaldson M.S. (1989) Autobiographical Memory for Health‐Related Events, Vital and Health Statistics, Series 6: Cognition and Survey Measurement, No. 2, DHHS Publication No. PHS 89–1077, National Center for Health Statistics.
  21. Nagelkerke N.J.D. (1991) Miscellanea: A note on a general definition of the coefficient of determination. Biometrika, 78, 691–692, DOI:10.1093/biomet/78.3.691. [Google Scholar]
  22. RTI International . (2004) SUDAAN® User's Manual: Release 9.0.0, RTI International. [Google Scholar]
  23. RTI International . (2005) 2006 National Survey on Drug Use and Health: CAI Specs for Programming, English Version, RTI International. Prepared for Substance Abuse and Mental Health Services Administration, Contract No. 283‐2004‐00022, Deliverable No. 2.
  24. Substance Abuse and Mental Health Services Administration (SAMHSA) . (2001) Development of Computer‐assisted Interviewing Procedures for the National Household Survey on Drug Abuse, DHHS Publication No. SMA 01‐3514, Methodology Series M–3, Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
  25. Substance Abuse and Mental Health Services Administration (SAMHSA) . (2006) National Survey on Drug Use and Health: Summary of Methodological Studies, 1971–2005, DHHS Publication No. SMA 06‐4146, Methodology Series M–6, Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
  26. Substance Abuse and Mental Health Services Administration (SAMHSA) . (2007a) Results from the 2006 National Survey on Drug Use and Health: National Findings, DHHS Publication No. SMA 07–4293, NSDUH Series H‐32, Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
  27. Substance Abuse and Mental Health Services Administration (SAMHSA) . (2007b) Results from the 2006 National Survey on Drug Use and Health: Detailed Tables, Substance Abuse and Mental Health Services Administration, Office of Applied Studies.
  28. Tourangeau R., Rasinski K.A. (1988) Cognitive processes underlying context effects in attitude measurement. Psychological Bulletin, 103, 299–314, DOI: 10.1037/0033‐2909.103.3.299. [Google Scholar]
  29. Tourangeau R., Rips L.J., Rasinski K. (2000) The Psychology of Survey Response, Cambridge University Press. [Google Scholar]
  30. Tourangeau R., Smith T.W. (1996) Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly, 60, 275–304. [Google Scholar]
  31. Turner C.F., Lessler J.T., Devore J.W. (1992) Effects of mode of administration and wording on reporting of drug use In: Survey Measurement of Drug Use: Methodological Studies (eds Turner CF, Lessler JT, Gfroerer JC.), DHHS Publication No. ADM 92‐1929, pp. 177–219, National Institute on Drug Abuse. [Google Scholar]
  32. Wu L.T., Schlenger W.E., Galvin D.M. (2007) Corrigendum to ‘Concurrent use of methamphetamine, MDMA, LSD, ketamine, GHB, and flunitrazepam among American youths’ [Drug and Alcohol Dependence, 2006, 84, 102–113]. Drug and Alcohol Dependence, 86, 301, DOI: 10.1016/j.drugalcdep.2006.01.018. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from International Journal of Methods in Psychiatric Research are provided here courtesy of Wiley

RESOURCES