Skip to main content
PMC home page
International Journal of Methods in Psychiatric Research logoLink to International Journal of Methods in Psychiatric Research
. 2010 Feb 28;19(1):34–49. doi: 10.1002/mpr.303

Attention deficit hyperactivity disorder: concordance of the adolescent version of the Composite International Diagnostic Interview Version 3.0 (CIDI) with the K‐SADS in the US National Comorbidity Survey Replication Adolescent (NCS‐A) supplement

Jennifer Greif Green 1, Shelli Avenevoli 2, Matthew Finkelman 3, Michael J Gruber 1, Ronald C Kessler 1,✉, Kathleen R Merikangas 4, Nancy A Sampson 1, Alan M Zaslavsky 1
PMCID: PMC2938790  NIHMSID: NIHMS228860  PMID: 20191660

Abstract

This paper evaluates the internal consistency reliability and concurrent validity of the assessment of Diagnostic and Statistical Manual of Mental Disorders (DSM‐IV) attention deficit hyperactivity disorder (ADHD) in the adolescent version of the World Health Organization (WHO) Composite International Diagnostic Interview Version 3.0 (CIDI). The CIDI is a lay‐administered diagnostic interview that was carried out in conjunction with the US National Comorbidity Survey Adolescent Supplement, a US nationally representative survey of 10,148 adolescents and their parents. Internal consistency reliability was evaluated using factor and item response theory analyses. Concurrent validity was evaluated against diagnoses based on blinded clinician‐administered interviews. Inattention and hyperactivity‐impulsivity items loaded on separate but correlated factors, with hyperactivity and impulsivity items forming a single factor in parent reports but separate factors in youth reports. We were able to differentiate hyperactivity and impulsivity factors for parents as well by eliminating a subset who endorsed zero ADHD items from the factor analysis. Although concurrent validity was relatively weak, decomposition showed that this was due to low validity of adolescent reports. A modified CIDI diagnosis based exclusively on parent reports generated a diagnosis that had good concordance with clinical diagnoses [area under the curve (AUC) = 0.78]. Implications for assessing ADHD using the CIDI and the effect of different informants on measurement are discussed. Copyright © 2010 John Wiley & Sons, Ltd.

Keywords: attention deficit hyperactivity disorder, WHO Composite International Diagnostic Interview (CIDI), validity, National Comorbidity Survey Replication Adolescent Supplement (NCS‐A)

Full Text

The Full Text of this article is available as a PDF (194.2 KB).

REFERENCES

  1. Amador‐Campos J.A., Forns‐Santacana M., Guàrdia‐Olmos J., Peró‐Cebollero M. (2006) DSM‐IV Attention Deficit Hyperactivity Disorder symptoms: Agreement between informants in prevalence and factor structure at different ages. Journal of Psychopathology and Behavior Assessment, 28, 23–32, DOI: 10.1007/s10862‐006‐4538‐x [Google Scholar]
  2. American Academy of Pediatrics . (2000) Clinical practice guideline: Diagnosis and evaluation of the child with attention‐deficit/hyperactivity disorder. Pediatrics 105, 1158–1170. [DOI] [PubMed] [Google Scholar]
  3. American Psychiatric Association . (2000) Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision, American Psychiatric Association. [Google Scholar]
  4. Cohen J. (1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46. [Google Scholar]
  5. Collett B.R., Ohan J.L., Myers K.M. (2003) Ten‐year review of rating scales. V: Scales assessing attention‐deficit/hyperactivity disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 1015–1037, DOI: 10.1097/01.chi.0000081821.25107.e7 [DOI] [PubMed] [Google Scholar]
  6. Conners C.K., Epstein J.N., Angold A., Klaric J. (2003) Continuous performance test performance in a normative epidemiological sample. Journal of Abnormal Child Psychology, 31, 555–562, DOI: 10.1023/A:1025457300409 [DOI] [PubMed] [Google Scholar]
  7. Dempster A.P., Laird N.M., Rubin D.B. (1977) Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39, 1–38. [Google Scholar]
  8. DuPaul G.J., Anastopoulos A.D., Power T.J., Reid R., Ikeda M.J., McGoey K.E. (1998) Parent ratings of attention‐deficit/hyperactivity disorder symptoms: Factor structure and normative data. Journal of Psychopathology and Behavior Assessment, 20, 83–102. [Google Scholar]
  9. Epstein J.N., Erkanli A., Conners C.K., Klaric J., Costello J.E., Angold A. (2003) Relations between Continuous Performance Test performance measures and ADHD behaviors. Journal of Abnormal Child Psychology, 31, 543–554, DOI: 10.1023/A:1025405216339 [DOI] [PubMed] [Google Scholar]
  10. Ezpeleta L., de la Osa N., Domenech J.M., Navarro J.B., Losilla J.M. (1997) Diagnostic agreement between clinicians and the Diagnostic Interview for Children and Adolescents – DICA‐R – in an outpatient sample. Journal of Child Psychology and Psychiatry, 38, 431–440, DOI: 10.1111/j.1469‐7610.1997.tb01528.x [DOI] [PubMed] [Google Scholar]
  11. Finkelman M., Green J.G., Gruber M., Zaslavsky A.M. (Submitted for publication) A zero‐ and k‐inflated mixture model for health questionnaire data. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Furman L. (2005) What is attention‐deficit hyperactivity disorder (ADHD)? Journal of Child Neurology, 20, 994–1002. [DOI] [PubMed] [Google Scholar]
  13. Glutting J.J., Youngstrom E.A., Watkins M.W. (2005) ADHD and college students: Exploratory and confirmatory factor structures with student and parent data. Psychological Assessment, 17, 44–55, DOI: 10.1037/1040‐3590.17.1.44 [DOI] [PubMed] [Google Scholar]
  14. Gomez R., Burns G.L., Walsh J.A., de Moura M.A. (2003) A multitrait‐multisource confirmatory factor analytic approach to the construct validity of ADHD rating scales. Psychological Assessment, 15, 3–16, DOI: 10.1037/1040‐3590.15.1.3 [DOI] [PubMed] [Google Scholar]
  15. Hambleton R.K., Swaminathan H., Rogers H.J. (1991) Fundamentals of Item Response Theory, Sage Publications. [Google Scholar]
  16. Hanley J.A., McNeil B.J. (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29–36. [DOI] [PubMed] [Google Scholar]
  17. Hartung C.M., McCarthy D.M., Milich R., Martin C.A. (2005) Parent–adolescent agreement on disruptive behavior symptoms: A multitrait‐multimethod model. Journal of Psychopathology and Behavior Assessment, 27, 159–168. [Google Scholar]
  18. Hoff K.E., Doepke K., Landau S. (2002) Best practices in the assessment of children with Attention Deficit/ Hyperactivity Disorder: Linking assessment to intervention In: Best Practices in School Psychology IV (eds Thomas A., Grimes J.), Volume 2, pp. 1129–1150, National Association of School Psychologists. [Google Scholar]
  19. Kaufman J., Birmaher B., Brent D., Rao U., Flynn C., Moreci P., Williamson D., Ryan N. (1997) Schedule for Affective Disorders and Schizophrenia for School‐Age Children‐Present and Lifetime Version (K‐SADS‐PL): Initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 980–988. [DOI] [PubMed] [Google Scholar]
  20. Kendler K.S., Neale M.C., Kessler R.C., Heath A.C., Eaves L.J. (1992) A population‐based twin study of major depression in women. The impact of varying definitions of illness. Archives of General Psychiatry, 49, 257–266. [DOI] [PubMed] [Google Scholar]
  21. Kessler R.C., Avenevoli S., Costello E.J., Green J.G., Gruber M.J., Heeringa S., Merikangas K.R., Pennell B.‐E., Sampson N.A., Zaslavsky A.M. (2009a) National Comorbidity Survey Replication Adolescent Supplement: II. Overview and design. Journal of the American Academy of Child and Adolescent Psychiatry. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Kessler R.C., Avenevoli S., Costello E.J., Green J.G., Gruber M.J., Heeringa S., Merikangas K.R., Pennell B.‐E., Sampson N.A., Zaslavsky A.M. (2009b) Design and field procedures in the US National Comorbidity Survey Replication Adolescent Supplement (NCS‐A). International Journal of Methods in Psychiatric Research, 18, 69–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Kessler R.C., Avenevoli S., Green J., Gruber M.J., Guyer M., He Y., Jin R., Kaufman J., Sampson N.A., Zaslavsky A.M., Merikangas K.R. (2009c) National Comorbidity Survey Replication Adolescent Supplement: III. Concordance of DSM‐IV/CIDI Diagnoses with clinical reassessments. Journal of the American Academy of Child and Adolescent Psychiatry, 48, 386–399. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Kessler R.C., Merikangas K.R. (2004) The National Comorbidity Survey Replication (NCS‐R): Background and aims. International Journal of Methods in Psychiatric Research, 13, 60–68. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Kessler R.C., Ustun T.B. (2004) The World Mental Health (WMH) Survey Initiative Version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). International Journal of Methods in Psychiatric Research, 13, 93–121. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Kraemer H.C., Morgan G.A., Leech N.L., Gliner J.A., Vaske J.J., Harmon R.J. (2003) Measures of clinical significance. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 1524–1529, DOI: 10.1097/01.chi.0000091507.46853.d1 [DOI] [PubMed] [Google Scholar]
  27. LeFever G.B., Dawson K.V., Morrow A.L. (1999) The extent of drug therapy for attention deficit‐hyperactivity disorder among children in public schools. American Journal of Public Health, 89, 1359–1364. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Merikangas K.R., Avenevoli S., Costello E.J., Koretz D., Kessler R.C. (2009) National Comorbidity Survey Replication Adolescent Supplement: I. Background and measures. Journal of the American Academy of Child and Adolescent Psychiatry, 48, 367–369. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Pelham W.E. Jr, Fabiano G.A., Massetti G.M. (2005) Evidence‐based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 449–476. [DOI] [PubMed] [Google Scholar]
  30. Pliszka S. (2007) Practice parameter for the assessment and treatment of children and adolescents with attention‐deficit/hyperactivity disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 894–921. [DOI] [PubMed] [Google Scholar]
  31. Research Triangle Institute . (2005) SUDAAN: Professional Software for Survey Data Analysis, version 9.0.1, Research Triangle Institute. [Google Scholar]
  32. Rohde L.A., Biederman J., Knijnik M.P., Ketzer C., Chachamovich E., Vieria G.M., Pinzon V. (1999) Exploring different information sources for DSM‐IV ADHD diagnoses in Brazilian adolescents. Journal of Attention Disorders, 3, 91–96, DOI: 10.1177/108705479900300203. [Google Scholar]
  33. Rohde P., Lewinsohn P.M., Seeley J.R. (1997) Comparability of telephone and face‐to‐face interviews in assessing axis I and II disorders. American Journal of Psychiatry, 154, 1593–1598. [DOI] [PubMed] [Google Scholar]
  34. Rubin D.B. (1981) The Bayesian bootstrap. The Annals of Statistics, 9, 13–134 [Google Scholar]
  35. Rubio‐Stipec M., Canino G.J., Shrout P., Dulcan M., Freeman D., Bravo M. (1994) Psychometric properties of parents and children as informants in child psychiatry epidemiology with the Spanish Diagnostic Interview Schedule for Children (DISC.2). Journal of Abnormal Child Psychology, 22, 703–720. [DOI] [PubMed] [Google Scholar]
  36. SAS Institute . (2002) SAS 9.1.3 Help and Documentation, SAS Publishing. [Google Scholar]
  37. Schwab‐Stone M.E., Shaffer D., Dulcan M.K., Jensen P.S., Fisher P., Bird H.R., Goodman S.H., Lahey B.B., Lichtman J.H., Canino G., Rubio‐Stipec M., Rae D.S. (1996) Criterion validity of the NIMH Diagnostic Interview Schedule for Children Version 2.3 (DISC‐2.3). Journal of the American Academy of Child and Adolescent Psychiatry, 35, 878–888. [DOI] [PubMed] [Google Scholar]
  38. Sciutto M.J., Eisenberg M. (2007) Evaluating the evidence for and against the overdiagnosis of ADHD. Journal of Attention Disorders, 11, 106–113. [DOI] [PubMed] [Google Scholar]
  39. Sobin E., Weissman M.M., Goldstein R.B., Adams P. (1993) Diagnostic interviewing for family studies: Comparing telephone and face‐to‐face methods for the diagnosis of lifetime psychiatric disorders. Psychiatric Genetics, 3, 227–233. [Google Scholar]
  40. Willcutt E.G., Pennington B.F., Chhabildas N.A., Friedman M.C., Alexander J. (1999) Psychiatric comorbidity associated with DSM‐IV ADHD in a nonreferred sample of twins. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1355–1362. [DOI] [PubMed] [Google Scholar]
  41. Zucker M., Morris M.K., Ingram S.M., Morris R.D., Bakeman R. (2002) Concordance of self‐ and informant ratings of adults' current and childhood attention‐deficit/hyperactivity disorder symptoms. Psychological Assessment, 14, 379–389. [DOI] [PubMed] [Google Scholar]

Articles from International Journal of Methods in Psychiatric Research are provided here courtesy of Wiley

RESOURCES