Skip to main content
PMC home page
International Journal of Methods in Psychiatric Research logoLink to International Journal of Methods in Psychiatric Research
. 2006 Nov 23;15(4):167–180. doi: 10.1002/mpr.196

Concordance of the Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health Surveys

Josep Maria Haro 1,✉, Saena Arbabzadeh‐Bouchez 2, Traolach S Brugha 3, Giovanni De Girolamo 4, Margaret E Guyer 5, Robert Jin 6, Jean Pierre Lepine 2, Fausto Mazzi 7, Blanca Reneses 8, Gemma Vilagut 9, Nancy A Sampson 6, Ronald C Kessler 6
PMCID: PMC6878271  PMID: 17266013

Abstract

The DSM‐IV diagnoses generated by the fully structured lay‐administered Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) in the WHO World Mental Health (WMH) surveys were compared to diagnoses based on follow‐up interviews with the clinician‐administered non‐patient edition of the Structured Clinical Interview for DSM‐IV (SCID) in probability subsamples of the WMH surveys in France, Italy, Spain, and the US. CIDI cases were oversampled. The clinical reappraisal samples were weighted to adjust for this oversampling. Separate samples were assessed for lifetime and 12‐month prevalence. Moderate to good individual‐level CIDI‐SCID concordance was found for lifetime prevalence estimates of most disorders. The area under the ROC curve (AUC, a measure of classification accuracy that is not influenced by disorder prevalence) was 0.76 for the dichotomous classification of having any of the lifetime DSM‐IV anxiety, mood and substance disorders assessed in the surveys and in the range 0.62–0.93 for individual disorders, with an inter‐quartile range (IQR) of 0.71–0.86. Concordance increased when CIDI symptom‐level data were added to predict SCID diagnoses in logistic regression equations. AUC for individual disorders in these equations was in the range 0.74–0.99, with an IQR of 0.87–0.96. CIDI lifetime prevalence estimates were generally conservative relative to SCID estimates. CIDI‐SCID concordance for 12‐month prevalence estimates could be studied powerfully only for two disorder classes, any anxiety disorder (AUC = 0.88) and any mood disorder (AUC = 0.83). As with lifetime prevalence, 12‐month concordance improved when CIDI symptom‐level data were added to predict SCID diagnoses. CIDI 12‐month prevalence estimates were unbiased relative to SCID estimates. The validity of the CIDI is likely to be under‐estimated in these comparisons due to the fact that the reliability of the SCID diagnoses, which is presumably less than perfect, sets a ceiling on maximum CIDI‐SCID concordance. Copyright © 2006 John Wiley & Sons, Ltd.

Keywords: Composite International Diagnostic Interview (CIDI), validity, WHO World Mental Health (WMH) Survey Initiative

Full Text

The Full Text of this article is available as a PDF (232.9 KB).

REFERENCES

  1. Agresti A (1996) An Introduction to Categorical Data Analysis. New York: John Wiley & Sons. [Google Scholar]
  2. Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, Bryson H, de Girolamo G, Graaf R, Demyttenaere K, Gasquet I, Haro JM, Katz SJ, Kessler RC, Kovess V, Lepine JP, Ormel J, Polidori G, Russo LJ, Vilagut G, Almansa J, Arbabzadeh‐Bouchez S, Autonell J, Bernal M, Buist‐Bouwman MA, Codony M, Domingo‐Salvany A, Ferrer M, Joo SS, Martinez‐Alonso M, Matschinger H, Mazzi F, Morgan Z, Morosini P, Palacin C, Romera B, Taub N, Vollebergh WA (2004) Sampling and methods of the European Study of the Epidemiology of Mental Disorders (ESEMeD) project. Acta Psychiatr Scand Suppl 420: 8–20. [DOI] [PubMed] [Google Scholar]
  3. Andrews G, Peters L, Guzman AM, Bird K (1995) A comparison of two structured diagnostic interviews: CIDI and SCAN. Aust N Z J Psychiatry 29: 124–32. [DOI] [PubMed] [Google Scholar]
  4. Booth BM, Kirchner JE, Hamilton G, Harrell R, Smith GR (1998) Diagnosing depression in the medically ill: validity of a lay‐administered structured diagnostic interview. J Psychiatr Res 32: 353–60. [DOI] [PubMed] [Google Scholar]
  5. Bromet EJ, Dunn LO, Connell MM, Dew MA, Schulberg HC (1986) Long‐term reliability of diagnosing lifetime major depression in a community sample. Arch Gen Psychiatry 43: 435–40. [DOI] [PubMed] [Google Scholar]
  6. Brugha TS (2002) The end of the beginning: a requiem for the categorization of mental disorder? Psychol Med 32: 1149–54. [DOI] [PubMed] [Google Scholar]
  7. Brugha TS, Jenkins R, Taub N, Meltzer H, Bebbington PE (2001) A general population comparison of the Composite International Diagnostic Interview (CIDI) and the Schedules for Clinical Assessment in Neuropsychiatry (SCAN). Psychol Med 31: 1001–13. [DOI] [PubMed] [Google Scholar]
  8. Byrt T, Bishop J, Carlin JB (1993) Bias, prevalence and kappa. J Clin Epidemiol 46: 423–9. [DOI] [PubMed] [Google Scholar]
  9. Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Measur 20: 37–46. [Google Scholar]
  10. Cook RJ (1998) Kappa and its dependence on marginal rates In Armitage P, Colton T. (eds) The Encyclopedia of Biostatistics. New York: Wiley, pp. 2166–8. [Google Scholar]
  11. Demyttenaere K, Bruffaerts R, Posada‐Villa J, Gasquet I, Kovess V, Lepine JP, Angermeyer MC, Bernert S, De Girolamo G, Morosini P, Polidori G, Kikkawa T, Kawakami N, Ono Y, Takeshima T, Uda H, Karam EG, Fayyad JA, Karam AN, Mneimneh ZN, Medina‐Mora ME, Borges G, Lara C, De Graaf R, Ormel J, Gureje O, Shen Y, Huang Y, Zhang M, Alonso J, Haro JM, Vilagut G, Bromet EJ, Gluzman S, Webb C, Kessler RC, Merikangas KR, Anthony JC, Von Korff MR, Wang PS, Brugha TS, Aguilar‐Gaxiola S, Lee S, Heeringa S, Pennell BE, Zaslavsky AM, Ustun TB, Chatterji S (2004) Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. JAMA 291: 2581–90. [DOI] [PubMed] [Google Scholar]
  12. First MB, Spitzer RL, Gibbon M, Williams JBW (2002) Structured Clinical Interview for DSM‐IV Axis I Disorders, Research Version, Non‐patient Edition (SCID‐I/NP) New York: Biometrics Research, New York State Psychiatric Institute. [Google Scholar]
  13. Gibbon M, McDonald‐Scott P, Endicott J (1981) Mastering the art of research interviewing. A model training procedure for diagnostic evaluation. Arch Gen Psychiatry 38: 1259–62. [DOI] [PubMed] [Google Scholar]
  14. Hasin DS, Grant BF (2004) The co‐occurrence of DSM – IV alcohol dependence: results of the National Epidemiologic survey on Alcohol and Related Conditions on heterogeneity that differ by population subgroup. Arch Gen Psychiatry 61: 891–96. [DOI] [PubMed] [Google Scholar]
  15. Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143: 29–36. [DOI] [PubMed] [Google Scholar]
  16. Jordanova V, Wickramesinghe C, Gerada C, Prince M (2004) Validation of two survey diagnostic interviews among primary care attendees: a comparison of CIS‐R and CIDI with SCAN ICD‐10 diagnostic categories. Psychol Med 34: 1013–24. [DOI] [PubMed] [Google Scholar]
  17. Kendler KS, Neale MC, Kessler RC, Heath AC, Eaves LJ (1992) A population‐based twin study of major depression in women. The impact of varying definitions of illness. Arch Gen Psychiatry 49: 257–66. [DOI] [PubMed] [Google Scholar]
  18. Kessler RC, Abelson J, Demler O, Escobar JI, Gibbon M, Guyer ME, Howes MJ, Jin R, Vega WA, Walters EE, Wang P, Zaslavsky A, Zheng H (2004a) Clinical calibration of DSM‐IV diagnoses in the World Mental Health (WMH) version of the World Health Organization (WHO) Composite International Diagnostic Interview (WMHCIDI) Int J Methods Psychiatr Res 13: 122–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Kessler RC, Akiskal HS, Angst J, Guyer M, Hirschfeld RM, Merikangas KR, Stang PE (in press). Validlity of the assessment of bipolar spectrum disorders in the WHO CIDI 30 J Affect Disord. [DOI] [PMC free article] [PubMed]
  20. Kessler RC, Adler L, Barkley R, Biederman J, Conners CK, Demler O, Faraone SV, Greenhill LL, Howes MJ, Secnik K, Spencer T, Ustun TB, Walters EE, Zaslavsky AM (2006) The prevalence and correlates of adult ADHD in the United States: results from the National Comorbidity Survey Replication. Am J Psychiatry 163: 716–23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Kessler RC, Berglund P, Chiu WT, Demler O, Heeringa S, Hiripi E, Jin R, Pennell BE, Walters EE, Zaslavsky A, Zheng H (2004b) The US National Comorbidity Survey Replication (NCS‐R): design and field procedures. Int J Methods Psychiatr Res 13: 69–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Kessler RC, Birnbaum H, Demler O, Falloon IR, Gagnon E, Guyer M, Howes MJ, Kendler KS, Shi L, Walters E, Wu EQ (2005) The prevalence and correlates of nonaffective psychosis in the National Comorbidity Survey Replication (NCS‐R). Biol Psychiatry 58: 668–76. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Kessler RC, Merikangas KR (2004) The National Comorbidity Survey Replication (NCS‐R): background and aims. Int J Methods Psychiatr Res 13: 60–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Kessler RC, Ustun TB (2004) The World Mental Health (WMH) survey initiative version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). Int J Methods Psychiatr Res 13: 93–121. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Kessler RC, Wittchen H‐U, Abelson JM, McGonagle KA, Schwarz N, Kendler KS, Knäuper B, Zhao S (1998) Methodological studies of the Composite International Diagnostic Interview (CIDI) in the US National Comorbidity Survey. Int J Methods Psychiatr Res 7: 33–55. [Google Scholar]
  26. Kish L, Frankel MR (1974) Inferences from complex samples. J Roy Stat Soc 36: 1–37. [Google Scholar]
  27. Kraemer HC, Morgan GA, Leech NL, Gliner JA, Vaske JJ, Harmon RJ (2003) Measures of clinical significance. J Am Acad Child Adolesc Psychiatry 42: 1524–9. [DOI] [PubMed] [Google Scholar]
  28. Kranzler HR, Tennen H, Babor TF, Kadden RM, Rounsaville BJ (1997) Validity of the longitudinal, expert, all data procedure for psychiatric diagnosis in patients with psychoactive substance use disorders. Drug Alcohol Depend 45: 93–104. [DOI] [PubMed] [Google Scholar]
  29. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33: 159–74. [PubMed] [Google Scholar]
  30. Lenzenweger MF, Lane MC, Loranger AW, Kessler RC (in press) DSM‐IV personality disorders in the National Comorbidity Survey Replication. Biol Psychiatry. [DOI] [PMC free article] [PubMed]
  31. Regier DA (2000) Community diagnosis counts. Arch Gen Psychiatry 57: 223–4. [DOI] [PubMed] [Google Scholar]
  32. Rehm J, Ustun TB, Saxena S, Nelson CB, Chatterji S, Ivis F, Adlaf E (1999) On the development and psychometric testing of the WHO screening instrument to assess disablement in the general population. Int J Methods Psychiatr Res 8: 110–23. [Google Scholar]
  33. Rohde P, Lewinsohn PM, Seeley JR (1997) Comparability of telephone and face‐to‐face interviews in assessing axis I and II disorders. Am J Psychiatry 154: 1593–8. [DOI] [PubMed] [Google Scholar]
  34. Rubin DB (1987) Multiple Imputation for Nonresponse in Surveys. New York: John Wiley & Sons. [Google Scholar]
  35. Rush AJ, Gullion CM, Basco MR, Jarrett RB, Trivedi MH (1996) The Inventory of Depressive Symptomatology (IDS): psychometric properties. Psychol Med 26: 477–486. [DOI] [PubMed] [Google Scholar]
  36. Segal DL, Hersen M, Van Hasselt VB (1994) Reliability of the Structured Clinical Interview for DSM‐III‐R: an evaluative review. Compr Psychiatry 35: 316–27. [DOI] [PubMed] [Google Scholar]
  37. Shear MK, Brown TA, Barlow DH, Money R, Sholomskas DE, Woods SW, Gorman JM, Papp LA (1997) Multicenter collaborative panic disorder severity scale. Am J Psychiatry 154: 1571–5. [DOI] [PubMed] [Google Scholar]
  38. Sobin C, Weissman MM, Goldstein RB, Adams P, Wickramaratne PJ, Warner V, Lisch JD (1993) Diagnostic interviewing for family studies: comparing telephone and face‐to‐face methods for the diagnosis of lifetime psychiatric disorders. Psychiatr Genet 3: 227–34. [Google Scholar]
  39. Spitzer RL (1983) Psychiatric diagnosis: are clinicians still necessary? Compr Psychiatry 24: 399–411. [DOI] [PubMed] [Google Scholar]
  40. Spitznagel EL, Helzer JE (1985) A proposed solution to the base rate problem in the kappa statistic. Arch Gen Psychiatry 42: 725–28. [DOI] [PubMed] [Google Scholar]
  41. Williams JB, Gibbon M, First MB, Spitzer RL, Davies M, Borus J, Howes MJ, Kane J, Pope HG, Jr ., Rounsaville B, Wittcher HU. [(1992) The Structured Clinical Interview for DSM‐III‐R (SCID) II. Multisite test‐retest reliability. Arch Gen Psychiatry 49: 630–6. [DOI] [PubMed] [Google Scholar]
  42. Wing JK, Babor T, Brugha T, Burke J, Cooper JE, Giel R, Jablenski A, Regier D, Sartorius N (1990) SCAN. Schedules for Clinical Assessment in Neuropsychiatry. Arch Gen Psychiatry 47: 589–93. [DOI] [PubMed] [Google Scholar]
  43. Wittchen HU (1994) Reliability and validity studies of the WHO–Composite International Diagnostic Interview (CIDI): a critical review. J Psychiatr Res 28: 57–84. [DOI] [PubMed] [Google Scholar]
  44. Wittchen HU, Kessler RC, Zhao S, Abelson J (1995) Reliability and clinical validity of UM‐CIDI DSM‐III‐R generalized anxiety disorder. J Psychiatr Res 29: 95–110. [DOI] [PubMed] [Google Scholar]
  45. Wittchen HU, Zhao S, Abelson JM, Abelson JL, Kessler RC (1996) Reliability and procedural validity of UM‐CIDI DSM‐III‐R phobic disorders. Psychol Med 26: 1169–77. [DOI] [PubMed] [Google Scholar]
  46. Wolter K (1985) Introduction to Variance Estimation. New York: Springer‐Verlag. [Google Scholar]

Articles from International Journal of Methods in Psychiatric Research are provided here courtesy of Wiley

RESOURCES