Skip to main content
PMC home page
International Journal of Methods in Psychiatric Research logoLink to International Journal of Methods in Psychiatric Research
. 2006 Aug 21;15(3):131–138. doi: 10.1002/mpr.189

Interrater reliability of the Psychiatric Research Interview for Substance and Mental Disorders in an HIV‐infected cohort: experience of the National NeuroAIDS Tissue Consortium

S Morgello 1,✉, CE Holzer III 2, E Ryan 1, C Young 3, M Naseer 1, SA Castellon 4, AB Frol 5, J Hampton Atkinson 3, BB Gelman 2, I Grant 6, EJ Singer 4
PMCID: PMC6878302  PMID: 17019897

Abstract

The interrater reliability of the Psychiatric Research Interview for Substance and Mental Disorders (PRISM) was assessed in a multicentre study. Four sites of the National NeuroAIDS Tissue Consortium performed blinded reratings of audiotaped PRISM interviews of 63 HIV‐infected patients. Diagnostic modules for substance‐use disorders and major depression were evaluated. Seventy‐six per cent of the patient sample displayed one or more substance‐use disorder diagnoses and 54% had major depression. Kappa coefficients for lifetime histories of substance abuse or dependence (cocaine, opiates, alcohol, cannabis, sedative, stimulant, hallucinogen) and major depression ranged from 0.66 to 1.00. Overall the PRISM was reliable in assessing both past and current disorders except for current cannabis disorders when patients had concomitant cannabinoid prescriptions for medical therapy. The reliability of substance‐induced depression was poor to fair although there was a low prevalence of this diagnosis in our group. We conclude that the PRISM yields reliable diagnoses in a multicentre study of substance‐experienced, HIV‐infected individuals. Copyright © 2006 John Wiley & Sons, Ltd.

Keywords: interrater reliability, PRISM, HIV

Full Text

The Full Text of this article is available as a PDF (136.1 KB).

REFERENCES

  1. Atkinson JH Jr, Grant I, Kennedy CJ, Richman DD, Spector SA, McCutchan JA. Prevalence of psychiatric disorders among men infected with human immunodeficiency virus. A controlled study. Arch Gen Psychiatr 1988; 45(9): 859–64. [DOI] [PubMed] [Google Scholar]
  2. Berney A, Preisig M, Matthey ML, Ferrero F, Fenton BT. Diagnostic interview for genetic studies (DIGS): inter‐rater and test‐retest reliability of alcohol and drug diagnoses. Drug Alcohol Depend 2002; 65(2): 149–58. [DOI] [PubMed] [Google Scholar]
  3. Bing EG, Burnam MA, Longshore D, Fleishman JA, Sherbourne CD, London AS, Turner BJ, Eggan F, Beckman R, Vitiello B, Morton SC, Orlando M, Bozzette SA, Ortiz‐Barron L, Shapiro M. Psychiatric disorders and drug use among human immunodeficiency virus‐infected adults in the United States. Arc Gen Psychiatr 2001; 58(8): 721–8. [DOI] [PubMed] [Google Scholar]
  4. Chuang HT, Jason GW, Pajurkova EM, Gill MJ. Psychiatric morbidity in patients with HIV infection. Can J Psychiatr 1992; 37: 109–15. [DOI] [PubMed] [Google Scholar]
  5. Clarke DM, Smith GC, Herrman HE, McKenzie DP. Monash Interview for Liason Psychiatry (MILP). Development, reliability, and procedural validity. Psychosomatics 1998; 39(4): 318–28. [DOI] [PubMed] [Google Scholar]
  6. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas 1960; 20: 37–46. [Google Scholar]
  7. Hasin D, Trautman K, Miele G, Samet S, Smith M, Psychiatric Endicott J. Research Interview for Substance and Mental Disorders (PRISM): reliability for substance abusers. Am J Psychiatr 1996; 153: 1195–201. [DOI] [PubMed] [Google Scholar]
  8. Helzer JE, Clayton PJ, Pambakian R, Reich T, Woodruff RA Jr, Reveley MA. Reliability of psychiatric diagnosis. II. The test/retest reliability of diagnostic classification. Arch Gen Psychiatr 1977; 34(2): 136–41. [DOI] [PubMed] [Google Scholar]
  9. Hesselbrock M, Easton C, Bucholz KK, Schuckit M, Hesselbrock V. A validity study of the SSAGA – a comparison with the SCAN. Addiction 1999; 94(9): 1361–70. [DOI] [PubMed] [Google Scholar]
  10. Holzer CE, Nguyen HT, Hirschfeld RM. Reliability of Diagnoses in Mood Disorders. Psychiatr Clin N Am 1996; 19(1): 73–84. [DOI] [PubMed] [Google Scholar]
  11. Keller MB, Klein DN, Hirschfeld RM, Kocsis JH, McCullough JP, Miller I, First MB, Holzer CP 3rd, Keitner GI, Marin DB, Shea T. Results of the DSM‐IV mood disorders field trial. Am J Psychiatr 1995; 152(6): 843–9. [DOI] [PubMed] [Google Scholar]
  12. Lipsitz JD, Williams JB, Rabkin JG, Remien RH, Bradbury M, el Sadr W, Goetz R, Sorrell S, Gorman JM. Psychopathology in male and female intravenous drug users with and without HIV infection. Am J Psychiatr 1994; 151: 1662–8. [DOI] [PubMed] [Google Scholar]
  13. Lyketsos CG, Hoover DR, Guccione M, Dew MA, Wesch JE, Bing EG, Treisman GJ. Changes in depressive symptoms as AIDS develops. The Multicenter AIDS Cohort Study. Am J Psychiatr 1996; 153(11): 1430–7. [DOI] [PubMed] [Google Scholar]
  14. Maj M, Janssen R, Starace F, Zaudig M, Satz P, Sughondhabirom B, Luabeya M, Riedel R, Ndetei D, Calil H, Bing E, St Louis M, Sartorius N. WHO neuropsychiatric AIDS study, cross‐sectional phase I: study design and psychiatric findings. Arch Gen Psychiatr 1994; 51: 39–49. [DOI] [PubMed] [Google Scholar]
  15. Martin CS, Pollock NK, Bukstein OG, Lynch KG. Inter‐rater reliability of the SCID alcohol and substance‐use disorders section among adolescents. Drug Alcohol Depend 2000; 59(2): 173–6. [DOI] [PubMed] [Google Scholar]
  16. Miele GM, Carpenter KM, Smith Cockerham M, Dietz Trautman K, Blaine J, Hasin DS. Concurrent and predictive validity of the Substance Dependence Severity Scale (SDSS). Drug Alcohol Depend 2000; 59(1): 77–88. [DOI] [PubMed] [Google Scholar]
  17. Morgello S, Gelman BB, Kozlowski PB, Vinters HV, Masliah E, Cornford M, Cavert W, Marra C, Grant I, Singer EJ. The National NeuroAIDS Tissue Consortium: a new paradigm in brain banking with an emphasis on infectious disease. Neuropathol Appl Neurobiol 2001; 27(4): 326–35. [DOI] [PubMed] [Google Scholar]
  18. Morrison MF, Petitto JM, Ten Have T, Gettes DR, Chiappini MS, Weber AL, Brinker‐Spence P, Bauer RM, Douglas SD, Evans DL. Depressive and anxiety disorders in women with HIV infection. Am J Psychiatr 2002; 159(5): 789–96. [DOI] [PubMed] [Google Scholar]
  19. Perkins D, Stern R, Golden R, Murphy C, Naftolowitz D, Evans D. Mood disorders in HIV infection: prevalence and risk factors in a nonepicenter of the AIDS epidemic. Am J Psychiatr 1994; 151: 233–6. [DOI] [PubMed] [Google Scholar]
  20. Rabkin JG, Ferrando SJ, Jacobsberg LB, Fishman B. Prevalence of axis I disorders in an AIDS cohort: a cross‐sectional, controlled study. Compr Psychiatr 1997a; 38(3): 146–54. [DOI] [PubMed] [Google Scholar]
  21. Rabkin JG, Goetz RR, Remien RH, Williams JB, Todak G, Gorman JM. Stability of mood despite HIV illness progression in a group of homosexual men. Am J Psychiatr 1997b; 154: 231–8. [DOI] [PubMed] [Google Scholar]
  22. Rabkin JG, Johnson J, Lin SH, Lipsitz JD, Remien RH, Williams JB, Gorman JM. Psychopathology in male and female HIV‐positive and negative injecting drug users: longitudinal course over 3 years. AIDS 1997c; 11: 507–15. [DOI] [PubMed] [Google Scholar]
  23. Rosenberger PH, Bornstein RA, Nasrallah HA, Para MF, Whitaker CC, Fass RJ, Rice RR Jr. Psychopathology in HIV infection: lifetime and current assessment. Compr Psychiatr 1993; 34(3): 150–8 [DOI] [PubMed] [Google Scholar]
  24. Skre I, Onstad S, Torgersen S, Kringlen E. High interrater reliability for the Structured Clinical Interview for DSM‐III‐R Axis I (SCID‐I). Acta Psychiatr Scand 1991; 84(2): 167–73. [DOI] [PubMed] [Google Scholar]
  25. Ventura J, Liberman RP, Green MF, Shaner A, Mintz J. Training and quality assurance with the Structured Clinical Interview for DSM‐IV (SCID‐I/P). Psychiatr Res 1998; 79(2): 163–73. [DOI] [PubMed] [Google Scholar]
  26. Williams J, Rabkin J, Remien R, Gorman J, Ehrhardt A. Multidisciplinary baseline assessment of homosexual men with and without HIV infection: Standardized clinical assessment of current and lifetime psychopathology. Arch Gen Psychiatr 1991; 48: 124–30. [DOI] [PubMed] [Google Scholar]
  27. Williams JB, Gibbon M, First MB, Spitzer RL, Davies M, Borus J, Howes MJ, Kane J, Pope HG Jr, Rounsaville B, Wittchen HU. The Structured Clinical Interview for DSM‐III‐R (SCID). II. Multisite test‐retest reliability. Arch Gen Psychiatr 1992; 49(8): 630–6. [DOI] [PubMed] [Google Scholar]

Articles from International Journal of Methods in Psychiatric Research are provided here courtesy of Wiley

RESOURCES