Skip to main content
NCBI home page
International Journal of Methods in Psychiatric Research logoLink to International Journal of Methods in Psychiatric Research
. 2010 Feb 28;19(1):50–62. doi: 10.1002/mpr.305

The validity of the German version of the Health of the Nation Outcome Scales (HoNOS‐D): a clinician‐rating for the differential assessment of the severity of mental disorders

Sylke Andreas 1,✉, Timo Harfst 2, Sven Rabung 1, Robert Mestel 3, Henning Schauenburg 4, Maria Hausberg 1, Stephan Kawski 1, Uwe Koch 1, Holger Schulz 1
PMCID: PMC6878520  PMID: 20191659

Abstract

The Health of the Nation Outcome Scales (HoNOS) is an internationally‐established clinician‐rating instrument for the differential assessment of the severity of patients with mental disorders. The aim of this study was to examine the validity of the German version of the HoNOS (HoNOS‐D). Evaluation of validity, including factor validity, convergent and discriminant validity and sensitivity to change, was conducted on a large, virtually representative, clinical sample of patients with mental disorders in inpatient psychotherapy (Study 1, N = 3169). Additional assessment of criterion‐based validity was completed using another clinical sample of patients with mental disorders (Study 2, N = 55). Although factor validity of the HoNOS‐D and its total score could not be confirmed as expected, the majority of single items of the HoNOS‐D proved to be valid in terms of convergent validity, criterion‐based validity and sensitivity to change. Hence, single items, rather than the total score of the HoNOS‐D, can be recommended for obtaining a picture of the impairment of patients with mental disorders in the clinical setting. Copyright © 2010 John Wiley & Sons, Ltd.

Keywords: HoNOS‐D, validity, mental disorders, outcome

Full Text

The Full Text of this article is available as a PDF (266.5 KB).

REFERENCES

  1. Adams M., Palmer A., O'Brien J.T., Crook W. (2000) Health of the nation outcome scales for psychiatry: Are they valid? Journal of Mental Health, 9, 193–198. [Google Scholar]
  2. American Psychiatric Association . (1994) Diagnostic and Statistical Manual of Mental Disorders, fourth edition, American Psychiatric Association. [Google Scholar]
  3. Andreas S., Harfst T., Dirmaier J., Kawski S., Koch U., Schulz H. (2007) A psychometric evaluation of the German version of the ‘Health of the Nation Outcome Scales, HoNOS‐D’: On the feasibility and reliability of a clinician‐rated measure of severity in patients with mental disorders. Psychopathology, 40, 116–125. [DOI] [PubMed] [Google Scholar]
  4. Andreas S., Rabung S., Horstmann S., Schauenburg H., Harris‐Hedder K., Schwenk W., Koch U., Schulz H. (2009) Ist eine Schulung von Ratern zur differenzierten Beurteilung des Schweregrades bei Patienten mit psychischen Störungen in der Routineversorgung notwendig? [Training of mental health care professionals in routine outcome assessment – necessary or dispensable?] Psychologische Medizin, 20, 117. [Google Scholar]
  5. Audin K., Marginson F.R., Clark J.M., Barkham M. (2001) Value of HoNOS in assessing patient change in NHS psychotherapy and psychological treatment services. The British Journal of Psychiatry, 178, 561–566. [DOI] [PubMed] [Google Scholar]
  6. Bech P., Bille J., Schutze T., Sondergaard S., Wiese M., Waarst S. (2003) Health of the Nation Outcome Scales (HoNOS): Implementability, subscale structure and responsiveness in the daily psychiatric hospital routine over the first 18 months. Nordic Journal of Psychiatry, 57, 285–290. [DOI] [PubMed] [Google Scholar]
  7. Bech P., Bille J., Waarst S., Wiese M., Borberg L., Treufeldt P., Kessing L. (2006) Validity of HoNOS in identifying frequently hospitalized patients with ICD‐10 mental disorders. Acta Psychiatrica Scandinavica, 113, 485–491. [DOI] [PubMed] [Google Scholar]
  8. Beck A.T., Ward C.H., Mendelson M., Mock J.E., Erbaugh J.T. (1961) An inventory for measuring depression. Archives of General Psychiatry, 4, 561–571. [DOI] [PubMed] [Google Scholar]
  9. Bentler P.M. (1990) Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. [DOI] [PubMed] [Google Scholar]
  10. Bentler P.M. (1995) EQS: A Structural Equations Program Manual, Multivariate Software, Inc. [Google Scholar]
  11. Bentler P.M., Wu E. (2004) EQS 6.1 for Windows, Multivariate Software Inc. [Google Scholar]
  12. Brooks R. (2000) The reliability and validity of the Health of the Nation Outcome Scales: Validation in relation to patient derived measures. Australian and New Zealand Journal of Psychiatry, 34, 504–511. [DOI] [PubMed] [Google Scholar]
  13. Browne S., Doran M., McGauran S. (2000) Health of the Nation Outcome Scales (HoNOS): Use in an Irish psychiatric outpatient population. Irish Journal of Psychological Medicine, 17, 17–19. [Google Scholar]
  14. Cohen J. (1988) Statistical Power and Analysis for the Behavioral Sciences, second edition, Lawrence. [Google Scholar]
  15. Derogatis L. (1983) SCL‐90‐R, Administration, Scoring & Procedures Manual for the R(evised) Version, Clinic Psychometric Research. [Google Scholar]
  16. Derogatis L. (ed.). (1977) SCL‐90‐R, Administration, Scoring & Procedures Manual‐I for the R(evised) Version, John Hopkins University School Medicine. [Google Scholar]
  17. Eagar K., Trauer T., Mellsop G. (2005) Performance of routine outcome measures in adult mental health care. Australian and New Zealand Journal of Psychiatry, 39, 713–718. [DOI] [PubMed] [Google Scholar]
  18. Ecob R., Croudace T.J., White I.R., Evans J.E., Harrison G.L., Sharp D., Jones P.B. (2004) Multilevel investigation of variation in HoNOS ratings by mental health professionals: a naturalistic study of consecutive referrals. International Journal of Methods in Psychiatric Research, 13, 152–164. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Endicott J., Spitzer R.L., Fleiss J.L., Cohen J. (1976) The Global Assessment Scale: A procedure for measuring overall severity of psychiatry disturbance. Archives of General Psychiatry, 33, 766–771. [DOI] [PubMed] [Google Scholar]
  20. Fleiss J.L., Cohen J. (1973) The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613–619. [Google Scholar]
  21. Fydrich T., Schmitz B., Bodem M. (1995) SKID‐II. Strukturiertes Klinisches Interview für DSM‐IV, Achse II [Structured Clinical Interview for DSM‐IV Personality Disorders, (SCID‐II) German version], Beltz‐Test. [Google Scholar]
  22. Gigantesco A., Picardi A., de Girolamo G., Morosini P. (2007) Discriminant ability and criterion validity of the HoNOS in Italian psychiatric residential facilities. Psychopathology, 40, 111–115. [DOI] [PubMed] [Google Scholar]
  23. Harfst T., Dirmaier J., Koch U., Schulz H. (2004) Entwicklung und psychometrische Überprüfung einer multidimensionalen Kurzform des Inventars zur Erfassung interpersonaler Probleme [Development and evaluation of a short version of the Inventory of Interpersonal Problems]. DRV‐Schriften, 52, 53–55. [Google Scholar]
  24. Harfst T., Koch U., von Aschoff Kurtz C., Nutzinger D.O., Rüddel H., Schulz H. (2002). Entwicklung und Validierung einer Kurzform der Symptom Checklist‐90‐R [Development and evaluation of a short version of the Symptom Checklist‐90‐R]. DRV‐Schriften, 33, 71–73. [Google Scholar]
  25. Hautzinger M., Bailer M., Worrall H., Keller F. (1995) Das Beck Depressionsinventar (BDI) [Beck Depression Inventory – German version], Huber. [Google Scholar]
  26. Holm S. (1979) A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65–70. [Google Scholar]
  27. Horowitz L.M., Rosenberg S.E., Baer B.A., Ureño G., Villaseñor V.S. (1988) Inventory of Interpersonal Problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56, 885–892. [DOI] [PubMed] [Google Scholar]
  28. Hu L., Bentler P.M. (1999) Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. [Google Scholar]
  29. Ilgen M.A., Quyen T., Finney J.W., Harris A.H. (2005) Recent suicide attempt and the effectiveness of inpatient and outpatient substance use disorder treatment. Alcoholism, Clinical and Experimental Research, 29, 1664–1671. [DOI] [PubMed] [Google Scholar]
  30. Kazis L.E., Anderson J.J., Meenan R.F. (1989) Effect sizes for interpreting changes in health status. Medical Care, 27(3 Suppl), S178–S189. [DOI] [PubMed] [Google Scholar]
  31. Kisely S., Campbell L.A., Crossman D., Gleich S., Campbell J. (2007) Are the Health of the Nation Outcome Scales a valid and practical instrument to measure outcomes in North America? A three‐site evaluation across Nova Scotia. Community Mental Health Journal, 43, 91–107. [DOI] [PubMed] [Google Scholar]
  32. Lauzon S., Corbiere M., Bonin J.P., Bonsack C., Lesage A.D., Ricard N. (2001) [Validation of the French version of the Health of the Nation Outcome Scales (HoNOS‐F)]. Canadian Journal of Psychiatry, 46, 841–846. [DOI] [PubMed] [Google Scholar]
  33. Lora A., Bai G., Bianchi S., Bolongaro G., Civenti G., Erlicher A., Maresca G., Monzani E., Panetta B., von Morgen B., Rossi F., Torri V., Morosini P. (2001) The Italian version of HoNOS (Health of the Nation Outcome Scales), a scale for evaluating the outcome and severity in mental health services. Epidemiologia e psichiatria sociale, 10, 198–212. [Google Scholar]
  34. Margraf J. (1994) Mini‐DIPS: Diagnostisches Kurz‐Interview bei psychischen Störungen [Mini‐DIPS: Short Diagnostic Interview for Mental Disorders], Springer. [Google Scholar]
  35. McClelland R., Trimble P., Fox M.L., Stevenson M.R., Bell B. (2000) Validation of an outcome scale for use in adult psychiatric practice. Quality in Health Care, 9, 98–105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Orrell M., Yard P., Handysides J., Schapira R. (1999) Validity and reliability of the Health of the Nation Outcome Scales in psychiatric patients in the community. British Journal of Psychiatry, 174, 409–412. [DOI] [PubMed] [Google Scholar]
  37. Overall J.E., Gorham D.R. (1976) BPRS. Brief Psychiatric Rating Scale In: ECDEU Assessment Manual for Psychopharmacology (ed. Guy W.), pp. 157–169, National Institute of Mental Health. [Google Scholar]
  38. Page A.C., Hooke G.R., Rutherford E.M. (2001) Measuring mental health outcomes in a private psychiatric clinic: Health of the Nation Outcome Scales and Medical Outcomes Short Form SF‐36. Australian and New Zealand Journal of Psychiatry, 35, 377–381. [DOI] [PubMed] [Google Scholar]
  39. Parker G., O'Donnell M., Hadzi‐Pavlovic D., Proberts M. (2002) Assessing outcome in community mental health patients: A comparative analysis of measures. International Journal of Social Psychiatry, 48, 11–19. [DOI] [PubMed] [Google Scholar]
  40. Pirkis J.E., Burgess P.M., Kirk P.K., Dodson S., Coombs T., Williamson M.K. (2005) A review of the psychometric properties of the Health of the Nation Outcome Scales (HoNOS) family of measures. Health and Quality of Life Outcomes, 3, 1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Rock D., Preston N. (2001) HoNOS: Is there any point in training clinicians? Journal of Psychiatric and Mental Health Nursing, 8, 405–409. [DOI] [PubMed] [Google Scholar]
  42. Schepank H. (1995) Der Beeinträchtigungs‐Schwere‐Score (BSS) [Degree of Impairment Score – German version], Beltz Test. [Google Scholar]
  43. Schepank H. (2002) BSS: Der Beeinträchtigungs‐Schwere‐Score [Degree of impairment score – German version]. In: Diagnostische Verfahren in der Psychotherapie (eds Brähler E, Strauß B.), pp. 68–72, Hogrefe‐Verlag. [Google Scholar]
  44. Schulz H., Harfst T., Andreas S., Kawski S., Koch U., Rabung, S. (2009) Zusammenhang zwischen Patienten‐ und Therapeuteneinschätzungen der Ergebnisqualität in der Rehabilitation von Patienten mit psychischen/psychosomatischen Erkrankungen am Beispiel des SF‐8. [Relationship between patient and clinician rated outcome measures of patients with mental disorders]. Rehabilitation, 48, 270–276. [DOI] [PubMed] [Google Scholar]
  45. Slade M. (2002) Routine outcome assessment in mental health services. Psychological Medicine, 32, 1339–1343. [DOI] [PubMed] [Google Scholar]
  46. SPSS . (2001) SPSS Version 15.0 for Windows, SPSS.
  47. Steiger J.H. (1990) Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180. [DOI] [PubMed] [Google Scholar]
  48. Trauer T. (1999) The subscale structure of the Health of the Nation Outcome Scales (HoNOS). Journal of Mental Health, 8, 499–509. [Google Scholar]
  49. Trauer T., Callaly T., Hantz P., Little J., Shields R., Smith J. (1999) Health of the Nation Outcome Scales: Results of the Victorian field trial. British Journal of Psychiatry, 174, 380–388. [DOI] [PubMed] [Google Scholar]
  50. Ware J.E., Kosinski M., Dewey J.E., Gandek B. (2000) How to Score and Interpret Single‐item Health Status Measures: A Manual for Users of the SF‐8 Health Survey, Quality Metric. [Google Scholar]
  51. World Health Organization (WHO) . (1992) The ICD‐10 Classification of Mental and Behavioural Disorders. Clinical Descriptions and Diagnostic Guidelines, WHO. [Google Scholar]
  52. Wing J.K., Beevor A.S., Curtis R.H., Park S.B., Hadden S., Burns A. (1998) Health of the Nation Outcome Scales (HoNOS): Research and development. British Journal of Psychiatry, 172, 11–18. [DOI] [PubMed] [Google Scholar]

Articles from International Journal of Methods in Psychiatric Research are provided here courtesy of Wiley

RESOURCES