Skip to main content
PMC home page
International Journal of Methods in Psychiatric Research logoLink to International Journal of Methods in Psychiatric Research
. 2006 Mar 24;13(1):10–23. doi: 10.1002/mpr.160

A longitudinal evaluation of two‐year outcome in a community‐based mental health service using graphical chain models

The South‐Verona Outcome Project 9

Mirella Ruggeri 1,✉, Giulia Bisoffi 1, Antonio Lasalvia 1, Francesco Amaddeo 1, Chiara Bonetto 1, Annibale Biggeri 2
PMCID: PMC6878300  PMID: 15181483

Abstract

The 2‐year outcome of 178 patients attending a community‐based mental health service was assessed from a multidimensional perspective. The study investigated: (1) the effect of disease‐related characteristics (such as diagnosis and illness duration) and of a series of outcome variables measured at baseline (global functioning, psychopathology, social disability, quality of life and satisfaction with services) on total costs of care over 2 years; and (2) the effect of costs of care and outcome variables measured at baseline on the corresponding outcome variables at 2 years.

To gain insight into the multivariate longitudinal dependencies among variables, we used graphical Gaussian chain models, a new multivariate method that analyses the relationship between continuous variables taking into account the effect of antecedent and intervening variables, to reveal not only direct but also indirect correlations.

Outcome variables showed the tendency to segregate, both at baseline and follow‐up, into two distinct groups: a clinician‐rated dimension (given by global functioning, social disability and psychopathology) and a patient‐rated dimension (given by service satisfaction and subjective quality of life). Higher costs at 2 years were predicted by higher psychopathology at baseline, diagnosis of psychosis and longer duration of illness. Baseline values for each variable were the main predictors of the corresponding values at two years. Improvement in satisfaction with life at follow‐up was experienced in those subjects with a lower functioning at baseline. This study throws some light on the complex relationships between clinical, social and economic variables affecting the medium‐term outcome of mental health care. Copyright © 2004 Whurr Publishers Ltd.

Keywords: community mental health services, outcome evaluation, longitudinal studies, multivariate analyses

Full Text

The Full Text of this article is available as a PDF (693.2 KB).

References

  1. Amaddeo F, Beecham J, Bonizzato P, Fenjo A, Knapp MJ, Tansella M. The use of a case register to evaluate the costs of psychiatric care. Acta Psychiatr Scand 1997a; 95: 189–98. [DOI] [PubMed] [Google Scholar]
  2. Amaddeo F, Beecham J, Bonizzato P, Fenyo A, Tansella M, Knapp M. The costs of community‐based psychiatric care for first‐ever patients. A case register study. Psychol Med 1998; 28: 173–83. [DOI] [PubMed] [Google Scholar]
  3. Amaddeo F, Bonizzato P, Tansella M. Psychiatric case registers for monitoring service utilization and evaluating its costs In Tansella M. ed Making Rational Mental Health Services. Roma: Il Pensiero Scientifico Editore, 1997b. [DOI] [PubMed] [Google Scholar]
  4. American Psychiatric Association . DSM‐IV. Diagnostic and Statistical Manual of Mental Disorders. 4 edn. Washington DC: APA, 1994. [Google Scholar]
  5. Anthony WA, Rogers ES, Cohen M, Davies RR. Relationships between psychiatric symptomatology, work skills, and future vocational performance. Psychiatr Serv 1995; 46: 353–8. [DOI] [PubMed] [Google Scholar]
  6. Atkinson MJ, Caldwell L. The differential effects of mood on patients' ratings of life quality and satisfaction with their care. J Affect Disord 1997; 44: 169–75. [DOI] [PubMed] [Google Scholar]
  7. Attkisson C, Cook J, Karno M, Lehman A, McGlashan H., Meltzer HJ, O'Connor M, Richardson T, Rosenblatt A, Wells K, Williams J, Hohmann AA. Clinical services research. Schizoph Bull 1992; 18: 561–626. [DOI] [PubMed] [Google Scholar]
  8. Balestrieri M, Bon MG, Rodriguez‐Sacristan A, Tansella M. Pathways to psychiatric care in south‐Verona, Italy. Psychol Med 1994; 24: 641–9. [DOI] [PubMed] [Google Scholar]
  9. Beecham J. Collecting and estimating costs In Knapp M. (ed.) The Economic Evaluation of Mental Health Care. Adelshot: Arena, 1995. [Google Scholar]
  10. Biggeri A, Bisoffi G, Rucci P, Ruggeri M, Tansella M. Graphical models for the multidimensional assessment of outcome In Tansella M, Thornicroft G. (eds) Mental Health Outcome Measures, Second Edition London: Gaskell, Royal College of Psychiatrists, 2001. [Google Scholar]
  11. Bonizzato P, Bisoffi G, Amaddeo F, Chisholm D, Tansella M. Community‐based mental health care: to what extent are service costs associated with clinical, social and service history variables? Psychol Med 2000; 30: 1205–15. [DOI] [PubMed] [Google Scholar]
  12. Cox DR, Wermuth N. Multivariate Dependencies. Models, Analysis and Interpretation. London: Chapman & Hall, 1996. [Google Scholar]
  13. Cox DR, Wermuth N. Tests of linearity, multivariate normality and the adequacy of linear score. Applied Statistic 1994; 43: 347–55. [Google Scholar]
  14. Edwards D. Introduction to Graphical Modelling, 2 edn. New York: Springer‐Verlag, 2000. [Google Scholar]
  15. Endicott J, Spitzer RL, Fleiss JL, Cohen J. The Global Assessment Scale: a procedure for measuring overall severity of psychiatric disturbance. Arch Gen Psychiatry 1976; 33: 766–71. [DOI] [PubMed] [Google Scholar]
  16. Everitt BS. An Introduction to Latent Variable Models. London: Chapman & Hall, 1984. [Google Scholar]
  17. Fahrmeir L, Tutz G. Multivariate Statistical Modelling based on Generalized Linear Models. New York: Springer‐Verlag, 1994. [Google Scholar]
  18. Fakhoury WK, Kaiser W, Roeder‐Wanner UU, Priebe S. (2002). Subjective evaluation: is there more than one criterion? Schizophr Bull 2002; 28: 319–27. [DOI] [PubMed] [Google Scholar]
  19. Hoffmann H, Kupper Z. Relationships between social competence, psychopathology and work performance and their predictive value for vocational rehabilitation of schizophrenic outpatients. Schizophr Res 1997; 23: 69–79. [DOI] [PubMed] [Google Scholar]
  20. Jenkins R. Toward a system of outcome indicators for mental health care. Br J Psychiatry 1990; 157: 500–14. [DOI] [PubMed] [Google Scholar]
  21. Jöreskog KG. Analysis of covariance structure. Scand J Stat 1981; 8: 65–92. [Google Scholar]
  22. Judd LL, Akiskal HS, Zeller PJ, Paulus M, Leon AC, Maser JD, Endicott J, Coryell W, Kunovac JL, Mueller TI, Rice JP, Keller MB. Psychosocial disability during the long‐term course of unipolar major depressive disorder. Arch Gen Psychiatry 2000; 57: 375–80. [DOI] [PubMed] [Google Scholar]
  23. Knudsen HC, Thornicroft M. Mental Health Service Evaluation. Cambridge: Cambridge University Press, 1996. [Google Scholar]
  24. Kreiner S. An informal introduction to graphical modelling In Knudsen HC, Thornicroft G. (eds) Mental Health Service Evaluation. Cambridge: Cambridge University Press, 1996. [Google Scholar]
  25. Lasalvia A, Ruggeri M, Mazzi MA, Dall'Agnola RB. The perception of needs for care in staff and patients in community‐based mental health services. The South‐Verona Outcome Project 3. Acta Psychiatr Scand 2000; 102: 366–75. [DOI] [PubMed] [Google Scholar]
  26. Lasalvia A, Ruggeri M, Dall'Agnola RB. Lancashire Quality of Life Profile In Ruggeri M, Dall'Agnola RB. Come Valutare l'Esito nei Dipartimenti di Salute Mentale. Roma: Il Pensiero Scientifico Editore, 2000. [Google Scholar]
  27. Lasalvia A, Ruggeri M, Santolini N. Subjective quality of life: its relationship with clinician‐rated and patient‐rated psychopathology. The South‐Verona Outcome Project 6. Psychother Psychosom 2002; 71: 275–84. [DOI] [PubMed] [Google Scholar]
  28. Lauritzen SL. Graphical Models. Oxford: Oxford University Press, 1996. [Google Scholar]
  29. Linder‐Pelz S. Social psychological determinants of patient satisfaction: a test of five hypotheses. Soc Sci Med 1982;16:583‐9. [DOI] [PubMed] [Google Scholar]
  30. Links PS, Heslegrave R, Van Reekum R. Prospective follow‐up study of borderline personality disorder: prognosis, prediction of outcome, and Axis II comorbidity. Can J Psychiatry 1998; 43: 265–70. [DOI] [PubMed] [Google Scholar]
  31. Lukoff D, Liberman RP, Nuechterlein KH. Manual for the Expanded Brief Psychiatric Rating Scale. Schizophr Bull 1986; 12: 594–602. [DOI] [PubMed] [Google Scholar]
  32. McCrone P, Thornicroft G, Parkman S, Nathaniel‐James D, Ojurongbe W. Predictors of mental health service costs for representative cases of psychosis in south London. Psychol Med 1998; 28: 159–64. [DOI] [PubMed] [Google Scholar]
  33. Norman RM, Malla AK, Cortese L, Cheng S, Diaz K, McIntosh E, McLean TS, Rickwood A, Voruganti LP. Symptoms and cognition as predictors of community functioning: a prospective analysis. Am J Psychiatry 1999;156: 400–5. [DOI] [PubMed] [Google Scholar]
  34. Oliver JP. The social care directive: development of a quality of life profile for use in community services for the mentally ill. Soc Work Soc Sci Rev 1991; 3: 5–45. [Google Scholar]
  35. Patterson TL, Semple SJ, Shaw WS, Halpain M, Moscona S, Grant I, Jeste DV. Self‐reported social functioning among older patients with schizophrenia. Schizophr Res 1997; 27: 199–210. [DOI] [PubMed] [Google Scholar]
  36. Priebe S, Kaiser W, Huxley PJ, Roder‐Wanner UU, Rudolf H. Do different subjective evaluation criteria reflect distinct constructs? J Nerv Ment Dis 1998; 186: 385–92. [DOI] [PubMed] [Google Scholar]
  37. Robinson DG, Woerner MG, Alvir JM, Geisler S, Koreen A, Sheitman B, Chakos M, Mayerhoff D, Bilder R, Goldman R, Lieberman JA. Predictors of treatment response from a first episode of schizophrenia or schizoaffective disorder. Am J Psychiatry 1999; 156: 544–9. [DOI] [PubMed] [Google Scholar]
  38. Roncone R, Ventura J, Impallomeni M, Falloon IR, Morosini PL, Chiaravalle E, Casacchia M. Reliability of an Italian standardized and expanded Brief Psychiatric Rating Scale (BPRS 4.0) in raters with high vs. low clinical experience. Acta Psychiatr Scand 1999; 100: 229–36. [DOI] [PubMed] [Google Scholar]
  39. Roverato A, Whittaker J. Standard Errors for the Parameters of Graphical Gaussian Models. Technical Report. Department of Mathematics, University of Lancaster (UK), 1993.
  40. Ruggeri M, Dall'Agnola R. The development and use of the Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) for measuring expectations and satisfaction with community‐based psychiatric services in patients, relatives and professionals. Psychol Med 1993; 23: 511–23. [DOI] [PubMed] [Google Scholar]
  41. Ruggeri M, Tansella M. Evaluating outcome in mental health care. Curr Opin Psychiatry 1995; 8: 116–21. [Google Scholar]
  42. Ruggeri M, Biggeri A, Rucci P, Tansella M. Multivariate analysis of outcome of mental health care using graphical chain models. The South‐Verona Outcome Project 1. Psychol Med. 1998a; 28: 1421–31. [DOI] [PubMed] [Google Scholar]
  43. Ruggeri M, Riani M, Rucci P, Biggeri A, Tansella M. Multidimensional assessment of outcome in psychiatry. The use of graphical displays. The South‐Verona Outcome Project 2. Int J Methods Psychiatr Res 1998b; 7: 186–98. [Google Scholar]
  44. Ruggeri M, Bisoffi G, Fontecedro L, Warner R. Subjective and objective dimensions of quality of life in psychiatric patients: a factor analytical approach. The South‐Verona Outcome Project 4. Br J Psychiatry 2001; 178: 268–75. [DOI] [PubMed] [Google Scholar]
  45. Ruggeri M, Gater R, Bisoffi G, Barbui C, Tansella M. Determinants of subjective quality of life in patients attending community‐based mental health services. The South‐Verona Outcome Project 5. Acta Psychiatr Scand. 2002; 105: 131–40. [DOI] [PubMed] [Google Scholar]
  46. Ruggeri M, Pacati P, Goldberg D. Neurotics are dissatisfied with life, but not with services. The South Verona Outcome Project 7. Gen Hosp Psychiatry 2003a; 25: 338–44. [DOI] [PubMed] [Google Scholar]
  47. Ruggeri M, Lasalvia A, Bisoffi G, Thornicroft G, Vazquez‐Barquero JL, Becker T, Knapp M, Knudsen HC, Schene A, Tansella M; EPSILON Study Group . Satisfaction with mental health services among people with schizophrenia in five European sites: results from the EPSILON Study. Schizophr Bull 2003b; 29: 229–45. [DOI] [PubMed] [Google Scholar]
  48. StataCorp. Stata Statistical Software: Release 6.0. Stata Corporation: College Station TX, 1999.
  49. Sytema S, Giel R, Ten Horn GHMM, Balestrieri M. The reliability of diagnostic coding in psychiatric case registers. Psychol Med 1989; 19: 999–1006. [DOI] [PubMed] [Google Scholar]
  50. Tansella M, Amaddeo F, Burti L, Ruggeri M. Community‐based mental health care in Verona, Italy In Goldberg D, Thornicroft G. (eds) Mental Health in our Future Cities Hove: Psychology Press, 1998. [Google Scholar]
  51. Thornicroft G, Tansella M. The Mental Health Matrix. A Manual to Improve Services. Cambridge: Cambridge University Press, 1999. [Google Scholar]
  52. Ventura J, Green M, Shaner A, Liberman R. Training and quality assurance with the Brief Psychiatric Rating Scale: ‘The drift busters’. Int J Methods Psychiatr Res 1993; 3: 221–44. [Google Scholar]
  53. Whittaker J. Graphical Models. Chichester: Wiley, 1990. [Google Scholar]
  54. World Health Organization . The ICD‐10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines. Geneva: WHO, 1992. [Google Scholar]
  55. World Health Organization . Disability Assessment Schedule (DAS‐II). Geneva: WHO, 1988. [Google Scholar]
  56. Zellner A. An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias. J Am Stat Assoc 1962; 57: 348–68. [Google Scholar]

Articles from International Journal of Methods in Psychiatric Research are provided here courtesy of Wiley

RESOURCES