Skip to main content
NCBI home page
Health Services Research logoLink to Health Services Research
. 1991 Oct;26(4):425–445.

Measuring outcomes of hospital care using multiple risk-adjusted indexes.

S DesHarnais 1, L F McMahon Jr 1, R Wroblewski 1
PMCID: PMC1069835  PMID: 1917500

Abstract

Using existing data sources, we developed three risk-adjusted measures of hospital quality: the risk-adjusted mortality index (RAMI), the risk-adjusted readmissions index (RARI), and the risk-adjusted complication index (RACI). We describe the construction and validation of each of these indexes. After these measures were developed, we tested the relationships among the three indexes using a sample of 300 hospitals. Actual numbers of adverse events were observed for each hospital and compared to the number predicted by the RAMI, RARI, and RACI models. Then each hospital was ranked on each index. Our results showed that no relationship existed between a hospital's ranking on any one of these indexes and its ranking on the other two indexes. This result provides some evidence that no measure of quality should be used by itself to represent different aspects of the quality of hospital care. Adequate overall measures of hospital quality will need to include multiple measures in order to be credible and to reflect the complexity of hospital care. The findings suggest that consumers, payers, and policymakers cannot simply choose one hospitalwide measure, such as the mortality rate, to validly represent a hospital's performance: those hospitals with high rankings on their mortality rates do not necessarily rank high on their readmission rates or complication rates.

Full text

PDF
425

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Adams D. F., Fraser D. B., Abrams H. L. The complications of coronary arteriography. Circulation. 1973 Sep;48(3):609–618. doi: 10.1161/01.cir.48.3.609. [DOI] [PubMed] [Google Scholar]
  2. Anderson G. F., Steinberg E. P. Predicting hospital readmissions in the Medicare population. Inquiry. 1985 Fall;22(3):251–258. [PubMed] [Google Scholar]
  3. Blumberg M. S. Risk adjusting health care outcomes: a methodologic review. Med Care Rev. 1986 Fall;43(2):351–393. doi: 10.1177/107755878604300205. [DOI] [PubMed] [Google Scholar]
  4. Brewster A. C., Karlin B. G., Hyde L. A., Jacobs C. M., Bradbury R. C., Chae Y. M. MEDISGRPS: a clinically based approach to classifying hospital patients at admission. Inquiry. 1985 Winter;22(4):377–387. [PubMed] [Google Scholar]
  5. Caper P. Defining quality in medical care. Health Aff (Millwood) 1988 Spring;7(1):49–61. doi: 10.1377/hlthaff.7.1.49. [DOI] [PubMed] [Google Scholar]
  6. Chilton C. P., Morgan R. J., England H. R., Paris A. M., Blandy J. P. A critical evaluation of the results of transurethral resection of the prostate. Br J Urol. 1978 Dec;50(7):542–546. doi: 10.1111/j.1464-410x.1978.tb06208.x. [DOI] [PubMed] [Google Scholar]
  7. DesHarnais S. I., Chesney J. D., Wroblewski R. T., Fleming S. T., McMahon L. F., Jr The Risk-Adjusted Mortality Index. A new measure of hospital performance. Med Care. 1988 Dec;26(12):1129–1148. doi: 10.1097/00005650-198812000-00004. [DOI] [PubMed] [Google Scholar]
  8. DesHarnais S. I., McMahon L. F., Jr, Wroblewski R. T., Hogan A. J. Measuring hospital performance. The development and validation of risk-adjusted indexes of mortality, readmissions, and complications. Med Care. 1990 Dec;28(12):1127–1141. [PubMed] [Google Scholar]
  9. Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q. 1966 Jul;44(3 Suppl):166–206. [PubMed] [Google Scholar]
  10. Fethke C. C., Smith I. M., Johnson N. "Risk" factors affecting readmission of the elderly into the health care system. Med Care. 1986 May;24(5):429–437. doi: 10.1097/00005650-198605000-00006. [DOI] [PubMed] [Google Scholar]
  11. Flood A. B., Scott W. R., Ewy W., Forrest W. H., Jr Effectiveness in professional organizations: the impact of surgeons and surgical staff organizations on the quality of care in hospitals. Health Serv Res. 1982 Winter;17(4):341–366. [PMC free article] [PubMed] [Google Scholar]
  12. Gonnella J. S., Hornbrook M. C., Louis D. Z. Staging of disease. A case-mix measurement. JAMA. 1984 Feb 3;251(5):637–644. [PubMed] [Google Scholar]
  13. Gooding J., Jette A. M. Hospital readmissions among the elderly. J Am Geriatr Soc. 1985 Sep;33(9):595–601. doi: 10.1111/j.1532-5415.1985.tb06315.x. [DOI] [PubMed] [Google Scholar]
  14. Hebel J. R., Kessler I. I., Mabuchi K., McCarter R. J. Assessment of hospital performance by use of death rates. A recent case history. JAMA. 1982 Dec 17;248(23):3131–3135. [PubMed] [Google Scholar]
  15. Holloway J. J., Thomas J. W., Shapiro L. Clinical and sociodemographic risk factors for readmission of Medicare beneficiaries. Health Care Financ Rev. 1988 Fall;10(1):27–36. [PMC free article] [PubMed] [Google Scholar]
  16. Kelly J. V., Hellinger F. J. Physician and hospital factors associated with mortality of surgical patients. Med Care. 1986 Sep;24(9):785–800. doi: 10.1097/00005650-198609000-00001. [DOI] [PubMed] [Google Scholar]
  17. Knaus W. A., Draper E. A., Wagner D. P., Zimmerman J. E. An evaluation of outcome from intensive care in major medical centers. Ann Intern Med. 1986 Mar;104(3):410–418. doi: 10.7326/0003-4819-104-3-410. [DOI] [PubMed] [Google Scholar]
  18. Knaus W. A., Zimmerman J. E., Wagner D. P., Draper E. A., Lawrence D. E. APACHE-acute physiology and chronic health evaluation: a physiologically based classification system. Crit Care Med. 1981 Aug;9(8):591–597. doi: 10.1097/00003246-198108000-00008. [DOI] [PubMed] [Google Scholar]
  19. Luft H. S., Hunt S. S. Evaluating individual hospital quality through outcome statistics. JAMA. 1986 May 23;255(20):2780–2784. [PubMed] [Google Scholar]
  20. Moses L. E., Mosteller F. Institutional differences in Postoperative death rates. Commentary on some of the findings of the National Halothane Study. JAMA. 1968 Feb 12;203(7):492–494. [PubMed] [Google Scholar]
  21. Riley G., Lubitz J. Outcomes of surgery in the Medicare aged population: rehospitalization after surgery. Health Care Financ Rev. 1986 Fall;8(1):23–34. [PMC free article] [PubMed] [Google Scholar]
  22. Roos L. L., Jr, Cageorge S. M., Austen E., Lohr K. N. Using computers to identify complications after surgery. Am J Public Health. 1985 Nov;75(11):1288–1295. doi: 10.2105/ajph.75.11.1288. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Roos L. L., Jr, Cageorge S. M., Roos N. P., Danzinger R. Centralization, certification, and monitoring. Readmissions and complications after surgery. Med Care. 1986 Nov;24(11):1044–1066. doi: 10.1097/00005650-198611000-00008. [DOI] [PubMed] [Google Scholar]
  24. Rosen H. M., Green B. A. The HCFA excess mortality lists: a methodological critique. Hosp Health Serv Adm. 1987 Feb;32(1):119–127. [PubMed] [Google Scholar]
  25. Smith D. M., Norton J. A., McDonald C. J. Nonelective readmissions of medical patients. J Chronic Dis. 1985;38(3):213–224. doi: 10.1016/0021-9681(85)90064-5. [DOI] [PubMed] [Google Scholar]
  26. Vuori H. Optimal and logical quality: two neglected aspects of the quality of health services. Med Care. 1980 Oct;18(10):975–985. doi: 10.1097/00005650-198010000-00001. [DOI] [PubMed] [Google Scholar]
  27. Wennberg J. E., Roos N., Sola L., Schori A., Jaffe R. Use of claims data systems to evaluate health care outcomes. Mortality and reoperation following prostatectomy. JAMA. 1987 Feb 20;257(7):933–936. [PubMed] [Google Scholar]
  28. Young W. W., Swinkola R. B., Zorn D. M. The measurement of hospital case mix. Med Care. 1982 May;20(5):501–512. doi: 10.1097/00005650-198205000-00006. [DOI] [PubMed] [Google Scholar]
  29. Zook C. J., Savickis S. F., Moore F. D. Repeated hospitalization for the same disease: a multiplier of national health costs. Milbank Mem Fund Q Health Soc. 1980 Summer;58(3):454–471. [PubMed] [Google Scholar]

Articles from Health Services Research are provided here courtesy of Health Research & Educational Trust

RESOURCES