To provide patients with understandable, accessible, hospital-quality metrics, the US Centers for Medicare and Medicaid Services (CMS) developed the Overall Hospital Quality Star Ratings. This system amalgamates data from various Hospital Compare measures, grouping measures into 7 weighted categories reflecting patient outcomes (mortality, safety, readmission), patient experience, processes of care (effectiveness, timeliness), and efficiency of care (efficient use of medical imaging). Composite scores from each category are used to generate a summary score, which is translated into a star rating from 1 to 5, reflecting hospital performance (1). CMS Star Ratings are recommended as a “starting point” to compare hospitals in nonemergency situations (2).
Cancer care can be complex and surgical management carries substantial risk; the CMS Star Rating presents an opportunity for cancer patients to select hospitals where quality of care may be higher and surgical risk lower. An association between CMS Star Rating and mortality after cancer surgery has previously been demonstrated (3), suggesting if all patients selected high-ranked hospitals, postoperative mortality could be reduced.
Using Medicare data for patients undergoing 1 of 5 high-risk complex cancer surgeries, Papageorge et al. (4) report higher 90-day mortality at 1-star compared with 5-star hospitals (10.4% vs 6.4%); differences were greatest for esophagectomy (19.2% vs 11%) and pancreaticoduodenectomy (17.1% vs 8.1%). The authors then modeled a scenario where all patients undergoing these 5 surgeries at 1-star hospitals were instead treated at 5-star hospitals and found this would reduce 90-day mortality from 10.4% to 6.6%. Relocation of these Medicare beneficiaries would have modest gains—84 lives saved per year—but would not have a major impact on postoperative mortality for this population. Even in a scenario where both patients treated at 1- and 2-star hospitals (30.8% of patients) were relocated to 5-star hospitals, 208 lives among the 32 591 patients treated would be saved per year.
Together, these results suggest CMS Star Ratings are not particularly helpful in guiding patients, because star ratings may not account for a large degree of observed variation in postoperative deaths. To understand why, several factors should be considered. The star ratings are not specific to the surgical procedures performed; ratings are developed and applied at the hospital level and factors that go into ratings, although important, are unlikely to reflect the quality of care delivered for relatively uncommon procedures and are unlikely to be causal in the relationship between hospital and outcome. From the data presented, it is unclear how widely postoperative mortality ranged within each star group. Postoperative mortality rates will vary in these hospitals such that reliance on star ratings could lead a patient to move from a low-mortality 1-star hospital to a higher mortality 5-star hospital, and, in some jurisdictions, the best performing hospital may be a 3- or 4-star hospital. Because of how scores are generated, 5-star ratings may not equate perfectly with other hospital characteristics associated with better outcomes. Notably, CMS Star Ratings do not correlate with hospital volumes (3), a factor known to be strongly associated with surgical outcomes (5,6). Additionally, compared with lower rated hospitals, 5-star hospitals less commonly have intensive care units and larger hospitals less frequently receive 5-star ratings than smaller hospitals (7).
Despite the modest benefits at the population-averaged level, individual patients may find these results convincing enough to rely on CMS Star Ratings to select hospitals for their cancer care. Migration of patients (and associated revenue) from low-ranked hospitals may compel institutions to provide higher quality care. However, there are potential downsides to such a strategy for patients and the health-care system. Although this study identifies an association between star ratings and 90-day mortality, whether postoperative outcomes are better at the 5-star hospital closest to an individual patient than the closest lower ranked hospital will vary. Additionally, major patient movement may overwhelm higher ranked hospitals, leading to longer wait times with implications for long-term cancer outcomes not offset by reduced postoperative mortality. Previous work has shown that patients with less social support, lower income, and poorer health are less willing to travel to receive care (8), and Black patients more often receive care at low-quality, higher mortality hospitals even when they live closer to high-quality hospitals than White patients (9). Encouraging patients to select hospitals based on CMS Star Ratings could, therefore, widen existing disparities (10).
Though regionalization of cancer care makes practical sense for very high-risk procedures performed at low volumes, for more common procedures, greater gains may result not from bringing patients to high-quality institutions but from bringing elements of high-quality institutions to patients. Within institutions, the effects of regionalization on surgeon experience can potentially be re-created. Sahni et al. (11) have shown that operative mortality is related to a surgeon’s degree of specialization in a specific procedure (number of times the procedure was performed divided by the surgeon’s total operative volume) even after adjustment for procedure volume. Although individual surgeons may currently have low volumes of complex cancer surgeries, pooling referrals within hospitals and designating individuals to perform particular procedures can increase surgeon volumes. Additionally, previous studies have shown similar complication rates at high- and low-mortality hospitals (12,13), suggesting higher mortality arises from failure to rescue (FTR) patients who experience complications. High-volume hospitals may have lower mortality because of processes that lower FTR, such as closed intensive care units, overnight coverage, and dedicated rapid response teams (14). However, only a small degree of variation in FTR is accounted for by hospital characteristics and operative volume (15), so strategies beyond investment of resources should be considered. More generally, encouraging a safety culture and having escalation protocols can also lead to improvements in morbidity and mortality for surgical patients (16,17).
Improving the quality of care for patients requiring complex cancer surgery by redirecting patients to the highest performing hospital in their region, although a simple solution, will not be achieved by using the Overall Hospital Quality Star Ratings, and such an approach may increase existing disparities. Instead, applying elements of high-quality hospitals, particularly those that require minimal resource investment, can help bridge the quality gap.
Notes
Disclosures: The authors have no conflicts of interest to disclose.
Role of the authors: FD drafted the manuscript. NNB provided critical review of the manuscript.
References
- 1.Overall hospital quality star rating on Hospital Compare methodology report. 2016. https://cpb-us-w2.wpmucdn.com/u.osu.edu/dist/c/28860/files/2016/08/Star_Rtngs_CompMthdlgy_052016-148w094.pdf. Accessed June 8, 2020.
- 2. Overall hospital quality star rating. https://www.medicare.gov/hospitalcompare/About/Hospital-overall-ratings.html. Accessed June 8, 2020.
- 3. Kaye DR, Norton EC, Ellimoottil C, et al. et al. Understanding the relationship between CMS’ Hospital Compare star rating, surgical case volume, and short-term outcomes after major cancer surgery. Cancer. 2017;123(21):4259–4267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Papageorge M, Resio B, Monsalve A, et al. Navigating by stars: using CMS Star Ratings to choose hospitals for complex cancer surgery. JNCI Cancer Spectrum. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346(15):1128–1137. [DOI] [PubMed] [Google Scholar]
- 6. Urbach DR, Baxter NN. Does it matter what a hospital is “high volume” for? Specificity of hospital volume-outcome associations for surgical procedures: analysis of administrative data. BMJ. 2004;328(7442):737–740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Betts D, Cruse C. There’s more than one way to become a 5-star hospital. https://www2.deloitte.com/content/dam/Deloitte/us/Documents/life-sciences-health-care/us-lshc-medicares-hospital-star-rating-system.pdf. Accessed June 8, 2020.
- 8. Symer MM, Abelson JS, Yeo HL. Barriers to regionalized surgical care: public perspective survey and geospatial analysis. Ann Surg. 2019;269(1):73–78. [DOI] [PubMed] [Google Scholar]
- 9. Dimick J, Ruhter J, Sarrazin MV, Birkmeyer JD. Black patients more likely than Whites to undergo surgery at low-quality hospitals in segregated regions. Health Aff. 2013;32(6):1046–1053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Urbach DR. Pledging to eliminate low-volume surgery. N Engl J Med. 2015;373(15):1388–1390. [DOI] [PubMed] [Google Scholar]
- 11. Sahni NR, Dalton M, Cutler DM, Birkmeyer JD, Chandra A. Surgeon specialization and operative mortality in United States: retrospective analysis. BMJ. 2016;354:i3571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Healy MA, Grenda TR, Suwanabol PA, et al. Colon cancer operations at high-and low-mortality hospitals. Surgery. 2016;160(2):359–365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Wong SL, Revels SL, Yin H, et al. Variation in hospital mortality rates with inpatient cancer surgery. Ann Surg. 2015;261(4):632–636. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Ward ST, Dimick JB, Zhang W, Campbell DA, Ghaferi AA. Association between hospital staffing models and failure to rescue. Ann Surg. 2019;270(1):91–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Sheetz KH, Dimick JB, Ghaferi AA. Impact of hospital characteristics on failure to rescue following major surgery. Ann Surg. 2016;263(4):692–697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Ghaferi AA, Dimick JB. Importance of teamwork, communication and culture on failure‐to‐rescue in the elderly. Br J Surg. 2016;103(2):e47–e51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Johnston MJ, Arora S, King D, et al. A systematic review to identify the factors that affect failure to rescue and escalation of care in surgery. Surgery. 2015;157(4):752–763. [DOI] [PubMed] [Google Scholar]