Where Are We Now?
Schaefer et al. [13] sought to create and validate an instrument that predicts which patients will lose independence after lower extremity surgery because of what they call “adverse discharge,” or discharge from the hospital to a long-term nursing home or skilled nursing facility. The tool they developed, the Adverse Discharge in Older Patients after Lower Extremity Surgery (ADELES) score [13], provided good-to-excellent discriminative ability in their sample of patients 60 years and older. The authors also found that the ADELES score was superior to the modified Frailty Index, Charlson comorbidity index, and Procedural Severity Scores for Morbidity and Mortality in predicting adverse discharge [13].
As healthcare systems move away from rewarding volume and toward championing value—defined as health outcomes achieved per dollar spent across the full cycle of care for a given condition [12]—studies like this [13] are especially important. To me, this paper raised two big-picture questions: (1) What are the benefits and shortcomings of risk calculators to predict outcomes that matter to patients, such as discharge disposition, and (2) how can we use information that should be available to providers at the point of care (such as data in the electronic medical record) to support surgeons, patients, and families as they engage in shared clinical decision-making?
Risk calculators can be helpful adjuncts to clinical data and expertise in patient care. A number of such calculators in elective lower extremity orthopaedic surgery have already been evaluated, including tools that predict THA and TKA revision [11], acute periprosthetic joint infection [15], and discharge to a skilled nursing facility or acute rehabilitation center after TKA or THA [3], among others. Additionally, researchers in Australia have created risk calculators to predict discharge destination after isolated lower limb fractures [7, 8]. Schaefer et al. [13] build on this prior work by designing a risk calculator focused on elderly patients only and including the reason for lower extremity surgery (such as TKA or fracture) as a variable in the model predicting adverse discharge destination.
Because shared clinical decision-making improves patient care [2], any tool that supports that process and helps surgeons better set expectations for patients and their families would be valuable. Using the instrument created by Schaefer et al. [13], surgeons can have more-informed discussions about the likelihood of patients needing a higher level of care after discharge simply by considering characteristics found with a quick review of a patient’s chart. This knowledge, which I did not appreciate in an actionable way before reading this paper, can be beneficial in informing patients and families of the possibility that the patient may lose some independence before undergoing any intervention. Indeed, more-precise prognoses on this topic can help families prepare and cope for what most will see as a serious setback, or worse. And, of course, the ability to modify factors we have control over—such as the use of general anesthesia—can only help us take better care of patients.
Where Do We Need To Go?
There are three main areas that future studies of risk calculators should seek to improve on: (1) ensuring accuracy, particularly the accuracy of data inputs and personalized patient information; (2) adding patient-reported outcome measures in risk calculators, whenever possible; and (3) incorporating more-appropriate measures of socioeconomic disadvantage and systemic racism, including implicit bias and generational trauma, as measures become available instead of proxy variables (such as self-reported race or neighborhood income) [1, 9].
Overall, risk calculators are only as accurate as the data inputs provided. In addition, it is imperative that surgeons stay vigilant in the use of risk calculators, ensuring that the populations in which the risk calculator was developed are similar to their own. If not, the tool will likely be inaccurate and may provide false—and misleading—information. Thus, future research is warranted in more patient subgroups. This was appropriately emphasized by the authors of the current study [13].
It also is vital that future risk calculators incorporate measurements of the endpoints that are most important to patients, in particular, patient-reported outcome measures. More-extensive use of patient-reported outcome measures in risk calculators may not only improve model performance but also provide a more-concrete stepping-off point to begin clinical shared decision-making discussions and set patient expectations, because most patient-reported outcomes tools are readily explainable to and easily understood by patients.
Socioeconomic factors have been shown to impact discharge disposition in patients undergoing lower extremity orthopaedic surgery [5, 14]. However, these measurements are only proxy variables for systemic racism, implicit bias, and generational trauma. As we improve our understanding of these ideas and determine how best to measure them, it will be important to include them and revalidate existing risk calculators.
How Do We Get There?
Improving risk calculators requires a commitment by surgeons to collect accurate data, to find ways to gather a wider array of data such as patient-reported outcome measures and accurate measures of socioeconomic disadvantage, and to pledge to push the boundaries of clinical research through new, innovative methods, including through the cautious use of machine learning [4, 6, 10]. Continued improvement of novel risk calculators such as the ADELES score may lead to higher-value, more-personalized care for all patients with orthopaedic conditions.
Footnotes
All ICMJE Conflict of Interest Forms for authors and Clinical Orthopaedics and Related Research® editors and board members are on file with the publication and can be viewed on request.
This CORR Insights® is a commentary on the article “What Factors Predict Adverse Discharge Disposition in Patients Older Than 60 Years Undergoing Lower-extremity Surgery? The Adverse Discharge in Older Patients after Lower-extremity Surgery (ADELES) Risk Score” by Schaefer et al. available at: DOI: 10.1097/CORR.0000000000001532.
The author certifies that neither he, nor any member of his immediate family, has funding or commercial associations (consultancies, stock ownership, equity interest, patent/licensing arrangements, etc.) that might pose a conflict of interest in connection with the submitted article.
The opinions expressed are those of the writer, and do not reflect the opinion or policy of CORR® or The Association of Bone and Joint Surgeons®.
References
- 1.Bernstein DN, Ukogu C. Letter to the editor: editorial: beware of studies claiming that social factors are "independently associated" with biological complications of surgery. Clin Orthop Relat Res. 2020;478:2938-2939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Bozic KJ. Orthopaedic healthcare worldwide: shared medical decision making in orthopaedics. Clin Orthop Relat Res. 2013;471:1412-1414. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Goltz DE, Baumgartner BT, Politzer CS, DiLallo M, Bolognesi MP, Seyler TM. The American College of Surgeons National Surgical Quality Improvement Program surgical risk calculator has a role in predicting discharge to post-acute care in total joint arthroplasty. J Arthroplasty. 2018;33:25-29. [DOI] [PubMed] [Google Scholar]
- 4.Helm JM, Swiergosz AM, Haeberle HS, et al. Machine learning and artificial intelligence: definitions, applications, and future directions. Curr Rev Musculoskelet Med. 2020;13:69-76. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Inneh IA, Clair AJ, Slover JD, Iorio R. Disparities in discharge destination after lower extremity joint arthroplasty: analysis of 7924 patients in an urban setting. J Arthroplasty. 2016;31:2700-2704. [DOI] [PubMed] [Google Scholar]
- 6.Karhade AV, Schwab JH. CORR synthesis: when should we be skeptical of clinical prediction models? Clin Orthop Relat Res. 2020;478:2722-2728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Kimmel LA, Holland AE, Edwards ER, et al. Discharge destination following lower limb fracture: development of a prediction model to assist with decision making. Injury. 2012;43:829-834. [DOI] [PubMed] [Google Scholar]
- 8.Kimmel LA, Holland AE, Simpson PM, Edwards ER, Gabbe BJ. Validating a simple discharge planning tool following hospital admission for an isolated lower limb fracture. Phys Ther. 2014;94:1005-1013. [DOI] [PubMed] [Google Scholar]
- 9.Leopold SS. Editorial: beware of studies claiming that social factors are "independently associated" with biological complications of surgery. Clin Orthop Relat Res. 2019;477:1967-1969. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Leopold SS, Porcher R, Gebhardt MC, et al. Editorial: opposites attract at CORR®-machine learning and qualitative research. Clin Orthop Relat Res. 2020;478:2193-2196. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Paxton EW, Inacio MC, Khatod M, Yue E, Funahashi T, Barber T. Risk calculators predict failures of knee and hip arthroplasties: findings from a large health maintenance organization. Clin Orthop Relat Res. 2015;473:3965-3973. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Porter ME. What is value in health care? N Engl J Med. 2010;363:2477-2481. [DOI] [PubMed] [Google Scholar]
- 13.Schaefer MS, Hammer M, Platzbecker K, et al. What factors predict adverse discharge disposition in patients older than 60 years undergoing lower-extremity surgery? The adverse discharge in older patients after lower-extremity surgery (ADELES) risk score. Clin Orthop Relat Res. 2021;479:546-557. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Singh JA, Kallan MJ, Chen Y, Parks ML, Ibrahim SA. Association of race/ethnicity with hospital discharge disposition after elective total knee arthroplasty. JAMA Netw Open. 2019;2:e1914259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wingert NC, Gotoff J, Parrilla E, Gotoff R, Hou L, Ghanem E. The ACS NSQIP risk calculator is a fair predictor of acute periprosthetic joint infection. Clin Orthop Relat Res. 2016;474:1643-1648. [DOI] [PMC free article] [PubMed] [Google Scholar]
