Does the Risk Assessment and Prediction Tool Predict Discharge Disposition After Joint Replacement?

Abstract

Background

Payers of health services and policymakers place a major focus on cost containment in health care. Studies have shown that early planning of discharge is essential in reducing length of stay and achieving financial benefit; tools that can help predict discharge disposition would therefore be of use. The Risk Assessment and Prediction Tool (RAPT) is a preoperative survey constructed to predict discharge disposition after total joint arthroplasty (TJA). The RAPT was developed and tested on a population of Australian patients undergoing joint replacement, but its validity in other populations is unknown. A low RAPT score is reported to indicate a high risk of needing any form of inpatient rehabilitation after TJA, including short-term nursing facilities.

Questions/purposes

This study attempts (1) to assess predictive accuracy of the RAPT on US patients undergoing total hip and knee arthroplasty (THA/TKA); and (2) to determine predictive accuracy of each individual score (1–12).

Methods

Between June 2006 and December 2011, RAPT scores of 3213 patients (1449 THAs; 1764 TKAs) were prospectively captured during the preoperative clinical visit. Scores were stored along with other clinical data, including discharge disposition, in a dedicated database on a secure server. The database was queried by the nursing case manager to retrieve the RAPT scores of all patients captured during this time period. Binary logistic regression was used to analyze the scores and determine predictive accuracy.

Results

Overall predictive accuracy was 78%. RAPT scores < 6 and > 10 (of 12) predicted with > 90% accuracy discharge to inpatient rehabilitation and home, respectively. Predictive accuracy was lowest for scores between 7 and 10 at 65.2% and almost 50% of patients received scores in this range. Based on our findings, the risk categories in our populations should be high risk < 7, intermediate risk 7 to 10, and low risk > 10.

Conclusions

The RAPT accurately predicted discharge disposition for high- and low-risk patients in our cohort. Based on our data, intermediate-risk patients should be defined as those with scores of 7 to 10. Predictive accuracy for these patients could potentially be improved through the identification and addition of other factors correlated to discharge disposition. The RAPT allows for identification of patients who are likely to be discharged home or to rehabilitation, which may facilitate preoperative planning of postoperative care. Additionally, it identifies intermediate-risk patients and could be used to implement targeted interventions to facilitate discharge home in this group of patients.

Level of Evidence

Level III, diagnostic study. See the Guidelines for Authors for a complete description of levels of evidence.

Introduction

Total joint arthroplasties (TJAs) are some of the most commonly performed elective orthopaedic procedures with more than 1,000,000 THAs and TKAs estimated to be performed annually in the United States [4]. Although they are effective treatments for osteoarthritis [6–9, 12], the costs associated with these procedures are substantial [1, 2, 10]. In recent years, payers of health services and policymakers have placed a major focus on cost containment in health care. Decreasing length of stay has been a key element of this emphasis. In addition, surgeons, patients, and policymakers have noted the importance of planning for discharge before the performance of elective procedures.

The Risk Assessment and Prediction Tool (RAPT) is a preoperative survey constructed to predict discharge disposition after TJA [11]. It consists of six questions and generates a score from 1 to 12 with a low score indicating a higher risk for needing inpatient rehabilitation after TJA, including short-term nursing facilities (SNFs). The tool was developed and validated on data from an Australian cohort of 650 patients undergoing TJA. The cohort was split into two groups; data from the first 530 patients were used to develop the tool and data from the next 120 patients were used for validation. The reported overall predictive accuracy was 75% [11].

The purposes of this study were to (1) assess the predictive accuracy of the RAPT on a larger cohort of US patients undergoing THA and TKA; and (2) determine the predictive accuracy of each of the individual scores (1–12).

Patients and Methods

The six items included in the RAPT are age, sex, preoperative walking distance, use of a gait aid, community supports, and the presence of a caregiver on return home. The questions in the score are weighted differently and the number of points assigned to each question depends on their relative correlation to discharge disposition. A score between 1 and 12 is generated based on a patient’s answers to the questions (Table 1). Patients with scores < 6 and > 9 have a high and low risk of needing any form of inpatient rehabilitation, respectively, whereas patients with scores between 6 and 9 are considered to have an intermediate risk.

Table 1.

Items included in the Risk Assessment and Prediction Tool (RAPT) and the score for each item

Item	Value	Score
Age group (years)	50–65	2
	66–75	1
	> 75	0
Sex	Male	2
	Female	1
Walking distance	Two blocks or more	2
	1–2 blocks	1
	Housebound	0
Use of gait aid	None	2
	Single-point stick	1
	Crutches/frame	0
Use of community supports	None or one per week	1
	Two or more per week	0
Caregiver at home	Yes	3
	No	0

As of June 2006, the RAPT was made available to patients scheduled for TJA at Massachusetts General Hospital (MGH). Scores were prospectively captured preoperatively by the nursing case manager and stored in a dedicated database on a secure server along with various other procedural data including discharge disposition. The number of scores that could be captured was limited by the caseload of the nursing case manager. RAPT scores captured in 2008 and 2009 were lost during transition to a new computer system and were therefore not available for analysis. The database was queried by the nursing case manager to retrieve the RAPT scores of all patients captured between June 2006 and December 2011. RAPT scores for 3213 patients undergoing TJA (1449 THAs; 1764 TKAs) were available in the database during the study period (Table 2).

Table 2.

Patient demographics and discharge disposition

Procedure	Number of patients	Age ± SD (years)	Sex (male)	Discharge disposition (home)
Primary THA	1449	66.0 ± 13.3	49.7%	59.0%
Primary TKA	1764	67.3 ± 10.0	41.0%	51.2%

Binary logistic regression analysis was used to assess the predictive accuracy of the RAPT and calculate predicted probabilities to discharge home for each of the RAPT scores (1–12). RAPT score and discharge disposition were used as the independent and dependent variables, respectively. Predictive accuracy was assessed for all patients combined as well groupwise for high-risk (score 0–5), intermediate-risk (score 6–9), and low-risk patients (score 10–12).

Discharge disposition in this study was divided into two groups: home and rehabilitation, with the latter being defined as any inpatient rehabilitation facility or SNF. The decision on discharge disposition was clinically based and made by the surgeon based on input from physical therapy and the case manager and patient’s preference. Insurance status did not have an influence on whether the patient received inpatient or outpatient rehabilitation. All statistical analyses were performed using PASW Statistics 17 (SPSS Inc, Chicago, IL, USA).

Results

The overall predictive accuracy of the RAPT (all scores) was 78% in our cohort of patients undergoing TJA. Predictive accuracy was 80% and 77% for patients undergoing THA and TKA, respectively. The results of the model show that the RAPT is more successful in accurately predicting patients who are discharged home than those discharged to an inpatient rehabilitation facility (Table 3). Fifty-five percent of patients with RAPT were discharged home after TJA and 45% were discharged to any type of inpatient rehabilitation facility. Patients after THA were discharged home 59% of the time, whereas patients who underwent TKA were discharged home in 51% of cases (Table 2).

Table 3.

Predictive accuracy of the RAPT for all patients and for specific risk groups

Cohort	Overall	Home	Rehabilitation	p value
All patients	78.3%	82.4%	73.4%	< 0.0001
THA	79.6%	91.1%	63.0%	< 0.0001
TKA	77.4%	83.3%	71.3%	< 0.0001
Original high risk (0–5)	92.8%	0.0%	100.0%	< 0.0001
High risk (0–6)	89.4%	0.0%	100.0%	< 0.0001
Original intermediate risk (6–9)	66.0%	44.0%	79.8%	< 0.0001
Intermediate risk (7–10)	65.2%	100.0%	0.0%	< 0.0001
Original low risk (10–12)	84.4%	100.0%	0.0%	< 0.0001
Low risk (11–12)	89.5%	100.0%	0.0%	< 0.0001

RAPT scores < 7 and > 10 had the highest predictive accuracy at almost 90% for both groups, whereas scores between 7 and 10 had the lowest predictive accuracy at 65% (Table 3). Scores between 7 and 10 all had predictive accuracies less than 75%, whereas scores < 7 and > 10 had predictive accuracies higher than 83%. The cohort of patients with scores between 7 and 10 consisted of 1477 of 3213 patients, making up 46% of the entire study cohort (Table 4; Fig. 1). Having a RAPT score of 6 equals having a 16% probability of going home and hence a score of 84% is predictive accuracy of not going home. RAPT scores < 6 showed a remarkably high accuracy in predicting discharge disposition. All scores < 6 had at least 90% predictive accuracy for both patients undergoing THA and those undergoing TKA. The same was true for having a RAPT score of 12, which predicts discharge home in 96% of THAs and 94% of TKAs. By contrast, a score of 10 translates into a 73% chance of going home and therefore a probability of 27% of not going home.

Table 4.

Distribution of RAPT scores, predicted probabilities, and predictive accuracies*

* The four scores with the lowest predictive accuracy, representing the intermediate-risk scores, are outlined by a rectangle; PP = predicted probability; PA = predictive accuracy.

Fig. 1.

Predictive accuracy of the RAPT is displayed as a plot of each score (1–12) versus the proportion of patients with that score who were discharged home. The scores of intermediate-risk patients in our cohort (score 7–10) are represented by the red rectangle.

Discussion

As part of an institutional effort to reduce cost and length of stay, we began using RAPT in 2006. The RAPT tool, originally described by Australian researchers [11], is designed to predict discharge disposition of patients undergoing TJA, thus allowing the surgeon and the entire healthcare staff to optimize care according to the patient’s specific needs. RAPT uses six criteria with categorical answers for each item with possible total scores of 1 to 12. We therefore sought to analyze the following: (1) the predictive accuracy of the RAPT on a cohort of US patients undergoing THA and TKA; and (2) the predictive accuracy of each of the individual scores.

There are several limitations to our study. First, patient characteristics and organizational aspects vary greatly not only between countries [3], but also hospitals [15], making our data difficult to extend to other medical institutions. This is illustrated by the significantly different distributions in RAPT scores among patients found in our study compared with those reported by Dauty et al. [5] and Tan et al. [14]. In addition, an intermediate RAPT score might result in very different discharge dispositions in different care systems. Second, our institution does not have strict discharge criteria, therefore increasing the variability in LOS between patients. Third, although equal access to free health care in some European countries makes comparison of discharge disposition easier, studies from the United States show that type of insurance coverage plays a role in patient discharge disposition and postoperative complications [4, 13], thus acting as a potential confounder, because we did not include insurance status in our analysis. It is plausible that patients with medical insurance that covers prolonged stay at a rehabilitation facility will opt to do so despite the surgeon recommending discharge straight to home. Fourth, we did not differentiate among discharge to home with no assistance, discharge to home with home health assistance, discharge to an acute inpatient rehabilitation facility, or discharge to a SNF. Most importantly, we found that half of our patients received intermediate scores, which accurately predicted outcome in only 65% of cases.

We first assessed the predictive accuracy of the RAPT in a large cohort of patients undergoing THA and TKA. The overall predictive accuracy was comparable to the one reported by Oldmeadow et al. [11]. The original investigation of RAPT found that inclusion of medical comorbidities, perhaps surprisingly, provided no additional benefit to predictive accuracy. Thus, we did not attempt to incorporate scoring of overall medical condition such as the Charlson Index in our study.

We next evaluated the results for each score. We noted that both very high and very low scores were highly predictive of discharge destination but that intermediate scores were less so. Although the overall predictive accuracy of the RAPT in our study was similar to the one reported by Oldmeadow et al. [11], the scores of the intermediate-risk patients differed. The RAPT classifies scores of 6 to 9 as intermediate risk, whereas in our study, the scores with the lowest predictive accuracy were 7 to 10. These findings suggest that in our cohort of patients, the risk categories should be defined as follows: high risk < 7, intermediate risk 7 to 10, and low risk > 10. Patients with intermediate-risk scores comprised 46% of our cohort and their discharge disposition could be accurately predicted in only 65% of cases. Compared with a pretest probability for any patient discharging home of 55%, this represents a mere 10 percentage point increase in predictive capacity. It is difficult to speculate as to why the RAPT scores with the lowest predictive accuracy differ between the two studies. Our results indicate that a patient in our US cohort needs a higher score than an Australian patient to not have a high risk of discharging to an inpatient rehabilitation facility (7 versus 6). Furthermore, our results indicate that a patient in our cohort needs a higher score to have a high chance of discharging home (10 versus 11). Perhaps these results reflect the difference in practice between the two countries in terms of use of inpatient rehabilitation facilities. This could be related to a number of factors such as patient preference, surgeon preference, and availability of inpatient rehabilitation facilities.

As part of an integrated clinical care pathway, preoperative scoring of likelihood of discharge is an attractive prospect, because it allows caregivers to focus on patients who require the most assistance with obtaining safe and appropriate postoperative care. The use of the RAPT in terms of preoperatively planning postoperative care is limited by the fact that almost 50% of the patients fall within the intermediate-risk category. This does, however, allow for identification of patients for targeted interventions that could potentially increase the likelihood of these patients being discharged home. Studies investigating additional factors correlated to discharge disposition such as patient-reported outcome measures, body mass index, and American Society of Anesthesiologists score are currently being performed at MGH and could potentially improve the predictive accuracy of the RAPT for intermediate-risk patients. Further studies assessing the predictive accuracy of preoperative scoring systems such as RAPT at other institutions are warranted as well as studies assessing the effect of using RAPT to identify patients for targeted interventions in terms of length of stay, discharge disposition, clinical outcomes, and financial impact.