Skip to main content
Elsevier Sponsored Documents logoLink to Elsevier Sponsored Documents
. 2021 Mar;2(3):e154–e162. doi: 10.1016/S2666-7568(21)00004-0

The use of linked routine data to optimise calculation of the Hospital Frailty Risk Score on the basis of previous hospital admissions: a retrospective observational cohort study

Andrew Street a,*, Laia Maynou a,b, Thomas Gilbert c, Tony Stone d, Suzanne Mason d, Simon Conroy e
PMCID: PMC7934406  PMID: 33733245

Summary

Background

The Hospital Frailty Risk Score (HFRS) has been widely but inconsistently applied in published studies, particularly in how diagnostic information recorded in previous hospital admissions is used in its construction. We aimed to assess how many previous admissions should be considered when constructing the HFRS and the influence of frailty risk on long length of stay, in-hospital mortality, and 30-day readmission.

Methods

This is a retrospective observational cohort study of patients aged 75 years or older who had at least one emergency admission to any of 49 hospital sites in the Yorkshire and Humber region of England, UK. We constructed multiple versions of the HFRS for each patient, each form incorporating diagnostic data from progressively more previous admissions in its construction within a 1-year or 2-year window. We assessed the ability of each form of the HFRS to predict long length of stay (>10 days), in-hospital death, and 30-day readmission.

Findings

Between April 1, 2013, and March 31, 2017, 282 091 patients had 675 155 hospital admissions. Regression analyses assessing the different constructions of HFRS showed that the form constructed with diagnostic information recorded in the current and previous two admissions within the preceding 2 years performed best for predicting all three outcomes. Under this construction, 263 432 (39·0%) of 674 615 patient admissions were classified as having low frailty risk, for whom 33 333 (12·7%) had a long length of stay, 10 145 (3·9%) died in hospital, and 45 226 (17·2%) were readmitted within 30 days. By contrast with those patients with low frailty risk, for those with intermediate frailty risk, the probability was 2·5-times higher (95% CI 2·4 to 2·6) for long length of stay, 2·17-times higher (2·1 to 2·2) for in-hospital death, and 0·7% higher (0·5 to 1) for readmission. For patients with high frailty risk, the probability was 4·3-times higher (4·2 to 4·5) for long length of stay, 2·48-times higher (2·4 to 2·6) for in-hospital death, and −1% (−1·2 to −0·5) lower for readmission than those with low frailty risk. The intermediate and high frailty risk categories were more important predictors of long length of stay than any of the other rich set of control variables included in our analysis. These categories also proved to be important predictors of in-hospital mortality, with only the Charlson Comorbidity Index offering greater predictive power.

Interpretation

We recommend constructing the HFRS with diagnostic information from the current admission and from the previous two admissions in the preceding 2 years. This HFRS form was a powerful predictor of long length of stay and in-hospital mortality, but less so of emergency readmissions.

Funding

National Institute of Health Research.

Introduction

Health systems worldwide are interested in identifying frailty in patients. Two widely used tools include the electronic Frailty Index (in primary care)1 and the Hospital Frailty Risk Score (HFRS; in secondary care).2 Gilbert and colleagues2 developed the HFRS focusing on individuals aged 75 years or older who are at greatest risk of harm and high resource use in hospital. This risk score takes values ranging from 0 (no frailty risk) to 173·2 and is calculated by combining a weighted set of 109 three-character diagnostic codes from the International Statistical Classification of Diseases and Related Health Problems, tenth revision (ICD-10), recorded during the current admission and any previous emergency admissions occurring in the preceding 2 years.

The HFRS has been widely adopted, but diagnostic information from past admissions is inconsistently used.3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 At face value, using more information is always better, increasing the likelihood that the HFRS captures the true effect of frailty risk on patient outcomes. However, obtaining historical data might incur costs and, even if these costs were marginal, they might not be worth incurring if the extra data do not offer substantial additional information.

There are two forms of inconsistency in constructing the HFRS. First, variation occurs in the so-called look-back window (how far back to go in health records to search for data) in accounting for previous admissions. Some studies apply a 2-year window,3, 4, 5, 6 as recommended by Gilbert and colleagues.2 Some studies use information from the current admission alone,7, 8, 9, 10 whereas others look back over the preceding 3 months,11, 12 the preceding year,13, 14 and even up to the preceding 15 years.15, 16 In some studies, the look-back period is not specified.17, 18, 19 This variation in defining the look-back period entails a lack of external consistency in how the HFRS is constructed, compromising the comparison of findings across studies.

Research in context.

Evidence before this study

We searched ResearchGate, ScienceDirect, Google scholar, and ClinicalTrials.gov using the search terms “Hospital Frailty Risk Score” (HFRS) and “HFRS” for studies in English published up to Oct 2, 2020, to identify studies that applied the HFRS to patients aged 75 or older to assess how past diagnostic data was used in its construction. Authors were contacted if these details were not reported in the article. We found that the HFRS has been widely but inconsistently applied, with studies differing in the use of diagnostic data from past emergency admissions when constructing the risk score.

Added value of this study

Our study offers two major contributions. First, we established what constitutes the minimum amount of diagnostic data from previous admissions required to construct the HFRS. More information offers better predictive accuracy, whether the estimated effects are larger or smaller than those based on less information, but historical data might be difficult to access. We determined the point at which there is no significant change in predictive ability, beyond which historical data are not worth accounting for. To determine this point, we constructed multiple forms of the HFRS and assessed their ability to predict long length of stay, in-hospital death, and 30-day emergency readmission. Second, we assessed the importance of the HFRS in predicting patient outcomes compared with a richer set of control variables than that used in the original HFRS study or in any other study that has since validated the HFRS, including patients' sociodemographic and clinical characteristics and their journey along the emergency and urgent care pathway before their admission to hospital.

Implications of all the available evidence

The HFRS should be constructed with diagnostic information recorded in the current and previous two admissions within the preceding 2 years, as diagnostic data from additional previous admissions did not add predictive value. The HFRS is a powerful predictor of long length of stay and in-hospital death, but not of 30-day readmission.

Second, studies will have internal inconsistency when constructing the HFRS if the look-back window had been defined by the period covered by the dataset but varied for individuals in the dataset.20, 21 Take a 2-year dataset, for instance: if a patient died at the start of these 2 years, they might only have a single record even though they might have been in hospital several times in the year or two before the start of the period covered by the data. For such an individual, their previous admissions would be unobserved and their frailty risk would be understated. By contrast, for a patient admitted towards the end of the data period, the frailty risk would be measured as intended by Gilbert and colleagues.2 In such applications, the HFRS will not be constructed consistently across patients in the same study.

In this study, we aimed to provide definitive guidance about how best to construct the HFRS both in terms of the number of previous admissions from which diagnostic data are extracted and the length of the look-back period so that the risk score can be used to predict accurately the probabilities of long length of stay (>10 days), dying in hospital, and 30-day readmission. To determine this minimum amount of previous admissions, we aimed to construct multiple forms of the HFRS and assessed their ability to predict long length of stay, in-hospital death, and 30-day emergency readmission. To assess the accuracy of HFRS predictions, we aimed to use a richer set of control variables than that used in the original HFRS study or in any other study that has since validated the HFRS. These control variables include patients' sociodemographic and clinical characteristics and their journey along the emergency and urgent care pathway before their admission to hospital.

Methods

Study setting and participants

We did a retrospective cohort study of individuals aged 75 years or older who had at least one emergency admission to any of the 49 sites of the 13 acute National Health Service (NHS) hospitals in the Yorkshire and Humber region of England (UK), with a population of 5·4 million people and a mixture of large and small urban, suburban, and rural settings. The Connected Health Cities Urgent and Emergency Care Research database (CUREd)22 collates routine data from NHS 111 service, the Yorkshire Ambulance Service computer-aided dispatch data, and the emergency department and inpatient patient administration systems. The full dataset runs from April 1, 2011, to March 31, 2017, but we ran the analyses from April 1, 2013, onwards so that the HFRS was always constructed consistently with use of a full 2-years' worth of historical data for all patients.

Study design

In the first stage of the analyses, each patient was categorised as having low (HFRS <5), intermediate (5–15) or high (>15) frailty risk by constructing the HFRS with use of diagnostic information from the current admission alone (labelled HFRS(a)). We then ran regression analyses to assess the association between frailty risk and of long length of stay, in-hospital mortality, and 30-day emergency readmission, taking into account various control variables, including category variables for the intermediate-risk group (labelled HFRSi) and the high-risk group (labelled HFRSh), with patients in the low-risk group serving as the reference category.

In the second stage, we investigated how each individual's categorisation by frailty risk changed as progressively more past admissions occurring in the preceding year were considered in the construction of the HFRS. The second form of the HFRS, HFRS(a + 1,1), captured diagnostic data from both the current and one previous admission (labelled a+1) that occurred within the preceding year (labelled 1). The third form, HFRS(a + 2,1), included data from the current and previous two admissions occurring in the preceding year, and so on. One patient had 39 admissions in the year preceding their current admission, and this was captured by the final HFRS(a + n,1) form.

To arrive at the preferred form of the HFRS, we assessed whether a significant (p<0·05) difference occurred in the point estimates associated with the high-risk frailty category under successive constructions of the HFRS, following the process set out in the top half of figure 1. If the point estimate from HFRSh(a + 1,1) fell within the 95% CI of the point estimate for HFRSh(a), then the HFRS(a) construction was preferred, as the extra diagnostic data of HFRSh(a + 1,1) did not increase the predictive ability compared with the use of fewer data. If not, we assessed whether the estimate for HFRSh(a + 2,1) fell within the 95% CI of the estimate for HFRSh(a + 1,1), and so on.

Figure 1.

Figure 1

Decision rules to arrive at preferred form of HFRS

(a)=current admission only. (a + n,1)=current admission and n previous admissions in the preceding year. HFRS=Hospital Frailty Risk Score.

In the third stage, we repeated the preceding analyses after widening the look-back window in which previous admissions occurred to 2 years before the current admission, as set out in the lower half of figure 1. To determine whether to use a 1-year or 2-year look-back window, the 1-year version of the HFRS preferred in the second stage of analysis (eg, HFRS(a + 1,1)) was compared with its 2-year window version (eg, HFRS(a + 1,2)). If the point estimate from the 2-year version (eg, HFRSh(a + 1,2)) was within the 95% CI of the 1-year version, then the 1-year version was preferred. If not, the 2-year version was preferred because this additional diagnostic data yielded a significantly different estimate of the effect of frailty risk on each outcome. We also did a sensitivity analysis that assessed whether a 3-year window added predictive accuracy.

Statistical analysis

The regression models took the general form

Y=f(HFRSi,HFRSh,X,P,T,Z)

where Y indicates one of three outcomes: long length of stay, in-hospital death, or 30-day emergency readmission. We used a Logit model for long length of stay, a Cox proportional hazard model for in-hospital death, and a sample selection bivariate probit model for 30-day readmission. As detailed in the appendix (p 4), the probit model for readmission recognises that in-hospital mortality is a competing risk for 30-day readmission and conditions the probability of readmission on whether the patient survived the previous hospitalisation.23 This involved first estimating a selection equation to explain the probability of survival before estimating the probability of readmission. This survival model accounts for the day of the admission, the argument being that the day of admission influences in-hospital mortality but has no bearing on the probability of readmission.23

If the regression coefficients for HFRSi and HFRSh were positive and significant, those patients with intermediate and high frailty risk had a higher likelihood of long length of stay (captured by odds ratios [ORs]), in-hospital death (captured by hazard ratios [HRs]), or emergency readmission (captured by average marginal effects) than patients assessed as having low frailty risk.

The regression analyses controlled for sociodemographic and clinical characteristics of patients, indicated by vector X, including age, sex, socioeconomic status, Charlson Comorbidity Index,24 number of emergency admissions in the preceding year, counts of the number of operation codes, whether or not they had ambulatory care-sensitive conditions (ACSC), the national tariff attached to the Healthcare Resource Group to which they were categorised, whether they were care home residents, and travel time between their residence and the hospital (appendix p 2).

Vector P includes variables capturing the patient's emergency and urgent care journey before admission: the number and length in minutes of the individual's emergency (NHS 111 and 999) calls, time of the ambulance on scene, time taken between calling the ambulance and arrival at the emergency department, the urgency with which the ambulance was dispatched, and whether the patient was admitted to hospital through the emergency department.

Variables indicating day, month, and year of admission were included in vector T. We included a fixed effect for each of the 49 hospital sites, represented as vector Z. For long length of stay and 30-day readmission, SEs were clustered at patient level to capture correlation across multiple admissions, perhaps to different hospital sites, by the same patient. Statistical analysis was done with Stata 15.

Role of the funding source

The funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report.

Results

The analysis sample comprised 282 091 patients who had 675 155 hospital admissions between April 1, 2013, and March 31, 2017. In-hospital death was recorded for all observations, discharge date was missing for 540 (0·1%) admissions for which neither long length of stay nor the HFRS could be calculated, and those patients censored at March 31, 2017, were assumed not to have been readmitted within 30 days. 177 255 (26·3%) of 674 615 observations had a long length of stay, 51 569 (7·6%) of 675 155 died in hospital, and 130 717 (19·4%) of 675 155 had an emergency readmission within 30 days of being discharged (table 1; summary statistics across all observations for each of the control variables are reported in appendix p 3). Regarding the HFRS(a) frailty risk categorisation, 373 799 (55·4%) of 674 615 admissions were in the low category, 251 009 (37·2%) in the intermediate category, and 49 807 (7·4%) in the high category (table 1).

Table 1.

Descriptive statistics of outcomes, 2013–17

Number of observations Percentage HFRS(a)
Low Intermediate High
HFRS(a) categorisation 373 799 (55·4%) 251 009 (37·2%) 49 807 (7·4%)
Outcomes
Length of stay (>10 days) 177 255/674 615 26·3% (44·1) 13·9% (34·6) 37·1% (48·3) 64·6% (47·8)
In-hospital death 51 569/675 155 7·6% (26·6) 4·5% (20·8) 10·8% (31·1) 15·1% (35·7)
Readmission 130 717/675 155 19·4% (39·5) 19·2% (39·4) 19·9% (39·9) 17·7% (38·2)

Data are n/N, n (%), or % (SD). In-hospital death was recorded for all observations. Discharge date was missing for 540 (0·1%) patients, for whom neither long length of stay nor the HFRS could be calculated, but they were included in the readmission analysis on the assumption that were not readmitted within 30 days. Of the 18 145 patients discharged after March 1, 2017, 1706 (9·4%) were readmitted before March 31, 2017, compared with a monthly average of 19·4% for the study period. The remaining censored observations were assumed not to have been readmitted within 30 days. HFRS=Hospital Frailty Risk Score. (a)=data from current admission alone.

The first stage of the study involved regression analysis of each of the three outcomes in turn, with frailty risk defined under the HFRS(a) construction and including the control variables (full set of results in appendix p 6). Compared with patients with low frailty risk, those with intermediate risk were 2·66-times more likely to have a long length of stay and 1·96-times more likely to die in hospital, but 0·3% less likely to be readmitted within 30 days; those with high frailty risk were 5·47-times more likely to have a long length of stay, 2·24-times more likely to die in hospital, but 2·7% less likely to be readmitted within 30 days (table 2).

Table 2.

Outcome coefficients for HFRS calculated with progressively more previous admissions

Length of stay (OR)
In-hospital deaths (HR)
30-day readmission (AME)
HFRS intermediate HFRS high HFRS intermediate HFRS high HFRS intermediate HFRS high
Current admission alone (a) 2·66* (2·61 to 2·70) 5·47* (5·32 to 5·62) 1·96* (1·92 to 2·01) 2·24* (2·17 to 2·31) −0·003* (−0·005 to −0·001) −0·027* (−0·031 to −0·023)
1-year window
Current admission plus previous admission in preceding year (a + 1,1) 2·58* (2·53 to 2·63) 4·75* (4·64 to 4·87) 2·15* (2·10 to 2·21) 2·53* (2·45 to 2·61) 0·001 (−0·002 to 0·003) −0·020* (−0·023 to −0·016)
Current admission plus previous 2 admissions in preceding year (a + 2,1) 2·61* (2·56 to 2·66) 4·76* (4·64 to 4·88) 2·22* (2·16 to 2·28) 2·62* (2·54 to 2·71) 0·003* (0·001 to 0·006) −0·017* (−0·020 to −0·013)
Current admission plus previous 3 admissions in preceding year (a + 3,1) 2·64* (2·58 to 2·69) 4·80* (4·68 to 4·92) 2·24* (2·18 to 2·30) 2·63* (2·55 to 2·73) 0·005* (0·002 to 0·008) −0·016* (−0·020 to −0·013)
Current admission plus previous 4 admissions in preceding year (a + 4,1) 2·64* (2·59 to 2·70) 4·83* (4·71 to 4·96) 2·25* (2·18 to 2·31) 2·65* (2·57 to 2·74) 0·006* (0·004 to 0·009) −0·013* (−0·017 to −0·010)
Current admission plus previous n admissions in preceding year (a + n,1) 2·65* (2·60 to 2·70) 4·82* (4·70 to 4·94) 2·25* (2·19 to 2·31) 2·66* (2·57 to 2·75) 0·009* (0·006 to 0·011) −0·004* (−0·007 to −0·000)
2-year window
Current admission plus previous admission in preceding 2 years (a + 1,2) 2·50* (2·45 to 2·55) 4·50* (4·39 to 4·61) 2·12* (2·06 to 2·17) 2·45* (2·37 to 2·53) 0·003* (0·001 to 0·006) −0·015* (−0·018 to −0·012)
Current admission plus previous 2 admissions in preceding 2 years (a + 2,2) 2·50* (2·45 to 2·55) 4·34* (4·24 to 4·45) 2·17* (2·11 to 2·23) 2·48* (2·40 to 2·56) 0·007* (0·004 to 0·010) −0·009* (−0·012 to −0·005)
Current admission plus previous 3 admissions in preceding 2 years (a + 3,2) 2·51* (2·46 to 2·56) 4·31* (4·21 to 4·42) 2·19* (2·12 to 2·25) 2·47* (2·39 to 2·56) 0·010* (0·007 to 0·012) −0·006* (−0·009 to −0·003)
Current admission plus previous 4 admissions in preceding 2 years (a + 4,2) 2·51* (2·46 to 2·57) 4·32* (4·21 to 4·42) 2·19* (2·13 to 2·26) 2·47* (2·39 to 2·55) 0·011* (0·009 to 0·014) −0·003 (−0·006 to 0·001)
Current admission plus previous n admissions in preceding 2 years (a + n,2) 2·52* (2·47 to 2·57) 4·26* (4·16 to 4·37) 2·20* (2·14 to 2·26) 2·47* (2·39 to 2·55) 0·014* (0·011 to 0·016) 0·010* (0·007 to 0·014)

Data are coefficients (95% CI), using low frailty risk as the reference category and after adjusting for all control variables. OR=odds ratio. HFRS=Hospital Frailty Risk Score. HR=hazard ratio. AME=average marginal effect.

*

Coefficient is significant (p<0·05).

In the second stage, we repeated the regression analyses, progressively substituting the intermediate and high frailty risk categories constructed based on HFRS(a) for constructions based on HFRS(a + 1,1), HFRS(a + 2,1), HFRS(a + 3,1), HFRS(a + 4,1), and HFRS(a + n,1), using increasingly more previous admissions occurring in the preceding year. The proportion of patients in the low frailty risk category decreased and the proportion of those in the high-risk category increased as data from progressively more historical admissions was used to construct the HFRS (table 3).

Table 3.

Proportion of patients in each frailty risk category under different forms of the HFRS

Low frailty risk Intermediate frailty risk High frailty risk
Current admission alone (a) 373 799 (55·4%) 251 009 (37·2%) 49 807 (7·4%)
HFRS 1-year window
Current admission plus previous admission in preceding year (a + 1,1) 301 882 (44·7%) 270 652 (40·1%) 102 081 (15·1%)
Current admission plus previous 2 admissions in preceding year (a + 2,1) 283 891 (42·1%) 262 129 (38·9%) 128 595 (19·1%)
Current admission plus previous 3 admissions in preceding year (a + 3,1) 278 364 (41·3%) 256 593 (38·0%) 139 658 (20·7%)
Current admission plus previous 4 admissions in preceding year (a + 4,1) 276 330 (41·0%) 254 017 (37·7%) 144 268 (21·4%)
Current admission plus previous n admissions in preceding year (a + n,1) 274 419 (40·7%) 251 491 (37·3%) 148 705 (22·0%)
HFRS 2-year window
Current admission plus previous admission in preceding 2 years (a + 1,2) 288 411 (42·8%) 275 278 (40·8%) 110 926 (16·4%)
Current admission plus previous 2 admissions in preceding 2 years (a + 2,2) 263 432 (39·0%) 263 944 (39·1%) 147 239 (21·8%)
Current admission plus previous 3 admissions in preceding 2 years (a + 3,2) 254 826 (37·8%) 254 875 (37·8%) 164 914 (24·4%)
Current admission plus previous 4 admissions in preceding 2 years (a + 4,2) 251 347 (37·3%) 249 942 (37·0%) 173 326 (25·7%)
Current admission plus previous n admissions in preceding 2 years (a + n,2) 247 640 (36·7%) 243 487 (36·1%) 183 488 (27·2%)

Percentages are proportions of a total of 674 615 observations. HFRS=Hospital Frailty Risk Score.

We plotted the proportion of patients in the high frailty risk category against the OR (95% CI) for long length of stay under each version of the HFRS (figure 2A). When adding one previous admission within a 1-year window to the current admission for the construction of the HFRS (HFRS(a + 1,1)), the proportion of patients with high frailty risk increased and the adjusted OR decreased significantly (OR of HFRSh(a + 1,1) was outside the 95% CI of HFRSh(a); table 2). By contrast, changes in the point estimates for each subsequent increase in the number of previous admissions (HFRSh(a + 2,1), HFRSh(a + 3,1), HFRSh(a + 4,1), and HFRSh(a + n,1)) were not significant (table 2); therefore, no significant change was observed in predictive power associated with the use of diagnostic data from any of these past admissions to construct the HFRS. This indicates that, if restricted to a single year's worth of data, data from the current and previous admission (HFRS(a + 1,1)) are sufficient to predict long length of stay. Applying the same strategy, we found that the preferred construction was HFRS(a + 2,1) for in-hospital death and HFRS(a + 1,1) for 30-day readmissions (figure 2B, C).

Figure 2.

Figure 2

HFRSh estimates for length of stay (>10 days; A), in-hospital deaths (B), and 30-day readmissions (C) within 1 year and 2 years

(a)=current admission. (a + n)=current admission and n previous admissions. h=high-risk group. HFRS=Hospital Frailty Risk Score.

In the third stage, we tested whether using a 2-year window offered greater accuracy. We observed that, compared with a 1-year window, a 2-year window resulted in larger proportions of patients categorised as having high frailty risk under each form of the HFRS (table 3).

We plotted the proportion of patients in the high frailty risk category against the OR (95% CI) for long length of stay under each version of the 2-year window HFRS (figure 2A). Using a 2-year window, the predictive power of high frailty risk on long length of stay was lower than that predicted when using a 1-year window (table 2). Within a 1-year window, the HFRSh(a + 1,1) was preferred for predicting long length of stay. The point estimate for the 2-year form, HFRSh(a + 1,2), was outside the 95% CI for HFRSh(a + 1,1), indicating that predictive accuracy improved with the use of 2-years' worth of data (table 2; figure 2A). Assessing the subsequent versions of HFRS, we then established that the point estimate for HFRSh(a + 2,2) was outside the 95% CI for HFRSh(a + 1,2), whereas the point estimates for HFRSh(a + 3,2), HFRSh(a + 4,2), and HFRSh(a + n,2) all were within the 95% CI for HFRSh(a + 2,2). These findings imply that, to predict long length of stay accurately, it is best to construct HFRS(a + 2,2), the version that uses diagnostic data from the current and previous two admissions that occurred in the preceding 2 years.

For in-hospital deaths and 30-day readmissions, our analyses reached the same conclusion as for long length of stay, with the point estimate for HFRSh(a + 2,2) lying outside the 95% CI for HFRSh(a + 2,1) (figure 2B, C). These findings mean that the HFRS(a + 2,2) construction was the optimal form of the HFRS for all three outcomes. The HFRS(a + 2,2) form was also preferred when the look-back window was widened to 3 years, with the predictions for the 2-year and 3-year windows almost exactly the same for all three outcomes (appendix p 12). This finding implies that no additional significant information was gained by applying a 3-year compared with a 2-year window. By extension, this ruled out the need to look even further back in time.

Under this HFRS(a + 2,2) form, of the 674 615 observations, 263 432 (39·0%) were classified as low frailty risk, 263 944 (39·1%) as intermediate frailty risk, and 147 239 (21·8%) as high frailty risk. For the 263 432 observations with low frailty risk, 33 333 (12·7%) resulted in a long length of stay, 10 145 (3·9%) in in-hospital death, and 45 226 (17·2%) in readmission within 30 days. Compared with observations with low frailty risk, the probability for observations with intermediate frailty risk was 2·5-times higher for long length of stay (95% CI 2·4 to 2·6), 2·17-times higher for in-hospital death (2·1 to 2·2), and 0·7% higher for readmission (0·5% to 1). For observations with high frailty risk, the probability was 4·3-times higher (4·2 to 4·5) for long length of stay, 2·48-times higher (2·4 to 2·6) for in-hospital death, and −1% (−1·2 to −0·5) lower for readmission, compared with observations with low frailty risk.

Full regression results for the three outcomes when using the HFRS(a + 2,2) construction are reported in the appendix (p 7) and summarised as forest plots (figure 3). The intermediate and high frailty risk categories were more important predictors of long length of stay than any of the other patient or pathway characteristics considered, none of which influenced long length of stay by more than 2·2-times their reference categories (figure 3A). The importance of the HFRS as a predictor held when examining the probability of length of stay in excess of 7 days and 21 days (appendix pp 8–9). For predicting in-hospital death, the Charlson Comorbidity Index was the most important (particularly for scores of 3 up to the maximum of 24 [HR 3·71]), followed by the frailty risk categories (figure 3B). The probability of dying in hospital also increased with age (HR 1·73 for patients older than 95 years) and for patients who were admitted with an ACSC (HR 1·55), and it increased with increasing urgency of the patient's condition as designated by the call handler (HR 1·75 for patients with a life-threatening condition; figure 3B).

Figure 3.

Figure 3

Regression results for length of stay (>10 days; A), in-hospital deaths (B), and 30-day readmissions (C) for HFRS(a + 2,2)

(a + 2,2)=current admission plus 2 previous admissions in the preceding 2 years. ACSC=ambulatory care-sensitive conditions. ED=emergency department. HFRS=Hospital Frailty Risk Score. HRG=Healthcare Resource Group. NHS=National Health Service.

The probability of 30-day readmission was higher for more previous admissions to hospital (17% higher if three or more in the preceding year) and for higher Charlson scores (2·7% higher for scores of three or higher; figure 3C). Patients living in care homes were 1·5% less likely to be readmitted. Compared with patients with low frailty risk, those with intermediate frailty risk were 1% more likely to be readmitted and those with high frailty risk were 1% less likely to be readmitted (figure 3C).

Discussion

The HFRS has been widely applied, but studies have inconsistently used previous admissions in its construction. In our study, we considered various forms of the HFRS to determine the minimum amount of diagnostic data to be used. Our assessment was based on whether there are significant changes in the ability of the high frailty risk marker to predict long length of stay, in-hospital death, and 30-day readmission in our cohort of patients. We judged that predictive ability was not improved if the HFRSh point estimate from a form of the HFRS constructed with more diagnostic data was within the 95% CI of the HFRSh from the preceding version. We found that the preferred form of the HFRS to predict all three outcomes used diagnostic data from the current and previous two admissions in the preceding 2-years.

Being categorised as having intermediate or high frailty risk was a more important predictor of long length of stay than any of the other rich set of control variables included in our analysis. These categories also proved to be important predictors of in-hospital mortality, with only the Charlson Comorbidity Index offering greater predictive power. The observation that both the HFRS and Charlson categories were highly significant predictors when jointly considered shows that they capture different risk factors associated with in-hospital death. By contrast, frailty risk was not a strong predictor of 30-day readmission. The inability of the HFRS to predict readmission might be because of the care that patients who are frail receive: if post-discharge care packages are put in place to support these individuals when they return to their usual place of residence, then their risk of readmission might be reduced.

Our findings that the HFRS is a strong predictor of long length of stay and in-hospital death are in line with other studies that have applied the HFRS to older people.2, 4 In agreement with some studies,3, 4 but not with others,2, 10 we found that the HFRS is not a strong predictor of readmission. Our study offers key advantages that make our predictions of frailty risk on outcomes more precise than those reported by other studies. The CUREd dataset covers 7 years, but data from the first 2 years were used solely to ensure that the HFRS was constructed consistently for all individuals. We benefited from a large sample size, thereby generating more precise estimates than those for small samples. Additionally, by linking individual data across emergency and urgent care settings, we controlled for a rich set of variables that might be correlated with frailty risk. Not accounting for these influences might over-estimate the impact of frailty risk on the outcomes.

Our study has limitations. The control variables can be improved, for instance by accounting for ethnicity—known to be poorly coded in English hospital data25—and by use of better measures of socioeconomic status. The positive association between the HFRS and longer length of stay might be upwardly biased because patients with longer stays tend to have more extensive documentation of frailty-related diagnoses,26 although the use of three-character rather than four-character ICD-10 codes offers some protection against this bias. The HFRS might not be feasible in health-care systems that do not routinely collect ICD-10 codes electronically. Although not a national study, our data are from a large, representative region of the UK.

Although no frailty tool discriminates well enough to direct clinical care at the individual patient level, tools can be used to identify cohorts at greater risk of poor outcomes.27 If embedded into hospital electronic health records, the HFRS could be used to target frailty interventions, avoiding the burden of implementing manual scores such as the Clinical Frailty Scale and improving the standardisation of frailty assessment. The combination of the electronic Frailty Index for primary care and HFRS for secondary care risk stratification would advance frailty-friendly care, as called for in various policy documents.28 The electronic Frailty Index and HFRS identify different at-risk cohorts, and thus their combination offers opportunity to identify the whole population at risk. Further research could examine how well the HFRS performs in other health-care systems, refine the HFRS through the incorporation of real-time data, and develop frailty-attuned clinical decision support systems.29

Data sharing

Retrospective, deidentified data were obtained from the CUREd Research database (CUREdRQ0004) hosted by the CURE Group (University of Sheffield, Sheffield, UK). Data were provided under a data sharing agreement which prohibits onward sharing. Other researchers can make their own requests for CUREd data online.

Acknowledgments

Acknowledgments

This work was supported by the NIHR (grant 17/05/96). SM is also funded by the NIHR Yorkshire and Humber Applied Research Centre (grant NIHR200166). This study was produced with use of CUREd data. We gratefully acknowledge the contribution of the NHS Trusts in the Yorkshire and Humber region that provided the original data to the University of Sheffield Connected Health Cities study. Connected Health Cities is a Northern Health Science Alliance (NHSA) led programme funded by the Department of Health and Social Care and delivered by a consortium of academic and NHS organisations across the north of England. The views expressed in this paper are those of the authors and do not represent those of the University of Sheffield Connected Health Cities study team, NHSA, NHS, NIHR, or the Department of Health and Social Care. CUREd data were provided in anonymised form; this study has been screened to ensure patient confidentiality was maintained. We would like to thank Nils Gutacker, Jamie Miles, Rebecca Leonard, Eilís Keeble, Rob Konstant-Hambling, Neil Prockter, Wataru Suzuki, and the Emergency Care for Frail Older People team for their valuable comments.

Contributors

AS and LM conceived the study, developed the methodological approach, did the analyses, and wrote the first draft of the manuscript. TG and AS did the literature review. TS and SM constructed the dataset, and AS, LM, TS, and SM accessed and verified the data. All authors contributed to interpretation of the data and critical revision of the manuscript and approved the final version. AS, LM, TS, and SM had access to the raw data. The corresponding author had final responsibility for the decision to submit for publication.

Declaration of interests

AS, LM, and SC report grants from the National Institute of Health Research (NIHR) during the conduct of the study. SM reports grants from the NIHR and NIHR Yorkshire and Humber Applied Research Centre during the conduct of the study. All other authors declare no competing interests.

Supplementary Material

Supplementary appendix
mmc1.pdf (1.1MB, pdf)

References

  • 1.Clegg A, Bates C, Young J. Development and validation of an electronic frailty index using routine primary care electronic health record data. Age Ageing. 2016;45:353–360. doi: 10.1093/ageing/afw039. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Gilbert T, Neuburger J, Kraindler J. Development and validation of a Hospital Frailty Risk Score focusing on older people in acute care settings using electronic hospital records: an observational study. Lancet. 2018;391:1775–1782. doi: 10.1016/S0140-6736(18)30668-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.McAlister F, van Walraven C. External validation of the Hospital Frailty Risk Score and comparison with the Hospital-patient One-year Mortality Risk Score to predict outcomes in elderly hospitalised patients: a retrospective cohort study. BMJ Qual Saf. 2019;28:284–288. doi: 10.1136/bmjqs-2018-008661. [DOI] [PubMed] [Google Scholar]
  • 4.McAlister FA, Lin M, Bakal JA. Prevalence and postdischarge outcomes associated with frailty in medical inpatients: impact of different frailty definitions. J Hosp Med. 2019;14:407–410. doi: 10.12788/jhm.3174. [DOI] [PubMed] [Google Scholar]
  • 5.McAlister FA, Savu A, Ezekowitz JA, Armstrong PW, Kaul P. The Hospital Frailty Risk Score in patients with heart failure is strongly associated with outcomes but less so with pharmacotherapy. J Intern Med. 2020;287:322–332. doi: 10.1111/joim.13002. [DOI] [PubMed] [Google Scholar]
  • 6.Redfern OC, Harford M, Gerry S, Prytherch D, Watkinson PJ. Frailty and unplanned admissions to the intensive care unit: a retrospective cohort study in the UK. Intensive Care Med. 2020;46:1512–1513. doi: 10.1007/s00134-020-06020-7. [DOI] [PubMed] [Google Scholar]
  • 7.Rauch J, Denter M, Hübner U. Use of emergency departments by frail elderly patients: temporal patterns and case complexity. Stud Health Technol Inform. 2019;267:215–223. doi: 10.3233/SHTI190830. [DOI] [PubMed] [Google Scholar]
  • 8.Bruno RR, Wernly B, Flaatten H, Schölzel F, Kelm M, Jung C. The Hospital Frailty Risk Score is of limited value in intensive care unit patients. Crit Care. 2019;23:239. doi: 10.1186/s13054-019-2520-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Smith RJ, Reid DA, Santamaria JD. Frailty is associated with reduced prospect of discharge home after in-hospital cardiac arrest. Intern Med J. 2019;49:978–985. doi: 10.1111/imj.14159. [DOI] [PubMed] [Google Scholar]
  • 10.Mitsutake S, Ishizaki T, Tsuchiya-Ito R. Associations of hospital discharge services with potentially avoidable readmissions within 30 days among older adults after rehabilitation in acute care hospitals in Tokyo, Japan. Arch Phys Med Rehabil. 2020;101:832–840. doi: 10.1016/j.apmr.2019.11.019. [DOI] [PubMed] [Google Scholar]
  • 11.Kundi H, Popma JJ, Reynolds MR. Frailty and related outcomes in patients undergoing transcatheter valve therapies in a nationwide cohort. Eur Heart J. 2019;40:2231–2239. doi: 10.1093/eurheartj/ehz187. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Kundi H, Noseworthy PA, Valsdottir LR. Relation of frailty to outcomes after catheter ablation of atrial fibrillation. Am J Cardiol. 2020;125:1317–1323. doi: 10.1016/j.amjcard.2020.01.049. [DOI] [PubMed] [Google Scholar]
  • 13.Tessier L, Guilcher SJT, Bai YQ, Ng R, Wodchis WP. The impact of hospital harm on length of stay, costs of care and length of person-centred episodes of care: a retrospective cohort study. CMAJ. 2019;191:E879–E885. doi: 10.1503/cmaj.181621. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Mitchell R, Draper B, Brodaty H. An 11-year review of hip fracture hospitalisations, health outcomes, and predictors of access to in-hospital rehabilitation for adults ≥ 65 years living with and without dementia: a population-based cohort study. Osteoporos Int. 2020;31:465–474. doi: 10.1007/s00198-019-05260-8. [DOI] [PubMed] [Google Scholar]
  • 15.Sigurdsson MI, Helgadottir S, Long TE. Association between preoperative opioid and benzodiazepine prescription patterns and mortality after noncardiac surgery. JAMA Surg. 2019;154 doi: 10.1001/jamasurg.2019.1652. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Olafsson HB, Sigurdarson GA, Christopher KB, Karason S, Sigurdsson GH, Sigurdsson MI. A retrospective cohort study on the association between elevated preoperative red cell distribution width and all-cause mortality after noncardiac surgery. Br J Anaesth. 2020;124:718–725. doi: 10.1016/j.bja.2020.02.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kwok CS, Zieroth S, Van Spall HGC. The Hospital Frailty Risk Score and its association with in-hospital mortality, cost, length of stay and discharge location in patients with heart failure short running title: frailty and outcomes in heart failure. Int J Cardiol. 2020;300:184–190. doi: 10.1016/j.ijcard.2019.09.064. [DOI] [PubMed] [Google Scholar]
  • 18.Mohamed MO, Sharma PS, Volgman AS. Prevalence, outcomes, and costs according to patient frailty status for 2.9 million cardiac electronic device implantations in the United States. Can J Cardiol. 2019;35:1465–1474. doi: 10.1016/j.cjca.2019.07.632. [DOI] [PubMed] [Google Scholar]
  • 19.Malik AH, Yandrapalli S, Zaid S. Impact of frailty on mortality, readmissions, and resource utilization after TAVI. Am J Cardiol. 2020;127:120–127. doi: 10.1016/j.amjcard.2020.03.047. [DOI] [PubMed] [Google Scholar]
  • 20.Deharo P, Bisson A, Herbert J. Impact of Sapien 3 balloon-expandable versus Evolut R self-expandable transcatheter aortic valve implantation in patients with aortic stenosis: data from a nationwide analysis. Circulation. 2020;141:260–268. doi: 10.1161/CIRCULATIONAHA.119.043971. [DOI] [PubMed] [Google Scholar]
  • 21.Deharo P, Bisson A, Herbert J. Valve-in-valve transcatheter aortic valve implantation after failed surgically implanted aortic bioprosthesis versus native transcatheter aortic valve implantation for aortic stenosis: data from a nationwide analysis. Arch Cardiovasc Dis. 2020 doi: 10.1016/j.acvd.2020.04.005. published online June 9. [DOI] [PubMed] [Google Scholar]
  • 22.University of Sheffield CUREd research database: how to access data or collaborate. 2019. https://www.sheffield.ac.uk/scharr/research/centres/cure/projects/cured-how-access-data
  • 23.Laudicella M, Li Donni P, Smith PC. Hospital readmission rates: signal of failure or success? J Health Econ. 2013;32:909–921. doi: 10.1016/j.jhealeco.2013.06.004. [DOI] [PubMed] [Google Scholar]
  • 24.Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–383. doi: 10.1016/0021-9681(87)90171-8. [DOI] [PubMed] [Google Scholar]
  • 25.Saunders CL, Abel GA, El Turabi A, Ahmed F, Lyratzopoulos G. Accuracy of routinely recorded ethnic group information compared with self-reported ethnicity: evidence from the English Cancer Patient Experience survey. BMJ Open. 2013;3 doi: 10.1136/bmjopen-2013-002882. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Mohammed MA, Deeks JJ, Girling A. Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals. BMJ. 2009;338:b780. doi: 10.1136/bmj.b780. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Ruiz M, Bottle A, Long S, Aylin P. Multi-morbidity in hospitalised older patients: who are the complex elderly? PLoS One. 2015;10 doi: 10.1371/journal.pone.0145372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Banerjee J, Conroy S, O'Leary V. The Silver Book: quality care for older people with urgent emergency care needs. 2012. https://www.bgs.org.uk/resources/silver-book [DOI] [PubMed]
  • 29.Kwan JL, Lo L, Ferguson J. Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials. BMJ. 2020;370 doi: 10.1136/bmj.m3216. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary appendix
mmc1.pdf (1.1MB, pdf)

Data Availability Statement

Retrospective, deidentified data were obtained from the CUREd Research database (CUREdRQ0004) hosted by the CURE Group (University of Sheffield, Sheffield, UK). Data were provided under a data sharing agreement which prohibits onward sharing. Other researchers can make their own requests for CUREd data online.

RESOURCES