Skip to main content
BMJ Open logoLink to BMJ Open
. 2015 Feb 18;5(2):e007259. doi: 10.1136/bmjopen-2014-007259

A tool for prediction of risk of rehospitalisation and mortality in the hospitalised elderly: secondary analysis of clinical trial data

Anna Alassaad 1,2, Håkan Melhus 1, Margareta Hammarlund-Udenaes 3, Maria Bertilsson 4, Ulrika Gillespie 2, Johan Sundström 1,4
PMCID: PMC4336459  PMID: 25694461

Abstract

Objectives

To construct and internally validate a risk score, the ‘80+ score’, for revisits to hospital and mortality for older patients, incorporating aspects of pharmacotherapy. Our secondary aim was to compare the discriminatory ability of the score with that of three validated tools for measuring inappropriate prescribing: Screening Tool of Older Person's Prescriptions (STOPP), Screening Tool to Alert doctors to Right Treatment (START) and Medication Appropriateness Index (MAI).

Setting

Two acute internal medicine wards at Uppsala University hospital. Patient data were used from a randomised controlled trial investigating the effects of a comprehensive clinical pharmacist intervention.

Participants

Data from 368 patients, aged 80 years and older, admitted to one of the study wards.

Primary outcome measure

Time to rehospitalisation or death during the year after discharge from hospital. Candidate variables were selected among a large number of clinical and drug-specific variables. After a selection process, a score for risk estimation was constructed. The 80+ score was internally validated, and the discriminatory ability of the score and of STOPP, START and MAI was assessed using C-statistics.

Results

Seven variables were selected. Impaired renal function, pulmonary disease, malignant disease, living in a nursing home, being prescribed an opioid or being prescribed a drug for peptic ulcer or gastroesophageal reflux disease were associated with an increased risk, while being prescribed an antidepressant drug (tricyclic antidepressants not included) was linked to a lower risk of the outcome. These variables made up the components of the 80+ score. The C-statistics were 0.71 (80+), 0.57 (STOPP), 0.54 (START) and 0.63 (MAI).

Conclusions

We developed and internally validated a score for prediction of risk of rehospitalisation and mortality in hospitalised older people. The score discriminated risk better than available tools for inappropriate prescribing. Pending external validation, this score can aid in clinical identification of high-risk patients and targeting of interventions.

Keywords: Prediction model, Risk-estimation, INTERNAL MEDICINE, THERAPEUTICS (pharmacotherapy), GERIATRIC MEDICINE, Organisation of health services < HEALTH SERVICES ADMINISTRATION & MANAGEMENT


Strengths and limitations of this study.

  • The 80+ score is based on data from a population on which there are strong incentives to focus: patients at high risk of hospitalisation and also of mortality.

  • The score is constructed from a prediction model that includes aspects of pharmacotherapy. The use of drugs can be either positively or negatively causally related to a clinical outcome, and can also be important indicators for a certain condition, disease or circumstance.

  • Data from a limited number of patients being admitted to an acute internal medicine ward at one hospital only were used in the construction of the score. The generalisability of the score is therefore unknown.

  • The 80+ score was internally validated, but external validation is required before general use and recommendation.

Background

Hospitalisations of older people pose an increasing economic burden on healthcare systems in the developed world. During recent years, attempts have been made to identify risk factors for hospital readmissions in order to help target interventions and decrease readmission rates.1 2 Variables tested for their ability to predict readmissions have included patient demographic factors, medical comorbidity data, laboratory data, social determinants of health, patient functional status and prior use of healthcare services. However, the patients’ medication use has rarely been evaluated as potential predictors of readmissions. As adverse drug reactions are the main cause of up to a fourth of hospital admissions3–5 and are ranked as the fourth to sixth leading cause of death in the USA,6 this is surprising. In older people, multiple coexisting diagnoses and concomitant multidrug use are common. This group is also, due to pharmacokinetic and pharmacodynamic changes, at increased risk of adverse drug reactions7 8 and, hence, hospitalisations and mortality. For this population in particular, the use of medications should be considered as a potential prognostic factor for revisits to hospital and mortality.

There are several tools available for assessment of appropriateness of prescribing in older people,9–16 which can be used prospectively as guides to appropriate prescribing or retrospectively for evaluation of the quality of prescribing.11 17 18 The tools are either checklist-based or judgement-based. Examples of checklist-based tools are STOPP (Screening Tool of Older Person's Prescriptions), identifying drugs that should be avoided in certain situations, and START (Screening Tool to Alert doctors to Right Treatment), identifying irrational prescribing omissions.11 Medication Appropriateness Index (MAI)15 is a validated judgement-based tool and includes 10 aspects of appropriateness of prescribing: indication, effectiveness, dosage, correct and practical directions, drug–drug and drug–disease interactions, duplication, duration and costs. These tools have mainly been developed through literature search and expert opinion.11–14 19–21 However, the association between inappropriate medication use in older people and poor health outcomes still remains uncertain. The evidence for a link between the tools and clinical outcomes is not convincing for any of them.22–25 In Sweden, as an attempt to improve the quality of prescribing and reduce drug-related morbidity, a number of drugs and drug classes have been recognised as inappropriate to elderly people (Swedish Association of Local Authorities and Regions (SALAR) drugs),16 and there is a national initiative aiming to reduce the prescribing of these drugs with economic reimbursement as incentives. The association between the prescribing of these drugs and negative clinical outcome has not been investigated.

The aim of this study was to construct a tool for estimating risk of revisits to hospital or mortality for older people, incorporating aspects of pharmacotherapy. The secondary aim was to compare the discriminatory ability of this tool, or score, with three validated tools for appropriate prescribing: STOPP, START and MAI and with the SALAR drug list.

Methods

Study participants and data

Patient data from a prospective randomised controlled trial (RCT) were used.22 26 The main objective of the RCT was to study the effects of adding a ward-based pharmacist service to the healthcare team on clinical outcomes (number of rehospitalisations; readmissions or emergency department visits) for elderly patients. Four hundred patients, aged 80 years and older and acutely admitted to the internal medicine wards at Uppsala University Hospital, were included and randomised in the control or intervention group. The patients in the intervention group received an enhanced pharmacist service during the hospital admission. All patients were followed for 12 months after hospital discharge, and the number of and time for revisits to hospital and/or mortality was recorded. Each participant gave written informed consent. In this study, the group assignment was not taken into consideration in the analyses.

Outcome variables

A composite variable (combining the event of an unplanned rehospitalisation (emergency department visit or readmission) or death during the 12-month follow-up period) was chosen as the end point for the analysis. The outcome variable in the regression analysis and the goodness-of-fit analysis was the time to the end point from the day of discharge from index admission. The outcome variable in the assessment of discriminatory ability was the occurrence of an event (ie, the end point).

Statistical analyses

Identification of risk factors

Candidate variables were selected based on a combination of clinical judgement and statistical properties of the variables. Clinical and drug variables were included. The selected clinical variables were: gender, age, renal function (estimated glomerular filtration rate (eGFR)), level of social support and medical history (heart failure, diabetes mellitus, pulmonary disease (chronic obstructive pulmonary disease (COPD) or asthma), arrhythmia, malignant disease (past or present), coronary artery disease, cerebral vascular lesion (past), myocardial infarction (past), hypertension and dementia). The drug variables were the patients’ prescribed medications, categorised into groups based on the Anatomical Therapeutic Chemical (ATC) classification system27 and on similar effect and risk in elderly people, or categorised according to the SALAR drug list (SALAR drug list presented in etable 1). In case a SALAR drug variable was the same as an ATC-based category variable, one of them was excluded. The drug variables were also potentially inappropriate medications (identified by STOPP) and potential prescription omissions (identified by START). Variables with less than 10 patients in the smallest group were excluded from further analyses. In order to detect potential redundancies among the variables, a principal component analysis (PCA) was performed. If two variables were collinear, the variable with the most balanced categories were included for further study. The remaining clinical, drug-disease and drug variables were then subject to a backward stepwise Cox regression likelihood-ratio elimination procedure. To minimise type I errors, the p value limit for inclusion was set to 0.01. The set of variables extracted from this analysis, that is, the risk factors, makes up the components of our new score.

Development of point score system

We developed a point score system for risk estimation, the ‘80+ score’, following the Framingham Heart Study approach.28 29 First, the continuous independent variable, eGFR, was organised into categories representing different levels of renal function. Reference values were determined for each of these categories. The remaining independent variables were modelled by sets of dichotomous indicator variables. For each variable, a base category was determined (using their most prevalent category). We then calculated how far each category was from the base category by dividing the regression unit for the category by a constant (B) that was common to all variables. The resulting quotient was rounded to the nearest whole number, which was used as the points associated with that category. The point score system is the 80+ score. Last, the risk associated with each level of the score was calculated. For this last step, the following formula was used: risk Inline graphic where S0(t) was the average 1-year event-free rate, and ∑ βχmean was the sum of the variables’ regression coefficients (β) multiplied with the means or proportions of the variables in the sample (table 1). ∑ βχ was approximated from multiplying the constant for the model (B) with the point score and adding back the base value (ie, the reference value for the base category) for the continuous variable eGFR.

Table 1.

Data used for calculation of point score system

Proportion of patients in each category β W and Wref for each category Regression unit for each category Point score
eGFR* −0.012  
 >90 mL/min 0.014 105 mL/min=Wref 0
 60–89 mL/min 0.128 74.5 mL/min 0.397 1
 30–59 mL/min 0.552 54.5 mL/min 0.787 2
 <30 mL/min 0.307 17.5 mL/min 1.138 3
Social support  
 Living alone or with spouse 0.818 0.481 0=Wref 0 0
 Nursing home 0.182 1 0.481 1
Pulmonary disease† 0.607  
 No 0.878 0=Wref 0 0
 Yes 0.122 1 0.607 2
Malignant disease‡ 0.506  
 No 0.834 0=Wref 0 0
 Yes 0.166 1 0.506 1
Prescription of drug for peptic ulcer and GERD 0.362  
 No 0.674 0=Wref 0 0
 Yes 0.326 1 0.362 1
Prescription of opioid drug 0.724  
 No 0.821 0=Wref 0 0
 Yes 0.179 1 0.724 2
Prescription of non-TCA-antidepressant drug −0.558  
 No 0.791 0=Wref 0 0
 Yes 0.209 1 −0.558 −2
The average 1-year event-free rate=0.3215§

Regression unit for each category=β(W−Wref).

Point score=β(W−Wref)/B.

*Cockroft-Gault formula eGFR.

†Asthma or COPD.

‡Past or present.

§The Kaplan–Meier estimate of the event-free rate at the mean values of the risk factors.

COPD, chronic obstructive pulmonary disease; eGFR, estimated glomerular filtration rate; GERD, gastroesophageal reflux disease; TCA, tricyclic antidepressant.

The goodness-of-fit of the 80+ score was assessed by the Grønnesby-Borgan test30 and calibration was assessed by plotting predicted risk versus observed risk. The discriminatory ability of the 80+ score was assessed using C-statistics. C-statistics, which can range from 0.5 (no discrimination) to 1 (perfect discrimination), provides the probability of the model giving a higher predicted risk to the patient that will have an event than the one that will not. We internally validated the score using an enhanced bootstrap with 1000 iterations, in order to quantify and account for the extent of overoptimism in our prediction model.31 We present optimism-corrected C-statistics for the 80+ score. The total STOPP, START and MAI scores and the total number of prescribed SALAR drugs were calculated for each patient. Their discriminatory abilities were also assessed using C-statistics, and these were compared with the C-statistic for the 80+ score.

The effect of the pharmacist intervention was not adjusted for in the regression analyses. The reason for this was that the intervention directly affected the results of the STOPP, START and MAI scores as well as the frequency of prescribing of SALAR drugs and the overall number of drugs. As a sensitivity analysis, the C-statistic for the 80+ score was calculated for the control group patients only. The proportionality of hazards was assessed using Schoenfeld's residuals and by inspecting cumulative incidence curves. We investigated the linearity of the association between eGFR and the outcomes by investigating models also including an ordinal variable for eGFR. Two-way interactions between the final set of variables in the score were investigated as deviations from multiplicativity. The score variables were also tested for the association with mortality only. All analyses were performed in IBM SPSS Statistics V.21 and STATA V.13.

Results

Out of the 400 included and randomised patients in the RCT, 368 were evaluable for further analyses (27 patients died during the index admission and 5 patients wished to be excluded after the randomisation). Table 2 presents baseline characteristics for these patients. Two hundred and fifty (68%) patients had an event (ie, either a revisit to the hospital or death) during the 12 months follow-up period. In the group of patients that had an event, 212 (85%) were rehospitalised and the rest (15%) died.

Table 2.

Baseline characteristics at the time of index hospital admission

Baseline characteristics All patients (n=368)
Age, mean (SD), years 86.7 (4.1)
Female, N (%) 216 (58.7)
Body weight, mean (SD), kg
 Women 61.3 (13.3)
 Men 71.3 (12.5)
Laboratory values
 eGFR*, mean (SD), mL/min/1.73 m2 40.3 (18.5)
 Haemoglobin level, mean (SD), mg/mL
 Sodium level, N (%)
  Hyponatraemia (<137 mEq/L) 112 (30.4)
  Within range (137–145 mEq/L) 247 (67.1)
  Hypernatraemia (>145 mEq/L) 9 (2.4)
 Potassium level, N (%)
  Hypokalaemia (<3.5 mEq/L) 49 (13.3)
  Within range (3.5–5 mEq/L) 295 (80.2)
  Hyperkalaemia (>5 mEq/L) 24 (6.5)
Social support, N (%)
 Living alone or with spouse 301 (81.8)
 Living in a nursing home 67 (18.2)
Medical history, N (%)
 Heart failure 116 (31.5)
 Diabetes 87 (23.6)
 Pulmonary disease (asthma or COPD) 44 (12.0)
 Arrhythmia 125 (34.0)
 Malignant disease (past and present) 54 (14.7)
 Coronary artery disease 114 (31.0)
 Cerebral vascular lesion (past) 57 (15.5)
 Myocardial infarct (past) 87 (23.6)
 Hypertension 147 (39.9)
 Dementia 47 (12.8)
Annual incidence of rehospitalisations (95% CI) 1.15 (1.01 to 1.32)
Annual incidence of mortality (95% CI) 0.40 (0.33 to 0.48)

*Cockroft-Gault formula eGFR.

COPD, chronic obstructive pulmonary disease; eGFR, estimated glomerular filtration rate.

Identification of risk factors

eTable 2A, B lists all variables taken into consideration in the analysis. Fourteen clinical variables and 64 drug variables met the inclusion criteria and were subject to the PCA. Three variables were excluded after the PCA: ‘B03B vitamin B12 and folic acid’ (collinear with ‘STOPP h5; long-term opiates in patients with recurrent falls’), ‘G03C oestrogens’ and ‘R03AC drugs for obstructive airway diseases; selective β-2-agonists’ (both collinear with R03B ‘drugs for obstructive airway diseases; anticholinergics +corticosteroids’).

Seventy-five variables were entered into the backward stepwise Cox regression. This procedure resulted in seven statistically significant variables, or risk factors, each having an individual association with the outcome variable. Four of the risk factors were clinical while three were drug-specific. Statistical information about the risk factors is presented in table 3. Past or present malignant disease and presence of pulmonary disease were both associated with an increased risk of rehospitalisation or mortality, as was impaired renal function. Further, living in a nursing home was linked to a higher risk of revisits to the hospital or death than living alone or with a spouse. Being prescribed a drug for peptic ulcer and gastroesophageal reflux disease (GERD) was associated with an increased risk (a vast majority of these prescriptions, 115 out of 120 (96%), were of a proton-pump inhibitor), as well as being prescribed a drug from the opioid class. Having an antidepressant drug (tricyclic antidepressants (TCAs) not included in this variable) was conversely associated with a lower risk.

Table 3.

Statistical information on 80+ score variables

Regression coefficient (SE) Mean or proportion p Value HR 95% CI for HR
eGFR* (per mL/min/1.73 m2) −0.012 (0.004) 40.285 0.001 0.988 0.981 to 0.995
Social support (living in nursing home vs living alone or with spouse) 0.481 (0.162) 0.182 0.003 1.617 1.176 to 2.224
Pulmonary disease† (vs not) 0.607 (0.177) 0.122 0.001 1.834 1.296 to 2.595
Malignant disease‡ (vs not) 0.506 (0.166) 0.166 0.002 1.659 1.198 to 2.297
Prescription of drug for peptic ulcer and GERD (vs not) 0.362 (0.135) 0.326 0.008 1.436 1.101 to 1.872
Prescription of opioid drug (vs not) 0.724 (0.157) 0.179 0.000 2.063 1.517 to 2.806
Prescription of non-TCA-antidepressant drug (vs not) −0.558 (0.170) 0.209 0.001 0.573 0.410 to 0.799

Variables selected from backward stepwise Cox regression.

*Cockroft-Gault formula eGFR.

†Asthma or COPD.

‡Past or present.

COPD, chronic obstructive pulmonary disease; eGFR, estimated glomerular filtration rate; GERD, gastroesophageal reflux disease; TCA, tricyclic antidepressant.

Development of the point score system

Table 1 presents reference values (W and Wref) and regression units of each category of each risk factor variable—data that were used for development of point score. eGFR was organised into four levels of renal function, with >90 mL/min being considered a normal renal function. As reference values for these categories, the midpoints were chosen. For the other risk factor variables, the categories were assigned the value of 0 or 1. A referent risk factor profile was determined: a patient with normal renal function, living alone or with a spouse, without diagnoses for pulmonary disease or malignant disease and with no prescription of drug for peptic ulcer or GERD, no prescription of opioids and no prescription of antidepressant drugs. The constant for the point score system (B) was selected, which was the regression coefficient for the variable ‘drugs for peptic ulcer and GERD’, 0.362. By dividing the regression unit for each category by B, it was computed how far the categories were from the base category. The point scores for each category for each risk factor variable were thus calculated. The point scores for the 80+ score system are presented in the right-hand column in table 1.

The point total is the summated score for each patient. For example, a patient with a renal function of 65 mL/min, living in a nursing home, diagnosed with COPD and prescribed a drug for peptic ulcer and GERD, would be given a point total of 1+1+2+1=5. The estimated risk associated with each point total in the 80+ score is shown in table 4. The estimated risk was computed using the formula described in the methods, where the ∑βχmean was calculated to—0.106842 and the ∑βχ was approximated by multiplying B with the points and adding back the base value for eGFR (−0.012×105 mL/min). An example of risk estimation from the Cox regression as well as from the point score system is illustrated in the online supplementary material.

Table 4.

Estimate of risk for each point total

Point total Estimate of risk
−2 0.1594
−1 0.2207
0 0.3010
1 0.4021
2 0.5223
3 0.6539
4 0.7821
5 0.8879
6 0.9568
7 0.9890
8 0.9985
9 0.9999
10 >0.9999

The goodness-of-fit of the 80+ score was good and is illustrated in figure 1. This was confirmed by the Grønnesby-Borgan test (p=0.49). A model including both an ordinal and a continuous variable for eGFR did not provide a better fit than a model with only the continuous variable (likelihood-ratio test p=0.11). There was some evidence of interactions between eGFR and the drug use variables ‘drugs for peptic ulcer and GERD’ and ‘non-TCA-antidepressants’, but the groups were very small. No deviations from proportionality were observed (all Schoenfeld's test p>0.21).

Figure 1.

Figure 1

Predicted risk versus observed risk for rehospitalisation or death.

When tested for their association with mortality only, the variables pulmonary disease, prescription of drug for peptic ulcer and GERD, and prescription of the non-TCA-antidepressant drug were not predictors of this outcome (p>0.05), while the link between social support and this outcome was strong (HR 3.107, 95% CI 2.081 to 4.640). The remaining variables showed similar predictive ability for the mortality outcome as they did for the combined outcome (rehospitalisation and mortality). Results are presented in etable 3.

A logistic regression model with the seven variables of the 80+ score as independent variables had a pseudo-R2 of 0.13. The 80+ score demonstrated a satisfying discriminatory ability of the outcome, with a C-statistic of 0.715 (figure 2). The optimism was 0.001, rendering an optimism-corrected C-statistic of 0.714 for the 80+ score. This means that a patient with an event (revisit to the hospital or death) had a 71% probability of being given a higher risk score than a patient with no event. Figure 2 also shows that STOPP and START scores and the SALAR drug list were basically non-discriminating for the chosen outcome (with C-statistics just above 0.5). When tested in the control group only, the 80+ score had a C-statistic of 0.71, which is similar to the value for the group as a whole.

Figure 2.

Figure 2

Area under the curve of sensitivity versus 1-specificity for rehospitalisation or death. STOPP, Screening Tool of Older Person's Prescriptions; START, Screening Tool to Alert doctors to Right Treatment; SALAR, Swedish Association of Local Authorities and Regions; MAI, Medication Appropriateness Index.

Discussion

Using a clinical trial database of hospitalised patients, aged 80 years and above, the most relevant factors for identifying those at risk of an adverse outcome were identified. A simple scoring system intended for clinical use was constructed and internally validated, pending validation in an independent cohort. The score is suggested as a tool for identifying patients at highest risk of readmissions and mortality, and ultimately as an aid in clinical decision-making for improving outcomes in these patients. Increasing age, usage of medical services and poor health pose a risk of rehospitalisation and mortality,2 and hence there are strong incentives for focusing on this population.

Various risk factors for rehospitalisation and mortality have previously been identified in prediction models based on data from a variety of populations and settings, and with different candidate variables.32–39 The 80+ risk score has a higher discriminatory ability for risk of rehospitalisation and mortality than most other prediction models of today. This is most likely due to the fact that we included drug variables as candidate variables—the drugs can either be causally related to the outcomes or serve as important proxies for certain conditions, diseases or circumstances. Further, the precision was most likely maximised by developing the score using data from a narrowly defined population—these patients were all aged 80 years or older and had been acutely admitted to an internal medicine ward. In the majority of risk prediction models of today, rehospitalisation has been chosen as the outcome measure, but this carries a high risk of bias due to competing risk by death. Therefore, in this study, event-free (ie, no emergency department visit or readmission) survival was used as the end point.

The use of drugs deemed inappropriate has been associated with adverse drug events40 41 and it is often proposed that patients prescribed inappropriate medications should be prioritised for interventions—aimed at improving the quality of prescribing—in order to reduce the risk of unwanted clinical outcomes. However, in this set of patient data, neither the STOPP nor START tools had an ability to discriminate between patients at risk of rehospitalisation or mortality that was better than chance. The numbers of prescribed SALAR drugs showed similar results. MAI, being a judgement-based tool, has a moderate discriminatory ability for risk in this population. However, owing to its time-consuming nature, with assessment times per patient of up to 30 min, MAI is not suitable as a screening tool for patients in clinical practice. As has already been stated, none of the STOPP, START and MAI scores or the SALAR drug system are designed as risk scores. Still, the lack of consistent evidence for their association with clinical outcomes is notable and needs to be further investigated.

Pulmonary disease as well as impaired renal function are known risk factors for readmissions to hospital.32–35 These variables also emerged as risk factors in our population. Many nursing home residents have multiple morbidities and are high consumers of healthcare,42 which explains the prognostic ability of this variable. The unique finding in this study is that three drug variables were individually related to the clinical outcome in the multivariate model: being prescribed a drug for peptic ulcer and GERD or being prescribed an opioid both appeared to increase the risk, while being prescribed an antidepressant drug was associated with a lower risk. The use of proton-pump inhibitors have in several studies been associated with various adverse events, such as Clostridium difficile infections and pneumonia,43 but another explanation for their association with the outcome variable is that the patients being prescribed these drugs have a history of ulcer (which was not among the candidate variables), which is a risk factor itself. This drug group may also function as a proxy for patients with multiple other comorbidities and polypharmacy since these patients have a potential need for preventive treatment for gastric disorders.43 Similarly, opioids can, as well as being a risk drug due to their potential to cause adverse drug reactions, be an indicator for pain or frailty (which are potential risk factors in themselves). The prescribing of non-TCA-antidepressants aims to provide relief from psychological symptoms and increase the patient's general well-being, which supposedly has a protective effect on rehospitalisation and mortality. An alternative explanation for the negative association between this variable and the outcome is that these drugs may be given more often to physically healthier patients with a longer life expectancy. The rationale for exclusion of TCAs in the antidepressant variable is that the safety profile in elderly people for these drugs differs from that of the other antidepressants. TCA drugs were not a candidate variable in the analyses—since only five patients were prescribed these drugs—but were included in the ‘SALAR a’ variable. The strong link between the level of social support and mortality is not surprising since patients often move to nursing homes for the last part of their lives. Interestingly, pulmonary disease or being prescribed a drug for peptic ulcer or GERD or a non-TCA-antidepressant drug was a predictor mainly for rehospitalisation.

A score for risk-identification purposes should have a satisfying predictive ability in the target population, and it should use data that are clinically readily available.1 44 The 80+ score meets these criteria. A simple and user-friendly point score system like this can quickly and easily identify high-risk patients. Yet, in order for this information to be useful, translation into suggested actions for reduction of this risk for these patients is crucial. This undertaking is obviously multifactorial. Nevertheless, by focusing on the patients with the highest risk, a pharmaceutical intervention, or other quality improvement effort, can be targeted more efficiently. For example, patients with COPD or asthma may benefit from a comprehensive patient education,45 and patients being prescribed an opioid or a drug for peptic ulcer or GERD may benefit from a thorough medication review.

The 80+ score was internally validated, but remains to be externally validated in another population before it can be generally recommended. A few limitations with this study need attention. Prior hospital visits have in several studies been associated with risk of rehospitalisation.33 34 36 38 39 This information was not available in this data set and has therefore not been included as a candidate variable. However, a potential weakness of having prior hospital visits as a variable in a clinical score is that this information may not be easily available on the patient’s admission to hospital. Another limitation is that the 80+ score is based on data from a limited number of patients being admitted to an acute internal medicine ward at one hospital only. This makes the generalisability unknown and increases the need for external validation. Finally, the limited sample size forced us to use the whole data set (both intervention and control group patients) for the development of the score. In this paper, we have discussed the role of prescribed drugs as potential risk factors for adverse clinical outcomes. However, it should be noted that the analyses do not take the potential risks of suboptimal use of drugs into consideration. Suboptimal drug use, such as patient non-adherence to treatment or lack of correct and complete transfer of information when patients are transitioned between different levels of healthcare, can cause adverse drug events and are risk factors of drug-related morbidity.46–48

Conclusion

We have developed and internally validated a score intended for use in clinical practice to identify the hospitalised elderly patients at highest risk of rehospitalisation and mortality, accounting for pharmacotherapy. The score outperforms scores for inappropriate medication use in risk-prediction ability and can ultimately aid in clinical decision-making for improving outcomes in elderly patients.

Footnotes

Contributors: AA, JS, MB and HM were involved in study concepts and design. AA, JS, MB, UG, HM and MH-U were involved in acquisition, analysis or interpretation of data. AA and JS were involved in the drafting of the manuscript. AA, HM, MH-U, MB, UG and JS were involved in a critical revision of the manuscript for important intellectual content. AA, JS and MB were involved in statistical analysis. HM and AA obtained funding. HM and UG provided administrative, technical or material support. JS, HM, MH-U and UG were involved in study supervision. AA had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Funding: The study was funded by grants from Uppsala University Hospital.

Competing interests: None.

Ethics approval: The study protocol was approved by the Uppsala Regional Ethics Committee (Trial Registration: clinicaltrials.gov Identifier: NCT00661310).

Provenance and peer review: Not commissioned; externally peer reviewed.

Data sharing statement: The statistical code and data set are available from the corresponding author.

References

  • 1.Kansagara D, Englander H, Salanitro A et al. . Risk prediction models for hospital readmission: a systematic review. JAMA 2011;306:1688–98. 10.1001/jama.2011.1515 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Vest JR, Gamm LD, Oxford BA et al. . Determinants of preventable readmissions in the United States: a systematic review. Implement Sci 2010;5:88 10.1186/1748-5908-5-88 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Hallas J, Gram LF, Grodum E et al. . Drug related admissions to medical wards: a population based survey. Br J Clin Pharmacol 1992;33:61–8. 10.1111/j.1365-2125.1992.tb04001.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Mannesse CK, Derkx FH, de Ridder MA et al. . Contribution of adverse drug reactions to hospital admission of older patients. Age Ageing 2000;29:35–9. 10.1093/ageing/29.1.35 [DOI] [PubMed] [Google Scholar]
  • 5.Col N, Fanale JE, Kronholm P. The role of medication noncompliance and adverse drug reactions in hospitalizations of the elderly. Arch Intern Med 1990;150:841–5. 10.1001/archinte.1990.00390160093019 [DOI] [PubMed] [Google Scholar]
  • 6.Lazarou J, Pomeranz BH, Corey PN. Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. JAMA 1998;279:1200–5. 10.1001/jama.279.15.1200 [DOI] [PubMed] [Google Scholar]
  • 7.Routledge PA, O'Mahony MS, Woodhouse KW. Adverse drug reactions in elderly patients. Br J Clin Pharmacol 2004;57:121–6. 10.1046/j.1365-2125.2003.01875.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Montamat SC, Cusack BJ, Vestal RE. Management of drug therapy in the elderly. N Engl J Med 1989;321:303–9. 10.1056/NEJM198908033210507 [DOI] [PubMed] [Google Scholar]
  • 9.Beers MH. Explicit criteria for determining potentially inappropriate medication use by the elderly. An update. Arch Intern Med 1997;157:1531–6. 10.1001/archinte.1997.00440350031003 [DOI] [PubMed] [Google Scholar]
  • 10.American Geriatrics Society 2012 Beers Criteria Update Expert Panel. American Geriatrics Society updated Beers Criteria for potentially inappropriate medication use in older adults. J Am Geriatr Soc 2012;60:616–31. 10.1111/j.1532-5415.2012.03923.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Gallagher P, Ryan C, Byrne S et al. . STOPP (Screening Tool of Older Person's Prescriptions) and START (Screening Tool to Alert doctors to Right Treatment). Consensus validation. Int J Clin Pharmacol Ther 2008;46:72–83. 10.5414/CPP46072 [DOI] [PubMed] [Google Scholar]
  • 12.Laroche M-L, Charmes J-P, Merle L. Potentially inappropriate medications in the elderly: a French consensus panel list. Eur J Clin Pharmacol 2007;63:725–31. 10.1007/s00228-007-0324-2 [DOI] [PubMed] [Google Scholar]
  • 13.McLeod PJ, Huang AR, Tamblyn RM et al. . Defining inappropriate practices in prescribing for elderly people: a national consensus panel. CMAJ 1997;156:385–91. [PMC free article] [PubMed] [Google Scholar]
  • 14.Holt S, Schmiedl S, Thürmann PA. Potentially inappropriate medications in the elderly: the PRISCUS list. Dtsch Ärztebl Int 2010;107:543–51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Samsa GP, Hanlon JT, Schmader KE et al. . A summated score for the medication appropriateness index: development and assessment of clinimetric properties including content validity. J Clin Epidemiol 1994;47:891–6. 10.1016/0895-4356(94)90192-9 [DOI] [PubMed] [Google Scholar]
  • 16.Sammanhållen vård och omsorg om de mest sjuka äldre 2014.axd. http://www.skl.se/BinaryLoader.axd?OwnerID=dbf2c094-6870-4e16-8fbd-7db59f326f72&OwnerType=0&Name=PropertyEmbeddedImg_8696d165-8969-485b-a0cb-d17e48806b5c&FileName=Sammanh%c3%a5llen+v%c3%a5rd+och+omsorg+om+de+mest+sjuka+%c3%a4ldre+2014+-+%c3%b6verenskommelse.pdf&Attachment=False (accessed 26 May 2014).
  • 17.Fick DM, Cooper JW, Wade WE et al. . Updating the Beers criteria for potentially inappropriate medication use in older adults: results of a US consensus panel of experts. Arch Intern Med 2003;163:2716–24. 10.1001/archinte.163.22.2716 [DOI] [PubMed] [Google Scholar]
  • 18.Fialová D, Topinková E, Gambassi G et al. . Potentially inappropriate medication use among elderly home care patients in Europe. JAMA 2005;293:1348–58. 10.1001/jama.293.11.1348 [DOI] [PubMed] [Google Scholar]
  • 19.Gallagher P, Baeyens J-P, Topinkova E et al. . Inter-rater reliability of STOPP (Screening Tool of Older Persons’ Prescriptions) and START (Screening Tool to Alert doctors to Right Treatment) criteria amongst physicians in six European countries. Age Ageing 2009;38:603–6. 10.1093/ageing/afp058 [DOI] [PubMed] [Google Scholar]
  • 20.Barry PJ, Gallagher P, Ryan C et al. . START (screening tool to alert doctors to the right treatment)––an evidence-based screening tool to detect prescribing omissions in elderly patients. Age Ageing 2007;36:632–8. 10.1093/ageing/afm118 [DOI] [PubMed] [Google Scholar]
  • 21.Beers MH, Ouslander JG, Rollingher I et al. . Explicit criteria for determining inappropriate medication use in nursing home residents. UCLA Division of Geriatric Medicine. Arch Intern Med 1991;151:1825–32. 10.1001/archinte.1991.00400090107019 [DOI] [PubMed] [Google Scholar]
  • 22.Gillespie U, Alassaad A, Hammarlund-Udenaes M et al. . Effects of pharmacists’ interventions on appropriateness of prescribing and evaluation of the instruments’ (MAI, STOPP and STARTs’) ability to predict hospitalization––analyses from a randomized controlled trial. PLoS ONE 2013;8:e62401 10.1371/journal.pone.0062401 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Laroche ML, Charmes JP, Bouthier F et al. . Inappropriate medications in the elderly. Clin Pharmacol Ther 2009;85:94–7. 10.1038/clpt.2008.214 [DOI] [PubMed] [Google Scholar]
  • 24.Patterson SM, Hughes C, Kerse N et al. . Interventions to improve the appropriate use of polypharmacy for older people. Cochrane Database Syst Rev 2012;5:CD008165. [DOI] [PubMed] [Google Scholar]
  • 25.Spinewine A, Schmader KE, Barber N et al. . Appropriate prescribing in elderly people: how well can it be measured and optimised? Lancet 2007;370:173–84. 10.1016/S0140-6736(07)61091-5 [DOI] [PubMed] [Google Scholar]
  • 26.Gillespie U, Alassaad A, Henrohn D et al. . A comprehensive pharmacist intervention to reduce morbidity in patients 80 years or older: a randomized controlled trial. Arch Intern Med 2009;169:894–900. 10.1001/archinternmed.2009.71 [DOI] [PubMed] [Google Scholar]
  • 27.WHOCC—Structure and principles. http://www.whocc.no/atc/structure_and_principles/ (accessed 21 Aug 2014).
  • 28.Sullivan LM, Massaro JM, D'Agostino RB Sr. Presentation of multivariate data for clinical use: the Framingham Study risk score functions. Stat Med 2004;23:1631–60.doi:10.1002/sim.1742 [DOI] [PubMed] [Google Scholar]
  • 29.D'Agostino RB Sr, Vasan RS, Pencina MJ et al. . General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation 2008;117:743–53. 10.1161/CIRCULATIONAHA.107.699579 [DOI] [PubMed] [Google Scholar]
  • 30.Grønnesby JK, Borgan O. A method for checking regression models in survival analysis based on the risk score. Lifetime Data Anal 1996;2:315–28. 10.1007/BF00127305 [DOI] [PubMed] [Google Scholar]
  • 31.Harrell FE. Regression modeling strategies with applications to linear models, logistic regression, and survival analysis New York, NY: Springer New York, 2001. 10.1007/978-1-4757-3462-1 10.1007/978-1-4757-3462-1 [DOI] [Google Scholar]
  • 32.Burns R, Nichols LO. Factors predicting readmission of older general medicine patients. J Gen Intern Med 1991;6:389–93. 10.1007/BF02598158 [DOI] [PubMed] [Google Scholar]
  • 33.Smith DM, Giobbie-Hurder A, Weinberger M et al. . Predicting non-elective hospital readmissions: a multi-site study. Department of Veterans Affairs Cooperative Study Group on Primary Care and Readmissions. J Clin Epidemiol 2000;53:1113–18. 10.1016/S0895-4356(00)00236-5 [DOI] [PubMed] [Google Scholar]
  • 34.Stäck P, Forsberg B, Högberg M et al. . Risken för akut återinläggning kan förutsägas. http://www.lakartidningen.se/Functions/OldArticleView.aspx?articleId=18930 (accessed 11 Jun 2014). [PubMed]
  • 35.Phillips RS, Safran C, Cleary PD et al. . Predicting emergency readmissions for patients discharged from the medical service of a teaching hospital. J Gen Intern Med 1987;2:400–5. 10.1007/BF02596366 [DOI] [PubMed] [Google Scholar]
  • 36.Marcantonio ER, McKean S, Goldfinger M et al. . Factors associated with unplanned hospital readmission among patients 65 years of age and older in a Medicare managed care plan. Am J Med 1999;107:13–17. 10.1016/S0002-9343(99)00159-X [DOI] [PubMed] [Google Scholar]
  • 37.Van Walraven C, Dhalla IA, Bell C et al. . Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 2010;182:551–7. 10.1503/cmaj.091117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Hasan O, Meltzer DO, Shaykevich SA et al. . Hospital readmission in general medicine patients: a prediction model. J Gen Intern Med 2010;25:211–19. 10.1007/s11606-009-1196-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Donzé J, Aujesky D, Williams D et al. . Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern Med 2013;173:632–8. 10.1001/jamainternmed.2013.3023 [DOI] [PubMed] [Google Scholar]
  • 40.Gallagher PF, O'Connor MN, O'Mahony D. Prevention of potentially inappropriate prescribing for elderly patients: a randomized controlled trial using STOPP/START criteria. Clin Pharmacol Ther 2011;89:845–54. 10.1038/clpt.2011.44 [DOI] [PubMed] [Google Scholar]
  • 41.Fick DM, Mion LC, Beers MH et al. . Health outcomes associated with potentially inappropriate medication use in older adults. Res Nurs Health 2008;31:42–51. 10.1002/nur.20232 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Gordon AL, Franklin M, Bradshaw L et al. . Health status of UK care home residents: a cohort study. Age Ageing 2014;43:97–103. 10.1093/ageing/aft077 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Masclee GMC, Sturkenboom MCJM, Kuipers EJ. A benefit-risk assessment of the use of proton pump inhibitors in the elderly. Drugs Aging 2014;31:263–82. 10.1007/s40266-014-0166-4 [DOI] [PubMed] [Google Scholar]
  • 44.Krumholz HM, Brindis RG, Brush JE et al. . Standards for statistical models used for public reporting of health outcomes: an American Heart Association Scientific Statement from the Quality of Care and Outcomes Research Interdisciplinary Writing Group: cosponsored by the Council on Epidemiology and Prevention and the Stroke Council. Endorsed by the American College of Cardiology Foundation. Circulation 2006;113:456–62. 10.1161/CIRCULATIONAHA.105.170769 [DOI] [PubMed] [Google Scholar]
  • 45.Tommelein E, Mehuys E, Van Hees T et al. . Effectiveness of pharmaceutical care for patients with chronic obstructive pulmonary disease (PHARMACOP): a randomized controlled trial. Br J Clin Pharmacol 2014;77:756–66. 10.1111/bcp.12242 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Boockvar KS, Liu S, Goldstein N et al. . Prescribing discrepancies likely to cause adverse drug events after patient transfer. Qual Saf Health Care 2009;18:32–6. 10.1136/qshc.2007.025957 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Coleman EA, Smith JD, Raha D et al. . Posthospital medication discrepancies: prevalence and contributing factors. Arch Intern Med 2005;165:1842–7. 10.1001/archinte.165.16.1842 [DOI] [PubMed] [Google Scholar]
  • 48.Sokol MC, McGuigan KA, Verbrugge RR et al. . Impact of medication adherence on hospitalization risk and healthcare cost. Med Care 2005;43:521–30. 10.1097/01.mlr.0000163641.86870.af [DOI] [PubMed] [Google Scholar]

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES