Abstract
Background
There is growing interest for interventions aiming at preventing frailty progression or even to reverse frailty in older people, yet it is still unclear which frailty instrument is most appropriate for measuring change scores over time to determine the effectiveness of interventions. The aim of this prospective cohort study was to determine reproducibility and responsiveness properties of the Frailty Index (FI) and Frailty Phenotype (FP) in acutely hospitalized medical patients aged 70 years and older.
Methods
Reproducibility was assessed by Intra-Class Correlation Coefficients (ICC), standard error of measurement (SEM) and smallest detectable change (SDC); Responsiveness was assessed by the standardized response mean (SRM), and area under the receiver operating characteristic curve (AUC).
Results
At baseline, 243 patients were included with a median age of 76 years (range 70–98). The analytic samples included 192 and 187 patients in the three and twelve months follow-up analyses, respectively. ICC of the FI were 0.85 (95 % confidence interval [CI]: 0.76; 0.91) and 0.84 (95% CI: 0.77; 0.90), and 0.65 (95% CI: 0.49; 0.77) and 0.77 (95% CI: 0.65; 0.84) for the FP. SEM ranged from 5 to 13 %; SDC from 13 to 37 %. SRMs were good in patients with unchanged frailty status (< 0.50), and doubtful to good for deteriorated and improved patients (0.43–1.00). AUC’s over three months were 0.77 (95% CI: 0.69; 0.86) and 0.71 (95% CI: 0.62; 0.79) for the FI, and 0.68 (95% CI: 0.58; 0.77) and 0.65 (95% CI: 0.55; 0.74) for the FP. Over twelve months, AUCs were 0.78 (95% CI: 0.69; 0.87) and 0.82 (95% CI: 0.73; 0.90) for the FI, and 0.78 (95% CI: 0.69; 0.87) and 0.75 (95% CI: 0.67; 0.84) for the FP.
Conclusions
The Frailty Index showed better reproducibility and responsiveness properties compared to the Frailty Phenotype among acutely hospitalized older patients.
Supplementary Information
The online version contains supplementary material available at 10.1186/s12877-021-02444-y.
Keywords: Frail; Psychometric properties; Measurement properties; Reliability, Internal Medicine; Geriatric care
Background
Frailty is a medical condition of increased vulnerability and poor resolution of homeostasis after a stressor event as a consequence of cumulative decline in many physiological systems during a lifetime [1]. Around 40 % of the hospitalized older patients are frail which is associated with poor health outcomes, such as functional decline, hospital re-admission, institutionalization, and mortality [2, 3].
Identifying (pre) frail older adults, and those at risk for progression of frailty is important. Some older adults may benefit from interventions targeted at prevention of frailty progression to lower the risk of poor health outcomes like functional decline [4, 5]. Reliable and valid assessment of frailty and how to measure relevant changes in frailty over time is therefore crucial.
Several frailty instruments exist for the purpose of diagnosing, risk stratification, and evaluating frailty over time [6]. Comprehensive geriatric assessment is currently the gold standard for diagnosing the frailty status in clinical practice [1], but the cumulative deficits model or Frailty Index (FI) and the Frailty Phenotype (FP) are the most widely used instruments used to establish frailty status in research [7, 8]. Construct validity and predictive validity of negative health outcomes of the FI and FP have been extensively evaluated and are proven to be satisfactory in both community-dwelling and hospitalized older adults [9–11]. Reproducibility and responsiveness of change scores of frailty instruments are poorly studied especially after hospitalization and it is still unclear which frailty instrument is most appropriate for measuring change scores over time or the effectiveness of interventions [9, 11, 12].
Therefore, the aim of this study is to determine the reproducibility and responsiveness of the FI and FP in acutely admitted hospitalized older medical patients.
Methods
Study population
During this monocentric prospective cohort study, patients aged ≥ 70 years were recruited between February 2017 and May 2018. Twelve months’ follow-up measurements continued to the end of April 2019. During weekdays patients admitted to surgical, cardiology, pulmonology, medical oncology, nephrology, and general internal medicine wards were checked for eligibility to participate. Inclusion criteria were age ≥ 70 years and an expected hospital stay of at least two days. Exclusion criteria were no understanding of the Dutch language, any (temporary) cognitive condition that influenced decision making capacity, and no written informed consent. The Research Ethics Committee of the University Medical Center Groningen ruled that no formal ethics approval was required (file number: 201,600,268). All participants provided written informed consent before participation.
Data collection
Baseline assessment took place within four days after admission. Telephonic assessments were performed at three and twelve months’ post-discharge, in which baseline questions were repeated and two anchor questions were added [13]. Data were collected by trained research staff.
Questionnaires
Frailty instruments
The FI score was calculated using 34 deficits associated with health status [14]. The FP was assessed by five self-reporting criteria including strength, walking ability, weight loss, physical activity, and exhaustion [15, 16]. A detailed description of the included items of the FI and FP are presented in Additional File 1, Tables A1 and A2.
Patient-reported anchor questions
Anchor questions were used as an external criterion for measuring responsiveness [17]. Two different anchor questions were used: (1) ‘In general, how is your health state now, compared to three months/twelve months ago before hospitalization?’ (2) ‘In general how is your daily functioning now, compared to three months/twelve months ago before hospitalization?’ Response options were a five point Likert scale. Patients were divided into three categories based on the anchor questions (improved, unchanged, and deteriorated patients). Improved was scored if a patient answered ‘slightly better’ or ‘much better’. Unchanged was scored if the answer was ‘more or less the same’. Deteriorated was scored if a patient answered ‘slightly worse’ or ‘much worse’.
Sociodemographic and patient characteristics
For all subjects, baseline sociodemographic characteristics were collected including age, sex, living situation (independent living vs. not independent living), and educational level (≤ high school vs. > high school. After discharge, medical charts were consulted to assess baseline comorbidity (Charlson Comorbidity Index) [18] and mortality during follow-up time.
Statistical analysis
Descriptive statistics
For all baseline sociodemographic and patient characteristics, descriptive statistics were calculated. The distribution of the scores on frailty instruments at baseline were inspected for possible floor and ceiling effects. Thresholds for floor and ceiling effects were if ≥ 15 % of the patients achieved the lowest or highest possible score, respectively [19].
Reproducibility
Test-retest reproducibility was assessed among patients who reported to be unchanged according to the anchor question three months post discharge. The following parameters were calculated:
The intraclass correlation coefficient (ICC) using a two-way mixed effects model for absolute agreement was used for the baseline and three months follow-up measurements of the FI and the FP. Cut-off values for interpretation of the ICC including the 95 % confidence interval were < 0.5 poor, ≥ 0.5 and < 0.75 moderate, ≥ 0.75 and < 0.9 good, ≥ 0.9 excellent reliability [20].
Cohen’s kappa and absolute agreement were calculated to assess the reproducibility of the FP using the categorized outcome (robust, prefrail, frail). Cut-off values were < 0.40 poor, ≥ 0.40 and < 0.75 fair to good, ≥ 0.75 excellent agreement [19].
Measurement error of the FI and FP was assessed by calculating Bland-Altman plots and the standard error of measurement (SEM). Bland-Altman plots were calculated by the mean change scores of baseline and three months post discharge assessments plotted against the difference on both scores. SEM was calculated using the following formula: SEM = SD(T0) x √(1-r). SD is the standard deviation of the baseline measurement of the Frailty Index of the unchanged group; r refers to the ICC. To interpret the SEM, scores are converted to percentages of the scale range. Cut-off values were: ≤5 % very good, ≤ 10 % good, > 10 % and < 20 % doubtful, ≥ 20 % poor [21].
To be able to interpret change scores, the smallest detectable change (SDC) was calculated for the FI and FP using continuous scores. SDC reflects the variance of the distribution of change scores among stable patients. Patients who reported no change according to the anchor question were assumed to be stable. SDC was calculated by the following formula: SDC = 1.96 x √2 x SEM [21]. Both the absolute SDC value as well as the SDC as a percentage of the scale range were calculated.
Responsiveness
Two types of responsiveness were determined over the timeframes from pre-hospital admission to three and twelve months’ post discharge:
Internal responsiveness, defined as the magnitude of change related to the variance in change scores, was determined by the standardized response mean (SRM). SRM is calculated by dividing the mean change score by the standard deviation of the mean change score [22]. SRMs were separately calculated for improved, unchanged, and deteriorated patients according to the anchor question for both the FI and FP using continuous scores. Cut-off values were: ≤0.2 small, > 0.2 and ≤ 0.5 doubtful, > 0.5 and ≤ 0.8 good, > 0.8 very good internal responsiveness for the improved and deteriorated patients; <0.50 good, ≥ 0.50 small for the unchanged patients [22].
External responsiveness, defined as the ability to detect change over time in the construct to be measured, was assessed by investigating the ability of the instruments to discriminate between relevant changes (improved and deteriorated patients) and irrelevant changes (unchanged patients) [19]. This is reflected by the area under the receiver operating characteristic curve (AUC). For these analyses, the anchor question was considered as the gold standard for change, and the change scores on the FI and FP using continuous scores were considered as the ‘diagnostic test’ for measuring change. An AUC of ≥ 0.70 was considered to be adequate. In addition, for each instrument the optimal cut-off point was calculated for which the sensitivity and specificity together revealed the least error in classifying patients as improved versus unchanged and deteriorated versus unchanged. To carry out these analyses, the correlation (Spearman’s rho) between the change score on the frailty instrument and the anchor question should be at least 0.40 [23].
Missing data and sensitivity analysis
Patients who died during follow-up were included in the analytic sample by imputing the highest prevalent frailty category for each frailty instrument and the worst outcome for the anchor questions. A complete case analysis was included as a sensitivity analysis. For all analyses IBM SPSS Statistics, version 23 was used.
Results
Descriptive statistics
Baseline characteristics were presented in Table 1. Of the 243 participants with baseline assessments, 51 had no follow-up data after three months post discharge resulting in an analytic sample of 192 in the three months follow-up analyses. The analytic sample of the twelve months follow-up analyses included 187 participants. A flowchart including a detailed description of the reason for missing data is provided in Additional File 1, Figure A1. In total, 39 patients (16 %) died during the study. These patients were older and had higher frailty and comorbidity index scores at baseline compared to patients with complete data for all assessments (n = 118) and patients lost to follow-up after twelve months (n = 56) (Additional File 2, Table S1). Between the latter two groups, no differences in baseline characteristics were found (Additional File 2, Table S1).
Table 1.
Baseline characteristics | Baseline sample | T1 sample | T2 sample | |
---|---|---|---|---|
(n = 243) | (n = 192) | (n = 187) | ||
Age, median (IQR 25;75) | 76 (72;81) | 76 (72;81) | 76 (73;81) | |
range (years) | 70–98 | 70–98 | 70–98 | |
Sex, male | 165 (68) | 132 (69) | 129 (69) | |
Housing situation | ||||
independent | 225 (93) | 179 (93) | 173 (93) | |
not independent | 18 (8) | 13 (7) | 14 (8) | |
Education | ||||
≤ high school | 173 (71) | 140 (73) | 132 (71) | |
> high school | 70 (29) | 52 (27) | 55 (29) | |
CCI, median (IQR 25;75) | 2 (1; 4) | 2 (1; 4) | 2 (1; 4) | |
Frailty Index | ||||
median (IQR 25;75) | 0.18 (0.08; 0.31) | 0.17 (0.08; 0.30) | 0.18 (0.08; 0.31) | |
lowest possible score | 0 (0) | 0 (0) | 0 (0) | |
highest possible score | 0 (0) | 0 (0) | 0 (0) | |
Frailty Phenotype | ||||
median (IQR 25;75) | 1.00 (0; 2.00) | 1.00 (0; 2.00) | 1.00 (0; 2.00) | |
robust (0 criteria) | 97 (40) | 81 (42) | 74 (40) | |
prefrail (1 or 2 criteria) | 88 (36) | 69 (36) | 68 (36) | |
frail (≥ 3 criteria) | 47 (19) | 38 (20) | 37 (20) | |
lowest possible score | 97 (40) | 81 (42) | 74 (40) | |
highest possible score | 4 (2) | 3 (2) | 4 (2) |
Notes: Values are presented as numbers and percentage (%) unless indicated otherwise. Percentages may not equal 100 % due to rounding and missing. CCI, Charlson Comorbidity Index; IQR, inter quartile range
The FP showed a floor effect at baseline assessment, hampering detection of improvement in 40 % of these patients (Table 1; Additional File 1, Figure A3). Mean scores of the frailty instruments at baseline and follow-up measurements for all and within collapsed categories as used in the analyses are presented in Table 2 and in Additional File 1, Table A3.
Table 2.
Frailty Index | Frailty Phenotype | ||||||
---|---|---|---|---|---|---|---|
n |
T0 mean (SD) |
T1 mean (SD) |
T0 mean (SD) |
T1 mean (SD) |
|||
Health anchor | |||||||
All categories | |||||||
much better | 24 | 0.19 (0.12) | 0.13 (0.09) | 1.38 (1.28) | 0.35 (0.65) | ||
slightly better | 24 | 0.23 (0.19) | 0.22 (0.20) | 1.57 (1.27) | 1.00 (1.18) | ||
more or less the same | 74 | 0.16 (0.12) | 0.13 (0.11) | 0.73 (1.12) | 0.67 (0.98) | ||
slightly worse | 34 | 0.19 (0.15) | 0.22 (0.16) | 0.97 (1.36) | 1.09 (1.36) | ||
much worse | 36 | 0.32 (0.17) | 0.60 (0.25) | 2.14 (1.40) | 3.60 (1.79) | ||
Collapsed categoriesa. | |||||||
improved | 48 | 0.21 (0.16) | 0.17 (0.16) | 1.48 (1.27) | 0.68 (1.00) | ||
unchanged | 74 | 0.16 (0.12) | 0.13 (0.11) | 0.73 (1.12) | 0.67 (0.98) | ||
deteriorated | 70 | 0.26 (0.17) | 0.42 (0.28) | 1.57 (1.49) | 2.38 (2.02) | ||
Functioning anchor | |||||||
All categories | |||||||
much better | 16 | 0.19 (0.13) | 0.13 (0.09) | 1.60 (1.30) | 0.25 (0.45) | ||
slightly better | 21 | 0.19 (0.18) | 0.15 (0.17) | 1.29 (1.42) | 0.70 (1.03) | ||
more or less the same | 80 | 0.17 (0.14) | 0.16 (0.14) | 0.78 (1.15) | 0.74 (0.99) | ||
slightly worse | 40 | 0.21 (0.15) | 0.22 (0.16) | 1.21 (1.32) | 1.08 (1.37) | ||
much worse | 35 | 0.32 (0.15) | 0.61 (0.23) | 2.12 (1.39) | 3.82 (1.57) | ||
Collapsed categoriesa. | |||||||
improved | 37 | 0.19 (0.16) | 0.14 (0.14) | 1.42 (1.36) | 0.50 (0.84) | ||
unchanged | 80 | 0.17 (0.14) | 0.16 (0.14) | 0.78 (1.15) | 0.74 (0.99) | ||
deteriorated | 75 | 0.26 (0.16) | 0.40 (0.28) | 1.64 (1.42) | 2.34 (2.00) |
aThe collapsed categories were used in the analyses of the health state and functioning anchor questions
Reproducibility
ICCs, SEMs, and SDCs were presented in Table 3. ICC of the FI were 0.85 (95 % confidence interval [CI]: 0.76; 0.91) and 0.84 (95% CI: 0.77; 0.90), and 0.65 (95% CI: 0.49; 0.77) and 0.77 (95% CI: 0.65; 0.84) for the FP. Kappa statistics of the FP categories were 0.41 (absolute agreement: 0.68) and 0.45 (absolute agreement: 0.70) indicating fair agreement (Additional File 1, Tables A4 – A7). SEM of the FI were good to very good (5 and 6 %) and doubtful for the FP (11 and 13 %) (Table 3). Bland Altman plots are presented in the Additional File 1, Figures A4 and A5. Good agreement was observed for the FI using the functioning anchor and for the FP using the health and functioning anchors (p > 0.05). A systematic mean difference was observed between baseline and three-months follow-up tests of the FI using the health anchor (mean difference 0.02; 95 % CI: 0.01; 0.03).
Table 3.
Health anchor (n = 74) | |||||
Instrument | ICC (95 % CI) | SEM | SEM%a | SDC | SDC%a |
FI | 0.85 (0.76; 0.91) | 0.05 | 5 % | 0.13 | 13 % |
FP | 0.65 (0.49; 0.77) | 0.66 | 13 % | 1.84 | 37 % |
Functioning anchor (n = 80) | |||||
Instrument | ICC (95 % CI) | SEM | SEM%a | SDC | SDC%a |
FI | 0.84 (0.77; 0.90) | 0.06 | 6 % | 0.16 | 16 % |
FP | 0.77 (0.65; 0.84) | 0.56 | 11 % | 1.56 | 31 % |
Notes: Intraclass correlation coefficient for agreement using a 2 way mixed effect model. ICC Intraclass Correlation Coefficient, FI Frailty Index; FP Frailty Phenotype; SDC smallest detectable change; SEM standard error of measurement.
a. SEM% and SDC% are SEM and SDC expressed in percentages of the continuous score of the instrument
Responsiveness
All SRMs in the improved and deteriorated groups were higher than the SRMs in the stable (unchanged) groups, meaning that the measured change in frailty outcomes was lower among patients in the stable groups compared to patients in both the improved and deteriorated groups (Table 4). Largest SRMs were found for deterioration over twelve months (Table 4), with SRMs ranging from 0.69 to 1.00, indicating good to very good internal responsiveness.
Table 4.
Health anchor | 3 months post discharge (n = 192) | 12 months post discharge (n = 187) | ||||
mean change score (SD) | Correlation | SRM | Mean change score (SD) | Correlation | SRM | |
Frailty Index | ||||||
improved | -0.05 (0.11) | 0.48 | -0.45 | -0.07 (0.12) | 0.61 | -0.58 |
unchanged | -0.02 (0.06) | -0.33 | -0.01 (0.08) | -0.13 | ||
deteriorated | 0.16 (0.23) | 0.70 | 0.27 (0.27) | 1.00 | ||
Frailty Phenotype | ||||||
improved | -0.86 (1.21) | 0.46 | -0.71 | -0.93 (1.38) | 0.57 | -0.67 |
unchanged | -0.05 (0.88) | -0.06 | -0.18 (0.86) | -0.21 | ||
deteriorated | 0.82 (1.67) | 0.49 | 1.60 (2.00) | 0.80 | ||
Functioning anchor | 3 months post discharge (n = 192) | 12 months post discharge (n = 187) | ||||
mean change score (SD) | Correlation | SRM | Mean change score (SD) | Correlation | SRM | |
Frailty Index | ||||||
improved | -0.06 (0.11) | 0.43 | -0.55 | -0.08 (0.13) | 0.57 | -0.62 |
unchanged | -0.01 (0.06) | -0.16 | -0.01 (0.09) | -0.11 | ||
deteriorated | 0.13 (0.23) | 0.57 | 0.23 (0.27) | 0.85 | ||
Frailty Phenotype | ||||||
improved | -0.94 (1.31) | 0.47 | -0.72 | -1.17 (1.46) | 0.57 | -0.80 |
unchanged | -0.09 (0.73) | -0.12 | -0.24 (1.01) | -0.24 | ||
deteriorated | 0.74 (1.73) | 0.43 | 1.36 (1.96) | 0.69 |
Notes: Spearman correlation coefficients were calculated by using the mean change scores of the total group and the anchor question. Abbreviations: SD standard deviation; SRM standardized response mean
Only the FI showed sufficient responsiveness (> 0.70) to detect deterioration in frailty over three months (Fig. 1). Highest AUC of the FI was found for the health anchor question (AUC: 0.77; 95 % CI: 0.69; 0.86, see Fig. 1). The optimal cut-off of the change scores from baseline to three months post discharge was 0.02 with corresponding sensitivity and specificity of 69 and 81 % (Additional File 1, Table A8). Over the timeframe of twelve month, both the FI and FP were responsive for deterioration in frailty status. Highest AUC’s were found for the health anchor (AUC: 0.82; 95 % CI: 0.73; 0.90 and AUC: 0.78; 95 % CI: 0.69; 0.87) (Fig. 1) with corresponding optimal change score of 0.04 (Sensitivity: 75 %; Specificity: 77 %) and 0.50 (Sensitivity: 68 %; Specificity: 84 %) for the FI and FP, respectively (Additional File 1, Table A8). The FP consistently performed better in detecting improvement in frailty, yet all AUC values were below the threshold of 0.70 (Fig. 1).
Sensitivity analyses including complete cases only yielded essentially the same results. However, as expected, by disregarding the frailest individuals (Additional File 2, Table S1) and due to the smaller sample, the AUC values regarding deterioration were lower in this subgroup (Additional File 2, Figure S1).
Discussion
In this study on acutely hospitalized older medical patients, we found that the FI showed good reproducibility and the FP showed moderate reproducibility. In addition, the FI was responsive in detecting deterioration in frailty between pre-acute hospital admission and three and twelve months post discharge. The FP was only responsive in detecting patients with deteriorating frailty status between pre-hospital admission and twelve months post-discharge.
Like cholesterol is a measurable marker for cardiovascular disease risk and HbA1c for risk of complications of diabetes type 2, frailty can be considered as the measurable marker for risk of adverse outcomes. Responsive frailty measures can therefore act as an important intermediate outcome for the evaluation of interventions aiming at preventing adverse health outcomes in older patients. Despite that the FP is frequently used as an outcome instrument to evaluate interventions, we failed to establish satisfactory reproducibility and responsiveness of the FP over a three months timeframe [24–26]. In addition, a floor effect of the FP was found in 40 % of the cases. This may have led to an underestimation of the ability to detect improvements, but it may have overestimated the results based on the unchanged patients. Consequently, the reproducibility outcomes may have been even overestimated due to the floor effect of the FP. Although, in theory, an instrument can be responsive with a low validity or reliability, it may be undesirable to use such an instrument to measure change over time [27]. Consequently, despite the apparently better outcomes of the FP compared to the FI to measure improvements in frailty status over time, we have substantial reservations to draw this conclusions due to the unsatisfactory reproducibility outcomes of the FP in the current study. In addition, the practical applicability of the FP to measure improvement over time is limited by the presence of a floor effect of the FP.
In the current study, an increase of five deficits over three months and six deficits over twelve months corresponds with the smallest detectable change of the FI that is meaningful to patients. The found change scores are higher than reported in recent other studies investigating clinically meaningful change of the FI [28, 29]. These differences may be explained by the used anchor: in the current study a subjective perception of change in health and functioning according to the patient was used, whereas the other studies used existing instruments, like the EQ-5D and the Clinical Frailty Scale, as the external anchor. Our participants could have been adapted to their changed health state after hospitalization [30] which may have resulted in a larger change score that is regarded meaningful to patients themselves. However, patients who perceived no change in health and functional status after three and twelve months post discharge, also had the smallest change scores on the frailty instruments. Another explanation may be that the change in frailty status according to a clinician which was investigated by Theou and colleagues [29] is different from the patients perception of change in frailty status as investigated in the current study.
Strengths of this study are the use of various methods for assessing reproducibility and responsiveness and the large sample size. More than twice the recommended number of patients for evaluating psychometric properties were included [19]. There are, however, limitations. First, instead of using a comprehensive geriatric assessment, the gold standard for frailty status, we used two relevant patient-based anchor questions to determine change in frailty. By using two anchor questions referring to change in function and health in a population that is prone to frailty, we intended to come close to evaluating real frailty status. The moderate positive correlations of these anchor questions with the change scores on the frailty instruments indicate that the chosen anchor questions may not fully capture the whole concept of frailty. Directly asking for change in frailty was, however, not an option because older adults themselves are not familiar with this concept [31]. Second, the design for determining the reproducibility of the frailty instruments was not ideal. On the one hand, the time interval between the test and the retest, three months, is a long period to assume that the patients have remained stable. In addition, stability was based on self-reported, thus subjective, anchor questions, which did show a moderate correlation with the change scores on the frailty instruments (ranging from 0.43 to 0.48). Although mean change scores and standard deviations were smallest in the unchanged subgroups, suggesting little variation in frailty scores between the first and second assessments and suggesting clinically stable patients, the gold standard for measuring frailty was unavailable and objective clinical stability could not be guaranteed. However, if some unstable patients were inadvertently considered stable in the current study, the found reproducibility scores are expected to be an underestimation of the “real” reliability. Third, we cannot rule out that the results are biased by response shift, as response shift evaluation was not incorporated in the study design [30]. Fourth, the modified FP was used instead of the original performance-based measures because in our population of older medical patients, performance-based assessment is often too challenging and would have led to the inclusion of the fittest frail patients, resulting in an undesirable selection bias. Fifth, due to ethical considerations, no patients were included with cognitive impairment due to dementia or delirium, although frailty in these patients is often present and their frailty status is expected to decline after hospitalization. However, the broad inclusion criteria still resulted in the inclusion of a representative sample of the geriatric population consisting of a heterogeneous group of mentally competent older medical patients.
Future research should compare the responsiveness of existing frailty instruments and their relation to the course of functional impairment in multiple studies and other patient groups with a reliable gold standard for the measurement of frailty. These studies should also incorporate measures such as a then-test in study designs to identify and adjust for response shift.
Conclusions
In this study, the Frailty Index showed better reproducibility and responsiveness properties compared to the Frailty Phenotype. Based on this single study we cannot yet formulate concrete recommendations about the best instrument to evaluating frailty status over time that is meaningful to older patients.
Supplementary Information
Acknowledgements
The authors also wish to acknowledge all the research assistants for their assistance with data collection and all study participants for their time.
Abbreviations
- AUC
Area Under the receiver operating Curve
- CCI
Charlson Comorbidity Index
- CI
Confidence Interval
- ICC
Intra-class Correlation Coefficient
- IQR
Inter Quartile Range
- FI
Frailty Index
- FP
Frailty Phenotype
- SD
Standard Deviation
- SDC
Smallest Detectable Change
- SEM
Standard Error of Measurement
- SRM
Standardized Response Mean
Authors’ contributions
SER, CJJ, MF coordinated the acquisition of subjects, data collection, and processing. MF and CJJ performed the initial statistical analyses. MF and FMMO wrote the first draft of the manuscript and performed the additional analyses and adjustments during the revision process. NS, BCM and SER aided in interpreting the results. All authors were involved in the study design, revising manuscript draft for important intellectual content, and gave approval for the final manuscript, and thereby taking full responsibility for the work and manuscript content.
Funding
None.
Availability of data and materials
The datasets used during the current study are available from the corresponding author upon reasonable request.
Declarations
Ethics approval and consent to participate
The Research Ethics Committee of the University Medical Center Groningen approved the study protocol and ruled that no formal ethics approval was required (file number: 201600268). Written informed consent of all participants was obtained before participation.
Consent for publication
Not applicable.
Competing interests
The authors declare they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Marlies Feenstra and Frederike M.M. Oud contributed equally to this work.
References
- 1.Clegg A, Young J, Iliffe S, Olde Rikkert MGM, Rockwood K. Frailty in older people summary. Lancet. 2013;381(9868):752–62. doi: 10.1016/S0140-6736(12)62167-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Joosten E, Demuynck M, Detroyer E, Milisen K. Prevalence of frailty and its ability to predict in hospital delirium, falls, and 6-month mortality in hospitalized older patients. BMC Geriatr. 2014;14(1):1–9. doi: 10.1186/1471-2318-14-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Vu HT, Nguyen TX, Nguyen TN, Nguyen AT, Cumming R, Hilmer SN, et al. Prevalence of frailty and its associated factors in older hospitalised patients in. BMC Geriatr. 2017;17(216):1–7. doi: 10.1186/s12877-017-0609-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Apóstolo J, Cooke R, Bobrowicz-campos E, Santana S, Marcucci M, Cano A, et al. Effectiveness of interventions to prevent pre-frailty and frailty progression in older adults: a systematic review. JBI Database Syst Rev Implement Rep. 2018;16(1):140–232. doi: 10.11124/JBISRIR-2017-003382. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Dedeyne L, Deschodt M, Verschueren S, Tournoy J, Gielen E. Effects of multi-domain interventions in (pre)frail elderly on frailty, functional, and cognitive status: A systematic review. Clin Interv Aging. 2017;12:873–96. doi: 10.2147/CIA.S130794. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Rockwood K, Theou O, Mitnitski A. What are frailty instruments for? Age Ageing. 2015;44(4):545–7. doi: 10.1093/ageing/afv043. [DOI] [PubMed] [Google Scholar]
- 7.Buta BJ, Walston JD, Godino JG, Park M, Kalyani RR, Xue Q, et al. Frailty assessment instruments: Systematic characterization of the uses and contexts of highly-cited instruments. Ageing Res Rev. 2017;March(26):53–61. doi: 10.1016/j.arr.2015.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Morley JE, Vellas B, Kan GA, Van, Anker SD, Bauer JM, Bernabei R, et al. Frailty Consensus: A Call to Action. J Am Med Dir Assoc. 2013;14(6):392–7. doi: 10.1016/j.jamda.2013.03.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Drubbel I, Numans ME, Kranenburg G, Bleijenberg N, Wit NJ, De Screening for frailty in primary care: a systematic review of the psychometric properties of the frailty index in community-dwelling older people. BMC Geriatr. 2014;14(1):1–13. doi: 10.1186/1471-2318-14-27. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sutton JL, Gould RL, Daley S, Coulson MC, Ward EV, Butler AM, et al. Psychometric properties of multicomponent tools designed to assess frailty in older adults: A systematic review. BMC Geriatr. 2016;16:1. doi: 10.1186/s12877-016-0225-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.De Vries NM, Staal JB, Van Ravensberg CD, Hobbelen JSM, Olde Rikkert MGM. Nijhuis-van der Sanden MWG. Outcome instruments to measure frailty: a systematic review. Ageing Res Rev. 2011;10:104–14. doi: 10.1016/j.arr.2010.09.001. [DOI] [PubMed] [Google Scholar]
- 12.Apostolo J, Cooke R, Bobowicz-Campos E, Santana S, Marcucci M, Cano A, et al. Predicting risk and outcomes for frail older adults: an umbrella review of frailty screening tools ´. JBI Database Syst Rev Implement Rep. 2017;15(4):1154–208. doi: 10.11124/JBISRIR-2016-003018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Kamper SJ, Maher CG, Mackay G. Global rating of change scales: A review of strengths and weaknesses and considerations for design. J Man Manip Ther. 2009;17(3):163–70. doi: 10.1179/jmt.2009.17.3.163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Searle SD, Mitnitski A, Gahbauer EA, Gill TM, Rockwood K. A standard procedure for creating a frailty index. BMC Geriatr. 2008;8(1):24. doi: 10.1186/1471-2318-8-24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: Evidence for a phenotype. Journals Gerontol Ser a-Biological Sci Med Sci. 2001;56(3):M146–56. doi: 10.1093/gerona/56.3.M146. [DOI] [PubMed] [Google Scholar]
- 16.Theou O, Rockwood K. Comparison and Clinical Applications of the Frailty Phenotype and Frailty Index Approaches. Interdiscip Top Gerontol Geriatr. 2015;41:74–84. doi: 10.1159/000381166. [DOI] [PubMed] [Google Scholar]
- 17.de Vet HC, Bouter LM, Bezemer PD, Beurskens AJ. Reproducibility and responsiveness of evaluative outcome measures. Theoretical considerations illustrated by an empirical example. Int J Technol Assess Health Care. 2001;17(4):479–87. doi: 10.1017/S0266462301107038. [DOI] [PubMed] [Google Scholar]
- 18.Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J Chronic Dis. 1987;40(5):373–83. doi: 10.1016/0021-9681(87)90171-8. [DOI] [PubMed] [Google Scholar]
- 19.De Vet HCW, Terwee CB, Knol DL, Mokkink LB. Measurement in Medicine. first. Cambridge: Cambridge University Press; 2011. 347 p.
- 20.Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016;15(2):155–63. doi: 10.1016/j.jcm.2016.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Ostelo RWJG, De Vet HCW, Knol DL, Van Den Brandt PA. 24-Item Roland-Morris Disability Questionnaire was preferred out of six functional status questionnaires for post-lumbar disc surgery. J Clin Epidemiol. 2004;57(3):268–76. doi: 10.1016/j.jclinepi.2003.09.005. [DOI] [PubMed] [Google Scholar]
- 22.Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York: Academic Press; 1977. [Google Scholar]
- 23.Akoglu H. User’s guide to correlation coefficients. Turkish J Emerg Med. 2018;18(3):91–3. doi: 10.1016/j.tjem.2018.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hars M, Herrmann FR, Fielding RA, Reid KF, Rizzoli R, Trombetti A. Long-Term Exercise in Older Adults: 4-Year Outcomes of Music-Based Multitask Training. Calcif Tissue Int. 2014;95(5):393–404. doi: 10.1007/s00223-014-9907-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Tarazona-Santabalbina FJ, Gómez-Cabrera MC, Pérez-Ros P, Martínez-Arnau FM, Cabo H, Tsaparas K, et al. A Multicomponent Exercise Intervention that Reverses Frailty and Improves Cognition, Emotion, and Social Networking in the Community-Dwelling Frail Elderly: A Randomized Clinical Trial. J Am Med Dir Assoc. 2016;17(5):426–33. doi: 10.1016/j.jamda.2016.01.019. [DOI] [PubMed] [Google Scholar]
- 26.Ng TP, Feng L, Nyunt MSZ, Feng L, Niti M, Tan BY, et al. Nutritional, Physical, Cognitive, and Combination Interventions and Frailty Reversal among Older Adults: A Randomized Controlled Trial. Am J Med. 2015;128(11):1225–36.e1. doi: 10.1016/j.amjmed.2015.06.017. [DOI] [PubMed] [Google Scholar]
- 27.Hays RD, Hadorn D. Responsiveness to change: an aspect of validity, not a separate dimension. Qual Life Res. 1992;1(1):73–5. doi: 10.1007/BF00435438. [DOI] [PubMed] [Google Scholar]
- 28.Jang IY, Jung HW, Lee HY, Park H, Lee E, Kim DH. Evaluation of Clinically Meaningful Changes in Measures of Frailty. J Gerontol A Biol Sci Med Sci. 2020;75(6):1143–7. doi: 10.1093/gerona/glaa003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Theou O, van der Valk AM, Godin J, Andrew MK, McElhaney JE, McNeil SA, et al. Exploring clinically meaningful changes for the frailty index in a longitudinal cohort of hospitalized older patients. Journals Gerontol - Ser A Biol Sci Med Sci. 2020;75(10):1928–34. doi: 10.1093/gerona/glaa084. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Barclay-Goddard R, Epstein JD, Mayo NE. Response shift: A brief overview and proposed research priorities. Qual Life Res. 2009;18(3):335–46. doi: 10.1007/s11136-009-9450-x. [DOI] [PubMed] [Google Scholar]
- 31.Durepos P, Sciences HH, Alsbury K, Hewston P, Borges J. Older Adults ’ Perceptions of Frailty Language: A Scoping Review. ResearchGate. 2020;(January). [DOI] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets used during the current study are available from the corresponding author upon reasonable request.