Which functional outcome measures can we use as a surrogate for exercise capacity during remote cardiopulmonary rehabilitation assessments? A rapid narrative review

Abstract

Introduction

The coronavirus disease 2019 (COVID-19) pandemic has seen many cardiopulmonary rehabilitation services delivering programmes remotely. One area of concern is how to assess exercise capacity when a supervised exercise test is not possible. The aim of this review was to examine the relationship between functional exercise tests and recommended exercise tests for cardiopulmonary rehabilitation.

Methods

A rapid narrative review was carried out. Searches were conducted by two of the study authors. The study had the following features. Participants: adults, all with long-term conditions; intervention: any/none; outcome: Duke activity status index (DASI), sit to stand (STS, 30 s, 1 min and 5 repetitions), short physical performance battery (SPPB), 4-metre gait speed (4MGS) or step test (Chester/others) AND directly compared to one of the recommended exercise tests for cardiopulmonary rehabilitation: 6-min walk test (6MWT), incremental shuttle walk test (ISWT) or cardiopulmonary exercise test (CPET) in terms of reporting agreement/correlation; Study design: primary research only, controlled trials or observational studies.

Results

Sixteen articles out of 249 screened were included (n=2271 patients). Overall, there were weak–strong correlations for the included tests with a recommended exercise test (r=0.38–0.85). There were few reported issues with feasibility or safety of the tests. However, all tests were supervised in a clinical setting. The test that had the highest correlation with the field walking test was the 4MGS with the ISWT (r=0.78) and with the 6MWT (r=0.85).

Discussion

The 4MGS has the highest correlation with routine measures of exercise tolerance. However, it may be difficult to standardise in a remote assessment or to prescribe exercise from. Clinicians should strive for face-to-face standardised exercise tests where possible to be able to guide exercise prescription.

Short abstract

Clinicians should strive for face-to-face standardised exercise tests where possible to be able to guide exercise prescription https://bit.ly/34saiQR

Introduction

Patients with chronic respiratory and cardiac disease benefit from centre-based rehabilitation in the form of exercise and disease management education. The benefits of this intervention have been proven in a range of outcome measures including exercise tolerance, quality of life, mood and mortality [1, 2]. Despite the known benefits, uptake to rehabilitation is poor [3, 4], and this problem is not unique to the United Kingdom [5]. To this end, recently we have seen the emergence of new programme formats that aim to improve access and uptake, including tele-rehabilitation and other home-based models. However, the evidence base for remotely delivered rehabilitation is not secure particularly in older patients with COPD [6]. Patient experience with remotely delivered healthcare is variable and will only be relevant for those who can access and engage with the technology [7, 8]. Evidence for tele-rehabilitation in the cardiac rehabilitation population is more convincing [9], perhaps due to patient demographics. All international guidelines state that an exercise programme should be individually prescribed and progressed, predicated on a measure of exercise capacity. Otherwise the programme is not recognised as pulmonary/cardiac rehabilitation (PR/CR) [10, 11]. The recent coronavirus disease 2019 (COVID-19) pandemic and ongoing social distancing measures have had a profound effect on how rehabilitation services are delivered around the world [12]. Many centres have temporarily suspended face-to-face activity and assessments have largely ceased; this has posed a challenge to rehabilitation providers, who have been unable to individually assess and prescribe the essential exercise component of the programme. Added to this, rehabilitation staff may have been redeployed to acute areas, COVID research teams or to work from home due to shielding.

Centres have risen to this challenge and turned to providing remote programmes in the form of home-based manuals, phone calls and virtual classes (tele-rehabilitation) [13]. However, there is a worry from the rehabilitation community that the effectiveness of rehabilitation may be diluted [12], particularly if no measure of exercise tolerance is completed at baseline.

Many functional exercise tests lend themselves to being conducted virtually in the home with minimal equipment (e.g. various sit to stand (STS) tests: e.g. 1-min STS [14], 4 metre gate speed (4MGS) [15], short physical performance battery (SPPB) [16] and various step tests, e.g. Chester Step test [17]). Furthermore, the Duke Activity Status Index (DASI) questionnaire has been suggested as a proxy for maximal exercise tolerance and yields a metabolic equivalents (METS) value [18] that can be converted to heart rate training zones. There is no specific national/international guidance on how to conduct virtual assessments (including exercise testing) in patients with cardiopulmonary disease, though locally developed protocols have been implemented. This is despite anxieties around safety; in particular, cardiovascular stability and oxygen desaturation when the assessment is not conducted in person. Greenhalgh and colleagues [19] have recently completed a rapid review of remote exercise testing for oxygen desaturation in COVID patients. They concluded that the 1-min sit to stand (1MSTS) and the 40-step test, validated in other lung diseases, could be considered, and a 3% decrease in pulse oximetry would be cause for concern. Furthermore, they argue that the test should not be used outside of a supervised healthcare visit if saturation was <96%. However, what has not been explored in a systematic way is the correlation between recommended measures of exercise tolerance in cardiopulmonary disease (e.g. cardiopulmonary exercise test (CPET), the 6-min walk test (6MWT) [20] or incremental shuttle walk test (ISWT) [21]) and these functional alternatives. Future research in the wake of COVID is likely to examine how reliable, practical and safe these functional measures are for virtual use and how responsive the measures to interventions such as rehabilitation. Prior to this we need to scope the literature for how valid these alternatives are for exercise prescription (i.e. how do they relate to a recommended exercise test?).

The aim of this rapid narrative review was to examine the relationship between functional exercise tests (in terms of correlation and/ or agreement) and measures of exercise tolerance, in patients with long-term conditions. Although our population of interest is those with cardiorespiratory disease, there may be useful data from other long-term conditions which could influence the review findings.

Methods

The review took place in May 2020. Searches were conducted by lead authors LHW and ED, with a third reviewer (SS) to resolve any discrepancies. The review was developed and reported using PRISMA methodology [22].

Inclusion criteria were as follows:

• Participants: Adults (>18 years), all with long-term conditions.

• Intervention: Any/none.

• Outcome – functional tests that can be performed in the home: DASI, STS (30 s, 1 min and 5 repetitions), SPPB, 4MGS, step test (Chester/others) AND directly compared to one of the recommended standardised tests for exercise prescription: 6MWT, ISWT or CPET in terms of reporting agreement or correlation [10–11]. See previous references [20, 21] for description of the test procedures. Secondary outcomes of interest were: feasibility, safety, equipment, reliability/repeatability and sensitivity.

• Study design: Primary research only, controlled trials or observational studies.

Exclusion criteria were as follows:

• Participants: Paediatrics, not long-term conditions (e.g. surgical procedures).

• Outcome – functional tests of interest: One of the five tests of interest not reported OR one of the five tests reported but not directly compared with a recommended exercise test for agreement/correlation. Tests that require additional equipment not routinely found in the patients’ home were excluded.

• Study design: Reviews, single case studies, abstracts.

Search terms for rapid review

This was not a systematic review and as such, search terms were limited to:

SPPB Or “Short physical performance Battery” OR 4MGS OR “Four meter gait speed” OR STS OR “sit to stand” OR “step test” OR DASI OR “Duke Activity Status Index”

We then searched through the hits to apply our inclusion and exclusion criteria. Databases searched were Medline and the Allied and Complimentary Medicine Database (AMED). There were no limits set on the language or time period of publication.

Data extraction and risk of bias assessment

Data extraction was performed by all authors manually and transcribed to an Excel spreadsheet. A brief risk of bias assessment was conducted at the same time using the COSMIN taxonomy (Measurement Properties of Outcome Measurement Instruments) [23]. This is specifically designed for clinician-reported and performance-based outcome measures. For eight categories the scale is poor, fair, good or excellent. We have converted this to an average rating low/moderate or high risk of bias.

Results

Figure 1 shows the PRISMA flow diagram of screened articles. Duplicates (n=33) were removed. Reasons for exclusion were as follows: not one of the five tests of interest (n=31), no validity outcome (i.e. correlation/agreement with routine exercise tests) (n=73), not a long-term condition (n=82), paediatrics (n=4) and wrong study design/publication type (n=10).

FIGURE 1.

PRISMA flow diagram of screened articles.

Primary outcome

Table 1 shows details of the included articles and average risk of bias score.

TABLE 1.

Included article details and average risk of bias score

First author year [ref.]	Outcome measure	n	Disease	Agreement/correlation to gold standard	Risk of bias
Briand 2018 [24]	1-min STS	107	ILD	1-min STS and 6MWT r=0.5	Moderate
Carter 2002 [25]	DASI	119	COPD	DASI and 6MWT r=0.53	High
Coute 2017 [26]	DASI	100	CV	Predicted METS from DASI and maximum exercise METS r=0.38	High
Crook 2017 [27]	1-min STS	255 (2 studies combined)	COPD	1-min STS and r=0.59 study 1 at baseline and r=0.67 at follow-up; r=0.64 study 2 at baseline and r=0.68 at follow-up	Moderate
Di Thommazo-Luporini 2015 [28]	Step test (6-min)	56	Obesity	CPET (treadmill test V′O2max) r=0.56	High
Jones 2013 [29]	5STS	475	COPD	ICC with ISWT −0.59	Low
Kon 2013 [30]	4MGS	586	COPD	4MGS and ISWT r=0.78, 4MGS and ISWT % pred 0.72	Moderate
Matkovic 2017 [31]	4MGS	111	COPD	4MGS and 6MWT r=0.85	Moderate
Mori 2019 [32]	SPPB	53	Charcot–Marie–Tooth	ICC with 6MWT 0.35	High
Meriem 2015 [33]	1-min STS	49	COPD	1-min STS and 6 MWT r=0.47	Moderate
Nolan 2018 [34]	4MGS	46	IPF	4MGS and 6MWT r=0.76	Low
Ozalevli 2007 [35]	1-min STS	53	COPD	1-min STS and 6MWT r=0.75	Moderate
Reed 2020 [36]	DASI and Chester Step test	50	CV	Step test and CPET (treadmill test V′O2max) r=0.69, DASI and CPET r=0.38	Moderate
Reyschler 2018 [37]	1-min STS	42	COPD	1 min STS and 6 MWT r=0.72	Moderate
Wilkinson 2018 [38]	1 min STS and 5STS	41	CKD	5STS and ISWT r=0.55 time point 1 and r=0.74 at 6 weeks; 1 min STS r not reported	Moderate
Zhang 2018 [39]	5STS and 30 s STS	128	COPD	5STS and 6 MWT r=−0.51, 30 s STS and 6 MWT r=0.53	Moderate

STS: sit to stand; ILD: interstitial lung disease; 6MWT: 6-min walk test; DASI: Duke Activity Status Index; CV: cardiovascular; METS: metabolic equivalents; CPET: cardiopulmonary exercise test; V′_O2max: peak oxygen uptake; ICC: intraclass correlation coefficient; ISWT: incremental shuttle walk test; 4MGS: 4-metre gait speed; SPPB: short physical performance battery; r: correlation coefficient; IPF: idiopathic pulmonary fibrosis; CKD: chronic kidney disease.

Secondary outcomes (where reported)

Feasibility

There were 12 studies that explored feasibility of outcome measures [24–26, 28–31, 34, 36–39]. These studies included the DASI, step tests, 5STS and 4MGS. Reported completion of the tests ranged from 85 to 100%. The DASI was reported to be completed by 100% of participants in the studies. One study reported that 7% of patients failed to complete the 30STS [39]. All studies explored the test in a hospital or outpatient setting under supervision, and therefore it may not be feasible to perform these in a home-based environment.

Safety/equipment

The equipment used in the listed tests include a step, chair, stopwatch, 4-metre track and in some instances a heart rate/oxygen saturation monitor. The step and chair heights, where described, would be a standardised height between patients and between testing time points (e.g. pre- and post-intervention). Two studies stated that the haemodynamic stress was lower for STS tests when compared to a 6MWT [33, 35]. None of the included studies reported any serious adverse events when performing the tests. However the tests were performed in clinical settings under supervision.

Reliability/repeatability

Seven studies assessed the reliability and repeatability of the tests [27, 29–30, 34, 37–39]. Inter-rater reliability was the most commonly reported measure using intraclass correlation coefficient (ICC). These were all moderate, good or excellent, range 0.68 (5STS [38]) and 0.99 (4MGS [30, 34], STS [27, 29]). Test re-test ICCs were good where reported (0.93–0.97) [27, 29–30, 34]. Two studies reported limits of agreement between two testing sessions for the 4MGS: these were 0.09 to −0.09 [34] and 0.135 to −0.125 [30]. One study examined the limits of agreement for the peak oxygen uptake (V′_O2) predicated from the DASI questionnaire and Chester Step test with the CPET [36]. Both tests overestimated V′_O2 when compared to the CPET: DASI by 3.6 mL·kg·min⁻¹ and the step test by 4.1 mL·kg·min⁻¹. One study compared nadir oxygen saturation measured by pulse oximetry (S_pO2) in the 1-min STS test to the 6MWT: the agreement ICC was 0.77 [24].

Sensitivity

Many of the studies were single time point/not testing response to an intervention. However, the sensitivity of the tests was explored in six studies, generally following exercise-based rehabilitation [27, 29, 34, 36, 38–39]. One study suggested a minimal important difference (MID) for the 5STS in patients with COPD of 1.3–1.7 s [29] and the MID for this outcome was reported as 7.5 s in patients with chronic kidney disease (CKD) [38]. For the 1-min STS, one study found an MID of 3 reps in COPD [27] and 4 reps in CKD [38]. Zhang et al. [39] reported receiver operating characteristic (ROC) curves and showed that the area under the curve (AUC) of the 5STS score in predicting poor 6-min walk distance (6MWD of <350 m) was 0.731, whereas the AUC of the 30STS score was 0.724, indicating that both tests are useful tools in predicting 6MWT performance. The 4MGS improved significantly following pulmonary rehabilitation in patients with idiopathic pulmonary fibrosis (IPF) (mean (95% CI) change: 0.16 (0.12–0.20) m·s⁻¹), effect size 0.65 [34]). In the cardiovascular study comparing DASI and the Chester Step test to the CPET, the change in DASI was 2.3±5 and for the Chester Step test the change was 1.9±5 mL·kg·min⁻¹ [36].

Discussion

This rapid review included 16 studies (2271 patients) with the aim of comparing functional exercise tests with recommended exercise tests in order to guide exercise prescription in patients with long-term conditions. Thirteen out of 16 studies were conducted in our population of interest (cardiopulmonary). This review was intended as a rapid review to guide practice in terms of exercise prescription. Searches were performed systematically and inclusion was assessed independently by two authors (ED/LHW). However, search terms were limited, and there were a large number of texts that were not included as they did not compare the agreement/correlation between the test of interest to a standard test, despite conducting a standard test in their study. Given the time scale of the rapid review, authors were not contacted for additional data. This may affect the review conclusions. Since this review was conducted, one study has assessed the 1-min STS with the 6MWT (r=0.82) and CPET (r=0.71); however, this was in a small sample (n=15) of interstitial lung disease patients with a high risk of bias [40]. Therefore, this would not change the conclusion of this review. Furthermore, a rapid risk of bias assessment was performed by the authors; most studies (10 out of 16) were at moderate risk of bias, which again may affect our findings.

It is imperative that cardiopulmonary rehabilitation is reinstated to a high standard as quickly as possible due to the importance of the intervention and the effects that shielding and isolation have on deconditioning [41]. Overall there was weak to strong correlations for the included tests (STS tests, step tests, DASI, 4MGS, SPPB) with recommended exercise tests (CPET, ISWT, 6MWT) (r=0.38–0.85). The tests generally had good to excellent reliability and repeatability. The test that correlated most highly with exercise tests was the 4MGS with the ISWT (r=0.78 [30]) and with the 6 MWT (r=0.85 [31]). This test was also shown to be sensitive to change following exercise rehabilitation in IPF (medium effect size of 0.65 [34]). The study by Kon et al. [30] reported 90% feasibility to perform the 4MGS in a home environment, though this was taken from a previous study [42] and not their own, which was performed in a hospital clinic. There were few reported issues with feasibility or safety in the included tests; only one study [39] reported that 7% of patients failed to complete the 30STS presumably due to fatigue. However, all tests included in this review were conducted in a supervised setting. Therefore the feasibility and safety of these measures in the home warrant further consideration.

Risk assessment should be performed prior to virtual assessment via a subjective assessment, medical notes screening and/or a risk assessment proforma to identify patients who are safe to perform these tasks at home [43, 44], and the usual contraindications to exercise testing will remain [10, 45] alongside local Standard Operating Procedures. Consideration should be given to patients that have cardiovascular instability and exercise-induced desaturation. Ideally a patient's heart rate response and oxygen saturation would be measured during exercise testing and in the recovery period, which has implications for equipment provision if intended to be performed in the home. Monitoring of symptoms (i.e. Borg breathlessness and perceived exertion scales) may help to guide exercise prescription, alongside the rise in wearable technology which would facilitate increased monitoring at home. Other equipment required is an important consideration. If performing tests at home, it will be difficult to standardise the test due to chair or step height discrepancies, course length, etc., though within-individual comparisons would be possible if the same height of chair/step and course length was used pre- and post-intervention. Safety in terms of avoiding trips and falls is of particular concern with steps.

Virtual assessment also relies on technology provision and digital literacy, which is known to be poor among patients with respiratory disease [8], and therefore non-technology-based alternatives are important. Provision of devices and training may be required for patients prior to assessment. All participants included in this review performed the test in a hospital environment, and therefore we do not know the implications of performing these tests at home. Furthermore, there will be local decisions that need to be made about the best virtual platform depending on what is considered safe in terms of data security and confidentiality.

This review excluded studies that required additional equipment; however, there is evidence for use of the 6-min stepper test in respiratory disease. These studies explore feasibility, comparison to 6MWT and sensitivity to PR [46]. We excluded two studies on cystic fibrosis [47–48]. Though these studies compared the 1-min STS to a standard (CPET), they looked at the relationship between cardiorespiratory variables and not the actual test results (e.g. Watts versus STS strokes). Of note the agreement in V′_O2max in these studies derived from STS and CPET ranged between r=0.59 and 0.98. This review included studies that explored long-term conditions, and as a result, a number of studies exploring the DASI in pre/post-surgical patients were excluded. The DASI has previously been used in cardiac rehabilitation to prescribe target heart rate for exercise training and has been found to provide broadly equivalent MET levels to a CPET. This may be of value given that it is a functional questionnaire and carries minimal safety and feasibility implications. Though the 4MGS performed the best when compared to recommended exercise tests, this does raise issues in how to prescribe exercise from this test as you can from the ISWT and 6MWT [49]. Rehabilitation should include prescribed exercise, and if it is not possible to derive exercise prescription, standard rehabilitation has not been delivered. This will have clinical implications for the patients, for service provision and for national audit reporting.

Based on the results of this review, the 4MGS had the best correlation with exercise tests; however, it may be difficult to standardise in a home environment/during a virtual assessment. These findings are surprising given that the 4MGS is not a maximal test, and patients can walk at their own speed. There is scope to perform the subjective assessment at home and an exercise test in a clinical or community setting. Practical considerations for infection prevention and how this might impact on a walking test, such as wearing a mask, may impact validity, although some evidence indicates that there is minimal alteration in peak ventilation when a mask is worn [50–51]. With a potential second wave predicted for autumn/winter 2020 it is important that we futureproof rehabilitation to enable assessments and programmes without delay. Clinicians should strive for face-to-face services with standardised exercise tests where possible to be able to guide exercise prescription. However, the current situation provides an opportunity for services to evaluate the efficacy of providing interventions delivered in the home/virtually. Future research should examine how feasible, reliable and safe these functional tests are for virtual use and how responsive they are to rehabilitation delivered virtually.