Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2021 Nov 24;18(23):12325. doi: 10.3390/ijerph182312325

Clinical Usefulness of Retropulsion Tests in Persons with Mild to Moderate Parkinson’s Disease

Beata Lindholm 1,2,*, Erika Franzén 3,4, Wojciech Duzynski 2, Per Odin 2,5, Peter Hagell 5,6
Editor: Paul B Tchounwou
PMCID: PMC8656501  PMID: 34886051

Abstract

People with Parkinson’s disease (PwPD) have an increased risk for falls and near falls. They have particular difficulties with maintaining balance against an external perturbation, and several retropulsion tests exist. The Unified PD Rating Scale item 30 (UPDRS30) is the most common, involving an expected shoulder pull. Others recommend using an unexpected shoulder pull, e.g., the Nutt Retropulsion Test (NRT). We aimed to evaluate the clinical usefulness of these tests for detecting future fallers. By using two different golden standards related to self-reported prospective falls and near falls over 6 months following two different time points with 3.5 years between, we estimated sensitivity/specificity, Youden index, predictive values, and likelihood ratios for each test. The different time points yielded a different prevalence of falls and near falls, as well as different predictive values. When comparing the performance of the NRT and UPDRS30 for detecting future fallers, we found that the NRT consistently performed better than UPDRS30. However, neither test exhibited optimal performance in terms of predictive values and associated likelihood ratios. Our findings speak against using either of these tests as a single assessment for this purpose and support previous recommendations of using a multifactorial approach when targeting balance problems in PwPD.

Keywords: Parkinson’s disease, postural stability, retropulsion, falls, near falls, prediction, pull test, predictive value, sensitivity, specificity

1. Introduction

Postural instability, i.e., impaired reactive balance, is one of the four cardinal features of Parkinson’s disease (PD). Falls and postural instability are common already in the early stages of PD [1,2] and increase with disease progression [3]. The prevalence of falls and near falls varies between 31–90% [1,2,3] and 26–75% [4,5,6,7], respectively. Transfers and activities in everyday life, such as transferring to/from sitting, walking, and turning, induce self-generated perturbations that challenge reactive balance responses [8] and predispose people with PD (PwPD) to falls [9,10,11]. Walking is particularly challenging since the body is in a state of imbalance, and the only way to prevent falling is to take the next step [12]. Passing over a carpet or transitioning between tiled and wooden surfaces have been identified as the most common environmental factors for falls indoors among PwPD and tripping and slipping are the most common environmental factors outdoors. Importantly, postural instability is the most common individual risk factor for both indoor and outdoor falls [11].

PwPD have particular difficulties in maintaining their balance when being externally perturbed, such as a push backward [13,14,15,16]. This is commonly assessed with retropulsion tests such as an external backward push to challenge their balance responses [13,14]. Item 30 of the Unified Parkinson’s Disease Rating Scale (UPDRS30) is the most common retropulsion test and involves an expected shoulder pull backward [17]. However, others recommend using an unexpected shoulder pull backward, e.g., the Nutt Retropulsion Test (NRT) [14]. These tests are commonly used in clinical settings to indicate risk of falling. Although postural instability is a major influence on falls in PwPD [11], only a few studies have evaluated the clinical usefulness of UPDRS30 and the NRT in terms of their ability to predict falls among PwPD [14,15,18]. For example, Visser et al. [14] evaluated an unexpected shoulder pull according to the NRT and an expected shoulder pull according to UPDRS30 in the same sample. Because of a lack of consensus regarding how an “abnormal” reaction to a shoulder pull should be defined, Visser et al. [14] considered flawless test performance as a normal score, whereas all deviant scorings, regardless of the degree of postural instability, were considered abnormal. However, neither falls nor near falls were recorded prospectively, thus prohibiting the assessment of the predictive value of these tests.

In general, the usefulness of a clinical test in terms of its ability to detect persons with and without the outcome of interest is usually described in terms of sensitivity, specificity, positive predictive value, and negative predictive value [19,20]. High values of both sensitivity and specificity are usually preferred. Sensitivity and specificity are estimated by using an independent confirmation of test results, a so-called gold standard that per definition is unavailable in clinical practice. Therefore, these values are of little practical use when it comes to helping the clinician estimate the probability of the outcome that we seek for individual patients. For this purpose, predictive values may be used, as they estimate the probability of the sought outcome. However, both positive and negative predictive values vary according to the prevalence of the outcome in the population. Therefore, predictive values determined for one population may not be applicable to another, and evaluation of predictive values in various populations is recommended [21,22].

Here we aimed to evaluate the sensitivity, specificity, as well as the positive and negative predictive values of UPDRS30 and the NRT in detecting prospective falls and near falls among persons with mild to moderate PD.

2. Materials and Methods

2.1. Ethics Statement

All subjects gave their informed consent for inclusion before they participated in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Regional Ethics Committee of Lund, Sweden (Dnr 2011/768).

2.2. Study Design

This prospective cohort study is a part of a larger project [5], including two time points (T1 and T2) with a first assessment (T1) at the start of the study and a second assessment (T2) 3.5 years later. Each assessment was followed by the prospective recording of falls and near falls during the subsequent 6 months.

2.3. Participants

All PwPD [23] who received care at a neurology outpatient clinic in the south of Sweden were considered eligible for inclusion in the study (n = 359). Exclusion criteria at the start of the study were age above 80 years old (n = 121), inability to stand without support (i.e., spontaneous tendency to fall in a standing position; n = 22), unable to understand instructions (n = 14), and severe comorbidity (n = 11). Of the remaining 191 potential participants, 40 (16 women) declined participation. Of 151 PwPD at T1, five did not complete the prospective assessment of falls and near falls. The final study sample at T1, therefore, included 146 PwPD.

At T2, 24 PwPD dropped out due to severe comorbidity or death, and 49 (17 women) declined participation. Severe comorbidities included metastatic cancer, stroke, heart failure, dialysis-treated renal failure, age-related eye diseases, gastrointestinal diseases, and diabetic complications. PwPD with an inability to stand without support were not excluded at T2. Of the remaining 73 PwPD at T2, an additional 15 did not complete the prospective assessment of falls and near falls, leaving data from a total of 58 PwPD available for analyses.

2.4. Assessments and Procedure

Detailed descriptions of the procedures are available elsewhere [5]. Clinical assessments were administered by the same physical therapist with extensive experience of movement disorders (BL). At T1 and T2, all participants were assessed during outpatient visits, which were scheduled at a time of day when they reported that they usually felt at their best. All participants self-rated their motor status at the time of examination as “good/on,” “on with dyskinesia,” or ”bad/off,”

Retropulsion was assessed using an unexpected shoulder pull according to the NRT [13] as well as an expected shoulder pull according to UPDRS30 [17]. The participant was standing with her/his feet slightly apart and eyes open, with the examiner giving a sudden, firm backward pull to the shoulders from behind. The NRT was executed first and scored 0–3: 0 (normal, ≤2 steps to recover), 1 (≥3 or more steps; recovers unaided), 2 (would fall if not caught), 3 (spontaneous tendency to fall or unable to stand unaided) [13,14]. This was followed by a 10-Meter Walk Test in comfortable gait speed (for another study questions, see [5]). Motor symptoms were assessed using the UPDRS part III (0–108, higher = worse) [17], and PD severity was assessed according to Hoehn and Yahr (HY) (I–V, higher = worse) [24]. Cognition was evaluated using the Mini-Mental State Examination (MMSE) (0–30, higher = better) [25]. During assessments according to UPDRS30 (as part of the UPDRS part III), the participant was first told that s/he was to be pulled and instructed to prevent falling [17,26]. Performance was scored 0–4: 0 (normal), 1 (retropulsion, but recovers unaided), 2 (absence of postural response, would fall if not caught by the examiner), 3 (very unstable, tends to lose balance spontaneously), and 4 (unable to stand without assistance).

As the last step during each outpatient visit, the definitions of a fall and a near fall were thoroughly described to participants. Falls were defined as “an unexpected event in which the person comes to rest on the ground, floor, or lower level” [27]. Near falls were defined as ”a fall initiated but arrested by support from the wall, railing, other person, etc.” [28]. Participants were then provided with a diary for the prospective recording of falls and near falls. This included the date and time of every fall/near fall event and an indication of whether it was a fall or a near fall. The question in relation to a fall was phrased as follows: Did you fall in such a way that your body hit the ground? The corresponding question about a near fall incident was phrased: Were you close to falling, but managed to brace yourself at the last moment (e.g., grabbed on to someone, to an object or the wall)? Both questions were answered by Yes or No. After the study visits, all participants were telephoned monthly to ensure that registrations of falls and near falls had been completed according to instructions. During the last telephone call, they were asked to return the diary in a pre-stamped envelope.

Data on demographics (age, gender, PD duration) and anti-parkinsonian medications were obtained from medical records. Daily levodopa equivalent (LDE) doses (mg/day) were calculated according to recommended conversion factors [29].

2.5. Statistical Analysis

Data were checked regarding underlying assumptions and analyzed accordingly using SPSS version 27 (IBM Corp., Armonk, NY, USA) and WinPepi version 11.65 [30]. Normally distributed interval/ratio level variables were described using means and SDs. In other cases, n (%) and median (q1–q3) were used as appropriate. The alpha level of significance was set at 0.05. Group comparison between those at T1 who dropped out at T2 (n = 88) and those at T1 who also participated at T2 (n = 58) was performed using the Mann-Whitney U test for ordinal or continuous variables and Chi-square test for categorical variables. Receiver operating characteristics (ROC) curve analysis was used to determine the sensitivity and specificity for each possible cut-off score of the NRT and UPDRS30 [19]. Sensitivity is the probability that a patient has a positive test result given that they have a positive outcome, while specificity is the probability that a patient has a negative test result given that they have a negative outcome. Two different outcomes (gold standards) collected during the prospective monitoring of falls and near falls were used in the analyses: (i) at least one reported fall and (ii) at least one reported fall and/or near fall (i.e., including those reporting both) [5]. The Youden index (sensitivity + specificity − 1), which may range between 0 and 1 (the larger, the better) [19], was estimated for each possible score of the NRT and UPDRS30. The cut-off score associated with the highest Youden index was chosen as the optimal cut-off score to discriminate between PwPD with and without the respective outcomes. Maximizing sensitivity and specificity minimize false positive and false negative identifications.

Based on the sensitivity and specificity, we also calculated the ratio of the probability of a positive test result if the outcome is positive (true positive) to the probability of a positive test result if the outcome is negative (false positive), i.e., the likelihood ratio of a positive test result (LR+). LR+ represents the increase in odds favoring the outcome given a positive test result. Similarly, we also calculated the ratio of the probability of a negative test result if the outcome is positive to the probability of a negative test result if the outcome is negative (LR−), which represents the increase in odds favoring the outcome given a negative test result [19].

The positive predictive value (PPV) and negative predictive value (NPV) were also calculated. The PPV is the probability of a positive outcome given a positive test result. This contrasts with sensitivity, which is the probability of a positive test result given a positive outcome. Similarly, the NPV is the probability of a negative outcome given a negative test result (differing from specificity, which is the probability of a negative test result given a negative outcome). In general, the higher the prevalence of the sought outcome, the less useful NPV is, while the response to PPV becomes more valuable. With decreasing prevalence, the reverse is true [19].

The clinical usefulness of the test is regarded as high if PPV and LR+ are high and if NPV is high and LR− is low [19].

3. Results

At T1, the sample consisted of 146 PwPD (46% women) with a mean age of 68 (SD, 9.6) years and a mean disease duration of 4 (SD, 3.9) years. Their median (q1–q3) UPDRS III score and HY stage was 12 (8–18) and 2 (2–3), respectively. The median (q1–q3) scores for both the NRT and UPDRS30 were 0 (0–1). T2 included 58 PwPD (55% women) with a mean age of 69 (8.7) years and a mean disease duration of 7 (3.7) years. Their median (q1–q3) UPDRS III score and HY stage was 13.5 (9–20) and 2 (2–3), respectively. The median (q1–q3) NRT and UPDRS30 scores were both 0 (0–1). Further details are provided in Table 1.

Table 1.

Sample characteristics.

Time 1
(n = 146)
Time 2
(n = 58)
Age (years), mean (SD; min–max) 68 (9.6; 35–80) 69 (8.9; 46–84)
Female gender, n (%) 67 (46) 32 (55)
PD duration (years), mean (SD; min–max) 4.0 (3.9; 0.1–17.0) 7.0 (3.7; 3.6–20)
PD severity (HY), median (q1–q3; min–max) 2 (2–3; 1–4) 2 (2–3; 1–4)
Daily total levodopa equivalent (LDE) dose (mg), median (q1–q3; min–max) 400 (300−600; 0–1477) 500 (400–675; 150–1580)
Self-rated motor status at the time of clinical examination
“on” or “on with dyskinesias,” n (%)
“off,” n (%)

128 (88)
18 (12)

48 (83)
10 (17)
Motor symptoms (UPDRS part III), median (q1–q3; min–max) 12 (8–18; 1–46) 13.5 (9–20; 1–40)
Cognition (MMSE), median (q1–q3; min–max) 28 (26–29; 19–30) 28 (27–29; 20–30)
Retropulsion (NRT), median (q1–q3; min–max) 0 (0–1; 0–2) 0 (0–1; 0–3)
Retropulsion (UPDRS30), median (q1–q3; min–max) 0 (0–1; 0–2) 0 (0–1; 0–3)

HY, Hoehn and Yahr; MMSE, Mini-Mental State Examination; NRT, Nutt Retropulsion Test; PD, Parkinson’s disease; UPDRS, Unified Parkinson’s Disease; Rating Scale; UPDRS part III, motor score of the Unified Parkinson’s Disease Rating Scale; UPDRS30, item 30 of UPDRS.

The sample who dropped out at T2 consisted of 88 PwPD (42% women) with a mean age of 69 (SD, 2.14) years and PD duration of 4.6 (SD, 4.5) years at T1. To compare with those who participated at both T1 and T2, their disease duration was significantly longer (p < 0.001) and their self-rated motor status significantly worse (p = 0.025). There were no significant differences regarding age, gender, disease severity, motor symptoms, daily total levodopa equivalent doses, cognition, or balance tests (p ≥ 0.68). Further details are provided in the Supplementary Materials, Table S1.

The prevalence of at least one fall or at least one fall and/or near fall among 146 PwPD during the prospective T1 monitoring was 32% and 46%, respectively. Results from the ROC curve analyses were significant (p < 0.010) for both tests (NRT and UPDRS30) and for both outcomes. For detecting PwPD with/without prospective falls at T1, the highest Youden index (0.32) was found for an NRT cut-off score of 1. The corresponding sensitivity/specificity was 0.47/0.85, PPV/NPV was 0.60/0.77, and LR+/LR− was 3.09/0.63. For detecting PwPD with/without prospective falls and/or near falls at T1, the highest Youden index (0.28) was also found for an NRT cut-off score of 1, with corresponding sensitivity/specificity of 0.40/0.87; PPV/NPV of 0.73/0.77, and LR+/LR− of 3.18/0.68. Further details are provided in Table 2. Corresponding ROC curve analyses for tests results at T1 for the 58 PwPD included in T2 were not significant neither for the NRT nor UPDRS30 (p ≥ 0.54).

Table 2.

Sensitivity, specificity, Youden index, predictive values, and likelihood ratios for different cut-off scores of the NRT and UPDRS30 with prospective falls and near falls as golden standards at Time 1 (n = 146).

p-Value for ROC Analysis Cut-Off Score Sens (95% CI) Spec (95% CI) YI (95% CI) PPV (95% CI) NPV (95% CI) LR+ (95% CI) LR− (95% CI)
Golden standard: falls (prevalence, 32%)
NRT
(0–3) 1
<0.001 1 0.47 (0.33–0.61) 0.85 (0.77–0.10) 0.32 (0.16–0.48) 0.60 (0.46–0.72) 0.77 (0.72–0.82) 3.09 (1.77–5.39) 0.63 (0.47–0.83)
2 0.34 (0.22–0.48) 0.96 (0.90–0.98) 0.30 (0.16–0.44) 0.80 (0.60–0.91) 0.75 (0.71–0.91) 8.43 (2.98–23.82) 0.69 (0.56–0.82)
UPDRS i 30
(0–4) 2
0.010 1 0.51 (0.37–0.65) 0.70 (0.60–0.78) 0.21 (0.04–0.38) 0.44 (0.35–0.55) 0.75 (0.69–0.83) 1.69 (1.12–2.54) 0.70 (0.51–0.97)
2 0.19 (0.10–0.34) 0.95 (0.89–0.98) 0.14 (0.02–0.26) 0.64 (0.40–0.83) 0.71 (0.68–0.74) 3.79 (1.34–10.69) 0.85 (0.74–0.99)
Golden standard: falls and/or near falls (prevalence, 46%)
NRT
(0–3) 1
0.001 1 0.40 (0.29–0.52) 0.87 (0.78–0.93) 0.28 (0.14–0.41) 0.73 (0.59–0.84) 0.63 (0.58–0.68) 3.18 (1.66–5.49) 0.68 (0.55–0.85)
2 0.25 (0.17–0.37) 0.93 (0.89–0.99) 0.22 (0.10–0.33) 0.85 (0.65–0.95) 0.60 (0.57–0.64) 6.68 (2.05–21.82) 0.78 (0.67–0.90)
UPDRS30
(0–4) 2
0.005 1 0.49 (0.38–0.61) 0.73 (0.63–0.82) 0.23 (0.07–0.38) 0.61 (0.50–0.71) 0.63 (0.57–0.69) 1.85 (1.19–2.88) 0.69 (0.53–0.91)
2 0.15 (0.08–0.25) 0.95(0.88–0.98) 0.10 (0.00–0.20) 0.71 (0.46–0.88) 0.57 (0.54–0.60) 2.95 (0.97–8.97) 0.90 (0.80–1.00)

1 those with score 3 were not included at Time 1; 2 those with scores 3 or 4 were not included at Time 1; YI, Youden index; LR+/−, positive/negative likelihood ratio; NPV, negative predictive value; NRT, Nutt Retropulsion Test; PPV, positive predictive value; ROC, receiver operating characteristics; Sens, sensitivity; Spec, specificity; UPDRS30, item 30 of the Unified Parkinson’s Disease Rating Scale.

The prevalence of at least one fall or at least one fall and/or near fall among 58 PwPD during the prospective T2 monitoring was 45% and 52%, respectively. Results from ROC curve analyses were significant (p ≤ 0.043) for NRT for both outcomes. Corresponding analyses for UPDRS30 were not significant (p ≥ 0.079). Therefore, estimation of sensitivity/specificity and PPV/NPV was not applicable for UPDRS30. For detecting PwPD with/without prospective falls as well as falls and/or near falls at T2, the highest Youden indices (0.26 and 0.23, respectively) were found for the NRT cut-off score of 1. Further details are provided in Table 3.

Table 3.

Sensitivity, specificity, Youden index, predictive values, and likelihood ratios for different cut-off scores of the NRT and UPDRS30 with prospective falls and near falls as golden standards at Time 2 (n = 58).

p-Value for ROC Analysis Cut–Off Score Sens (95% CI) Spec (95% CI) YI (95% CI) PPV (95% CI) NPV (95% CI) LR+ (95% CI) LR− (95% CI)
Golden standard: falls (prevalence, 45%)
NRT
(0–3)
0.034 1 0.48 (0.30–0.67) 0.78 (0.61–0.89) 0.26 (0.02–0.50) 0.63 (0.46–0.79) 0.66 (0.56–0.75) 2.19 (1.01–4.75) 0.67 (0.44–1.01)
2 0.23 (0.11–0.42) 0.91 (0.77–0.98) 0.14 (−0.05–0.33) 0.68 (0.28–0.95) 0.59 (0.53–0.65) 2.46 (0.68–8.90) 0.85 (0.67–1.08)
3 0.08 (0.02–0.24) 1.00 (0.89–1.00) 0.08 (−0.03–0.18) 1.00 (0.13–1.00) 0.57 (0.52–0.62) NA (0.18–NA) 0.92 (0.83–1.03)
UPDRS30
(0–4)
0.079 NA
Golden standard: falls and/or near falls (prevalence, 52%)
NRT
(0–3)
0.043 1 0.45 (0.28–0.63) 0.79 (0.61–0.90) 0.23 (0.00–0.47) 0.68 (0.50–0.83) 0.58 (0.48–0.67) 2.09 (0.92–4.73) 0.70 (0.48–4.73)
2 0.20 (0.10–0.37) 0.89 (0.73–0.96) 0.09 (−0.09–0.28) 0.66 (0.27–0.91) 0.51 (0.45–0.57) 1.87 (0.52–6.76) 0.90 (0.72–1.12)
3 0.07 (0.02–0.21) 1.00 (0.88–1.00) 0.07 (−0.02–0.16) 1.00 (0.15–1.00) 0.50 (0.45–0.56) NA (0.16–NA) 0.93 (0.85–1.03)
UPDRS30
(0–4)
0.231 NA

YI, Youden index; LR+/−, positive/negative likelihood ratio; NA, not applicable; NPV, negative predictive value; NRT, Nutt Retropulsion Test; PPV, positive predictive value; ROC, receiver operating characteristics; Sens, sensitivity; Spec, specificity; UPDRS30, item 30 of the Unified Parkinson’s Disease Rating Scale.

4. Discussion

In this study, we evaluated the clinical usefulness of two commonly used retropulsion tests, the NRT and UPDRS30, for detecting future falls and near falls among persons with mild to moderate PD. By using two different golden standards, i.e., prospectively self-reported falls and falls and/or near falls over 6 months following two different time points with 3.5 years between, we estimated sensitivity/specificity, Youden index, predictive values, and likelihood ratios for each cut-off value and for each test. The different time points yielded different prevalence of falls and near falls, as well as different predictive values. However, when comparing the performance of the NRT and UPDRS30 as indicators of future falls and near falls, we found that the NRT consistently performed better than UPDRS30. Importantly, neither test exhibited optimal performance in terms of predictive values and associated LR [19]. This suggests that whereas an unexpected (i.e., the NRT) is more useful than an expected shoulder pull (i.e., UPDRS30), both retropulsion tests are of limited clinical value in terms of predicting future falls and near falls in PwPD. Although these clinical tests are commonly used, this is not unexpected since falls are multifactorial [31,32,33,34] and not only related to reactive balance responses. Therefore, it is reasonable to suggest that clinical prediction of future falls needs to be based on more than one indicator. For example, the 3-step falls prediction model (including gait speed and history of falls and freezing of gait) has been found to be a quick and useful means of predicting future falls in PwPD [35,36,37]. Moreover, history of falls, abnormal tandem gait, and cognitive impairment have been found to be predictive of the number of falls/near falls in PwPD [38].

Our results regarding the advantage of the NRT over UPDRS30 as a predictor of future falls are in line with those of Visser et al., who also evaluated both tests at the same time [14]. However, their estimates of sensitivity (0.63) and PPV (0.86) indicate better usefulness of NRT compared with that found in our study. This may be explained by differences in the definition of the golden standard, as in addition to falls and near falls, Visser et al. also considered adaptations to prevent falls (i.e., use of walking aids). This extension of the golden standard definition was conducted to reduce the risk that participants with impaired postural stability were inadvertently classified as non-fallers. In another study, Valcovic et al. [18] evaluated the clinical usefulness of the NRT for the prediction of falls. Their reported sensitivity (0.69) and PPV (0.76) were higher than those estimated in our study. This may, however, be due to differences in sample characteristics. That is, the participants in the study by Valcovic et al. [18] had longer disease duration and more severe motor symptoms than our sample. In fact, it has been suggested that retropulsion tests are more useful for the detection of fallers in the later stages of PD due to more severe postural instability [39]. Importantly, considering near falls in defining the golden standard, as in our study, and, thus, focusing on early aspects of postural instability in PwPD [40] contributed to a higher PPV. This is not surprising because the history of near falls has been reported to be a more powerful predictor of future falls than a history of falls [5]. However, monitoring of near falls, based on self-reports as in our study, may underestimate the true prevalence of such events [41,42]. There is ongoing research that aims to develop inertial sensors to improve detection of near falls and evaluation of fall risk [43,44,45].

Jacobs et al. [15] evaluated sensitivity/specificity of several tests such as the Push & Release (P&R) test and UPDRS30 in relation to falls as a golden standard. Reported sensitivity (0.35) and specificity (0.96) of UPDRS30 was largely in line with the results in our study and indicated the poor ability of this test for the detection of fallers. The P&R test, which includes an expected perturbation induced by the patient leaning backward while supported by the examiner, showed similar results (sensitivity 0.41 and specificity 0.77) [15]. Importantly, two comprehensive assessments of postural instability (the Mini-BESTest and Brief-BESTest) outperformed the P&R test and UPDRS30 [15]. Therefore, clinicians may benefit from using multi-item balance tests instead of a single-item when aiming to detect falls in PwPD. Furthermore, multi-item balance tests may have the additional benefit of guiding preventative interventions targeting balance impairments for those individuals who are classified to be at risk for future falls [15].

The major limitations of this study are that at T1, those with an inability to stand without support, i.e., spontaneous tendency to fall in the standing position, were excluded, which was not the case at T2. Moreover, at T2, the most severely affected PwPD, especially men and older persons, declined from participation, which challenges generalizability. Further, most of the participants in this study were relatively mildly affected by PD, and those above the age of 80 years were initially excluded. Thus, our findings may not apply to very old PwPD or those with more severe PD. However, our study samples appear representative of its target population. Furthermore, focusing on PwPD in the relatively early stages of the disease has been recommended for professionals to work proactively in preventing falls [46,47].

5. Conclusions

The clinical usefulness of the NRT and UPDRS30 for the prediction of falls and near falls is limited. Our findings speak against using either of these tests as a single assessment alone for this purpose and support previous recommendations of using a multifactorial approach when targeting balance difficulties and falls in PwPD.

Acknowledgments

The authors are grateful to all participants for their contribution to this study. Special thanks to Eva Berg (RN) for assistance with participant selection.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph182312325/s1, Table S1: comparison between those at T1 who dropped out at T2 (n = 88) and those at T1 who participated at T2 (n = 58).

Author Contributions

All authors have participated sufficiently in the research and take public responsibility for appropriate portions of the content. Conceptualization, B.L. and P.H.; methodology, B.L., E.F., W.D., P.O. and P.H.; software, B.L. and P.H.; validation, B.L., E.F. and P.H.; formal analysis, B.L. and P.H.; investigation, B.L.; resources, B.L.; data curation, B.L.; writing—original draft preparation, B.L., E.F. and P.H.; writing—review and editing, W.D. and P.O.; project administration, B.L.; funding acquisition, B.L. and P.H. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by grants from the Stoltz foundation (Department of Neurology, Rehabilitation Medicine, Memory Disorders and Geriatrics, Malmö, Skåne University Hospital, Sweden), Skåne County Council’s research and development foundation, the Promobilia Foundation, the Swedish Parkinson Foundation, the Swedish Parkinson Academy, the Academy of Caring Sciences (Skåne University Hospital, Sweden), and Kristianstad University, Sweden. None of the funders had any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Regional Ethics Committee of Lund, Sweden (Dnr 2011/768, 22 May 2018).

Informed Consent Statement

Written informed consent has been obtained from the patient(s) to publish this paper.

Data Availability Statement

The datasets generated during and/or analysed during the current study are not publicly available due to Swedish and EU personal data legislation but are available from the corresponding author on reasonable request. Any sharing of data will be regulated via a data transfer and user agreement with the recipient.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Allen N.E., Schwarzel A.K., Canning C.G. Recurrent Falls in Parkinson’s Disease: A Systematic Review. Parkinsons Dis. 2013;2013:906274. doi: 10.1155/2013/906274. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Almeida L.R., Sherrington C., Allen N.E., Paul S.S., Valenca G.T., Oliveira-Filho J., Canning C.G. Disability is an Independent Predictor of Falls and Recurrent Falls in People with Parkinson’s Disease Without a History of Falls: A One-Year Prospective Study. J. Parkinson’s Dis. 2015;5:855–864. doi: 10.3233/JPD-150651. [DOI] [PubMed] [Google Scholar]
  • 3.Gazibara T., Tepavcevic D.K., Svetel M., Tomic A., Stankovic I., Kostic V.S., Pekmezovic T. Recurrent falls in Parkinson’s disease after one year of follow-up: A nested case-control study. Arch. Gerontol. Geriatr. 2016;65:17–24. doi: 10.1016/j.archger.2016.02.006. [DOI] [PubMed] [Google Scholar]
  • 4.Gazibara T., Tepavcevic D.K., Svetel M., Tomic A., Stankovic I., Kostic V.S., Pekmezovic T. Near-falls in people with Parkinson’s disease: Circumstances, contributing factors and association with falling. Clin. Neurol. Neurosurg. 2017;161:51–55. doi: 10.1016/j.clineuro.2017.08.008. [DOI] [PubMed] [Google Scholar]
  • 5.Lindholm B., Hagell P., Hansson O., Nilsson M.H. Prediction of Falls and/or Near Falls in People with Mild Parkinson’s Disease. PLoS ONE. 2015;10:e0117018. doi: 10.1371/journal.pone.0117018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Jonasson S.B., Nilsson M.H., Lexell J. Psychometric properties of four fear of falling rating scales in people with Parkinson’s disease. BMC Geriatr. 2014;14:66. doi: 10.1186/1471-2318-14-66. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Stack E., Ashburn A. Fall events described by people with Parkinson’s disease: Implications for clinical interviewing and the research agenda. Physiother. Res. Int. 1999;4:190–200. doi: 10.1002/pri.165. [DOI] [PubMed] [Google Scholar]
  • 8.Huxham F.E., Goldie P.A., Patla A.E. Theoretical considerations in balance assessment. Aust. J. Physiother. 2001;47:89–100. doi: 10.1016/S0004-9514(14)60300-7. [DOI] [PubMed] [Google Scholar]
  • 9.Błaszczyk J.W., Orawiec R., Duda-Kłodowska D., Opala G. Assessment of postural instability in patients with Parkinson’s disease. Exp. Brain Res. 2007;183:107–114. doi: 10.1007/s00221-007-1024-y. [DOI] [PubMed] [Google Scholar]
  • 10.Ashburn A., Stack E., Ballinger C., Fazakarley L., Fitton C. The circumstances of falls among people with Parkinson’s disease and the use of Falls Diaries to facilitate reporting. Disabil. Rehabil. 2008;30:1205–1212. doi: 10.1080/09638280701828930. [DOI] [PubMed] [Google Scholar]
  • 11.Gazibara T., Pekmezovic T., Tepavcevic D.K., Tomic A., Stankovic I., Kostic V.S., Svetel M. Circumstances of falls and fall-related injuries among patients with Parkinson’s disease in an outpatient setting. Geriatr. Nurs. 2014;35:364–369. doi: 10.1016/j.gerinurse.2014.05.001. [DOI] [PubMed] [Google Scholar]
  • 12.Winter D.A. Human balance and posture control during standing and walking. Gait Posture. 1995;3:193–214. doi: 10.1016/0966-6362(96)82849-9. [DOI] [Google Scholar]
  • 13.Nutt J., Hammerstad J., Gancher S. Parkinson’s Disease: 100 Maxims. Edward Arnold; London, UK: 1992. Diagnosis: Is it Parkinsonism? Major Symptoms and Signs of the Disorder; pp. 3–9. [Google Scholar]
  • 14.Visser M., Marinus J., Bloem B.R., Kisjes H., Berg B.M.V.D., van Hilten J.J. Clinical tests for the evaluation of postural instability in patients with parkinson’s disease. Arch. Phys. Med. Rehabil. 2003;84:1669–1674. doi: 10.1053/S0003-9993(03)00348-4. [DOI] [PubMed] [Google Scholar]
  • 15.Jacobs J.V., Earhart G.M., McNeely M.E. Can postural instability tests improve the prediction of future falls in people with Parkinson’s disease beyond knowing existing fall history? J. Neurol. 2015;263:133–139. doi: 10.1007/s00415-015-7950-x. [DOI] [PubMed] [Google Scholar]
  • 16.Horak F.B., Dimitrova D., Nutt J.G. Direction-specific postural instability in subjects with Parkinson’s disease. Exp. Neurol. 2005;193:504–521. doi: 10.1016/j.expneurol.2004.12.008. [DOI] [PubMed] [Google Scholar]
  • 17.Fahn S., Elton R., UPDRS Development Committee . Recent Developments in Parkinson’s Disease. McMillan Healthcare Information; Florham Park, NJ, USA: 1987. Unified Parkinson’s Disease Rating Scale; pp. 153–163, 293–304. [Google Scholar]
  • 18.Valkovič P., Brožová H., Bötzel K., Růžička E., Benetin J. Push and release test predicts better Parkinson fallers and nonfallers than the pull test: Comparison in OFF and ON medication states. Mov. Disord. Off. J. Mov. Disord. Soc. 2008;23:1453–1457. doi: 10.1002/mds.22131. [DOI] [PubMed] [Google Scholar]
  • 19.Bewick V., Cheek L., Ball J. Statistics review 13: Receiver operating characteristic curves. Crit. Care. 2004;8:508–512. doi: 10.1186/cc3000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Loong T.-W. Understanding sensitivity and specificity with the right side of the brain. BMJ. 2003;327:716–719. doi: 10.1136/bmj.327.7417.716. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Akobeng A.K. Understanding diagnostic tests 1: Sensitivity, specificity and predictive values. Acta Paediatr. 2007;96:338–341. doi: 10.1111/j.1651-2227.2006.00180.x. [DOI] [PubMed] [Google Scholar]
  • 22.Akobeng A.K. Understanding diagnostic tests 2: Likelihood ratios, pre- and post-test probabilities and their use in clinical practice. Acta Paediatr. 2007;96:487–491. doi: 10.1111/j.1651-2227.2006.00179.x. [DOI] [PubMed] [Google Scholar]
  • 23.Hughes A.J., Daniel S.E., Kilford L., Lees A.J. Accuracy of clinical diagnosis of idiopathic Parkinson’s disease: A clinico-pathological study of 100 cases. J. Neurol. Neurosurg. Psychiatry. 1992;55:181–184. doi: 10.1136/jnnp.55.3.181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hoehn M.M., Yahr M.D. Parkinsonism: Onset, progression, and mortality. Neurology. 2001;57:11–26. [PubMed] [Google Scholar]
  • 25.Folstein M.F., Folstein S.E., McHugh P.R. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 1975;12:189–198. doi: 10.1016/0022-3956(75)90026-6. [DOI] [PubMed] [Google Scholar]
  • 26.Goetz C.G., Stebbins G.T., Chmura T.A., Fahn S., Klawans H.L., Marsden C.D. Teaching tape for the motor section of the unified Parkinson’s disease rating scale. Mov. Disord. Off. J. Mov. Disord. Soc. 1995;10:263–266. doi: 10.1002/mds.870100305. [DOI] [PubMed] [Google Scholar]
  • 27.Lamb S.E., Jã¸rstad-Stein E.C., Hauer K., Becker C., Prevention of Falls Network Europe and Outcomes Consensus Group Development of a Common Outcome Data Set for Fall Injury Prevention Trials: The Prevention of Falls Network Europe Consensus. J. Am. Geriatr. Soc. 2005;53:1618–1622. doi: 10.1111/j.1532-5415.2005.53455.x. [DOI] [PubMed] [Google Scholar]
  • 28.Gray P., Hildebrand K. Fall risk factors in Parkinson’s disease. J. Neurosci. Nurs. 2000;32:222–228. doi: 10.1097/01376517-200008000-00006. [DOI] [PubMed] [Google Scholar]
  • 29.Tomlinson C.L., Stowe R., Patel S., Rick C., Gray R., Clarke C.E. Systematic review of levodopa dose equivalency reporting in Parkinson’s disease. Mov. Disord. 2010;25:2649–2653. doi: 10.1002/mds.23429. [DOI] [PubMed] [Google Scholar]
  • 30.Abramson J.H. WINPEPI updated: Computer programs for epidemiologists, and their teaching potential. Epidemiol. Perspect. Innov. 2011;8:1. doi: 10.1186/1742-5573-8-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Jacobs J.V., Horak F.B., Tran V.K., Nutt J.G. Multiple balance tests improve the assessment of postural stability in subjects with Parkinson’s disease. J. Neurol. Neurosurg. Psychiatry. 2006;77:322–326. doi: 10.1136/jnnp.2005.068742. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Nonnekes J., Goselink R., Weerdesteyn V., Bloem B.R. The retropulsion test: A good evaluation of postural instability in Parkinson’s disease? J. Parkinson’s Dis. 2015;5:43–47. doi: 10.3233/JPD-140514. [DOI] [PubMed] [Google Scholar]
  • 33.van der Marck M.A., Klok M.P.C., Okun M.S., Giladi N., Munneke M., Bloem B.R., Force N.F.T. Consensus-based clinical practice recommendations for the examination and management of falls in patients with Parkinson’s disease. Parkinsonism Relat. Disord. 2014;20:360–369. doi: 10.1016/j.parkreldis.2013.10.030. [DOI] [PubMed] [Google Scholar]
  • 34.Segev-Jacubovski O., Herman T., Yogev-Seligmann G., Mirelman A., Giladi N., Hausdorff J.M. The interplay between gait, falls and cognition: Can cognitive therapy reduce fall risk? Expert Rev. Neurother. 2011;11:1057–1075. doi: 10.1586/ern.11.69. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Paul S.S., Canning C.G., Sherrington C., Lord S.R., Close J.C., Fung V.S. Three simple clinical tests to accurately predict falls in people with Parkinson’s disease. Mov. Disord. 2013;28:655–662. doi: 10.1002/mds.25404. [DOI] [PubMed] [Google Scholar]
  • 36.Duncan R.P., Cavanaugh J.T., Earhart G.M., Ellis T.D., Ford M.P., Foreman K.B., Leddy A.L., Paul S.S., Canning C.G., Thackeray A., et al. External validation of a simple clinical tool used to predict falls in people with Parkinson disease. Parkinsonism Relat. Disord. 2015;21:960–963. doi: 10.1016/j.parkreldis.2015.05.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Lindholm B., Nilsson M.H., Hansson O., Hagell P. External validation of a 3-step falls prediction model in mild Parkinson’s disease. J. Neurol. 2016;263:2462–2469. doi: 10.1007/s00415-016-8287-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Lindholm B., Brogårdh C., Odin P., Hagell P. Longitudinal prediction of falls and near falls frequencies in Parkinson’s disease: A prospective cohort study. J. Neurol. 2021;268:997–1005. doi: 10.1007/s00415-020-10234-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Bloem B.R., Grimbergen Y.A., Cramer M., Willemsen M., Zwinderman A.H. Prospective assessment of falls in Parkinson’s disease. J. Neurol. 2001;248:950–958. doi: 10.1007/s004150170047. [DOI] [PubMed] [Google Scholar]
  • 40.Sipp A.R., Rowley B.A. Detection of baseline and near-fall postural stability; Proceedings of the 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society; Vancouver, BC, Canada. 20–25 October 2008; pp. 1262–1265. [DOI] [PubMed] [Google Scholar]
  • 41.Srygley J.M., Herman T., Giladi N., Hausdorff J.M. Self-Report of Missteps in Older Adults: A Valid Proxy of Fall Risk? Arch. Phys. Med. Rehabil. 2009;90:786–792. doi: 10.1016/j.apmr.2008.11.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Teno J., Kiel D., Mor V. Multiple Stumbles: A Risk Factor for Falls in Community-Dwelling Elderly; A Prospective Study. J. Am. Geriatr. Soc. 1990;38:1321–1325. doi: 10.1111/j.1532-5415.1990.tb03455.x. [DOI] [PubMed] [Google Scholar]
  • 43.Lee J.K., Robinovitch S., Park E.J. Inertial Sensing-Based Pre-Impact Detection of Falls Involving Near-Fall Scenarios. IEEE Trans. Neural Syst. Rehabil. Eng. 2015;23:258–266. doi: 10.1109/TNSRE.2014.2357806. [DOI] [PubMed] [Google Scholar]
  • 44.Stack E., King R., Janko B., Burnett M., Hammersley N., Agarwal V., Hannuna S., Burrows A., Ashburn A. Could In-Home Sensors Surpass Human Observation of People with Parkinson’s at High Risk of Falling? An Ethnographic Study. BioMed Res. Int. 2016;2016:3703745. doi: 10.1155/2016/3703745. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Hansson E.E., Tornberg Å. Coherence and reliability of a wearable inertial measurement unit for measuring postural sway. BMC Res. Notes. 2019;12:201. doi: 10.1186/s13104-019-4238-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Kerr G.K., Worringham C.J., Cole M.H., Lacherez P.F., Wood J.M., Silburn P.A. Predictors of future falls in Parkinson disease. Neurology. 2010;75:116–124. doi: 10.1212/WNL.0b013e3181e7b688. [DOI] [PubMed] [Google Scholar]
  • 47.Pickering R.M., Grimbergen Y.A., Rigney U., Ashburn A., Mazibrada G., Wood B., Gray P., Kerr G., Bloem B.R. A meta-analysis of six prospective studies of falling in Parkinson’s disease. Mov. Disord. 2007;22:1892–1900. doi: 10.1002/mds.21598. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

The datasets generated during and/or analysed during the current study are not publicly available due to Swedish and EU personal data legislation but are available from the corresponding author on reasonable request. Any sharing of data will be regulated via a data transfer and user agreement with the recipient.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES