Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Apr 29;15(4):e0231984. doi: 10.1371/journal.pone.0231984

The turning and barrier course reveals gait parameters for detecting freezing of gait and measuring the efficacy of deep brain stimulation

Johanna O’Day 1,2, Judy Syrkin-Nikolau 2,¤a, Chioma Anidi 2,¤b, Lukasz Kidzinski 1, Scott Delp 1, Helen Bronte-Stewart 2,3,*
Editor: Fabio A Barbieri4
PMCID: PMC7190141  PMID: 32348346

Abstract

Freezing of gait (FOG) is a devastating motor symptom of Parkinson’s disease that leads to falls, reduced mobility, and decreased quality of life. Reliably eliciting FOG has been difficult in the clinical setting, which has limited discovery of pathophysiology and/or documentation of the efficacy of treatments, such as different frequencies of subthalamic deep brain stimulation (STN DBS). In this study we validated an instrumented gait task, the turning and barrier course (TBC), with the international standard FOG questionnaire question 3 (FOG-Q3, r = 0.74, p < 0.001). The TBC is easily assembled and mimics real-life environments that elicit FOG. People with Parkinson’s disease who experience FOG (freezers) spent more time freezing during the TBC compared to during forward walking (p = 0.007). Freezers also exhibited greater arrhythmicity during non-freezing gait when performing the TBC compared to forward walking (p = 0.006); this difference in gait arrhythmicity between tasks was not detected in non-freezers or controls. Freezers’ non-freezing gait was more arrhythmic than that of non-freezers or controls during all walking tasks (p < 0.05). A logistic regression model determined that a combination of gait arrhythmicity, stride time, shank angular range, and asymmetry had the greatest probability of classifying a step as FOG (area under receiver operating characteristic curve = 0.754). Freezers’ percent time freezing and non-freezing gait arrhythmicity decreased, and their shank angular velocity increased in the TBC during both 60 Hz and 140 Hz STN DBS (p < 0.05) to non-freezer values. The TBC is a standardized tool for eliciting FOG and demonstrating the efficacy of 60 Hz and 140 Hz STN DBS for gait impairment and FOG. The TBC revealed gait parameters that differentiated freezers from non-freezers and best predicted FOG; these may serve as relevant control variables for closed loop neurostimulation for FOG in Parkinson’s disease.

Introduction

Gait impairment and freezing of gait (FOG) are common in Parkinson’s disease, and lead to falls, [13] resulting in injury, loss of independence, institutionalization, and even death [4,5]. Over 10 million people are affected by Parkinson’s disease (PD) worldwide, and over 80% of people with moderate to advanced PD develop FOG [6]. Gait impairment is characterized by the loss of rhythmic alternating cycles of forward motion of one leg during the stance phase of the other leg, which are represented by the variability of stride time (rhythmicity) and the angular velocity of the lower leg (shank angular velocity) during the swing phase, respectfully. FOG is an intermittent, involuntary inability to perform alternating stepping and usually occurs when patients attempt to initiate walking, turn, or navigate obstacles.

Understanding and treating gait impairment and FOG are paramount unmet needs and were given the highest priority at the National Institute of Neurological Disorders and Stroke 2014 PD conference [7]. Both gait impairment and FOG have unpredictable responses to dopaminergic medication and continuous high frequency open loop subthalamic deep brain stimulation (DBS) [8,9]. Although gait impairment and FOG may improve on continuous lower frequency (60 Hz) DBS, Parkinsonian tremor may worsen, and many patients do not tolerate 60 Hz DBS for long periods of time [1012]. A closed loop, adaptive system that can adjust stimulation appropriately may be able to improve therapy for FOG and impaired gait. Before this goal can be attained, however, it is important to determine which gait parameters are associated with freezing behavior, which predict freezing events, and the effect of different DBS frequencies on gait impairment and FOG.

Several studies have employed wearable inertial sensors to monitor, detect, and predict FOG using a variety of different gait parameters. The most popular approach has been to use a frequency-based analysis of leg accelerations to capture the “trembling of knees” associated with FOG, and many variations on this approach have been described including the “freeze index” [13] and “Frequency Ratio” [14]. These studies have employed a variety of different FOG-eliciting tasks, such as turning 360 degrees in place for two minutes, walking around cones, or walking during dual tasking [1422]. These tasks have improved the detection of FOG but are not representative of real-world environments, or cannot objectively measure gait arrhythmicity, which has been correlated with FOG [2327]. Objective gait measures and standardized gait tasks that reliably induce FOG are needed to study the progression of gait impairment and FOG in PD, and the efficacy of therapeutic interventions.

The goals of this study were to (1) validate a standardized gait task, the turning and barrier course (TBC), which mimics real-life environments and elicits FOG, (2) discover relevant gait parameters for detecting FOG in Parkinson’s disease in the TBC, and (3) evaluate the effects of 60 Hz and 140 Hz subthalamic deep brain stimulation (DBS) on quantitative measures of non-freezing gait and FOG.

Materials and methods

Human subjects

Twenty-three subjects with PD (8 female), and 12 age-matched healthy controls (11 female), participated in the study. Subjects were recruited from the Stanford Movement Disorders Center and were not pre-selected based on a history of FOG. Subjects were excluded if they had peripheral neuropathy, hip or knee prostheses, structural brain disorders, or any visual or anatomical abnormalities that affected their walking. For all PD subjects, long-acting dopaminergic medication was withdrawn over 24h (72h for extended-release dopamine agonists), and short-acting medication was withdrawn over 12h before all study visits. A certified rater performed the Unified Parkinson’s Disease Rating Scale (UPDRS III) motor disability scale [28], and the Freezing of Gait Questionnaire (FOG-Q, [29]) on all subjects. Four subjects had FOG-Q scores taken from a prior research visit within the last 4 months. Subjects were classified as a freezer or non-freezer based on the FOG-Q question 3 (FOG-Q3): Do you feel that your feet get glued to the floor while walking, turning or when trying to initiate walking? The scores were as follows: 0 –never, 1 –about once a month, 2 –about once a week, 3 –about once a day, 4 –whenever walking. A freezer was defined as a subject who reported a FOG-Q3 ≥ 2 or if the subject exhibited a freezing event during the tasks. Control subjects were excluded if they reported neurological deficits or interfering pathology that affected their gait. All subjects gave their written informed consent to participate in the study, which was approved by the FDA and the Stanford Institutional Review Board.

Experimental protocol

All experiments were performed off therapy (medication and/or DBS). Subjects performed two gait tasks: Forward Walking (FW), which is a standard clinical test of Parkinson’s gait, and the TBC, in a randomized order at their self-selected pace. Both tasks started with 20s of quiet standing. For the FW task, subjects walked in a straight line for 10m, turned around and returned, and repeated this for a total of 40 m. We only analyzed data from the straight walking parts of FW. The FW task was conducted in a hallway at least 1.7 m wide formed by a wall and room dividers (Bretford Mobile Screens, Pivot Interiors Inc., Pleasanton, CA). The room dividers were 1.98 m high and a maximum of 1.14 m wide. In the TBC, subjects walked around and through a narrow opening formed by room dividers [25], Fig 1A.

Fig 1. Turning and Barrier Course (TBC) dimensions and specifications.

Fig 1

A: the individual barrier and course dimensions. Tall barriers limited vision around turns and narrow passageways to simulate a real-world environment. B: front view with patient walking in the TBC. C: aerial diagram of the TBC with barriers (dark grey bars) and wall (light grey bar). Subjects walked in two ellipses and then two figures of eight around the barriers; this task was repeated starting on both the left and right side, for a total of four ellipses and four figures of eight.

The TBC was enclosed by a row of dividers on one side and a wall on the other, Fig 1B, which limited the subjects’ visual field; the aisles of the TBC were the same width as a standard minimum hallway (0.91 meters) in the U.S., and the narrow opening between dividers was the same width as a standard doorway (0.69 meters), Fig 1A. After the initial standing rest period, the subject was instructed to sit on the chair. At the ‘Go’ command, the subject was instructed to stand up, walk around the dividers twice in an ellipse, and then walk in a ‘figure of eight’ (i.e., around and through the opening between the dividers), twice, before sitting down again, Fig 1C. The subject was then instructed to repeat the task in the opposite direction, for a total of four ellipses and four figures of eight. The direction order was randomized.

Data acquisition and analysis

Shank angular velocity was measured during the gait tasks using wearable inertial measurement units (IMUs, APDM, Inc., Portland, OR), which were positioned in a standardized manner on the lateral aspect of both shanks. We aligned the IMU on the shank so that the positive Z-axis was directed laterally and measured the angular velocity of the shank in the sagittal plane. Signals from the IMUs’ triaxial gyroscope and accelerometer and magnetometer were sampled at 128 Hz. The data were filtered using a zero phase 8th order low pass Butterworth filter with a 9 Hz cut-off frequency, and principal component analysis was used to align the angular velocity with the sagittal plane. Using the sagittal plane angular velocity, the beginning of the swing phase (positive slope zero crossing), end of swing phase (subsequent negative slope zero crossing), and peak shank angular velocities (first positive peak following the beginning of swing phase) were identified, Fig 2.

Fig 2. Gait parameters extracted from inertial measurement units (IMU).

Fig 2

Top: schematic of one gait cycle with IMU on the shank used to define gait parameters including stride time, forward swing time, swing angular range and peak angular velocities (peak AV). Bottom: gait parameters extracted from shank sagittal angular velocity data for the left (blue) and right (red) legs during periods of non-freezing walking, and freezing of gait (orange).

Forward swing times (time between subsequent zero crossings of the same leg) and stride times (time between consecutive peak angular velocities) were calculated from these data, Fig 2. We used the peaks of the shank angular velocity trace (corresponding to forward swing of the leg) to calculate stride times for each leg to avoid difficulty of discerning heel strikes in PD [30]. These angular velocity peaks were readily identifiable with a computer algorithm and visually. Peaks were marked as steps only if they exceeded a minimum threshold of 10 deg/s, therefore freezing episodes occurred when there was no forward movement of leg or it was below this threshold. Swing angular range was calculated by integrating the sagittal angular velocity curve during the swing time. Swing times and stride times were used to calculate asymmetry and arrhythmicity respectively, during periods when the subject was not freezing. Asymmetry was defined as: asymmetry = 100 × |ln(SSWT/LSWT)|, where SSWT and LSWT correspond to the leg with the shortest and longest mean swing time over the trials, respectively and arrhythmicity was defined as: arrhythmicity = the mean stride time coefficient of variation of both legs [23,26,31]. A large stride time coefficient of variation is indicative of a less rhythmic gait. We developed a “forward freeze index” inspired by the “Freeze Index” [13], and used antero-posterior accelerations instead of vertical accelerations, making it similar to the “Frequency Ratio” [14]. We used a window of 2s rather than 4s because 2s was closer to the mean stride time, and therefore consistent with our other stride-by-stride metrics. The forward freeze index was calculated as the square of the total power in the freeze band (3–8 Hz) over a 2s window, divided by the square of the total power in the locomotor band (0.5–3 Hz) over the same 2s window. External videos of all tasks were acquired on an encrypted clinical iPad (Apple Inc., Sunnyvale, CA) and synchronized with the APDM data capture system through the Videography application (Appologics Inc., Germany).

A logistic regression model of freezing of gait

We developed a logistic regression model to calculate the probability that a given stride was part of a freezing episode. The model was trained using 8 gait parameters (peak shank angular velocity, stride time, swing angular range, arrhythmicity, asymmetry, forward freeze index, peak shank angular velocity of the previous step, stride time of the previous step) and ground truth binary labels (FOG = 1, no FOG = 0), from an experienced neurologist’s (HBS) video-determined ratings of freezing behavior, defined as periods where patient’s normal gait pattern changed (usually prior to a freezing episode) and where such behavior ended. VCode software (Hagedorn, Hailpern, & Karahalios, 2008), was used to mark periods of freezing behavior in each video with an accuracy of 10ms. Individual strides were identified using the shank angular velocity trace as described above, and gait parameters were extracted for each stride. The following gait parameters were calculated for each leg independently: peak shank angular velocity, stride time, swing time, and swing angular range. The stride time and peak shank angular velocity were normalized to averages from the subject’s FW trial so that subjects could be combined and compared to one another in the model. A step is likely to be a freeze if the step before it has characteristics of a freeze, so the peak shank angular velocity for the previous stride was included as a model input [15]. The swing and stride times for both legs were concatenated to calculate arrhythmicity and asymmetry over the past 6 strides.

Analysis of gait parameters was performed in MATLAB (version 9.2, The MathWorks Inc. Natick, MA, USA), and the logistic regression model was constructed using R (R Core Team (2017)). We used a logistic regression model with a sparse set of features determined by L1 regularization (LASSO) to predict whether a step was freezing or not. To evaluate model performance, we used leave-one-out cross validation (LOOCV), which we refer to as external LOOCV, where we left out a single subject as the test set. We then used the remaining subjects as a training set, and used internal LOOCV, leaving out another subject as an internal test set with which we used L1 regularization (LASSO) to determine a sparse set of features for the model. Regularization minimizes the coefficients of different gait parameters, and the severity to which it does this is determined by the regularization parameter. We found the best regularization parameter (0.01) from the internal training set. This was repeated so that all subjects were left out. We found that the variables selected by the internal LOOCV were consistent across all runs, giving the combination of variables that best identified FOG. In both LOOCVs, we kept subjects, who had multiple visits’ worth of data together. For example, if Subject X had two different visits, then data from both visits were either in the training set or in the test set.

Investigating effects of DBS frequency in a subset of the PD cohort

A subset of the cohort, twelve PD subjects (7 freezers and 5 non-freezers), had been treated with at least 21 months of optimized, continuous high frequency subthalamic DBS using an implanted, investigative, concurrent sensing, and stimulating, neurostimulator (Activa® PC + S, FDA-IDE approved; model 3389 leads, Medtronic, Inc.). Kinematic recordings were obtained, off medication, during randomized presentations of no, 60 Hz, and 140 Hz subthalamic DBS while subjects performed the TBC. The voltage was the same at both frequencies for each subject’s subthalamic nucleus. At least five minutes was allotted between experiments to allow the subjects to rest.

Statistics

A two-way repeated-measures multivariate analysis of variance (MANOVA) test was conducted to assess the effect of Group (Control, Non-Freezer, Freezer) or Task (Forward Walking, TBC ellipse, TBC figure of eight), on average peak shank angular velocity, stride time, asymmetry, and arrhythmicity for the three groups during non-freezing walking while OFF DBS. If a main effect was found in the MANOVA, follow up univariate ANOVAs were used to evaluate significant parameters. Post-hoc pairwise effects were examined using a Bonferroni correction. A three-way repeated measures ANOVA was used to compare the effect of DBS frequency (OFF, 60 Hz, 140 Hz), Group (Non-Freezer, Freezer), or Task (TBC ellipse, TBC figure of eight) during non-freezing walking in the TBC. Post hoc analyses were conducted to compare between stimulation conditions. A Student t-test was used to compare freezers’ percent time spent freezing in the TBC ellipses versus TBC figures of eight. Students t-tests were used for the comparison of demographics between the freezer, non-freezer and control groups. A paired samples Wilcoxon test was used to compare UPDRS III scores between visits for subjects with repeated visits. The relationship between percent time freezing and FOG-Q3 response was investigated using a Spearman correlation analysis. The relationship between gait parameters and FOG-Q3 response was investigated using a Spearman correlation analysis. The relationship between percent time freezing and average peak shank angular velocity, stride time, asymmetry, and arrhythmicity during non-freezing walking was investigated using a Pearson correlation analysis to compare freezers’ non-freezing walking with the severity of their freezing behavior. All statistical testing was performed in SPSS Version 21, or SigmaPlot (Systat Software, San Jose, CA) using two-tailed tests with significance levels of p < .05.

Results

Human subjects

Among the 23 PD subjects, there were 8 freezers, 13 non-freezers, and 2 subjects who converted from the definition of a non-freezer to a freezer between two visits. Non-freezers and controls were of similar ages, while freezers were younger (65.9 ± 7.5, 66.9 ± 8.9 years, 57.9 ± 6.14, respectively, p < 0.05). Disease duration was similar between the freezer and non-freezer groups (9.3 ± 2.8, 8.9 ± 4.2 years, respectively). Freezers had a higher off medication UPDRS III score than non-freezers (39.8 ± 9.2, 24.1 ± 13.6 respectively, p < 0.01), and all PD patients had higher UPDRS III scores than controls (p < 0.001). All subjects completed all walking tasks, except two freezers who could not complete the TBC, and one non-freezer whose sensor data was unusable; these three subjects were excluded from the analysis. Three healthy control subjects were excluded due to arthritis (N = 2) or essential tremor (N = 1), which affected their walking. The average total durations of FW and the TBC were 33.1 ± 8.7 and 157.4 ± 88.9 seconds, respectively.

Nine subjects had repeat visits. The length between repeated visits was 430 ± 112 days (mean ± SD) and the repeated visit group’s mean UPDRS III score trended higher but was not significant at the second visit (32.4 ± 12.0, 35.7 ± 14.8, respectively, p = 0.09). The repeated patient visits were treated independently. Data from 40 visits (9 from controls, 13 from freezers, and 18 from non-freezers) were used to examine how the three different cohorts completed the gait tasks while OFF stimulation. In assessing the effects of lower and high frequency subthalamic DBS on subjects in the TBC, there were no repeat visits.

Gait parameters and percent time freezing in the TBC correlated with the FOG-Q3

Subjects’ gait arrhythmicity and shank angular velocity during non-freezing gait of the FW task, TBC ellipses and TBC figures of eight were strongly correlated with their self-reported freezing severity (FOG-Q3 score; r = 0.65, 0.46, 0.73 for arrhythmicity respectively, and r = -0.58, -0.46, -0.65 for shank angular velocity respectively, p < 0.003 for all), Fig 3. The correlation was strongest during the TBC figures of eight for both gait parameters.

Fig 3. Relationship between gait parameters and freezing of gait questionnaire question 3 (FOG-Q3) during walking tasks.

Fig 3

Correlation with FOG-Q3 between A–C: gait arrhythmicity, and D–F: shank angular velocity, during FW (A, D), TBC ellipses (B, E), and TBC figures of eight (C, F). Regression lines (black line) and confidence intervals of the correlation coefficient at 95% (shaded grey), and subjects (black dots) shown.

Gait asymmetry was also modestly correlated with FOG-Q3 score in the FW task, the TBC ellipses and the TBC figures of eight (r = 0.44, 0.46, 0.42 respectively, p < 0.01 for all). Stride time was not correlated with FOG-Q3 in any of the walking tasks (p > 0.05 for all).

During the TBC, all freezers experienced a freezing episode. In total, 217 freezing episodes were identified. Freezers spent more time freezing in the TBC figures of eight than the TBC ellipses (38.23 ± 29.0%, 23.6 0 ± 19.3%, respectively, p < 0.01). During FW only one freezer experienced a freezing episode. Freezers spent an average of 33.0 ± 24.2% of the time freezing in the TBC compared to the one freezer who spent 2% of the time freezing during forward walking and was a moderate to severe freezer who spent 59% of the TBC task freezing (as determined by the blinded neurologist). There was a strong correlation between the time spent freezing in the TBC and a subject’s report of freezing severity from the FOG-Q3 (r = 0.74, p < 0.001), which validates the TBC as a tool for measuring FOG in Parkinson’s disease. There was no significant correlation between the time spent freezing during FW and a subject’s report of freezing severity from the FOG-Q3 (r = 0.28, p = 0.075). These results validate the TBC as a task that can measure gait impairment and FOG; the TBC figures of eight resulted in the strongest correlations between the FOG-Q3 and gait arrhythmicity, shank angular velocity and percent time freezing compared to the TBC ellipses or FW.

Arrhythmicity during non-freezing gait differentiates freezers from non-freezers

Gait arrhythmicity during non-freezing walking differentiated freezers from non-freezers and from healthy controls in all gait tasks, Fig 4. MANOVA results indicated a main effect of Group (freezer, non-freezer, control, p < 0.001) and Task (FW, TBC ellipse, TBC figures of eight, p < 0.001), demonstrating that the three groups were distinguishable regardless of task, and the tasks were distinguishable regardless of group. All four of the gait parameters showed significant univariate effects of Group, and all gait parameters except asymmetry showed significant univariate effects of Task. There was an interaction effect of Task*Group (p = 0.011), with a univariate effect only in arrhythmicity. Post-hoc pairwise comparisons showed that freezers’ non-freezing gait was more arrhythmic than that of non-freezers or controls during all tasks (p < 0.05 for all), Fig 4A.

Fig 4. Group gait parameters during walking tasks.

Fig 4

A: Gait arrhythmicity, B: average peak shank angular velocity, C: asymmetry, and D: stride time in healthy controls, non-freezers and freezers, during non-freezing FW, TBC ellipses and TBC figures of eight. Error bars represent standard deviation. * p < 0.05; ** p < 0.01; *** p < 0.001; ^ p < 0.05 TBC ellipses and TBC figures of eight compared to FW in freezers; ~ p < 0.05 between TBC ellipses and TBC figures of eight in non-freezers and in freezers.

Post-hoc pairwise comparisons showed that freezers’ non-freezing gait during both the TBC ellipses and TBC figures of eight demonstrated greater arrhythmicity compared to their non-freezing gait during FW (p = 0.001, p < 0.001, respectively), and the arrhythmicity of both freezers and non-freezers was greater in the TBC figures of eight than in the TBC ellipses (p < 0.001, p = 0.02 respectively), Fig 4A. No pairwise effect was detected for non-freezers’ or controls’ gait arrhythmicity between TBC and FW. There was no Task*Group interaction observed for shank angular velocity, stride time or asymmetry, though the observed power for these variables was low.

Gait features in logistic regression model detect freezing on a step-by-step basis

A logistic regression model demonstrated that the best predictor of whether a stride was part of a freezing episode used a combination of four gait parameters: swing angular range, stride time, arrhythmicity, and asymmetry, and had an AUC of 0.754, Fig 5A.

Fig 5. Logistic regression model performance for different gait parameters.

Fig 5

A: overall model performance: AUC values for different model iterations using leave-one-out cross validation on the freezer group. First row: individual gait parameters; second row: all gait parameters; third row: sparse parameter set chosen from regularization. Peak Shank AV = Peak Shank Angular Velocity. Some metrics are calculated over a window of steps in time: “t-3:t” represents a window from “t-3” or 3 steps earlier, to and including the current step “t”. B: representative shank angular velocity traces from right and left legs; model-identified freezing events (pink shading) and neurologist-identified freezing behavior (orange shading).

Of these, the gait parameter with the largest coefficient and thereby the strongest predictor of whether a step was part of a freeze, was the arrhythmicity over the last six steps (coefficient of 2.034), followed by stride time (coefficient of 0.0931), swing angular range (coefficient of -0.0615), and finally asymmetry over the last six steps (coefficient of 0.0003), with a model intercept of 0.941. The logistic regression models with single parameters had all coefficients significantly different from zero (p < 0.001) but most were only moderately better than chance (AUC = 0.5), first row Fig 5A. A logistic regression model using all gait parameters, second row in Fig 5A, outperformed any single-parameter model but had an AUC (0.750) less than that of the four-parameter-model.

Since the AUC is a threshold-independent assessment of the model, we calculated the accuracy of the model at a threshold of 0.50 (e.g. if the probability that the step was a freeze was over 50% then it was determined to be a freeze). At this threshold, the accuracy of the model to correctly identify a step as freezing or not freezing ((true positives + true negatives)/total number of steps), was 90%. We found that the model often detected a freezing event within the interval defined as freezing behavior by the neurologist, Fig 5B. In this case, the model overlapped with the neurologist-identified freezing behavior, though it did not detect some of preceding or succeeding freezing behavior identified by the neurologist. We defined such a case as correct model-identification of a freezing event, and overall, the model correctly identified 77% of the neurologist-identified freezing behavior events, overlapping with neurologist markings within a 2-stride window.

The time spent freezing in the TBC for all subjects, identified by the logistic regression model, correlated with the subject’s score on FOG-Q3 (r = 0.68, p < 0.001). The percent time freezing predicted by the model for the control subjects and non-freezers was less than 1% for each subject, except for one subject who had one step erroneously classified as freezing resulting in 2.5% time spent freezing in the TBC.

Percent time spent freezing correlated with freezers’ gait parameters during non-freezing gait in the TBC

Freezers’ gait arrhythmicity during non-freezing gait in both the TBC ellipses and the TBC figures of eight were strongly correlated with their percent time freezing, as determined by the model (r = 0.94, r = 0.92 respectively, p < 0.001 for both), Fig 6. Gait arrhythmicity during FW was not correlated with percent time freezing, Fig 6A.

Fig 6. Relationship between freezers’ non-freezing gait arrhythmicity and freezing severity.

Fig 6

Relationship between freezers’ non-freezing gait arrhythmicity and percent time freezing A: during FW, B: during the TBC ellipses, and C: during the TBC figures of eight. Regression lines (black line) and confidence intervals of the correlation coefficient at 95% (shaded grey), and subjects (colored dots) shown.

Freezers’ peak shank angular velocity during non-freezing gait in the TBC figures of eight, but not in the TBC ellipses or FW, also correlated with their percent time spent freezing in the TBC (r = - 0.71, p < 0.01, data not shown). There was no correlation between gait asymmetry or stride time during non-freezing walking in the TBC, or between any gait parameter during FW, with percent time freezing in the TBC. These results demonstrated that increased gait arrhythmicity and decreased peak shank angular velocity of non-freezing gait during the TBC were strong markers of FOG severity in PD freezers.

Sixty Hz and 140 Hz subthalamic DBS improved non-freezing gait impairment and FOG in freezers during the TBC

Gait impairment and FOG improved during both 60 Hz and 140 Hz subthalamic DBS: the percent time spent freezing in the TBC was lower during either 60 Hz or 140 Hz DBS compared to when OFF DBS in freezers (5 ± 7%, 9 ± 10%, 35 ± 23%, respectively, p < 0.05) and was not different from that of non-freezers (whose percent time spent freezing was zero).

Fig 7 demonstrates that there was a statistically significant effect of DBS frequency (OFF, 60 Hz, 140 Hz) on shank angular velocity and arrhythmicity (p < 0.01, p < 0.05), as well as a statistically significant effect of Task (TBC ellipse, TBC figure of eight) on shank angular velocity (p < 0.001) as determined by three-way repeated measures ANOVAs.

Fig 7. Gait arrhythmicity and average peak shank angular velocity OFF and during 60 Hz and 140 Hz deep brain stimulation (DBS).

Fig 7

A: Gait arrhythmicity and B: average peak shank angular velocity during stimulation conditions. Healthy control averages shown (green line) with standard deviations (shaded green). Error bars represent standard deviation. * denotes p < 0.05, ** denotes p < 0.01.

Freezers’ gait arrhythmicity during the TBC decreased to values not statistically different from those of non-freezers during both 60 Hz and 140 Hz DBS (p > 0.05), Fig 7A, despite freezers’ arrhythmicity being significantly higher than that of non-freezers OFF DBS (p < 0.01). Freezers’ shank angular velocity increased during either frequency of DBS (p < 0.01), Fig 7B, despite being significantly less than that of non-freezers OFF DBS (p = 0.036). There was no effect of DBS on stride time or asymmetry as determined by three-way repeated measures ANOVAs in freezers and DBS had no detectable effect on any of the non-freezers’ gait parameters.

OFF DBS freezers had significantly higher arrhythmicity and asymmetry and lower shank angular velocity, than controls (p < 0.05 for all), but a similar stride time. OFF DBS there was no difference in non-freezers’ arrhythmicity, asymmetry or stride time from those of controls (p > 0.05 for all); non-freezers’ shank angular velocity was significantly lower than that of controls (p = 0.031).

Discussion

This study has validated the objective measurement of FOG from an instrumented gait task, the turning and barrier course (TBC), with the international standard FOG questionnaire (FOG-Q). The TBC mimicked real-life scenarios that trigger FOG in PD and was superior at eliciting more arrhythmic non-freezing gait, and freezing episodes in freezers compared to 40 meters of forward walking. Freezers’ non-freezing gait was more arrhythmic than that of non-freezers or controls irrespective of task.

A logistic regression model demonstrated that a combination of stride time, swing angular range, arrhythmicity, and asymmetry of the past six steps best predicted FOG during the TBC (AUC = 0.754). Freezers’ gait arrhythmicity was not only the strongest feature for predicting FOG, but also the non-freezing gait parameter most highly correlated with freezing severity (the percent time freezing).

Freezers’ percent time freezing decreased during either 60 Hz or 140 Hz STN DBS and their non-freezing gait arrhythmicity and shank angular velocity was restored to similar values as those of non-freezers.

The TBC is a validated task for assessing impaired gait and FOG in PD

It has been difficult to develop an objective measure of FOG since it is challenging to elicit FOG in the clinic or laboratory where there are few obstacles, tight corners, or narrow door openings [32]. Tasks that have been shown to provoke FOG include rapid clockwise and counterclockwise 360 degree turns in place [33], in combination with walking through doorways [34], walking with dual tasking [14,3537], and forward walking tasks including straight walking or turning around cones [38]. We previously validated freezing behavior during a stepping in place task on dual force plates with the FOG-Q3 [23].

In designing the TBC, we desired a forward walking task that included standardized situational triggers for FOG that were representative of real-world scenarios, which could also measure gait parameters such as stride time, swing time, asymmetry and arrhythmicity during both non-freezing and freezing behavior, and gait transitions into and out of freezing [25]. This study validated the TBC with the FOG-Q3, not only with the percent time freezing but also with parameters of gait impairment such as gait arrhythmicity and shank angular velocity that are not available in other tasks. Non-freezing gait arrhythmicity was the most valuable parameter in the validation of the TBC and in differentiating freezers from non-freezers, further supporting the usefulness of the TBC compared to other tasks that cannot measure stride time variability. The TBC was superior to FW in eliciting more arrhythmic gait and FOG events in freezers, and in the correlation of gait arrhythmicity with percent time freezing. This result aligns with previous studies that have shown that freezers exhibit greater arrhythmicity than non-freezers during non-freezing walking or stepping [24,25,31,39,40], though this is the first study to demonstrate this during non-freezing walking and turning to the best of our knowledge. This confirms that the arrhythmicity of non-freezing gait elicited during the TBC is a useful metric to predict the severity of FOG that freezers may experience in the real world, and is a robust measure of freezing behavior even during non-freezing gait.

A logistic regression model identified freezing events using gait parameters from the TBC

A logistic regression model identified gait arrhythmicity, swing angular range, stride time, and asymmetry as the most important gait parameters for classifying freezing events during the TBC. The model had an AUC of 0.754 and identified the freezing events within the neurologist identified periods of freezing behavior with 77% accuracy. It was interesting that both the neurologist and the model behaved as they were ‘trained.’ The model’s definition of a freezing event was within the neurologist’s period, Fig 5B, as the latter identified gait behavior leading up to and after an actual freezing episode, which encompassed complete halts in walking often seen in freezing of gait, but also included gait shuffling, festination, trembling, and shorter strides that often precede and succeed the complete gait arrest. This highlights another variable in the definition of FOG, some definitions only include ‘motor blocks’ or events when forward motion stops, whereas others include abnormal freezing behavior in the definition of FOG.

These variable definitions may have contributed to the variation in the accuracy of other IMU-based FOG detection algorithms, which have reported sensitivities and specificities ranging from 73–99% [1316,1820,22,41]. Some of these algorithms detected FOG based on high frequency components of leg linear acceleration corresponding to leg trembling-FOG, with lower sensitivity to non-trembling FOG, despite high specificity. The forward freeze index, which measures the relative component of high to low frequency gait components, has been shown to be a useful predictor of FOG in a 360-degree turning task [14]; however this had a lower AUC value in our model compared to other gait parameters, Fig 5A. Explanations for this may include that the TBC task did not include 360 degree turning, which may specifically induce more leg trembling high frequency components of freezing behavior. This supports the clinical experience that FOG manifests with different types of gait impairment depending on what gait task the person with PD is trying to accomplish.

FOG and gait impairment in freezers improved during STN DBS

We demonstrated that both FOG and predictors of FOG during non-freezing gait improved during 60 Hz and 140 Hz STN DBS while subjects walked in the TBC that mimicked real-life environments that elicit FOG. During the TBC, freezers spent less time freezing when on either frequency of DBS compared to OFF DBS, which is similar to our reports of the effect of DBS on the stepping in place and forward walking tasks [24]. Freezers’ gait arrhythmicity also improved on both 60 Hz and 140 Hz DBS, to levels that were not different from that of non-freezers’. Three out of four of non-freezers’ gait parameters OFF DBS were not different from those exhibited by healthy controls and all were left unchanged on either frequency of DBS. This ‘if it isn’t broken, it doesn’t need fixing’ effect of DBS has been observed in gait [24,42] and in aspects of postural instability [4244].

Sixty Hz DBS has been shown to be effective in improving axial symptoms in patients with FOG [10,11], though it is not obvious whether 60 Hz versus 140 Hz is better for FOG in real-world walking tasks. Using the clinical assessment of FOG from the MDS-UPDRS III, Ramdhani et al. reported that lower frequency (60 Hz) DBS reduced FOG when high frequency (130 Hz) DBS did not, even shortly after DBS was initiated [45]. Our previous investigations of the effect of 60 Hz and 140 Hz DBS on repetitive stepping in place and on progressive bradykinesia demonstrated that 60 Hz DBS promoted more regularity in ongoing movement, [24,46]

In this study, percent time freezing and gait arrhythmicity improved during either 60 Hz or 140 Hz STN DBS, and to a similar degree. This aligns with a previous report that gait and postural performances with low and high frequency stimulations were largely similar [42], and another demonstrating that 140 Hz STN DBS increased stride length and foot clearing [47], underscoring the increased shank angular velocities demonstrated during STN DBS in this study. Altogether this is valuable assurance for people with PD and clinicians that STN DBS can improve gait and FOG, and that both 60 Hz and 140 Hz improve FOG in real-world walking tasks.

Limitations

Our logistic regression model utilized data from only one IMU from a small cohort of freezers. Although this resulted in interpretable gait features and an accuracy within that of several other FOG models, it could be improved. Multiple IMUs on different parts of the body may add sensitivity. The model, being a binary classifier, attempted to capture all of the variability in freezing behavior with just two labels: “FOG” or “not FOG”. A different model might use multiple classes, where the classifier discriminates between unimpaired walking, a completely halted gait freeze event, shuffling, and a start hesitation. In addition, only freezers were used to train and test the logistic regression model, so that the incidence of freezing events was sufficient. Future models might include bootstrapping methods, evaluate the data from multiple IMUs, or more data to increase the sizes of the training and test sets.

Conclusions

Tools and tasks such as the instrumented TBC are necessary for designing and assessing personalized interventions and therapies for gait impairment and FOG in PD. We have validated and demonstrated the utility of the instrumented TBC for eliciting FOG, for revealing gait parameters that identify freezers and predict FOG during non-freezing gait, and for measuring the efficacy of different frequencies of STN DBS. From the TBC experimental data and a logistic regression model, we have identified the gait parameters that are most likely to predict freezing events and which may be useful in closed loop DBS for gait impairment and FOG.

Acknowledgments

We thank Matthew Petrucci, Tom Prieto, Jordan Parker, Varsha Prabhakar, Raumin Neuville, Ross Anderson, and Amaris Martinez for their support during the experiments and helpful comments. We would also like to thank our dedicated patient population who contributed their time to participating in our study (ClinicalTrials.gov Identifier: NCT02304848).

Data Availability

All gait parameter data files will be available from the public repository SimTK (https://simtk.org/projects/pdwalking, http://doi.org/10.18735/454q-tx50).

Funding Statement

This study was supported in part by the Michael J. Fox Foundation (9605, HBS), the National Institute of Neurological Disorders and Stroke (NINDS Grant 5 R21 NS096398-02; HBS, CA, JSN), the Robert and Ruth Halperin Foundation (HBS), the John A. Blume Foundation (HBS), the Helen M. Cahill Award for Research in Parkinson’s Disease (HBS), the Stanford Bio-X Bowes Graduate Fellowship (JO), and the National Institutes of Health Big Data to Knowledge (BD2K) Center of Excellence Grant U54EB020405 (SD, JO). Medtronic Inc. provided the devices used in this study but no additional financial support. At the time that the data was collected and study performed, all the authors of the study were employees and funded by Stanford University and the project was funded by the funders listed in the study. Subsequent to this, one of the authors (JSN) became employed by Cala Health. The funders did not have any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. Michael J Fox: https://www.michaeljfox.org/ NINDS: https://www.ninds.nih.gov/ Stanford Bio-X: https://biox.stanford.edu/ NIH BD2K: https://commonfund.nih.gov/bd2k.

References

  • 1.Giladi N, McMahon D, Przedborski S, Flaster E, Guillory S, Kostic V, et al. Motor blocks in Parkinson’s disease. Neurology. 1992. February;42(2):333–9. 10.1212/wnl.42.2.333 [DOI] [PubMed] [Google Scholar]
  • 2.Morgan D, Funk M, Crossley M, Basran J, Kirk A, Dal Bello-Haas V. The potential of gait analysis to contribute to differential diagnosis of early stage dementia: current research and future directions. Can J Aging. 2007; [DOI] [PubMed] [Google Scholar]
  • 3.Lippa CF, Duda JE, Grossman M, Hurtig HI, Aarsland D, Boeve BF, et al. DLB and PDD boundary issues: Diagnosis, treatment, molecular pathology, and biomarkers. Neurology. 2007; [DOI] [PubMed] [Google Scholar]
  • 4.Brozova H, Stochl J, Roth J, Ruzicka E. Fear of falling has greater influence than other aspects of gait disorders on quality of life in patients with Parkinson’s disease. Neuro Endocrinol Lett [Internet]. 2009;30(4):453–7. Available from: http://www.ncbi.nlm.nih.gov/pubmed/20010494 [PubMed] [Google Scholar]
  • 5.Bloem BR, Hausdorff JM, Visser JE, Giladi N. Falls and freezing of gait in Parkinson’s disease: A review of two interconnected, episodic phenomena. Mov Disord [Internet]. 2004. August;19(8):871–84. Available from: http://doi.wiley.com/10.1002/mds.20115 [DOI] [PubMed] [Google Scholar]
  • 6.Amboni M, Stocchi F, Abbruzzese G, Morgante L, Onofrj M, Ruggieri S, et al. Prevalence and associated features of self-reported freezing of gait in Parkinson disease: The DEEP FOG study. Park Relat Disord [Internet]. 2015;21(6):644–9. Available from: 10.1016/j.parkreldis.2015.03.028 [DOI] [PubMed] [Google Scholar]
  • 7.Sieber B-AA, Landis S, Koroshetz W, Bateman R, Siderowf A, Galpern WR, et al. Prioritized research recommendations from the National Institute of Neurological Disorders and Stroke Parkinson’s Disease 2014 Conference. Ann Neurol [Internet]. 2014. October;76(4):469–72. Available from: http://doi.wiley.com/10.1002/ana.24261 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Merola A, Zibetti M, Angrisano S, Rizzi L, Ricchi V, Artusi CA, et al. Parkinson’s disease progression at 30 years: a study of subthalamic deep brain-stimulated patients. Brain [Internet]. 2011. July 1;134(7):2074–84. Available from: https://academic.oup.com/brain/article-lookup/doi/10.1093/brain/awr121 [DOI] [PubMed] [Google Scholar]
  • 9.Schlenstedt C, Shalash A, Muthuraman M, Falk D, Witt K, Deuschl G. Effect of high-frequency subthalamic neurostimulation on gait and freezing of gait in Parkinson’s disease: a systematic review and meta-analysis. Eur J Neurol. 2017;24(1):18–26. 10.1111/ene.13167 [DOI] [PubMed] [Google Scholar]
  • 10.Xie T, Vigil J, MacCracken E, Gasparaitis A, Young J, Kang W, et al. Low-frequency stimulation of STN-DBS reduces aspiration and freezing of gait in patients with PD. Neurology [Internet]. 2015. January 27;84(4):415–20. Available from: http://www.neurology.org/cgi/doi/10.1212/WNL.0000000000001184 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Xie T, Padmanaban M, Bloom L, MacCracken E, Bertacchi B, Dachman A, et al. Effect of low versus high frequency stimulation on freezing of gait and other axial symptoms in Parkinson patients with bilateral STN DBS: a mini-review. Transl Neurodegener [Internet]. 2017;6:13 Available from: http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=prem&NEWS=N&AN=28529730 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Moreau C, Defebvre L, Destee A, Bleuse S, Clement F, Blatt JL, et al. STN-DBS frequency effects on freezing of gait in advanced Parkinson disease. Neurology [Internet]. 2008. July 8;71(2):80–4. Available from: http://www.neurology.org/cgi/doi/10.1212/01.wnl.0000303972.16279.46 [DOI] [PubMed] [Google Scholar]
  • 13.Moore ST, MacDougall HG, Ondo WG. Ambulatory monitoring of freezing of gait in Parkinson’s disease. J Neurosci Methods. 2008;167(2):340–8. 10.1016/j.jneumeth.2007.08.023 [DOI] [PubMed] [Google Scholar]
  • 14.Mancini M, Priest KC, Nutt JG, Horak FB. Quantifying freezing of gait in Parkinson’s disease during the instrumented timed up and go test. 2012 Annu Int Conf IEEE Eng Med Biol Soc [Internet]. 2012;1198–201. Available from: http://ieeexplore.ieee.org/document/6346151/ [DOI] [PMC free article] [PubMed]
  • 15.Palmerini L, Rocchi L, Mazilu S, Gazit E, Hausdorff JM, Chiari L. Identification of characteristic motor patterns preceding freezing of gait in Parkinson’s disease using wearable sensors. Front Neurol. 2017;8(AUG):1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Silva de Lima AL, Evers LJW, Hahn T, Bataille L, Hamilton JL, Little MA, et al. Freezing of gait and fall detection in Parkinson’s disease using wearable sensors: a systematic review. J Neurol [Internet]. 2017;264(8):1642–54. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28251357%0Ahttp://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC5533840 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kwon Y, Park SH, Kim J-W, Ho Y, Jeon H-M, Bang M-J, et al. A practical method for the detection of freezing of gait in patients with Parkinson’s disease. Clin Interv Aging [Internet]. 2014;9:1709–19. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=4199977&tool=pmcentrez&rendertype=abstract [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Rezvanian S, Lockhart T. Towards Real-Time Detection of Freezing of Gait Using Wavelet Transform on Wireless Accelerometer Data. Sensors [Internet]. 2016. April 2;16(4):475 Available from: http://www.mdpi.com/1424-8220/16/4/475 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Coste C, Sijobert B, Pissard-Gibollet R, Pasquier M, Espiau B, Geny C. Detection of Freezing of Gait in Parkinson Disease: Preliminary Results. Sensors [Internet]. 2014. April 15;14(4):6819–27. Available from: http://www.mdpi.com/1424-8220/14/4/6819/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Zach H, Janssen AM, Snijders AH, Delval A, Ferraye MU, Auff E, et al. Identifying freezing of gait in Parkinson’s disease during freezing provoking tasks using waist-mounted accelerometry. Parkinsonism Relat Disord. 2015. November;21(11):1362–6. 10.1016/j.parkreldis.2015.09.051 [DOI] [PubMed] [Google Scholar]
  • 21.Khemani P, Dewey RB, BH Q, MP B, A B, RG C, et al. Deep Brain Stimulation of the Subthalamic Nucleus. JAMA Neurol [Internet]. 2015;72(5):499 Available from: http://archneur.jamanetwork.com/article.aspx?doi=10.1001/jamaneurol.2015.36 [DOI] [PubMed] [Google Scholar]
  • 22.Kim H, Lee HJ, Lee W, Kwon S, Kim SK, Jeon HS, et al. Unconstrained detection of freezing of Gait in Parkinson’s disease patients using smartphone. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 2015. p. 3751–4. [DOI] [PubMed]
  • 23.Nantel J, de Solages C, Bronte-Stewart H. Repetitive stepping in place identifies and measures freezing episodes in subjects with Parkinson’s disease. Gait Posture [Internet]. 2011;34(3):329–33. Available from: 10.1016/j.gaitpost.2011.05.020 [DOI] [PubMed] [Google Scholar]
  • 24.Anidi C, O’Day JJ, Anderson RW, Afzal MF, Syrkin-Nikolau J, Velisar A, et al. Neuromodulation targets pathological not physiological beta bursts during gait in Parkinson’s disease. Neurobiol Dis. 2018;120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Syrkin-Nikolau J, Koop MM, Prieto T, Anidi C, Afzal MF, Velisar A, et al. Subthalamic neural entropy is a feature of freezing of gait in freely moving people with Parkinson’s disease. Neurobiol Dis [Internet]. 2017;108(June):288–97. Available from: 10.1016/j.nbd.2017.09.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Plotnik M, Hausdorff JM. The role of gait rhythmicity and bilateral coordination of stepping in the pathophysiology of freezing of gait in Parkinson’s disease. Mov Disord. 2008;23(SUPPL. 2):444–50. [DOI] [PubMed] [Google Scholar]
  • 27.Hausdorff JM. Gait dynamics in Parkinson’s disease: common and distinct behavior among stride length, gait variability, and fractal-like scaling. Chaos. 2009. June;19(2):26113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Goetz CG, Tilley BC, Shaftman SR, Stebbins GT, Fahn S, Martinez-Martin P, et al. Movement Disorder Society-Sponsored Revision of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS): Scale presentation and clinimetric testing results. Mov Disord. 2008;23(15):2129–70. 10.1002/mds.22340 [DOI] [PubMed] [Google Scholar]
  • 29.Giladi N, Tal J, Azulay T, Rascol O, Brooks DJ, Melamed E, et al. Validation of the Freezing of Gait Questionnaire in patients with Parkinson’s disease. Mov Disord. 2009;24(5):655–61. 10.1002/mds.21745 [DOI] [PubMed] [Google Scholar]
  • 30.Salarian A, Russmann H, Vingerhoets FJG, Dehollain C, Blanc Y, Burkhard PR, et al. Gait assessment in Parkinson’s disease: Toward an ambulatory system for long-term monitoring. IEEE Trans Biomed Eng. 2004;51(8):1434–43. 10.1109/TBME.2004.827933 [DOI] [PubMed] [Google Scholar]
  • 31.Plotnik M, Giladi N, Balash Y, Peretz C, Hausdorff JM. Is freezing of gait in Parkinson’s disease related to asymmetric motor function? Ann Neurol. 2005;57(5):656–63. 10.1002/ana.20452 [DOI] [PubMed] [Google Scholar]
  • 32.Nieuwboer A, Giladi N. The challenge of evaluating freezing of gait in patients with Parkinson’s disease. Br J Neurosurg [Internet]. 2008. January 1;22(sup1):S16–8. Available from: 10.1080/02688690802448376 [DOI] [PubMed] [Google Scholar]
  • 33.Mancini M, Smulders K, Cohen RG, Horak FB, Giladi N, Nutt JG. The clinical significance of freezing while turning in Parkinson’s disease. Neuroscience [Internet]. 2017;343:222–8. Available from: 10.1016/j.neuroscience.2016.11.045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Ziegler K, Schroeteler F, Ceballos-Baumann AO, Fietzek UM. A new rating instrument to assess festination and freezing gait in Parkinsonian patients. Mov Disord. 2010;25(8):1012–8. 10.1002/mds.22993 [DOI] [PubMed] [Google Scholar]
  • 35.Snijders AH, Haaxma CA, Hagen YJ, Munneke M, Bloem BR. Freezer or non-freezer: clinical assessment of freezing of gait. Parkinsonism Relat Disord. 2012. February;18(2):149–54. 10.1016/j.parkreldis.2011.09.006 [DOI] [PubMed] [Google Scholar]
  • 36.Spildooren J, Vercruysse S, Desloovere K, Wim Vandenberghe MD P, Kerckhofs E, Nieuwboer A. Freezing of Gait in Parkinson’s Disease: The Impact of Dual-Tasking and Turning. Mov Disord. 2010. November 15;25:2563–70. 10.1002/mds.23327 [DOI] [PubMed] [Google Scholar]
  • 37.Rochester L, Nieuwboer A, Baker K, Hetherington V, Willems AM, Kwakkel G, et al. Walking speed during single and dual tasks in Parkinson’s disease: Which characteristics are important? Mov Disord. 2008;23(16):2312–8. 10.1002/mds.22219 [DOI] [PubMed] [Google Scholar]
  • 38.Mitchell T, Conradsson D, Paquette C. Gait and trunk kinematics during prolonged turning in Parkinson’s disease with freezing of gait. Park Relat Disord [Internet]. 2019;(April):0–1. Available from: 10.1016/j.parkreldis.2019.04.011 [DOI] [PubMed] [Google Scholar]
  • 39.Plotnik M, Hausdorff JM. The role of gait rhythmicity and bilateral coordination of stepping in the pathophysiology of freezing of gait in Parkinson’s disease. Mov Disord. 2008;23 Suppl 2:S444–50. [DOI] [PubMed] [Google Scholar]
  • 40.Hausdorff JM, Schaafsma JD, Balash Y, Bartels AL, Gurevich T, Giladi N. Impaired regulation of stride variability in Parkinson’s disease subjects with freezing of gait. Exp Brain Res. 2003;149(2):187–94. 10.1007/s00221-002-1354-8 [DOI] [PubMed] [Google Scholar]
  • 41.Moore ST, Yungher DA, Morris TR, Dilda V, MacDougall HG, Shine JM, et al. Autonomous identification of freezing of gait in Parkinson’s disease from lower-body segmental accelerometry. J Neuroeng Rehabil [Internet]. 2013;10(1):19 Available from: http://jneuroengrehab.biomedcentral.com/articles/10.1186/1743-0003-10-19 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Vallabhajosula S, Haq IU, Hwynn N, Oyama G, Okun M, Tillman MD, et al. Low-frequency versus high-frequency subthalamic nucleus deep brain stimulation on postural control and gait in Parkinson’s disease: a quantitative study. Brain Stimul. 2015;8(1):64–75. 10.1016/j.brs.2014.10.011 [DOI] [PubMed] [Google Scholar]
  • 43.Bronte-Stewart HM. Postural instability in idiopathic Parkinson’s disease: the role of medication and unilateral pallidotomy. Brain [Internet]. 2002;125(9):2100–14. Available from: http://brain.oxfordjournals.org/content/125/9/2100.abstract [DOI] [PubMed] [Google Scholar]
  • 44.Shivitz N, Koop MM, Fahimi J, Heit G, Bronte-Stewart HM. Bilateral subthalamic nucleus deep brain stimulation improves certain aspects of postural control in Parkinson’s disease, whereas medication does not. Mov Disord. 2006;21(8):1088–97. 10.1002/mds.20905 [DOI] [PubMed] [Google Scholar]
  • 45.Ramdhani RA, Patel A, Swope D, Kopell BH. Early Use of 60 Hz Frequency Subthalamic Stimulation in Parkinson’s Disease: A Case Series and Review. Neuromodulation. 2015;18(8):664–9. 10.1111/ner.12288 [DOI] [PubMed] [Google Scholar]
  • 46.Blumenfeld Z, Koop MM, Prieto TE, Shreve LA, Velisar A, Quinn EJ, et al. Sixty-hertz stimulation improves bradykinesia and amplifies subthalamic low-frequency oscillations. Mov Disord. 2017;32(1):80–8. 10.1002/mds.26837 [DOI] [PubMed] [Google Scholar]
  • 47.Hell F, Plate A, Mehrkens JH, Bötzel K. Subthalamic oscillatory activity and connectivity during gait in Parkinson’s disease. NeuroImage Clin [Internet]. 2018;19(May):396–405. Available from: 10.1016/j.nicl.2018.05.001 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Fabio A Barbieri

11 Feb 2020

PONE-D-19-35218

The turning and barrier course reveals gait parameters for detecting freezing of gait and measuring the efficacy of deep brain stimulation

PLOS ONE

Dear Dr Bronte-Stewart,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Thanks for the submission. Both reviewers indicated that the paper is suitable for publication in the journal, but it needs carefully reviewed. Please be attentive in the comments and improve the manuscript.

We would appreciate receiving your revised manuscript by Mar 23 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Fabio A. Barbieri, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements:

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following in the Financial Disclosure section:

"This study was supported in part by the Michael J. Fox Foundation (9605, HBS), the National Institute of Neurological Disorders and Stroke (NINDS Grant 5 R21 NS096398-02; HBS, CA, JSN), the Robert and Ruth Halperin Foundation (HBS), the John A. Blume Foundation (HBS), the Helen M. Cahill Award for Research in Parkinson's Disease (HBS), the Stanford Bio-X Bowes Graduate Fellowship (JO), and the National Institutes of Health Big Data to Knowledge (BD2K) Center of Excellence Grant U54EB020405 (SD, JO). Medtronic Inc. provided the devices used in this study but no additional financial support. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Michael J Fox: https://www.michaeljfox.org/

NINDS: https://www.ninds.nih.gov/

Stanford Bio-X: https://biox.stanford.edu/

NIH BD2K: " ext-link-type="uri" xlink:type="simple">https://commonfund.nih.gov/bd2k"

We note that one or more of the authors are employed by a commercial company: Cala Health.

  1. Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

2. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc.  

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf.

3. Thank you for stating the following in the Competing Interests section:

"I have read the journal's policy and the authors of this manuscript have the following competing interests: Dr. Helen Bronte-Stewart is a member of a clinical advisory board for Medtronic Inc."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

4. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Comments on The turning and barrier course reveals gait parameters for detecting freezing of gait and measuring the efficacy of deep brain stimulation

This represents an interesting piece of scientific work, clearly and accurately written, presenting new tasks and protocol to induce FoG events in a clinic-like setup. The authors argue that “TBC is easily assembled and mimics real-life environments that elicit FOG”. However, it requires some room and specific equipment to be applied. The continuous turning task, in comparison, has shown to be very sensitive in detecting freezing events while not requiring either room or special equipment. As the current results have clear potential applicability in clinical settings, it would be desirable to make a comparison between the evaluation tasks, discussing potential benefits of using TBC rather than the turning task. I understand that such an argumentation should go beyond the point that the task “mimics real-life environments”, using the presented data on gait analysis as the main point.

Lines 227-8: “students t-test” should be “Student t-test”.

Lines 229-30: “Paired t-tests were used to compare UPDRS III 230 scores between visits for subjects with repeated visits.” Due to the nature of these data, a corresponding non-parametric test should be used.

Lines 507-11: The authors stated that the normalization procedure allowed comparison among individuals with different natural walking speeds. In the sequence, the authors propose that in future studies absolute measures could be tested. From my perspective, (a) speed variability is a feature of this group, and (b) speed normalization is an appropriate procedure for analysis, and so any of these points could not be considered as limitations. The suggestion of using absolute speed is contradictory to the reasons leading to data normalization.

Reviewer #2: The goals of this study were to (1) validate a standardized gait task, the turning and barrier course (TBC), which mimics real-life environments and elicits FOG, (2) discover relevant gait parameters for detecting FOG in Parkinson’s disease in the TBC, and (3) evaluate the effects of 60 Hz and 140 Hz subthalamic deep brain stimulation (DBS) on quantitative measures of non freezing gait and FOG. The paper is interesting, but it needs to have some questions of data analysis answered to support the conclusions.

Insert a reference for the method of identifying the phases of the gait from the angular velocity of the shank. Is this method validated to identify gait cycles in patients with Parkinson's disease, especially with freezing episodes? The calculation of the time of the phases is important because it will influence the logistic regression model.

How did the freezing episodes affect the identification of the gait cycle? Figure 4B shows the difficulty of identifying gait cycles during freezing episodes using the shank's angular velocity.

Detail the reasons for changing the way of calculating the Freeze index.

Why was it analyzed about the rectilinear movement in the Forward Walking task? There is a difference between the tasks because the others have curves.

A figure would be needed showing the correlations between the variables and the FOG-Q3.

Figure 3B could present the values of peak angular velocity shank that was used for the statistic

Please check the correlation between Arrhythmicity and FOG (Figure 5ª). I don't think there is a correlation given the dispersion of individual data.

The analysis of repeated visits is confusing. What are these subjects?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Luis Augusto Teixeira

Reviewer #2: Yes: Daniel Boari Coelho

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Apr 29;15(4):e0231984. doi: 10.1371/journal.pone.0231984.r002

Author response to Decision Letter 0


20 Mar 2020

We greatly appreciate these reviews, we really think they have improved the quality of the manuscript and we appreciated the reviewers’ time and energy into their reviews. Here we address each reviewer’s suggestions and questions, and we outline where the changes have been made in the revised manuscript.

Reviewer #1:

(1) This represents an interesting piece of scientific work, clearly and accurately written, presenting new tasks and protocol to induce FoG events in a clinic-like setup. The authors argue that “TBC is easily assembled and mimics real-life environments that elicit FOG”. However, it requires some room and specific equipment to be applied. The continuous turning task, in comparison, has shown to be very sensitive in detecting freezing events while not requiring either room or special equipment. As the current results have clear potential applicability in clinical settings, it would be desirable to make a comparison between the evaluation tasks, discussing potential benefits of using TBC rather than the turning task. I understand that such an argumentation should go beyond the point that the task “mimics real-life environments”, using the presented data on gait analysis as the main point.

Response: We have included in the discussion, a more in-depth comparison between the evaluation tasks (page 20, line 452-460). The TBC also allows for calculation of additional metrics such as stride time, swing time, asymmetry and arrhythmicity during both non-freezing and freezing behavior in a real-life environment. In addition, the TBC allows measurement of gait transitions into and out of freezing.

(2) Lines 227-8: “students t-test” should be “Student t-test.”

Response: This has been addressed in the revised manuscript (page 11, line 234).

(3) Lines 229-30: “Paired t-tests were used to compare UPDRS III 230 scores between visits for subjects with repeated visits.” Due to the nature of these data, a corresponding non-parametric test should be used.

Response: We used a non-parametric test, a paired samples Wilcoxon test and the difference was not significant (p = 0.09). We have adjusted the manuscript to address this change (page 11, line 236-7) and (page 12, lines 262-3).

(4) Lines 507-11: The authors stated that the normalization procedure allowed comparison among individuals with different natural walking speeds. In the sequence, the authors propose that in future studies absolute measures could be tested. From my perspective, (a) speed variability is a feature of this group, and (b) speed normalization is an appropriate procedure for analysis, and so any of these points could not be considered as limitations. The suggestion of using absolute speed is contradictory to the reasons leading to data normalization.

Response: We agree and appreciate this being brought to our attention, lines (507-11) have been removed to alleviate this contradiction.

Reviewer #2:

The goals of this study were to (1) validate a standardized gait task, the turning and barrier course (TBC), which mimics real-life environments and elicits FOG, (2) discover relevant gait parameters for detecting FOG in Parkinson’s disease in the TBC, and (3) evaluate the effects of 60 Hz and 140 Hz subthalamic deep brain stimulation (DBS) on quantitative measures of non freezing gait and FOG. The paper is interesting, but it needs to have some questions of data analysis answered to support the conclusions.

(1) Insert a reference for the method of identifying the phases of the gait from the angular velocity of the shank. Is this method validated to identify gait cycles in patients with Parkinson's disease, especially with freezing episodes? The calculation of the time of the phases is important because it will influence the logistic regression model.

Response: We agree that the calculation of the time of the gait phases is important. We used a validated method to identify gait cycles (Salarian et al., 2004), and we have clarified and inserted that reference in the manuscript (page 7-8, line 156-61). We have used this method in two other publications (Syrkin-Nikolau et al., 2017, Anidi et al., 2018).

(2) How did the freezing episodes affect the identification of the gait cycle? Figure 4B shows the difficulty of identifying gait cycles during freezing episodes using the shank's angular velocity

.

Response: Thank you; we agree and we did not use the standard heel strike to identify the start of a gait cycle for this reason. We used the peak of the angular velocity trace because this was a readily identifiable peak, both with a computer algorithm and visually. Angular velocity peaks were marked as steps only if they exceeded a minimum threshold of 10 deg/s. Therefore, during complete cessation of gait, steps were not identified. It was precisely for this reason, that we identified freezing episodes as a lack of leg swinging, rather than from heel strikes. We have clarified this in the manuscript (pg. 8 line 159-61).

(3) Detail the reasons for changing the way of calculating the Freeze index.

Response: We adapted the freeze index window to be more consistent with our stride by stride metrics which were on average 1-2 seconds rather than 4 seconds. Please see page 8, line 170-72.

(4) Why was it analyzed about the rectilinear movement in the Forward Walking task? There is a difference between the tasks because the others have curves.

Response: The forward walking task was used as a control task that does not typically elicit freezing. In that task we only analyzed rectilinear walking as it reflects the way that patients are usually assessed in clinics. We wanted to compare how well forward walking elicited freezing behavior compared to the turning and barrier course because it is known that freezing is not often elicited during the clinical assessment of gait. This is a large reason why we developed the TBC because of difficulty of eliciting FOG in forward walking.

(5) A figure would be needed showing the correlations between the variables and the FOG-Q3.

Figure 3B could present the values of peak angular velocity shank that was used for the statistic

Response: We thank the reviewer for this insight and we found that gait arrhythmicity and shank angular velocity did correlate with the FOGQ-3 in addition to the percent time freezing. We have added a figure, Figure 3, and have updated the manuscript (page 12-13, line 269-86).

(6) Please check the correlation between Arrhythmicity and FOG (Figure 5ª). I don't think there is a correlation given the dispersion of individual data.

Response: The reviewer is correct, there was no significant correlation between percent time freezing and forward walking (Figure 5a – now Figure 6a). We have made this clearer in the manuscript and in the figure (page 17, line 378-9).

(7) The analysis of repeated visits is confusing. What are these subjects?

Response: We had subjects with repeated visits that were, on average, over year apart, 430 ± 112 days (mean ± SD), so we included them as separate visits.

(8) PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Response: Yes

References

Anidi C, O’Day JJ, Anderson RW, Afzal MF, Syrkin-Nikolau J, Velisar A, et al. Neuromodulation targets pathological not physiological beta bursts during gait in Parkinson’s disease. Neurobiol Dis. 2018;120.

Salarian A, Russmann H, Vingerhoets FJG, Dehollain C, Blanc Y, Burkhard PR, et al. Gait assessment in Parkinson’s disease: Toward an ambulatory system for long-term monitoring. IEEE Trans Biomed Eng. 2004;51(8):1434–43.

Syrkin-Nikolau J, Koop MM, Prieto T, Anidi C, Afzal MF, Velisar A, et al. Subthalamic neural entropy is a feature of freezing of gait in freely moving people with Parkinson’s disease. Neurobiol Dis [Internet]. 2017;108(June):288–97. Available from: http://dx.doi.org/10.1016/j.nbd.2017.09.002

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Fabio A Barbieri

6 Apr 2020

The turning and barrier course reveals gait parameters for detecting freezing of gait and measuring the efficacy of deep brain stimulation

PONE-D-19-35218R1

Dear Dr. Bronte-Stewart,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Fabio A. Barbieri, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed. There was an improvement in the description of the methods and results.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Luis Augusto Teixeira

Reviewer #2: Yes: Daniel Boari Coelho

Acceptance letter

Fabio A Barbieri

20 Apr 2020

PONE-D-19-35218R1

The turning and barrier course reveals gait parameters for detecting freezing of gait and measuring the efficacy of deep brain stimulation

Dear Dr. Bronte-Stewart:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Fabio A. Barbieri

Academic Editor

PLOS ONE


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES