Skip to main content
PLOS One logoLink to PLOS One
. 2022 Mar 23;17(3):e0265750. doi: 10.1371/journal.pone.0265750

Step-to-step variability indicates disruption to balance control when linking the arms and legs during treadmill walking

Daisey Vega 1,#, Helen J Huang 2,3,#, Christopher J Arellano 1,*,#
Editor: David J Clark4
PMCID: PMC8942237  PMID: 35320305

Abstract

We recently discovered that a rope-pulley system that mechanically coupling the arms, legs and treadmill during walking can assist with forward propulsion in healthy subjects, leading to significant reductions in metabolic cost. However, walking balance may have been compromised, which could hinder the potential use of this device for gait rehabilitation. We performed a secondary analysis by quantifying average step width, step length, and step time, and used their variability to reflect simple metrics of walking balance (n = 8). We predicted an increased variability in at least one of these metrics when using the device, which would indicate disruptions to walking balance. When walking with the device, subjects increased their average step width (p < 0.05), but variability in step width and step length remained similar (p’s > 0.05). However, the effect size for step length variability when compared to that of mechanical perturbation experiments suggest a minimal to moderate disruption in balance (Rosenthal ES = 0.385). The most notable decrement in walking balance was an increase in step time variability (p < 0.05; Cohen’s d = 1.286). Its effect size reveals a moderate disruption when compared to the effect sizes observed in those with balance deficits (effect sizes ranged between 0.486 to 1.509). Overall, we conclude that healthy subjects experienced minimal to moderate disruptions in walking balance when using with this device. These data indicate that in future clinical experiments, it will be important to not only consider the mechanical and metabolic effects of using such a device but also its potential to disrupt walking balance, which may be exacerbated in patients with poor balance control.

Introduction

Arm movements are beneficial for walking and can play an integral part in gait rehabilitation [14]. These insights motivated us to develop a simple rope-pulley system in which the active use of the arms is mechanically linked to the legs during treadmill walking, with the hope that this system could serve as a gait rehabilitation strategy. We discovered that the active use of the arms with this simple device helped propel the body by assisting with the generation of propulsive forces, which led to a significant reduction in the net metabolic power required to walk [5]. Reducing net metabolic power has important clinical implications because individuals with gait pathologies may experience major decrements in walking economy [6], signifying that it is highly strenuous to walk. While there are various factors that may impair walking economy, one critical factor is the inability to generate propulsive forces by the legs, which has been observed in individuals recovering from a spinal cord injury [6]. Therefore, the active use of the arms by means of our rope-pulley system may help alleviate this mechanical demand. By assisting in the generation of propulsive forces, the active use of the arms can make it easier to propel the body in the forward direction.

Despite the mechanical and metabolic benefits and their potential clinical implications, we also observed abnormal arm swing with the use of our device. Abnormal arm swing was characterized by increased shoulder protraction and increased elbow joint flexion/extension. This might be an undesirable trade-off since a recent experiment found that abnormal increases in arm swing, with amplitudes reaching shoulder height, increases stepping variability [7]. The increase in stepping variability suggests a possible disruption to walking balance. While our simple rope-pulley device provides both mechanical and metabolic benefits [5], this may have come at the expense of increased stepping variability, which would indicate an undesirable disruption to walking balance. It is well documented that humans maintain walking balance by adjusting their foot placement and timing from step to step [6, 8, 9]. The variability in one’s stepping pattern can serve as simple metrics of walking balance [1012], which have good validity for predicting fall probability [12] and are good clinical correlates for walking balance [13]. For example, the variability in step width, step length and/or step time have been used as simple metrics of balance in patients recovering from a spinal cord injury [13], patients diagnosed with Parkinson’s disease [14] and peripheral neuropathy [15, 16], and older adults experiencing multiple falls [17]. Therefore, to understand if mechanically linking the active use of the arms with the legs disrupted walking balance, we carried out a secondary analysis by quantifying the variability in step width, step length, and step time.

Understanding if, and to what extent, balance was compromised will help determine if linking the arms and legs during treadmill walking could feasibly translate to clinical users undergoing gait rehabilitation. Helping patients maintain balance while practicing their stepping motion is critical for walking recovery [18, 19], reducing fear of falling [20, 21], and preventing falls [22]. Ideally, our arm-leg rope pulley system would not disrupt walking balance, but our observations of abnormal arm swinging suggest otherwise. Therefore, we wanted to understand if physically coupling of the arms and legs during walking may have influenced balance. Given the novelty of this device, we did not have any a priori knowledge as to which stepping parameter(s) would exhibit an increase in variability. For this reason, we hypothesized that walking with our arm-leg rope pulley system would increase the variability in either step width, step length, and/or step time. If walking with our arm-leg rope pulley system did disrupt balance, we expect an increase in the variability of at least one of these stepping parameters. We also suspected that subjects could adjust their foot placement strategy when walking with the rope pulley system, which may or may not be coupled with an increase in variability. Therefore, we examined whether subjects altered their average step width, step length, and/or step time while walking with the arm-leg rope pulley system, as this could indicate a foot placement strategy to avoid disruptions to walking balance.

Methods

Eight healthy subjects (3 females and 5 males; mean ± SD: age = 23.25 ± 3.37 years, mass = 73.88 ± 18.46 kg, height = 173.84 ± 13.95 cm) provided consent and participated in the study, which was approved by the University of Houston Institutional Review Board. Subjects walked on a dual-belt treadmill at 1.25 m/s for randomized conditions of walking with the arm-leg rope-pulley system (assisted walking; Fig 1) and without it (normal walking). Each trial lasted 7 minutes with at least 5 minutes of rest between trials.

Fig 1. Arm-leg rope pulley system.

Fig 1

Subjects walked on a treadmill while attached to a simple rope-pulley device that connects the ipsilateral arm and leg via a rope. Figure modified from Vega and Arellano [5].

From our previous data [5], we calculated step width, step length, and step time from the positions of the left and right heel markers. We used the vertical versus time component of each heel marker to identify initial contact as instances when the waveform exhibited a trough during each step. At each instance of initial contact, we quantified step width and step length as the medio-lateral (ML) and anterior-posterior (AP) distance between the left and right heel markers, respectively, and step time as the period between consecutive instances of initial contact. We determined the number of steps achieved by each subject and then found that 288 steps were the minimum number of steps taken across all subjects. For every trial in our analysis, we used these 288 steps to calculate the average and standard deviation values for all step parameters. For each subject, we normalized step width, step length, and their variability by dividing each metric by leg length (LL) and expressed these values as a percentage [8, 23]. Leg length is defined as the distance between the greater trochanter and the ground. We also normalized step time by LL/g where g is gravity [23]. To help visualize the time series data for each stepping parameter across 288 steps, Fig 2 illustrates the time series data for one subject.

Fig 2. Time series data (n = 1).

Fig 2

Solid circles represent values for each step over a series of 288 consecutive steps for one subject. Average (solid line) ± 1 SD (shaded region) are shown for each stepping parameter during normal and assisted walking conditions. When compared to normal walking, the subject increased their average step width by 0.032 m (normalized: 3.45% LL) during assisted walking, but step width variability remained relatively unchanged (2.27% LL vs 2.26% LL). Additionally, this subject slightly decreased their average step length by 0.011 m (normalized: 1.13% LL) and exhibited a 0.006 m (normalized: 0.69% LL) increase in step length variability. Lastly, the subject did not alter their average step time (54 ms vs 54 ms), but their step time variability slightly increased by 3.2 ms (normalized: 0.01). Note that all subjects responded in a slightly different way (see Fig 3 for individual data).

For our statistical analysis, the Shapiro-Wilk was used to test the assumption of normality. If the assumption of normality was met, we performed paired sample t-tests to test for significant differences between normal and assisted walking conditions. The values for each condition are reported as mean ± standard deviation (SD). Additionally, Cohen’s d was used to calculate a parametric effect size (noted as Cohen ES). If the assumption of normality was not met, we used the non-parametric Related Samples Wilcoxon Signed Rank test. In this case, these values are reported as median values with their interquartile range (IQR), defined as the range between the 25th and 75th percentile. Furthermore, a non-parametric effect size noted as Rosenthal ES [24] was calculated by diving the Z score by the square root of N where N is the number of observations for both conditions (i.e. N = 16). In line with our hypothesis, we used a one-tailed test for the variability metrics and a two-tailed test for the average metrics. All statistical tests were performed with an α-level of 0.05 (IBM SPSS Inc., Chicago, IL, USA).

Results

All variables met the assumption of normality except for step length variability and average step width. Average step length (two-tailed p = 0.718, Cohen ES = 0.133) and step time (two-tailed p = 0.233, Cohen ES = 0.461) revealed no significant differences between normal and assisted walking conditions. Yet, when compared to normal walking, subjects increased their average step width by 0.032 m during assisted walking (normalized median ± IQR: 14.42 ± 5.67% LL vs 18.83 ± 5.69% LL; Wilcoxon Signed Rank test, two-tailed p = 0.012, Z = 2.521, Rosenthal ES = 0.630, Fig 3). Despite adjustments in step width, there were no statistical differences in either step width variability (one-tailed p = 0.347, Cohen ES = 0.146) or step length variability (Wilcoxon Signed Rank test, one-tailed p = 0.062, Z = 1.540, Rosenthal ES = 0.385). In contrast, walking with the assistive arm-leg device increased step time variability by an average of 5 ms (normalized mean ± SD: 0.04 ± 0.01 vs. 0.06 ± 0.01; one-tailed p = 0.004, Cohen ES = 1.286; Fig 3). For reference, the data underlying the findings of this study are made available in the S1 File.

Fig 3. Box and whisker plots for all stepping parameters during normal (NW) and assisted (AW) walking conditions.

Fig 3

Individual data points are superimposed and connected to show paired data (n = 8). Most notably, all subjects increased their average step width. Additionally, seven out of eight subjects exhibited an increase in step time variability. Asterisks indicate p < 0.05.

Discussion

From the balance metrics quantified here, we found that linking the active use of the arms with the legs during treadmill walking led to a significant increase in step time variability, but not step width nor step length variability. These findings support our hypothesis that walking with our arm-leg pulley system would increase the variability of at least one of these stepping parameters. To assess whether the statistical increase in step time variability reflected a meaningful change, we used its effect size to interpret the relative magnitude to which walking balance was disrupted. Additionally, the value of calculating effect sizes is that they are independent of sample size and allows us to compare findings from various studies. Our literature review revealed that data on step time variability in individuals recovering from a spinal cord injury or stroke were not available and therefore, we could not make effect size comparisons to the intended population who could possibly benefit from such a device. Instead, we gathered data on individuals with balance deficits manifesting from neurological disorders and aging as well as data from mechanical perturbation experiments (S1 File).

In individuals with Parkinson’s disease and older adults experiencing multiple falls, step time variability is greater than healthy control subjects (Hedges’ g = 1.509 [14]) and non-fallers (Cohen ES = 0.486 [17]), respectively. For relative comparisons, these effect sizes ranged between 0.486 and 1.509, and our observed effect size for step time variability (Cohen ES = 1.286) falls within this range. While these comparisons are to be taken with caution, they are still useful for gauging the degree to which our rope-pulley system disrupts walking balance. Therefore, we interpret our effect size for step time variability to indicate a moderate disruption to the temporal component of walking balance.

As for the spatial component of walking balance, we did not detect a statistically significant increase in either step width variability or step length variability. Given our small sample size, it is helpful to examine more closely the individual trends in stepping variability. For instance, half of our subjects exhibited a small increase in step width variability while the other half exhibited a small decrease (Fig 3). Overall, the individual changes in step width variability appear small, but for relative comparisons, we can judge our findings to that of Madehkhaksar et al. [25], who applied sudden mechanical perturbations in the forward direction and observed significant increases in step width variability during treadmill walking in healthy subjects. Based on our estimate from their published data, the increase in step width variability reflects a Cohen ES of 0.845. Our observed Cohen ES for step width variability is 0.146, falling well below the value that is observed from an experiment that intentionally induced mechanical perturbations in the forward direction. Collectively, our results suggest that the arm-leg rope pulley system elicited little to no disruption to balance in the medio-lateral direction. On the contrary, seven out of eight subjects exhibited an increase in step length variability (Fig 3). With limited step length variability data in the literature, we were only able to make an effect size comparison to the 12-month retrospective study of Callisaya et al. [17], who reported differences between older adults who experience multiple falls and to those with no falls (Hedges’ g = 0.369). Our observed effect size for step length variability (Rosenthal ES = 0.385) is similar in magnitude. Therefore, given the relative magnitude of our effect size, irrespective of statistical non-significance, it is reasonable to consider the increase in step length variability as a meaningful disruption to balance. In all, we conclude that linking the active use of the arms with the legs via our simple rope-pulley system led to a minimal to moderate disruption to balance in the anterior-posterior direction.

These comparisons should be interpreted in the context of our small sample size and the limited data that is reported for stepping variability in the clinical and gait rehabilitation literature. Differences in normalization techniques, or lack thereof, further reduce the amount of available literature we could compare. In addition, it was not possible to account for differences in walking speed or conditions (e.g., overground versus treadmill walking), which influence these stepping parameters as well. It should also be noted that the analyses of this study were focused on linear analyses of gait variability. It may be helpful to consider other metrics (e.g., fractal analysis of gait variability, Lyapunov exponent, etc.) that are based on non-linear analyses in future studies, which may capture potential disruptions to balance in ways that linear analyses do not. Despite these limitations, we use effect size comparisons as a reasonable gauge to help interpret the degree which balance control may have been disrupted.

To further address the limitation of our small sample size, we carried out sensitivity analyses in GPower (please see S2 File for more details) to determine if the findings from our variability variables were adequately powered. Our analysis parameters were set to 80% power, α = 0.05 and a one-tailed dependent t-test or a one-tailed Wilcoxon signed rank test. Based on the analyses, a sample size of 8 indicates that the minimum effect size that can be detected are 0.978 for step width variability and 1.007 for step length variability. The effect sizes found in our study (step width variability ES = 0.146 and step length variability ES = 0.385) fall short of the minimum effect size that can be detected with 80% power. Therefore, we note that our findings for step width and length variability may not be adequately powered with our sample size of 8. However, the sensitivity analysis reveals that our findings for step time variability appears to be adequately powered since our effect size (1.286) is above the minimum effect size of 0.978 detectable at 80% power. We interpret this to suggest that the temporal component of walking balance is most disrupted with the use of the arm-leg rope-pulley system. Yet, it is possible that the spatial component may have been disrupted but was not detectable with our sample size of 8 subjects.

To determine the appropriate sample size needed for a future study, we carried out another sensitivity analysis (S2 File). For this analysis, we used “meaningful” effect sizes based on data gathered from the literature to determine the sample size needed for a study with sufficient power (parameters were set to 80% power, α = 0.05, and a one-tailed dependent t-test). The meaningful effect size for each stepping variable were gathered from two studies that investigated stepping variability in fallers versus non-fallers [17] and under treadmill perturbations [25]. Given the limited data, these studies were chosen as a reasonable gauge because their findings suggest that 1) increases in step time and step length variability are most notable in distinguishing fallers from non-fallers [17] and 2) step width variability increased under a forward treadmill perturbation [25], which is analogous to the effects of our arm-pulley device. This sensitivity analysis reveals that the sample size for a sufficiently powered study would require between 10 to 49 subjects. We suspect that for individuals undergoing gait rehabilitation (e.g., patients with a spinal cord injury), such effect sizes would be much greater in magnitude, and therefore, this may be a conservative estimate of sample size. A sample size of 49 is atypical in experiments involving individuals with an incomplete spinal cord injury, but a sample size of 10 may be too small. Considering the resources, time, and challenges with subject recruitment of this clinical population [26], we feel that a sample size of n = 20 would be reasonable for a future study investigating walking balance using linear variability measures.

In addition to increasing the sample size for future experiments, we also aim to modify our arm-leg pulley system and experimental design so that it minimizes any disruption to the subject’s preferred stepping kinematics. When considering the other foot placement metrics quantified here, we found that healthy subjects increased their average step width, which may reflect a foot placement strategy to maintain an appropriate level of balance in the medio-lateral direction. Given the novelty of using the device, it is possible that linking the arms and legs during treadmill walking may have induced a psychological fear of falling, which in itself has been associated with increases in step width [21]. It is also possible that the arm-leg rope pulley system was too wide for subjects, leading them to compensate by increasing their step width. The short and single-session familiarization period may have also contributed to subjects taking wider steps. Adopting wider steps could be a response to learning under a novel condition where maintaining balance is more challenging and therefore, requires an individual to alter their stepping strategy [27]. For future experiments, we will incorporate longer sessions that allow for learning adaptation and adjust the width of both pulleys so that they are aligned to the subject’s step width. These modifications may help to mitigate disruptions to walking balance and thus, minimize the need for subjects to alter their foot placement strategy in the medio-lateral direction.

In conclusion, when physically linking the arms and legs during treadmill walking, healthy subjects exhibited the most notable increase in step time variability, and its effect size reveals a moderate disruption to the temporal component of balance. There also appears to be a minimal to moderate disruption to the spatial component of walking balance, particularly along the anterior-posterior direction. While disruption to walking balance ranges between minimal to moderate in healthy subjects, the question remains as to whether using this device would exacerbate disruptions to walking balance in individuals with already poor balance control, such as those recovering from a spinal cord injury or stroke. Negating disruptions to walking balance would allow these patients to focus on coordinating the active use of their arms with the stepping motion of their legs during gait re-training. Maintaining an appropriate level of walking balance while benefiting from the mechanical and metabolic effects will be key to understanding whether this device or a modified version can promote walking recovery in a clinical setting.

Supporting information

S1 File. Data set and effect sizes.

This excel file contains the data set for this study as well as the calculated effects sizes from literature reported in the discussion.

(XLSX)

S2 File. Sensitivity analyses.

This file contains the protocol and graphs of the sensitivity analyses performed in GPower.

(DOCX)

Acknowledgments

We would like to thank Dr. Stacey L. Gorniak and Dr. Adam Thrasher for their helpful feedback on previous versions of this manuscript. We are also grateful to Dr. Daniel P. O’Connor for his expert advice on statistical power and sensitivity analyses.

Data Availability

All relevant data are within the Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Behrman AL, Harkema SJ. Locomotor Training After Human Spinal Cord Injury: A Series of Case Studies. Physical Therapy. 2000. Jul 1;80(7). [PubMed] [Google Scholar]
  • 2.Huang HJ, Ferris DP. Neural coupling between upper and lower limbs during recumbent stepping. Journal of Applied Physiology. 2004. Oct;97(4). doi: 10.1152/japplphysiol.01350.2003 [DOI] [PubMed] [Google Scholar]
  • 3.Klarner T, Barss TS, Sun Y, Kaupp C, Loadman PM, Zehr EP. Exploiting Interlimb Arm and Leg Connections for Walking Rehabilitation: A Training Intervention in Stroke. Neural Plasticity. 2016;2016. doi: 10.1155/2016/1517968 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Zhou R, Alvarado L, Ogilvie R, Chong SL, Shaw O, Mushahwar VK. Non-gait-specific intervention for the rehabilitation of walking after SCI: role of the arms. Journal of Neurophysiology. 2018. Jun 1;119(6). doi: 10.1152/jn.00569.2017 [DOI] [PubMed] [Google Scholar]
  • 5.Vega D, Arellano CJ. Using a simple rope-pulley system that mechanically couples the arms, legs, and treadmill reduces the metabolic cost of walking. Journal of NeuroEngineering and Rehabilitation. 2021. Dec 7;18(1). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kuo AD, Donelan JM. Dynamic Principles of Gait and Their Clinical Implications. Physical Therapy. 2010. Feb 1;90(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Siragy T, Mezher C, Hill A, Nantel J. Active arm swing and asymmetric walking leads to increased variability in trunk kinematics in young adults. Journal of Biomechanics. 2020. Jan;99. doi: 10.1016/j.jbiomech.2019.109529 [DOI] [PubMed] [Google Scholar]
  • 8.Bauby CE, Kuo AD. Active control of lateral balance in human walking. Journal of Biomechanics. 2000. Nov;33(11). doi: 10.1016/s0021-9290(00)00101-9 [DOI] [PubMed] [Google Scholar]
  • 9.Collins SH, Kuo AD. Two Independent Contributions to Step Variability during Over-Ground Human Walking. PLoS ONE. 2013. Aug 28;8(8). doi: 10.1371/journal.pone.0073597 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hausdorff JM. Gait variability: methods, modeling and meaning. Journal of NeuroEngineering and Rehabilitation. 2005;2(1). doi: 10.1186/1743-0003-2-19 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Hamacher D, Singh NB, van Dieën JH, Heller MO, Taylor WR. Kinematic measures for assessing gait stability in elderly individuals: a systematic review. Journal of The Royal Society Interface. 2011. Dec 7;8(65). doi: 10.1098/rsif.2011.0416 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Bruijn SM, Meijer OG, Beek PJ, van Dieën JH. Assessing the stability of human locomotion: a review of current measures. Journal of The Royal Society Interface. 2013. Jun 6;10(83). doi: 10.1098/rsif.2012.0999 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Day K v., Kautz SA, Wu SS, Suter SP, Behrman AL. Foot placement variability as a walking balance mechanism post-spinal cord injury. Clinical Biomechanics. 2012. Feb;27(2). doi: 10.1016/j.clinbiomech.2011.09.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Hausdorff JM, Cudkowicz ME, Firtion R, Wei JY, Goldberger AL. Gait variability and basal ganglia disorders: Stride-to-stride variations of gait cycle timing in parkinson’s disease and Huntington’s disease. Movement Disorders. 1998. May;13(3). doi: 10.1002/mds.870130310 [DOI] [PubMed] [Google Scholar]
  • 15.Richardson JK, Thies SB, DeMott TK, Ashton-Miller JA. A Comparison of Gait Characteristics Between Older Women with and Without Peripheral Neuropathy in Standard and Challenging Environments. Journal of the American Geriatrics Society. 2004. Sep;52(9). doi: 10.1111/j.1532-5415.2004.52418.x [DOI] [PubMed] [Google Scholar]
  • 16.Richardson JK, Thies SB, DeMott TK, Ashton-Miller JA. Gait Analysis in a Challenging Environment Differentiates Between Fallers and Nonfallers Among Older Patients With Peripheral Neuropathy. Archives of Physical Medicine and Rehabilitation. 2005. Aug;86(8). [DOI] [PubMed] [Google Scholar]
  • 17.Callisaya ML, Blizzard L, Schmidt MD, Martin KL, McGinley JL, Sanders LM, et al. Gait, gait variability and the risk of multiple incident falls in older people: a population-based study. Age and Ageing. 2011. Jul;40(4). doi: 10.1093/ageing/afr055 [DOI] [PubMed] [Google Scholar]
  • 18.Hugues Barbeau, Ladouceur M, Normal KE, Pépin A, Leroux A. Walking after spinal cord injury: Evaluation, treatment and functional recovery. Archives of Physical Medicine and Rehabilitation. 1999;80(2):225–35. doi: 10.1016/s0003-9993(99)90126-0 [DOI] [PubMed] [Google Scholar]
  • 19.Barbeau H. Locomotor Training in Neurorehabilitation: Emerging Rehabilitation Concepts. Neurorehabilitation and Neural Repair. 2003. Mar;17(1). doi: 10.1177/0888439002250442 [DOI] [PubMed] [Google Scholar]
  • 20.John LT, Cherian B, Babu A. Postural control and fear of falling in persons with low-level paraplegia. The Journal of Rehabilitation Research and Development. 2010;47(5). doi: 10.1682/jrrd.2009.09.0150 [DOI] [PubMed] [Google Scholar]
  • 21.Chamberlin ME, Fulwider BD, Sanders SL, Medeiros JM. Does Fear of Falling Influence Spatial and Temporal Gait Parameters in Elderly Persons Beyond Changes Associated With Normal Aging? The Journals of Gerontology Series A: Biological Sciences and Medical Sciences. 2005. Sep 1;60(9). doi: 10.1093/gerona/60.9.1163 [DOI] [PubMed] [Google Scholar]
  • 22.Brotherton SS, Krause JS, Nietert PJ. Falls in individuals with incomplete spinal cord injury. Spinal Cord. 2007. Jan 21;45(1). [DOI] [PubMed] [Google Scholar]
  • 23.Hof AL. Scaling gait data to body size. Gait & Posture. 1996. May;4(3). [DOI] [PubMed] [Google Scholar]
  • 24.Rosenthal R. Meta-analytic procedures for social research. 2nd ed. Newburry Park, CA: Sage; 1991. [Google Scholar]
  • 25.Madehkhaksar F, Klenk J, Sczuka K, Gordt K, Melzer I, Schwenk M. The effects of unexpected mechanical perturbations during treadmill walking on spatiotemporal gait parameters, and the dynamic stability measures by which to quantify postural response. PLOS ONE. 2018. Apr 19;13(4). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Blight AR, Hsieh J, Curt A, Fawcett JW, Guest JD, Kleitman N, et al. The challenge of recruitment for neurotherapeutic clinical trials in spinal cord injury. Spinal Cord. 2019. May 8;57(5). doi: 10.1038/s41393-019-0276-2 [DOI] [PubMed] [Google Scholar]
  • 27.Ochs WL, Woodward J, Cornwell T, Gordon KE. Meaningful measurements of maneuvers: People with incomplete spinal cord injury ‘step up’ to the challenges of altered stability requirements. Journal of NeuroEngineering and Rehabilitation. 2021. Dec 2;18(1). [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

David J Clark

1 Nov 2021

PONE-D-21-31057Step-to-step variability indicates minimal disruption to balance when linking the arms and legs during treadmill walkingPLOS ONE

Dear Dr. Arellano,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Dec 16 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

David J Clark

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please amend your current ethics statement to address the following concerns:

a) Did participants provide their written or verbal informed consent to participate in this study?

b) If consent was verbal, please explain i) why written consent was not obtained, ii) how you documented participant consent, and iii) whether the ethics committees/IRB approved this consent procedure.

3. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In this paper the authors conduct a secondary analysis on a device they previously developed that may be useful as a gait rehabilitation device in the future. Specifically, they previously saw metabolic benefits to mechanically coupling the arms and the legs during treadmill walking, but this new device also lead to abnormal arm swing. Thus, in the present study the authors sought to determine if there were changes in the stepping pattern while mechanically coupling the arms and legs since significant disruptions to normal walking could limit the device’s usefulness in a patient population.

Overall, I am satisfied with the manuscript as it was initially submitted, and I have no major suggestions for improvement. My recommendation is to accept the paper. The authors frame the scope of this paper well. The methods are sound, and the conclusions they draw are reasonable. I look forward to seeing the future work. My three comments below are minor and do not need to be addressed in the paper itself. They are more curiosities than critiques.

Comment 1: I’m curious what the effect size was for step length variability. The p-value was not quite significant, but Figure 3 shows a decent effect in all but one subject, as you mentioned in the caption. In the ideal world, your device would provide metabolic benefits without any changes to the stepping pattern. Thus, for the purposes of this paper (identifying potential disruptions to normal walking), I think it is reasonable to consider a p-value of 0.062 as a potential effect. Step length and step length variability are the variables I would a priori assume to be most affected (as opposed to step width) since the rope-pulley system directly pulls on the feet in the anteroposterior direction as opposed to mediolaterally.

Comment 2: In future work, I would be interested in exploring connecting the arms to the contralateral legs. You referenced previous work by Zehr who has explored the neural coupling between the arms and legs. I am only somewhat aware of his work, not the major findings nor how they directly relate to your current work. I would be interested to know from a neuro-rehab perspective if linking arms and legs ipsilaterally versus contralaterally is expected to be more beneficial, for example for individuals that have experienced a stroke. It would be slightly more difficult to implement than your current setup, but it should still be reasonably possible to change the mechanical coupling to be contralateral if there were a specific benefit to connecting them that way.

Comment 3: In future work I might also suggest adding an elastic band or other spring mechanism between the ropes and the contact points on the body. That would allow you to dampen or limit the forces between the arms and legs which may help people more quickly learn how to walk in the device.

Reviewer #2: • Briefly describe the rationale and mechanism of the rope-pulley system. It seems to be beneficial for reducing the mechanical cost of walking based on a previous study, but there is no description of why it is important and by what mechanism it helps human gait. Readers should understand this from the current paper without visiting the previous study. Briefly describe this in the introduction.

• Other questions regarding the rope-pulley system: Why is reducing net metabolic power important when walking? Does the system increase arm swing range of motion or velocity?

• I have a concern regarding the statistical power of this study. Although the difference in stride length variability was insignificant, it was close to be significant, and all but one participant showed increased stride length variability (Figure 3). I suspect a low statistical power of this result along with low effect size in other results and thus suggest increasing the sample size or justify the sample size (n = 8) by conducting a power analysis.

• The summary of findings based on the low sample size also raises concerns. The authors repeatedly states that there was no increase in either step width variability or step length variability which indicate no spatial components of walking balance. This conclusion is a big leap and could be biased without warranting the statistical power.

• The authors’ interpretation of small effect size also raises concerns. The authors interpret the small effect size for step time variability to indicate a minimal disruption to the temporal component of walking balance. However, the small effect size could be due to the small sample size not because of the minimal disruption. Verify that the degree of differences in step time variability is minimal before reaching to a conclusion.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Kyoung Shin Park

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

David J Clark

19 Dec 2021

PONE-D-21-31057R1Step-to-step variability indicates disruption to balance control when linking the arms and legs during treadmill walkingPLOS ONE

Dear Dr. Arellano,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

One of the reviewers is suggesting additional data analysis.  I reached out to this reviewer for additional clarification/justification on the analysis approach that he proposed. The reviewer responded with an updated version of his comments, which I am pasting here in their entirety. Please consider adding to your analysis of the data, or justifying why additional analysis may not be warranted. 

  • The authors conducted a secondary data analysis from a parent study to further examine whether the rope pulley system disrupts walking balance in healthy adults. They hypothesized that the rope pulley system may increase the variability of at least one of step width, step length, and step time which may indicate the disruption of walking balance. The result indicates increased variability in step time (M = 5 ms, p < 0.05, Cohen’s d = 1.286) but not in other parameters. The authors conclude that healthy subjects experienced minimal to moderate disruptions in walking balance when using with this device. This study addresses an interesting topic, and the manuscript is well written. However, given that the analysis is based on a small sample size and the significant result was found in only one of three variables of interest, there remains a couple of shortcomings in this study to be published under the current condition.

  • The finding reported in this study is that the rope pulley system marginally increased step time variability but not all other parameters of interest. I think this is comparably weak findings with a small sample size. The variability parameters are all linear variability and non-linear gait dynamics will be a great addition to the current weak findings.

  • Please provide the rationale for the hypothesis. How can an increase in either one of three parameters of variability be enough to indicate disruption in walking balance?

  • I understand that it would be not feasible to collect more data as this is a secondary data analysis. Anyhow, please report the power of current analysis which may provide more clear view of your acknowledgement of the small sample size as the limitation of this study.

  • How were the variability parameters computed? Provide citation for the way of normalized standard deviation with leg length. Standard deviation also needs to be normalized with average value, which is a common computation of gait variability called coefficient of variation. Please consider using this parameter and justify the current data processing method. 

  • Please provide the interpretation of Figure 2. What do you mean by a representative subject?

  • Standard deviation-based variability parameters are linear variability of human gait.  Please consider additional analysis of non-linear analysis of gait dynamics to strengthen the current findings. Non-linear gait analysis is appropriate for this type of time-series gait data. While the linear variability of gait represents the magnitude of the step-to-step fluctuation, dynamics of gait changes (alterations in the fractal pattern) is a great addition to the study of gait variability (Hausdorff, 2005, DOI: https://doi.org/10.1186/1743-0003-2-19). Although fractal analysis of gait variability used to conducted with time series gait data with > 600 strides, Kuznetsov and Rhea (2017) demonstrated that it is possible with relatively short gait time series (100 - 200 strides) (DOI: 10.1371/journal.pone.0174144). If this additional analysis of gait variability is not conducted, please provide justification that three variables of interest are adequate indicators of gait instability. Also discuss and acknowledge that the current analysis of gait variability is limited to linear analysis and that fractal analysis of gait variability was not considered due to some limitation but will strengthen the whole picture of gait variability altered by the rope pulley system in a future study.

==============================

Please submit your revised manuscript by Feb 02 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

David J Clark

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I am satisfied with the current state of the paper and recommend it is accepted for publication.

Comment 1: I commend the authors for catching the mistake with reporting the effect size estimate.

Comment 2: In future studies it might be worthwhile to add a quick subjective measure of participants' self-perceived walking balance. That will help disambiguate meaningful disruptions to balance from mild or imperceptible disruptions.

Reviewer #2: • The authors conducted a secondary data analysis from a parent study to further examine whether the rope pulley system disrupts walking balance in healthy adults. They hypothesized that the rope pulley system may increase the variability of at least one of step width, step length, and step time which may indicate the disruption of walking balance. The result indicates increased variability in step time (M = 5 ms, p < 0.05, Cohen’s d = 1.286) but not in other parameters. The authors conclude that healthy subjects experienced minimal to moderate disruptions in walking balance when using with this device. This study addresses an interesting topic, and the manuscript is well written. However, given that the analysis is based on a small sample size and the significant result was found in only one of three variables of interest, there remains a couple of shortcomings in this study to be published under the current condition.

• The finding reported in this study is that the rope pulley system marginally increased step time variability but not all other parameters of interest. I think this is comparably weak findings with a small sample size. The variability parameters are all linear variability and non-linear gait dynamics will be a great addition to the current weak findings.

• Please provide the rationale for the hypothesis. How can an increase in either one of three parameters of variability be enough to indicate disruption in walking balance? Why not two or three but one?

• How were the variability parameters computed? Provide citation for the way of normalized standard deviation with leg length. Standard deviation also needs to be normalized with average value, which is a common computation of gait variability called coefficient of variation. Please consider using this parameter and justify the current data processing method.

• Standard deviation-based variability parameters are linear variability of human gait. Please consider additional analysis of non-linear analysis of gait dynamics (e.g., detrended fluctuation analysis), which is doable with 280 steps (10.1371/journal.pone.0174144) and thus a great addition to linear variability, so will strengthen the findings of this study.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 2

David J Clark

8 Mar 2022

Step-to-step variability indicates disruption to balance control when linking the arms and legs during treadmill walking

PONE-D-21-31057R2

Dear Dr. Arellano,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

David J Clark

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: The authors have successfully addressed the concerns raised. The results reported substantiate that the rope pulley system may increase the step time variability which may indicate the disruption of walking balance.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

Acceptance letter

David J Clark

14 Mar 2022

PONE-D-21-31057R2

Step-to-step variability indicates disruption to balance control when linking the arms and legs during treadmill walking

Dear Dr. Arellano:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. David J Clark

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Data set and effect sizes.

    This excel file contains the data set for this study as well as the calculated effects sizes from literature reported in the discussion.

    (XLSX)

    S2 File. Sensitivity analyses.

    This file contains the protocol and graphs of the sensitivity analyses performed in GPower.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers FINAL.docx

    Data Availability Statement

    All relevant data are within the Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES