We read with great interest the Letter to the Editor by Mohammad Alwardat [1] on our article [2]. We have addressed each of his concerns as below.
Dr. Alwardat raised the question of using PEDro and recommended using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach. We appreciate the opportunity to entertain all other valid options to assess bias risk or methodological quality in individual studies in addition to PEDro, such as Cochrane's Collaboration of risk of bias [3], Newcastle-Ottawa Scale [4], and Down and Black checklist [5]. We also value the potential use of the GRADE system that Dr. Alwardat recommended, yet the GRADE system is used for grading the quality of “body of evidence” rather than the study level [6]. It also does not provide a quantitative rating of bias risk. We elected to display the PEDro scores of the articles in our data as we believe it will facilitate the reader's understanding of the relative level of quality of evidence contained therein, which the GRADE system was not able to provide. In addition, Dr. Alwardat mentioned that in his opinion PEDro values of 6 were relatively low for our type of study; however, the reference he cited [7] examined risk of bias methods specifically when using PEDro cutoff scores, which we did not use in our study. Furthermore, studies with PEDro scores of 6 or higher are widely ascribed terms such as to be of “good”, “fair”, or “moderate” [8–10], and thus our choice of language to describe our results is justified. As an additional clarification, we would like to inform readers that our median PEDro scores for included studies are 8 with an interquartile range (IQR) of 3. Over 76% of the included studies have the PEDro score of 6 or higher.
Another comment referred to our inclusion criteria. It was suggested that our inclusion criteria were ambiguous and did not follow the PICO (P: participants, I: intervention, C: comparison, O: outcomes) format; however, it is outlined clearly in our paper in the Methods section. Indeed, the commenter's own written response claims the study is lacking defined “outcome measures” while quoting in the same paragraph a section of our paper which includes a description of exactly such an included outcome measure: “studies included the value of relative flow-mediated dilation…”. It was also suggested that our study lacked “comparison” groups, but this is again inaccurate; comparisons such as exercise duration, modality, and intensity (among others) can be clearly seen in the figure and tables and in our moderator analysis results.
The final observation pertains to the use of MeSH (Medical Subject Headings) in addition to keywords in the search of related articles when constructing a meta-analysis. We appreciate the opportunity to clarify the details of our methodology and understand that searching using both free text and MeSH is an important aspect of meta-analysis methodology; failing to do so would risk missing relevant articles. We did perform such a search, using both keywords and MeSH as appropriate, when obtaining relevant articles for our study using PubMed. We did not feel this particular detail of our methodology bore special delineation in our Methods section, and thus it was not specifically mentioned that we had done so. We thank Dr. Alwardat for the chance to provide this detail to our readers.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this article.
References
- 1.Alwardat M. Comment on “Effect of exercise intervention on flow-mediated dilation in overweight and obese adults: meta-analysis”. International Journal of Vascular Medicine. 2018;2018:2. doi: 10.1155/2018/5082903.5082903 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Son Y., Kim K., Jeon S., et al. Effect of exercise intervention on flow-mediated dilation in overweight and obese adults: meta-analysis. International Journal of Vascular Medicine. 2017;2017:11. doi: 10.1155/2017/7532702.7532702 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.The Cochrane Collaboration. Cochrane Handbook for Systematic Reviews of Interventions. 2011, http://handbook-5-1.cochrane.org/chapter_8/8_assessing_risk_of_bias_in_included_studies.htm.
- 4.Stang A. Critical evaluation of the Newcastle-Ottawa scale for the assessment of the quality of nonrandomized studies in meta-analyses. European Journal of Epidemiology. 2010;25(9):603–605. doi: 10.1007/s10654-010-9491-z. [DOI] [PubMed] [Google Scholar]
- 5.Downs S. H., Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of Epidemiology and Community Health. 1998;52(6):377–384. doi: 10.1136/jech.52.6.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Guyatt G. H., Oxman A. D., Vist G., et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias) Journal of Clinical Epidemiology. 2011;64(4):407–415. doi: 10.1016/j.jclinepi.2010.07.017. [DOI] [PubMed] [Google Scholar]
- 7.Armijo-Olivo S., Da Costa B. R., Cummings G. G., et al. PEDro or Cochrane to assess the quality of clinical trials? A meta-epidemiological study. PLoS ONE. 2015;10(7) doi: 10.1371/journal.pone.0132634.e0132634 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Foley N. C., Teasell R. W., Bhogal S. K., Speechley M. R. Stroke rehabilitation evidence-based review: methodology. Topics in Stroke Rehabilitation. 2003;10(1):1–7. doi: 10.1310/y6tg-1kq9-ledq-64l8. [DOI] [PubMed] [Google Scholar]
- 9.da Silva F. C., Iop R. D. R., de Oliveira L. C., et al. Effects of physical exercise programs on cognitive function in Parkinson's disease patients: a systematic review of randomized controlled trials of the last 10 years. PLoS ONE. 2018;13 doi: 10.1371/journal.pone.0193113.e0193113 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Van Duijnhoven H. J. R., Heeren A., Peters M. A. M., et al. Effects of exercise therapy on balance capacity in chronic stroke: systematic review and meta-analysi. Stroke. 2016;47(10):2603–2610. doi: 10.1161/STROKEAHA.116.013839. [DOI] [PubMed] [Google Scholar]