Skip to main content
Healthcare logoLink to Healthcare
. 2021 Oct 14;9(10):1368. doi: 10.3390/healthcare9101368

A Reporting Quality Assessment of Systematic Reviews and Meta-Analyses in Sports Physical Therapy: A Review of Reviews

Sung-Hyoun Cho 1, In-Soo Shin 2,*
Editor: Filipe Manuel Clemente
PMCID: PMC8544369  PMID: 34683046

Abstract

This review of reviews aimed to evaluate the reporting quality of published systematic reviews and meta-analyses in the field of sports physical therapy using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. This review of reviews included a literature search; in total, 2047 studies published between January 2015 and December 2020 in the top three journals related to sports physical therapy were screened. Among the 125 identified articles, 47 studies on sports physical therapy were included in the analysis (2 systematic reviews and 45 meta-analyses). There were several problems areas, including a lack of reporting for key components of the structured summary (10/47, 21.3%), protocol and registration (18/47, 38.3%), risk of bias in individual studies (28/47, 59.6%), risk of bias across studies (24/47, 51.1%), effect size and variance calculations (5/47, 10.6%), additional analyses (25/47, 53.2%), and funding (10/47, 21.3%). The quality of the reporting of systematic reviews and meta-analyses of studies on sports physical therapy was low to moderate. For better evidence-based practice in sports physical therapy, both authors and readers should examine assumptions in more detail, and report valid and adequate results. The PRISMA guideline should be used more extensively to improve reporting practices in sports physical therapy.

Keywords: assessment, meta-analysis, systematic review, physical therapy, review of reviews

1. Introduction

Evidence-based practice (EBP) is the best decision-making method for patients [1]. The term “evidence-based medicine” was first introduced by Gordon Guyatt at McMaster University, in Canada in 1992 [2]. The Center of Evidence-Based Physiotherapy (CEBP), currently headquartered at the University of Sydney, Australia, was established in 1999 [3]. Clinicians should have the knowledge and skills to write and understand published systematic reviews and meta-analyses that will help better decision-making for patients [4]. Primary studies have several limitations in terms of clinical decision-making, e.g., a limited sample, mixed results, and inconsistent analytical methods and reporting [5]. Some scientific journals even tend to selectively publish thesis manuscripts with statistically significant results [6]. This may induce biases, such as result reporting bias, which may affect the validity of the results [4,7]. SRs and MAs overcome the limitations of primary studies [7].

Systematic reviews (SRs) and meta-analyses (Mas) are some of the best sources of evidence and scientific research, including clinical expertise and patient-reported outcomes [6]. The process of SR and MA includes problem formulation, literature search, data coding, and data analysis and reporting, which minimize the bias and increase transparency and reproducibility [8]. An SR is a literature review that collects, comprehensively analyzes, and evaluates all studies related to a research topic [9]. Therefore, if several clinical research papers show the same results through studies on the effect of the same treatment rather than a single clinical study, it provides a more accurate basis for the treatment effect than a single individual clinical study paper [10].

MA refers to a statistical method that synthesizes and analyzes quantitative research results extracted from multiple studies to produce summarized and organized empirical knowledge on a topic [7]. MA is a valid method for finding evidence so that clinicians and researchers can have a rationale for solving health-related problems [11]. Additionally, MA distinguishes the intervention effects of previous studies by characteristics and objectively compares them to develop intervention programs that can be successfully used in various practical fields [12].

SRs and MAs comprise the highest level in the evidence pyramid of medicine [13]. Systematic reviews (SRs) and meta-analyses (MAs) provide the best basis for use in decision-making regarding the application of medical service interventions [6,14]. Clinicians should have the knowledge and skills to write and understand published SRs and MAs, as this will aid in making better decisions with their patients [5].

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines detail what should be reported in MAs and SRs analyses [15]. However, the reporting quality of MAs and SRs in numerous clinical areas is low and very problematic [16,17,18]. Only one 2012 paper was found to analyze the reporting of SRs related to physical therapy, and it was also of very low quality [19].

Clinical intervention should be guided by scientific evidence, which should be obtained by valid and transparent processes and methods. Bias in the scientific process can lead to inappropriate clinical practices. Therefore, MAs and SRs should be conducted by referring to the PRISMA guidelines [20]. Quality assessment studies on MAs and RSs in other fields have been published. The purpose of this study is to indicate problems in research reporting methods and thus produce a more valid MA in sports physical therapy [20,21].

Interpreting the results of SRs and MAs should be performed carefully because the results may suffer from reporting study weakness [22]. There has been no quality reporting about SRs and MAs in the field of sports physical therapy research. Therefore, the purpose of this study was to evaluate the reporting quality of SRs and MAs published in the top three sports physical therapy journals [15]. This article summarized the major study results, the SRs and MAs method, and major findings and evaluated whether the reviewed articles aligned with the PRISMA guidelines’ 27 items.

2. Materials and Methods

2.1. Eligibility and Exclusion Criteria

2.1.1. Eligibility Criteria

The top three journals in the field of sports physical therapy were selected based on the Journal Citation Reports impact factor (IF) index. The Journal of Orthopaedic & Sports Physical Therapy, Journal of Athletic Training, and Physical Therapy in Sports ranked first, second, and third in this specific category of journals with IFs of 3.839, 2.478, and 1.926, respectively. The IF index measures the average number of citations received in a particular year by papers published in the journal during the preceding years of 2019 and 2020 [23]. The article selection criteria were as follows: (1) peer-reviewed articles published between January 2015 and December 2020, and (2) a statistical MA or systematic literature review of an intervention program.

2.1.2. Exclusion Criteria

As this study was not meant for clinical effect analysis, only treatment effect SRs from the three top journals were targeted. Narrative reviews, diagnostic test SRs, primary studies, qualitative review articles, authors’ opinions, letters, and abstract presentations were excluded.

2.2. Information Sources and Search Strategy

2.2.1. Electronic Search

We searched the Journal of Orthopaedic & Sports Physical Therapy (https://www.jospt.org, accessed on 31 April 2021), Journal of Athletic Training (https://natajournals.org/loi/attr, accessed on 31 April 2021), and Physical Therapy in Sports (https://www.journals.elsevier.com/physical-therapy-in-sport, accessed on 31 April 2021). The search strategy utilized a combination of medical subject heading (MeSH) terms and free text words, including “meta-analysis” (MeSH), “meta-analysis” (text word), “review” (MeSH), and “systematic review” (text words).

2.2.2. Manual Search

The included studies returned by the search, and previously published SRs and MAs related to the topic, were screened to identify any additional studies which could fit the criteria.

2.3. Study Selection

Publication details of all studies identified in the literature search were exported to EndNote (Endnote X9.3.3, Clarivate Analytics, Philadelphia, PA, USA). Once all records were imported, duplicates were removed. After that, titles and abstracts were independently screened for eligibility by the two authors using the specified inclusion and exclusion criteria. Full texts of the remaining articles were then sourced and independently evaluated for inclusion. Any disagreement was resolved through discussion.

2.4. Data Collection Process and Data Item

The PRISMA statement includes a checklist of 27 items [21], and the PRISMA checklist was used by the raters in the analyses of the eligible SRs [21]. For each checklist item, it was established that a rating of “yes” would only be assigned if the PRISMA statement recommendations were fully complied with. If the rater considered the information regarding any item to be incomplete, missing, or doubtful, that item was rated as “no.” The quality evaluation criteria of this paper were identified as follows: “low quality,” “moderate quality,” and “high quality” when there was <50%, <75%, and >75% agreement with the PRISMA checklist items, respectively [19,22,24,25,26].

The characteristics of the participants and interventions in the 47 selected articles were identified and coded per the research evaluation framework (Supplementary Materials Table S1) [19]. The articles were listed and outlined according to the coding table (Appendix A).

The two authors also independently extracted the following data from each included article into predesigned coding sheets: (1) study identification: the first author’s name, location of the corresponding author(s), year of publication, and journal name; (2) number and design of the studies in the MA/SR; (3) population (participants); (4) interventions; (5) comparison between interventions; and (6) outcome measures. Discrepancies were resolved through discussion.

2.5. Reliability of the Evaluators

Two researchers independently checked each checklist item in a coding sheet and resolved discrepancies by consensus via weekly Zoom meetings. If the disagreement was not resolved, the researchers planned to consult a third coder to make the final decision. However, there were no disagreements between the coders in any of the items. Some items were not fulfilled according to the PRISMA checklist. The two researchers also evaluated additional reporting and statistical issues based on the PRISMA 2020 statement [27].

2.6. Planned Methods of Analysis

2.6.1. Reporting of Epidemiological and Descriptive Characteristics

The epidemiological and descriptive characteristics of the included MAs and SRs were assessed according to the journal type, corresponding author’s location, number and design of included studies, population/patients/defects, type of intervention, comparison between interventions, outcome (Appendix A).

2.6.2. Statistical Analysis

Each PRISMA checklist item was presented as either the ratio or percentage of how many of the 47 PRISMA articles were properly followed (Appendix B).

2.7. Ethical Statement

This study was approved by the institutional review board of Nambu University (ethical code: 1041478-2017-HR-016; approval date: 8 November 2017) and was conducted in accordance with the ethical standards of the Declaration of Helsinki.

3. Results

3.1. Study Selection

A total of 2047 studies published by the Journal of Orthopaedic & Sports Physical Therapy, Journal of Athletic Training, and Physical Therapy in Sports between January 2015 and December 2020 were considered. Among these, 47 articles listed as a systematic literature review or MA in the article category were initially selected. We excluded five narrative review articles, two articles that reported a rate, three articles that reported a ratio, two articles that reported the prevalence, one article that reported intraclass correlation coefficients, one article that reported reliability and validity, and one article that presented the diagnostic accuracy of a clinical test. Consequently, 47 articles were included in the final analysis (Appendix C) (Figure 1).

Figure 1.

Figure 1

Flow chart describing the selection of the 47 articles after multiple phases of the screening process. ICC, intra-class correlation.

3.2. Study Characteristics

3.2.1. Epidemiological and Descriptive Characteristics

MAs and SRs published in the Journal of Athletic Training, Journal of Orthopaedic & Sports Physical Therapy, or Physical Therapy in Sports are shown in Appendix A. The types of interventions varied across the wide-ranging sports physical therapy field. The reporting guidelines used for the SR process also varied: 32 (68.1%) articles used the PRISMA guidelines [15]. However, 15 (31.9%) articles did not describe the reporting guidelines used. Regarding funding sources, 10 studies received private and/or public support (21.3%), and 37 studies received no funding.

3.2.2. General Characteristics of the Included Studies

The main characteristics of all the included studies are described in Appendix A. The reporting quality of key components of the MAs and SRs, as evaluated based on the PRISMA guidelines, is shown in Appendix B. Two papers performed an SR, and the remaining 45 conducted a MA. Furthermore, 27 (57.4%) studies included an RCT. Forty-two (89.4%) studies used outcomes that were continuous variables, such as the mean change difference.

3.3. Synthesis of the Results

The evaluation results are described below in the following order: title, abstract, introduction, methods, results, and discussion (Appendix B).

Reporting of the General Components of the SR Process (27 Items)

To enhance the validity and impact of SRs, all authors and editors must apply established reporting standards. Thirty-two articles mentioned the application of a guideline and 15 articles did not. Thirty-two studies adhered to the PRISMA guidelines and two studies applied the 2015 PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-analysis Protocols) guidelines [28,29]. One of the studies [28] mentioned the Measurement Tool to Assess Meta-analysis of Observational Studies in Epidemiology (MOOSE) [30].

Regarding item 2 (structured summary), we checked whether the abstract specifically presented the analytical model and effect size. Powden et al. specified that a fixed or randomized model was used [31]. Furthermore, studies that only reported the odds ratio (OR), relative risk (95% confidence interval [CI]), and effect size (Cohen’s d, 95% CI) in the data synthesis methods, and studies that did not present specific results (numbers) in the abstract, were considered to not have a structured summary (item 2). The PRISMA summary guidelines are a better source for this item published in 2013 [20].

In primary studies, researchers tend to report statistically significant results and emphasize a positive and large effect [32]. SRs and MAs have similar tendencies and, thus, require protocol registration to prevent selective reporting. Protocol registration is one of the methods that increase the validity of a MA [9]. Therefore, the protocols of SRs and MAs should be registered in PROSPERO (an international database of prospectively registered SRs in health and social care by the University of York, which is accessible to the public and researchers) [33], as for primary studies. However, no studies reported that the protocol was registered in PROSPERO or a local research foundation (item 5). For protocol and registration (item 5), none of the studies reported a selection/reporting bias.

The registration rate in the medical field is also very low, at 21% [34]. Protocol registration should be emphasized because selective reporting can be evaluated by comparing the protocol against the full paper [34,35]. The National Institute for Health Research (NIHR) also supports protocol registration [36].

Twenty-eight (59.6%) studies did not report the methods used to assess the risk of bias of studies (item 12). Furthermore, 23 (48.9%) studies did not report the methods used to assess the risk of bias across studies (e.g., publication bias) (item 15), and 28 (59.6%) studies did not describe the methods of additional analyses (item 16). Furthermore, more than half of the reviews did not report the “risk of bias within studies” (data presented on the risk of bias of each study and, if available, any outcome level assessment). This finding was also consistent with previous studies [22]. Reporting bias is crucial for assessing effect size because only advantageous results may be reported [37].

In the results section, 19 (40.4%) studies did not present data on the risk of bias for each study and any outcome level assessment, if available (item 19), and 23 (48.9%) did not report the risk of bias assessment across studies (item 22). Heterogeneity means the degree of differences in the results of each single research finding [38]. Through MAs, scholars calculate the heterogeneity index to understand the primary factors that impact individual studies’ effect sizes [39]. For heterogeneity tests, Q (34/47) and I2 inconsistency (38/47) statistics were used. Reporting on the effect size, most studies (42/47) did not provide the effect size formula, and no study reported the effect size variance formula in their methods section [40].

In this review, very few studies reported independent assumptions, missing data, or outliers, which should be addressed. Independent assumptions comprise two issues: first, whether the same sample was used twice or not, and second, how more than one effect size was treated in calculating an effect size for MA [40].

The results of additional analyses were mentioned in only 25 (53.2%) studies (e.g., sensitivity or subgroup analyses and meta-regression analysis) (item 23). Forty-two articles did not describe a sensitivity analysis. The sensitivity analysis, used to test the reliability of the cumulative effect across included studies, revealed the effect sizes [41].

Interestingly, one study [42] evaluated the reviewed articles using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group criteria after they completed their MA [43,44]. GRADE was used to investigate the overall quality of evidence for each outcome [45]. The MA evaluated the study’s design, risk of bias and publication bias, consistency, the complexity of interventions, and roughness [46]. The Cochrane Handbook for Systematic Reviews of Interventions also supports the evaluation process by researchers who completed the reviews [14]. The GRADE criteria include five quality evaluations: (a) risk of bias, (b) inconsistency, (c) indirectness, (d) imprecision, and (e) publication bias [47].

In the discussion section, comments about the study limitations, outcome level, and review levels, such as the risk of bias and incomplete retrieval of identified research and funding, were not provided in 37 (78.7%) studies (item 27). Many studies did not report a funding source. Research results can fundamentally differ according to funding sources. Funding bias refers to when a study’s outcome is more likely to support the interests of the organization funding the study [48]. For example, studies regarding omega-3 supplementation for the prevention of cardiovascular disease, or the relationship between cell phone use and the risk of brain tumors, showed contrasting results depending on the funding source [49,50]. Most research indicates that sucralose is safe—except for research sponsored by competitors [51].

4. Discussion

This study was benchmarked against previous studies, which were mainly published in top journals according to the IF criteria related to the reporting quality assessment [52,53,54,55]. The trends of the last 5 years were assessed because the PRISMA-Diagnostic Test Accuracy, PRISMA-Rapid Reviews, PRISMA-Scoping Reviews, and PRISMA-Network MA guidelines were released in 2015. Thus, the current year was when systematic literature review and MA reporting standards began to be subdivided [56]. This review evaluated 47 MAs and SRs reported in the Journal of Orthopaedic & Sports Physical Therapy, Journal of Athletic Training, and Physical Therapy in Sports related to sports physical therapy, using the PRISMA guidelines.

The study results were very similar compared to analyses of reporting of systematic reviews in physical therapy [19]. Analysis of reporting of systematic reviews in studies of reporting standards using the PRISMA statement have reported information regarding the risk of bias, protocol and registration, additional analysis, and funding was insufficient in quality-evaluated studies in the field of nursing [24], acupuncture [25], and diagnostic testing [26]. In the field of sports physical therapy, protocol registrations (38.3%), risk of bias across studies (51.1%), additional analysis (40.4%), and funding (21.3%) were the most problematic PRISMA items. Although the quality of SR and MA reporting in sports physical therapy was medium-to-low, similar to that in other clinical fields, key reporting components of the SR process were missing in most of the MAs and SRs. The critical appraisal of such studies must improve these reporting issues, which pertain to general MAs (27 items). For better EBP in sports physical therapy, authors and readers should examine assumptions in more detail, and report valid and adequate results. The PRISMA guidelines should be used more extensively to improve reporting practices in physical therapy.

Protocol registration is increasingly recommended in clinical trials [57] and SRs [34], but this study showed a low protocol enrollment of 38.3% (item 5). In a previous survey, only about one-fifth of SRs in physical therapy were registered, indicating that the enrollment rate was low [58]. According to the Cochrane Handbook for systematic literature review of interventions, the prospective registration of the protocol reduces the author’s bias by publicly documenting a priori planned methodology [34,36]. Importantly, the registered SRs showed significantly higher methodological quality compared to the unregistered SRs. The protocol provides transparency and clarifies the hypothesis, methodology, and analysis of the SRs and MAs undertaken.

Quality assessment of meta-analysis for randomized controlled trials (RCT) was performed using the Risk of Bias tool developed by the Cochrane group [59]. The NRS tools for Newcastle and Ottawa Scale (NOS) [60], and Risk of Bias Assessment tool for Non-randomized Studies (ROBANS) [61]. However, there may be some confusion in the concepts of the reporting standards for individual studies (CONSORT statement) [62]. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement [63], and quality assessment tools for meta-analysis (ROB, NOBANS) [64].

One study reported the STROBE statement as a reporting standard for individual studies, as opposed to a quality assessment tool for meta-analysis [65]. The STROBE statement is a checklist of items that should be included in reports of cohort studies. An explanation and elaboration article discussed each checklist item and provided the methodological background and published examples of transparent reporting [63]. The reporting criterion for meta-analysis of observational studies should be evaluated as MOOSE [30].

For summary measures, the type of effect size measure used in the manuscript must be described. The OR and standardized mean difference (SMD) as summary measures were indicated in the studies (item 13). The effect size is a key concept in a meta-analysis, and an essential component of quantitative research reporting and hypothesis testing [40]. In many studies, a corrected SMD, i.e., Hedges’ g with 95% CI was computed in consideration of the small sample size, and the inverse of the variance was used as the weight for each effect size [66]. As shown herein, studies need to classify the effect size computation, variance computation, and equations, and present them in an easily comprehensible manner for readers. However, only 5 of 47 studies described the effect size computation [29,65,67,68,69] (Supplementary Materials Table S1). One benefit of evaluating the effect size is that it quantifies the difference between groups in the observed data [70]. Moreover, the effect size is presented as a standard deviation; thus, it can be compared between studies and utilized in MAs, as well [71]. Researchers in the field of clinical medicine should also recognize the benefits of the effect size and use it widely in medical research.

Subgroup analyses further decrease the number of studies and thus weaken the power of the analysis, necessitating a careful interpretation of the data. Additionally, only 1 of the 23 studies performed a multivariate analysis [72].

The quality evaluation level of the 47 studies that were investigated revealed low to moderate and very low levels in statistical issues, such as mentioning the effect size formula and variance in the methods section. MAs use a summary measure with a statistically known variance [73], and the effect size variance formula is related to the distributional assumption such as the normality and homogeneity assumption for hypothesis testing. The results of effect size computation (like the SMD dealing with continuous variables, correlations, and odds ratios with dichotomous variables) should be provided for each individual MA study as major characteristics of the included studies [27,40].

There were some flaws in the reviewed articles, and some suggestions were proposed for more valid MA results. Applying appropriate MA assessment tools for physical therapy research is required to increase the reviewed articles’ validity. The synthesis of research studies in physical therapy research includes various study designs such as RCTs, observational studies, and scholars must consider the appropriate method of exploring validated reviews in physical therapy research.

As of 2021, version 6.0 of the Cochrane Handbook for Systematic Reviews of Interventions has been released [14]. The ROB 2 is the gold standard to evaluate the quality of RCT biases [39] and is a reorganized form of the Cochrane ROB tool by the same team [74]. The key features are that researchers can simply decide if a bias exists in the reviewed research and can evaluate bias for particular result findings within an RCT design and beyond the RCT design [75]. The Risk of Bias in Non-randomized Studies of Interventions (ROBINS-I) was also developed to evaluate intervention studies with nonrandomization in the Cochrane handbook (version 6.0). The main differences are that reviewers can easily critique the bias (using “low,” “moderate,” “serious,” and “critical”), focusing on the after-intervention effects [76].

Researchers should use appropriate, updated quality assessment tools to reflect a study’s research design and objectives and consider the complexity of interventions, proper groupings, and scientific effect size calculations. In addition, the present study proposed measures to improve the quality of MAs and ultimately aimed to examine the current situation, contributing to the enhancement of the EBP of sports physical therapy.

4.1. Limitations

To our knowledge, no study has investigated the reporting quality of SRs and MAs in the field of sports physical therapy. However, the present study has some limitations.

The database searches were only conducted in three specific journals based on their IF in the field of sports physical therapy. We need to comprehensively search the relevant databases related to sports physical therapy to conduct future SRs. For example, other journals from the field of sports and exercise medicine (e.g., British Journal of Sports Medicine) are important and should be included in the next study. We will extend the more studies to for 10 years in the next study.

The authors of the reviewed articles may have used the appropriate method but omitted important details from the report or removed key information during the publication process. We were in the position of the reader and could evaluate what was reported in the articles only. Additionally, there may be limitations in that the scope of the research may be different from the part where the actual research was conducted because the researcher reported based on the writing of a paper.

Quality thresholds were based on previous studies and were not agreed to be absolutely not interpreted. In addition, we determined that the quality of the performance was appropriate only if the reporting was adequate in terms of each checklist. If a comprehensive quality evaluation of the reporting criteria is conducted by including studies other than those in the top journals, the issue of low quality could be even more serious.

Because of research ethics, sports physical therapy studies need to perform general physical therapy in addition to the major intervention; thus, the lack of studies that only examined the physical therapy intervention poses a considerable limitation. In the future, when conducting systematic literature reviews and MAs, it will be helpful to improve the quality of clinical studies only when non-random studies, as well as RCT studies, are included due to the nature of clinical studies in physical therapy.

4.2. Clinical Implications

The findings of our study suggest that physical therapy studies need to be designed appropriately as per the purpose of the study and that physical therapy programs for patients should be structured more systematically. Considering the lack of previous studies that qualitatively evaluate and emphasize clinical judgment, future studies need to discuss complex interventions and network MAs as recent research trends.

5. Conclusions

This critical assessment demonstrated that the current quality of reporting and conducting of MAs and SRs is low to moderate, as it is in other medical disciplines. Problem areas of current meta-analyses and SRs include the exploration of the risk of bias across studies, protocol registrations, and additional analyses. Performing a meta-analysis with inadequate reporting increases the risk of invalid results in a meta-analysis.

Therefore, a reporting guideline, such as the PRISMA statement, is helpful for authors when writing meta-analyses and SR.s Clinicians need to have a thorough knowledge of research methodology, to render the interpretation of sophisticated statistical analyses easier. In addition, the present study proposed measures to improve the quality of meta-analyses, and ultimately aimed to examine the current situation, contributing to the enhancement of the practice of sports physical therapy.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/healthcare9101368/s1, Table S1: Analysis of articles according to the PRISMA recommendations.

Appendix A

Table A1.

Study characteristics of included systematic review and meta-analysis in reporting quality assessment.

# Author (Country*) Year Journal Type The Number and Design of Included Studies Population/Patients/
Defects
Intervention Comparison between Interventions Outcome
1 Games et al. (USA) 2015 J. Athl. Train MA 10 studies
(10 clinical trials)
Participants with healthy adults:
(1) Use of a commercially available WBV device
(2) a human research model
(3) a pre-WBV condition and at least 1 WBV experimental condition
Therapeutic whole-body vibration (WBV) Vibration type and frequency •  Muscle-oxygenation levels
•  Peripheral blood flow
2 Sciascia et al.
(USA)
2015 J. Athl. Train SR 11 studies
(11 Case series reports)
(1) Surgical repair of an isolated superior labral injury of a superior labral injury with soft tissue debridement
(2) Overhead athletes equal to or less than 40 years of age
Return to
preinjury levels of participation
NA •  Return-to-participation odds and interpretations for athletes with isolated superior labral repair
•  Return-to-participation odds and interpretations for athletes with concurrent superior labral repair and soft tissue
3 Knapik & Steelman (USA) 2016 J. Athl. Train MA 15 studies (15 Retrospective studies) Injuries during military static-line
airborne operations
Risk factors for injury One group •  Risk ratio
•  Odds ratio
•  Summary risk ratio (Summary 95%
confidence interval)
4 Powden et al.
(USA)
2017 J. Athl. Train MA 15 studies
(10 RCTs and 5 non-RCTs design)
Individuals with chronic ankle instability Balance Training,
Manual Therapy,
Combined Interventions
One group or control group Improving health-related
quality of life (HRQL)
5 Alsalaheen et al. (USA) 2017 J. Athl. Train MA 17 studies (17 observational studies) (1) A total of 1777 patients (1250 males, 527 females)
with concussion
(2) Participants from 13 to 33 years old representing clinical management of concussion
(3) Participants in the reviewed studies included middle and high school-aged children, college-aged adults, and professional athletes
Computerized neurocognitive
test and self-reported symptoms
Participants with self-reported symptoms before 1 week and
between 1 and 3 weeks postconcussion.
•  Verbal memory
•  Visual memory
•  Processing speed
•  Reaction time
•  Postconcussion symptom scale with 1 week postconcussion
6 Slater et al. (USA) 2017 J. Athl. Train MA 27 studies (27 clinical trials) Anterior cruciate
ligament reconstruction (ACLR),
anterior cruciate ligament deficient (ACLD)
3-dimensional (3D) lower extremity kinematics and kinetics of walking among individuals Healthy control participants •  Peak external knee-flexion moment, knee-extension moment
•  Peak knee-flexion angle
•  Peak hip-flexion angle
•  Peak knee-adduction angle
•  Peak external knee-adduction moment
7 Armitano et al. (USA) 2018 J. Athl. Train SR 18 studies
(18 clinical trials)
Healthy adults (age > 18 years) The use of augmented information for reducing anterior cruciate ligament injury risk during jump landings Control group or no control group Kinematic and kinetic risk factors associated with anterior cruciate ligament injury due to jump landing technique
8 Bullock et al. (USA) 2018 J. Athl. Train MA 6 studies
(6 prospective studies)
Baseball players aged 13 years or older The relationship between shoulder ROM and the risk of arm injuries
Uninjured participant or previously determined injured cut points Pooled proportion for absolute shoulder range of motion.
•  Internal rotation
•  External rotation
•  Total range of motion
•  Horizontal adduction
9 Takeno et al. (USA) 2019 J. Athl. Train MA 7 studies
(4 RCTs and 2 Quasi-experimental studies and Case-control studies)
Patients with Subacromial Impingement The short- and long-term therapeutic
interventions for SIS
Control group or No control group •  Scapular upward rotation
•  Scapular posterior tilt
•  Scapular internal rotation
•  Disability of the arm, shoulder and hand score
10 Vallandingham
et al. (USA)
2019 J. Athl. Train MA 10 studies (10 clinical trials)
Individuals with chronic ankle instability Joint mobilizations Control group or sham group •  Dorsiflexion range of motion
•  Dynamic postural control
11 Jeong et al.
(Republic of Korea)
2019 J. Athl. Train MA 7 studies
(7 RCTs)
Patients with Knee Osteoarthritis (age > 50 years) Proprioceptive training Control group •  Pain
•  Stiffness
•  Physical function questionnaire outcome
•  Physical function test
12 Montalvo et al.
(USA)
2019 J. Athl. Train MA 36 studies
(Observational Cohort and Cross-Sectional Studies)
Studies were included if they provided the
number of ACL injuries and the number of athlete-exposures (AEs)
by sex or enough information to allow the number of ACL injuries by sex to be calculated.
Injury incidence by sex and sport classification NA Sex differences in incidence rates
(IRs) of anterior cruciate ligament (ACL) injury by sport type
(collision, contact, limited contact, and noncontact)
13 Seffrin et al.
(USA)
2019 J. Athl. Train MA 13 studies
(13 RCTs)
Participants in these studies varied in age (high school to middle age) and activity level (sedentary lifestyle to competitive athletics) Instrument-assisted soft tissue mobilization (IASTM) At least 1 other group
not receiving IASTM
Range of motion (ROM), pain, strength, and patient-reported function
14 McAuliffe et al.
(United Kingdom)
2019 J. Athl. Train MA 19 studies
(cross-sectional or baseline data
from prospective or intervention studies)
Individuals with Achilles tendinopathy (AT) •  Maximal-strength profile
•  Explosive-strength Profile
•  Reactive-strength profile (Hopping)
Healthy control participants Plantar flexion (PF) strength
15 Kang et al.
(Taiwan)
2019 J. Athl. Train MA 18 studies
(7 systematic reviews and 11 meta-analyses)
Healthy adults Push-up plus exercise Different hand positions (the distance between the hands,
shoulder-flexion angle,
and elbow-flexion angle) and different lower extremity positions variably
Serratus anterior and upper trapezius electromyographic analysis
16 Desjardins-Charbonneau et al.
(Canada)
2015 J. Orthop. Sports Phys. Ther. MA 21 studies
(21 RCTs)
Patients with rotator cuff (RC) tendinopathy Manual therapy (MT) Placebo or in addition to another intervention or a multimodal intervention •  Pain
•  Shoulder range of motion
17 Almeida et al.
(Brazil)
2015 J. Orthop. Sports Phys. Ther. MA 16 Studies (cross-sectional,
case-control, prospective,
and retrospective study)
Runners at least 18 years of age Biomechanical characteristics
of foot-strike patterns during running
Rearfoot strike and forefoot strike or midfoot in shod conditions •  Vertical ground reaction force: Second peak
•  Vertical loading rate
•  Ankle plantar flexion moment
18 Deasy et al.
(Australia)
2016 J. Orthop. Sports Phys. Ther. MA 5 studies
(4 Case-control studies and 1 two-group pre-post design
People with symptomatic knee osteoarthritis A modified grading of recommendations assessment,
development and evaluation approach
Healthy control participants •  Isometric hip muscle strength
•  Isokinetic hip muscle strength
19 Gattie et al.
(USA)
2017 J. Orthop. Sports Phys. Ther. MA 13 studies
(13 RCTs)
Human subjects who had musculoskeletal conditions Dry needling dry needling performed
by a physical therapist
Control or other intervention •  Pain
•  Pressure pain threshold(PPT)
•  Functional outcome
20 Zhao et al.
(China)
2017 J. Orthop. Sports Phys. Ther. MA 11 studies
(11 RCTs)
Postmenopausal women Combined exercise interventions Control group
(nonexercise group)
Lumbar spine, femoral neck,
total hip, and total body BMD
(bone mineral density)
21 Basson et al.
(South Africa)
2017 J. Orthop. Sports Phys. Ther. MA 19 studies
(19 RCTs)
Participants over the age of 18 years with neuromusculoskeletal conditions indicative of neural tissue dysfunction Neural Mobilization for
Neuromusculoskeletal Conditions
Control group
•  Pain and disability in N-LBP
(nerve-related low back pain) and
•  Pain in N-NAP
(nerve-related neck and arm pain)
•  Pain and disability in CTS(carpal tunnel syndrome)
22 Nascimento
et al.
(Brazil)
2018 J. Orthop. Sports Phys. Ther. MA 14 studies
(Randomized and/or
controlled trials)
Individuals with patellofemoral pain Experimental intervention is strengthening,
in order to increase strength of the posterolateral hip muscles
Nothing/placebo or
knee strengthening alone
Measures of strength,
pain intensity, or activity
23 Eckenrode et al.
(USA)
2018 J. Orthop. Sports Phys. Ther. MA 9 studies
(9 RCTs)
Individuals with patellofemoral pain Manual therapy or manual therapy plus exercise
Sham/Control or
alternative treatment
Pain and self-reported function
24 Al-Mahrouqi et al.
(Australia)
2018 J. Orthop. Sports Phys. Ther. MA 8 studies
(8 clinical trials)
Adults with ankle osteoarthritis Physical impairments Healthy controls or
the unaffected ankle
Range of motion, ankle arthrometry, calf cross-sectional area (CSA)
and fatty infiltration, joint torque, muscle electromyography (EMG), standing balance, body impairment
25 Lam et al.
(Canada)
2018 J. Orthop. Sports Phys. Ther. MA 12 studies
(12 RCTs)
Patients with either acute (less than 12 weeks in duration) or chronic (greater than 12 weeks in duration) low back pain (LBP) McKenzie method of mechanical diagnosis and therapy (MDT) Other interventions in patients with acute or chronic LBP Pain and disability
26 Perriman et al.
(Australia)
2018 J. Orthop. Sports Phys. Ther. MA 10 studies
(10 RCTs)
Participants who had
Anterior Cruciate Ligament
Reconstruction (ACSR)
Open- Kinetic-Chain (OKC)
quadriceps exercises
Closed- Kinetic-Chain (CKC)
quadriceps exercises
Anterior tibial laxity, lower-limb strength, function, quality of life, or adverse events in the ACLR population
27 Mansfield et al.
(USA)
2019 J. Orthop. Sports Phys. Ther. MA 21 studies
(21 RCTs)
Individuals who received any form of needling therapy to their muscle(s), including healthy/uninjured, injured,
nonoperative, and operative.
Any form of needling therapy provided to a muscle, irrespective of body region. Any intervention such as therapeutic exercise, modality, or form
of placebo needling
Any formal assessment of muscle force production
28 den Bandt et al.
(Netherlands)
2019 J. Orthop. Sports Phys. Ther. MA 24 studies
(15 Cross-sectional studies,
5 Case-control studies,
1 Clinical trial,
1 Cohort study,
1 Longitudinal treatment study,
1 Observational study)
People with nonspecific
low back pain
Pain mechanisms in low back pain Health controls Mechanical quantitative
sensory testing outcomes
• Pressure pain thresholds (PPTs)
• Temporal summation
• Conditioned pain modulation
29 Desmeules et al. (Canada) 2015 Phys. Ther. Sports MA 11 studies
(11 RCTs)
Adults suffering
from RC tendinopathy
Therapeutic ultrasound (US) Placebo or other interventions in
adults suffering from RC tendinopathy
•  Pain reduction
•  Functional improvement
30 Sales et al.
(Brazil)
2016 Phys. Ther. Sports MA 20 studies
(20 RCTs)
Athletes Respiratory muscle training (RMT) non-athletes Respiratory muscle endurance (RME)
31 Tsikopoulos et al.
(Greece)
2016 Phys. Ther. Sports MA 5 studies
(5 RCTs)
Adults with tendinopathy Platelet-rich plasma injections Placebo or dry needling injections Pain intensity
functional disability
32 Chou et al.
(Taiwan)
2016 Phys. Ther. Sports MA 9 studies
(9 RCTs)
Patients with lateral epicondylosis Autologous blood injection
in treating lateral epicondylosis
corticosteroid injection or
platelet-rich plasma injection
Pain related measurement in each
selected randomized controlled trial
33 Takasaki et al.
(Japan)
2016 Phys. Ther. Sports MA 12 studies
(9 Quasi-experimental,
2 Randomized experimental
1 Randomized cross-over)
Patients with shoulder pathologies Fatiguing task for the shoulder musculature Glenohumeral movements and
scapulothoracic resting alignments
Active repositioning acuity and scapulothoracic resting alignment
34 Tsikopoulos et al.
(Greece)
2016 Phys. Ther. Sports MA 9 studies
(9 RCTs)
Patients with epicondylopathy
and plantar fasciopathy
Autologous whole blood Corticosteroid injections Assessment of pain relief assessment of composite outcomes
35 Gomes-Neto et al.
(Brazil)
2017 Phys. Ther. Sports MA 11 studies
(11 RCTs)
Patients
with low back pain
Stabilization exercise General exercises or manual
therapy
Pain, disability, and function
36 Ghai et al.
(Germany)
2017 Phys. Ther. Sports MA 50 studies
(6 RCTs, 42 CCTs,
2 observational
neuroimaging studies)
Participants affected
by ankle instability
Joint stabilizers Control group Proprioception, postural stability,
and neurological activity
37 Nae et al.
(Sweden)
2017 Phys. Ther. Sports MA 28 studies
(28 clinical trials)
In participants with or without lower extremity musculoskeletal disorders The performance of
weight-bearing functional tasks
2D and 3D kinematics Measurement properties of visual assessment and rating of Postural Orientation Errors (POEs)
38 Lima et al.
(Brazil)
2018 Phys. Ther. Sports MA 17 studies (1 Case-control(
16 Cross-sectional)
Participants presenting with
dynamic knee valgus (DKV)
Association between ankle dorsiflexion (ADF) and dynamic knee valgus (DKV) Control group •  Ankle dorsiflexion(ADF)
•  Dynamic knee valgus measurement method
39 Slimani et al.
(Tunisia)
2018 Phys. Ther. Sports MA 13 studies
(8 Prospective, longitudinal cohort, 3 intervention trials, 3 RCTs,
1 Prospective cohort study)
Injured soccer players aged between 14 and 36 years Psychological-based prevention interventions Psychosocial predictor of succer injureies
or control group
Psychosocial risk factors, psychological-based prevention interventions and
injury risk in soccer players
40 Coburn et al.
(Australia)
2018 Phys. Ther. Sports MA 21 studies (4 cross-section studies compared to control, (6 cross-section and validity studies, 4 RCTs, 7 repeated measures studies) Individuals with patellofemoral pain
aged under 50 years
PFP interventions Pain-free controls and
population norms
Knee- and health-related
Quality of life (QOL)
41 Karsten et al.
(Brazil)
2019 Phys. Ther. Sports MA 25 studies
(25 clinical trials)
Athletes Inspiratory muscle training with
linear workload devices (IMT-linear)
Healthy individuals •  Sports performance (work load and exercise time)
•  Cardiopulmonary function
(oxygen uptake, ventilatory threshold, and maximal inspiratory or expiratory pressure)
42 Cayco et al.
(Philippines)
2019 Phys. Ther. Sports MA 39 studies
(39 RCTs)
Healthy adults
Hold-relax and contract-relax stretching
(HR and CR)
No intervention and
other stretching techniques
Hamstring flexibility
43 Bunn et al.
(Brazil)
2019 Phys. Ther. Sports MA 20 studies
(20 Observational studies)
Participants who perform physical exercises, such as athletes of different modalities and military of different specialties “exposed” the participants who practiced
physical activities and whose FMS™ score were evaluated
High risk and low risk (I) the injury was associated with
athletic participation or military exercises; (II) there was a need for
health care; and (III) there was time lost with restricted participa tion for at least 24 h. The included studies should meet at least one of these criteria.
44 Alzahrani et al.
(Australia)
2019 Phys. Ther. Sports MA 3 studies
(3 RCTs)
People diagnosed with non-specific low
back pain (acute, subacute, chronic,
recurrent, persistent) aged 18 years or over
Any intervention oflifestyle physical activity
that was provided as the main component
of the treatment
•  Non-physical activity interventions
•  No intervention
•  A “sham” intervention
•  A wait list
•  Advice to “stay active or maintain usual activities”
•  Physical activity related outcomes
•  Low back pain related outcomes
45 Dix et al.
(Australia)
2019 Phys. Ther. Sports MA 16 studies
(6 Cohort, 5 Cross-sectional laboratory studies,
2 Observational prospective,
2 Exploratory,
1 Correlation study)
asymptomatic females over 18 years old Relationship between hip strength
and dynamic lower extremity valgus,
Relationship between hip strength and dynamic
lower extremity valgus for the various tasks
Validity of comparison between the findings of research that uses different kinematic
assessment tasks
•  Strength measure (Hand held dynamometry & isometric testing
unless otherwise stated)
•  Kinematic measure
46 Neilson et al.
(New Zealand)
2019 Phys. Ther. Sports MA 11 studies
(Randomized control trials and
Clinically controlled trials)
•  Neurologically and physically healthy
•  Man and woman
•  Adolescents and adults aged 12–65 years old
Augmented Feedback (AF): external or
extrinsic feedback given during practice
RCTs & CCTs: changes in key
landing biomechanical parameters
in the AF groups compared to control groups without AF
Numerical kinematic and kinetic parameters reported
47 López et al.
(Spain)
2019 Phys. Ther. Sports MA 6 studies
(1 experimental trial,
2 randomized experimental trials, 1 randomized double-blinded controlled trial, 1 randomized assessor-blind, placebo-controlled trial,
1 three-arm assessor-blinded randomized controlled trial)
Participants aged over 18 years Neurodynamic treatment No treatment, placebo, and with other manual
therapy techniques
Hamstring flexibility

Country*: means the location of corresponding author. Abbreviations: SR: Systematic reviews, MA: meta-analysis, RCTs: randomized controlled trials, Non-RCTs: non-randomized controlled trials, NNT: numbers-needed-to-treat, RRR: relative risk reduction, NA: not applicable.

Appendix B

Table A2.

Reporting key components of the systematic review process and meta-analyses by PRISMA guideline.

Section/Topic # Checklist Item—Yes if Reported No (%) of Reports (n = 47)
Title
Title 1 Identify the report as a systematic review, meta-analysis, or both. 47 (100%)
Abstract
Structured summary 2 Provide a structured summary including, as applicable: background; objectives; data sources; study eligibility criteria, participants, and interventions; study appraisal and synthesis methods; results; limitations; conclusions and implications of key findings; systematic review registration number. 10 (21.3%)
Introduction
Rationale 3 Describe the rationale for the review in the context of what is already known. 47 (100%)
Objectives 4 Provide an explicit statement of questions being addressed with reference to participants, interventions, comparisons, outcomes, and study design (PICOS). 47 (100%)
Methods
Protocol and registration 5 Indicate if a review protocol exists, if and where it can be accessed (e.g., Web address), and, if available, provide registration information including registration number. 18 (38.3%)
Eligibility criteria 6 Specify study characteristics (e.g., PICOS, length of follow-up) and report characteristics (e.g., years considered, language, publication status) used as criteria for eligibility, giving rationale. 46 (97.9%)
Information sources 7 Describe all information sources (e.g., databases with dates of coverage, contact with study authors to identify additional studies) in the search and date last searched. 47 (100%)
Search 8 Present full electronic search strategy for at least one database, including any limits used,
such that it could be repeated.
47 (100%)
Study selection 9 State the process for selecting studies (i.e., screening, eligibility, included in systematic review, and,
if applicable, included in the meta-analysis).
47 (100%)
Data collection process 10 Describe method of data extraction from reports (e.g., piloted forms, independently, in duplicate) and
any processes for obtaining and confirming data from investigators.
47 (100%)
Data items 11 List and define all variables for which data were sought (e.g., PICOS, funding sources) and any assumptions and simplifications made. 44 (93.6%)
Risk of bias in individual studies 12 Describe methods used for assessing risk of bias of individual studies (including specification of whether this was performed at the study or outcome level), and how this information is to be used in any data synthesis. 28 (59.6%)
Summary measures 13 State the principal summary measures (e.g., risk ratio, difference in means). 47 (100%)
Synthesis of results 14 Describe the methods of handling data and combining results of studies, if performed, including measures of consistency (e.g., I2) for each meta-analysis. 47 (100%)
Risk of bias across studies 15 Specify any assessment of risk of bias that may affect the cumulative evidence (e.g., publication bias, selective reporting within studies). 24 (51.1%)
Additional analyses 16 Describe methods of additional analyses (e.g., sensitivity or subgroup analyses, meta-regression), if performed, indicating which were pre-specified. 19 (40.4%)
Results
Study selection 17 Give numbers of studies screened, assessed for eligibility, and included in the review, with reasons for exclusions at each stage, ideally with a flow diagram. 46 (97.9%)
Study characteristics 18 For each study, present characteristics for which data were extracted (e.g., study size, PICOS, follow-up period) and provide the citations. 46 (97.9%)
Risk of bias within studies 19 Present data on risk of bias of each study and, if available, any outcome level assessment (see item 12). 28 (59.6%)
Results of individual studies 20 For all outcomes considered (benefits or harms), present, for each study: (a) simple summary data for each intervention group (b) effect estimates and confidence intervals, ideally with a forest plot. 47 (100%)
Synthesis of results 21 Present results of each meta-analysis performed, including confidence intervals and measures of consistency. 47 (100%)
Risk of bias across studies 22 Present results of any assessment of risk of bias across studies (see Item 15). 24 (51.1%)
Additional analysis 23 Give results of additional analyses, if performed (e.g., sensitivity or subgroup analyses, meta-regression (see Item 16). 25 (53.2%)
Discussion
Summary of evidence 24 Summarize the main findings including the strength of evidence for each main outcome; consider their relevance to key groups (e.g., healthcare providers, users, and policy makers). 47 (100%)
Limitations 25 Discuss limitations at study and outcome level (e.g., risk of bias), and at review-level (e.g., incomplete retrieval of identified research, reporting bias). 47 (100%)
Conclusions 26 Provide a general interpretation of the results in the context of other evidence, and implications for future research. 47 (100%)
Funding
Funding 27 Describe sources of funding for the systematic review and other support (e.g., supply of data); role of funders for the systematic review. 10 (21.3%)

Data are number (%) of reports featuring the corresponding item.

Appendix C. A Total of 47 Included Studies in Reporting Quality Assessment

Al-Mahrouqi MM, MacDonald DA, Vicenzino B, Smith MD. Physical impairments in adults with ankle osteoarthritis: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2018;48:449–459. https://doi.org/10.2519/jospt.2018.7569.

Almeida MO, Davis IS, Lopes AD. Biomechanical differences of foot-strike patterns during running: a systematic review with meta-analysis. J Orthop Sports Phys Ther. 2015;45:738–755. https://doi.org/10.2519/jospt.2015.6019.

Alsalaheen B, Stockdale K, Pechumer D, Broglio SP, Marchetti GF. A comparative meta-analysis of the effects of concussion on a computerized neurocognitive test and self-reported symptoms. J Athl Train. 2017;52:834–846. https://doi.org/10.4085/1062-6050-52.7.05.

Alzahrani H, Mackey M, Stamatakis E, Pinheiro MB, Wicks M, Shirley D. The effectiveness of incidental physical activity interventions compared to other interventions in the management of people with low back pain: a systematic review and meta-analysis of randomised controlled trials. Phys Ther Sport. 2019;36:34–42. https://doi.org/10.1016/j.ptsp.2018.12.008.

Armitano CN, Haegele JA, Russell DM. The use of augmented information for reducing anterior cruciate ligament injury risk during jump landings: a systematic review. J Athl Train. 2018;53:844–859. https://doi.org/10.4085/1062-6050-320-17.

Basson A, Olivier B, Ellis R, Coppieters M, Stewart A, Mudzi W. The effectiveness of neural mobilization for neuromusculoskeletal conditions: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2017;47:593–615. https://doi.org/10.2519/jospt.2017.7117.

Bullock GS, Faherty MS, Ledbetter L, Thigpen CA, Sell TC. Shoulder range of motion and baseball arm injuries: a systematic review and meta-analysis. J Athl Train. 2018;53:1190–1199. https://doi.org/10.4085/1062-6050-439-17.

Bunn PDS, Rodrigues AI, Bezerra da Silva E. The association between the functional movement screen outcome and the incidence of musculoskeletal injuries: a systematic review with meta-analysis. Phys Ther Sport. 2019;35:146–158. https://doi.org/10.1016/j.ptsp.2018.11.011.

Cayco CS, Labro AV, Gorgon EJR. Hold-relax and contract-relax stretching for hamstrings flexibility: a systematic review with meta-analysis. Phys Ther Sport. 2019 Jan;35:42–55. https://doi.org/10.1016/j.ptsp.2018.11.001.

Chou LC, Liou TH, Kuan YC, Huang YH, Chen HC. Autologous blood injection for treatment of lateral epicondylosis: a meta-analysis of randomized controlled trials. Phys Ther Sport. 2016;18:68–73 https://doi.org/10.1016/j.ptsp.2015.06.002.

Coburn SL, Barton CJ, Filbay SR, Hart HF, Rathleff MS, Crossley KM. Quality of life in individuals with patellofemoral pain: a systematic review including meta-analysis. Phys Ther Sport. 2018;33:96–108. https://doi.org/10.1016/j.ptsp.2018.06.006.

Deasy M, Leahy E, Semciw AI. Hip strength deficits in people with symptomatic knee osteoarthritis: a systematic review with meta-analysis. J Orthop Sports Phys Ther. 2016;46:629–639. https://doi.org/10.2519/jospt.2016.6618.

Den Bandt HL, Paulis WD, Beckwée D, Ickmans K, Nijs J, Voogt L. Pain mechanisms in low back pain: a systematic review with meta-analysis of mechanical quantitative sensory testing outcomes in people with nonspecific low back pain. J Orthop Sports Phys Ther. 2019;49:698–715. https://doi.org/10.2519/jospt.2019.8876.

Desjardins-Charbonneau A, Roy JS, Dionne CE, Frémont P, MacDermid JC, Desmeules F. The efficacy of manual therapy for rotator cuff tendinopathy: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2015;45:330–350. https://doi.org/10.2519/jospt.2015.5455.

Desmeules F, Boudreault J, Roy JS, Dionne C, Frémont P, MacDermid JC. The efficacy of therapeutic ultrasound for rotator cuff tendinopathy: a systematic review and meta-analysis. Phys Ther Sport. 2015;16:276–284. https://doi.org/10.1016/j.ptsp.2014.09.004.

Dix J, Marsh S, Dingenen B, Malliaras P. The relationship between hip muscle strength and dynamic knee valgus in asymptomatic females: a systematic review. Phys Ther Sport. 2019;37:197–209. https://doi.org/10.1016/j.ptsp.2018.05.015.

Eckenrode BJ, Kietrys DM, Parrott JS. Effectiveness of manual therapy for pain and self-reported function in individuals with patellofemoral pain: systematic review and meta-analysis. J Orthop Sports Phys Ther. 2018;48:358–371. https://doi.org/10.2519/jospt.2018.7243.

Games KE, Sefton JM, Wilson AE. Whole-body vibration and blood flow and muscle oxygenation: a meta-analysis. J Athl Train. 2015;50:542–549. https://doi.org/10.4085/1062-6050-50.2.09.

Gattie E, Cleland JA, Snodgrass S. The effectiveness of trigger point dry needling for musculoskeletal conditions by physical therapists: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2017;47:133–149. https://doi.org/10.2519/jospt.2017.7096.

Ghai S, Driller M, Ghai I. Effects of joint stabilizers on proprioception and stability: a systematic review and meta-analysis. Phys Ther Sport. 2017;25:65–75. https://doi.org/10.1016/j.ptsp.2016.05.006.

Gomes-Neto M, Lopes JM, Conceição CS, et al. Stabilization exercise compared to general exercises or manual therapy for the management of low back pain: a systematic review and meta-analysis. Phys Ther Sport. 2017;23:136–142. https://doi.org/10.1016/j.ptsp.2016.08.004.

Jeong HS, Lee SC, Jee H, Song JB, Chang HS, Lee SY. Proprioceptive training and outcomes of patients with knee osteoarthritis: a meta-analysis of randomized controlled trials. J Athl Train. 2019;54:418–428. https://doi.org/10.4085/1062-6050-329-17.

Kang FJ, Ou HL, Lin KY, Lin JJ. Serratus anterior and upper trapezius electromyographic analysis of the push-up plus exercise: a systematic review and meta-analysis. J Athl Train. 2019;54:1156–1164. https://doi.org/10.4085/1062-6050-237-18.

Karsten M, Ribeiro GS, Esquivel MS, Matte DL. The effects of inspiratory muscle training with linear workload devices on the sports performance and cardiopulmonary function of athletes: a systematic review and meta-analysis. Phys Ther Sport. 2018 Nov;34:92–104. https://doi.org/10.1016/j.ptsp.2018.09.004.

Knapik J, Steelman R. Risk factors for injuries during military static-line airborne operations: a systematic review and meta-analysis. J Athl Train. 2016;51:962–980. https://doi.org/10.4085/1062-6050-51.9.10.

Lam OT, Strenger DM, Chan-Fee M, Pham PT, Preuss RA, Robbins SM. Effectiveness of the McKenzie method of mechanical diagnosis and therapy for treating low back pain: literature review with meta-analysis. J Orthop Sports Phys Ther. 2018;48:476–490. https://doi.org/10.2519/jospt.2018.7562.

Lima YL, Ferreira VMLM, de Paula Lima PO, Bezerra MA, de Oliveira RR, Almeida GPL. The association of ankle dorsiflexion and dynamic knee valgus: a systematic review and meta-analysis. Phys Ther Sport. 2018;29:61–69. https://doi.org/10.1016/j.ptsp.2017.07.003.

López López L, Torres JR, Rubio AO, Torres Sánchez I, Cabrera Martos I, Valenza MC. Effects of neurodynamic treatment on hamstrings flexibility: a systematic review and meta-analysis. Phys Ther Sport. 2019;40:244–250. https://doi.org/10.1016/j.ptsp.2019.10.005.

Mansfield CJ, Vanetten L, Willy R, Di Stasi SPPDO, Magnussen R, Briggs M. The effects of needling therapies on muscle force production: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2019;49:154–170. https://doi.org/10.2519/jospt.2019.8270.

McAuliffe S, Tabuena A, McCreesh K, O’Keeffe M, Hurley J, Comyns T, et al. Altered strength profile in Achilles tendinopathy: a systematic review and meta-analysis. J Athl Train. 2019;54:889–900. https://doi.org/10.4085/1062-6050-43-18.

Montalvo AM, Schneider DK, Webster KE, et al. Anterior cruciate ligament injury risk in sport: a systematic review and meta-analysis of injury incidence by sex and sport classification. J Athl Train. 2019;54:472–482. https://doi.org/10.4085/1062-6050-407-16.

Nae J, Creaby MW, Cronström A, Ageberg E. Measurement properties of visual rating of postural orientation errors of the lower extremity—A systematic review and meta-analysis. Phys Ther Sport. 2017;27:52–64. https://doi.org/10.1016/j.ptsp.2017.04.003.

Nascimento LR, Teixeira-Salmela LF, Souza RB, Resende RA. Hip and knee strengthening is more effective than knee strengthening alone for reducing pain and improving activity in individuals with patellofemoral pain: a systematic review with meta-analysis. J Orthop Sports Phys Ther. 2018;48:19–31. https://doi.org/10.2519/jospt.2018.7365.

Neilson V, Ward S, Hume P, Lewis G, McDaid A. Effects of augmented feedback on training jump landing tasks for ACL injury prevention: a systematic review and meta-analysis. Phys Ther Sport. 2019 Sep;39:126–135. https://doi.org/10.1016/j.ptsp.2019.07.004.

Perriman A, Leahy E, Semciw AI. The effect of open-versus closed-kinetic-chain exercises on anterior tibial laxity, strength, and function following anterior cruciate ligament reconstruction: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2018;48:552–566. https://doi.org/10.2519/jospt.2018.7656.

Powden CJ, Hoch JM, Hoch MC. Rehabilitation and improvement of health-related quality-of-life detriments in individuals with chronic ankle instability: a meta-analysis. J Athl Train. 2017;52:753–765. https://doi.org/10.4085/1062-6050-52.5.01.

Sales AT, Fregonezi GA, Ramsook AH, Guenette JA, Lima IN, Reid WD. Respiratory muscle endurance after training in athletes and non-athletes: A systematic review and meta-analysis. Phys Ther Sport. 2016;17:76–86. https://doi.org/10.1016/j.ptsp.2015.08.001.

Sciascia A, Myers N, Kibler WB, Uhl TL. Return to preinjury levels of participation after superior labral repair in overhead athletes: a systematic review. J Athl Train. 2015;50:767–777. https://doi.org/10.4085/1062-6050-50.3.06.

Seffrin CB, Cattano NM, Reed MA, Gardiner-Shires AM. Instrument-assisted soft tissue mobilization: a systematic review and effect size analysis. J Athl Train. 2019;54:808–821. https://doi.org/10.4085/1062-6050-481-17.

Slater LV, Hart JM, Kelly AR, Kuenze CM. Progressive changes in walking kinematics and kinetics after anterior cruciate ligament injury and reconstruction: a review and meta-analysis. J Athl Train. 2017 Sep;52(9):847–860. https://doi.org/10.4085/1062-6050-52.6.06.

Slimani M, Bragazzi NL, Znazen H, Paravlic A, Azaiez F, Tod D. Psychosocial predictors and psychological prevention of soccer injuries: a systematic review and meta-analysis of the literature. Phys Ther Sport. 2018;32:293–300. https://doi.org/10.1016/j.ptsp.2018.05.006.

Takasaki H, Lim ECW, Soon B. The effect of shoulder muscle fatigue on active repositioning acuity and scapulothoracic resting alignment: a systematic review with meta-analysis. Phys Ther Sport. 2016;20:61–78. https://doi.org/10.1016/j.ptsp.2016.01.001.

Takeno K, Glaviano NR, Norte GE, Ingersoll CD. Therapeutic interventions for scapular kinematics and disability in patients with subacromial impingement: a systematic review. J Athl Train. 2019;54:283–295. https://doi.org/10.4085/1062-6050-309-17.

Tsikopoulos K, Tsikopoulos A, Natsis K. Autologous whole blood or corticosteroid injections for the treatment of epicondylopathy and plantar fasciopathy? a systematic review and meta-analysis of randomized controlled trials. Phys Ther Sport. 2016;22:114–122. https://doi.org/10.1016/j.ptsp.2016.02.002.

Tsikopoulos K, Tsikopoulos I, Simeonidis E, et al. The clinical impact of platelet-rich plasma on tendinopathy compared to placebo or dry needling injections: a meta-analysis. Phys Ther Sport. 2016;17:87–94. https://doi.org/10.1016/j.ptsp.2015.06.003.

Vallandingham RA, Gaven SL, Powden CJ. Changes in dorsiflexion and dynamic postural control after mobilizations in individuals with chronic ankle instability: a systematic review and meta-analysis. J Athl Train. 2019 Apr;54(4):403–417. https://doi.org/10.4085/1062-6050-380-17.

Zhao R, Zhang M, Zhang Q. The effectiveness of combined exercise interventions for preventing postmenopausal bone loss: a systematic review and meta-analysis. J Orthop Sports Phys Ther. 2017;47:241–251. https://doi.org/10.2519/jospt.2017.6969.

Author Contributions

Conceptualization, S.-H.C., and I.-S.S.; Methodology, I.-S.S.; Writing—Original Draft Preparation, S.-H.C.; Writing—Review & Editing, S.-H.C., and I.-S.S.; Project Administration, I.-S.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Institutional Review Board Statement

This study was approved by the institutional review board (IRB) of Nambu University (ethical code: 1041478-2017-HR-016; approved date: 8 November 2017) and was conducted in accordance with the ethical standards of the Declaration of Helsinki.

Informed Consent Statement

Since this study analyzed existing research results, we received an expedited review with exemption from informed consent.

Data Availability Statement

All data relevant to the study are included in the article. Data were collected from studies published online or publicly available, and specific details related to the data will be made available upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Jette D.U., Bacon K., Batty C., Carlson M., Ferland A., Hemingway R.D., Hill J.C., Ogilvie L., Volk D. Evidence-based practice: Beliefs, attitudes, knowledge, and behaviors of physical therapists. Phys. Ther. 2003;83:786–805. doi: 10.1093/ptj/83.9.786. [DOI] [PubMed] [Google Scholar]
  • 2.Evidence-Based Medicine Working Group Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992;268:2420–2425. doi: 10.1001/jama.1992.03490170092032. [DOI] [PubMed] [Google Scholar]
  • 3.Moseley A.M., Herbert R.D., Sherrington C., Maher C.G. Evidence for physiotherapy practice: A survey of the Physiotherapy Evidence Database (PEDro) Aust. J. Physiother. 2002;48:43–49. doi: 10.1016/S0004-9514(14)60281-6. [DOI] [PubMed] [Google Scholar]
  • 4.Kurichi J.E., Sonnad S.S. Statistical methods in the surgical literature. J. Am. Coll. Surg. 2006;202:476–484. doi: 10.1016/j.jamcollsurg.2005.11.018. [DOI] [PubMed] [Google Scholar]
  • 5.Salbach N.M., Jaglal S.B., Korner-Bitensky N., Rappolt S., Davis D. Practitioner and organizational barriers to evidence-based practice of physical therapists for people with stroke. Phys. Ther. 2007;87:1284–1303. doi: 10.2522/ptj.20070040. [DOI] [PubMed] [Google Scholar]
  • 6.Gopalakrishnan S., Ganeshkumar P. Systematic reviews and meta-analysis: Understanding the best evidence in primary healthcare. J. Fam. Med. Prim. Care. 2013;2:9–14. doi: 10.4103/2249-4863.109934. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Littell J.H., Corcoran J., Pillai V. Systematic Reviews and Meta-Analysis. Oxford University Press; Oxford, UK: 2008. [Google Scholar]
  • 8.Cooper C., Booth A., Varley-Campbell J., Britten N., Garside R. Defining the process to literature searching in systematic reviews: A literature review of guidance and supporting studies. BMC Med. Res. Methodol. 2018;18:85. doi: 10.1186/s12874-018-0545-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Ahn E., Kang H. Introduction to systematic review and meta-analysis. Korean J. Anesthesiol. 2018;71:103–112. doi: 10.4097/kjae.2018.71.2.103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Harbour R., Miller J. A new system for grading recommendations in evidence based guidelines. BMJ. 2001;323:334–336. doi: 10.1136/bmj.323.7308.334. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Shin I.S. Recent Research Trends in Meta-analysis. Asian Nurs. Res. (Korean Soc. Nurs. Sci.) 2017;11:79–83. doi: 10.1016/j.anr.2017.05.004. [DOI] [PubMed] [Google Scholar]
  • 12.Borenstein M., Hedges L.V., Higgins J.P.T., Rothstein H.R. Introduction to Meta-Analysis. Wiley; West Sussex, UK: 2009. [Google Scholar]
  • 13.Murad M.H., Asi N., Alsawas M., Alahdab F. New evidence pyramid. Evid. Based Med. 2016;21:125–127. doi: 10.1136/ebmed-2016-110401. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Higgins J.P.T., Thomas J., Chandler J., Chandler J., Cumpston M., Li T., Page M., Welch V. Cochrane Handbook for Systematic Reviews of Interventions (Version 6.2) [(accessed on 22 July 2021)]. Available online: https://training.cochrane.org/handbook/current/chapter-11/
  • 15.Moher D., Liberati A., Tetzlaff J., Altman D.G., PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Ann. Intern. Med. 2009;151:264–269. doi: 10.7326/0003-4819-151-4-200908180-00135. [DOI] [PubMed] [Google Scholar]
  • 16.Cullis P.S., Gudlaugsdottir K., Andrews J. A systematic review of the quality of conduct and reporting of systematic reviews and meta-analyses in paediatric surgery. PLoS ONE. 2017;12:e0175213. doi: 10.1371/journal.pone.0175213. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Narayan V.M., Chrouser K., Haynes R.B., Parrish R., Dahm P. Defining the publication source of high-quality evidence in urology: An analysis of EvidenceUpdates. BJU Int. 2016;117:861–866. doi: 10.1111/bju.13392. [DOI] [PubMed] [Google Scholar]
  • 18.Page M.J., Shamseer L., Altman D.G., Tetzlaff J., Sampson M., Tricco A.C., Catalá-López F., Li L., Reid E.K., Sarkis-Onofre R., et al. Epidemiology and reporting characteristics of systematic reviews of biomedical research: A cross-sectional study. PLoS Med. 2016;13:e1002028. doi: 10.1371/journal.pmed.1002028. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Padula R.S., Pires R.S., Alouche S.R., Chiavegato L.D., Lopes A.D., Costa L.O. Analysis of reporting of systematic reviews in physical therapy published in Portuguese. Braz. J. Phys. Ther. 2012;16:381–388. doi: 10.1590/S1413-35552012005000040. (In English & Portuguese) [DOI] [PubMed] [Google Scholar]
  • 20.Beller E.M., Glasziou P.P., Altman D.G., Hopewell S., Bastian H., Chalmers I., Gøtzsche P.C., Lasserson T., Tovey D., PRISMA for Abstracts Group PRISMA for abstracts: Reporting systematic reviews in journal and conference abstracts. PLoS Med. 2013;10:e1001419. doi: 10.1371/journal.pmed.1001419. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Liberati A., Altman D.G., Tetzlaff J., Mulrow C., Gøtzsche P.C., Ioannidis J.P., Clarke M., Devereaux P.J., Kleijnen J., Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. J. Clin. Epidemiol. 2009;62:e1–e34. doi: 10.1016/j.jclinepi.2009.06.006. [DOI] [PubMed] [Google Scholar]
  • 22.Tan W.K., Wigley J., Shantikumar S. The reporting quality of systematic reviews and meta-analyses in vascular surgery needs improvement: A systematic review. Int. J. Surg. 2014;12:1262–1265. doi: 10.1016/j.ijsu.2014.10.015. [DOI] [PubMed] [Google Scholar]
  • 23.Clarivate Analytics Journal Citation Reports. [(accessed on 17 April 2021)]. Available online: https://clarivate.com/webofsciencegroup/solutions/journal-citation-reports/
  • 24.Tam W.W.S., Lo K.K.H., Khalechelvam P. Endorsement of PRISMA statement and quality of systematic reviews and meta-analyses published in nursing journals: A cross-sectional study. BMJ Open. 2017;7:e013905. doi: 10.1136/bmjopen-2016-013905. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Liu Y., Zhang R., Huang J., Zhao X., Liu D., Sun W., Mai Y., Zhang P., Wang Y., Cao H., et al. Reporting quality of systematic reviews/meta-analyses of acupuncture. PLoS ONE. 2014;9:e113172. doi: 10.1371/journal.pone.0113172. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Ge L., Wang J.C., Li J.L., Liang L., An N., Shi X.T., Liu Y.C., Tian J.H. The assessment of the quality of reporting of systematic reviews/meta-analyses in diagnostic tests published by authors in China. PLoS ONE. 2014;9:e85908. doi: 10.1371/journal.pone.0085908. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Pigott T.D., Polanin J.R. Methodological guidance paper: High-quality meta-analysis in a systematic review. Rev. Educ. Res. 2020;90:24–46. doi: 10.3102/0034654319877153. [DOI] [Google Scholar]
  • 28.Lima Y.L., Ferreira V.M.L.M., de Paula Lima P.O., Bezerra M.A., de Oliveira R.R., Almeida G.P.L. The association of ankle dorsiflexion and dynamic knee valgus: A systematic review and meta-analysis. Phys. Ther. Sport. 2018;29:61–69. doi: 10.1016/j.ptsp.2017.07.003. [DOI] [PubMed] [Google Scholar]
  • 29.Neilson V., Ward S., Hume P., Lewis G., McDaid A. Effects of augmented feedback on training jump landing tasks for ACL injury prevention: A systematic review and meta-analysis. Phys. Ther. Sport. 2019;39:126–135. doi: 10.1016/j.ptsp.2019.07.004. [DOI] [PubMed] [Google Scholar]
  • 30.Stroup D.F., Berlin J.A., Morton S.C., Olkin I., Williamson G.D., Rennie D., Moher D., Becker B.J., Sipe T.A., Thacker S.B. Meta-analysis of observational studies in epidemiology: A proposal for reporting. JAMA. 2000;283:2008–2012. doi: 10.1001/jama.283.15.2008. [DOI] [PubMed] [Google Scholar]
  • 31.Powden C.J., Hoch J.M., Hoch M.C. Rehabilitation and improvement of health-related quality-of-life detriments in individuals with chronic ankle instability: A meta-analysis. J. Athl. Train. 2017;52:753–765. doi: 10.4085/1062-6050-52.5.01. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Greenland S., Senn S.J., Rothman K.J., Carlin J.B., Poole C., Goodman S.N., Altman D.G. Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. Eur. J. Epidemiol. 2016;31:337–350. doi: 10.1007/s10654-016-0149-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.National Institute for Health Research PROSPERO is Fast-Tracking Registration of Protocols Related to COVID-19 2021. [(accessed on 22 July 2021)]. Available online: https://www.crd.york.ac.uk/prospero/
  • 34.Tawfik G.M., Giang H., Ghozy S., Altibi A.M., Kandil H., Le H.H., Eid P.S., Radwan I., Makram O.M., Hien T., et al. Protocol registration issues of systematic review and meta-analysis studies: A survey of global researchers. BMC Med. Res. Methodol. 2020;20:213. doi: 10.1186/s12874-020-01094-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Booth A., Clarke M., Ghersi D., Moher D., Petticrew M., Stewart L. An international registry of systematic-review protocols. Lancet. 2011;377:108–109. doi: 10.1016/S0140-6736(10)60903-8. [DOI] [PubMed] [Google Scholar]
  • 36.Booth A. Providing transparency in systematic review methods: The case for protocol registration. Gerodontology. 2019;36:301–302. doi: 10.1111/ger.12440. [DOI] [PubMed] [Google Scholar]
  • 37.Shantikumar S., Wigley J., Hameed W., Handa A. A survey of instructions to authors in surgical journals on reporting by CONSORT and PRISMA. Ann. R Coll. Surg. Engl. 2012;94:468–471. doi: 10.1308/003588412X13373405386619. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Walker E., Hernandez A.V., Kattan M.W. Meta-analysis: Its strengths and limitations. Clevel. Clin. J. Med. 2008;75:431–439. doi: 10.3949/ccjm.75.6.431. [DOI] [PubMed] [Google Scholar]
  • 39.Luchini C., Veronese N., Nottegar A., Shin J.I., Gentile G., Granziol U., Soysal P., Alexinschi O., Smith L., Solmi M. Assessing the quality of studies in meta-research: Review/guidelines on the most important quality assessment tools. Pharm. Stat. 2021;20:185–195. doi: 10.1002/pst.2068. [DOI] [PubMed] [Google Scholar]
  • 40.Appelbaum M., Cooper H., Kline R.B., Mayo-Wilson E., Nezu A.M., Rao S.M. Journal article reporting standards for quantitative research in psychology: The APA publications and Communications Board task force report. Am. Psychol. 2018;73:3–25. doi: 10.1037/amp0000191. [DOI] [PubMed] [Google Scholar]
  • 41.Haidich A.B. Meta-analysis in medical research. Hippokratia. 2010;14((Suppl. 1)):29–37. [PMC free article] [PubMed] [Google Scholar]
  • 42.Alzahrani H., Mackey M., Stamatakis E., Pinheiro M.B., Wicks M., Shirley D. The effectiveness of incidental physical activity interventions compared to other interventions in the management of people with low back pain: A systematic review and meta-analysis of randomised controlled trials. Phys Ther. Sport. 2019;36:34–42. doi: 10.1016/j.ptsp.2018.12.008. [DOI] [PubMed] [Google Scholar]
  • 43.Atkins D., Best D., Briss P.A., Eccles M., Falck-Ytter Y., Flottorp S., Guyatt G.H., Harbour R.T., Haugh M.C., Henry D., et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328:1490. doi: 10.1136/bmj.328.7454.1490. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Atkins D., Eccles M., Flottorp S., Guyatt G.H., Henry D., Hill S., Liberati A., O’Connell D., Oxman A.D., Phillips B., et al. Systems for grading the quality of evidence and the strength of recommendations I: Critical appraisal of existing approaches The GRADE Working Group. BMC Health Serv. Res. 2004;4:38. doi: 10.1186/1472-6963-4-38. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Furlan A.D., Malmivaara A., Chou R., Maher C.G., Deyo R.A., Schoene M., Bronfort G., van Tulder M.W., Editorial Board of the Cochrane Back, Neck Group 2015 updated method guideline for systematic reviews in the Cochrane Back and Neck Group. Spine. 2015;40:1660–1673. doi: 10.1097/BRS.0000000000001061. [DOI] [PubMed] [Google Scholar]
  • 46.Singh J.A., Wells G.A., Christensen R., Tanjong Ghogomu E., Maxwell L., Macdonald J.K., Filippini G., Skoetz N., Francis D., Lopes L.C., et al. Adverse effects of biologics: A network meta-analysis and Cochrane overview. Cochrane Database Syst. Rev. 2011;2011:CD008794. doi: 10.1002/14651858.CD008794.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Cochrane Training Completing “Summary of Findings” Tables and Grading the Certainty of the Evidence. [(accessed on 21 April 2021)]. Available online: https://training.cochrane.org/handbook/current/chapter-14.
  • 48.Krimsky S. Do Financial Conflicts of Interest Bias Research? An Inquiry into the ‘‘Funding Effect’’ Hypothesis. Sci. Technol. Hum. Values. 2013;38:1–22. doi: 10.1177/0162243912456271. [DOI] [Google Scholar]
  • 49.Kwak S.M., Myung S.K., Lee Y.J., Seo H.G., Korean Meta-Analysis Study Group Efficacy of omega-3 fatty acid supplements (eicosapentaenoic acid and docosahexaenoic acid) in the secondary prevention of cardiovascular disease: A meta-analysis of randomized, double-blind, placebo-controlled trials. Arch. Intern. Med. 2012;172:686–694. doi: 10.1001/archinternmed.2012.262. [DOI] [PubMed] [Google Scholar]
  • 50.Myung S.K., Ju W., McDonnell D.D., Lee Y.J., Kazinets G., Cheng C.T., Moskowitz J.M. Mobile phone use and risk of tumors: A meta-analysis. J. Clin. Oncol. 2009;27:5565–5572. doi: 10.1200/JCO.2008.21.6366. [DOI] [PubMed] [Google Scholar]
  • 51.Tandel K.R. Sugar substitutes: Health controversy over perceived benefits. J. Pharm. Pharm. 2011;2:236–243. doi: 10.4103/0976-500X.85936. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Helfer B., Prosser A., Samara M.T., Geddes J.R., Cipriani A., Davis J.M., Mavridis D., Salanti G., Leucht S. Recent meta-analyses neglect previous systematic reviews and meta-analyses about the same topic: A systematic examination. BMC Med. 2015;13:82. doi: 10.1186/s12916-015-0317-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Bigna J.J.R., Um L.N., Nansseu J.R.N. A comparison of quality of abstracts of systematic reviews including meta-analysis of randomized controlled trials in high-impact general medicine journals before and after the publication of PRISMA extension for abstracts: A systematic review and meta-analysis. Syst. Rev. 2016;5:174. doi: 10.1186/s13643-016-0356-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.MacDonald S.L., Canfield S.E., Fesperman S.F., Dahm P. Assessment of the methodological quality of systematic reviews published in the urological literature from 1998 to 2008. J. Urol. 2010;184:648–653. doi: 10.1016/j.juro.2010.03.127. [DOI] [PubMed] [Google Scholar]
  • 55.Braga L.H., Pemberton J., Demaria J., Lorenzo A.J. Methodological concerns and quality appraisal of contemporary systematic reviews and meta-analyses in pediatric urology. J. Urol. 2011;186:266–271. doi: 10.1016/j.juro.2011.03.044. [DOI] [PubMed] [Google Scholar]
  • 56.Page M.J., Moher D. Evaluations of the uptake and impact of the Preferred Reporting Items for Systematic reviews and Meta Analyses (PRISMA) Statement and extensions: A scoping review. Syst. Rev. 2017;6:263. doi: 10.1186/s13643-017-0663-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Mayo-Wilson E., Heyward J., Keyes A., Reynolds J., White S., Atri N., Alexander G.C., Omar A., Ford D.E., National Clinical Trials Registration and Results Reporting Taskforce Survey Subcommittee Clinical trial registration and reporting: A survey of academic organizations in the United States. BMC Med. 2018;16:60. doi: 10.1186/s12916-018-1042-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Oliveira C.B., Elkins M.R., Lemes Í.R., de Oliveira Silva D., Briani R.V., Monteiro H.L., Azevedo F.M., Pinto R.Z. A low proportion of systematic reviews in physical therapy are registered: A survey of 150 published systematic reviews. Braz. J. Phys. Ther. 2018;22:177–183. doi: 10.1016/j.bjpt.2017.09.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Hartling L., Ospina M., Liang Y., Dryden D.M., Hooton N., Seida J.K., Klassen T.P. Risk of bias versus quality assessment of randomised controlled trials: Cross sectional study. BMJ. 2009;339:b4012. doi: 10.1136/bmj.b4012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Deeks J.J., Dinnes J., D’Amico R., Sowden A.J., Sakarovitch C., Song F., Petticrew M., Altman D.G., International Stroke Trial Collaborative Group. European Carotid Surgery Trial Collaborative Group Evaluating non-randomised intervention studies. Health Technol. Assess. 2003;7:1–173. doi: 10.3310/hta7270. [DOI] [PubMed] [Google Scholar]
  • 61.Kim S.Y., Park J.E., Lee Y.J., Seo H.J., Sheen S.S., Hahn S., Jang B.H., Son H.J. Testing a tool for assessing the risk of bias for non-randomized studies showed moderate reliability and promising validity. J. Clin. Epidemiol. 2013;66:408–414. doi: 10.1016/j.jclinepi.2012.09.016. [DOI] [PubMed] [Google Scholar]
  • 62.Schulz K.F., Altman D.G., Moher D., CONSORT Group CONSORT 2010 statement: Updated guidelines for reporting parallel group randomized trials. Ann. Intern. Med. 2010;152:726–732. doi: 10.7326/0003-4819-152-11-201006010-00232. [DOI] [PubMed] [Google Scholar]
  • 63.Vandenbroucke J.P., Von Elm E., Altman D.G., Gøtzsche P.C., Mulrow C.D., Pocock S.J. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. BMJ. 2007;335:806–808. doi: 10.1136/bmj.39335.541782.AD. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.De Morton N.A. The PEDro scale is a valid measure of the methodological quality of clinical trials: A demographic study. Aust. J. Physiother. 2009;55:129–133. doi: 10.1016/S0004-9514(09)70043-1. [DOI] [PubMed] [Google Scholar]
  • 65.Alsalaheen B., Stockdale K., Pechumer D., Broglio S.P., Marchetti G.F. A comparative meta-analysis of the effects of concussion on a computerized neurocognitive test and self-reported symptoms. J. Athl. Train. 2017;52:834–846. doi: 10.4085/1062-6050-52.7.05. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Hoyt W.T., Del Re A.C. Effect size calculation in meta-analyses of psychotherapy outcome research. Psychother. Res. 2018;28:379–388. doi: 10.1080/10503307.2017.1405171. [DOI] [PubMed] [Google Scholar]
  • 67.Slater L.V., Hart J.M., Kelly A.R., Kuenze C.M. Progressive changes in walking kinematics and kinetics after anterior cruciate ligament injury and reconstruction: A review and meta-analysis. J. Athl. Train. 2017;52:847–860. doi: 10.4085/1062-6050-52.6.06. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Seffrin C.B., Cattano N.M., Reed M.A., Gardiner-Shires A.M. Instrument-assisted soft tissue mobilization: A systematic review and effect-size analysis. J. Athl. Train. 2019;54:808–821. doi: 10.4085/1062-6050-481-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.McAuliffe S., Tabuena A., McCreesh K., O’Keeffe M., Hurley J., Comyns T., Purtill H., O’Neill S., O’Sullivan K. Altered strength profile in Achilles tendinopathy: A systematic review and meta-analysis. J. Athl. Train. 2019;54:889–900. doi: 10.4085/1062-6050-43-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Olejnik S., Algina J. Measures of effect size for comparative studies: Applications, interpretations, and limitations. Contemp. Educ. Psychol. 2000;25:241–286. doi: 10.1006/ceps.2000.1040. [DOI] [PubMed] [Google Scholar]
  • 71.Beeson P.M., Robey R.R. Evaluating single-subject treatment research: Lessons learned from the aphasia literature. Neuropsychol. Rev. 2006;16:161–169. doi: 10.1007/s11065-006-9013-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Knapik J., Steelman R. Risk factors for injuries during military static-line airborne operations: A systematic review and meta-analysis. J. Athl. Train. 2016;51:962–980. doi: 10.4085/1062-6050-51.9.10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Hedges L.V., Olkin I. Statistical Methods for Meta-Analysis. Academic Press; Cambridge, MA, USA: 1985. [Google Scholar]
  • 74.McGuinness L.A., Higgins J.P.T. Risk-of-bias VISualization (robvis): An R package and Shiny web app for visualizing risk-of-bias assessments. Res. Synth. Methods. 2021;12:55–61. doi: 10.1002/jrsm.1411. [DOI] [PubMed] [Google Scholar]
  • 75.Shea B.J., Reeves B.C., Wells G., Thuku M., Hamel C., Moran J., Moher D., Tugwell P., Welch V., Kristjansson E., et al. AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008. doi: 10.1136/bmj.j4008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Sterne J.A.C., Hernán M.A., McAleenan A., Reeves B.C., Higgins J.P.T. Chapter 25: Assessing risk of bias in a non-randomized study. In: Higgins J., Thomas J., Chandler J., Cumpston M., Li T., Page M.J., Welch V.A., editors. Cochrane Handbook for Systematic Reviews of Interventions. Wiley-Balckwell; Hoboken, NJ, USA: 2020. [(accessed on 22 July 2021)]. Version 6.1. Available online: www.training.cochrane.org/handbook. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

All data relevant to the study are included in the article. Data were collected from studies published online or publicly available, and specific details related to the data will be made available upon request.


Articles from Healthcare are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES