Skip to main content
PLOS One logoLink to PLOS One
. 2023 Jan 26;18(1):e0280800. doi: 10.1371/journal.pone.0280800

Effects of the menstrual cycle phase on anterior cruciate ligament neuromuscular and biomechanical injury risk surrogates in eumenorrheic and naturally menstruating women: A systematic review

Thomas Dos’Santos 1,2,*, Georgina K Stebbings 1,2, Christopher Morse 1,2, Medha Shashidharan 1,2, Katherine A J Daniels 1,2, Andy Sanderson 1,2
Editor: Javier Peña3
PMCID: PMC9879429  PMID: 36701354

Abstract

Background

Eumenorrheic women experience cyclic variations in sex hormones attributed to the menstrual cycle (MC) which can impact anterior cruciate ligament (ACL) properties, knee laxity, and neuromuscular function. This systematic review aimed to examine the effects of the MC on ACL neuromuscular and biomechanical injury risk surrogates during dynamic tasks, to establish whether a particular MC phase predisposes women to greater ACL injury risk.

Methods

PubMed, Medline, SPORTDiscus, and Web of Science were searched (May-July 2021) for studies that investigated the effects of the MC on ACL neuromuscular and biomechanical injury risk surrogates. Inclusion criteria were: 1) injury-free women (18–40 years); 2) verified MC phases via biochemical analysis and/or ovulation kits; 3) examined neuromuscular and/or biomechanical injury risk surrogates during dynamic tasks; 4) compared ≥1 outcome measure across ≥2 defined MC phases.

Results

Seven of 418 articles were included. Four studies reported no significant differences in ACL injury risk surrogates between MC phases. Two studies showed evidence the mid-luteal phase may predispose women to greater risk of non-contact ACL injury. Three studies reported knee laxity fluctuated across the MC; two of which demonstrated MC attributed changes in knee laxity were associated with changes in knee joint loading (KJL). Study quality (Modified Downs and Black Checklist score: 7–9) and quality of evidence were low to very low (Grading of Recommendations Assessment Development and Evaluation: very low).

Conclusion

It is inconclusive whether a particular MC phase predisposes women to greater non-contact ACL injury risk based on neuromuscular and biomechanical surrogates. Practitioners should be cautious manipulating their physical preparation, injury mitigation, and screening practises based on current evidence. Although variable (i.e., magnitude and direction), MC attributed changes in knee laxity were associated with changes in potentially hazardous KJLs. Monitoring knee laxity could therefore be a viable strategy to infer possible ACL injury risk.

1. Introduction

Female athletes (18–40 years old) are ~3.5 times more likely to sustain an ACL injury compared to male athletes [1], depending on sporting population [2]. Despite recent advancements in sports medicine and technology, ACL injury rates in female athletes are not declining [36] which is problematic as female sport participation rates are increasing [7, 8]. Female ACL injury incidence rates would therefore be predicted to increase in future due to greater participant exposures. Although risk factors related to skeletal anatomy [913], biomechanical movement strategies [1417], neuromuscular activation patterns [15, 1820], and biopsychosocial factors (i.e., inequities in socioeconomic status and skill training provision) may partially contribute to the sex disparity in ACL injury [3, 4, 2123], one specific physiological risk factor increasing in interest is the role of fluctuations in ovarian sex hormones on ACL injury risk attributed to the menstrual cycle (MC).

Eumenorrheic and naturally menstruating women of reproductive age experience variations in ovarian sex hormones during different phases of the MC which can influence physiological systems and function [2429]. For example, based on a 28-day MC length, the early follicular days 1–5 (Phase 1) is associated with low oestrogen and progesterone, whereas the highest oestrogen to progesterone ratio is observed during late follicular days 6–12 (Phase 2). During ovulation (Phase 3; days 13–15), oestrogen is lower (medium concentration) than phase 2 but higher than phase 1 with low progesterone levels, whereas the mid-luteal days 20–23 (Phase 4; ~7 days post ovulation) contains the highest progesterone concentrations, with relatively high oestrogen levels (> phase 1 and 3 but < than 2) [25, 26, 30]. Due to the different concentrations of ovarian sex hormonal profiles throughout the MC, phases associated with increased oestrogen may impact soft tissue compliance [31, 32], influence collagen formation and the tensile properties and integrity of ligaments (i.e., mechanical load tolerance) [3335], impacting ligamentous and knee laxity [33, 34, 36], and neuromuscular function [24, 27, 30, 37, 38], and thus potentially increasing ACL injury susceptibility [39, 40].

There is, however, mixed and conflicting evidence that a specific MC phase may predispose female athletes to greater risk of non-contact ACL injury [3942]. Notably, previous research in this area is generally confounded by methodological and research design limitations. These include inconsistencies in MC verification (i.e., lack of biomechanical analysis or ovulation kits, thus potential inclusion of anovulatory or luteal phase deficient women) and definitions [2527], non-homogenous group profiling (i.e., describing injury in both the follicular and ovulatory phases [preovulatory] without considering the distinct hormonal variations in the early and late parts of each), inclusion of hormonal contraception (HC) users (distinctly different hormonal profiles) and contact ACL injuries, and use of unreliable injury recall or questionnaires.

As neuroexcitation [38], neuromuscular function [24, 27, 30, 37, 38], and ligamentous and knee laxity [33, 34, 36] can fluctuate throughout the MC, as well as psychological and perceptions of perceived effort and intensity [27], MC hormonal perturbations are likely to affect neuromuscular activation and coordination patterns during high impact tasks [39]. These changes may impact neuromuscular control and movement quality, which may influence the generation of hazardous mechanical loads associated with non-contact ACL injury risk during jump-landing and change of direction (COD) tasks [39]. To improve ACL injury mitigation strategies, injury screening protocols, and physical preparation and management of female athletes, greater understanding of how hormonal, neuromuscular, and biomechanical factors interrelate and influence the execution and movement quality of jump-landing and COD tasks across different MC phases is needed. The aim of this systematic review was to examine the effects of the MC on ACL neuromuscular and biomechanical injury risk surrogates, during dynamic, high impact tasks in eumenorrheic and naturally menstruating women. A secondary aim was to highlight the limitations, considerations, and future directions for research to improve our understanding regarding the effect of the MC on ACL injury risk. It was hypothesised that differences in neuromuscular and biomechanical injury risk surrogates would be observed between MC phases in eumenorrheic and naturally menstruating women. If specific MC phases may have potentially heightened injury risk, the findings may assist in ACL injury mitigation strategies, injury screening protocols, and physical preparation and management of female athletes.

2. Methods

This review conforms to the PRISMA 2020 statement guidelines [43] (S1 Checklist). A review protocol was not pre-registered for this review; however, the review methods were established prior to conducting the review.

2.1 Study inclusion and exclusion criteria

Consideration of Population, Intervention, Comparator, Outcomes, and Study design (PICOS) was used to establish the parameters within which the review was conducted [44]. The PICOS strategy is presented in Table 1. Studies that did not meet the PICOS criteria were excluded from the review.

Table 1. Consideration of population, intervention, comparator, outcomes and study design.

Population Participants included women who were: a) aged between 18 and 40 years old; b) Healthy Eumenorrheic / naturally menstruating women of reproductive age (i.e., post-menarche and pre-menopausal) who experience ovulation confirmed via biochemical analysis or ovulation kits; c) free from any menstrual-related dysfunctions (e.g., amenorrhea) or any other conditions (e.g., pregnancy, eating disorders or disordered eating, low energy availability and relative energy deficiency syndrome) known to affect the hypothalamic–pituitary–ovarian axis [24]; d) never previously sustained a severe knee injury such as an ACL injury, and no previous lower-limb injury which required surgery or no previous lower limb injury within a year prior to testing; e) engaged in physical activity or sport from recreational to elite playing status [45]. Studies that contained participants with previous or current history of polycystic ovary syndrome (PCOS) were excluded.
Intervention / Method A specific intervention was not investigated but participants were required to meet the population criteria above. Studies must have examined biomechanical and/or neuromuscular surrogates of non-contact ACL injury risk during a pre-planned or unplanned bilateral or unilateral landing / jump-landing, deceleration, or COD task using 3D motion and/or GRF analysis, 2D kinematic analysis, goniometry, and/or surface electromyography (sEMG). Only studies that verified participants’ MC phase via biochemical analysis (i.e., blood/serum analysis) and / or ovulation kits were included, in line with McNulty et al. [24].
Comparator To determine the effect of MC phase on neuromuscular and biomechanical injury risk surrogates, included studies must compare an outcome measure (i.e., surrogate of ACL injury risk) at a minimum of 2 phases of MC in line with McNulty et al. [24]. Comparisons must have been made between two of the following MC phases in line with classifications provided in previous research [24, 25]: early follicular (days 1–5), late follicular (days 6–12), ovulation (days 13–15), early luteal (days 16–19), mid-luteal (days 20–23) and late luteal (days 24–28).
Outcomes Studies must have included precise mean and SD or SEs for injury risk surrogates for all phases examined. Subsequently, a change in injury risk surrogate between MC phases denotes a potential change in non-contact ACL injury risk. Biomechanical non-contact ACL injury risk surrogates (i.e., factor which has been shown to increase ACL loading / strain / KJL or prospectively shown to predict injury) included [9, 46, 47]: knee abduction, rotation, flexion moments / impulse (knee joint loads) due to the propensity to increase ACL strain [47, 48], or studies that investigated ACL loading via musculoskeletal modelling [49, 50] or measured proximal anterior tibial shear [51]. Technical, kinetic, or kinematic determinants of surrogates of injury risk (i.e., KJL) [9, 46, 52] related to quadriceps, ligament, trunk, and/or leg dominance, such as: vertical / posterior GRF / impulse; initial or peak lateral trunk flexion/rotation angle, hip internal rotation angle, knee valgus / internal rotation angle, knee flexion / hip flexion angle, and foot progression angles were also considered as biomechanical injury risk surrogates. Because neuromuscular activation patterns have been shown to predict non-contact ACL injury [53, 54], and has the potential to support ligament unloading [55], or increase ACL loading [5659]; studies that examined outcome measures related to quadriceps femoris, hamstrings, gluteal groups, gastrocnemius, and / or soleus preactivation, time to activation, peak activation at pre ground contact, initial contact and / or over weight-acceptance were included and considered as injury risk surrogates.
Study design Clinical studies were included for analysis if they: a) were a peer reviewed full published article in English using human participants; b) had the primary or secondary objective of monitoring changes in ACL injury risk surrogates between MC phases; and c) included within-group comparison for phases of MC with outcome measures clearly taken during two or more MC phases.
Other data extraction The following data was extracted and recorded in a spreadsheet:
  1. author names, publication year

  2. sample size and participant characteristics including sport(s), playing level/status, training history, strength training history/status/profile

  3. timing of injury risk surrogate (outcome measures) during the MC and whether testing order was randomised

  4. how MC phase was identified and verified (method)

  5. how ACL injury risk surrogate was assessed (methods)

  6. reliability and familiarisation stated for outcome measures / tasks (if reported)

  7. outcome measures with results

Key: ACL: Anterior cruciate ligament; MC: Menstrual cycle; KJL: Knee joint load; COD: Change of direction; 2D: Two-dimensional; 3D: Three-dimensional; GRF: Ground reaction force

2.2 Search strategy

A literature search was performed using PubMed, Medline (OVID), SPORTDiscus, and Web of Science databases by two reviewers (TDS and MS) from May 2021 to July 2021 with the final search date of 2nd July 2021. Citation tracking on Google Scholar was also used to identify any additional material. A schematic of the search methodology in accordance with established guidelines [43] is presented in Fig 1.

Fig 1. Flow chart illustrating the different phases of the search strategy in accordance with PRISMA guidelines.

Fig 1

Adapted from Page et al. [43].

Search terms were as follows:

  1. (“Anterior cruciate ligament” OR “knee” OR “ACL”)

  2. (“biomechanic” OR “biomechanics” OR “biomechanical” OR “neuromuscular” OR “injury” OR “kinetic” OR “kinematic” OR “electromyography” OR “muscle activation” OR “biomec*” or electromy*”)

  3. (“menstrual phase” OR “menstrual cycle” OR “menstrual” OR “menstruation” OR “follicular phase” OR “luteal phase” OR “ovulation” OR “ovulatory”)

  4. 1 AND 2 AND 3

Subsequently, bibliographies of prospectively eligible studies were compiled and hand searched by two independent reviewers to screen for further suitable studies. Studies were first assessed based on title and abstract to identify potentially eligible studies, the full text of these studies was then read to confirm if they met the eligibility criteria. If disagreement on eligibility occurred between the two reviewers (TDS and MS), a third independent reviewer (AS) was consulted, and their decision deemed as final.

2.3 Quality assessment of included studies and quality of evidence

Study quality was assessed by two reviewers (TDS and MS) and independently verified by one reviewer (AS). The appraisal tool was based on the Downs and Black checklist for measuring study quality and was modified according to McNulty et al. [24] who conducted a related review examining the effect of MC on exercise performance, and thus developed a more appropriate tool for the present review. The modified Downs and Black checklist comprised 15 outcomes, from five domains: (1) reporting; (2) external validity; (3) internal validity—bias; (4) internal validity—confounding; and (5) power. A maximum attainable score of 16 could be awarded, whereby study quality was categorised as follows: “high” (14–16); “moderate” (10–13); “low” (6–9); or “very low” (0–5) [24]. The results of the Downs and Black assessment were used to assign an a priori quality rating to each study. In accordance with McNulty et al. [24], the a priori rating was then either maintained, or downgraded a level, based on the response to two questions that were considered key to the directness of these research studies: Q.1) was the MC phase confirmed using blood samples? If the authors reported using blood samples to confirm MC phase, the a priori rating was maintained and if not, the study was downgraded a level (e.g., a study that started out as “high” in quality, but did not confirm MC phase using a blood sample, drops to “moderate” in quality); and Q.2) was the MC phase confirmed using urinary ovulation detection kits? If the authors reported the use of a urinary ovulation detection kit to identify MC phase, the Q.1 rating was maintained; if not, the study was downgraded a level. As such, the maximum rating for any study that does not use serum analysis or urinary ovulation detection kits to identify and verify MC phase is “low” [24].

Finally, the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach was implemented to further assess the quality of evidence obtained from the present review [60]. The tool was applied for surrogates of ACL injury risk (Table 1; outcomes) for five determinants: risk of bias, inconsistency, imprecision, indirectness, and publication bias [61]. As all studies in this review were experimental / clinical studies (i.e., repeated measures observations with no formal intervention or treatment), the GRADE scores initially start with a low rating. The overall quality of evidence within the studies was upgraded for factors such as large effect sizes or dose-response relationships (i.e., directness) or downgraded for factors including risk of bias (i.e., control of confounding factors), imprecision (i.e., reporting of confidence intervals and p values), inconsistency (i.e., reported results / effects), indirectness (i.e., outcome measures and comparisons between MC phases) and publication bias [60, 61].

2.4 Data collation

Quantitative data pertaining to study methodology, participant characteristics, MC phase and verification, ACL injury risk surrogates, reliability measures, and results (Table 1) were obtained for qualitative analysis by two independent reviewers (TDS and MS). Results were collated through identifying significant (p < 0.05) and non-significant findings (p > 0.05) for outcome measures and correlational R values where applicable, while percentage changes and effect sizes were also extracted if provided by the authors.

3. Results

3.1 Literature search

Fig 1 illustrates a flow chart which summarises the results of the systematic search process.

3.2 Study characteristics and findings

Seven studies met the inclusion criteria for this review [3335, 6265]. An overview of the methodological quality assessment is provided in Table 2, while study characteristics and findings are presented in Tables 3 and 4. Sample sizes ranged from 10 to 71 [3335, 62, 64, 65], with Shultz et al. [63] examining a substantially larger sample size of 71 compared to the next highest (n = 28). Participant characteristics were generally poorly described across all studies with no study providing any information pertaining to specific sports, skill level, or resistance training history.

Table 2. Methodological quality assessment of included studies and quality of evidence.

Study 1 2 3 4 5 6 7
Author Abt et al. (2007) Chaudhari et al. (2007) Dedrick et al. (2008) Okazaki et al. (2017) Park et al. (2009) AMJSM Park et al. (2009) BJSM Shultz et al. (2012)
Q Title
Reporting
1 Is the hypothesis/aim/objective of the study clearly described? Yes = 1 No = 0 1 1 1 1 1 1 1
2 Are the main outcomes to be measured clearly described in the introduction or methods section? If the main outcomes are first mentioned in the results section, answer no. Yes = 1 No = 0 1 1 1 1 1 1 1
3 Are the characteristics of the participants included in the study clearly described? In observational studies, inclusion and/or exclusion criteria should be given. In case-control studies, inclusion and/or exclusion and the source of controls should be given. Yes = 1 No = 0 0 0 0 0 0 0 0
4 Were the tested menstrual cycle phases clearly described? Answer yes if the precise criteria used to define phase were provided, answer no if the exact phase tested cannot be ascertained (e.g., vague language such as “early” or “late” were used, without defining the criteria) Yes = 1 No = 0 1 0 1 1 1 1 1
5 Are the main findings of the study clearly described? Simple outcome data should be reported for all major findings so the reader can check the major analyses and conclusions. This does not cover statistical tests which are addressed in other questions. Yes = 1 No = 0 1 1 1 1 1 1 1
6 Does the study provide estimates of the random variability in the data for the main outcomes? In non-normal data, inter-quartile range should be reported. In normal data, standard deviation, standard error or confidence intervals should be reported. Yes = 1 No = 0 1 1 1 1 1 1 1
External validity
7 Were the subjects confirmed as non-hormonal contraceptive users, for at least three months prior to participation? Yes = 1 No = 0 Unable to determine = 0 0 0 1 0 1 1 1
Internal validity–bias
8 Was at least one familiarization trial conducted prior to exercise testing? Yes = 1 No = 0 Unable to determine = 0 1 0 0 0 0 0 1
9 Were the exercise test conditions adequately standardised (taking into consideration factors including time of day, prior nutritional intake [including caffeine] and prior exercise). Yes (all relevant factors standardised) = 2 Yes (some relevant factors standardised) = 1 Exercise testing unstandardized = 0 Unable to determine = 0 0 2 0 0 0 0 0
10 If any of the results of the study were based on ‘data dredging’ was this made clear? Any analyses that had not been planned at the outset should be clearly indicated. If no retrospective subgroup analyses were reported, then answer yes. Yes = 1 No = 0 Unable to determine = 0 0 0 0 0 0 0 0
11 Were statistical tests used to assess the main outcomes appropriate? The statistical techniques used must be appropriate to the data and the research question. Yes = 1 No = 0 Unable to determine = 0 1 1 1 1 1 1 1
12 Were the main outcome measures used accurate (i.e., valid and reproducible)? For studies where the validity and reproducibility of outcome measures are clearly described, the question should be answered yes. For studies which refer to other work that demonstrates the outcome measures are accurate, answer yes. Yes = 1 No = 0 Unable to determine = 0 0 0 0 0 0 0 0
Internal validity–confounding (selection bias)
13 Was the order of phase testing randomised? Yes = 1 No = 0 Unable to determine = 0 0 0 1 0 0 0 0
Power
14 Did the study have sufficient power to detect an a priori specified scientifically important effect at a pre-determined probability threshold? Answer yes if they included a power calculation, and no if not. Yes = 1 No = 0 0 0 0 0 0 0 0
15 Was study retention > 85%? Yes = 1 No = 0 Unable to determine = 0 1 1 1 1 1 1 1
Grading (assign an a priori study quality rating based on the modified Downs and Black checklist, so all studies will start out as being of “high”, “moderate”, “low”, “very low”)
16 Identify if menstrual cycle phase was confirmed using blood samples. If yes, the a priori rating is maintained and this is the final study quality rating. If not, the study is downgraded a level (e.g., a study that started out as high, drops to moderate). No Yes Yes Yes Yes Yes No
17 Identify if menstrual cycle phase was confirmed using ovulation kits. If yes, the Q1. rating is maintained. If no, the study is downgraded another level (e.g., a study that started out high, drops to low). This means that the maximum rating that any study that does not use blood analysis or ovulation kits is “low” or “very low”. Yes No No Yes Yes Yes Yes
Rating 8 7 9 7 8 8 9
Downs and Black checklist (maximum score attainable = 16). Study quality was categorised as follows: “high”: 14–16; “moderate”: 10–13; “low”: 6–9; “very low”: 0–5)
A priori Low Low Low Low Low Low Low
Final classification Very low Very low Very low Low Low Low Very low

GRADE: Risk of bias: high (-); Inconsistency; yes (-); Imprecision: yes (-); Indirectness: no (+); Publication bias (-); moderate (-). Level of Evidence: Very low

Key: GRADE: Grading of Recommendations Assessment, Development and Evaluation; Q: Question.

Table 3. Synthesis of methodologies and research designs of eligible studies.

Study Author MC verification MC phases examined Task
Blood / Biochemical Ovulation kits Early follicular Late follicular Ovulatory Mid-luteal Follicular Luteal Cut Jump-stop Drop jump Drop-Landing
1 Abt et al. (2007)
2 Chaudhari et al. (2007)
3 Dedrick et al. (2008)
4 Okazaki et al. (2017) ✔ (spans late follicular)
5 Park et al. (2009) AMJSM ✔ (spans late follicular)
6 Park et al. (2009) BJSM ✔ (spans late follicular)
7 Shultz et al. (2012)

Key: MC: Menstrual cycle; HC: Hormonal contraception; GRF: Ground reaction force; sEMG: Surface electromyography; F: Familiarisation; R: Reliability

Table 4. Summary of literature that has investigated the effects of MC phase on neuromuscular and biomechanical non-contact ACL injury risk surrogates.

Author Sample size n = Population details (i.e., sport, playing level, age, height)
Population training, strength, skill history
Population menstrual / health status and length
MC phase method verification and details
Dynamic task and methods
Key outcome measures / variables
Reliability / familiarisation reported (y/n)
Results and implications (i.e., does a certain MC phase predispose athlete to greater risk of injury? Comments
Abt et al. (2007) n = 10
Age: 21.4 ± 1.4 years; height: 1.67 ± 0.06 m; mass: 59.9 ± 7.4 kg
Physically active women recruited from a local university.
Specific sport, skill, or strength training history not stated.
Eumenorrheic and ovulating. MC length and frequency per year not stated.
Phases were defined based on first day of menses. Urine samples collected daily starting on day 10 until a positive test was received using ovulation detection kit. Positive test indicated start of post ovulatory phase.
Mid luteal phase was defined as starting 7 days after a positive ovulation test (21–23 of MC).
Ovulation was also confirmed by screening mid-luteal progesterone threshold level.
Testing occurred three times; on day 3 of menses (early follicular), 24–36 hours post-positive ovulation test, mid-luteal (21–23) / 7 days post ovulation detection.
Single leg stop-jump task - 3D motion and GRF analysis
Knee flexion and valgus angle, peak proximal tibial anterior shear force.
Knee flexion and valgus moment at peak anterior tibial shear force. From initial contact to peak to peak knee flexion / valgus.
One month familiarisation period. No reliability measures reported for outcome measures.
  • Estradiol ↑ during post-ovulatory and mid-luteal vs early follicular

  • Progesterone ↓ in early follicular and post-ovulatory

  • ↔ in knee flexion excursion, knee valgus excursion, peak proximal tibial anterior shear force, flexion moment at peak proximal tibial anterior shear force, or valgus moment at peak proximal tibial anterior shear force between MC phases.

  • No difference in knee biomechanical injury risk surrogate were found in the phases. This implies that there may not be a greater risk of ACL injury associated with one particular MC phase.

Specific sport, skill, or strength training history not stated. 2 phases of MC verified. Limited number of biomechanical variables in relation to ACL examined; only knee kinetic and kinematics; ACL injury multi-segment mechanism (i.e., hip, trunk and foot). Small sample size. MC length not stated. Testing order was non-randomised. One subject removed for anovulatory cycle. No individual analysis which may conceal differences. No reliability measures reported for outcome measures. No sEMG. No temporal analysis / coordination examined. MC phases not verified with blood samples. HC usage not confirmed. Changes were not examined relative to measurement error
Chaudhari et al. (2007) n = 12
Age: 19.1 ± 1.0 years; height: 1.7 ± 0.1 m; weight: 595 ± 98 N
Women who participated in recreational sports at a local university.
Specific sport, skill, or strength training history not stated.
Verified MC length for 2 cycles.
Women were tested twice for each phase of the MC (follicular, luteal, ovulatory), as determined from serum analysis. Onset of the ovulatory phase of the cycle was determined using the PC-2000 saliva testing system (I.M.P., Manschau, Germany), which gives a positive result 3 to 5 days before ovulation. The subjects used this system once a day for 60 days before testing.
Onset of luteal phase (~day 15) was estimated from saliva testing data, and a serum blood test for estradiol, progesterone, and luteinizing hormone was performed. Specific dates of the 3 phases not provided. Testing conditions standardised between phases.
Bilateral horizontal jump, bilateral vertical jump, and unilateral drop from a 30-cm box on the left leg.
Limited 3D motion and GRF analysis—5 marker link model
Lower-limb kinematics (at foot strike and max knee flexion) and peak externally applied moments were calculated (hip adduction moment, hip internal rotation moment, knee flexion moment, knee abduction moment) during weight acceptance.
No familiarisation or reliability measures reported for outcome measures.
  • ↔ in knee moments or knee angle between MC phases

  • No difference in knee biomechanical injury risk surrogate were found in the phases. This implies that there may not be a greater risk of ACL injury associated with one particular MC phase.

Specific sport, skill, or strength training history not stated. Small sample size. MC phases not clearly described. Unclear if non-randomised testing order was used. No individual analysis which may conceal differences. Large variability in mean/SD. Limited marker model used for 3D motion analysis. No reliability measures reported for outcome measures. No sEMG. No temporal analysis / coordination examined. MC phases not verified with ovulation kit. HC usage not confirmed. Changes were not examined relative to measurement error.
Dedrick et al. (2008) n = 22
Age: 20.5 ± 1.9 years; height: 164.9 ± 5.6 cm; mass: 62.1 ± 13.7 kg; and Wojtys et al. [66] activity scale 5.4 ± 1.4 hr/week
Recreationally active women with no formal history of jump-landing training.
Specific sport, skill, or strength training history not stated.
Participants had regular menses for at least one year. Eumenorrhea was defined as cycles occurring at regular intervals ranging from 26 to 32 days. Cycles established for 2 months prior to testing.
MC length 28.3 ± 1.5 days. Participants non-HC usage ≥ 3 months prior to testing.
Blood assays verified sex hormone levels and cycle phase.
Random assignment of participants to testing time: 11 subjects beginning data collection in the early follicular phase (day 1–3), 8 in mid-luteal phase (day 21–24), and 7 in the late follicular phase (day 11–13) of the menstrual cycle.
Bilateral drop jumps from 0.5m.
sEMG of six muscles and goniometer data for knee angles. Varus/valgus knee angle and sEMG activity from six lower extremity muscles (GM, ST, vastus lateralis, vastus medialis oblique, tibialis anterior, and the lateral head of the gastrocnemius). Angle data between initial contact and 500ms of ground contact.
No familiarisation or reliability measures reported for outcome measures.
  • ↔ knee valgus angle or time to reach knee valgus angle between MC phases

  • ST muscle exhibited onset delays relative to ground contact during mid-luteal phase, and demonstrated a significant difference in onset time between early and late follicular phases.

  • Muscle timing differences between the GM and ST were decreased in the mid-luteal phases compared to early follicular phases influencing co-activation.

  • ↔ temporal muscle sequencing / sequential recruitment between MC phases

  • MC phases appears not to influence knee valgus angle; however, may alter muscle activity (onset and timing) particularly ST and activation of GM and ST during mid-luteal phase which may increase ACL risk.

Participants excluded if history of formalized jump training. Specific sport, skill, or strength training history not stated. Random assignment of cycles which is positive. Only limited number of variables examined. Only one task examined. No reliability measures reported for outcome measures. Limited number of biomechanical variables in relation to ACL injury risk examined; only knee kinematics; ACL injury multi-segment mechanism (i.e., hip, trunk and foot). No temporal analysis / coordination examined. MC phases not verified with ovulation kit. Changes were not examined relative to measurement error.
Okazaki et al. (2017) n = 28
Age: 21.0 ± 0.8 years; height: 158.1 ± 6.0 cm; mass: 52.8 ± 6.5 kg
Specific sport, skill, activity, or strength training history not stated.
Healthy but MC length not stated
Blood sample verification menstrual phase (1st-5th day; actually, early follicular), follicular phase (7th-10th day; actually, late follicular), ovulation phase (12th-15th day), and luteal phase (7th-9th day from ovulation; actually, mid-luteal).
MC cycles verified over 3 cycle history. MC phases verified with assay of serum hormonal levels.
The test examiner was blinded to the MC of the participants. Ovulation kit used to detect ovulation.
Unilateral drop-landing 0.30 m. 3D motion and GRF analysis and sEMG
Peak GRF and time to peak GRF. Hip, knee, and ankle kinematics. EMG activity 150 ms before activity. GM, ST, BF, and RF.
No familiarisation or reliability measures reported for outcome measures.
Mid-luteal phase:
  • Time to peak GRF ↓ vs. early follicular phase (6%)

  • Hip internal rotation and knee valgus ↑ vs early follicular (43% and 34%, respectively)

  • Knee flexion ↓ vs early and late follicular phases (7–9%)

  • Ankle dorsi-flexion ↓ vs late follicular phase (11%)

  • Ankle adduction and eversion ↑ vs early and late follicular phases (26–46%, and 27–33%, respectively)

  • GM ↓ activation before landing vs early and late follicular phases (20–22%)

  • ↔ between MC phases for BF, ST, or RF muscle activity

  • Mid-luteal phase may predispose women to greater risk of non-contact ACL injury based on changes in biomechanical and NMS injury risk surrogates

Incorrect definition of MC phases, specifically stating menstrual phases. Specific sport, skill, or strength training history not stated. The examiner was blinded which is positive but unclear if testing order was randomised. No knee joint loads were examined. No reliability measures reported for outcome measures. No individual analysis which may conceal differences. No temporal analysis / coordination examined. HC usage not confirmed. Changes were not examined relative to measurement error.
Park et al. (2009) AMJSM n = 26
Age: 22.7 ± 3.3 years; height: 170.1 ± 7.1 cm; mass: 65.0 ± 9.6 kg
Recreationally active women who played Sports—activity levels 8.7 ± 4.6 hr/week
Specific sport, skill, or strength history not stated.
MC length: 28.9 ± 2.7 days
Follicular (Early) (3–7), ovulation (24–48 hours after detection of oestrogen surge—ovulation kit) and luteal (mid-luteal) (~7 days post ovulation) phases—serum hormone.
Non-randomised order. Blood samples collected at 3 time points to verify.
Timing of the third test varied and ranged between 19 and 26 days (22.85 ± 3.22 days) depending on the length of the participants’ MC. Participants non-HC usages ≥ 3 months.
45° pre-planned cut (CUT45); target speed 3.5 m/s. 3D motion and GRF analysis
Bilateral jump and stop action—self-selected speed and kept consistent between sessions. 3D motion and GRF analysis
Knee laxity—KT-2000 arthrometer 89N and compared 3D data between participants with low, medium, and high laxity
Knee laxity (mm), peak knee angle, and knee joint moment (Nm) and knee joint impulse (Nms). Internal knee adduction, knee flexion, and int/ext rotation moment during stance phase.
Reliability measures reported for knee laxity only.
  • ↔ for any parameter for both tasks between MC phases

  • Of the 26 participants, 13 showed the lowest knee laxity during the early follicular phase; 3 were lowest during ovulation, and 10 lowest during mid-luteal phase. 14 of 26 participants displayed highest knee laxity during ovulation compared with 10 participants during the early follicular phase and only 2 participants during the mid-luteal phase.

  • ↑ CUT45 knee adduction (valgus) impulse (0.31 ± 0.30 Nms) in high vs low knee laxity group (0.22 ± 0.21 Nms).

  • ↑ jump-stop knee adduction moment (49.77 ± 23.05 Nm) in high vs medium knee laxity group (40.23 ± 20.42 N∙m).

  • ↑ jump-stop knee external rotation moment and impulse in high vs low knee laxity group (external rotation impulse: 0.47 ± 0.42 Nms vs 0.27 ± 0.27 Nms; external rotation moment: 8.28 ± 4.45 N∙m vs 6.04 ± 3.51 N∙m) during jumping and stopping.

  • 1.3-mm difference in knee laxity ↑ ~30% in knee adduction impulse during CUT45, ↑ ~20% in knee adduction moment, and ↑ ~ 20–45% external rotation loads for jump-stop

  • No specific MC phases predisposes women to greater risk, rather the phases produce variations in knee laxity, with increases in laxity increasing multiplanar knee joint loads and potential ACL injury risk.

  • Higher knee laxity associated with increased multiplanar knee joint loads. However, variation in the MC phase where the highest and lowest laxity observed.

  • Thus, group analysis is potentially masking differences. Clear individual variation in laxity and subsequent knee joint loading

Examined two tasks which is positive. Specific sport, skill, or strength training history not stated. Non-randomised testing order which introduces potential order effect. 3D motion analysis using limited marker set. Only one cutting angle examined at a low entry speed. Limited number of biomechanical variables in relation to ACL examined; only knee kinematics; ACL injury multi-segment mechanism (i.e., hip, trunk and foot). No temporal analysis / coordination. Group analysis masked out differences due to positive and negative responders. No reliability measures reported for outcome measures. Early follicular phase slightly spans later follicular MC phase classification according to McNulty et al. [24]. No sEMG. Changes were not examined relative to measurement error.
Park et al. (2009) BJSM n = 25
Age: 22.7 ± 3.5 years, 170.2 ± 7.0 cm, 64.7 ± 9.6 kg
Sports at recreational level—activity levels 8.7 ± 4.6 hr/week
Specific sport, skill, or strength history not stated.
MC length: 28.9 ± 2.8 days
Follicular (5–8) (Spans both early and late according to McNulty’s et al’s [24] classification), ovulation (24–48 hours after detection of oestrogen surge—ovulation kit) and luteal (~7 days post 2nd test; (mid-luteal))—serum hormone.
Non-randomised order. Blood samples collected at 3 time points to verify. Participants non-HC usages ≥ 3months.
45° pre-planned cut; target speed 3.5 m/s. 3D motion and GRF analysis
Knee laxity—KT-2000 arthrometer 89N
Knee laxity (mm),peak knee angle and knee joint moment (Nm) and knee joint impulse (Nms). Internal knee adduction, knee flexion, and int/ext rotation moment during stance phase.
No familiarisation or reliability measures reported for outcome measures.
  • ↑ knee laxity in ovulation vs. mid-luteal phase, but ↔ knee joint mechanics between MC phases.

  • Positive correlation between Δ knee laxity and Δ knee joint loads (moment or impulse) from follicular phase to ovulation (r = 0.523), and ovulation to mid-luteal luteal phase (r = 0.526)

  • Positive correlations between Δ laxity and Δ knee internal rotation impulse, and Δ laxity and Δ knee adduction impulse from ovulation to the luteal phase (r = 0.450) and (r = 0.408)

  • 15 women with ↑ knee laxity from follicular to ovulation phases showed tendency to ↑ knee joint loads (adduction / impulse), whereas other 10 with ↓ knee laxity, showed a tendency to ↓ knee joint loads.

  • 20 women whose knee laxity ↓ from ovulation to mid-luteal phase showed a tendency to ↓ knee joint loads (internal rotation moment and impulse and adduction impulse), whereas the other five, whose knee laxity ↑, showed a tendency to ↑ knee loads.

  • Women whose knee laxity ↑ between MC phases showed ↑ knee joint loads, and women whose knee laxity ↓ showed ↓ knee joint loads.

  • 1–3 mm Δ knee laxity during the MC caused a 3–4 Nm Δ internal rotation moments and 40–50 Nm Δ adduction moments.

  • No specific MC phase predisposes females to greater risk of ACL injury based on biomechanical risk injury risk surrogates.

  • Changes in laxity associated with change in KJL—due to MC phase hormonal changes (positive = positive / negative = negative). However, considerable variability in changes (magnitude and direction) in laxity across MC phases.

Specific sport, skill, or strength training history not stated. Non-randomised testing order. 3D motion analysis with limited marker set. Only one cutting angle examined at a low entry speed. Limited number of biomechanical variables in relation to ACL injury risk examined; only knee kinematics; ACL injury multi-segment mechanism (i.e., hip, trunk and foot). No temporal analysis / coordination. Group analysis masked out differences due to positive and negative responders. No reliability measures reported for outcome measures. Follicular phase spans early and later follicular MC phase classification according to McNulty et al. [24] No sEMG. Changes were not examined relative to measurement error
Shultz et al. (2012) n = 71
Recreationally active women (2.5–10 hrs/week) for 3 months prior. Other anthropometrics not reported.
Specific sport, skill, or strength training history not stated.
Nulliparous—self reported MC length (26–32 days) ± 1 day
Ovulation kit to verify ovulation.
Early follicular (up to 6 days after menses) and mid-luteal (8–10 consecutive days after ovulation).
Testing performed on days based on two time points where knee laxity was highest (T2) and lowest (T1) which coincided with these periods. Participants non-HC usages ≥ 3months.
Bilateral drop-jump from 0.45 m. 3D motional and GRF analysis with sEMG (quadriceps, hamstrings, gastrocnemius).
Knee laxity—KT-2000 arthrometer 133N. Electromagnetic position sensors (Ascension Technology Corp, Burlington, VT) 10 Nm varus/valgus torque and 5Nm internal-external torque)
Sagittal, frontal, and transverse kinetics and kinematics. Muscle pre- landing and post-landing activation. Full temporal analysis.
Participants’ familiarisation 2 weeks prior to testing. Reliability for laxity measurements and landing duration only—male data only
  • Sub-group of women who ↑ both sagittal and frontal plane laxity from T1 to T2 (cluster 3 and 4) had greater relative net change toward knee valgus of 3.7-to 5.2° compared with clusters who did not increase sagittal and frontal plane laxity (cluster 1).

  • ↔ in muscle activation and moments between time points.

  • Women who demonstrate changes in anterior and frontal laxity may display more valgus motion; however, moments and muscle activity do not change across MC phases which ultimately contributes to ACL loading.

Specific sport, skill, or strength training history not stated. Large sample size which is positive. No reliability measures reported for outcome measures. Temporal analysis conducted which is a positive of study. Unclear if testing order was randomised. MC phases not verified with blood samples. Changes were not examined relative to measurement error

Key: Anterior cruciate ligament; GRF: Ground reaction force; sEMG: Surface electromyography; MC menstrual cycle; 3D: Three-dimensional; GM: Gluteus maximus; ST: Semitendinosus; BF: Biceps femoris; RF: Rectus femoris; SD: Standard deviation; NMS: neuromuscular; CUT45: 45° pre-planned cut. ↑: significantly greater / higher / increase (p < 0.05); ↓: significantly lower / lesser / decrease (p < 0.05); ↔ no significant change or difference (p > 0.05)

Table 3 provides specific information pertaining to tasks examined (primarily bilateral and unilateral jumping), biomechanical and neuromuscular measures (primarily via 3D analysis n = 6 and EMG n = 3), injury risk surrogates, and measurement techniques for the included studies. Additionally, Table 3 provides information pertaining to no hormonal contraception usage (n = 4), MC phase verification method (i.e., urinary luteal hormone measurement n = 5 or blood samples n = 5), the MC phases examined (ranging from 2–5 phases in accordance with recommendations [24]) for the included studies.

With respect to the effect of MC phase on neuromuscular and biomechanical non-contact ACL injury risk surrogates, four studies observed no significant or meaningful differences between MC phases [33, 34, 62, 65], while two studies [35, 64] showed evidence that the mid-luteal phase may predispose women to greater risk of non-contact ACL injury compared to the early and late follicular phase based on neuromuscular activity and landing kinematics. Two studies [33, 34] showed that knee laxity fluctuated throughout the MC phases and the change in knee laxity was associated with changes in KJLs; however, considerable individual variation was observed with respect to the MC phase which elicited the greatest knee laxity and KJL. One study [63] also showed that increases in sagittal and frontal knee laxity were associated with increases in knee valgus motion, but muscle activity and KJLs were not significantly different. The researchers [63] examined landing mechanics during the periods of lowest and maximum laxity during the early follicular and mid-luteal phases but the authors do not clearly specify which phase elicited the highest or lowest laxity.

Only one study randomised the testing order across MC phases [64], with three studies confirming that testing order was non-randomised [33, 34, 62]. The remaining studies did not verify if the testing order was randomised [35, 63, 65]. Only one study clearly stated that testing conditions were standardised between MC phases [65], while one study confirmed that the examiner was blinded to MC phase [35]. Only two studies stated that a familiarisation period or session was provided prior to data collection [62, 63]. No study provided any reliability measures pertaining to the neuromuscular or biomechanical outcome measures [3335, 6265], nor did any study compare and interpret the change in outcome measure in relation to measurement error [3335, 6265]. No study examined joint-joint coordination changes between MC phases [3335, 6265], and only one study included a form of temporal analysis [63] while the remaining studies generally conducted discrete point analysis [3335, 62, 64, 65].

3.3 Assessment of methodological quality and quality of evidence

Methodological quality assessment data is presented in Table 2. Three [3335] and four [6265] studies were classed as low and very low, respectively, with scores ranging from 7–9. All studies were provisionally (a priori) scored as low; however, two studies were downgraded due to the failure to confirm MC phases using blood samples [62, 63], with two more studies downgraded for not verifying MC phases using ovulation kits [64, 65] in accordance with McNulty et al. [24]. Thus, only three studies [3335] maintained their a priori quality rating. There was a small number of studies included which were heterogenous in methodology precluding a meta-analysis; however, we assessed overall quality of evidence using GRADE, and found it to be very low (Table 2).

4. Discussion

The primary finding from this systematic review is that it is inconclusive whether a particular MC phase predisposes eumenorrheic and naturally menstruating women to greater non-contact ACL injury risk. Mixed findings from seven studies regarding the effects of the MC on ACL neuromuscular and biomechanical injury risk surrogates were observed, with very low quality of evidence. Four studies reported no meaningful differences in neuromuscular or biomechanical ACL injury risk surrogates between MC phases [33, 34, 62, 65], while two studies [35, 64] showed evidence that the mid-luteal phase may predispose women to greater risk of non-contact ACL injury compared to early or late follicular phases. Importantly, the MC influenced knee laxity [33, 34, 63], with two studies [33, 34] demonstrating MC attributed changes in knee laxity were associated with changes in KJL (i.e., increase in laxity associated with increase in KJL) and thus potential ACL injury risk [9, 47, 52]. However, considerable individual variation (i.e., magnitude and direction) was observed with respect to the MC phase which elicited the greatest knee laxity and KJL [33, 34]. Finally, the research in this review was low to very low in methodological quality, with significant methodological and research design limitations which should be acknowledged when interpreting the findings and improved in future research. A comprehensive overview regarding the methodological and research design limitations, considerations, and recommendations for future research are presented in Table 5.

Table 5. Limitations and considerations of the synthesised research pertaining to the effect of the MC on ACL neuromuscular and biomechanical injury risk surrogates.

Limitations and considerations Recommendations
Sample sizes are generally low and not justified (n = 10–28) [3335, 62, 64, 65] with no a priori statistical power or sample size estimates calculated. Studies are likely underpowered which increases the risk of type II error [91], significant effects are likely to overestimate population effects sizes [91], have lower precision [91], and are less likely to be true and reproducible [92]. Greater sample sizes with a priori sample size estimation and rationale are needed to ensure study is sufficiently powered. Researchers are advised to explicitly state the method for calculating statistical power (software, inputs etc.) and specify the chosen test to delineate the given effect size [91] or clearly state the sample size estimation method.
Participant characteristics are generally poorly described and limited to recreational or physically active women. Across all studies, none provided any information pertaining to specific sports, skill level, or resistance training history. This omission is key because skill level, training history, and physical capacity can influence movement strategy [9397]. Additionally, not all women are the same, as more experienced naturally menstruating / eumenorrheic sportswomen can have different hormonal profiles concentrations compared to untrained women which is likely to influence physiology and subsequent performance [98]. Better reporting of participant characteristics, particularly in relation to specific sports, skill level, or resistance training history [93], and further investigations into the effect of MC on ACL injury risk surrogates in a range of different sporting populations and skill levels is needed, particularly in elite populations.
Most studies investigated jump-landing tasks, using generally one or two tasks to evaluate potential injury risk. Additionally, only two studies examined a COD task, but this was limited to a 45° side-step cutting task only [33, 34]. Athletes’ biomechanical injury risk profiles are task dependent [7982] and importantly, a wide range of COD actions are performed in sport [99, 100] which are linked to ACL injuries including crossover cuts, split steps, shuffle steps, and pivots / turns. Additionally, the biomechanical demands of COD are angle and velocity dependent [80, 101], which have distinct implications on the technical execution, muscle activation, kinetic and kinematics, and KJLs. Thus, investigating only one COD angle only provides insight into an athlete’s ability to COD at the specific angle and action. No study examined penultimate foot contact braking strategies which can play an important role in COD [102, 103], and no study examined a deceleration task: a key mechanism of ACL injury [104107]. Further research using a range of different tasks such as jump-landing, COD, and deceleration actions, with considerations of the angle-velocity trade-off during COD.
Majority of studies have focused on lower-limb biomechanics, particularly the knee, and have failed to explore the hip, trunk, and ankle kinetics or kinematics [33, 34, 62, 65]. This is important because the ACL injury mechanism and loading is multi-segmental [46, 52, 77, 78]. Comprehensive whole-body analysis is needed when exploring the effect of the MC on neuromuscular and biomechanical ACL injury risk surrogates.
Three studies examined neuromuscular activity using sEMG techniques during abovementioned tasks [35, 63, 64]. Alternatively, high density sEMG can provide more detailed insights into the spatial distribution of activity and muscle coordination which can help understand how specific neuromuscular activity patterns affect movement quality, strategy, and potential KJLs. Further research is needed using high density sEMG in addition to bipolar, which can provide novel insights into whether the MC alters the muscle coordination and spatial distribution of activity which can therefore affect movement quality, strategy, and potential knee joint loading and subsequent ACL injury risk.
Only one study randomised the order of testing across MC phases [64], only one study clearly stated that testing conditions (extraneous factors) were standardised between MC phases [65], while one study confirmed that the examiner was blinded to MC phase [35]. The lack of randomisation introduces the potential for order / learning / familiarisation effects, while the lack of blinding can introduce issues with bias. The lack of testing standardisation (extraneous factors) between MC phases can influence physiological functions and concentrations of reproductive hormones attributed to changes in circadian rhythm (time of day), diet and nutritional supplementation, prior exercise, alcohol and consumption and smoking [25, 29]. Future research should ensure that: 1) randomised or counterbalanced testing order is adopted; 2) that the assessor is blinded to the MC phase; and 3) ensure that extraneous factors are standardised when conducting repeated measures / longitudinal testing.
Majority of studies fail to conduct individual analysis, and generally determine the effect of the MC on neuromuscular and biomechanical injury risk surrogates based on group analysis. Because not all women are the same, and the MC can result in inter-individual variations in physiological and hormonal responses [2527], inferences based on group means only may conceal potentially meaningful information [108110]; thus, the monitoring of individual changes and identification of positive-, non- and negative responders, would provide further insight into the effect of the MC on injury risk and performance. These individual changes should be interpreted relative to measurement error, SDD, or SWC as adopted in recently published literature [110112]. Finally, most data are presented in tabular or column chart format, and individual data is not provided in figures. This reduces data transparency, and does not allow researchers to examine the variability and distribution within the data, identify outliers, and examine trends in the individual changes in outcome variables between the MC phases [113]. This is of particular importance when working with small sample sizes. In addition to group analysis, researchers are encouraged to conduct individual analysis, monitoring positive, negative and non-responders. Ideally, when monitoring changes, these should also be interpreted relative to measurement error, SDD, or SWC. Finally, data transparency is advocated, and researchers should present their individual data, such as using univariate scatter plots.
No study reported reliability measures for their biomechanical or neuromuscular data, and only two studies stated a familiarisation session(s) / period [62, 63] was performed. Reliability is central in order to establish confidence in the data collection, analysis, and participant’s performance of the task, and to determine whether the data is stable, consistent, accurate, and valid. Unfortunately, most investigations failed to report reliability measures, and evidence has shown that injury risk surrogates, such as KJLs, can be susceptible to variability between sessions [114116]. Ensure participants are adequately familiarised with the testing protocols and ensure the reliability measures are reported to ensure data collected is stable, accurate, and valid. This will also result in greater data transparency and research quality.
No study examined joint-joint coordination changes between MC phases [3335, 6265]. Examinations of joint-joint coordination; angle-angle plots; position-velocity plots, will provide further insight into coupling behaviours and movement strategy and execution during high intensity tasks [117119]. Only one study included a form of temporal analysis [63] while the remaining studies generally conducted discrete point analysis [3335, 62, 64, 65]. This approach can lead to regional focus bias, whereby a large amount of data are discarded from the entire waveform [120124]; thus, valuable information across the whole curve is unexamined because only a single data point is examined [125, 126]. Additionally, discrete point analysis does not consider the position of the key measures (i.e., differences in timing); for example, trial peaks may occur at different timings along the waveform and thus, the temporal organisation of the pattern is lost [127129]. Future research should consider examining coordination changes in movement between MC phases to establish if the MC alters movement strategy and coupling behaviours between multiple segments. In addition to discrete point analysis, future research should conduct full temporal analysis of the full waveform, using statistical approaches such as statistical parametric mapping [114, 130132] or temporal phase analysis [133135]. Conducting such analysis could provide further insight not only into the magnitude of differences, but importantly provide more detail into where these differences occur across the whole time-series.

Key: COD: Change of direction; MC: menstrual cycle; ACL: anterior cruciate ligament; KJL: knee joint load; SWC: smallest worthwhile change; SDD: smallest detectable difference. sEMG: surface electromyography.

4.1 Evidence showing MC phase has no effect on ACL neuromuscular or Neuromuscular injury risk surrogates

Four studies [33, 34, 62, 65] reported no significant differences in neuromuscular or biomechanical (anterior tibial shear, KJL or knee valgus) ACL injury risk surrogates between MC phases during jump-landing. Similarly, two studies revealed no biomechanical differences in knee injury risk surrogates during 45° cutting [33, 34] or stop-jump actions [33] between MC phases. Thus, in line with GRADE interpretation, there is very low level of evidence which potentially implies that no specific MC phase elevates non-contact ACL injury risk based on biomechanical surrogates. The lack of differences in biomechanical ACL injury risk surrogates between ovulation and mid-luteal phases, speculatively, could be attributed to similar, high concentrations of oestrogen which may have comparable effects on ligament and tendon properties, neuromuscular control, and thus potential injury risk [67].

Although Chaudhari et al. [65] standardised testing conditions when comparing biomechanics between MC phases, the phase descriptions were unclear (i.e., failed to specify day that MC phase coincided with); therefore, making it difficult to verify and ascertain whether accurate MC phases were identified [24, 25]. Additionally, Park et al. [33, 34] identified the early follicular phase, using a date range that spans both early and late follicular phase according to recent descriptions [24, 25]. This approach may lead to the grouping of non-homogeneous participants and potential inaccurate evaluation regarding the influence of the MC [25]. The sample sizes used in the studies are generally small (n = 10–28) and likely underpowered. Two studies stated the testing order was non-randomised [62, 65], while two studies did not clearly describe whether randomised testing occurred [33, 34]. Thus, the lack of differences observed between MC phases by researchers [33, 34] could be influenced by a learning or order effect, potentially confounding the observations. Based on current evidence, methodological, and research design limitations, practitioners should be cautious manipulating their injury mitigation, screening, and physical preparation strategies based on the MC for female athletes.

4.2 Evidence showing mid-luteal phase may increase ACL injury risk based on neuromuscular or biomechanical injury risk surrogates

Two studies [35, 64] indicated that the mid-luteal phase may predispose women to greater non-contact ACL injury risk compared to other phases based on biomechanical (i.e., kinematics linked to greater KJLs) [35] and neuromuscular (i.e., reduced gluteal activation [35] or delayed semitendinosus activation which could increase anterior tibial shear [64]) surrogates during drop-landing tasks. This delay, speculatively, could be attributed to significant increases in progesterone compared to other phases (i.e., follicular and ovulation) which can elicit nervous system inhibitory effects [68, 69]. Importantly, however, minimal differences were observed in onset timing for other lower-limb muscles by Dedrick et al. [64]. Nonetheless, these studies have either blinded the assessor [35] or randomised testing [64], thus reducing bias.

Okazaki et al. [35] and Dedrick et al. [64] did not examine KJLs, a key ACL loading surrogate [48, 7072]. Akin to previous studies [33, 34, 62, 65], reliability measures were not reported for the outcome measures, while changes in measures were not interpreted relative to measurement error. This raises questions as to whether observed muscle activity [64] and joint kinematic [35] changes were due to error (i.e., neuromuscular or movement variability and measurement error) or truly attributable to MC influenced hormonal changes. Further research is needed which examines the effect of the MC on neuromuscular and biomechanical ACL injury risk surrogates, particularly KJLs, accounting for measurement error when interpreting changes between MC phases.

4.3 Evidence supporting an effect of MC on knee laxity and subsequent knee joint loads

While the MC’s effect on neuromuscular and biomechanical ACL injury risk surrogates appears inconclusive, three studies [33, 34, 63] demonstrated changes in knee laxity between different MC phases which were accompanied with changes in potentially hazardous biomechanics associated with ACL loading. Park et al. [33, 34] reported no differences in KJLs between MC phases, but measured knee laxity at each MC phase. Interestingly, women with higher knee laxity [33], and increases in laxity between MC phases [34], were associated with greater KJLs during cutting or stop-jumping. These findings [33, 34] may help explain why prospective research has identified an association between knee laxity and non-contact ACL injury [73, 74]. However, the MC phase which produced the greatest knee laxity and subsequent KJL was inconsistent between women (see Table 4), and thus an individualised approach to laxity, neuromuscular, and biomechanical monitoring is advised.

Collectively, this research indicates no specific MC phase predisposes women to greater risk of ACL injury based on biomechanical injury risk surrogates or knee laxity [33, 34]; however, the changes in laxity associated with MC phase hormonal changes produces a problematic laxity effect for KJLs and potential ACL injury risk. Notably, considerable variability in the changes (i.e., magnitude and direction) in laxity and its effect on KJLs was observed across MC phases which could be attributed to intra- and inter-individual-variation in the magnitude and rate of change in ovarian hormonal concentrations which influences laxity [75]. Additionally, genetic variation between individuals and differential expression of oestrogen receptors may effect oestradiol’s (E2) ability to bind to its receptor, potentially varying oestrogen-attributed physiological responses in musculoskeletal connective tissue, thus laxity responses [76].

Caution is advised regarding the aforementioned research [33, 34] as some definitions and classifications for the early follicular phase are different to recent MC classifications [24, 25], spanning both early and late phases (i.e., 5–8 days and 3–7 days). Additionally, similar to aforementioned studies [33, 34, 62, 65], only knee joint kinetics and kinematics were examined [33, 34], with other segments and joints (trunk, hip, and ankle), and neuromuscular activity also unexamined. This absence is important because the ACL injury mechanism and loading is multi-segmental [46, 52, 77, 78], and neuromuscular activity patterns has the potential to unload [55] or increase ACL loading [5659]. Conversely, in a larger sample size, previous work [63] reported that women who demonstrate changes in anterior and frontal knee laxity may display more valgus motion during bilateral drop vertical jumping; however, KJL and muscle activity did not change across phases which ultimately contributes to ACL loading and injury risk [47, 55]. Although difficult to rationalise these contrasting observations with Park et al. [33, 34], athletes’ biomechanical injury risk profiles are task dependent [7982]; thus, caution is advised generalising the conclusions regarding the role of the MC and biomechanical and neuromuscular injury risk surrogates when only a limited number of tasks have been investigated.

Although there is no consistent MC effect on knee laxity, MC hormonal perturbations can both increase and decrease women’s knee laxity at each MC phase. Therefore, monitoring female athletes’ knee laxity changes could be a viable strategy to infer potential KJLs changes and potential ACL injury risk throughout the MC. This can be done using an arthrometer [33, 34, 83, 84], rolimeter [85, 86], ultrasound [87], radiography [88], or wearable accelerometers [84].

5. Limitations, considerations, and future recommendations for research

Recently suggested [75], greater emphasis should be placed on exploring the effect of hormonal concentrations (i.e., magnitude, relative and / or rate of change from baseline) rather than focusing on the MC phase’s effect on performance or injury risk, because the change in hormonal contribution ultimately affects the physiological system. Further research is needed to understand how hormonal, neuromuscular, and biomechanical ACL injury risk factors interrelate and influence joint laxity and movement execution of dynamic tasks at different MC phases, whilst considering hormonal concentrations.

There is significant underrepresentation of female athletes in sports and exercise medicine research [23, 89, 90]. Researchers often avoid investigating women due to the MC associated physiological changes and the potential methodological difficulties [25]. The limited published literature synthesised during this review is insightful and provides unique, important information from an underrepresented population. We have, however, highlighted some methodological and research design limitations, and have suggested some future recommendations for research to build on the insightful body of work to improve research quality. Consequently, this has led to recent recommendations for more research into female athletes [23, 25, 26], particularly more rigorous research designs when exploring the MC’s effect in relation to potential injury risk and exercise performance [25, 26]. Therefore, future investigations which follow this review and other researchers’ suggestions [25, 26, 29], accounting for the methodological and research design limitations, will produce greater methodological quality and higher-quality data in women. This will permit fairer and more accurate conclusions regarding the MC’s effect on ACL injury risk.

Strengths of this systematic review included the comprehensive search strategy conforming with PRISMA, adopting the PICOS strategy to permit the synthesis of methodology and study findings. Additionally, methodological quality was assessed using a modified Downs and Black checklist [24], though this version has not been validated. Overall quality of evidence was evaluated using the GRADE approach, but due to the heterogeneity, quantitative statistical analysis and a meta-analysis could not be performed. Finally, this review was not pre-registered which can increase risk of bias (i.e., collating and synthesis of research, selective reporting, overall transparency, duplication, research waste).

6. Conclusion

Based on this review, it is inconclusive whether a particular MC phase predisposes eumenorrheic and naturally menstruating women to greater non-contact ACL injury risk based on neuromuscular and biomechanical surrogates, with mixed findings observed. Interestingly, knee laxity was affected by the MC, with evidence that MC attributed changes in knee laxity were associated with changes in KJL and thus potential ACL injury risk. However, considerable individual variation (i.e., magnitude and direction) was observed with respect to the MC phase which elicited the greatest knee laxity and KJL. Nonetheless, monitoring changes in knee laxity in female athletes could be a viable strategy to infer potential changes in KJLs and ACL injury risk. Research synthesised in this review was low to very low in methodological quality, contributing to a very low quality of evidence, which could be improved with respect to design and execution. As such, it is difficult to make definitive conclusions regarding the effects of the MC phase on ACL neuromuscular and biomechanical injury risk surrogates, and thus practitioners should be cautious manipulating their physical preparation, injury mitigation, and screening practises based on current evidence.

Supporting information

S1 Checklist. PRISMA 2020 checklist.

(TIF)

Data Availability

The data within this study are secondary data and available through the relevant articles referenced throughout. This is a systematic review, and thus, there is no data to provide.

Funding Statement

The author received no specific funding for this work.

References

  • 1.Voskanian N. ACL Injury prevention in female athletes: review of the literature and practical considerations in implementing an ACL prevention program. Current reviews in musculoskeletal medicine. 2013;6(2):158–63. doi: 10.1007/s12178-013-9158-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Montalvo AM, Schneider DK, Webster KE, Yut L, Galloway MT, Heidt RS Jr, et al. Anterior cruciate ligament injury risk in sport: a systematic review and meta-analysis of injury incidence by sex and sport classification. J Athl Training. 2019;54(5):472–82. doi: 10.4085/1062-6050-407-16 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Parsons JL, Coen SE, Bekker S. Anterior cruciate ligament injury: towards a gendered environmental approach. Br J Sports Med. 2021. doi: 10.1136/bjsports-2020-103173 [DOI] [PubMed] [Google Scholar]
  • 4.Fox A, Bonacci J, Hoffmann S, Nimphius S, Saunders N. Anterior cruciate ligament injuries in Australian football: should women and girls be playing? You’re asking the wrong question. BMJ open sport & exercise medicine. 2020;6(1):e000778. doi: 10.1136/bmjsem-2020-000778 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Sanders TL, Maradit Kremers H, Bryan AJ, Larson DR, Dahm DL, Levy BA, et al. Incidence of anterior cruciate ligament tears and reconstruction: a 21-year population-based study. Am J Sport Med. 2016;44(6):1502–7. doi: 10.1177/0363546516629944 [DOI] [PubMed] [Google Scholar]
  • 6.Zbrojkiewicz D, Vertullo C, Grayson JE. Increasing rates of anterior cruciate ligament reconstruction in young Australians, 2000–2015. Medical Journal of Australia. 2018;208(8):354–8. doi: 10.5694/mja17.00974 [DOI] [PubMed] [Google Scholar]
  • 7.Eime R, Charity M, Harvey J, Westerbeek H. Five-Year Changes in Community-Level Sport Participation, and the Role of Gender Strategies. Frontiers in Sports and Active Living. 2021;3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Statista. Women’s sports participation in the United Kingdom (UK)2020:[1–73 pp.].
  • 9.Dos’Santos T, Thomas C, McBurnie A, Donelon T, Herrington L, Jones PA. The Cutting Movement Assessment Score (CMAS) qualitative screening tool: application to mitigate anterior cruciate ligament injury risk during cutting. Biomechanics. 2021;1(1):83–101. [Google Scholar]
  • 10.Myer GD, Ford KR, Di Stasi SL, Foss KDB, Micheli LJ, Hewett TE. High knee abduction moments are common risk factors for patellofemoral pain (PFP) and anterior cruciate ligament (ACL) injury in girls: is PFP itself a predictor for subsequent ACL injury? Br J Sports Med. 2015;49(2):118–22. doi: 10.1136/bjsports-2013-092536 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Price MJ, Tuca M, Cordasco FA, Green DW. Nonmodifiable risk factors for anterior cruciate ligament injury. Current opinion in pediatrics. 2017;29(1):55–64. doi: 10.1097/MOP.0000000000000444 [DOI] [PubMed] [Google Scholar]
  • 12.Acevedo RJ, Rivera-Vega A, Miranda G, Micheo W. Anterior cruciate ligament injury: identification of risk factors and prevention strategies. Current sports medicine reports. 2014;13(3):186–91. doi: 10.1249/JSR.0000000000000053 [DOI] [PubMed] [Google Scholar]
  • 13.Pfeifer CE, Beattie PF, Sacko RS, Hand A. Risk factors associated with non-contact anterior cruciate ligament injury: a systematic review. Int J Sports Phys Ther. 2018;13(4):575–87. [PMC free article] [PubMed] [Google Scholar]
  • 14.Schilaty ND, Bates NA, Nagelli C, Krych AJ, Hewett TE. Sex-Based Differences in Knee Kinetics With Anterior Cruciate Ligament Strain on Cadaveric Impact Simulations. Orthopaedic Journal of Sports Medicine. 2018;6(3):2325967118761037. doi: 10.1177/2325967118761037 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Mendiguchia J, Ford KR, Quatman CE, Alentorn-Geli E, Hewett TE. Sex differences in proximal control of the knee joint. Sports Med. 2011;41(7):541–57. doi: 10.2165/11589140-000000000-00000 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Sigward SM, Cesar GM, Havens KL. Predictors of frontal plane knee moments during side-step cutting to 45 and 110 degrees in men and women: implications for anterior cruciate ligament injury. Clin J Sport Med. 2015;25(6):529–34. doi: 10.1097/JSM.0000000000000155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.McLean SG, Walker KB, van den Bogert AJ. Effect of gender on lower extremity kinematics during rapid direction changes: an integrated analysis of three sports movements. J Sci Med Sport. 2005;8(4):411–22. doi: 10.1016/s1440-2440(05)80056-8 [DOI] [PubMed] [Google Scholar]
  • 18.Bencke J, Aagaard P, Zebis MK. Muscle activation during acl injury risk movements in young female athletes: A Narrative Review. Frontiers in Physiology. 2018;9:445. doi: 10.3389/fphys.2018.00445 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Sigward SM, Powers C. The influence of gender on knee kinematics, kinetics and muscle activation patterns during side-step cutting. Clin Biomech. 2006;21(1):41–8. doi: 10.1016/j.clinbiomech.2005.08.001 [DOI] [PubMed] [Google Scholar]
  • 20.Malinzak RA, Colby SM, Kirkendall DT, Yu B, Garrett WE. A comparison of knee joint motion patterns between men and women in selected athletic tasks. Clin Biomech. 2001;16(5):438–45. doi: 10.1016/s0268-0033(01)00019-5 [DOI] [PubMed] [Google Scholar]
  • 21.Truong LK, Bekker S, Whittaker JL. Removing the training wheels: embracing the social, contextual and psychological in sports medicine. BMJ Publishing Group Ltd and British Association of Sport and Exercise Medicine; 2021. doi: 10.1136/bjsports-2020-102679 [DOI] [PubMed] [Google Scholar]
  • 22.Bruton MR, O’Dwyer N, Adams R. Sex differences in the kinematics and neuromuscular control of landing: biological, environmental and sociocultural factors. J Electromyogr Kines. 2013;23(4):747–58. doi: 10.1016/j.jelekin.2013.04.012 [DOI] [PubMed] [Google Scholar]
  • 23.Emmonds S, Heyward O, Jones B. The challenge of applying and undertaking research in female sport. Sports medicine-open. 2019;5(1):1–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.McNulty KL, Elliott-Sale KJ, Dolan E, Swinton PA, Ansdell P, Goodall S, et al. The effects of menstrual cycle phase on exercise performance in eumenorrheic women: a systematic review and meta-analysis. Sports Med. 2020:1–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Elliott-Sale KJ, Minahan CL, de Jonge XAJ, Ackerman KE, Sipilä S, Constantini NW, et al. Methodological considerations for studies in sport and exercise science with women as participants: a working guide for standards of practice for research on women. Sports Med. 2021;51(5):843–61. doi: 10.1007/s40279-021-01435-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Elliott-Sale K, Ross E, Burden R, Hicks K. The BASES expert statement on conducting and implementing female athlete based research. The Sport and Exercise Scientist. 2020(65):6–7. [Google Scholar]
  • 27.Carmichael MA, Thomson RL, Moran LJ, Wycherley TP. The Impact of Menstrual Cycle Phase on Athletes’ Performance: A Narrative Review. International journal of environmental research and public health. 2021;18(4):1667. doi: 10.3390/ijerph18041667 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Park E-J, Lee J-H, Ryue J-J, Sohn J-H, Lee K-K. Influence of anticipation on landing patterns during side-cutting maneuver in female collegiate soccer players. Korean Journal of Sport Biomechanics. 2011;21(4):391–5. [Google Scholar]
  • 29.JANSE DE JONGE X, Thompson B, Han A. Methodological recommendations for menstrual cycle research in sports and exercise. Med Sci Sports Exerc. 2019;51(12):2610–7. doi: 10.1249/MSS.0000000000002073 [DOI] [PubMed] [Google Scholar]
  • 30.Blagrove RC, Bruinvels G, Pedlar CR. Variations in strength-related measures during the menstrual cycle in eumenorrheic women: A systematic review and meta-analysis. J Sci Med Sport. 2020;23(12):1220–7. doi: 10.1016/j.jsams.2020.04.022 [DOI] [PubMed] [Google Scholar]
  • 31.Yim J, Petrofsky J, Lee H. Correlation between mechanical properties of the ankle muscles and postural sway during the menstrual cycle. The Tohoku journal of experimental medicine. 2018;244(3):201–7. doi: 10.1620/tjem.244.201 [DOI] [PubMed] [Google Scholar]
  • 32.Sung E-S, Kim J-H. The difference effect of estrogen on muscle tone of medial and lateral thigh muscle during ovulation. Journal of exercise rehabilitation. 2018;14(3):419. doi: 10.12965/jer.1836110.055 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Park S-K, Stefanyshyn DJ, Ramage B, Hart DA, Ronsky JL. Alterations in knee joint laxity during the menstrual cycle in healthy women leads to increases in joint loads during selected athletic movements. Am J Sport Med. 2009;37(6):1169–77. doi: 10.1177/0363546508330146 [DOI] [PubMed] [Google Scholar]
  • 34.Park S-K, Stefanyshyn DJ, Ramage B, Hart DA, Ronsky JL. Relationship between knee joint laxity and knee joint mechanics during the menstrual cycle. Br J Sports Med. 2009;43(3):174–9. doi: 10.1136/bjsm.2008.049270 [DOI] [PubMed] [Google Scholar]
  • 35.Okazaki M, Kaneko M, Ishida Y, Murase N, Katsumura T. Changes in the width of the tibiofibular syndesmosis related to lower extremity joint dynamics and neuromuscular coordination on drop landing during the menstrual cycle. Orthopaedic journal of sports medicine. 2017;5(9):2325967117724753. doi: 10.1177/2325967117724753 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Shultz SJ, Kirk SE, Johnson ML, Sander TC, Perrin DH. Relationship between sex hormones and anterior knee laxity across the menstrual cycle. Med Sci Sports Exerc. 2004;36(7). doi: 10.1249/01.mss.0000132270.43579.1a [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Sarwar R, Niclos BB, Rutherford O. Changes in muscle strength, relaxation rate and fatiguability during the human menstrual cycle. The Journal of physiology. 1996;493(1):267–72. doi: 10.1113/jphysiol.1996.sp021381 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Ansdell P, Brownstein CG, Škarabot J, Hicks KM, Simoes DC, Thomas K, et al. Menstrual cycle-associated modulations in neuromuscular function and fatigability of the knee extensors in eumenorrheic women. Journal of Applied Physiology. 2019;126(6):1701–12. doi: 10.1152/japplphysiol.01041.2018 [DOI] [PubMed] [Google Scholar]
  • 39.Balachandar V, Marciniak J-L, Wall O, Balachandar C. Effects of the menstrual cycle on lower-limb biomechanics, neuromuscular control, and anterior cruciate ligament injury risk: a systematic review. Muscles, ligaments and tendons journal. 2017;7(1):136. doi: 10.11138/mltj/2017.7.1.136 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Hewett TE, Zazulak BT, Myer GD. Effects of the menstrual cycle on anterior cruciate ligament injury risk: a systematic review. Am J Sport Med. 2007;35(4):659–68. doi: 10.1177/0363546506295699 [DOI] [PubMed] [Google Scholar]
  • 41.Martin D, Timmins K, Cowie C, Alty J, Mehta R, Tang A, et al. Injury incidence across the menstrual cycle in international footballers. Frontiers in sports and active living. 2021;3:17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Somerson JS, Isby IJ, Hagen MS, Kweon CY, Gee AO. The menstrual cycle may affect anterior knee laxity and the rate of anterior cruciate ligament rupture: a systematic review and meta-analysis. JBJS reviews. 2019;7(9):e2. doi: 10.2106/JBJS.RVW.18.00198 [DOI] [PubMed] [Google Scholar]
  • 43.Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. Bmj. 2021;372. doi: 10.1136/bmj.n160 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC health services research. 2014;14(1):1–10. doi: 10.1186/s12913-014-0579-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.McKay AK, Stellingwerff T, Smith ES, Martin DT, Mujika I, Goosey-Tolfrey VL, et al. Defining Training and Performance Caliber: A Participant Classification Framework. Int J Sports Physiol and Perform. 2022;17(2):317–31. doi: 10.1123/ijspp.2021-0451 [DOI] [PubMed] [Google Scholar]
  • 46.Donelon TA, Dos’Santos T, Pitchers G, Brown M, Jones PA. Biomechanical determinants of knee joint loads associated with increased anterior cruciate ligament loading during cutting: a systematic review and technical framework. Sports Medicine-Open. 2020;6(1):1–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Beaulieu ML, Ashton-Miller JA, Wojtys EM. Loading mechanisms of the anterior cruciate ligament. Sport Biomech. 2021:1–29. doi: 10.1080/14763141.2021.1916578 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Hewett T, Myer GD, Ford KR, Heidt RS, Colosimo AJ, McLean SG, et al. Biomechanical measures of neuromuscular control and valgus loading of the knee predict anterior cruciate ligament injury risk in female athletes a prospective study. Am J Sport Med. 2005;33(4):492–501. doi: 10.1177/0363546504269591 [DOI] [PubMed] [Google Scholar]
  • 49.Sinclair J, Brooks D, Stainton P. Sex differences in ACL loading and strain during typical athletic movements: a musculoskeletal simulation analysis. European journal of applied physiology. 2019;119(3):713–21. doi: 10.1007/s00421-018-04062-w [DOI] [PubMed] [Google Scholar]
  • 50.Weinhandl JT, Earl-Boehm JE, Ebersole KT, Huddleston WE, Armstrong BS, O’connor KM. Reduced hamstring strength increases anterior cruciate ligament loading during anticipated sidestep cutting. Clin Biomech. 2014;29(7):752–9. doi: 10.1016/j.clinbiomech.2014.05.013 [DOI] [PubMed] [Google Scholar]
  • 51.Yu B, Lin C-F, Garrett WE. Lower extremity biomechanics during the landing of a stop-jump task. Clin Biomech. 2006;21(3):297–305. doi: 10.1016/j.clinbiomech.2005.11.003 [DOI] [PubMed] [Google Scholar]
  • 52.Fox AS. Change-of-Direction Biomechanics: Is What’s Best for Anterior Cruciate Ligament Injury Prevention Also Best for Performance? Sports Med. 2018;48(8):1799–807. doi: 10.1007/s40279-018-0931-3 [DOI] [PubMed] [Google Scholar]
  • 53.Zebis MK, Andersen LL, Bencke J, Kjaer M, Aagaard P. Identification of athletes at future risk of anterior cruciate ligament ruptures by neuromuscular screening. Am J Sport Med. 2009;37(10):1967–73. doi: 10.1177/0363546509335000 [DOI] [PubMed] [Google Scholar]
  • 54.Smeets A, Malfait B, Dingenen B, Robinson MA, Vanrenterghem J, Peers K, et al. Is knee neuromuscular activity related to anterior cruciate ligament injury risk? A pilot study. Knee. 2019;26(1):40–51. doi: 10.1016/j.knee.2018.10.006 [DOI] [PubMed] [Google Scholar]
  • 55.Lloyd DG, Buchanan TS. Strategies of muscular support of varus and valgus isometric loads at the human knee. J Biomech. 2001;34(10):1257–67. doi: 10.1016/s0021-9290(01)00095-1 [DOI] [PubMed] [Google Scholar]
  • 56.Maniar N, Schache AG, Pizzolato C, Opar DA. Muscle contributions to tibiofemoral shear forces and valgus and rotational joint moments during single leg drop landing. Scand J Med Sci Spor. 2020. doi: 10.1111/sms.13711 [DOI] [PubMed] [Google Scholar]
  • 57.Maniar N, Schache AG, Sritharan P, Opar DA. Non-knee-spanning muscles contribute to tibiofemoral shear as well as valgus and rotational joint reaction moments during unanticipated sidestep cutting. Sci Rep. 2018;8(1):2501. doi: 10.1038/s41598-017-19098-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Adouni M, Shirazi-Adl A, Marouane H. Role of gastrocnemius activation in knee joint biomechanics: gastrocnemius acts as an ACL antagonist. Computer methods in biomechanics and biomedical engineering. 2016;19(4):376–85. doi: 10.1080/10255842.2015.1032943 [DOI] [PubMed] [Google Scholar]
  • 59.Mokhtarzadeh H, Yeow CH, Goh JCH, Oetomo D, Malekipour F, Lee PV-S. Contributions of the soleus and gastrocnemius muscles to the anterior cruciate ligament loading during single-leg landing. J Biomech. 2013;46(11):1913–20. doi: 10.1016/j.jbiomech.2013.04.010 [DOI] [PubMed] [Google Scholar]
  • 60.Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. Journal of clinical epidemiology. 2011;64(4):401–6. doi: 10.1016/j.jclinepi.2010.07.015 [DOI] [PubMed] [Google Scholar]
  • 61.Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. Journal of clinical epidemiology. 2011;64(4):383–94. doi: 10.1016/j.jclinepi.2010.04.026 [DOI] [PubMed] [Google Scholar]
  • 62.Abt JP, Sell TC, Laudner KG, McCrory JL, Loucks TL, Berga SL, et al. Neuromuscular and biomechanical characteristics do not vary across the menstrual cycle. Knee Surgery, Sports Traumatology, Arthroscopy. 2007;15(7):901–7. doi: 10.1007/s00167-007-0302-3 [DOI] [PubMed] [Google Scholar]
  • 63.Shultz SJ, Schmitz RJ, Kong Y, Dudley WN, Beynnon BD, Nguyen A-D, et al. Cyclic variations in multiplanar knee laxity influence landing biomechanics. Med Sci Sports Exerc. 2012;44(5):900–9. doi: 10.1249/MSS.0b013e31823bfb25 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Dedrick GS, Sizer PS, Merkle JN, Hounshell TR, Robert-McComb JJ, Sawyer SF, et al. Effect of sex hormones on neuromuscular control patterns during landing. J Electromyogr Kines. 2008;18(1):68–78. doi: 10.1016/j.jelekin.2006.09.004 [DOI] [PubMed] [Google Scholar]
  • 65.Chaudhari AM, Lindenfeld TN, Andriacchi TP, Hewett TE, Riccobene J, Myer GD, et al. Knee and hip loading patterns at different phases in the menstrual cycle. Am J Sport Med. 2007;35(5):793–800. [DOI] [PubMed] [Google Scholar]
  • 66.Wojtys EM, Wylie BB, Huston LJ. The effects of muscle fatigue on neuromuscular function and anterior tibial translation in healthy knees. Am J Sport Med. 1996;24(5):615–21. doi: 10.1177/036354659602400509 [DOI] [PubMed] [Google Scholar]
  • 67.Chidi-Ogbolu N, Baar K. Effect of estrogen on musculoskeletal performance and injury risk. Frontiers in physiology. 2019:1834. doi: 10.3389/fphys.2018.01834 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Smith SS, Woodward DJ, Chapin JK. Sex steroids modulate motor-correlated increases in cerebellar discharge. Brain research. 1989;476(2):307–16. doi: 10.1016/0006-8993(89)91251-1 [DOI] [PubMed] [Google Scholar]
  • 69.Smith SS, Woolley CS. Cellular and molecular effects of steroid hormones on CNS excitability. Cleveland Clinic journal of medicine. 2004;71(2):S4. [DOI] [PubMed] [Google Scholar]
  • 70.Besier TF, Lloyd DG, Cochrane JL, Ackland TR. External loading of the knee joint during running and cutting maneuvers. Med Sci Sports Exerc. 2001;33(7):1168–75. doi: 10.1097/00005768-200107000-00014 [DOI] [PubMed] [Google Scholar]
  • 71.McLean SG, Huang X, van den Bogert AJ. Association between lower extremity posture at contact and peak knee valgus moment during sidestepping: implications for ACL injury. Clin Biomech. 2005;20(8):863–70. doi: 10.1016/j.clinbiomech.2005.05.007 [DOI] [PubMed] [Google Scholar]
  • 72.Dempsey AR, Lloyd DG, Elliott BC, Steele JR, Munro BJ. Changing sidestep cutting technique reduces knee valgus loading. Am J Sport Med. 2009;37(11):2194–200. doi: 10.1177/0363546509334373 [DOI] [PubMed] [Google Scholar]
  • 73.Myer GD, Ford KR, Paterno MV, Nick TG, Hewett TE. The effects of generalized joint laxity on risk of anterior cruciate ligament injury in young female athletes. Am J Sport Med. 2008;36(6):1073–80. doi: 10.1177/0363546507313572 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Uhorchak JM, Scoville CR, Williams GN, Arciero RA, Pierre PS, Taylor DC. Risk factors associated with noncontact injury of the anterior cruciate ligament. Am J Sport Med. 2003;31(6):831–42. [DOI] [PubMed] [Google Scholar]
  • 75.Burden R, Shill A, Bishop N. Elite female athlete research: stop searching for the ‘magic P’. Experimental Physiology. 2021;106(10):2029–30. [DOI] [PubMed] [Google Scholar]
  • 76.McMillin SL, Minchew EC, Lowe DA, Spangenburg EE. Skeletal muscle wasting: the estrogen side of sexual dimorphism. American Journal of Physiology-Cell Physiology. 2022;322(1):C24–C37. doi: 10.1152/ajpcell.00333.2021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Koga H, Nakamae A, Shima Y, Iwasa J, Myklebust G, Engebretsen L, et al. Mechanisms for noncontact anterior cruciate ligament injuries knee joint kinematics in 10 injury situations from female team handball and basketball. Am J Sport Med. 2010;38(11):2218–25. doi: 10.1177/0363546510373570 [DOI] [PubMed] [Google Scholar]
  • 78.Donnelly CJ, Lloyd DG, Elliott BC, Reinbolt JA. Optimizing whole-body kinematics to minimize valgus knee loading during sidestepping: implications for ACL injury risk. J Biomech. 2012;45(8):1491–7. doi: 10.1016/j.jbiomech.2012.02.010 [DOI] [PubMed] [Google Scholar]
  • 79.Jones PA, Herrington LC, Munro AG, Graham-Smith P. Is there a relationship between landing, cutting, and pivoting tasks in terms of the characteristics of dynamic valgus? Am J Sport Med. 2014;42(9):2095–102. [DOI] [PubMed] [Google Scholar]
  • 80.Dos’ Santos T, Thomas C, Jones PA. The effect of angle on change of direction biomechanics: Comparison and inter-task relationships. J Sports Sci. 2021;39(12):2618–31. doi: 10.1080/02640414.2021.1948258 [DOI] [PubMed] [Google Scholar]
  • 81.Chinnasee C, Weir G, Sasimontonkul S, Alderson J, Donnelly C. A Biomechanical Comparison of Single-Leg Landing and Unplanned Sidestepping. Int J Sports Med. 2018;39(08):636–45. doi: 10.1055/a-0592-7422 [DOI] [PubMed] [Google Scholar]
  • 82.Kristianslund E, Krosshaug T. Comparison of drop jumps and sport-specific sidestep cutting: implications for anterior cruciate ligament injury risk screening. Am J Sport Med. 2013;41(3):684–8. [DOI] [PubMed] [Google Scholar]
  • 83.Maruyama S, Yamazaki T, Sato Y, Suzuki Y, Shimizu S, Ikezu M, et al. Relationship Between Anterior Knee Laxity and General Joint Laxity During the Menstrual Cycle. Orthopaedic Journal of Sports Medicine. 2021;9(3):2325967121993045. doi: 10.1177/2325967121993045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Runer A, di Sarsina TR, Starke V, Iltchev A, Felmet G, Braun S, et al. The evaluation of Rolimeter, KLT, KiRA and KT-1000 arthrometer in healthy individuals shows acceptable intra-rater but poor inter-rater reliability in the measurement of anterior tibial knee translation. Knee Surgery, Sports Traumatology, Arthroscopy. 2021:1–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Ganko A, Engebretsen L, Ozer H. The rolimeter: a new arthrometer compared with the KT-1000. Knee Surgery, Sports Traumatology, Arthroscopy. 2000;8(1):36–9. doi: 10.1007/s001670050008 [DOI] [PubMed] [Google Scholar]
  • 86.Pugh L, Mascarenhas R, Arneja S, Chin PY, Leith JM. Current concepts in instrumented knee-laxity testing. Am J Sport Med. 2009;37(1):199–210. doi: 10.1177/0363546508323746 [DOI] [PubMed] [Google Scholar]
  • 87.Teng PSP, Leong KF, Yi Xian Phua P, Kong PW. An exploratory study of the use of ultrasound in the measurement of anterior tibial translation under gastrocnemius muscle stimulation. Res Sports Med. 2021;29(2):103–15. doi: 10.1080/15438627.2020.1840378 [DOI] [PubMed] [Google Scholar]
  • 88.Beldame J, Mouchel S, Bertiaux S, Adam J-M, Mouilhade F, Roussignol X, et al. Anterior knee laxity measurement: comparison of passive stress radiographs Telos® and “Lerat”, and GNRB® arthrometer. Orthopaedics & Traumatology: Surgery & Research. 2012;98(7):744–50. [DOI] [PubMed] [Google Scholar]
  • 89.Costello JT, Bieuzen F, Bleakley CM. Where are all the female participants in Sports and Exercise Medicine research? Eur J Sports Sci. 2014;14(8):847–51. doi: 10.1080/17461391.2014.911354 [DOI] [PubMed] [Google Scholar]
  • 90.Cowley ES, Olenick AA, McNulty KL, Ross EZ. “Invisible Sportswomen”: The Sex Data Gap in Sport and Exercise Science Research. Women in Sport and Physical Activity Journal. 2021;29(2):146–51. [Google Scholar]
  • 91.Abt G, Boreham C, Davison G, Jackson R, Nevill A, Wallace E, et al. Power, precision, and sample size estimation in sport and exercise science research. Jounal of Sports Sciences. 2020;38(17):1933–5. doi: 10.1080/02640414.2020.1776002 [DOI] [PubMed] [Google Scholar]
  • 92.Hecksteden A, Kellner R, Donath L. Dealing with small samples in football research. Science and Medicine in Football. 2021:1–9. doi: 10.1080/24733938.2021.1978106 [DOI] [PubMed] [Google Scholar]
  • 93.Nimphius S. Exercise and sport science failing by design in understanding female athletes. Int J Sports Physiol and Perform. 2019;14(9):1157–8. doi: 10.1123/ijspp.2019-0703 [DOI] [PubMed] [Google Scholar]
  • 94.Sigward SM, Powers C. The influence of experience on knee mechanics during side-step cutting in females. Clin Biomech. 2006;21(7):740–7. doi: 10.1016/j.clinbiomech.2006.03.003 [DOI] [PubMed] [Google Scholar]
  • 95.Spiteri T, Cochrane JL, Hart NH, Haff GG, Nimphius S. Effect of strength on plant foot kinetics and kinematics during a change of direction task. Eur J Sports Sci. 2013;13(6):646–52. doi: 10.1080/17461391.2013.774053 [DOI] [PubMed] [Google Scholar]
  • 96.Orishimo KF, Liederbach M, Kremenic IJ, Hagins M, Pappas E. Comparison of landing biomechanics between male and female dancers and athletes, part 1: Influence of sex on risk of anterior cruciate ligament injury. Am J Sport Med. 2014;42(5):1082–8. doi: 10.1177/0363546514523928 [DOI] [PubMed] [Google Scholar]
  • 97.Liederbach M, Dilgen FE, Rose DJ. Incidence of anterior cruciate ligament injuries among elite ballet and modern dancers: a 5-year prospective study. Am J Sport Med. 2008;36(9):1779–88. doi: 10.1177/0363546508323644 [DOI] [PubMed] [Google Scholar]
  • 98.Cook CJ, Kilduff LP, Crewther BT. Basal and stress‐induced salivary testosterone variation across the menstrual cycle and linkage to motivation and muscle power. Scand J Med Sci Spor. 2018;28(4):1345–53. doi: 10.1111/sms.13041 [DOI] [PubMed] [Google Scholar]
  • 99.Dos’Santos T, McBurnie A, Thomas C, Comfort P, Jones PA. Biomechanical Comparison of Cutting Techniques: A Review and Practical Applications. Strength Cond J. 2019;41(4):40–54. [Google Scholar]
  • 100.Dos’ Santos T, McBurnie A, Thomas C, A. JP, Harper DJ. Attacking Agility Actions: Match Play Contextual Applications With Coaching and Technique Guidelines. Strength Cond J. 2022:Published ahead of print.
  • 101.Dos’Santos T, Thomas C, Comfort P, Jones PA. The effect of angle and velocity on change of direction biomechanics: an angle-velocity trade-off. Sports Med. 2018;48(10):2235–53. doi: 10.1007/s40279-018-0968-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102.Dos’ Santos T, Thomas C, Jones PA. How Early Should You Brake During A 180° Turn? A Kinetic Comparison Of The Antepenultimate, Penultimate, And Final Foot Contacts During A 505 Change Of Direction Speed Test. J Sports Sci. 2021;39(4):395–405. [DOI] [PubMed] [Google Scholar]
  • 103.Dos’Santos T, Thomas C, Comfort P, Jones PA. The Role of the Penultimate Foot Contact During Change of Direction: Implications on Performance and Risk of Injury. Strength Cond J. 2019;41(1):87–104. [Google Scholar]
  • 104.Brophy RH, Stepan JG, Silvers HJ, Mandelbaum BR. Defending puts the anterior cruciate ligament at risk during soccer: a gender-based analysis. Sports health. 2015;7(3):244–9. doi: 10.1177/1941738114535184 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Cochrane JL, Lloyd DG, Buttfield A, Seward H, McGivern J. Characteristics of anterior cruciate ligament injuries in Australian football. J Sci Med Sport. 2007;10(2):96–104. doi: 10.1016/j.jsams.2006.05.015 [DOI] [PubMed] [Google Scholar]
  • 106.Boden BP, Torg JS, Knowles SB, Hewett TE. Video analysis of anterior cruciate ligament injury abnormalities in hip and ankle kinematics. Am J Sport Med. 2009;37(2):252–9. doi: 10.1177/0363546508328107 [DOI] [PubMed] [Google Scholar]
  • 107.Della Villa F, Buckthorpe M, Grassi A, Nabiuzzi A, Tosarelli F, Zaffagnini S, et al. Systematic video analysis of ACL injuries in professional male football (soccer): injury mechanisms, situational patterns and biomechanics study on 134 consecutive cases. Br J Sports Med. 2020;54:1423–32. doi: 10.1136/bjsports-2019-101247 [DOI] [PubMed] [Google Scholar]
  • 108.Fox AS, Bonacci J, McLean SG, Saunders N. Exploring individual adaptations to an anterior cruciate ligament injury prevention programme. Knee. 2018;25(1):83–98. doi: 10.1016/j.knee.2017.11.011 [DOI] [PubMed] [Google Scholar]
  • 109.Cowling E, Steele J, McNair P. Training quadriceps-hamstring muscle synchrony: Do group data mask individual lower limb muscle coordination strategies? J Sci Med Sport. 2003;6(S1):90. [Google Scholar]
  • 110.Dos’Santos T, Thomas C, Comfort P, Jones PA. Biomechanical effects of a 6-week change-of-direction technique modification intervention on anterior cruciate ligament injury risk. J Strength Cond Res. 2021;35(8):2133–44. doi: 10.1519/JSC.0000000000004075 [DOI] [PubMed] [Google Scholar]
  • 111.Mendiguchia J, Conceição F, Edouard P, Fonseca M, Pereira R, Lopes H, et al. Sprint versus isolated eccentric training: Comparative effects on hamstring architecture and performance in soccer players. Plos one. 2020;15(2):e0228283. doi: 10.1371/journal.pone.0228283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 112.Dos’Santos T, McBurnie A, Comfort P, Jones PA. The Effects of Six-Weeks Change of Direction Speed and Technique Modification Training on Cutting Performance and Movement Quality in Male Youth Soccer Players. Sports. 2019;7(9):205. doi: 10.3390/sports7090205 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Weissgerber TL, Milic NM, Winham SJ, Garovic VD. Beyond bar and line graphs: time for a new data presentation paradigm. PLoS biology. 2015;13(4):e1002128. doi: 10.1371/journal.pbio.1002128 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 114.Sankey SP, Azidin RMFR, Robinson MA, Malfait B, Deschamps K, Verschueren S, et al. How reliable are knee kinematics and kinetics during side-cutting manoeuvres? Gait Posture. 2015;41(4):905–11. doi: 10.1016/j.gaitpost.2015.03.014 [DOI] [PubMed] [Google Scholar]
  • 115.Mok K-M, Bahr R, Krosshaug T. Reliability of lower limb biomechanics in two sport-specific sidestep cutting tasks. Sport Biomech. 2018;17:157–67. doi: 10.1080/14763141.2016.1260766 [DOI] [PubMed] [Google Scholar]
  • 116.Dos’Santos T. Biomechanical determinants of injury risk and performance during change of direction: implications for screening and intervention: University of Salford; 2020. [Google Scholar]
  • 117.Mullineaux DR, Bartlett RM, Bennett S. Research design and statistics in biomechanics and motor control. J Sports Sci. 2001;19(10):739–60. doi: 10.1080/026404101317015410 [DOI] [PubMed] [Google Scholar]
  • 118.Hashemi J, Breighner R, Chandrashekar N, Hardy DM, Chaudhari AM, Shultz SJ, et al. Hip extension, knee flexion paradox: a new mechanism for non-contact ACL injury. J Biomech. 2011;44(4):577–85. doi: 10.1016/j.jbiomech.2010.11.013 [DOI] [PubMed] [Google Scholar]
  • 119.Welch N, Richter C, Franklyn-Miller A, Moran K. Principal Component Analysis of the Biomechanical Factors Associated With Performance During Cutting. J Strength Cond Res. 2021;35(6):1715–23. doi: 10.1519/JSC.0000000000003022 [DOI] [PubMed] [Google Scholar]
  • 120.Mullineaux DR, Wheat J. Research methods: sample size and varaibility effects on statistical power. In: Payton CJ, Burden A, editors. Biomechanical Evaluation of Movement in Sport and Exercise: The British Association of Sport and Exercise Sciences Guide: Routledge; 2017. [Google Scholar]
  • 121.Robinson MA, Vanrenterghem J, Pataky TC. Statistical Parametric Mapping (SPM) for alpha-based statistical analyses of multi-muscle EMG time-series. J Electromyogr Kines. 2015;25(1):14–9. doi: 10.1016/j.jelekin.2014.10.018 [DOI] [PubMed] [Google Scholar]
  • 122.Pataky TC, Robinson MA, Vanrenterghem J, Savage R, Bates KT, Crompton RH. Vector field statistics for objective center-of-pressure trajectory analysis during gait, with evidence of scalar sensitivity to small coordinate system rotations. Gait Posture. 2014;40(1):255–8. doi: 10.1016/j.gaitpost.2014.01.023 [DOI] [PubMed] [Google Scholar]
  • 123.Pataky TC, Robinson MA, Vanrenterghem J. Vector field statistical analysis of kinematic and force trajectories. J Biomech. 2013;46(14):2394–401. doi: 10.1016/j.jbiomech.2013.07.031 [DOI] [PubMed] [Google Scholar]
  • 124.Pataky TC. Generalized n-dimensional biomechanical field analysis using statistical parametric mapping. J Biomech. 2010;43(10):1976–82. doi: 10.1016/j.jbiomech.2010.03.008 [DOI] [PubMed] [Google Scholar]
  • 125.Preatoni E, Hamill J, Harrison AJ, Hayes K, Van Emmerik REA, Wilson C, et al. Movement variability and skills monitoring in sports. Sport Biomech. 2013;12(2):69–92. doi: 10.1080/14763141.2012.738700 [DOI] [PubMed] [Google Scholar]
  • 126.Brown C, Bowser B, Simpson KJ. Movement variability during single leg jump landings in individuals with and without chronic ankle instability. Clin Biomech. 2012;27(1):52–63. doi: 10.1016/j.clinbiomech.2011.07.012 [DOI] [PubMed] [Google Scholar]
  • 127.Stergiou N, Harbourne RT, Cavanaugh JT. Optimal movement variability: a new theoretical perspective for neurologic physical therapy. Journal of Neurologic Physical Therapy. 2006;30(3):120–9. doi: 10.1097/01.npt.0000281949.48193.d9 [DOI] [PubMed] [Google Scholar]
  • 128.Richter C, Marshall B, Moran K. Comparison of discrete-point vs. dimensionality-reduction techniques for describing performance-related aspects of maximal vertical jumping. J Biomech. 2014;47(12):3012–7. doi: 10.1016/j.jbiomech.2014.07.001 [DOI] [PubMed] [Google Scholar]
  • 129.Richter C, O’Connor NE, Marshall B, Moran K. Analysis of characterizing phases on waveforms: an application to vertical jumps. Journal of applied biomechanics. 2014;30(2):316–21. [DOI] [PubMed] [Google Scholar]
  • 130.Vanrenterghem J, Venables E, Pataky T, Robinson MA. The effect of running speed on knee mechanical loading in females during side cutting. J Biomech. 2012;45(14):2444–9. doi: 10.1016/j.jbiomech.2012.06.029 [DOI] [PubMed] [Google Scholar]
  • 131.Robinson MA, Donnelly CJ, Tsao J, Vanrenterghem J. Impact of knee modeling approach on indicators and classification of ACL injury risk. Med Sci Sports Exerc. 2013;46:1269–76. [DOI] [PubMed] [Google Scholar]
  • 132.Franklyn-Miller A, Richter C, King E, Gore S, Moran K, Strike S, et al. Athletic groin pain (part 2): a prospective cohort study on the biomechanical evaluation of change of direction identifies three clusters of movement patterns. Br J Sports Med. 2017;51(5):460–8. doi: 10.1136/bjsports-2016-096050 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 133.McMahon JJ, Rej SJE, Comfort P. Sex differences in countermovement jump phase characteristics. Sports. 2017;5(1):8. doi: 10.3390/sports5010008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 134.Cormie P, McBride JM, McCaulley GO. Power-time, force-time, and velocity-time curve analysis of the countermovement jump: impact of training. J Strength Cond Res. 2009;23(1):177–86. doi: 10.1519/JSC.0b013e3181889324 [DOI] [PubMed] [Google Scholar]
  • 135.McMahon JJ, Murphy S, Rej SJE, Comfort P. Countermovement jump phase characteristics of senior and academy rugby league players. Int J Sports Physiol and Perform. 2017;12(6):803–11. doi: 10.1123/ijspp.2016-0467 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Kristian Samuelsson

1 Sep 2022

PONE-D-22-07730

Effects of The Menstrual Cycle Phase on Anterior Cruciate Ligament Neuromuscular and Biomechanical Injury Risk Surrogates in Eumenorrheic and Naturally Menstruating Women: A Systematic Review and Recommendations for Future Research

PLOS ONE

Dear Dr. Dos'Santos,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Oct 07 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Kristian Samuelsson, MD, PhD, MSc

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf".

2. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In the manuscript ‘’Effects of The Menstrual Cycle Phase on Anterior Cruciate Ligament Neuromuscular and Biomechanical Injury Risk Surrogates in Eumenorrheic and Naturally Menstruating Women: A Systematic Review and Recommendations for Future Research’’, the authors attempted to address whether the menstrual cycle has an impact on the neuromuscular and biomechanical risk surrogates of ACL injury patients. Furthermore, the authors also provided comments on the current literature and propose suggestions for future research on the menstrual cycle and ACL injuries.

Although the manuscript may be of interest for the readers of PLOS ONE, it suffers some important issues.

General comments:

The manuscript is written with a high standard of English language. This promotes good readability and a general flow. Moreover, the article adheres to appropriate reporting guidelines for the current systematic review as it was conducted according to the PRISMA protocol. However, the manuscript in its current form is too long and there are some concerns with regards to reporting of the results.

Specific comments:

Title page

1. The title of the article is somewhat long, perhaps it would be useful to shorten it, for example: ‘’Effects of the menstrual cycle phase on anterior cruciate ligament injury risk surrogates in menstruating women: a systematic review’’.

2. Line 20: please change ‘’1 figures’’ to ‘’1 figure’’.

Abstract

1. Lines 43-48, it would be helpful to add which quality assessment tool(s) was used for the included studies of the systematic review. This could also be added to the last sentence of the results section (line 53) where the overall study quality of included studies is presented.

2. In the background, only the primary aim of the study is provided while in the conclusion, both the primary and secondary aims are listed. The background and the conclusion section should match in the abstract.

Introduction

1. The first, second, third and fourth paragraph of the introduction are some general aspects of ACL injuries which are already well known. These paragraphs may perhaps be removed from the manuscript so that the focus lies on the menstrual cycle and its relationship to ACL injuries.

2. Lines 171-75, the primary objective of the manuscript is provided twice although in different forms. I would suggest that the question ‘’does the way women perform the aforementioned high-risk manoeuvres predispose them to potentially greater non-contact ACL injury risk based on neuromuscular and biomechanical surrogates of non-contact ACL injury risk at a particular MC stage?’’ is removed from this paragraph.

Methods

1. Line 179 – the study protocol was not pre-registered, however – were the review methods established prior to the conduct of the review? Clarifying this to the reader would be helpful.

2. Table 1. The authors use references in the PICOS section, which in my opinion is not necessary. In the last row, the authors provide the data that was extracted. Was the data extraction process performed in duplicate?

3. Line 230 – it is stated that all studies in this review were observational although in Table 1 ‘’study design’’ only experimental studies were included. I believe that these 2 study designs are not equivalent to each other as observational studies can for instance be cohort studies while experimental studies can be performed in laboratories.

Results

1. Line 243 – it appears as if the table numbers have been written in the wrong order as table 2 includes the quality assessment according to Downs and Black checklist and not the study characteristics. Please revise the order of the tables. Additionally, it is stated that the sample sizes ranged from 10-28 although one study (Shultz et al.) had a sample size of 71 which leads to a range of 10-71.

2. Line 290-297 – the a-priori quality should be provided first, followed by the revised quality scores/quality evidence, i.e. the Downs and Black checklist scores, followed by the GRADE.

Table 3

1. The table includes valuable information of the study designs but is somewhat big, perhaps divide this table into 2 separate ones?

Discussion

1. The discussion in its current form is too long. For example, each paragraph includes detailed information on specific studies, perhaps these could be shortened?

2. The discussion section refers to the included tables of the manuscript which should be removed, for instance see line 335.

3. A comment on the revised Downs and Black checklist used in the current manuscript would be welcomed, is it validated for instance?

4. The discussion section is currently lacking a strength/limitation section of the methodology applied in the systematic review.

5. A short paragraph addressing the biochemical analyses and ovulation kits used to determine the phase of the menstrual cycle of included studies would be valuable to the manuscript.

Author contributions

The author contributions are stated in the methods section as all in the author contribution section, perhaps these could be listed in only one paragraph?

Reviewer #2: Dear authors,

As a reviewer, I appreciate your scientific efforts in elaborating the topic of the submitted study. The topic of the study is interesting und not well studied so far. The reviewer believes that the submitted study is of interest to the readership of PLOS ONE. However, there are several limitations that should be addressed before the study can be considered for publication in PLOS ONE.

The main limitations / revisions needed are as follows:

-The clinical relevance of the study needs to be highlighted. Why is this study needed and how is this study useful in daily clinical practice / research.

- Data analysis is poorly described and quantitative data were rarely reported. This can be done better.

-The manuscript is well written. However, the manuscript is far too long and needs to be shortened.

Title

The reviewer recommends to delete “and recommendations for future research”.

Abstract

Background: Adequate.

Methods: Line 48: The reviewer recommends to add one sentence about data analysis (e.g., quantitative, qualitative etc.).

Results: Line 53: Please be more specific. Provide quantitative data for “low to very low” study quality (i.e., modified Downs and Black checklist).

Conclusions: The reviewer recommends to shorten the Conclusion section of the abstract. In addition, add one sentence about the clinical relevance of this study.

Level of evidence: Is missing, please add.

Key Words: Adequate.

Introduction

Far too long. Please shorten and focus on the topic of the study. Why is this study needed? Highlight particular controversies in the introduction section. Adequate objectives. Hypothesis of the study is missing. Please add.

Line 65, 121: Define abbreviations when they are used for the first time (i.e., ACL, MC).

Material and Methods

There are several missing items in the material and methods section that should be added:

-Who performed data extraction?

-Which data were collected from each study for data synthesis?

-Statistical analysis and methods of data synthesis

Line 179-180: Why was this review not registered in advance? This is a major limitation and should be mentioned in the limitations section. This reduces the quality of the systematic review.

Line 187: It is recommended to add the full search strategy as a supplemental file.

Line 219-225: This is somewhat confusing. Based on Table 1, only “studies that verified participants’ MC phase via biochemical analysis (i.e., blood/serum analysis) and / or ovulation kits were included, in line with McNulty et al.”. Therefore, no study should have been downgraded? Please clarify.

Results

In general, it would be good to present a quantitative data synthesis. However, the studies may have been so heterogeneous that data synthesis was not possible, which is a limitation of the study. Please comment.

Discussion

The discussion section is well written. However, the discussion section is far too long. Please try to shorten. Focus on the topic of the study and highlight the clinical relevance of this study. How can the results of this study be useful in daily clinical practice?

Line 329: It is recommended to start the discussion section as follows: “The most important finding of this study was …”

Conclusion

Far too long. Please shorten. In the conclusion section, the authors should “conclude” their findings in 2-5 sentences. In addition, the clinical relevance of the study should be highlighted. Moreover, it is recommended to delete quotations (both for references and tables) in the conclusion section.

Figures

Figure 1: Adequate.

Tables

Table 1: How did the authors confirm that the women were eumenorrheic? Please clarify.

Table 1: Please be more specific and define biomechanical and/or neuromuscular surrogates.

Table 2: Adequate.

Table 3: Adequate.

Table 4 + 5: Exhaustive and busy table. Try to shorten.

References

Adequate.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Jan 26;18(1):e0280800. doi: 10.1371/journal.pone.0280800.r002

Author response to Decision Letter 0


21 Sep 2022

General comments:

The manuscript is written with a high standard of English language. This promotes good readability and a general flow. Moreover, the article adheres to appropriate reporting guidelines for the current systematic review as it was conducted according to the PRISMA protocol. However, the manuscript in its current form is too long and there are some concerns with regards to reporting of the results.

Response: Thank you for your comment. We have done our best to reduce the word count, reducing the word count overall from 6777 words to 5728. This has included some extra additions in the methods and discussion as your requests and reviewer 2.

Specific comments:

Title page

1. The title of the article is somewhat long, perhaps it would be useful to shorten it, for example: ‘’Effects of the menstrual cycle phase on anterior cruciate ligament injury risk surrogates in menstruating women: a systematic review’’.

Response: Thank you for your comment. We agree that it is slightly long; however, we believe it is more appropriate and important to use the scientific terminology as recommended by Elliott-Sale et al. (2021) to specifically provide context regarding the reproductive profiles of the women of this systematic review (i.e., Eumenorrheic and Naturally Menstruating). Moreover, there are a plethora of different ACL risk factors and surrogates; however, we are reluctant to remove the terms “neuromuscular and biomechanical” because we feel the inclusion of there terms provides more context and scope for the systematic review. However, in light of your comment and R2’s, we have removed the term “and recommendations for future research” from the title.

2. Line 20: please change ‘’1 figures’’ to ‘’1 figure’’.

Response: Thank you for your comment. This has been amended.

Abstract

1. Lines 43-48, it would be helpful to add which quality assessment tool(s) was used for the included studies of the systematic review. This could also be added to the last sentence of the results section (line 53) where the overall study quality of included studies is presented.

Response: Thank you for your comment. This has been amended. Please see line 50-53 and 58.

2. In the background, only the primary aim of the study is provided while in the conclusion, both the primary and secondary aims are listed. The background and the conclusion section should match in the abstract.

Response: Thank you for your comment. This has been amended where we have added a brief indication of the secondary aim. Please see line 42.

Introduction

1. The first, second, third and fourth paragraph of the introduction are some general aspects of ACL injuries which are already well known. These paragraphs may perhaps be removed from the manuscript so that the focus lies on the menstrual cycle and its relationship to ACL injuries.

Response: Thank you for your comment. We have reduced the introduction by 2 paragraphs / 451 words (1780 to 1329 words) and we hope that the introduction is more concise. We decided that the content related to the biomechanical and neuromuscular risk factors should stay, given the importance of these risk factors on potential mechanical loads and the fact that these risk factors were the inclusion criteria for the systematic review, thus providing context for the reader.

2. Lines 171-75, the primary objective of the manuscript is provided twice although in different forms. I would suggest that the question ‘’does the way women perform the aforementioned high-risk manoeuvres predispose them to potentially greater non-contact ACL injury risk based on neuromuscular and biomechanical surrogates of non-contact ACL injury risk at a particular MC stage?’’ is removed from this paragraph.

Response: Thank you for your comment. This has been amended and we have removed your suggested sentence. Please see line xx.

Methods

1. Line 179 – the study protocol was not pre-registered, however – were the review methods established prior to the conduct of the review? Clarifying this to the reader would be helpful.

Response: Thank you for your comment. This has been amended and we have added the following: however, the review methods were established prior to conducting the review. Please see line 153.

2. Table 1. The authors use references in the PICOS section, which in my opinion is not necessary. In the last row, the authors provide the data that was extracted. Was the data extraction process performed in duplicate?

Response: Thank you for your comment. With respect, would still like to include the references in table 1. We feel the inclusion of references further supports and justifies the PICOS strategy for specific population, method, comparator, or outcome criteria. Yes, performed in duplicate. This is added on Line 182.

3. Line 230 – it is stated that all studies in this review were observational although in Table 1 ‘’study design’’ only experimental studies were included. I believe that these 2 study designs are not equivalent to each other as observational studies can for instance be cohort studies while experimental studies can be performed in laboratories.

Response: Thank you for your comment. Apologies for this error. This has been amended.

Results

1. Line 243 – it appears as if the table numbers have been written in the wrong order as table 2 includes the quality assessment according to Downs and Black checklist and not the study characteristics. Please revise the order of the tables. Additionally, it is stated that the sample sizes ranged from 10-28 although one study (Shultz et al.) had a sample size of 71 which leads to a range of 10-71.

Response: Thank you for your comment. Apologies, this has been amended. Please see line 225-228.

2. Line 290-297 – the a-priori quality should be provided first, followed by the revised quality scores/quality evidence, i.e. the Downs and Black checklist scores, followed by the GRADE.

Response: Thank you for your comment. This has been amended in light of your suggestions. Please see line 274-280.

Table 3

1. The table includes valuable information of the study designs but is somewhat big, perhaps divide this table into 2 separate ones?

Response: Thank you for your comment. While it is a quite a large table, we feel it is best to contain all of this information in one table so all information is collated in one area and table. If accepted, the journal publishers can also format the table to aid with clarity.

Discussion

1. The discussion in its current form is too long. For example, each paragraph includes detailed information on specific studies, perhaps these could be shortened?

Response: Thank you for your comment. We have done our best to reduce the word count of the discussion. As such, we have reduced the length by 742 words, from 2882 to 2140 words.

2. The discussion section refers to the included tables of the manuscript which should be removed, for instance see line 335.

Response: Thank you for your comment. References to tables have been removed in the discussion.

3. A comment on the revised Downs and Black checklist used in the current manuscript would be welcomed, is it validated for instance?

Response: Thank you for your comment. We have commented on this on line 455.

4. The discussion section is currently lacking a strength/limitation section of the methodology applied in the systematic review.

Response: Thank you for your comment. We have added a small paragraph regarding the strength and limitations. Please see line 454-459.

5. A short paragraph addressing the biochemical analyses and ovulation kits used to determine the phase of the menstrual cycle of included studies would be valuable to the manuscript.

Response: Thank you for your comment. We are conscious of the word count and are, with respect, reluctant to include further information. We do briefly discuss which studies used biochemical analysis / ovulation kits in the results section (line 249-251) and information is also presented in Table 4.

Author contributions

The author contributions are stated in the methods section as all in the author contribution section, perhaps these could be listed in only one paragraph?

Response: Thank you for your comment. Unfortunately, we do not fully understand this comment. We have followed the author contributions guidance as per PlosOne journal specifications.

Reviewer #2: Dear authors,

As a reviewer, I appreciate your scientific efforts in elaborating the topic of the submitted study. The topic of the study is interesting und not well studied so far. The reviewer believes that the submitted study is of interest to the readership of PLOS ONE. However, there are several limitations that should be addressed before the study can be considered for publication in PLOS ONE.

The main limitations / revisions needed are as follows:

-The clinical relevance of the study needs to be highlighted. Why is this study needed and how is this study useful in daily clinical practice / research.

- Data analysis is poorly described and quantitative data were rarely reported. This can be done better.

-The manuscript is well written. However, the manuscript is far too long and needs to be shortened.

Response: Thank you for your comments. In the introduction, we high highlighted the clinical relevance of this study. Please see lines 142-145 and 151-153. We have now added a data analysis collations section. Please see line 212-217. We have done our best to reduce the word count, reducing the word count overall from 6777 words to 5728. This has included some extra additions in the methods and discussion as your requests and reviewer 1. We have reduced the introduction by 2 paragraphs / 451 words (1780 to 1329 words) and we hope that the introduction is more concise. Additionally, we have reduced the length of the discussion by 742 words, from 2882 to 2140 words.

Title

The reviewer recommends to delete “and recommendations for future research”.

Response: Thank you for your comment. This has been amended.

Abstract

Background: Adequate.

Methods: Line 48: The reviewer recommends to add one sentence about data analysis (e.g., quantitative, qualitative etc.).

Response: Thank you for your comment. This has been amended. We have added the following on line 49: “Quantitative data pertaining to study methodology, participant, MC phase and verification, ACL injury risk surrogates, reliability measures, and results were obtained for qualitative analysis.”

Results: Line 53: Please be more specific. Provide quantitative data for “low to very low” study quality (i.e., modified Downs and Black checklist).

Response: Thank you for your comment. This has been amended. Please see line 58 where we state the following: “Study quality and quality of evidence was low to very low (7-9 Modified Downs and Black Checklist score 7-9; and GRADE).”

Conclusions: The reviewer recommends to shorten the Conclusion section of the abstract. In addition, add one sentence about the clinical relevance of this study.

Response: Thank you for your comment. Due to the extensive nature of this systematic review, and complexities and caveats with the evaluation of the literature, we believe is an inappropriate to try and summarise this in one sentence. Previous systematic reviews have used multiple sentences in the abstract conclusion when contextualising their findings. Please see McNulty et al. 2021 and Somerson et al. 2019 in our reference list. We have amended some sentences to further highlight the clinical relevance of our review findings. Please see line 60-66.

Level of evidence: Is missing, please add.

Response: Thank you for your comment. This has been added. Please see line 67.

Key Words: Adequate.

Introduction

Far too long. Please shorten and focus on the topic of the study. Why is this study needed? Highlight particular controversies in the introduction section. Adequate objectives. Hypothesis of the study is missing. Please add.

Response: Thank you for your comments. In the introduction, we high highlighted the clinical relevance of this study. Please see lines 142-145 and 151-153. We have reduced the introduction by 2 paragraphs / 451 words (1780 to 1329 words) and we hope that the introduction is more concise.

Hypotheses have also been added. Please see line 151: “It was hypothesised that differences in neuromuscular and biomechanical injury risk surrogates would be observed between MC phases in eumenorrheic and naturally menstruating women.”

Line 65, 121: Define abbreviations when they are used for the first time (i.e., ACL, MC).

Response: Thank you for your comment. This has been added. Please see line 69 and 96.

Material and Methods

There are several missing items in the material and methods section that should be added:

-Who performed data extraction?

-Which data were collected from each study for data synthesis?

-Statistical analysis and methods of data synthesis

Response: Thank you for your comment. We have now added a data collation section (2.4) which provides information pertaining to data extraction and specific data. No statistical analysis / meta-analysis was performed due to the heterogeneity in methodology and outcome measures.

Line 179-180: Why was this review not registered in advance? This is a major limitation and should be mentioned in the limitations section. This reduces the quality of the systematic review.

Response: Thank you for your comment. In hindsight, we should have registered the review. We have acknowledged this as a limitation. Please see line 460.

Line 187: It is recommended to add the full search strategy as a supplemental file.

Response: Thank you for your comment. The full search strategy is provided on line 173.

Line 219-225: This is somewhat confusing. Based on Table 1, only “studies that verified participants’ MC phase via biochemical analysis (i.e., blood/serum analysis) and / or ovulation kits were included, in line with McNulty et al.”. Therefore, no study should have been downgraded? Please clarify.

Response: Thank you for your comment. Yes, if they failed to do blood samples but used an ovulation kit, they were downgraded. Likewise, if they used a blood sample but no ovulation kits, then again, they were downgraded. Thus, to maintain their rating, they had to do both. This was the case for study 1, 2, 3, and 7 which were downgraded.

Results

In general, it would be good to present a quantitative data synthesis. However, the studies may have been so heterogeneous that data synthesis was not possible, which is a limitation of the study. Please comment.

Response: Thank you for your comment. Yes, we have now included a data collation section (2.4) and have acknowledged that that the data and methodologies were heterogeneous which precluded a meta-analysis. Please see line 281 and 460.

Discussion

The discussion section is well written. However, the discussion section is far too long. Please try to shorten. Focus on the topic of the study and highlight the clinical relevance of this study. How can the results of this study be useful in daily clinical practice?

Response: Thank you for your comment. We have reduced the length of the discussion by 742 words, from 2882 to 2140 words. We have further highlighted the clinical relevance in certain sections. Please see lines 345-347, 398, 439-442. However, because of the low quality of evidence and methodological quality, this review is primarily highlighting the future directions of research and methodological approaches to improve research quality and data to increase our understanding of the menstrual cycle on ACL injury risk.

Line 329: It is recommended to start the discussion section as follows: “The most important finding of this study was …”

Response: Thank you for your comment. This has been amended. Please see line 305.

Conclusion

Far too long. Please shorten. In the conclusion section, the authors should “conclude” their findings in 2-5 sentences. In addition, the clinical relevance of the study should be highlighted. Moreover, it is recommended to delete quotations (both for references and tables) in the conclusion section.

Response: Thank you for your comment. We have reduced the length from 489 to 277 words and have removed quotations and references.

Figures

Figure 1: Adequate.

Tables

Table 1: How did the authors confirm that the women were eumenorrheic? Please clarify.

This was based on the methodologies reported by the research group and interpreted according to the definition presented by Elliott-Sale et al. 2021 for eumenorrheic classification.

Table 1: Please be more specific and define biomechanical and/or neuromuscular surrogates.

Response: Thank you for your comment. This has been added.

Table 2: Adequate.

Table 3: Adequate.

Table 4 + 5: Exhaustive and busy table. Try to shorten.

Response: Thank you for your comment. We feel these are critical tables for the systematic review and contain relevant and highly important information. In particular, Table 5 is central for highlighting the limitations and recommended areas for future research to improve research quality in this topic area. As such, with respect, we would like to keep the tables as they are.

References

Adequate.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Javier Peña

24 Oct 2022

PONE-D-22-07730R1Effects of The Menstrual Cycle Phase on Anterior Cruciate Ligament Neuromuscular and Biomechanical Injury Risk Surrogates in Eumenorrheic and Naturally Menstruating Women: A Systematic ReviewPLOS ONE

Dear Dr. Dos'Santos,Thank you for submitting your manuscript to PLOS ONE. After receiving a new report from two external reviewers, both consider that your manuscript needs further revision. 

However, the opinion about the current version of the text is not uniform in both cases. Thus, after carefully reading the comments, I have recommended a major revision of the text. Please review all comments in detail and solve all the doubts raised about the content of your article

Please submit your revised manuscript by Dec 08 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Javier Peña, Ph.D.

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Abstract:

On line 59, please change (7-9 Modified Downs and Black Checklist score 7-9; and GRADE) so that it is understandable which score corresponds to which quality assessment/grading tool.

Line 65-66 – remove this sentence as it does not add additional value to the conclusion section.

Methods:

In table I ‘’study design’’, please change experimental to clinical or human.

Who performed the literature search in PubMed, Medline (OVID), SPORTDiscus, and Web of Science databases?

Line 169, please add the reference to the guideline that was used.

Results

I would recommend that ‘’statistically’’ is removed from ‘’no statistically significant’’ on line 255. Furthermore, what does ‘’meaningful difference’’ refer to on line 255?

Discussion

The sentence on line 305-308 is very long, I would suggest that the sentence is divided into two.

Please remove reference to table on line 454.

Line 461 – please add which type of bias(es) the review was subjected to.

Conclusion

The conclusion section is far too long. It needs to be shortened.

Reviewer #2: Dear authors,

The first revision substantially improved the quality of the study. However, the biggest limitation of the manuscript is that it is still far too long. In particular, the introduction, discussion, and conclusion sections need to be shortened. The authors should focus on the most important and at the same time clinically relevant topics. A better structure and shorter version would significantly improve the study and maintain the excitement of reading throughout the entire manuscript. The reviewer recommends that the aforementioned limitations be addressed before the study can be considered for publication in PLOS ONE.

See the detailed comments on each section below.

Title

Much better now. Adequate title.

Abstract

According to the submission guidelines (https://journals.plos.org/plosone/s/submission-guidelines), the abstract should not exceed 300 words. In the current version, the abstract has more than 400 words. Please shorten the abstract and focus on the most important information.

Background: Adequate.

Methods: Line 50-53: In order to shorten the abstract, the authors consider to delete this information from the abstract. However, this information is of utmost importance in the main manuscript.

Results: Adequate.

Conclusions: Despite the response of the authors, the conclusion is still too long. Try to shorten.

Introduction

The introduction is far too long. This was already mentioned by both reviewers in the first review. Try to shorten the introduction to no more than 500 words.

Line 69-86: The information in the first paragraph is well known. The authors should summarize the most important information regarding the submitted systematic review in 1-2 sentences or consider deleting the first paragraph.

Line 87-98: This paragraph is a good introduction into the topic of the systematic review.

Line 109-111: Consider to delete this part.

Material and Methods

The authors did a good job on revising the materials and methods section. No further comments.

Results

The authors may shorten the results section. Try to avoid repetitions between tables and written text.

Moreover, the authors did a good job on revising the results section. No more comments.

Discussion

The discussion section is still far too long. It is not intended to report all studies of the research topic and their results. Rather, a discussion / interpretation of the most important findings of the systematic review with already existing literature should be performed. Controversies should be discussed and clinically relevant results highlighted.

Conclusion

The conclusion section is still too long. The authors should shorten the conclusion and focus on the most significant and clinically relevant findings.

Line 480-486: The reviewer recommends to move this part to the discussion section.

Figures + Tables

No further comments.

References

No further comments.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Re-revision Horvath.docx

PLoS One. 2023 Jan 26;18(1):e0280800. doi: 10.1371/journal.pone.0280800.r004

Author response to Decision Letter 1


5 Dec 2022

Re-review of revised manuscript ‘’Effects of The Menstrual Cycle Phase on Anterior Cruciate Ligament Neuromuscular and Biomechanical Injury Risk Surrogates in Eumenorrheic and Naturally Menstruating Women: A Systematic Review and Recommendations for Future Research’’, Dos’Santos et al.

Reviewer: Alexandra Horvath, PONE-D-22-07730R1

Abstract:

On line 59, please change (7-9 Modified Downs and Black Checklist score 7-9; and GRADE) so that it is understandable which score corresponds to which quality assessment/grading tool.

Response: Thank you for your comment. In a previous round of revisions, we were told to include this. Both of these tools use descriptors to classify the evidence as low or very low.

Line 65-66 – remove this sentence as it does not add additional value to the conclusion section.

Response: Thank you for your comment. This has been removed.

Methods:

In table I ‘’study design’’, please change experimental to clinical or human.

Response: Thank you for your comment. This has been amended.

Who performed the literature search in PubMed, Medline (OVID), SPORTDiscus, and Web of Science databases?

Response: Thank you for your comment. This has been added. Please see line 117.

Line 169, please add the reference to the guideline that was used.

Response: Thank you for your comment. This has been added. Please see line 119.

Results

I would recommend that ‘’statistically’’ is removed from ‘’no statistically significant’’ on line 255. Furthermore, what does ‘’meaningful difference’’ refer to on line 255?

Response: Thank you for your comment. This has been removed throughout the document. Please see line section 3. Meaningful is a term to denote inferences regarding the magnitude of differences, as suggested by Will Hopkins https://www.sportsci.org/jour/05/ambwgh.htm For instance, there may indeed be significant differences observed; however, the magnitude of the differences (i.e., effect size) may be trivial / small and thus not practically or clinically meaningful. Conversely, you may observe no significant differences; however, a practically or clinically meaningful effect size could be observed. As such, we would like to keep the term “meaningful” in the manuscript.

Discussion

The sentence on line 305-308 is very long, I would suggest that the sentence is divided into two.

Response: Thank you for your comment. This has been amended to two sentences.

Please remove reference to table on line 454.

Response: Thank you for your comment. This has been removed.

Line 461 – please add which type of bias(es) the review was subjected to.

Response: Thank you for your comment. This has been added. Please see line 354-356.

Conclusion

The conclusion section is far too long. It needs to be shortened.

Response: Thank you for your comment. This has been reduced from 277 to 186 words

Reviewer #2: Dear authors,

The first revision substantially improved the quality of the study. However, the biggest limitation of the manuscript is that it is still far too long. In particular, the introduction, discussion, and conclusion sections need to be shortened. The authors should focus on the most important and at the same time clinically relevant topics. A better structure and shorter version would significantly improve the study and maintain the excitement of reading throughout the entire manuscript. The reviewer recommends that the aforementioned limitations be addressed before the study can be considered for publication in PLOS ONE.

See the detailed comments on each section below.

Title

Much better now. Adequate title.

Response: Thank you for your comment.

Abstract

According to the submission guidelines (https://journals.plos.org/plosone/s/submission-guidelines), the abstract should not exceed 300 words. In the current version, the abstract has more than 400 words. Please shorten the abstract and focus on the most important information.

Response: Thank you for your comment. This has been reduced from 402 to 300 words.

Background: Adequate.

Methods: Line 50-53: In order to shorten the abstract, the authors consider to delete this information from the abstract. However, this information is of utmost importance in the main manuscript.

Response: Thank you for your comment and suggestion. This has been amended.

Results: Adequate.

Response: Thank you for your comment.

Conclusions: Despite the response of the authors, the conclusion is still too long. Try to shorten.

Response: Thank you for your comment. This has been reduced from 90 to 74 words.

Introduction

The introduction is far too long. This was already mentioned by both reviewers in the first review. Try to shorten the introduction to no more than 500 words.

Response: Thank you for your comment. We have amended the introduction, removing two main paragraphs and therefore have 4 short paragraphs. As such, the word count is now 691 words, having previously been 1329 words. We have done our best to remove all unnecessary information but feel the remaining content must remain in the introduction to provide an appropriate background and context. Overall, the word count is quite short for an introduction, and the total word count is 4102 words which I am sure you agree is low for a systematic review.

Line 69-86: The information in the first paragraph is well known. The authors should summarize the most important information regarding the submitted systematic review in 1-2 sentences or consider deleting the first paragraph.

Response: Thank you for your comment. We have deleted this first paragraph.

Line 87-98: This paragraph is a good introduction into the topic of the systematic review.

Response: Thank you for your comment. We have started from here. Please see line 61.

Line 109-111: Consider to delete this part.

Response: Thank you for your comment. We have deleted this.

Material and Methods

The authors did a good job on revising the materials and methods section. No further comments.

Response: Thank you for your comment.

Results

The authors may shorten the results section. Try to avoid repetitions between tables and written text.

Moreover, the authors did a good job on revising the results section. No more comments.

Response: Thank you for your comment. We have removed ~220 words, reducing the word count from 886 words to 664 words.

Discussion

The discussion section is still far too long. It is not intended to report all studies of the research topic and their results. Rather, a discussion / interpretation of the most important findings of the systematic review with already existing literature should be performed. Controversies should be discussed and clinically relevant results highlighted.

Response: Thank you for your comment. We have removed ~700 words from the discussion, reducing the word count 2142 words to 1375 words, leaving the most clinically relevant results and applications.

Conclusion

The conclusion section is still too long. The authors should shorten the conclusion and focus on the most significant and clinically relevant findings. Line 480-486: The reviewer recommends to move this part to the discussion section.

Response: Thank you for your comment. This has been reduced from 277 to 185 words.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Javier Peña

10 Jan 2023

Effects of The Menstrual Cycle Phase on Anterior Cruciate Ligament Neuromuscular and Biomechanical Injury Risk Surrogates in Eumenorrheic and Naturally Menstruating Women: A Systematic Review

PONE-D-22-07730R2

Dear Dr. Dos'Santos,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Javier Peña, Ph.D.

Academic Editor

PLOS ONE

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Re-revision of revised manuscript ‘’Effects of The Menstrual Cycle Phase on Anterior Cruciate Ligament Neuromuscular and Biomechanical Injury Risk Surrogates in Eumenorrheic and Naturally Menstruating Women: A Systematic Review and Recommendations for Future Research’’, Dos’Santos et al.

I have no further comments to add.

Reviewer #2: Dear authors,

The second revision substantially improved the quality of the study. The systematic review is well done and interesting. The reviewer recommends that the manuscript be accepted for publication in PLOS ONE in its current form.

Title

Adequate.

Abstract

The abstract in its revised version is good.

Introduction

The authors did a good job in revising the introduction section. The authors make a good introduction into the topic of the systematic review! Adequate objective. Adequate hypothesis. No further comments.

Material and Methods

No further comments.

Results

The authors did a good job in revising the results section. No further comments.

Discussion

The authors did a good job in revising the discussion section. No further comments.

Conclusion

No further comments.

Figures + Tables

No further comments.

References

No further comments.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Attachment

Submitted filename: Re-revision Horvath .docx

Acceptance letter

Javier Peña

17 Jan 2023

PONE-D-22-07730R2

Effects of The Menstrual Cycle Phase on Anterior Cruciate Ligament Neuromuscular and Biomechanical Injury Risk Surrogates in Eumenorrheic and Naturally Menstruating Women: A Systematic Review

Dear Dr. Dos'Santos:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Javier Peña

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Checklist. PRISMA 2020 checklist.

    (TIF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Re-revision Horvath.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Re-revision Horvath .docx

    Data Availability Statement

    The data within this study are secondary data and available through the relevant articles referenced throughout. This is a systematic review, and thus, there is no data to provide.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES