Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Oct 14;16(10):e0258307. doi: 10.1371/journal.pone.0258307

Does mental fatigue affect skilled performance in athletes? A systematic review

He Sun 1,*, Kim Geok Soh 1,*, Samsilah Roslan 2, Mohd Rozilee Wazir Norjali Wazir 1, Kim Lam Soh 3
Editor: Daniel Boullosa4
PMCID: PMC8516214  PMID: 34648555

Abstract

Background

Mental fatigue is a psychobiological state induced by a prolonged duration of demanding cognitive tasks. The effects of mental fatigue on physical performance have been well investigated in the literature. However, the effect of mental fatigue on skilled performance in sports remains unclear.

Objective

This study aimed to report a comprehensive systematic review investigating the carryover effects of mental fatigue on skilled performance among athletes.

Methods

A thorough search was conducted on PubMed, Web of Science, EBSCOhost (CENTRAL, SPORTDicus), and Scopus to select relevant literature, as well as on Google Scholar and sources of reference for grey literature. The selected literatures are centred on a mental fatigue protocol in which cognitive tasks are performed prior to athletic tasks. Only studies that used an experimental design to test two conditions, namely mental fatigue and non-mental fatigue, were selected.

Results

Eleven articles were chosen based on the selection criteria. Mental fatigue affects skilled performance in three sports: soccer, basketball, and table tennis. A decline in skilled performance (decreased accuracy, increased performing time etc) is relevant to impaired executive functions. Seven studies focus on offensive skills, whereas only two studies are associated with defensive skills.

Conclusion

Mental fatigue has a negative effect on various sports skills of high-level athletes, including their technical and decision-making skills; however, the impact is greater on offensive skills than that of defensive skills in terms of the role of athletes. Impaired executive functions may be responsible for the negative effects of mental fatigue on skilled performance.

Introduction

Skilled performance in sports is defined as the ability to perform at a high standard effectively and efficiently [1] and it determines the outcome in sport [2]. It is also known as skilled sports execution or technical performance [3]. For example, in ball sports such as basketball and rugby, the term specifically refers to how efficiently the athletes handle the ball, including executing effective disposals (i.e., passing, shooting, and dribbling) and tackling to the benefit of the team [4]. Most importantly, skilled performance requires quick and accurate decision making, which is the most important perceptual-cognitive skill in team sports [5, 6]. Moreover, Fernandez-Navarro et al. [7] found that some team athletes have different playing styles based on their roles (offensive and defensive). Similarly, a recent study highlighted that the required technical skills vary depending on their roles and a study that neglects the differences between the different roles and positions of athletes in a team may produce inconclusive findings and/or methodological problems [1]. Therefore, it may be insightful to investigate skilled performance in sports that include technical and decision-making skills related to their roles. Significantly, it has been well investigated that athletes’ skills often decreases in the final stages of performance, with the decline being attributed to fatigue, as well as the athletes’ decision-making skills [8, 9].

Fatigue is a complex and multifaceted phenomenon that is referred to as a decreased ability for maximal performance and the inability to complete a task that was once achievable within a reasonable time frame [10]. The influence of fatigue on sports performance has primarily been measured from both a metabolic and a neuromuscular standpoint (physical fatigue) [11]. However, recent discussions on the role of mental fatigue in sports performance have diverged [12, 13] from the common factor of “physical fatigue” [10].

Mental fatigue is a psychobiological condition caused by a prolonged duration of cognitive activity that is characterized by feelings of “tiredness” and “lack of energy” [14, 15]. Mental fatigue impairs cognitive performance, which has been linked to altered executive functions [16, 17], such as reduced directed attention and less accurate reactions. Since executive functions are highly correlated to a series of actions, such as the ability to initiate and stop, monitor and change behaviour, and plan for subsequent moves [18]. They are essential to performances in sports [1921]. Researchers have recently begun to investigate the effect of mental fatigue on soccer performance.”

Gonzaga [22] and Vestberg [23] explicitly suggested that executive functions are highly related to skilled performance. For example, in ball sports, new decisions must be made about passing the ball when the actions of opponents or the location of the ball tend to inhibit the intended actions (inhibition of executive functions). However, mental fatigue impairs inhibition [24]. To the best of the authors’ knowledge, there is no comprehensive review of skilled performance in the context of mental fatigue.

Most studies have only focused on physical performance aspects, such as cycling time-to-exhaustion and resistance work [2530]. In a previous investigation, skilled performance was analysed as part of physical performance [31], providing only a surface understanding of the issue and was insufficient to draw valid conclusions. In another comprehensive review, Van Cutsem et al. [29] evaluated 11 studies on physical performance conducted using experimental design and found that while endurance performance was impaired, maximal strength and anaerobic work were not. However, the study did not include skilled performance.

The most recent study comes from Habay et al. [32], who conducted a comprehensive review of the effect of mental fatigue on sport-specific psychomotor performance. Habay and his colleague defined psychomotor performance as a highly complex motor behaviour that results from the cognitive processing of sensory and perceptual information in a sport-specific context. The results showed that mental fatigue impairs sport-specific psychomotor performance in many sports, and these impairments may be brain-related. However, the specific impact in brain was not discussed. Also, the study did not focus on skilled performance based on the role/position of players.

One prominent theory of mental fatigue in the physical field (endurance performance) is psychobiological model that was proposed by Marcora et al. [15]. The model postulates that endurance performance is a consciously regulated behaviour primarily determined by two psychological factors: motivation and perception of effort. Previous studies have found that mental fatigue dose not reduce both success and intrinsic motivation [15, 33]. Thus, a higher perception of effort is the most likely explanation for the impairment in the mental fatigue condition. However, the impairment in the skilled performance was theoretically attributed to a reduction in executive functions due to mental fatigue tasks activating the anterior cingulate cortex (ACC), likely leading to elevated adenosine and correspondingly decreased dopamine [34, 35]. To determine the mechanism of effects, the current study reviews each key executive functions in specific skilled performance.

Methodology

The review’s reporting follows the preferred reporting items checklist used in the systematic (PRISMA) protocol [36]. A systematic literature search was carried out involving four main databases, namely PubMed, Web of Science, EBSCOhost (CENTRAL, SPORTDicus), and Scopus for published works since their inception dates to January 2021 (S1 Table). EBSCOhost comprises numerous sub-databases. However, due to the content’s relevance, only Cochrane Central Register of Controlled Trials (CENTRAL) and SPORTDicus were selected. Data searching was assisted by experienced librarians, who ensured the method’s reliability.

Eligibility criteria

The PICO method was used in the selection of literature (Table 1). The selected literature must also be available in English and fully published in a peer-reviewed journal. Specifically, studies were eligible when the study outcomes included any form of skilled performance (see Methodology: Data Analysis) in sports, which is the main outcome of the current review. Interventions were used to induce mental fatigue prior to the test of skilled performance with all types of cognitive tasks, and the population only included athletes who are very good at sports, particularly on the court. They can be classified into various levels, such as amateur, well-trained, elite and professional etc. In addition, these studies had to include a control group that induced no or less mental fatigue than the mentally fatiguing tasks.

Table 1. PICO (Participation, Intervention, Comparison, Outcome).

PICO Criteria
Participation Athlete
Intervention Acute fatigue induced by cognitive tasks
Comparison Mentally fatigued vs non-mentally fatigued athletes
Outcome Performance of sport skills

Data analysis

To investigate a more in-depth investigation, the current qualitative review will examine the main outcomes of three aspects: offensive, defensive and decision-making skills (see details in the Introduction part). The action of engaging an opposing individual/team with the objective of scoring points or goals is referred to as offensive skill, whereas, defensive skill refers to the action of preventing an opponent from scoring [2]. In addition, athletes are usually required to pay sustained attention for making accurate, quick decisions based on the retrieval and processing of information from a dynamic environment [5, 6]. Athletes must excel in three aspects to achieve peak performance.

Search strategy and selection of literature

The following keywords, truncation and Boolean operators, were used individually and in combination in the search in five databases (S1 Table). A search was also conducted on Google Scholar and based on the sources of reference in the selected reviews for additional literature that may not have appeared in the search results using the main databases.

The PICO method was used to determine whether the articles should be included or excluded (Table 1). First, the titles and abstracts were screened. Then, potential full-text articles were identified and selected. Two reviewers worked independently in this process (S.H. and S.K.G.). Disagreements were resolved by a discussion between the two reviewers. If necessary, a third reviewer (S.K.L.) was consulted to reach a consensus. Fig 1 summarises the selection process.

Fig 1. PRISMA summary of the study selection process.

Fig 1

Protocol and registration

The protocol of methods and planned analyses applied in this systematic review was registered in PROSPERO (ref. CRD42020201715). Although there are protocols in PROSPERO that examine the effects of mental fatigue, none of them focus on skill performance in sports. Hence, the novelty of the proposed protocol was ensured.

Quality assessment

A systematic review is essential for evaluating relevant studies. Similarly, an overview should brief the assessment on the quality of the selected systematic reviews [37]. In addition, the data should be handled with care to prevent a “garbage in, garbage out” scenario that is the basis of conducting a systematic review [38].

The quality of the methodology used in this study was assessed using the quantitative assessment tool “QuaIlSyst” [39], which includes 14 items (Table 2). The scoring is based on how well a specific criterion was met (no = 0, partial = 1, yes = 2). The letter “NA” represents items that do not apply to the study design and are thus excluded from the calculation of the summary score. Each study’s summary score was calculated by adding the total score obtained and dividing it by the total possible score. The scores, ≤ 55%, 55–75%, and ≥ 75, indicate low, medium, and high quality, respectively. Any low-quality study should be excluded from the systematic review [39].

Table 2. “Qualsyst” of quality assessment.

Publication Question/objective described Appropriate study design Appropriate subject selection Characteristics sufficiently described Random allocation Researchers blinded Subjects blinded Outcome measures well defined and robust to bias Appropriate sample size Analytic methods well described Estimate of variance reported Controlled for confounding Results reported in detail Conclusion supported by results? Rating
Badin et al. [40] 1 2 2 1 NA 1 0 2 1 2 2 1 1 2 medium
Smith et al. [41] 2 2 2 2 NA 2 1 2 1 2 2 1 2 2 high
Smith et al. [42] 2 2 2 2 NA 0 1 2 1 2 2 1 2 2 high
Smith et al. [43] 2 2 2 1 NA 2 1 2 1 2 2 1 1 2 medium
Le Mansec et al. [44] 2 1 2 2 NA 0 0 2 1 2 2 0 2 2 medium
Greco et al. [45] 1 1 1 2 1 0 0 1 0 2 1 0 1 1 low
Moreira et al. [46] 2 2 2 2 NA 0 1 2 2 2 1 2 2 2 high
Fortes et al. [47] 2 2 2 2 NA 2 0 2 1 2 2 2 2 1 high
Gantois et al. [48] 2 2 2 2 NA 2 0 2 2 2 2 2 2 1 high
Bahrami et al. [49] 1 0 1 1 1 0 0 1 1 0 2 0 0 1 low
Filipas et al. [50] 2 2 2 2 NA 2 0 1 2 2 0 1 1 1 medium
Fortes et al. [51] 2 2 2 2 NA 2 0 2 2 2 2 2 2 1 high
Trecroci et al. [52] 2 2 2 2 NA 0 0 2 1 2 2 0 2 2 medium

NA: not applicable, 2 indicates yes, 1 indicates partial, 0 indicates no Quality; Quality score: ≥ 75% high, 55% -75% medium, ≤ 55% low.

Result

Selection of literature

There were initially 1242 hits from PubMed, Web of Science, EBSCOhost (CENTRAL, SPORTDicus), and Scopus, as well as two hits from a reference search and Google Scholar. All duplicates were removed, and after screening the title and abstract, the entire text was read; ten literatures were chosen for this study (Fig 1). However, 2 out of the 13 literatures were deemed to be of low quality and were thus excluded from this review. Thus, this systematic review was based on 11 studies that focused on skilled performance among athletes in various sports. The details are presented in Table 3.

Table 3. Overview of publications details.

Publication Subjects N Manipulation Duration (min) Measurement Sport-skill Task Type of Sport Type of Skills Outcome
Badin et al. [40] Elite 20 Stroop task computer version 30 VAS Soccer:
small-sided games
Team
Lower Limb
Offensive Passing Accuracy%↓ MF↑ ME↑
MO ↔ RPE↑
HR↓
Defensive Tackle success↓
Tackle (n)↔
Smith et al. (Study 2) [42] Well-trained 14 Stroop task
paper version
30 BRUMS LSPT Team
Lower Limb
Offensive MF↑ ME↓ MO↔ RPE↔ HR↔
Penalty time↑ Performance time↑
Points per shot↓ Shot speed↓
Smith et al. [41] Professional 12 Stroop task
paper version
30 VAS Soccer:
decision making skill
Team
Lower Limb
Decision
Making
MF↑ ME↑ MO↑
Overall response accuracy↓
Response time↑ Visual search ↔
Smith et al. [43] Well-trained 14 Stroop Task
Paper Version
30 VAS LSPT, LSST Team
Lower Limb
Offensive MF↑ ME↑ MO↔ Error↓
Perfect passes↑ Time↔
Missed target↓
Le Mansec et al. [44] Professional 22 AX-CPT 90 VAS Table Tennis:
forehand strokes
Individual
Upper Limb
Offensive MF↑ RPE↔ Ball speed↓ Accuracy↓
Faults number↑ Total score↓
Moreira et al. [46] Elite 48 Stroop task
computer version
30 Cognitive Performance Basketball:
small-sided game
Team
Upper Limb
Offensive RT↑ Ac↓ RPE↔ HR↔
Salivary parameters↑ alpha- amylase↑
Athletes’ efficiency↔ Turnover number↑
Fortes et al. [47] exp. 1 Professional 20 Smartphone 15 Cognitive Performance Soccer:
full-sided game
Team
Lower Limb
Decision Making RT↔ Ac↔ RPE↔ HRV↔ Hy↔
PDM↔
exp. 2 30 RT↑ Ac↓ RPE↔ HRV↓ Hy↔
PDM↓
exp. 3 45
Gantois et al. [48] exp. 1 Professional 20 Stroop task
computer version
15 Cognitive Performance Soccer:
full-sided game
Team
Lower Limb
Decision Making RT↔ Ac↔ RPE↔
HRV↔ Hy↔ Passing accuracy↔
exp. 2 30 RT↑ Ac↓ RPE↔ HRV↔ Hy↔
PDM↓
Filipas et al. [50] Sub-elite U14: 12 Stroop task
computer version
30 VAS Soccer:
LSPT, LSST
Team
Lower Limb
Offensive Penalty,
Performance time↔
MF↑ ME↑
U16: 12 Penalty,
Performance time↔
U18: 12 Penalty,
Performance time↓
Fortes et al. [51] exp1 Professional 25 Smartphone 30 Cognitive Performance Soccer:
full-sided game
Team
Lower Limb
Decision Making RT↑ Ac↓ RPE↔ Lactate Blood↔ Hy↔
PDM↓
Fortes et al. exp2 Video games 30
Trecroci et al. [52] sub-elite 9 Stroop task
Smartphone app
30 VAS Soccer:
small-sided game
Team
Lower Limb
Offensive Negative passes↑
Pass; Shot accuracy↓
MF↑ ME↑MO↔
RPE↔
Defensive Negative, positive tackles; tackle (n); tackle success↔
Decision Making Negative passes↑ Passing; Dribbling accuracy↓

LSPT: Loughborough Soccer Passing Test; LSST: Loughborough Soccer Shooting Test. MF: mental fatigue; ME: mental effort; MO: motivation; RT: reaction time; Ac: accuracy; Hy: hydration. RPE: rating of perceived exertion; PDM: Passing performance decision making index; Higher↑; lower↓; no significant difference ↔ in the condition of mental fatigue compared with control condition; VAS: Visual Analogue Scale; BRUMS: Brunel Mood Scale.

Overview of sports

The comprehensive search yielded studies involving ball sports, of which only Le mansec et al. [44] reported on an individual sport (table tennis), while the others reported on team sports (soccer and basketball). Soccer was the subject of 9 out of 10 studies on team sports [4043, 47, 48, 5052].

Interestingly, the majority of studies have focused on high-level athletes, including professionals [44, 47, 48, 51] and elites [40, 46]. In addition, most studies have focused more on offensive skills rather than defensive skills.

Intervention inducing and the manifestation of mental fatigue

Badin et al. [40], Moreira et al. [46] and Gantois et al. [48] and Filipas et al. [50] used a 30-minute computerised Stroop task to induce mental fatigue. Gantois et al. [48] also investigated a 15-minute exposure to examine the dose-response of the Stroop task. Smith et al. [41], Smith et al. [42], and Smith et al [43]. have investigated the 30-minute exposure of the printed version Stroop task. In addition, Le Mansec et al. [44] required that participants complete a 90-minute AX-continuous performance test (AX-CPT). Fortes et al. [47] and Fortes et al. [51] have studied the effect of exposure to social network apps on smartphones for 15, 30, and 45 minutes, in addition to a 30-minute video gaming session, which is more realistic in today’s world. In general, continuous exposure to cognitive tasks for ≥ 30 minutes successfully induces mental fatigue when compared to two 15-minute interventions, as observed in studies involving smartphone exposure [47] and a computerised Stroop task [48].

To prove the condition of mental fatigue, seven studies have chosen subjective manifestation, all of which used the Visual Analogue Scale (VAS) [40, 41, 4549] rated from “0” to “100”, signifying “not exhausted at all” to “completely exhausted”. However, the other five studies used VAS to report motivation and no significant difference in performance was reported between the mentally fatigued and control group in the given tasks in five of the studies [40, 41, 43, 44, 52]. Interestingly, greater motivation was observed in the mentally fatigued group than in the control group. [46]; the findings demonstrated that motivation is not diminished by mental fatigue. It is consistent with the psychobiological model of endurance performance, and effects of mental fatigue on skilled performance are not caused by motivation. However, only one study reported that mental fatigue likely increased RPE [40]. Most physiological variables that were assessed were general parameters, such as heart rate and blood lactate, which did not change in the presence of mental fatigue. Interestingly, Moreira et al. [46] found a higher concentration of salivary testosterone in mental fatigue athletes. The general physiological indicators, such as heart rate and blood lactate, did not show significant differences.

Cognitive performance was measured in four of the selected studies, which included 11 experiments, to evaluate the effects of mental fatigue [4648, 51]. The results demonstrate that the 30-minute cognitive tasks result in a significant reduction in reaction time and performance accuracy among the athletes.

Skilled performance outcome

As a prediction, the extracted literature has mainly focused on the skill demands based on the role or position of the athletes, and technical skills have been divided into two categories (offensive and defensive skills). It is worth noting that previous studies focused more on offensive skills than defensive skills. The details are presented in the following sections.

Technical skill

Offensive skill

Seven of the selected studies have evaluated the offensive skills used in the Loughborough Soccer Shooting Test (LSST) and Loughborough Soccer Passing Test (LSPT) [42, 43, 50], as well as in small-sided soccer [40, 52] and basketball games [46], and the stroke performance test in table tennis [44]. In the LSST, athletes must perform a series of moves and score a goal. Mental fatigue affects athletes’ accuracy and speed when shooting a goal [43]. In the LSPT, athletes must perform 16 passes against 4 gymnasium-standard benches as quickly as possible. For each mistake, they will be penalised with additional time (s). Higher penalty time (s), several errors (n) and missed target/missed passes (n) were observed in a study involving an experimental group (mentally fatigued athletes) and a control group [42]. There was no significant difference in time taken to complete the task between the two groups (Mean ± SD: MF = 47.8 ± 4.9; Control = 47.9 ± 4.1). However, the experimental group (mentally fatigued) had more errors (MF = 4.0 ± 2.8; Control = 2.5 ± 2.1) and fewer perfect passes (MF = 5.6 ± 1.4; Control = 6.6 ± 1.5) [45]. Filipas et al. [50] recently examined LSPT and LSST in three different age groups (U14, U16 and U18). Interestingly, only reductions in U18 were found (Penalty time: MF = 15.3 ± 4.7; Control = 8.0 ± 3.1; Performance time: MF = 67.2 ± 7.4; Control = 57.2 ± 6.7).

Because small-sided games (SSG) are a popular training method for developing multiple fitness, technical, and tactical components in team sport [53], Badin et al. [40] and Trecroci [52] conducted two separate experiments in SSG. A decline in accurate passes [Mean Difference (MD): 2.1% and 7% from two studies] and shots (MD = 36.9% in Trecroci [52]) were reported regarding offensive skills. Another investigation using SSG on athletes’ basketball performance found that athletes committed a high number of errors (high number of total turnovers) [Effect Size (ES) = 0.71, 0.29; 1.12] [46]. Table tennis was also investigated. Le Mansec et al. [44] compared the effects of various types of fatigue on skilled performance. Mental fatigue affects the ball speed [2.2 ± 3.5% (-4.4 ± 0.1), p = 0.035, dz = 0.669] and accuracy [-6.7 ± 7.7% (-11.6, -1.8), p = 0.001, dz = 0.886], as well as increasing the chances of athletes committing faults [+5.5 ± 6.3% (+1.4, +9.4), p = 0.014, dz = 0.850] in specific protocols.

Defensive skill

Only two studies in the selected literature dealt with defensive performance. Badin et al. [40] found that the percentage of tackling success is about 28% lower in mentally fatigued athletes than that of athletes in controlled conditions, as observed in the soccer SSGs. In Trecroci et al. [52] the success rate was not significantly different between the two conditions (MF = 46.6 ± 27.1; Control = 49.1 ± 34.4). Moreover, neither study found any changes in the total number of tackles in terms of defensive skills.

Decision-making skills

The first investigation on decision-making skills was conducted in a controlled laboratory setting [41]. Film simulation was used by the researchers, which is one of the most popular methods. The results demonstrated that athletes’ decision-making ability is impaired after performing a cognitive task in terms of response accuracy (MF = 80.9 ± 6.4%; Control = 85.7 ± 4.9%; ES = -0.89 ± 0.73) and time (MF = 768 ± 134 ms; Control = 685 ± 156 ms; ES = 0.49 ± 0.47). Mental fatigue causes decrements because it impairs executive function, shifting athletes’ goal-directed attention to stimulus-driven attention, negatively impacting decision-making skills [41].

Three of the selected studies have attempted to examine the effects of mental fatigue on decision-making skills in soccer athletes, particularly when passing the ball. Despite testing various treatments, the studies used the same method for measuring the outcome; two of the studies have investigated the effects of smartphones and video games [47, 51] whereas the other looked at the effects of normal/experimental cognitive tasks on sports performance [48]. All three studies have found that mental fatigue influences passing decision making (condition effect: p < 0.01) in soccer athletes after ≥30 minutes of treatment exposure.

Based on the study of Smith et al. [41], Trecroci et al. [52] conducted an experiment in a SSG (4 vs. 4; 1 wildcard) to examine decision-making skills, which are more relevant to real competition. Mental fatigue affects not only the total number of passing decision making (MF = 2.4 ± 1.1; Control = 1.5 ± 1.2), but also the accuracy of passing (MF = 81.5 ± 9.5; Control = 88.2 ± 10.4) and dribbling (MF = 41.3 ± 32.2; Control = 75.3 ± 35.5).

Discussion

This systematic review attempts to outline current knowledge of the effects of mental fatigue on skilled performance in athletes, including technical and decision-making skills.

Overview of sports

Unsurprisingly, all of the selected 11 studies have focused primarily on ball sports (soccer, basketball and table tennis), as the cognitive demands in ball sports are extremely challenging [54, 55]. In sports, the trajectory paths of athletes’ movements and the ball are usually unpredictable; interruptions may occur, causing changes in direction, as well as various occlusions and segmentation, such as objects blocking or disappearing from view. Therefore, athletes playing ball sports must remain alert throughout the game [34, 54] that increases the chances of mental fatigue. In line with previous studies, the predominant focus on soccer athletes demonstrates that these athletes may be more susceptible to mental fatigue than other athletes due to the longer duration of exposure to cognitive tasks in ball sports than other sports [34].

Most of the selected studies have focused on high-level athletes, which suggests that the chances of mental fatigue are exceptionally high in athletes who are under extreme pressure due to high-intensity training and competition demands [13, 34]. However, studies on athletes in other categories are also important, because many studies have shown that factors unrelated to sports activities are also responsible for mental fatigue in athletes during games [47, 51, 56, 57]. Future studies should consider this particular scope.

Intervention inducing and the manifestation of mental fatigue

The Stroop task was used in most of the selected studies (see Table 3). Generally, the Stroop task is a classical method for measuring inhibitory control and sustained attention, which are executive functions [18]. According to a previous study, these functions are highly related to skilled performance in sports [22, 23, 34]; a decrease in such abilities may impair athletes’ performance. Also, in line with recent studies, a 30-minute Stroop task can be used to induce effective mental fatigue in athletes of all levels [29]. Contrastingly, McMorris [35] indicated that shorter cognitive tasks have a larger negative effect than longer ones due to learning effects. The longer duration influence was found to be more negative in the current review [47, 48]. Because the types of cognitive tasks and subsequent tests are different. Brown et al. [31] found that shorter and longer cognitive tasks did not affect submaximal exercise. McMorris [35] also raised this issue, stating that the short versus long duration of cognitive tasks should be addressed in the future.

Consistent with Smith et al. [58], the current review showed that subjective manifestation is reliable for measuring mental fatigue. Previous studies have shown that subjective ratings can detect fatigue when objective assessment is not possible [59, 60], Moreover, it has been suggested that subjective mental fatigue precedes any decrements in performance [60]. Particularly, VAS appeared to be an effective instrument, and it has been widely implemented [40, 41, 43, 44, 50, 52], as well as for minimum time spent and easy interpretation [59].

The effect of mental fatigue on sports skilled performance

Technical skill

Technical skills are mainly divided into offence and defence skills based on specific demands based on the athletes’ role or position. Notably, the majority of the selected studies have focused on offensive skills because cognitive resources are more exhausted when performing offensive skills than defensive skills [61]. Therefore, athletes are more likely to experience mental fatigue when performing offensive skills than defensive skills, because the perception of effort increases more in the former than the latter. However, this hypothesis should be confirmed in future studies by a direct comparison of these two technical skills used in the same sport.

Because mental fatigue impairs the trade-off between speed and accuracy [62]. More complex sport-related technical skills will almost certainly be altered. Le Mansec et al. [44], Smith et al. [43] and Filipas et al. [50] have all found that mental fatigue reduces accuracy and ball speed. However, Smith et al. [43] conducted a time-based experiment that emphasized speed. Generally, a speed-accuracy trade-off occurs during performance under mental fatigue conditions, whereby the speed performance (primary) goal is maintained at the expense of the accuracy (secondary) goal. This systematic review highlights the negative effects of mental fatigue on skilled performance in sports, in general. However, the effects vary depending on the task’s demand. The information can be used to develop a training plan and a match. Furthermore, the knowledge enables athletes to adopt a good strategy in the event of mental fatigue; for example, during ball games, passing the ball to a team athlete in a less pressured position (more time, but less accurate), rather than risking a pass to a team athlete at a highly pressured attacking position (more accurate, but less time).

Mental fatigue does not affect physical performance in simulated games, as reported by Badin et al. [40] and Gantois et al. [48]. However, the effects can be observed in soccer-specific endurance tasks [42]. This is also in contrast to Trecroci et al. [52], who reported that athletes likely covered less distance when accelerating, and possibly a lower equivalent distance than in control conditions in the SSG. However, such effects are not elaborated on this systematic review, because they are beyond the research scope. However, future research should not disregard such findings to better understand the effects of mental fatigue.

Decision-making skill

Smith et al. [41] conducted the first study on decision-making performance in sports, demonstrating that mental fatigue negatively influences the speed and accuracy of athletes in making critical decisions in a lab setting. Trecroci et al. [52] extended their results to a field setting (SSG), which is more relevant to real-world competition. Poor performance was observed in both studies, probably due to impairments in cognitive skills such as executive functions and information processing [63, 64], which may influence athletes’ decision-making skills [41]. Athletes’ visual search behaviour has also been linked to lower information processing performance, according to researchers. In a previous study, although athletes in both the experimental (mental fatigue) and control groups extracted information from similar sources (athletes with the ball, opponents, the ball), the ability to identify and to use the information appropriately was compromised by the athletes in the experimental group. The findings suggest that mental fatigue may affect attentiveness [41], which is controlled by the executive function of “inhibition”.

Three of the selected studies have focused on passing decision-making skills, despite the slight differences in their purposes. Two of the three studies sought to investigate prolonged exposure to smartphones and video games as a possible cause of mental fatigue [47, 51], as well as the subsequent impact on decision-making skills; the third, a study by Gantois et al. [48], sought to directly analyse the effects of mental fatigue on decision making. These three studies have solely focused on decision-making ability related to ball passing because it is one of the key tasks that determines game outcomes [65]. All three studies have applied similar equations to calculate the passing decision-making index (PDM). The equation is as follows:

PDM=AaAa+Ia×100

Aa = appropriate actions

Ia = inappropriate actions

The findings of the three studies demonstrate that mental fatigue impairs ball passing decision-making skills when exposed to a 30-minute or 45-minute cognitive task; exposure to a 15-minute cognitive task has no effect on decision-making skills. Therefore, it is concluded that the duration of a cognitive task should be at least 30 minutes to experimentally induce mental fatigue.

Potential mechanism

Understanding the potential underlying mechanisms may assist in the development of interventions to counteract the negative effect of mental fatigue on skilled performance. To consider the mechanisms, it is inevitable to consider the perception of effort in the literature of physical performance, which has demonstrated that it is the only parameter to mediate the effect of mental fatigue on endurance performance [15, 29]. However, the current review did not find consistent evidence, as the level of RPE was not significantly different in the majority of the studies. Importantly, Moreira et al. [46] found that mental fatigue elevates salivary testosterone that may be associated with the increased errors of technical skill. Indeed, testosterone is thought to be involved in regulating activity of the mesolimbic reward system involving dopamine [66]. Moreira et al. [46] proposed that lower testosterone levels may influence dopamine transmission in mentally fatigued athletes. This finding shows that mental fatigue decreases dopamine in the ACC, impairing executive functions.

Technical skill impairment has been strongly related to attentional direction [40, 42, 43]. Indeed, mental fatigue has been shown to shift attention from goal-directed to stimuli-directed that are irrelevent to subsequent performance [16, 67]. Furthermore, it decreased the ability to anticipate ball movement and prepare to control it [43]. Smith et al. [42] even suggested that this negative effect may be more likely in the match setting, where the additional irrelevant stimuli are increased compared to a control experimental environment. Moreover, athletes must constantly monitor and adjust their skills to improve their performance. However, a previous study indicated that mental fatigue leads to an impaired capacity for performance monitoring and adjustment [68]. The ability to monitor error performance is thought to rely predominantly on intact ACC functioning [69]. Lorist et al. [68] found that people typically slow down to perform when an error occurs. Thus, when athletes are mentally fatigued, they may slow down to exert technical skills to avoid errors, allowing opponents to counterattack.

Athletes’ decision-making ability is also impaired due to the shift in attention focus. In soccer, decision making highly relies on the human brain’s ability to perceive relevant information from a complex environment while blocking out irrelevant distractions [48, 70]. This process is controlled by selective attention [71, 72]. Selectivity prevents athletes from reacting reflexively to environmental stimuli and allows them to make flexible decisions. However, it was impaired by mental fatigue.

Another possible explanation is that athletes are unable to respond to cues to prepare for upcoming decisions because mental fatigue negatively impairs preparation and planning [73]. To make a good decision, athletes should interpret and/or anticipate the movement of teammates, opponents and/or the ball etc. However, the execution of preparation and planning processes is susceptible to mental fatigue and frontal negativity [73].

Furthermore, the impairment has been attributed to the reduced ability of the visual search strategy. In team sports, mentally fatigued athletes tend to spend more time fixating on their opponents while spending less time fixating on their teammates [41, 47]. Therefore, athletes have little focus on the movement of their teammates, even though they may understand the movements of their opponents, impairing the passing decision-making skill, as evidenced by three extracted studies [47, 48, 51].

The implications and future directions

The mechanisms of mental fatigue in sports in terms of skilled performance are complicated. Understanding these mechanisms may assist in the development of future interventions. Prior cognitive tasks have been shown to activate the ACC, inducing the concentration of adenosine to rise. Indeed, the ACC plays a key role in many executive functions that are in charge of performing skills among athletes. Future studies may look into strategies, such as implementation intentions to aid in action automation; mindfulness music, and nature exposure to enhance directed attention; biofeedback to monitor/adjust performance and improve executive functions while countering mental fatigue.

The impact of duration after cognitive tasks should be considered by future studies, for the condition of metal fatigue is acute. Although the precise duration of mental fatigue is unknown, Smith et al. [58] reported the prolonged mental fatigue condition in an individual after 60 minutes in an assessment using the Psychomotor Vigilance task and VAS; the findings also demonstrate that the individual may recover from acute mental fatigue in 60–135 minutes.

The fact that most of the investigations in the selected literatures have converged on soccer suggests that soccer athletes may be more prone to mental fatigue than athletes in other ball sports, or athletes in other sports in general. Previous studies have consistently reported that soccer athletes face extremely challenging cognitive demands when competing [13, 34]. However, attention should also be given to athletes from other sports, as recent studies have shown that mental fatigue may be caused by factors unrelated to sports activities (i.e., smartphones, video playing, fixture congestion, etc.).

Most importantly, athletes who play an offensive role may be more susceptible to mental fatigue than defensive athletes in some team sports, such as soccer. This suggestion should be considered by coaches. Offensive athletes may need to do more mental training.

However, during high demand cognitive tasks, athletes are prompted to perform an executive function to maintain vigilance. If this process is prolonged, mental fatigue may set in. This knowledge provides opportunities for future studies to improve skill performance in sports by increasing athletes’ ability to perform an executive function.

Conclusion

This systematic review demonstrates that mental fatigue affects a wide range of components of skilled performance in sports among high-level athletes. Technical and decision-making skills are important components, particularly when athletes play offensive roles. The influences have been predominantly observed in three sports: soccer, basketball, and table tennis.

A 30-minute Stroop task is sufficient to induce mental fatigue in all cognitive assessments. In addition, VAS is effective for subjective measurement. The findings suggest that athletes should avoid cognitive tasks prior to competition or training, to achieve optimal performance. This includes exposure to screens and video games.

There were no physiological or psychological indicator mediated effects of mental fatigue on skilled performance. The possible mechanism for the effect of mental fatigue on skilled performance is the increased concentration of adenosine in the prefrontal cortex activated by cognitive tasks, impairing a series of executive functions. Interventions to counteract this negative effect of mental fatigue are urgently needed.

Limitations

This systematic review poses a few noteworthy limitations. First, this systematic review, conducted rigorously, is not a meta-analysis. Moreover, the systematic review focuses only on skilled performance, defined as technical and decision-making skills, excluding physical performance in sports. Because three of these skilled performances are closely related and contribute to athletes’ performance, future studies should investigate them together to obtain more comprehensive results. Finally, selecting articles only written in English may limit the representation of the results even further.

Supporting information

S1 Table. Detailed search strategy.

(DOC)

S2 Table. PRISMA 2009 checklist.

(DOC)

Acknowledgments

The authors would like to thank Dr Zubaidah Ibrahim and Dr Lim Xin Jean for their assistance with the searching strategy.

Data Availability

All relevant data are within the manuscript and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1. Koopmann T, Faber I, Baker J, Schorer J. Assessing Technical Skills in Talented Youth Athletes: A Systematic Review. Sports Med. 2020; 50(9):1593–1611. doi: 10.1007/s40279-020-01299-4 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Allard F, Burnett N. Skill in sport. Canadian Journal of Psychology/Revue canadienne de psychologie. 1985; 39(2):294–312. [Google Scholar]
  • 3.Rampinini E, Bishop D, Marcora SM, et al. Validity of simple field tests as indicators of match-related physical performance in top-level professional soccer players. International Journal of Sports Medicine. 2007; 28(3):228–235. doi: 10.1055/s-2006-924340 . [DOI] [PubMed] [Google Scholar]
  • 4.Mooney MG. A Conceptual Model of Physical Performance in Australian Football. [dissertation]. University of Ballarat: 2012 [cited 2022 March 15]. https://core.ac.uk/reader/212996600
  • 5.Farahani J, Soltani P, Rezlescu C. Assessing decision-making in elite academy footballers using real-world video clips. Progress in Brain Research. 2020; 253:59–70. doi: 10.1016/bs.pbr.2020.06.015 . [DOI] [PubMed] [Google Scholar]
  • 6.McGuckian TB, Cole MH, Pepping GJ. A systematic review of the technology-based assessment of visual perception and exploration behaviour in association football. Journal of Sports Sciences. 2018; 36(8):861–80. doi: 10.1080/02640414.2017.1344780 . [DOI] [PubMed] [Google Scholar]
  • 7.Fernandez-Navarro J, Fradua L, Zubillaga A, Ford PR, McRobert AP. Attacking and defensive styles of play in soccer: analysis of Spanish and English elite teams. Journal of Sports Sciences. 2016; 34(24):2195–204. doi: 10.1080/02640414.2016.1169309 [DOI] [PubMed] [Google Scholar]
  • 8.Hancock S, McNaughton L. Effects of Fatigue on Ability to Process Visual Information by Experienced Orienteers. Perceptual and Motor Skills. 1986; 62(2):491–8. doi: 10.2466/pms.1986.62.2.491 . [DOI] [PubMed] [Google Scholar]
  • 9.Royal KA, Farrow D, Mujika I, Halson SL, Pyne D, Abernethy B. The effects of fatigue on decision making and shooting skill performance in water polo players. Journal of Sports Sciences. 2006; 24(8):807–15. 10.1080/02640410500188928 . [DOI] [PubMed] [Google Scholar]
  • 10.Russell S, Jenkins D, Halson S, Kelly V. Changes in subjective mental and physical fatigue during netball games in elite development athletes. Journal of Science and Medicine in Sport. 2020; 23(6):615–20. doi: 10.1016/j.jsams.2019.12.017 . [DOI] [PubMed] [Google Scholar]
  • 11.Bangsbo J, Iaia FM, Krustrup P. Metabolic response and fatigue in soccer. International journal of sports physiology and performance. 2007; 2(2):111–27. doi: 10.1123/ijspp.2.2.111 . [DOI] [PubMed] [Google Scholar]
  • 12.Kunrath CA, Cardoso F da SL, Calvo TG, da Costa IT. Mental fatigue in soccer: A systematic review. Revista Brasileira de Medicina do Esporte. 2020; 26(2):172–8. [Google Scholar]
  • 13.Russell S, Jenkinsa D, Smith M, Halsone S, Kelly V. The application of mental fatigue research to elite team sport performance: new perspectives. Journal of Science and Medicine in Sport. 2019; 22(6):723–8. 10.1016/j.jsams.2018.12.008 . [DOI] [PubMed] [Google Scholar]
  • 14.Boksem MAS, Tops M. Mental fatigue: Costs and benefits. Brain Research Reviews. 2008; 59(1):125–39. 10.1016/j.brainresrev.2008.07.001 . [DOI] [PubMed] [Google Scholar]
  • 15.Marcora SM, Staiano W, Manning V. Mental fatigue impairs physical performance in humans. Journal of Applied Physiology. 2009; 106(3):857–64. doi: 10.1152/japplphysiol.91324.2008 . [DOI] [PubMed] [Google Scholar]
  • 16.Boksem MAS, Meijman TF, Lorist MM. Effects of mental fatigue on attention: An ERP study. Cognitive Brain Research. 2005; 25(1):107–16. doi: 10.1016/j.cogbrainres.2005.04.011 . [DOI] [PubMed] [Google Scholar]
  • 17.Boksem MAS, Meijman TF, Lorist MM. Mental fatigue, motivation and action monitoring. Biological Psychology. 2006; 72(2):123–32. doi: 10.1016/j.biopsycho.2005.08.007 . [DOI] [PubMed] [Google Scholar]
  • 18.Diamond A. Executive functions. Annual Review of Psychology. 2013; 64:135–68. doi: 10.1146/annurev-psych-113011-143750 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Hernández-Mendo A, Reigal RE, López-Walle JM, Serpa S, Samdal O, Morales-Sánchez V, et al. Physical Activity, Sports Practice, and Cognitive Functioning: The Current Research Status. Front Psychol. 2019; 10:2658. doi: 10.3389/fpsyg.2019.02658 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Sakamoto S, Takeuchi H, Ihara N, Ligao B, Suzukawa K. Possible requirement of executive functions for high performance in soccer. PLoS ONE. 2018; 13(8):e0201871. doi: 10.1371/journal.pone.0201871 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Vestberg T, Reinebo G, Maurex L, Ingvar M, Petrovic P. Core executive functions are associated with success in young elite soccer players. PLoS One. 2017; 12(2): e0170845. doi: 10.1371/journal.pone.0170845 ; [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Gonzaga ADS, Albuquerque MR, Malloy-Diniz LF, Greco PJ, Teoldo Da Costa I. Affective decision-making and tactical behavior of under-15 soccer players. doi: 10.1371/journal.pone.0101231 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Vestberg T, Gustafson R, Maurex L, Ingvar M, Petrovic P. Executive functions predict the success of top-soccer players. PLoS One. 2012; 7(4): e34731. doi: 10.1371/journal.pone.0034731 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Guo Z, Chen R, Liu X, Zhao G, Zheng Y, Gong M, et al. The impairing effects of mental fatigue on response inhibition: An ERP study. PLoS One. 2018; 13(6): e0198206. doi: 10.1371/journal.pone.0198206 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Pageaux B, Marcora SM, Rozand V, Lepers R. Mental fatigue induced by prolonged self-regulation does not exacerbate central fatigue during subsequent whole-body endurance exercise. Front Human Neuroscience. 2015; 25(9):67. doi: 10.3389/fnhum.2015.00067 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Rozand V, Pageaux B, Marcora SM, Papaxanthis C, Lepers R. Does mental exertion alter maximal muscle activation? Front Human Neuroscience. 2015; 25(9):67. doi: 10.3389/fnhum.2015.00067 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Schücker L, MacMahon C. Working on a cognitive task does not influence performance in a physical fitness test. Psychology of Sport and Exercise. 2016; 25:1–8. 10.1016/j.psychsport.2016.03.002 [DOI] [Google Scholar]
  • 28.Smith MR, Marcora SM, Coutts AaJ. Mental fatigue impairs intermittent running performance. Medicine and Science in Sports and Exercise. doi: 10.1249/MSS.0000000000000592 . [DOI] [PubMed] [Google Scholar]
  • 29.van Cutsem J, Marcora S, de Pauw K, Stephen B, Meeusen R, Roelands B. The Effects of Mental Fatigue on Physical Performance: A Systematic Review. Sports Medicine. 2017; 47(8):1569–88. 1569–1588. doi: 10.1007/s40279-016-0672-0 . [DOI] [PubMed] [Google Scholar]
  • 30.Veness D, Patterson SD, Jeffries O, Waldron M. The effects of mental fatigue on cricket-relevant performance among elite players. Journal of Sports Sciences. 2017; 35(24):2461–7. doi: 10.1080/02640414.2016.1273540 . [DOI] [PubMed] [Google Scholar]
  • 31.Brown DMY, Graham JD, Innes KI, Harris S, Flemington A, Bray SR. Effects of Prior Cognitive Exertion on Physical Performance: A Systematic Review and Meta-analysis. Sports Medicine. 2020; 50(3):497–529. doi: 10.1007/s40279-019-01204-8 . [DOI] [PubMed] [Google Scholar]
  • 32.Habay J, van Cutsem J, Verschueren J, de Bock S, Proost M, de Wachter J, et al. Mental Fatigue and Sport-Specific Psychomotor Performance: A Systematic Review. Sports Medicine. 2021; 51(7):1527–1548. doi: 10.1007/s40279-021-01429-6 . [DOI] [PubMed] [Google Scholar]
  • 33.Brownsberger J, Edwards A, Crowther R, Cottrell D. Impact of mental fatigue on self-paced exercise. International Journal of Sports Medicine. 2013; 34(12):1029–36. doi: 10.1055/s-0033-1343402 . [DOI] [PubMed] [Google Scholar]
  • 34.Smith MR, Thompson C, Marcora SM, Skorski S, Meyer T, Coutts AJ. Mental Fatigue and Soccer: Current Knowledge and Future Directions. Sports Medicine. 2018; 48(7):1525–1532. doi: 10.1007/s40279-018-0908-2 . [DOI] [PubMed] [Google Scholar]
  • 35.McMorris T. Cognitive Fatigue Effects on Physical Performance: The Role of Interoception. Sports Medicine. 2020; 50(10):1703–1708. doi: 10.1007/s40279-020-01320-w . [DOI] [PubMed] [Google Scholar]
  • 36.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews. 2015; 4(1):1. doi: 10.1186/2046-4053-4-1 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Pieper D, Buechter R, Jerinic P, Eikermann M. Overviews of reviews often have limited rigor: A systematic review. Journal of Clinical Epidemiology. 2012. Dec;65(12):1267–73. doi: 10.1016/j.jclinepi.2012.06.015 . [DOI] [PubMed] [Google Scholar]
  • 38.Nasseri-Moghaddam S, Malekzadeh R. “Systematic Review”: Is it different from the traditional review"? Archives of Iranian Medicine. 2006;9(3):196–9. . [PubMed] [Google Scholar]
  • 39.Kmet LM, Lee RC, Cook LS. Standard quality assessment criteria for evaluating primary research papers from a variety of fields. HTA Initiative. 2004. 1–22. https://www.ihe.ca/advanced-search/standard-quality-assessment-criteria-for-evaluating-primary-research-papers-from-a-variety-of-fields.
  • 40.Badin OO, Smith MR, Daniele C, Coutts AJ. Mental fatigue impairs technical performance in small-sided soccer games. International Journal of Sports Physiology and Performance. 2016;17(3):413–26. doi: 10.1123/ijspp.2015-0710 . [DOI] [PubMed] [Google Scholar]
  • 41.Smith MR, Zeuwts L, Lenoir M, Hens N, de Jong LMS, Coutts AJ. Mental fatigue impairs soccer-specific decision-making skill. Journal of Sports Sciences. 2016;34(14):1297–304. doi: 10.1080/02640414.2016.1156241 . [DOI] [PubMed] [Google Scholar]
  • 42.Smith MR, Coutts AJ, Merlini M, Deprez D, Lenoir M, Marcora SM. Mental fatigue impairs soccer-specific physical and technical performance. Medicine and Science in Sports and Exercise. 2016; 48(2):267–76. doi: 10.1249/MSS.0000000000000762 . [DOI] [PubMed] [Google Scholar]
  • 43.Smith MR, Fransen J, Deprez D, Lenoir M, Coutts AJ. Impact of mental fatigue on speed and accuracy components of soccer-specific skills. Science and Medicine in Football. 2017;1(1):48–52. 10.1080/02640414.2016.1252850 [DOI] [Google Scholar]
  • 44.le Mansec Y, Pageaux B, Nordeza A, Dorela S, Jubeaua M. Mental fatigue alters the speed and the accuracy of the ball in table tennis. Journal of Sports Sciences. 2017;36(23):2751–9. 10.1080/02640414.2017.1418647 . [DOI] [PubMed] [Google Scholar]
  • 45.Greco G, Tambolini R, Ambruosi P, Fischetti F. Negative effects of smartphone use on physical and technical performance of young footballers. International Journal of Motor Control and Learning. 2017; 4(2):4–10. 10.7752/jpes.2017.04280. [DOI] [Google Scholar]
  • 46.Moreira A, Aoki MS, Franchini E, da Silva Machado DG, Paludo AC, Okano AH. Mental fatigue impairs technical performance and alters neuroendocrine and autonomic responses in elite young basketball players. Physiology and Behavior. 2018;196(1):112–8. doi: 10.1016/j.physbeh.2018.08.015 . [DOI] [PubMed] [Google Scholar]
  • 47.Fortes LS, Lima-Junior D, Nascimento-Júnior JRA, Costa EC, Matta MO, Ferreira MEC. Effect of exposure time to smartphone apps on passing decision-making in male soccer athletes. Psychology of Sport and Exercise. 2019; 44:35–41. 10.1016/j.psychsport.2019.05.001 [DOI] [Google Scholar]
  • 48.Gantois P, Ferreira MEC, de Lima-Junior D, Nakamura FY, Batista GR, Fonseca FS, et al. Effects of mental fatigue on passing decision- making performance in professional soccer athletes. 2020. May;20(4):534–543. 10.1080/17461391.2019.1656781 . [DOI] [PubMed] [Google Scholar]
  • 49.Bahrami AM, J. Etaati Z. Negative effects of smartphone use on physical and technical performance of young footballers. Journal of Physical Education and Sport. 2020; 17(4):2495–501. [Google Scholar]
  • 50.Filipas L, Borghi S, la Torre A, Smith MR. Effects of mental fatigue on soccer-specific performance in young players. Science and Medicine in Football. 2016; 48(2):267–76. doi: 10.1249/MSS.0000000000000762 . [DOI] [PubMed] [Google Scholar]
  • 51.Fortes LS, de Lima-Junior D, Fiorese L, Nascimento-Júnior JRA, Mortatti AL, Ferreira MEC. The effect of smartphones and playing video games on decision-making in soccer players: A crossover and randomised study. Journal of Sports Sciences. 2020; 38(5):552–8. doi: 10.1080/02640414.2020.1715181 . [DOI] [PubMed] [Google Scholar]
  • 52.Trecroci A, Boccolini G, Duca M, Formenti D, Alberti G. Mental fatigue impairs physical activity, technical and decision-making performance during small-sided games. PLoS ONE. 2020; 15(9): e0238461. doi: 10.1371/journal.pone.0238461 ; PMCID: PMC7480836. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Hill-Haas S, Dawson B, Impellizzeri F, Coutts A. Physiology of Small-Sided Games Training. Journal of Sports Medicine. 2011; 41(3):199–220. doi: 10.2165/11539740-000000000-00000 . [DOI] [PubMed] [Google Scholar]
  • 54.Faubert J, Sidebottom L. Perceptual-cognitive training of athletes. Journal of Clinical Sport Psychology. 2012; 6(1):85–102. 10.1123/jcsp.6.1.85 [DOI] [Google Scholar]
  • 55.Heppe H, Kohler A, Fleddermann MT, Zentgraf K. The relationship between expertise in sports, visuospatial, and basic cognitive skills. Frontiers in Psychology. 2016; 7:1–14. doi: 10.3389/fpsyg.2016.00001 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Abbott W, Brownlee TE, Naughton RJ, Clifford T, Page R, Harper LD. Changes in perceptions of mental fatigue during a season in professional under-23 English Premier League soccer players. Research in Sports Medicine. 2020; 28(4):1–11. doi: 10.1080/15438627.2020.1784176 . [DOI] [PubMed] [Google Scholar]
  • 57.Thompson CJ, Noon M, Towlson C, Perry J, Coutts AJ, Harper LD, et al. Understanding the presence of mental fatigue in English academy soccer players. Journal Sports Science. 2020; 38(13):1524–1530. doi: 10.1080/02640414.2020.1746597 . [DOI] [PubMed] [Google Scholar]
  • 58.Smith MR, Chai R, Nguyen HT, Marcora SM, Coutts AJ. Comparing the Effects of Three Cognitive Tasks on Indicators of Mental Fatigue. Journal of Psychology: Interdisciplinary and Applied. 2019;153(8):759–83. doi: 10.1080/00223980.2019.1611530 . [DOI] [PubMed] [Google Scholar]
  • 59.Christodoulou C. The assessment and measurement of fatigue. In: DeLuca J, editor. Fatigue as a Window to the Brain. Massachusetts Institute of Technology: TheMIT Pressv; 2005. [Google Scholar]
  • 60.Kanfer R. Determinants and consequences of subjective cognitive fatigue. In: Ackerman PL, editor. Cognitive fatigue: Multidisciplinary perspectives on current research and future applications. Washington, DC: American Psychological Association; 2011. p. 189–207. [Google Scholar]
  • 61.Sansone AP, Tessitore A, Lukonaitiene I, Paulauskas H. Technical-tactical profile, perceived exertion, mental demands and enjoyment of different tactical tasks and training regimes in basketball small-sided games. Biology of sport. 2020; 37(1):14–23. doi: 10.5114/biolsport.2020.89937 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Duncan MJ, Fowler N, George O, Joyce S, Hankey J. Mental fatigue negatively influences manual dexterity and anticipation timing but not repeated high-intensity exercise performance in trained adults. Research in Sports Medicine. 2015; 23(1):1–13. doi: 10.1080/15438627.2014.975811 . [DOI] [PubMed] [Google Scholar]
  • 63.Meijman TF. Mental fatigue and the efficiency of information processing in relation to work times. International Journal of Industrial Ergonomics. 1997; 20(1):31–8. 10.1016/S0169-8141(96)00029-7 [DOI] [Google Scholar]
  • 64.van der Linden D, Frese M, Meijman TF. Mental fatigue and the control of cognitive processes: Effects on perseveration and planning. Acta Psychologica. 2003; 113(1):45–65. doi: 10.1016/s0001-6918(02)00150-6 . [DOI] [PubMed] [Google Scholar]
  • 65.Fortes LS, Nascimento-Júnior JRA, Mortatti AL, Lima-Júnior DRAA de, Ferreira MEC. Effect of Dehydration on Passing Decision Making in Soccer Athletes. Research Quarterly for Exercise and Sport. 2018; 89(3):332–9. doi: 10.1080/02701367.2018.1488026 . [DOI] [PubMed] [Google Scholar]
  • 66.Robbins TW, Everitt BJ. Neurobe havioural mechanisms of reward and motivation. Current Opinion in Neurobiology. 1996; 6(2):228–36. doi: 10.1016/s0959-4388(96)80077-8 . [DOI] [PubMed] [Google Scholar]
  • 67.Csathó Á, van der Linden D, Hernádi I, Buzás P, Kalmár G. Effects of mental fatigue on the capacity limits of visual attention. Journal of Cognitive Psychology. 2012; 24(5):511–24. 10.1080/20445911.2012.658039 [DOI] [Google Scholar]
  • 68.Lorist MM, Boksem MAS, Ridderinkhof KR. Impaired cognitive control and reduced cingulate activity during mental fatigue. Cognitive Brain Research. 2005; 24(2):199–205. doi: 10.1016/j.cogbrainres.2005.01.018 . [DOI] [PubMed] [Google Scholar]
  • 69.Botvinick MM, Braver TS, Barch DM, Carter CS, Cohen JD. Conflict Monitoring and Cognitive. Cohen & Servan-Schreiber. 2001; 108(3):624–52. doi: 10.1037/0033-295x.108.3.624 . [DOI] [PubMed] [Google Scholar]
  • 70.Baker J, Côté J, Abernethy B. Sport specific training, deliberate practice and the development of expertise in team ball sports. Journal of Applied Sport Psychology. 2003; 15(15):12–25. [Google Scholar]
  • 71.Murray SO, Wojciulik E. Attention increases neural selectivity in the human lateral occipital complex. Nature Neuroscience. 2004; 7(1):70–4. doi: 10.1038/nn1161 . [DOI] [PubMed] [Google Scholar]
  • 72.Kastner S, Pinsk MA, de Weerd P, Desimone R, Ungerleider LG. Increased Activity in Human Visual Cortex during Directed Attention in the Absence of Visual Stimulation. Neuron. 1999; 22(4):751–61. doi: 10.1016/s0896-6273(00)80734-5 . [DOI] [PubMed] [Google Scholar]
  • 73.Lorist MM, Klein M, Nieuwenhuis S, de Jong R, Mulder G, Meijman TF. Mental fatigue and task control: Planning and preparation. Psychophysiology. 2000; 37(5):614–25. . [PubMed] [Google Scholar]

Decision Letter 0

Daniel Boullosa

24 May 2021

PONE-D-21-04367

Does Mental Fatigue Affect Skilled Performance in Sports among Athletes? A Systematic Review

PLOS ONE

Dear Dr. Sun,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 08 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Daniel Boullosa

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

3. Please include a copy of Table 4 which you refer to in your text on pages 10, 15 and 16.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: General comments

This is an interesting review study with results that might add to our current understanding of mental fatigue and skilled performance in athletes. There are however a number of issues that need attention.

A thorough revision of grammar and language of this manuscript is imperative before making further decisions on the acceptability of the manuscript. So please have the manuscript corrected by a native English speaker/a professional company for revising scientific documents.

Specific comments

Title

I suggest change to “Does mental fatigue affect skilled performance in athletes? A systematic review”

Abstract

Background

Last sentence. Change “mechanism” for “effect”.

Conclusion

“Conclusion” could be dark and lined up to the left.

Introduction

First paragraph

Change “ball sports” to “team sports”.

Change “Fernandez- Navarro et al7”to “Fernandez-Navarro et al. [7]”

At the end of the first paragraph recommends for describe that fatigue can impair technical and decision-making skill. This information is importante because could link the first with second paragraph.

Third paragraph

Very long sentence “Since these executive functions are highly correlated to a series of actions, for example the capacity of initiating and stopping, monitoring and changing behaviour, and planning for subsequent moves [15], which is the key to a good sports performance among athletes [16-18], researchers recently started to investigate the effect of mental fatigue on soccer performance.” It’s recommended to divide it without the information being altered.

Forth paragraph

Change “ball game” to “team sport”

Before sentence “To the authors’ knowledge, a comprehensive review on skilled performance in the context of mental fatigue is still unavailable.” the authors could describe the possible motives of mental fatigue impair the inhibitory control and consequently perceptual-cognitive skills (e.g., increased adenosina in ACC).

Seventh paragraph

Change “on performance in endurance performance” to “on endurance performance”

Change “ball sports” to “team sports”.

Although the most adopted framework model in the literature of mental fatigue is psychobiological, this model does not seem to explain the changes in perceptual-cognitive skills (e.g., decision-making). Perhaps the authors could explain the brain mechanisms pointed by Terry McMorris (e.g., attenuated dopamine to front-parietal regions) and visual search strategy (visual cortex) changed in athletes mentally fatigued.

References

McMorris, T. Cognitive Fatigue Effects on Physical Performance: The Role of Interoception. Sports Medicine, 2020. https://doi.org/10.1007/s40279-020-01320-w

Mitchell R. Smith, Linus Zeuwts, Matthieu Lenoir, Nathalie Hens, Laura M. S. De Jong & Aaron J. Coutts (2016): Mental fatigue impairs soccer-specific decision-making skill, Journal of Sports Sciences, DOI: 10.1080/02640414.2016.1156241

Methods

It’s recommended add “data analysis” for describe the subgroups created in results section:

Technical skill, offensive skill, defensive skill, and decision-making skill.

Results

Overview of Sports

First paragraph

Change “ball sports” to “team sports”

Intervention inducing and manifestation of mental fatigue

It’s suggested to create a Table indicating the main findings (e.g., task used to induce mental fatigue, test or scale utilized for measurement mental fatigue)

Discussion

Intervention inducing and manifestation of mental fatigue

Second paragraph

“However, contrast to the study of [50], the higher perception of effort is not only responsible for the impairment in physical performance, but also skilled performance. Four selected literature have measured the effects of motivation as part of the methodology [36, 40, 42, 44].”

The sentences are unconnected. It’s recommended re-writing.

I understanding that the impaired perceptual-cognitive skill in athletes mentally fatigue can be explain by visual search strategy altered or by activity changed in front-parietals regions (e.g., increased theta wave in PFC). It’s suggested describe about this.

The implication and future directions

First paragraph

It’s recommend to remove the first paragraph, because the findings of systematic review no demonstrated rating perceived exertion as a mediator between mental fatigue and skilled performance.

Second paragraph

There is a difference between rating perceived exertion (RPE) and session-RPE. For evaluate session-RPE is necessary measure RPE 30-min after physical or experimental session. Some studies measured RPE after 30-min for analyze session-RPE or internal training load. It’s suggested review this paragraph.

Reviewer #2: General Comments

This is a timely systematic review of the effects of mental fatigue on skilled performance in sport which I believe can have a good impact in the field. There are, however, several issues to be resolved before publication as explained in the specific comments. I also suggest the authors to have the whole manuscript reviewed by an English copyeditor as some terminology and phrases are often unusual and odd. Some parts are also unnecessary and can be eliminated (see specific comments).

Specific comments

INTRODUCTION

Although not entirely similar, the authors should include in their introduction and discussion reference to the literature review by Habay and colleagues 1 dealing with the effects of mental fatigue on psychomotor performance, including tests of skilled sport performance.

The paragraph on the single narrative review on sport-related performance can be eliminated or shortened

The psychobiological model proposed by Marcora is a model of endurance performance and cannot be transferred so easily to skilled sport performance. Although you can mention the (generally lack of) effect of mental fatigue on motivation, the most relevant explanations for the negative effects of mental fatigue on skilled sport performance are its effects on attention, inhibitory control, and other executive functions. In the context of skilled sport tasks, RPE is more an index of how much effort the athletes exerted during the tasks (which can be similar but with different performance outcomes due to mental fatigue) rather than a mechanism of impaired performance. So I suggest reducing the sections about the psychobiological model of endurance performance.

METHODS

One of the main methodological problems of this paper is the lack of proper operational definitions of the PICO criteria. Please provide in the revised manuscript. There should also be operational definitions for the categories you have used to analyse the results of the systematic review, e.g. level of the athletes, difference between offensive and defensive skills, etc. Fnally, you should also include information about the dates and language limits you used for the search.

RESULTS

In general, in the text I would like to see more quantitative information about the literature, for example absolute values and/or percentages of papers in relation to the analyses shown in Table 3.

DISCUSSION

Try not to repeat too much the results in the Discussion. Instead summarise and then compare the observed effects of mental fatigue with the effects of other related factors, e.g. i) the decline in technical performance between the first and second half of a soccer match, ii) the effects of sleep deprivation or iii) the effects of physical fatigue.

I also suggest that, for each skilled sport performance task, you identify some key executive functions and discuss literature from cognitive science on the effects of mental fatigue on these executive functions. Such discussion would provide a much better explanation of potential mechanisms than the current explanation based on the psycholobiological model which needs to be reduced in length and de-emphasised as the main explanation for the negative effects of mental fatigue on skilled sport performance (see also comments about the Introduction).

References

1. Habay, J. et al. Mental Fatigue and Sport-Specific Psychomotor Performance: A Systematic Review. Sports Med. (2021) doi:10.1007/s40279-021-01429-6.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Leonardo de Sousa Fortes

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Oct 14;16(10):e0258307. doi: 10.1371/journal.pone.0258307.r002

Author response to Decision Letter 0


2 Jul 2021

Thanks for giving valuable feedback regarding the manuscript. We greatly appreciate it. We have been able to incorporate changes to reflect most of the suggestions. After thorough considerations, we respond to each point including reviewer and editor comments in the attachment "Response to reviewers". Please have a look.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Daniel Boullosa

24 Sep 2021

Does mental fatigue affect skilled performance in athletes? A systematic review

PONE-D-21-04367R1

Dear Dr. Sun,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Daniel Boullosa

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript improved significantly. The authors answered all suggestions. The paper can be accepted. Congratulations for authors.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Leonardo de Sousa Fortes

Acceptance letter

Daniel Boullosa

29 Sep 2021

PONE-D-21-04367R1

Does mental fatigue affect skilled performance in athletes? A systematic review

Dear Dr. Sun:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Daniel Boullosa

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Detailed search strategy.

    (DOC)

    S2 Table. PRISMA 2009 checklist.

    (DOC)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES