Skip to main content
PLOS One logoLink to PLOS One
. 2020 Aug 25;15(8):e0236643. doi: 10.1371/journal.pone.0236643

Accelerometry as a method for external workload monitoring in invasion team sports. A systematic review

Carlos D Gómez-Carmona 1,*, Alejandro Bastida-Castillo 2,3, Sergio J Ibáñez 1, José Pino-Ortega 2
Editor: Cristina Cortis4
PMCID: PMC7447012  PMID: 32841239

Abstract

Accelerometry is a recent method used to quantify workload in team sports. A rapidly increasing number of studies supports the practical implementation of accelerometry monitoring to regulate and optimize training schemes. Therefore, the purposes of this study were: (1) to reflect the current state of knowledge about accelerometry as a method of workload monitoring in invasion team sports according to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines, and (2) to conclude recommendations for application and scientific investigations. The Web of Science, PubMed and Scopus databases were searched for relevant published studies according to the following keywords: “accelerometry” or “accelerometer” or “microtechnology” or “inertial devices”, and “load” or “workload”, and “sport”. Of the 1383 studies initially identified, 118 were selected for a full review. The main results indicate that the most frequent findings were (i) devices’ body location: scapulae; (b) devices brand: Catapult Sports; (iii) variables: PlayerLoadTM and its variations; (iv) sports: rugby, Australian football, soccer and basketball; (v) sex: male; (vi) competition level: professional and elite; and (vii) context: separate training or competition. A great number of variables and devices from various companies make the comparability between findings difficult; unification is required. Although the most common location is at scapulae because of its optimal signal reception for time-motion analysis, new methods for multi-location skills and locomotion assessment without losing tracking accuracy should be developed.

Introduction

Workload quantification is defined as the process of recording training and competition workload demands to regulate training volumes and intensities in athletes and to decrease the risk of injuries and overtraining [1]. These demands should not only be assessed overall but also individually as each player will respond differently to the same training workloads [2, 3]. Concerning workload quantification, sport science research differentiates between internal and external workload [4]. The internal workload is defined as the biological reaction of the athlete’s organism, both physiological and psychological, as a consequence of the external workload performed during exercise and it is measured through different variables like heart rate telemetry, blood lactate, oxygen consumption or rating of perceived exertion (RPE) [5]. In contrast, the external workload is defined as the mechanical and locomotor actions performed by an athlete, measured through various variables like power, speed, changes of speed, changes of direction or impacts [6]. Therefore, current literature suggests adopting strategies for quantifying and monitoring internal and external workload can enable team staff to assess fatigue and fitness level of players in real-time throughout the season [4, 7, 8].

At high levels in sports performance, coaches and sports scientists are constantly trying to find new ways for measuring athletes’ performance to obtain an advantage over their opponents [9]. However, training and competition activity and the developments of performance are extremely difficult to measure directly [10]. For this reason, sports professionals have found different methods for measuring the players’ workloads indirectly such as inertial measurement units (IMUs) for recording in a reliable and valid way compared to other instruments considered as “gold standard” or “criterion measures” [1113]. These instruments or diagnostic tests are considered the best available and most accurate under reasonable conditions (e.g. the gold standard for players tracking is video analysis but indirect methods can detect it with high accuracy as Global Navigation Satellite Systems, GNSS, Local Position Measurements, LPM or accelerometry).

In this sense, technological advances have allowed the development of different devices to obtain objective data in indoor and outdoor sports. Since 2001, the Australian Centre of Microtechnological Research through Project 2.5 “Technology of Communication to Athletes Monitoring” has been designing a unique and non-intrusive device for sports monitoring in real-time [14]. These devices are able to record external workload demands such as (a) total distance, (b) work zones concerning velocity or changes of speed, or (c) impacts performed by the athletes [15]. The incorporation of tri-axial accelerometers into these units has provided the opportunity to analyze new load parameters such as three axes acceleration recorded during sports movements, measured in arbitrary units (a.u.) [16].

The validity of accumulated accelerometry-based workload in the three planes of movement has been compared with other internal workload variables such as session RPE (sRPE) or the Edwards method, finding high correlations among indexes [17], and also with muscle oxygen saturation [18] or maximal oxygen uptake [19]. Previous research has also found satisfactory reliability results both in accelerometry-based workload [20, 21]. However, the workload recorded by accelerometers could be affected by the individualized profile of gait biomechanics or the speed of the athlete’s locomotion [22]. Nonetheless, accelerometry-based indexes have been used for workload monitoring in invasion team sports [23] such as netball [24, 25], soccer [17, 26], basketball [2730] and Australian football [31, 32], among others. Carey et al. [31] mentioned in a recent investigation that a multi-variable analysis should be carried out, where accelerometry-based indexes are incorporated with other external and internal workload indicators such as total distance covered, sRPE or high-intensity locomotion.

Since its appearance, the use of accelerometry as a method of workload monitoring has developed greatly. Although accelerometers do not provide information about static actions when an effort is performed without an acceleration (e.g. screenings or a prolonged stance position), their reliability, precision and sensitivity are greater compared to other automatic and semiautomatic time-motion analysis (TMA) technologies such as video-tracking, GNSS or LPM [26, 30]. Automatic and semiautomatic TMA may underestimate the workload demands because high-intensity actions where there is no locomotion (jumps, collisions, etc.) are classified in the group of low-intensity actions [26]. For these reasons, recent investigations identified that microtechnologies (e.g. wearable microsensors and accelerometers) may represent a valid and practical alternative to TMA and offer distinct advantages compared with TMA such as the relative simplification to analyze data using either proprietary or used-defined algorithms that quantify movement [30, 33]. Given this background, the purposes of the present study were to reflect the current state of knowledge, outline best practices and conclude recommendations about the use of accelerometry as a method of workload monitoring in invasion team sports.

Methods

Study design and search strategy

This manuscript is a systematic review [34] about peer-reviewed, scientific papers related to workload monitoring via accelerometry in sports. The Web of Science (Web of Science Core Collection, MEDLINE, Current Contents Connect, Derwent Innovations Index, KCI-Korean Journal Database, Russian Science Citation Index and Scielo Citation Index), PubMed electronics and Scopus electronic databases were searched on 1st May 2020 for relevant articles published between 1st January 2010 and 30th April 2020 using the keywords “accelerometer” or “accelerometry” or “microtechnology” or “inertial devices”, and “load” or “workload”, and “sport”. Reference lists of included articles were scanned to identify relevant studies. Any disagreements were resolved by consensus between two investigators and arbitration by a third investigator.

One investigator conducted electronic searches, identified relevant studies, and extracted data in an unblended, standardized manner. The database search was limited to peer-reviewed journal articles published in English. A systematic review of the available literature was undertaken in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [35] (Fig 1).

Fig 1. PRISMA flow diagram displaying the identification, screening, and selection of relevant studies in this systematic review.

Fig 1

In the present review the inclusion criteria for these articles were: (1) cross-sectional and longitudinal studies written in English, (2) participants were healthy players irrespective of competition level (amateur, well-trained, professional, elite, junior, senior) and sex (male and female), and (3) about invasion team sports following the classification of Read and Edwards [36] divided into three sports modalities: (a) goal throwing games (netball, basketball, handball and lacrosse), (b) try-scoring games (rugby, rugby union, Australian football and American football) and (c) goal striking games (hockey and soccer). Analysis during training or competition was not selected as an exclusion criterion. All included studies were deemed to have suitable ethical approval by a relevant review board.

Studies were excluded if (1) the type of document was case studies, doctoral thesis, books or book chapters, congress communications, patents or reviews, (2) they involved animals, (3) the workload monitoring was performed without accelerometry-based indexes, (4) the study context was outside competitive sports, and (5) they only assessed the reliability and validity of accelerometer raw data or accelerometry-based indexes.

Data extraction and analyzed variables

The Cochrane Consumers and Communication Review Group’s data extraction protocol [35] was used to extract the following information about studies that monitored external workload by accelerometry-based indexes in invasion team sports: (1) authors and date, (2) participant data (including sex and sample size), (3) description of the sport and competition level, ((4) type of session or sport context (training, competition, or both), (5) device and body location, (6) accelerometry-based indexes, (7) technical features of accelerometers (sample frequency, number of accelerometers 3D vs 2D, output range, and previous validity or reliability results), (8) main results and (9) referential values. This process was developed and tested with 10 randomly selected studies. First, one researcher extracted the data from the included studies and a second researcher then checked the extracted data. Disagreements were resolved by consensus.

Quality of the studies

The quality of the studies was evaluated with a risk-of-bias quality form used for quantitative studies developed by Law et al. [37] (S4 Table) and composed of 16 items in an evaluation process performed by five university full professors with a PhD in sport science and a large number of publications in the field of technology to monitoring sports performance in team sports. Cohen’s Kappa was calculated with 95% confidence interval to evaluate the inter-coders reliability and interpreted as: <0.20 poor, 0.21–0.40 fair, 0.41–0.60 moderate, 0.61–0.80 good, >0.80 very good [38].

Articles were assessed based on purpose (item 1), relevance of background literature (item 2), appropriateness of study design (item 3), sample studied (items 4 and 5), use of informed consent procedure (item 6), outcome measures (items 7 and 8), method description (item 9), significance of results (item 10), analysis (item 11), practical importance (item 12), description of dropouts (item 13), conclusions (item 14), practical implications (item 15), and limitations (item 16). All 16 quality criteria were rated on a binary scale (0/1), wherein two of those criteria (items 6 and 13) presented the option: ‘If not applicable, assume N/A’. The introduction of this option for items 6 ‘Was informed consent obtained?’ and 13 ‘Were any dropouts reported?’ was included because, in some studies, the investigators were not required to obtain informed consent (item 6) or report dropouts (item 13). The introduction of the option ‘not applicable’ allowed an appropriate score for the article, eliminating the negative effect of assuming the value ‘0’ on a binary scale, when in fact that specific item did not apply to that study. For this, the sum of the score of all items was divided by the number of relevant scored items for that specific research design. All articles were classified as (1) low methodological quality (<50%); (2) good methodological quality (51–75%), and (3) excellent methodological quality (>75%).

Results

Search, selection and inclusion of publications

1371 articles were identified from the Web of Science (n = 566), PubMed (n = 443) and Scopus (n = 443) database search. In addition, 12 articles identified and selected in previous database searching (30th June 2019) and not found on 1st May 2020 were included, being a total of 1383 articles. These studies were then exported to reference manager software (Zotero), and any duplicates (818 articles) were eliminated automatically. From the remaining 565 articles, 243 did not fulfill the inclusion criteria and were removed after revision of the abstract and another 204 after full-text assessment. At the end of the screening procedure, 118 articles remained for the systematic review related to the invasion team sports modality: (a) goal striking games (soccer and hockey; n = 25) [6, 26, 3961] (S1 Table), (b) goal throwing games (basketball, netball, lacrosse and handball; n = 33) (S2 Table) [8, 24, 25, 2729, 6288] and (c) try-scoring games (rugby, rugby union, rugby seven, Australian and American football; n = 60) [32, 89147] (S3 Table).

The main reasons for exclusion were individual sports (n = 59), reliability and validity analyses of raw data and workload indexes through accelerometry (n = 38), monitoring external workload without accelerometry-based indexes (n = 37) and non-competitive sports contexts (n = 33). Other reasons for exclusion included studies that analyzed physical conditioning tests (n = 16) and non-invasion team sports (n = 14).

Quality of the studies

To analyze the quality of the selected studies, the classification designed by Law et al. [37] that is shown as S4 Table was utilized. Previously to quality assessment, an inter-coder reliability analysis was performed, obtaining a value of 0.93 that represents a very good agreement between observers (Confidence interval 95%: 0.89 to 0.96). The main results of the quality indicators for the selected studies were as follows: (1) the average methodological quality score was 82.3%; (2) Two articles reached the maximum score of 100%; (3) no study obtained a score below 50%; (4) 33 studies obtained a score between 50% and 75% (good methodological quality); and (5), 83 articles reached a rating of >75% (excellent methodological quality).

Four items were mainly related with methodological deficiencies in the selected studies: (1) Criterion 5 where 84.6% of studies did not show an explicit justification of the study sample size; (2) Criterion 16 where 60.7% of articles did not clearly acknowledge the limitations of the study; (3) Criterion 8 where 66.9% did not report the validity of the accelerometry-based index of the device; and (4) Criterion 7 where 42.4% did not report the reliability of the device for accelerometry-based index measurement.

Scientific journals, sports context, competition level, sex and publication years

Fig 2 shows the scientific journals, sports context, sports level, sex and publication years of the selected studies that use accelerometry-based indexes for workload monitoring in invasion team sports. The trends of topic publications are shown in Fig 2A, where there exists an increasing number of publications with an exponential evolution from 2015. The 118 papers included in the systematic review were published in 27 different journals, with 59.3% appearing in 4 journals, each publishing at least ten articles (Fig 2B).

Fig 2.

Fig 2

(a) Research evolution, (b) scientific journals, (c) type of session, (d) competition level and (e) sex of participants in the selected studies that use accelerometry-based indexes for monitoring workload in sport.

Most of the studies analyzed competition (58 articles, 49%) or training (32 articles, 27%) separately, with only 24% of selected studies that analyzed both contexts (Fig 2C). Most of the reviewed papers analyzed elite (46 articles, 39%) and professional-level (37 articles, 31%) athletes, although studies in other levels as junior (19%), university (8%) and amateur (2%), and referees (1%) were also carried out (Fig 2D). Finally, 86% of selected studies were performed with males compared to 14% with females (Fig 2E).

Body location, devices and invasion team sports analyzed

Fig 3 shows the body location, devices and companies, indexes and invasion team sports analyzed by scientific studies through accelerometry-based workload indexes. The most common body location for evaluation was the scapulae (95.8%, 113/118), through MinimaxX (23.7%, 28/118) and Optimeye (33.9%, 40/118) devices in their different versions, developed by the Australian company Catapult Sports (64.4%, 76/118). Most papers were descriptive and assessed maximum accelerations (impacts, collisions) (21/118, 17,8%) or accumulated workload accelerometry-based indexes expressed as arbitrary units (a.u.) through different indexes related to the developer company of the device (16 indexes). Australian football (18.6%, 22/118), soccer (20.3%, 24/118), rugby (13.6%, 16/118) and basketball (16.9%, 20/118) were the most frequently investigated invasion team sports. In addition, impact and collisions were mostly assessed in try-scoring games, and Dynamic Stress Load, Locomotion efficiency, Impulse Load and PLRE in goal striking games (see Table 1 for definitions).

Fig 3. Classification of selected studies related to body location, device model and company, accelerometry-based workload indexes and invasion team sport.

Fig 3

Table 1. Accelerometry-based external workload variables utilized in the selected studies in this systematic review.

Index Description Units Developing company Formula
AcelT Root square of the sum of the accelerations in the three axes of movement. Meters per second square (m·s2) None (x2+y2+z2)
Body Load (BL) Accelerometry-load based index in the three axes of movement. Following steps are repeated for each acceleration value: (1) Initialize the Body Load count to 0; (2) Root square of the sum of the accelerations in the three axes of movement (x, y and z); (3) Normalize the magnitude vector by subtracting a notional 1G; (4) If the normalized value is less than 0.25G then go to step 2; (5) Calculate the unscaled Body Load (USBL) contribution for this acceleration vector; (6) Calculate the scaled Body load (SBL) considering the accelerometer logging rate (100 Hz) and Exercise Factor (EF); (7) Calculate the total Body Load as the accumulation of the scaled Body Load count. Arbitrary units (A.U.) GPS Sports 1. BL = 0
2. (ay2+ax2+az2)
3. NV = V– 1.0 G
5. USBL = NV + (NV)3
6. SBL = USBL / 100 / EF
7. BL + SBL
Body Load 2D (BL2D) Accelerometry-load based index in the two planes of movement (anteroposterior and mediolateral). Same steps as BL but not considering z-axis in the formula. Arbitrary units (A.U.) GPS Sports 2. (ay2+ax2)
Collisions For a collision to be detected, the unit was required to be in a nonvertical position, meaning the player was leaning forwards, backwards, or to the left or right. The instantaneous player load was calculated from the sum of the three axes of acceleration. A spike in the instantaneous player load shortly before the change in orientation of the unit was also required for the collision to be detected. Count (n) Catapult Not applicable
Dynamic Stress Load (DSL) It was calculated as the total of the weighted impacts. Impacts were weighted using a convex-shaped function (approximately a cubic function), an approach similar to the one used in the speed-intensity calculation, with the key concept being that an impact of 4g is more than twice as hard on the body as an impact of 2 g. The weighted impacts were totaled and finally scaled to give more workable values expressed in arbitrary units (AU). Arbitrary units (A.U.) StatSports Not provided
Impacts Using the magnitude of the 3-dimensional accelerometer values at any time point, impacts were identified as maximum accelerometer magnitude values above Xg in a 0.1-second period in relation to manufacturers’ specifications. Count (n) GPS Sports Not applicable
StatSports
GPS Sports: 6 ranges of impacts according to the impact intensity: very light (<5.0-6g), light to moderate (6.1–6.5), moderate to heavy (6.5–7.0), heavy impact (7.1–8.0), very heavy (8.1–10.0) and severe (over than 10.1g).
StatSports: Values above 2g.
RealTrack Systems: Configurable threshold from 1 to 1000 G.
IMA Application of polynomial smoothing curves between the start and end point of identified accelerative events. The magnitudes of such events are subsequently calculated by summing the accelerations under the polynomial curves, measured in terms of delta-velocity. Meters per second square (m·s2) Catapult Not provided
Impulse Load Sum of the forces in the medio-lateral, anterior-posterior and vertical plane in relation to gravity. Newtons (N) Zephyr Technology s=1nxs2+ys2+zs29.8067
Locomotion Efficiency To assess the within-match patterns of PlayerLoadTM and its individual planes in comparison to the locomotor activities, PLz was made relative to the total distance covered (TDC) as a measure of players locomotor efficiency. Arbitrary units (A.U.) Catapult (upt=i+1upt=i)2100TotalDistanceCovered
PlayerLoadTM (PLTM) Change in acceleration in the anterior-posterior (ax) medio-lateral (ay) and vertical (az) planes. Arbitrary units (A.U.) Catapult (fwdt=i+1fwdt=i)2+(sidet=i+1sidet=i)2+(upt=i+1upt=i)2100
PlayerLoadTM x-axis (PLx) Change in acceleration in the anterior-posterior (ax) plane. Arbitrary units (A.U.) Catapult (sidet=i+1sidet=i)2100
PlayerLoadTM y-axis (PLy) Change in acceleration in the medio-lateral (ay) plane. Arbitrary units (A.U.) Catapult (fwdt=i+1fwdt=i)2100
PlayerLoadTM z-axis (PLz) Change in acceleration in the vertical (az) plane. Arbitrary units (A.U.) Catapult (upt=i+1upt=i)2100
PlayerLoadTM 2D (PL2D) Change in acceleration in the anterio-posterior (ax) and medio-lateral (ay) plane. Arbitrary units (A.U.) Catapult (fwdt=i+1fwdt=i)2+(sidet=i+1sidet=i)2100
PlayerLoadTM slow (PLslow) Change in acceleration in the anterior-posterior (ax) medio-lateral (ay) and vertical (az) planes lower than 2G. Arbitrary units (A.U.) Catapult (fwdt=i+1fwdt=i)2+(sidet=i+1sidet=i)2+(upt=i+1upt=i)2100
Player LoadRT
(PLRT)
Vector sum of the Body accelerometric channel calculated through the sensorial fusion of inertial device sensors (accelerometer, gyroscope, magnetometer) in its 3 axes (vertical, anteroposterior and lateral). Arbitrary units (A.U.) RealTrack Systems PLn=(XnXn1)2+(YnYn1)2+(ZnZn1)2100
PLacummulated=n=0mPLnx0,01
Player LoadRE (PLRE) The player load is calculated and presented as a downscaled (i.e., divided by 800) value of the square sum of the high-passed filtered accelerometer values for the respective axes (X, Y, and Z). Arbitrary units (A.U.) ZXY SporTracking (x2+y2+z2)800
Total Load Total of the forces on the player over the entire session based on accelerometer data alone where aca is acceleration along the anterior-posterior axis, acl is acceleration along the lateral axis and acv is acceleration along the vertical axis, i is the current time and t is time. This is then scaled by 1000. Arbitrary units (A.U.) StatSports (acat=i+1acat=i)2+(aclt=i+1aclt=i)2+(acvt=i+1acvt=i)21000

Accelerometry technical features and based workload indexes

About technical features, 102 articles (86.4%) mentioned the sampling frequency of the accelerometers, being in all cases of 100 Hz, and the triaxial properties of the accelerometers (89.8%, 106/118). Instead, only 9 studies showed the number of accelerometers that composed the devices (4 accelerometers, 6.8%, 8/118; 3 accelerometers, 1/118). Respect to the reproducibility and the accuracy of the accelerometers, 41 articles not reported both aspects (34.75%), 37 articles reported the reliability (31.4%) and 10 reported the validity to measure the accelerometry-based workload index (8.5%). Only 30 articles reported the validity and reliability of the accelerometers that composed the inertial devices (25.4%).

Finally, Table 1 shows the accelerometry-based indexes utilized for workload monitoring with the developer company, description, measurement unit and formula for its calculation. The most frequently used is PlayerLoadTM (PLTM) developed by Catapult Sports (77 studies, 65.3%). Also, variations of the original formula such as accelerometry workload at low intensity (PLslow, 11 studies, 9.3%) and divided by axis such as PLx (14 studies, 11.9%), PLz (13 studies, 11.1%) and PLy (14 studies, 11.9%) were utilized (more details in Fig 3).

Discussion

This manuscript showed a general overview of the use of accelerometry as a method of workload monitoring in invasion team sports, including research evolution, journals, sport modalities and contexts, competition level, sex, device location, accelerometry-based variables and technical features. For this purpose, a systematic review was carried out of the articles related to the study topic [34, 35]. The main results show a rapidly increasing number of publications about accelerometry-based workload monitoring, where training and competition were analyzed separately, in elite and professional-level men, placing the device at the scapulae level and using the PLTM index in invasion team sports in outdoor and indoor conditions.

Competition vs. training

Most studies analyzed training and competition contexts separately (78%) so that only a limited number compared both contexts (22%). The interrelation between training and competition during sports seasons is essential to achieve the appropriate adaptations, maintain optimal players’ physical fitness and avoid the occurrence of injuries due to an irregular workload dynamic between both sports contexts [7, 28]. Therefore, the sports tasks selection concerning the purpose of the training sessions and workload planning during competitive microcycles is fundamental for sports performance [39, 148].

In this review, a total number of 28 publications were found that performed an external workload analysis through accelerometry-based indexes in training and competition. Most studies analyzed the overall weekly workload (training and competition) and did not provide distinct training and competition hours so that the normalization is not possible making their comparison difficult [32, 62, 63, 8992]. To solve this problem, different researches contain the workload related to playing time [39, 40, 6466]. Therefore, future researches should provide training and competition hours or present the workload indexes both total and relative to playing time to allow for comparison between sports contexts.

Four studies that compared both sport contexts found a higher workload in training than in competition [25, 40, 64, 65]; four other articles reported the opposite [39, 41, 66, 93]. Higher competition workload reported in some studies may be the consequence of differences in weekly schedules, not accounting for conditions (e.g. day after game (starting vs substitutes), strength and power capabilities, technical-tactical elements, activation drills) for further analysis. Gentles et al. [41] analyzed the average training session workload in comparison with competition in university-level female soccer players through Impulse Load (20120±8609 vs. 12410±4067). Montgomery et al. [66] assessed the differences between 5vs5 game-based tasks in training in comparison with competition through PL/min (2.79±0.58 vs 1.71±0.84). Ritchie et al. [93] found a greater workload in training compared with matches during the pre-season (PL: 1985±745 vs. 1010±290), and the opposite during the competitive season (PL: 1014±383 vs. 1320±195).

On the other hand, if each training session is analyzed specifically and is not masked by overall weekly workload demands, a higher workload than the competition can be found depending on the training session purpose. In this sense, Beenham et al. [40] found higher demands in 2vs2, 3vs3 and 4vs4 small-sided games in comparison with official matches in youth soccer measured by PL/min. Chandler et al. [65] and Fox et al. [64] showed a greater workload when the purpose of the training sessions was physical conditioning or game-based training in comparison with competition in women’s netball and men’s basketball respectively.

It is necessary for the best preparation of the player to understand physical and physiological stress during both training and competition [28, 66, 93]. A correct training session design related to the technical-tactical-physical purpose and the competition is important for workload managing during competitive microcycles [4, 5, 64]. In this sense, the use of effective strategies can help to anticipate the higher peak of performance in competition [67, 68, 94]. Also, it is important to monitor the player during all the training phases to assure the efficacy of the training effectiveness [9597]. For this purpose, combined monitoring of internal responses with external workload demands through different variables based on tracking systems or accelerometry allow workload monitoring in an objective way [4, 15], being fundamental the selection of suitable workload indexes crucial for their control and also a clear presentation of the results for better decision-making by the team staff [149].

Device location

In most of the analyzed studies, the inertial devices composed of tri-axial accelerometers for external workload monitoring in invasion team sports have been placed on the scapulae using an anatomically adjusted harness [8, 17, 26, 69, 93, 98, 99], except in a few studies where the companies recommend the location on the center of mass [2426, 29] or the sternum [41].

The device location in team sports has been on the scapulae as this place is the most acceptable for detecting position coordinates by GNSS (latitude/longitude) in outdoor conditions [15, 40], or horizontal LPM using radio-frequency systems in indoor conditions [150153]. Placing the device in a different location from the scapulae is sometimes selected because a body-worn accelerometer only measures the acceleration of the segment to which it is attached [154]. Thus, to detect more accurately the specific skills and workload of each sports discipline, accelerometers have been placed on different locations like the wrist in tennis [155], the head in swimming [156], the cockpit in kayak [157], the handlebar, seat or bike shank in cycling XCO-MTB [158, 159], or the tibia during running [19, 154, 160].

Therefore, if the aim is to record and measure specific events or skills, the device location should be the closest to the segment that performs the movement/action to achieve the highest accuracy [154]. Conversely, if the aim is to record and measure player tracking, the device must be placed on the scapulae to achieve the highest accuracy both in indoor and outdoor conditions [161164]. To combine both measures and achieve the highest accuracy in both aims, the proposed solution is the development of a system composed of two interconnected parts: (a) an inertial device or HUB (signal concentrator) located on the scapulae for tracking location and receiving the signal from (b) different micro-sensors (accelerometers, gyroscopes, etc.) placed on different anatomical locations to detect the specific accelerometry-based workload of each segment. These micro-sensors would send the signal to the HUB by wireless technology (Ant+, Bluetooth, among others) where it would be stored for subsequent analysis. In this way, a recent study proposed the monitoring of different body locations simultaneously (scapulae, lumbar region, knees and ankles) through multiple inertial devices that could be attached to the body with elastic bands and harness or with a specific one-piece sport jumpsuit with pockets [165].

Accelerometry-based workload indexes

Currently, from the raw data obtained by the accelerometer, the analysis of external workload is carried out from two main variables: impacts as a function of intensity ranges and PLTM in its different variants (2D, x-axis, y-axis, z-axis, slow). Workload quantification about the intensity of impacts has been used predominantly in rugby [92, 100103], soccer [42] and American football [99]. In rugby and American football the detection threshold is 10G [91, 92, 99, 103]. In soccer, the detection threshold is 5G, and the number of impacts ranges from 490±309.5 to 613.1±329.4 number of impacts [42]. In trying score games, a greater number of >5G impacts were found in rugby 895±325 [102], rugby union 1222±607 [103] and American football 951±192 [99]. This difference could be due to the lower intensity of physical contacts in soccer (disputes, tackles, charges) compared with rugby or American football (collisions, scrum, rucks, etc.), or different game duration and format. Therefore, it is important to analyze the specific demands of each sport modality and to adapt the indexes or threshold detection for an accuracy workload monitoring during training and competition contexts.

The most frequently used accelerometry-based index is PLTM, which represents the accumulative workload in the three axes of movement during all sessions. For the comparison between sports disciplines, the variable PLTM is normalized by total session time [min]. Studies that included time normalized PLTM reported different workloads across sports as soccer 10.18±2.12 [40] or 10.6–13.2±1.5–2.5 [43], netball 9.4–10.6±2.4–3.6 [70], MMA 15.37±1.71 [166], handball 9.18–9.76±0.6–1.4 [69], rugby union 7.6±0.6 [104], hockey 13.8–12.5±1.6–1.0 [44], lacrosse 7.6–9.9±1.5–2.7 [71], Australian football 15.1–16.3±0.9–1.4 [105] and rugby 7.2–10.4±0.8–2.0 [100]. These data confirm that each sport has specific demands regarding external workload, being the ranges as a consequence of the different playing positions. Therefore, it is necessary to analyze the competition workload to design the optimal stimulus during training sessions for sports performance enhancement.

Different investigations also use other PLTM-dependent variables such as their segmentation by axes (PLx, PLy, PLz) to analyze the specific contribution of each axis in the total workload on the technical-tactical skills or which axis is more related to fatigue during competition [40, 62, 65, 70, 106, 167]. Otherwise, PLslow quantifies the contribution of low-intensity workload (<2G) to the total workload of the players [90, 100, 104, 107, 108]. These two indexes allow higher accuracy and individualization of the demands performed by the athletes. The highest contribution to the external workload suffered by the athletes is from the vertical axis of movement, being over 50% of the total workload (y-axis > x-axis > z-axis). Also, the low-intensity workload represented between 35 and 50% of the cumulative PL. Therefore, the assessment of both indexes will be important for designing individualized technical-tactical-physical workloads and making possible the objective detection of players’ deficiencies and optimum performance value enhancement.

Finally, concerning the company that develops each device, other variables are found in sport sciences area such as Dynamic Stress Load [45], Body Load [109], Total Load [46], Force Load [32], Impulse Load [41], PLRT [27] or PLRE [26] to quantify the cumulative workload during training sessions or official matches in team sports. These indexes are based on the accelerometry raw data in the 3-axes of movement applying different algorithms and scaled values. This makes the comparability of data from different devices difficult [168]. The result is a very high to perfect correlation between accelerometry-based workload indexes with very large differences in absolute values [47].

Thanks to this great number of variables, it is possible to specifically analyze the accelerometry load in each sports discipline, both the accumulative load and the specific demands of skills/abilities, with the aim of individualizing the specific load in each sport in relation with player position or roles in competition. However, a consensus is necessary to be able to compare data among devices.

Accelerometer technical features

Most studies with the purpose to detect movement patterns in invasion team sports through accelerometers presented a sampling frequency of 100 Hz. This technical feature is important to ensure high data quality during data collection [169]. A lower sampling rate is related to lower accuracy [153]. For this reason, Migueles et al. [170] recommended the use of a minimum of 90 Hz when researchers are using the manufacturer methods, or 100 Hz when researchers are filtering and processing the signal on their own. Therefore, a sampling frequency of 100 Hz is enough to detect external workload in the three-axis of movement through accelerometers in team sports.

Other important technical features that should be considered are the planes of movement (2 planes x-y vs 3 planes x-y-z), the number of accelerometers that compose the device and the output range of each accelerometer. Most of the studies shown that triaxial accelerometers composed the inertial device used. This characteristic is fundamental to detect three-dimensional movement and, consequently, to calculate the external workload index, which requires the acceleration in the three axes [15, 47, 170]. On the other hand, only 9 studies specified the number of accelerometers used in the devices. The number of accelerometers is only important if the output range of each accelerometer is considered. WIMU PRO is composed of four accelerometers with specific output ranges ±16g, ±16g, ±32g and ± 400g [47, 48, 72] while Optimeye S5 is composed of three ±16g accelerometers [49]. This technical feature is very important due to the second device cannot detect the peak of force generated when a collision is over than 16g. Therefore, the number of accelerometers cannot be considered as a quality criterion without the output range of the accelerometers that compose the device. For this reason, both technical aspects should be described in the methods section to identify if the accelerometers can detect with high accuracy all movements or events evaluated (total workload and peak workload) during training and competition.

Finally, the most important technical feature is the validity and reliability of accelerometers. The reliability is the consistency of measure between devices and across time that allows the workload comparison between devices and between sessions, while the validity is the extent to which the scores actually represent the variable they are intended to [171]. In this systematic review, it is worrying that only 25.4% of the selected studies reported both validity and reliability, 31.4% only reliability and 8.5% only validity of accelerometers. Specifically, the validity and reliability of PL and MinimaxX [16, 19], PLRT and WIMU PRO [18, 21], Body Load and SPI-PRO [172] and Impulse Load and Zephyr Bioharness [173] have been evaluated previously. All devices and accelerometry-based variables presented satisfactory results, except BodyLoad [172].

Among studies that cited the reliability and validity of accelerometers, 15 investigations (i.e. 12.7%) cited the reliability and validity of other devices that were not used in their respective research. Investigations measured with Optimeye and Team 2.5 devices (Catapult Sports) [62, 67, 69, 73, 74, 104, 110112], ZXY Sportracking (Radionor Communications) [26], X8-mini (Gulfcoast Data Concept) [24, 25, 29], Actilife v12 (ActiGraph) [75], and Viper V2 (StatSport) [76] cited the validity study of Barrett et al. [19] and reliability of Boyd et al. [16] realized with MinimaxX devices (Catapult Sports). Noteworthy, 34.7% of the studies did not report the validity or reliability and did also not refer to literature findings for this purpose.

Therefore, the validity and reliability of the accelerometer-derived outcomes to determine how they can be effectively applied to individual and team sports is necessary. A consensus in this aspect should be reached for that companies need to assess their devices through an independent and standardized protocol that assure the accuracy and reproducibility of accelerometer-derived outcomes in different context and sports.

Sports modalities, sex and category

Most of the selected studies have been on Australian football, rugby, soccer and basketball. The rest of invasion team sports have aroused low research interest. Thanks to the Australian Centre of Microtechnological Research through the Project 2.5 “Technology of Communication to Athletes Monitoring” beginning to design a unique and non-intrusive device for sports monitoring in real-time in 2001 [14], the research topic has been centered on the most popular sports in this region (Australian football and rugby), developing specific variables such as impact/collision detection [92, 100103]. Later, from the results obtained and the high socioeconomic impact, this technology began to be used in the most popular sports in Europe and the United States such as soccer and basketball [6, 27, 29, 40, 50, 51, 63, 64].

This socioeconomic aspect is also found in the sports category and sex. The majority of studies were performed at the elite and professional-level (77%) with men players (87%). This has meant that numerous studies have analyzed the relationship between accelerometry-based workload indexes and low-cost objective and subjective monitoring methods due to the low economic resources in the rest of the categories. Different research has related the accelerometry-based indexes with heart rate workload indexes such as training impulse (TRIMPS), and Edwards or summated heart rate zones (SHRZ) finding very high to almost perfect validity values [8, 17, 64]. Besides, it also has been related to sRPE [17, 52, 63] or subjective tools such as Integral System of Training Task Analysis (SIATE) [53, 174] with high to very high correlation values. Therefore, due to the low economic resources in non-professional categories and women’s sports, these alternative methods could be used for workload monitoring subjectively, both at internal and external workload levels. In addition to finding alternative methods for workload monitoring, it is the task of researchers and professional teams to help knowledge development through research in these sports populations where the largest number of athletes and licenses are to be found.

Although there are existing correlations between accelerometry-based workload with external subjective (SIATE) and internal subjective (sRPE) and objective (TRIMPS, Edwards and SHRZ) workload indexes, the use of accelerometers is recommendable to quantify external workloads objectively. Their reliability, precision and sensitivity are greater compared to other external workload quantification systems such as automatic and semiautomatic time-motion analysis (video tracking, GNSS or LPM) [26, 30]. Automatic and semiautomatic TMA systems may underestimate the external workload demands because static high-intensity actions (jumps, collisions, etc.) are classified in the low-intensity actions group [26]. Therefore, recent investigations identified that microtechnologies (e.g. wearable microsensors and accelerometers) may represent a valid and practical alternative to TMA and offer distinct advantages compared with TMA such as the relative simplification to analyze data using either proprietary or used-defined algorithms that quantify movement, detect forces generated by the athlete related to gravity, the non-invasiveness, the measuring of internal and external workload simultaneously and the real-time feedback to minimize fatigue and injury risk while ultimately improving performance [18, 30, 33, 47, 149].

Limitations

While the results of this systematic review have provided a global overview of accelerometry-based workload demands in invasion team sports, considering multiple factors such as journals, context, categories, sex, body locations, brands and devices, technical features of accelerometers, variables and specific sports, some limitations to the study must be acknowledged. Firstly, only studies from Web of Science databases, PubMed and Scopus wrote in English were included, thereby potentially overlooking other relevant publications in other languages. Besides, although the study topic was invasion team sports, it would be interesting to include in a future systematic review all team and individual sports to achieve a better overview.

Conclusions and practical applications

This systematic review shows all studies that carried out workload monitoring through accelerometry-based indexes in invasion team sports during training and competition contexts. From the findings of the present systematic review, different conclusions could be shown:

  1. There has been an increase in workload monitoring through accelerometry-based indexes in training and competition, for which previous validity and reliability analysis is necessary both to evaluate the accuracy and allow comparison among and within units.

  2. A large number of accelerometry-based workload indexes were found depending on the device manufacturing companies. The most widely used is PLTM, but index unification among companies is required to be able to compare results among studies.

  3. The upper back (scapulae) is the most common body location used to place the inertial device on the players due to the better tracking signal reception by Global Navigation Satellite Systems in outdoor and Local Position Measurement in indoor conditions. New research should quantify the workload not only on the scapulae but in different body segments simultaneously in training and competition contexts in order to identify the real workload of the athlete during skill performance and sport locomotion more accurately.

Supporting information

S1 Table. Selected articles in goal striking games.

(DOCX)

S2 Table. Selected articles in goal throwing games.

(DOCX)

S3 Table. Selected articles in try-scoring games.

(DOCX)

S4 Table. Quality criteria used to analyze the quantitative publications (extracted from Law et al. [37]).

(DOCX)

S1 File. PRISMA 2009 checklist.

(DOC)

S2 File. Search database output.

(XLSX)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

The first author of the present study is a beneficiary of a grant from the Spanish Ministry of Science, Innovation and Universities (FPU17/00407). This study has been partially subsidized by the Aid for Research Groups (GR18170) from the Regional Government of Extremadura (Department of Employment, Companies and Innovation), with a contribution from the European Union through the European Funds for Regional Development. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Bourdon PC, Cardinale M, Murray A, Gastin P, Kellmann M, Varley MC, et al. Monitoring Athlete Training Loads: Consensus Statement. Int J Sports Physiol Perform. 2017;12:S2-161–S2-170. [DOI] [PubMed] [Google Scholar]
  • 2.Brink MS, Nederhof E, Visscher C, Schmikli SL, Lemmink KA. Monitoring load, recovery, and performance in young elite soccer players. J Strength Cond Res. 2010;24:597–603. 10.1519/JSC.0b013e3181c4d38b [DOI] [PubMed] [Google Scholar]
  • 3.Paulson TAW, Mason B, Rhodes J, Goosey-Tolfrey VL. Individualized Internal and External Training Load Relationships in Elite Wheelchair Rugby Players. Front Physiol. 2015;6:388 10.3389/fphys.2015.00388 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Akubat I, Barrett S, Abt G. Integrating the internal and external training loads in soccer. Int J Sports Physiol Perform. 2014;9:457–62. 10.1123/ijspp.2012-0347 [DOI] [PubMed] [Google Scholar]
  • 5.Halson SL. Monitoring Training Load to Understand Fatigue in Athletes. Sports Med. 2014;44:139–47. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Buchheit M, Lacome M, Cholley Y, Simpson BM. Neuromuscular Responses to Conditioned Soccer Sessions Assessed via GPS-Embedded Accelerometers: Insights Into Tactical Periodization. Int J Sports Physiol Perform. 2018;13:577–83. 10.1123/ijspp.2017-0045 [DOI] [PubMed] [Google Scholar]
  • 7.Gabbett TJ. The training—injury prevention paradox: should athletes be training smarter and harder? Br J Sports Med. 2016;50:273–280. 10.1136/bjsports-2015-095788 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Scanlan AT, Wen N, Tucker PS, Dalbo VJ. The relationships between internal and external training load models during basketball training. J Strength Cond Res. 2014;28:2397–2405. 10.1519/JSC.0000000000000458 [DOI] [PubMed] [Google Scholar]
  • 9.Barris S, Button C. A review of vision-based motion analysis in sport. Sports Med. 2008;38:1025–1043. 10.2165/00007256-200838120-00006 [DOI] [PubMed] [Google Scholar]
  • 10.Carling C, Reilly T, Williams AM. Performance assessment for field sports. London; New York: Routledge; 2009. [Google Scholar]
  • 11.Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998;26:217–238. 10.2165/00007256-199826040-00002 [DOI] [PubMed] [Google Scholar]
  • 12.Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–160. 10.1177/096228029900800204 [DOI] [PubMed] [Google Scholar]
  • 13.O’Donoghue P. Research methods for sports performance analysis. London: Routledge; 2010. [Google Scholar]
  • 14.Wu F, Zhang K, Zhu M, Mackintosh C, Rice T, Gore C, et al. An Investigation of an Integrated Low-cost GPS, INS and Magnetometer System for Sport Applications. Fort Worth, TX; 2007. p. 113–20. [Google Scholar]
  • 15.Cummins C, Orr R, O’Connor H, West C. Global Positioning Systems (GPS) and Microtechnology Sensors in Team Sports: A Systematic Review. Sports Med. 2013;43:1025–42. 10.1007/s40279-013-0069-2 [DOI] [PubMed] [Google Scholar]
  • 16.Boyd LJ, Ball K, Aughey RJ. The reliability of MinimaxX accelerometers for measuring physical activity in Australian football. Int J Sports Physiol Perform. 2011;6:311–321. 10.1123/ijspp.6.3.311 [DOI] [PubMed] [Google Scholar]
  • 17.Casamichana D, Castellano J, Calleja-Gonzalez J, San Román J, Castagna C. Relationship Between Indicators of Training Load in Soccer Players. J Strength Cond Res. 2013;27:369–74. 10.1519/JSC.0b013e3182548af1 [DOI] [PubMed] [Google Scholar]
  • 18.Gomez-Carmona CD, Bastida-Castillo A, González-Custodio A, Olcina G, Pino-Ortega J. Using an inertial device (WIMU PROTM) to quantify neuromuscular load in running: Reliability, convergent validity and the influence of type of surface and device location. J Strength Cond Res. 2019;34:365–373. [DOI] [PubMed] [Google Scholar]
  • 19.Barrett S, Midgley A, Lovell R. PlayerLoadTM: Reliability, Convergent Validity, and Influence of Unit Position during Treadmill Running. Int J Sports Physiol Perform. 2014;9:945–52. 10.1123/ijspp.2013-0418 [DOI] [PubMed] [Google Scholar]
  • 20.Johnston RJ, Watsford ML, Pine MJ, Spurrs RW, Murphy AJ, Pruyn EC. The validity and reliability of 5-Hz global positioning system units to measure team sport movement demands. J Strength Cond Res. 2012;26:758–765. 10.1519/JSC.0b013e318225f161 [DOI] [PubMed] [Google Scholar]
  • 21.Gómez-Carmona CD, Bastida-Castillo A, García-Rubio J, Ibáñez SJ, Pino-Ortega J. Static and dynamic reliability of WIMU PROTM accelerometers according to anatomical placement. Proc Inst Mech Eng Part P J Sports Eng Technol. 2019;233:238–48. [Google Scholar]
  • 22.Barreira P, Robinson MA, Drust B, Nedergaard N, Raja Azidin RMF, Vanrenterghem J. Mechanical Player Load using trunk-mounted accelerometry in football: Is it a reliable, task- and player-specific observation? J Sports Sci. 2017;35:1674–81. 10.1080/02640414.2016.1229015 [DOI] [PubMed] [Google Scholar]
  • 23.Read B, Edwards P. Blue Section. Introducing Formal Games. Teach Child Play Games. 1st edition. Leeds, UK: White Line Publishing Services; 1992. p. 61–5. [Google Scholar]
  • 24.Bailey JA, Gastin PB, Mackey L, Dwyer DB. The Player Load Associated with Typical Activities in Elite Netball. Int J Sports Physiol Perform. 2017;12:1218–1223. 10.1123/ijspp.2016-0378 [DOI] [PubMed] [Google Scholar]
  • 25.Young CM, Gastin PB, Sanders N, Mackey L, Dwyer DB. Player Load in Elite Netball: Match, Training, and Positional Comparisons. Int J Sports Physiol Perform. 2016;11:1074–1079. 10.1123/ijspp.2015-0156 [DOI] [PubMed] [Google Scholar]
  • 26.Dalen T, Jørgen I, Gertjan E, Havard HG, Ulrik W. Player Load, Acceleration, and Deceleration During Forty-Five Competitive Matches of Elite Soccer. J Strength Cond Res. 2016;30:351–359. 10.1519/JSC.0000000000001063 [DOI] [PubMed] [Google Scholar]
  • 27.Pino-Ortega J, Rojas-Valverde D, Gómez-Carmona CD, Bastida-Castillo A, Hernández-Belmonte A, García-Rubio J, et al. Impact of Contextual Factors on External Load During a Congested-Fixture Tournament in Elite U’18 Basketball Players. Front Psychol. 2019;10:1100 10.3389/fpsyg.2019.01100 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Reina M, García-Rubio J, Feu S, Ibáñez SJ. Training and competition load monitoring and analysis of women’s amateur basketball by playing position: approach study. Front Psychol. 2018;9:2689 10.3389/fpsyg.2018.02689 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Schelling X, Torres L. Accelerometer Load Profiles for Basketball-Specific Drills in Elite Players. J Sports Sci Med. 2016;15:585–591. [PMC free article] [PubMed] [Google Scholar]
  • 30.Fox JL, Scanlan AT, Stanton R. A Review of Player Monitoring Approaches in Basketball: Current Trends and Future Directions. J Strength Cond Res. 2017;31:2021–9. 10.1519/JSC.0000000000001964 [DOI] [PubMed] [Google Scholar]
  • 31.Carey DL, Blanch P, Ong K-L, Crossley KM, Crow J, Morris ME. Training loads and injury risk in Australian football—differing acute: chronic workload ratios influence match injury risk. Br J Sports Med. 2017;51:1215–1220. 10.1136/bjsports-2016-096309 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Colby MJ, Dawson B, Heasman J, Rogalski B, Gabbett TJ. Accelerometer and GPS-derived running loads and injury risk in elite Australian footballers. J Strength Cond Res. 2014;28:2244–2252. 10.1519/JSC.0000000000000362 [DOI] [PubMed] [Google Scholar]
  • 33.Ferioli D, Schelling X, Bosio A, La Torre A, Rucco D, Rampinini E. Match Activities in Basketball Games: Comparison Between Different Competitive Levels. J Strength Cond Res. 2020;34:172–182. 10.1519/JSC.0000000000003039 [DOI] [PubMed] [Google Scholar]
  • 34.Ato M, López-García JJ, Benavente A. Un sistema de clasificación de los diseños de investigación en psicología. An Psicol. 2013;29:1038–1059. [Google Scholar]
  • 35.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Read B, Edwards P. Blue Section. Invasion Games. Teach Child Play Games. 1st edition. Leeds, UK: White Line Publishing Services; 1992. p. 91–139. [Google Scholar]
  • 37.Law M, Stewart D, Pollock N, Letts L, Bosch J, Westmorland M. Critical review form: quantitative studies. Hamilton: MacMaster University; 1998. [Google Scholar]
  • 38.Landis JR, Koch GG. The Measurement of Observer Agreement for Categorical Data. Biometrics. 1977;33:159–74. [PubMed] [Google Scholar]
  • 39.Gómez-Carmona C, Gamonales J, Pino-Ortega J, Ibáñez S. Comparative Analysis of Load Profile between Small-Sided Games and Official Matches in Youth Soccer Players. Sports. 2018;6:173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Beenham M, Barron DJ, Fry J, Hurst HH, Figueirdo A, Atkins S. A Comparison of GPS Workload Demands in Match Play and Small-Sided Games by the Positional Role in Youth Soccer. J Hum Kinet. 2017;22:129–137. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Gentles J, Coniglio C, Besemer M, Morgan J, Mahnken M. The Demands of a Women’s College Soccer Season. Sports. 2018;6:16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Abade EA, Gonçalves BV, Leite NM, Sampaio JE. Time-Motion and Physiological Profile of Football Training Sessions Performed by Under-15, Under-17, and Under-19 Elite Portuguese Players. Int J Sports Physiol Perform. 2014;9:463–70. 10.1123/ijspp.2013-0120 [DOI] [PubMed] [Google Scholar]
  • 43.Trewin J, Meylan C, Varley MC, Cronin J. The match-to-match variation of match-running in elite female soccer. J Sci Med Sport. 2018;21:196–201. 10.1016/j.jsams.2017.05.009 [DOI] [PubMed] [Google Scholar]
  • 44.Polglaze T, Dawson B, Hiscock DJ, Peeling P. A Comparative Analysis of Accelerometer and Time–Motion Data in Elite Men’s Hockey Training and Competition. Int J Sports Physiol Perform. 2015;10:446–451. 10.1123/ijspp.2014-0233 [DOI] [PubMed] [Google Scholar]
  • 45.Gaudino P, Iaia FM, Strudwick AJ, Hawkins RD, Alberti G, Atkinson G, et al. Factors Influencing Perception of Effort (Session Rating of Perceived Exertion) during Elite Soccer Training. Int J Sports Physiol Perform. 2015;10:860–864. 10.1123/ijspp.2014-0518 [DOI] [PubMed] [Google Scholar]
  • 46.Bowen L, Gross AS, Gimpel M, Li F-X. Accumulated workloads and the acute:chronic workload ratio relate to injury risk in elite youth football players. Br J Sports Med. 2017;51:452–459. 10.1136/bjsports-2015-095820 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Gómez-Carmona CD, Pino-Ortega J, Sánchez-Ureña B, Ibáñez SJ, Rojas-Valverde D. Accelerometry-Based External Load Indicators in Sport: Too Many Options, Same Practical Outcome? Int J Environ Res Public Health. 2019;16:5101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Oliva-Lozano JM, Rojas-Valverde D, Gómez-Carmona CD, Fortes V, Pino-Ortega J. Impact Of Contextual Variables On The Representative External Load Profile Of Spanish Professional Soccer Match-Play: A Full Season Study. Eur J Sport Sci. 2020;Epub:Ahead of print. [DOI] [PubMed] [Google Scholar]
  • 49.Enes A, Oneda G, Alves DL, Palumbo D de P, Cruz R, Moiano Junior JVM, et al. Determinant Factors of the Match-Based Internal Load in Elite Soccer Players. Res Q Exerc Sport. 2020;Epub:Ahead of print. [DOI] [PubMed] [Google Scholar]
  • 50.Jones RN, Greig M, Mawéné Y, Barrow J, Page RM. The influence of short-term fixture congestion on position specific match running performance and external loading patterns in English professional soccer. J Sports Sci. 2019;37:1338–1346. 10.1080/02640414.2018.1558563 [DOI] [PubMed] [Google Scholar]
  • 51.Rabbani A, Kargarfard M, Castagna C, Clemente FM, Twist C. Associations Between Selected Training Stress Measures and Fitness Changes in Male Soccer Players. Int J Sports Physiol Perform. 2019;14:1050–1057. 10.1123/ijspp.2018-0462 [DOI] [PubMed] [Google Scholar]
  • 52.Winder N, Russell M, Naughton R, Harper L. The Impact of 120 Minutes of Match-Play on Recovery and Subsequent Match Performance: A Case Report in Professional Soccer Players. Sports. 2018;6:22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Gómez-Carmona CD, Gamonales-Puerto JM, Feu S, Ibáñez SJ. Study of internal and external load by different instruments. A case study in grassroots. Sport Sci J Sch Sport Phys Educ Psychomot. 2019;5:444–468. [Google Scholar]
  • 54.Barrett S, Midgley A, Reeves M, Joel T, Franklin E, Heyworth R, et al. The within-match patterns of locomotor efficiency during Professional Soccer match play: Implications for Injury risk? J Sci Med Sport. 2016;19:810–815. 10.1016/j.jsams.2015.12.514 [DOI] [PubMed] [Google Scholar]
  • 55.Barron DJ, Atkins S, Edmundson C, Fewtrell D. Accelerometer derived load according to playing position in competitive youth soccer. Int J Perform Anal Sport. 2014;14:734–743. [Google Scholar]
  • 56.Clemente FM. Associations between wellness and internal and external load variables in two intermittent small-sided soccer games. Physiol Behav. 2018;197:9–14. 10.1016/j.physbeh.2018.09.008 [DOI] [PubMed] [Google Scholar]
  • 57.Clemente FM, Praça GM, Bredt S da GT, Linden CMI van der, Serra-Olivares J. External Load Variations Between Medium- and Large-Sided Soccer Games: Ball Possession Games vs Regular Games with Small Goals. J Hum Kinet. 2019;70:191–198. 10.2478/hukin-2019-0031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Clemente FM, Rabbani A, Conte D, Castillo D, Afonso J, Truman Clark CC, et al. Training/Match External Load Ratios in Professional Soccer Players: A Full-Season Study. Int J Environ Res Public Health. 2019;16:3057. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.García-Ceberino JM, Antúnez A, Feu S, Ibáñez SJ. Quantification of Internal and External Load in School Football According to Gender and Teaching Methodology. Int J Environ Res Public Health. 2020;17:344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Reche-Soto P, Cardona-Nieto D, Diaz-Suarez A, Bastida-Castillo A, Gomez-Carmona C, Garcia-Rubio J, et al. Player Load and Metabolic Power Dynamics as Load Quantifiers in Soccer. J Hum Kinet. 2019;69:259–269. 10.2478/hukin-2018-0072 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Strauss A, Sparks M, Pienaar C. The Use of GPS Analysis to Quantify the Internal and External Match Demands of Semi-Elite Level Female Soccer Players during a Tournament. J Sports Sci Med. 2019;11:73–81. [PMC free article] [PubMed] [Google Scholar]
  • 62.Peterson KD, Quiggle GT. Tensiomyographical responses to accelerometer loads in female collegiate basketball players. J Sports Sci. 2017;35:2334–2341. 10.1080/02640414.2016.1266378 [DOI] [PubMed] [Google Scholar]
  • 63.Svilar L, Castellano J, Jukic I. Load monitoring system in top-level basketball team: relationship between external and internal training load. Kinesiology. 2018;50:25–33. [Google Scholar]
  • 64.Fox JL, Stanton R, Scanlan AT. A Comparison of Training and Competition Demands in Semiprofessional Male Basketball Players. Res Q Exerc Sport. 2018;89:103–111. 10.1080/02701367.2017.1410693 [DOI] [PubMed] [Google Scholar]
  • 65.Chandler PT, Pinder SJ, Curran JD, Gabbett TJ. Physical demands of training and competition in collegiate netball players. J Strength Cond Res. 2014;28:2732–2737. 10.1519/JSC.0000000000000486 [DOI] [PubMed] [Google Scholar]
  • 66.Montgomery PG, Pyne DB, Minahan CL. The Physical and Physiological Demands of Basketball Training and Competition. Int J Sports Physiol Perform. 2010;5:75–86. 10.1123/ijspp.5.1.75 [DOI] [PubMed] [Google Scholar]
  • 67.Alonso E, Miranda N, Zhang S, Sosa C, Trapero J, Lorenzo J, et al. Peak Match Demands in Young Basketball Players: Approach and Applications. Int J Environ Res Public Health. 2020;17:2256. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Graham S, Zois J, Aughey R, Duthie G. The peak player loadTM of state-level netball matches. J Sci Med Sport. 2020;23:189–193. 10.1016/j.jsams.2019.09.014 [DOI] [PubMed] [Google Scholar]
  • 69.Wik EH, Luteberget LS, Spencer M. Activity Profiles in International Women’s Team Handball Using PlayerLoad. Int J Sports Physiol Perform. 2017;12:934–942. 10.1123/ijspp.2015-0732 [DOI] [PubMed] [Google Scholar]
  • 70.Cormack SJ, Smith RL, Mooney MM, Young WB, O’Brien BJ. Accelerometer Load as a Measure of Activity Profile in Different Standards of Netball Match Play. Int J Sports Physiol Perform. 2014;9:283–291. 10.1123/ijspp.2012-0216 [DOI] [PubMed] [Google Scholar]
  • 71.Polley CS, Cormack SJ, Gabbett TJ, Polglaze T. Activity Profile of High-Level Australian Lacrosse Players: J Strength Cond Res. 2015;29:126–136. 10.1519/JSC.0000000000000599 [DOI] [PubMed] [Google Scholar]
  • 72.Fernández-Leo A, Gómez-Carmona CD, García-Rubio J, Ibáñez SJ. Influence of Contextual Variables on Physical and Technical Performance in Male Amateur Basketball: A Case Study. Int J Environ Res Public Health. 2020;17:1193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Fox J, O’Grady C, Scanlan AT. Game schedule congestion affects weekly workloads but not individual game demands in semi-professional basketball. Biol Sport. 2020;37:59–67. 10.5114/biolsport.2020.91499 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Heishman A, Miller RM, Freitas EDS, Brown BS, Daub BD, Bemben MG. Monitoring External Training Loads and Neuromuscular Performance For Division I Basketball Players Over the Pre-Season. J Sports Sci Med. 2020;19:204–212. [PMC free article] [PubMed] [Google Scholar]
  • 75.Staunton C, Wundersitz D, Gordon B, Kingsley M. Accelerometry-Derived Relative Exercise Intensities in Elite Women’s Basketball. Int J Sports Med. 2018;39:822–827. 10.1055/a-0637-9484 [DOI] [PubMed] [Google Scholar]
  • 76.Vázquez-Guerrero J, Suarez-Arrones L, Casamichana Gómez D, Rodas G. Comparing external total load, acceleration and deceleration outputs in elite basketball players across positions during match play. Kinesiology. 2018;50:228–234. [Google Scholar]
  • 77.Birdsey LP, Weston M, Russell M, Johnston M, Cook CJ, Kilduff LP. Neuromuscular, physiological and perceptual responses to an elite netball tournament. J Sports Sci. 2019;37:2169–2174. 10.1080/02640414.2019.1625613 [DOI] [PubMed] [Google Scholar]
  • 78.Brooks ER, Benson AC, Fox AS, Bruce LM. Physical movement demands of elite-level netball match-play as measured by an indoor positioning system. J Sports Sci. 2020;Epub:ahead of print. [DOI] [PubMed] [Google Scholar]
  • 79.Fox JL, Stanton R, Sargent C, O’Grady CJ, Scanlan AT. The Impact of Contextual Factors on Game Demands in Starting, Semiprofessional, Male Basketball Players. Int J Sports Physiol Perform. 2020;15:450–456. [DOI] [PubMed] [Google Scholar]
  • 80.García-Santos D, Pino-Ortega J, García-Rubio J, Vaquera A, Ibáñez SJ. Internal and External Demands in Basketball Referees during the U-16 European Women’s Championship. Int J Environ Res Public Health. 2019;16:3421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Heishman A, Peak K, Miller R, Brown B, Daub B, Freitas E, et al. Associations Between Two Athlete Monitoring Systems Used to Quantify External Training Loads in Basketball Players. Sports. 2020;8:33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.King DA, Cummins C, Hume PA, Clark TN. Physical Demands of Amateur Domestic and Representative Netball in One Season in New Zealand Assessed Using Heart Rate and Movement Analysis. J Strength Cond Res. 2018;Epub:ahead of print. [DOI] [PubMed] [Google Scholar]
  • 83.Kniubaite A, Skarbalius A, Clemente FM, Conte D. Quantification of external and internal match loads in elite female team handball. Biol Sport. 2019;36:311–316. 10.5114/biolsport.2019.88753 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Mancha-Triguero D, Reina M, Baquero B, García-Rubio J, Ibáñez SJ. Analysis of the competitive load in u16 handballers as a function of the final result. E-Balonmano Com Rev Cienc Deporte. 2018;14:99–108. [Google Scholar]
  • 85.O’Grady CJ, Dalbo VJ, Teramoto M, Fox JL, Scanlan AT. External Workload Can Be Anticipated During 5 vs. 5 Games-Based Drills in Basketball Players: An Exploratory Study. Int J Environ Res Public Health. 2020;17:2103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Portes R, Jiménez SL, Navarro RM, Scanlan AT, Gómez M-Á. Comparing the External Loads Encountered during Competition between Elite, Junior Male and Female Basketball Players. Int J Environ Res Public Health. 2020;17:1456. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.van Gogh MJ, Wallace LK, Coutts AJ. Positional Demands and Physical Activity Profiles of Netball: J Strength Cond Res. 2020;34:1422–1430. 10.1519/JSC.0000000000002388 [DOI] [PubMed] [Google Scholar]
  • 88.Vázquez-Guerrero J, Fernández-Valdés B, Gonçalves B, Sampaio JE. Changes in Locomotor Ratio During Basketball Game Quarters From Elite Under-18 Teams. Front Psychol. 2019;10:2163 10.3389/fpsyg.2019.02163 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Graham SR, Cormack S, Parfitt G, Eston R. Relationships Between Model Predicted and Actual Match Performance in Professional Australian Footballers During an In-Season Training Macrocycle. Int J Sports Physiol Perform. 2018;13:339–346. 10.1123/ijspp.2017-0026 [DOI] [PubMed] [Google Scholar]
  • 90.Boyd LJ, Ball K, Aughey RJ. Quantifying external load in Australian football matches and training using accelerometers. Int J Sports Physiol Perform. 2013;8:44–51. 10.1123/ijspp.8.1.44 [DOI] [PubMed] [Google Scholar]
  • 91.Gabbett T, Jenkins D, Abernethy B. Physical collisions and injury during professional rugby league skills training. J Sci Med Sport. 2010;13:578–583. 10.1016/j.jsams.2010.03.007 [DOI] [PubMed] [Google Scholar]
  • 92.Gabbett T. Quantifying the Physical Demands of Collision Sports: Does Microsensor Technology Measure What It Claims to Measure? J Strength Cond Res. 2013;27:2319–2322. 10.1519/JSC.0b013e318277fd21 [DOI] [PubMed] [Google Scholar]
  • 93.Ritchie D, Hopkins WG, Buchheit M, Cordy J, Bartlett JD. Quantification of Training and Competition Load across a Season in an Elite Australian Football Club. Int J Sports Physiol Perform. 2016;11:474–479. 10.1123/ijspp.2015-0294 [DOI] [PubMed] [Google Scholar]
  • 94.Johnston RD, Murray NB, Austin DJ, Duthie G. Peak Movement and Technical Demands of Professional Australian Football Competition. J Strength Cond Res. 2019;Epub:Ahead of Print. [DOI] [PubMed] [Google Scholar]
  • 95.Wellman AD, Coad SC, Flynn PJ, Siam TK, McLellan CP. Comparison of Preseason and In-Season Practice and Game Loads in National Collegiate Athletic Association Division I Football Players: J Strength Cond Res. 2019;33:1020–1027. [DOI] [PubMed] [Google Scholar]
  • 96.Cummins C, McLean B, Halaki M, Orr R. Positional Differences in External On-Field Load During Specific Drill Classifications Over a Professional Rugby League Preseason. Int J Sports Physiol Perform. 2017;12:764–776. 10.1123/ijspp.2015-0789 [DOI] [PubMed] [Google Scholar]
  • 97.Johnston RD, Murray NB, Austin DJ. The influence of pre-season training loads on in-season match activities in professional Australian football players. Sci Med Footb. 2019;3:143–149. [Google Scholar]
  • 98.Gibson NE, Boyd AJ, Murray AM. Countermovement jump is not affected during final competition preparation periods in elite rugby sevens players. J Strength Cond Res. 2016;30:777–783. 10.1519/JSC.0000000000001156 [DOI] [PubMed] [Google Scholar]
  • 99.Wellman AD, Coad SC, Goulet GC, Coffey VG, McLellan CP. Quantification of Accelerometer Derived Impacts Associated With Competitive Games in NCAA Division I College Football Players. J Strength Cond Res. 2017;31:330–338. 10.1519/JSC.0000000000001506 [DOI] [PubMed] [Google Scholar]
  • 100.Gabbett T. Relationship Between Accelerometer Load, Collisions, and Repeated High-Intensity Effort Activity in Rugby League Players: J Strength Cond Res. 2015;29:3424–3431. 10.1519/JSC.0000000000001017 [DOI] [PubMed] [Google Scholar]
  • 101.Gabbett TJ, Seibold AJ. Relationship between tests of physical qualities, team selection, and physical match performance in semiprofessional rugby league players. J Strength Cond Res. 2013;27:3259–3265. 10.1519/JSC.0b013e31828d6219 [DOI] [PubMed] [Google Scholar]
  • 102.McLellan CP, Lovell DI. Neuromuscular responses to impact and collision during elite rugby league match play. J Strength Cond Res. 2012;26:1431–1440. 10.1519/JSC.0b013e318231a627 [DOI] [PubMed] [Google Scholar]
  • 103.Suárez-Arrones LJ, Portillo LJ, González-Ravé JM, Muñoz VE, Sanchez F. Match running performance in Spanish elite male rugby union using global positioning system. Isokinet Exerc Sci. 2012;20:77–83. [Google Scholar]
  • 104.Read DB, Jones B, Phibbs PJ, Roe GAB, Darrall-Jones JD, Weakley JJS, et al. Physical Demands of Representative Match-Play in Adolescent Rugby Union: J Strength Cond Res. 2017;31:1290–1296. 10.1519/JSC.0000000000001600 [DOI] [PubMed] [Google Scholar]
  • 105.Mooney M, Cormack S, O’Brien B, Coutts AJ. Do physical capacity and interchange rest periods influence match exercise-intensity profile in Australian football? Int J Sports Physiol Perform. 2013;8:165–172. 10.1123/ijspp.8.2.165 [DOI] [PubMed] [Google Scholar]
  • 106.Cormack SJ, Mooney MG, Morgan W, McGuigan MR. Influence of neuromuscular fatigue on accelerometer load in elite Australian football players. Int J Sports Physiol Perform. 2013;8:373–378. 10.1123/ijspp.8.4.373 [DOI] [PubMed] [Google Scholar]
  • 107.Gallo T, Cormack S, Gabbett T, Williams M, Lorenzen C. Characteristics impacting on session rating of perceived exertion training load in Australian footballers. J Sports Sci. 2015;33:467–475. 10.1080/02640414.2014.947311 [DOI] [PubMed] [Google Scholar]
  • 108.Roe G, Halkier M, Beggs C, Till K, Jones B. The Use of Accelerometers to Quantify Collisions and Running Demands of Rugby Union Match-Play. Int J Perform Anal Sport. 2016;16:590–601. [Google Scholar]
  • 109.Cunniffe B, Proctor W, Baker JS, Davies B. An evaluation of the physiological demands of elite rugby union using global positioning system tracking software. J Strength Cond Res. 2009;23:1195–1203. 10.1519/JSC.0b013e3181a3928b [DOI] [PubMed] [Google Scholar]
  • 110.Johnston RD, Gabbett TJ, Jenkins DG, Hulin BT. Influence of physical qualities on post-match fatigue in rugby league players. J Sci Med Sport. 2015;18:209–213. 10.1016/j.jsams.2014.01.009 [DOI] [PubMed] [Google Scholar]
  • 111.Rowell AE, Aughey RJ, Clubb J, Cormack SJ. A Standardized Small Sided Game Can Be Used to Monitor Neuromuscular Fatigue in Professional A-League Football Players. Front Physiol. 2018;9:1011 10.3389/fphys.2018.01011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 112.Phibbs PJ, Jones B, Read DB, Roe GAB, Darrall-Jones J, Weakley JJS, et al. The appropriateness of training exposures for match-play preparation in adolescent schoolboy and academy rugby union players. J Sports Sci. 2018;36:704–709. 10.1080/02640414.2017.1332421 [DOI] [PubMed] [Google Scholar]
  • 113.Bayliff GE, Jacobson BH, Moghaddam M, Estrada C. Global Positioning System Monitoring of Selected Physical Demands of NCAA Division I Football Players During Games: J Strength Cond Res. 2019;33:1185–1191. 10.1519/JSC.0000000000003137 [DOI] [PubMed] [Google Scholar]
  • 114.Carey DL, Ong K, Whiteley R, Crossley KM, Crow J, Morris ME. Predictive Modelling of Training Loads and Injury in Australian Football. Int J Comput Sci Sport. 2018;17:49–66. [Google Scholar]
  • 115.Coad S, Gray B, McLellan C. Seasonal Analysis of Mucosal Immunological Function and Physical Demands in Professional Australian Rules Footballers. Int J Sports Physiol Perform. 2016;11:574–580. 10.1123/ijspp.2015-0242 [DOI] [PubMed] [Google Scholar]
  • 116.Coad S, Gray B, Wehbe G, McLellan C. Physical Demands and Salivary Immunoglobulin a Responses of Elite Australian Rules Football Athletes to Match Play. Int J Sports Physiol Perform. 2015;10:613–617. 10.1123/ijspp.2014-0493 [DOI] [PubMed] [Google Scholar]
  • 117.Cummins C, Welch M, Inkster B, Cupples B, Weaving D, Jones B, et al. Modelling the relationships between volume, intensity and injury-risk in professional rugby league players. J Sci Med Sport. 2019;22:653–660. 10.1016/j.jsams.2018.11.028 [DOI] [PubMed] [Google Scholar]
  • 118.Davies MJ, Young W, Farrow D, Bahnert A. Comparison of agility demands of small-sided games in elite Australian football. Int J Sports Physiol Perform. 2013;8:139–147. 10.1123/ijspp.8.2.139 [DOI] [PubMed] [Google Scholar]
  • 119.Esmaeili A, Hopkins WG, Stewart AM, Elias GP, Lazarus BH, Aughey RJ. The Individual and Combined Effects of Multiple Factors on the Risk of Soft Tissue Non-contact Injuries in Elite Team Sport Athletes. Front Physiol. 2018;9:1280 10.3389/fphys.2018.01280 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 120.Fleay B, Joyce C, Banyard H, Woods CT. Manipulating Field Dimensions During Small-sided Games Impacts the Technical and Physical Profiles of Australian Footballers: J Strength Cond Res. 2018;32:2039–2044. 10.1519/JSC.0000000000002423 [DOI] [PubMed] [Google Scholar]
  • 121.Gallo TF, Cormack SJ, Gabbett TJ, Lorenzen CH. Pre-training perceived wellness impacts training output in Australian football players. J Sports Sci. 2016;34:1445–1451. 10.1080/02640414.2015.1119295 [DOI] [PubMed] [Google Scholar]
  • 122.Gastin PB, McLean O, Spittle M, Breed RVP. Quantification of tackling demands in professional Australian football using integrated wearable athlete tracking technology. J Sci Med Sport. 2013;16:589–593. 10.1016/j.jsams.2013.01.007 [DOI] [PubMed] [Google Scholar]
  • 123.Garrett J, Graham SR, Eston RG, Burgess DJ, Garrett LJ, Jakeman J, et al. A Novel Method of Assessment for Monitoring Neuromuscular Fatigue Within Australian Rules Football Players. Int J Sports Physiol Perform. 2019;14:598–605. 10.1123/ijspp.2018-0253 [DOI] [PubMed] [Google Scholar]
  • 124.Goodale TL, Gabbett TJ, Tsai M-C, Stellingwerff T, Sheppard J. The Effect of Contextual Factors on Physiological and Activity Profiles in International Women’s Rugby Sevens. Int J Sports Physiol Perform. 2017;12:370–376. 10.1123/ijspp.2015-0711 [DOI] [PubMed] [Google Scholar]
  • 125.Govus AD, Coutts A, Duffield R, Murray A, Fullagar H. Relationship Between Pretraining Subjective Wellness Measures, Player Load, and Rating-of-Perceived-Exertion Training Load in American College Football. Int J Sports Physiol Perform. 2018;13:95–101. 10.1123/ijspp.2016-0714 [DOI] [PubMed] [Google Scholar]
  • 126.Highton J, Mullen T, Norris J, Oxendale C, Twist C. The Unsuitability of Energy Expenditure Derived From Microtechnology for Assessing Internal Load in Collision-Based Activities. Int J Sports Physiol Perform. 2017;12:264–267. 10.1123/ijspp.2016-0069 [DOI] [PubMed] [Google Scholar]
  • 127.Hogarth LW, Burkett BJ, McKean MR. Influence of Yo-Yo IR2 Scores on Internal and External Workloads and Fatigue Responses of Tag Football Players during Tournament Competition. Fisher G, editor. PLOS ONE. 2015;10:e0140547 10.1371/journal.pone.0140547 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 128.Johnston RD, Devlin P, Wade JA, Duthie GM. There Is Little Difference in the Peak Movement Demands of Professional and Semi-Professional Rugby League Competition. Front Physiol. 2019;10:1285 10.3389/fphys.2019.01285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 129.Jones M, West D, Crewther B, Cook C, Kilduf L. Quantifying positional and temporal movement patterns in professional rugby union using global positioning system. Eur J Sport Sci. 2015; 15:488–496. 10.1080/17461391.2015.1010106 [DOI] [PubMed] [Google Scholar]
  • 130.Kempton T, Sullivan C, Bilsborough JC, Cordy J, Coutts AJ. Match-to-match variation in physical activity and technical skill measures in professional Australian Football. J Sci Med Sport. 2015;18:109–113. 10.1016/j.jsams.2013.12.006 [DOI] [PubMed] [Google Scholar]
  • 131.Li RT, Salata MJ, Rambhia S, Sheehan J, Voos JE. Does Overexertion Correlate With Increased Injury? The Relationship Between Player Workload and Soft Tissue Injury in Professional American Football Players Using Wearable Technology. Sports Health Multidiscip Approach. 2020;12:66–73. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 132.McLaren SJ, Weston M, Smith A, Cramb R, Portas MD. Variability of physical performance and player match loads in professional rugby union. J Sci Med Sport. 2016;19:493–497. 10.1016/j.jsams.2015.05.010 [DOI] [PubMed] [Google Scholar]
  • 133.Murray A, Buttfield A, Simpkin A, Sproule J, Turner AP. Variability of within-step acceleration and daily wellness monitoring in Collegiate American Football. J Sci Med Sport. 2019;22:488–493. 10.1016/j.jsams.2018.10.013 [DOI] [PubMed] [Google Scholar]
  • 134.Owen SM, Venter RE, du Toit S, Kraak WJ. Acceleratory match-play demands of a Super Rugby team over a competitive season. J Sports Sci. 2015;33:2061–2069. 10.1080/02640414.2015.1028086 [DOI] [PubMed] [Google Scholar]
  • 135.Phibbs PJ, Jones B, Roe GA, Read DB, Darrall-Jones J, Weakley JJ, et al. We know they train, but what do they do? Implications for coaches working with adolescent rugby union players. Int J Sports Sci Coach. 2017;12:175–182. [Google Scholar]
  • 136.Phibbs PJ, Jones B, Roe G, Read DB, Darrall-Jones J, Weakley J, et al. Organized Chaos in Late Specialization Team Sports: Weekly Training Loads of Elite Adolescent Rugby Union Players. J Strength Cond Res. 2018;32:1316–1323. 10.1519/JSC.0000000000001965 [DOI] [PubMed] [Google Scholar]
  • 137.Read DB, Jones B, Phibbs PJ, Roe GAB, Darrall-Jones J, Weakley JJS, et al. The physical characteristics of match-play in English schoolboy and academy rugby union. J Sports Sci. 2018;36:645–650. 10.1080/02640414.2017.1329546 [DOI] [PubMed] [Google Scholar]
  • 138.Roe G, Darrall-Jones J, Till K, Phibbs P, Read D, Weakley J, et al. The effect of physical contact on changes in fatigue markers following rugby union field-based training. Eur J Sport Sci. 2017;17:647–655. 10.1080/17461391.2017.1287960 [DOI] [PubMed] [Google Scholar]
  • 139.Rowell AE, Aughey RJ, Hopkins WG, Stewart AM, Cormack SJ. Identification of Sensitive Measures of Recovery After External Load From Football Match Play. Int J Sports Physiol Perform. 2017;12:969–976. 10.1123/ijspp.2016-0522 [DOI] [PubMed] [Google Scholar]
  • 140.Sullivan C, Bilsborough JC, Cianciosi M, Hocking J, Cordy J, Coutts AJ. Match score affects activity profile and skill performance in professional Australian Football players. J Sci Med Sport. 2014;17:326–331. 10.1016/j.jsams.2013.05.001 [DOI] [PubMed] [Google Scholar]
  • 141.Tee JC, Coopoo Y, Lambert M. Pacing characteristics of whole and part-game players in professional rugby union. Eur J Sport Sci. 2019;Epub:ahead of print. [DOI] [PubMed] [Google Scholar]
  • 142.Twist C, Highton J, Daniels M, Mill N, Close G. Player Responses to Match and Training Demands During an Intensified Fixture Schedule in Professional Rugby League: A Case Study. Int J Sports Physiol Perform. 2017;12:1093–1099. 10.1123/ijspp.2016-0390 [DOI] [PubMed] [Google Scholar]
  • 143.Ward PA, Ramsden S, Coutts AJ, Hulton AT, Drust B. Positional Differences in Running and Nonrunning Activities During Elite American Football Training: J Strength Cond Res. 2018;32:2072–2084. 10.1519/JSC.0000000000002294 [DOI] [PubMed] [Google Scholar]
  • 144.Weaving D, Marshall P, Earle K, Nevill A, Abt G. Combining Internal- and External-Training-Load Measures in Professional Rugby League. Int J Sports Physiol Perform. 2014;9:905–912. 10.1123/ijspp.2013-0444 [DOI] [PubMed] [Google Scholar]
  • 145.Weaving D, Jones B, Marshall P, Till K, Abt G. Multiple Measures are Needed to Quantify Training Loads in Professional Rugby League. Int J Sports Med. 2017;38:735–740. 10.1055/s-0043-114007 [DOI] [PubMed] [Google Scholar]
  • 146.Weaving D, Dalton NE, Black C, Darrall-Jones J, Phibbs PJ, Gray M, et al. The Same Story or a Unique Novel? Within-Participant Principal-Component Analysis of Measures of Training Load in Professional Rugby Union Skills Training. Int J Sports Physiol Perform. 2018;13:1175–1181. 10.1123/ijspp.2017-0565 [DOI] [PubMed] [Google Scholar]
  • 147.Yamamoto H, Takemura M, Iguchi J, Tachibana M, Tsujita J, Hojo T. In-match physical demands on elite Japanese rugby union players using a global positioning system. BMJ Open Sport Exerc Med. 2020;6:e000659 10.1136/bmjsem-2019-000659 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 148.Martin-Garcia AS, Diaz AGM, Bradley PS, Morera F, Casamichana D. Quantification of a professional football team’s external load using a microcycle structure. J Strength Cond Res. 2018;32:3511–3518. 10.1519/JSC.0000000000002816 [DOI] [PubMed] [Google Scholar]
  • 149.Rojas-Valverde D, Gómez-Carmona CD, Gutiérrez-Vargas R, Pino-Ortega J. From big data mining to technical sport reports: the case of inertial measurement units. BMJ Open Sport Exerc Med. 2019;5:e000565 10.1136/bmjsem-2019-000565 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 150.Bastida Castillo A, Gómez Carmona CD, De la Cruz Sánchez E, Pino Ortega J. Accuracy, intra- and inter-unit reliability, and comparison between GPS and UWB-based position-tracking systems used for time–motion analyses in soccer. Eur J Sport Sci. 2018;18:450–457. 10.1080/17461391.2018.1427796 [DOI] [PubMed] [Google Scholar]
  • 151.Frencken WGP, Lemmink KAPM, Delleman NJ. Soccer-specific accuracy and validity of the local position measurement (LPM) system. J Sci Med Sport. 2010;13:641–645. 10.1016/j.jsams.2010.04.003 [DOI] [PubMed] [Google Scholar]
  • 152.Leser R, Schleindlhuber A, Lyons K, Baca A. Accuracy of an UWB-based position tracking system used for time-motion analyses in game sports. Eur J Sport Sci. 2014;14:635–642. 10.1080/17461391.2014.884167 [DOI] [PubMed] [Google Scholar]
  • 153.Stevens TGA, de Ruiter CJ, van Niel C, van de Rhee R, Beek PJ, Savelsbergh GJP. Measuring Acceleration and Deceleration in Soccer-Specific Movements Using a Local Position Measurement (LPM) System. Int J Sports Physiol Perform. 2014;9:446–456. 10.1123/ijspp.2013-0340 [DOI] [PubMed] [Google Scholar]
  • 154.Nedergaard NJ, Robinson MA, Eusterwiemann E, Drust B, Lisboa PJ, Vanrenterghem J. The Relationship Between Whole-Body External Loading and Body-Worn Accelerometry During Team-Sport Movements. Int J Sports Physiol Perform. 2017;12:18–26. 10.1123/ijspp.2015-0712 [DOI] [PubMed] [Google Scholar]
  • 155.Whiteside D, Cant O, Connolly M, Reid M. Monitoring Hitting Load in Tennis Using Inertial Sensors and Machine Learning. Int J Sports Physiol Perform. 2017;12:1212–1217. 10.1123/ijspp.2016-0683 [DOI] [PubMed] [Google Scholar]
  • 156.Beanland E, Main LC, Aisbett B, Gastin P, Netto K. Validation of GPS and accelerometer technology in swimming. J Sci Med Sport. 2014;17:234–238. 10.1016/j.jsams.2013.04.007 [DOI] [PubMed] [Google Scholar]
  • 157.Janssen I, Sachlikidis A. Validity and reliability of intra-stroke kayak velocity and acceleration using a GPS-based accelerometer. Sports Biomech. 2010;9:47–56. 10.1080/14763141003690229 [DOI] [PubMed] [Google Scholar]
  • 158.Macdermid PW, Fink PW, Miller MC, Stannard S. The impact of uphill cycling and bicycle suspension on downhill performance during cross-country mountain biking. J Sports Sci. 2017;35:1355–1363. 10.1080/02640414.2016.1215493 [DOI] [PubMed] [Google Scholar]
  • 159.Macdermid PW, Fink PW, Stannard SR. Transference of 3D accelerations during cross country mountain biking. J Biomech. 2014;47:1829–1837. 10.1016/j.jbiomech.2014.03.024 [DOI] [PubMed] [Google Scholar]
  • 160.Sinclair J, Fau-Goodwin J, Richards J, Shore H. The influence of minimalist and maximalist footwear on the kinetics and kinematics of running. Footwear Sci. 2016;8:33–39. [DOI] [PubMed] [Google Scholar]
  • 161.Bastida-Castillo A, Gómez-Carmona CD, de la Cruz Sánchez E, Pino-Ortega J. Comparing Accuracy between Global Positioning Systems and Ultra-Wideband-Based Position Tracking Systems Used for Tactical Analyses in Soccer. Eur J Sport Sci. 2019;19:1157–1165. 10.1080/17461391.2019.1584248 [DOI] [PubMed] [Google Scholar]
  • 162.Bastida-Castillo A, Gómez-Carmona CD, De la Cruz Sánchez E, Reche-Royo X, Ibáñez SJ, Pino-Ortega J. Accuracy and Inter-Unit Reliability of Ultra-Wide-Band Tracking System in Indoor Exercise. Appl Sci. 2019;9:939. [Google Scholar]
  • 163.Aughey RJ. Applications of GPS Technologies to Field Sports. Int J Sports Physiol Perform. 2011;6:295–310. 10.1123/ijspp.6.3.295 [DOI] [PubMed] [Google Scholar]
  • 164.Buchheit M, Simpson BM. Player Tracking Technology: Half-Full or Half-Empty Glass? Int J Sports Physiol Perform. 2016;12:S235–S241. 10.1123/ijspp.2016-0499 [DOI] [PubMed] [Google Scholar]
  • 165.Gómez-Carmona CD, Pino-Ortega J, Ibáñez SJ. Design and validity of a field test battery for assessing multi-location external load profile in invasion team sports. E-Balonmano.com J Sport Sci. 2020;16:23–48. [Google Scholar]
  • 166.Kirk C, Hurst HT, Atkins S. Measuring the Workload of Mixed Martial Arts using Accelerometry, Time Motion Analysis and Lactate. Int J Perform Anal Sport. 2015;15:359–370. [Google Scholar]
  • 167.Barrett S, Midgley AW, Towlson C, Garrett A, Portas M, Lovell R. Within-Match PlayerLoadTM Patterns during a Simulated Soccer Match: Potential Implications for Unit Positioning and Fatigue Management. Int J Sports Physiol Perform. 2016;11:135–140. 10.1123/ijspp.2014-0582 [DOI] [PubMed] [Google Scholar]
  • 168.Buchheit M, Haddad HA, Simpson BM, Palazzi D, Bourdon PC, Salvo VD, et al. Monitoring Accelerations with GPS in Football: Time to Slow Down? Int J Sports Physiol Perform. 2014;9:442–445. 10.1123/ijspp.2013-0187 [DOI] [PubMed] [Google Scholar]
  • 169.Malone JJ, Lovell R, Varley MC, Coutts AJ. Unpacking the Black Box: Applications and Considerations for Using GPS Devices in Sport. Int J Sports Physiol Perform. 2017;12:S2-18–S2-26. [DOI] [PubMed] [Google Scholar]
  • 170.Migueles JH, Cadenas-Sanchez C, Ekelund U, Delisle Nyström C, Mora-Gonzalez J, Löf M, et al. Accelerometer Data Collection and Processing Criteria to Assess Physical Activity and Other Outcomes: A Systematic Review and Practical Considerations. Sports Med. 2017;47:1821–1845. 10.1007/s40279-017-0716-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 171.Currell K, Jeukendrup AE. Validity, reliability and sensitivity of measures of sporting performance. Sports Med. 2008;38:297–316. 10.2165/00007256-200838040-00003 [DOI] [PubMed] [Google Scholar]
  • 172.Kelly SJ, Murphy AJ, Watsford ML, Austin D, Rennie M. Reliability and Validity of Sports Accelerometers during Static and Dynamic Testing. Int J Sports Physiol Perform. 2015;10:106–111. 10.1123/ijspp.2013-0408 [DOI] [PubMed] [Google Scholar]
  • 173.Johnstone JA, Ford PA, Hughes G, Watson T, Mitchell ACS, Garrett AT. Field based reliability and validity of the BioharnessTM multivariable monitoring device. J Sports Sci Med. 11:643–652. [PMC free article] [PubMed] [Google Scholar]
  • 174.Reina M, Mancha-Triguero D, García-Santos D, García-Rubio J, Ibáñez SJ. Comparison of three methods of quantifying the training load in basketball. RICYDE Rev Int Cienc Deporte. 2019;15:368–382. [Google Scholar]

Decision Letter 0

Cristina Cortis

1 Apr 2020

PONE-D-19-33961

Accelerometry as a method for external workload monitoring in invasion team sports. A systematic review

PLOS ONE

Dear Mr. Gómez-Carmona,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by May 16 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Cristina Cortis, Ph.D.

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements:

1.    Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS ONE does not permit references to unpublished data; therefore, we request that you either include the referenced data or remove the instances of "data not shown," "unpublished results," or similar.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

4. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This systematic review provides insights regarding the use of accelerometers to quantify external workloads in team sports. The literature review is well-written and correctly formatted for submission to PLOS ONE; it is well organised providing clear and comprehensive information on the topic. A thorough analysis of current literature is provided identifying and discussing gaps on this topic; however, introduction section should be really improved to further underline the need to develop this systematic review. The current version of the manuscript clearly presents the literature background, without really pointing out why this review is needed. Furthermore, authors should develop the discussion section to point out the relevant information retrieved for practitioners. Please make sure to really edit the manuscript according to these overall suggestions. Furthermore, a better use of abbreviations is required throughout the manuscript. Specific comments are listed below.

Line 11 – “associate professor” should not be included here.

L41 – replace “colon” with “comma”.

L50 – Be consistent with the use of “load” or “workload” throughout the manuscript. Edit accordingly within the entire manuscript.

L60 – Please replace “rated” with “rating of”.

L61 – Remove “on the other hand”. This is too colloquial.

L62 – Include “various variables like” after “through”.

L63-64 – Please try to link the first and second paragraph of the introduction section. It appears that you completely

L70 – Specify what are these instruments considered as “gold standard” and “criterion measures”.

L82 – Please specify that you are referring to “internal” load.

L84-85 – This sentence is not clear. Please edit for clarity.

L89 – Include the following reference here.

- A Review of Player Monitoring Approaches in Basketball: Current Trends and Future Directions. Fox JL, Scanlan AT, Stanton R. J Strength Cond Res. 2017 Jul;31(7):2021-2029. doi: 10.1519/JSC.0000000000001964.

L93 – “rated perceived exertion” should be “RPE”. Be consistent when using abbreviation within the manuscript and check the other abbreviations used. Make sure to explain it the first time you use it and then use the abbreviation.

L94-96 – A reference is required here.

L96-99 – This is a very important point to be discussed here. Please consider also to include something about the comparison between accelerometers and time-motion analysis. With this regard, accelerometers do not provide information about static actions too when an effort is performed without an acceleration (e.g. screenings or a prolonged stance position in basketball) but their reliability is greater compared to other systems. Furthermore, accelerometers provide real-time data. This paragraph should be improved to better develop the importance of using accelerometers compared to other systems and to further underline the importance of carrying out this review. For example, it has been stated that “microtechnologies (e.g., wearable microsensors and accelerometers) in basketball may represent a valid and practical alternative to TMA” (Ferioli, 2020) or “accelerometers offer distinct advantages compared with TMA, with accelerometer data being relatively simple to analyze using either proprietary or user-defined algorithms that quantify movement” (Fox, 2017).

- Match Activities in Basketball Games: Comparison Between Different Competitive Levels. Ferioli D, Schelling X, Bosio A, La Torre A, Rucco D, Rampinini E. J Strength Cond Res. 2020 Jan;34(1):172-182. doi: 10.1519/JSC.0000000000003039.

- A Review of Player Monitoring Approaches in Basketball: Current Trends and Future Directions. Fox JL, Scanlan AT, Stanton R. J Strength Cond Res. 2017 Jul;31(7):2021-2029. doi: 10.1519/JSC.0000000000001964.

L115 - Should “retrieved” be “peer-reviewed” manuscript?

L128 - Why did the authors include only two electronic databases? The inclusion of other databases (like Scopus, MEDLINE, ERIC, Google Scholar, SCIndex, ScienceDirect..) would have been more appropriate.

L130 – In line with my previous comment, including more keywords (e.g. microtecnologies, workloads, physical demands..) would have been more appropriate.

L140 – Replace (iii) with “(3)”

L141 – Replace (3) with “(4)”

Figure 2b – “Int J Sport Physiol” should be “Int J Sports Physiol Perform”; “J Sport Sci” should be “J Sports Sci”. Please check all the journal abbreviations and edit if needed.

L261-263 – The abbreviations included here have not been explained before. Consider including the variables without abbreviation and/or include something like “see Table 1 for definitions”.

L273 – “PlayerloadTM” should be PLTM. (see line 244). The authors should check the use of correct abbreviations (when required) throughout the manuscript.

L307-312 – I would suggest including a message for practitioners regarding the use of accelerometers when monitoring workloads during training or competitions. The current version of this paragraph does not provide any relevant information, while this systematic review should provide insights on this topic. For example, is it important to monitor external workloads during both competitions and trainings? Would the monitoring of competition workloads assist planning training workloads? The authors did a big effort investigating workload sustained during both competitions and trainings, as such they should provide some relevant information here to underline the utility of this systematic review.

L320 – definitions of GPS and GNSS are required here.

L323 – definitions of LPM and UWB are required here.

L337 – definition of HUB is required here.

L331-342. This paragraph is well discussed, providing relevant information and practical applications. Well done.

L340 and 344 – Neuromuscular load – Here the authors are including the term “neuromuscular load” that was not included in the introduction or elsewhere before. Can this term be replaced with external workload as done in the introduction? If not, the introduction should be edit accordingly.

L350-351 – Are the authors referring to soccer competitions? This is not clear.

L359 – Again, “PlayerloadTM” should be PLTM. (see line 244).

L381-382 – “making possible objective players’ weaknesses detection” is not clear enough. Please edit for clarity.

L390-392 – This is a systematic review, as such unpublished data should not be included. Remove this sentence. It might be more appropriate to include something regarding the development of a strategy to correctly use and interpret data retrieved with different systems (and algorithms).

L416 – Include the following reference here:

- The relationships between internal and external training load models during basketball training. Scanlan AT, Wen N, Tucker PS, Dalbo VJ. J Strength Cond Res. 2014 Sep;28(9):2397-405. doi: 10.1519/JSC.0000000000000458.

L417 – RPE was already abbreviated.

413-423 – The authors should consider that despite the existing associations, accelerometers are used to quantify the external workloads, while the cited tools are used to measure the internal workloads. This should be underlined, as the reader could erroneously interpret that the systems are interchangeable. This is not the case, as workload quantification should include both internal and external measures. It might be of interest to include here and discuss the methodologies used to quantify external workloads (TMA, tracking systems..) highlighting the positive and negative aspects of using accelerometers than other systems. This paragraph should be really edit accordingly.

Reviewer #2: Thank you for giving the chance to review the manuscript on accelerometry as monitoring tool in team sports.

General comments:

The manuscript seems to fulfill the journal publication criteria and addresses a topic perceived relevant by the scientific community for training monitoring and regulation. To a large extent, the manuscript documents descriptive data of the selected studies. The interpretation and conclusions for practical relevance can be improved. Otherwise, the value of this review is questionable. A good example of a clearly outlined relevance of this manuscript’s contribution to the state of knowledge and community is device location. Here, the manuscript clearly can recommend a most common and best practice. In other regards, the value added by this review (except for the documentation of descriptive numbers) seems often questionable. In general, the value of the reported numbers can be improved by deepening the interpretation and conclusions drawn from these numbers.

A second general concern is the way how the relevance of this review and objectives is displayed in the introduction. It is recommended to outline the current deficits and needs that justify this review rather than building strongly on an increased interest (see L100), which is by the way one of the results and not a given fact at the stage of the introduction (at least it is not supported by the literature). This makes it a weak justification.

Other general concerns are addressed in specific comments relating to concrete examples but should be considered throughout the manuscript. The whole manuscript requires to be checked for weaknesses comparable with the examples pointed out in the specific comments.

The manuscript can be suitable for further consideration after a major revision. Perhaps, an expert in scientific English writing should be consulted.

Specific comments:

ABSTRACT

L30-31: „for using it if they are coherently organised” is no valuable information. More valuable would be to add the benefit of applying the method. For example: “A rapidly increasing number of studies supports the practical implementation of accelerometry monitoring to regulate and optimise training schemes.” (If such statement is in line with the literature and the authors intentions).

L33: “and identify and organise them”: First, correct is "TO identify and organise them". Second, these are weak objectives. Consider something like “to reflect the current state of knowledge and to conclude recommendations for application and scientific investigations".

L38-39: The subsequent list is not a list of “fulfilled aspects”. Reword (e.g. “main findings include”). The list is also unclear; it is not self-explaining that the first item is the addressed issue (e.g. body location for device), followed by the specification/most frequent finding etc. (e.g. scapulae). Also the punctuation marks are inconsistent (i.e. “,” vs “:”).

L42-44: Please aim for condensed language, straight to the point: E.g. “A great number of variables and devices from various companies makes comparability between findings difficult; unification is required.” Also be careful with terms like “evident”.

INTRODUCTION

L52-54: First, no “,” before “that”. Second, the information “that are analysed by sport scientists and fitness coaches” is not very relevant and can be removed. Third, “with the purpose of explaining" can be replaced by “to explain". Fourth, “explaining training effects”: Really? Maybe more appropriate would be “regulate training volumes” or something comparable. Fifth, “injury risk or that of overtraining”: Reword as “risk of injuries and overtraining”.

Please take this first sentence as an example how to improve the writing throughout the whole manuscript.

L55: “respond” is correct.

L64: Be more precise. It is not an area. Consider “At high levels”

L65: Shorten: “to obtain” instead of “with the aim of obtaining”

L66-67: The reviewer thinks that it is not performance that is difficult to be measured but developments, training activity, input-outcome etc. Consider rewriting this statement because, as it is, this is not the reason for the subsequent statement (i.e. different methods to measure workloads indirectly).

L77: Do not use “among others”. Consider “include A, B, C”. Then, there is no need for “among other”, “and more”, “etc.”.

L79: no “,” before “such”.

L100: the “increasing interest” is not a given fact at this stage and is not supported by the literature. It is a part of the result of this study. So, please do not refer to it as a reason for this study. Instead, you may reason by benefits of accelerometry over other methods as you indicated in the comparison with video tracking methods.

L101 ff: Please shorten the purpose and focus on things that are relevant to clarify what the major purpose is. Do not redundantly use 2 sentences introducing different purposes. The purpose and objective should match the need analysis for this study (i.e. be in line with its relevance). For example, the purpose is to summarize/reflect the current state, outline best practices, and conclude recommendations.

METHODS

L113-116: Another example for condensing the manuscript: Please consider to merge both sentences into “This manuscript is a systematic review that analyses [30] scientific articles related to workload monitoring via accelerometry in sports.” Note that you downgrade your own work by stressing it is an exclusively theoretical work.

L116-118: Please remove completely. Repeating systematic methodology is self-explaining in a systematic review and having no complex statistics is again downgrading your own work. There is no point in doing such statement.

L119-125: Such questions do not belong in this chapter; they should be clarified in the introduction. The reviewer thinks they are clear. Second, they are not required for justification of the inclusion criteria. Therefore, the reviewer suggests removing this part. This allows merging this sub-chapter with the subsequent one: One chapter "Design and Search Strategy". You may start with the sentence suggested in the previous comment and then go on with L128 introducing the database search.

L132: Replace “or” by “and”

L139: Consider “across ages” or replace “different” by “various”. Otherwise, “different” suggests that it was a criterion to have at least 2 levels in each study and these levels must differ. Maybe the best would be to simply remove it. As the reviewer understood it, the level was in fact not a criterion. Studies were included “irrespective of level” (that could be another wording you may use).

L140: Same goes for sexes (see previous comment). Both sexes separately and the combined analyses of both were included in the review. So, sex is no inclusion/exclusion criterion. Also, what is this different format of the number (i.e. “iii”)?

L150: Please adjust by saying “competitive sports context” because it would be wrong to say health activities and practices implemented in elderly cannot be sport! Please remove “older people” in brackets.

L152: Remove the sixth point. It is redundant after defining invasive team sports as inclusion criterion previously.

L158: Please change “competition (playing level and sport)” to “sport and competition level”. Moreover, check throughout the rest of the manuscript to use “competition level” instead of players’/playing/sports level.

L168-170: Please shorten to “by five university full professors with a PhD in sports science and a large number of publications in the field of xy [specify; 1-2 words].”

L176: Do you mean “rated” instead of “scored”?

RESULTS

L192 ff: You may shorten as follows: “From the remaining 296 articles, 83 did not fulfill the inclusion criteria and were removed after revision of the abstract and another 141 after full-text assessment.”

L201: Consider to shorten: “Main reasons for exclusion were non-competitive sports contexts (n=41) and reliability and validity analyses of raw data and load indexes (n=37)”.

L203-205: If these two reasons’ numbers are mentionable, please add the numbers (n=?). Otherwise, there is no need to mention these two reasons at all.

L210-217: The usage of Kappa, thresholds for quality levels, and 95% CI should be introduced in methods section.

L232: Remove “With respect to the sports context”. Just start with “Most studies […]”.

L237: Change to “males” and “females” instead of “men” and “women” as you mention that some analysed juniors.

L244: Most FREQUENTLY used.

L259-260: Again, remove “with respect…”. Change to “x, y, and z were the most frequently investigated invasion team sports.”

L260: What do you mean by “in a specific manner”?

L267: As mentioned in general comments: to “select” and describe is a weak purpose. Consider “summarise” and something like “identify common practices and conclude recommendations” based on the review. For explanation: A pure selection and reflection of descriptive numbers is not very helpful for the community except for other manuscripts to back up statements like “commonly/most frequently used”. A more valuable contribution is to draw conclusions and to outline recommendations based on these numbers.

L269: Replace “Thus” by “Therefore”. Please be aware that they are not interchangeable as thus strongly relates to the way how something is done.

L271: Be precise and correct in language: The evolution is not rapid. The increase may be. Here, the reviewer suggests “show a rapidly increasing number of publications”

L276: “Most studies” instead of “Most of the studies”

L277: “limited” instead of “reduced”

L279: “occurrence” instead of “appearance”

L283: Add: a total NUMBER of 16 publications

L284-286: Please clarify here if these studies provided training and competition hours so that they allowed for normlisation or not. If not, state it here.

L286: Rephrase: “Four studies that compared both sport contexts found higher workload in training than in competition; three articles reported the contrary.”

L290: Please clarify “in relation to their purpose”

L292: “female” instead of “women”

291+294+302+305: Probably you mean “in comparison with” instead of “with respect to”. Please be aware that these are not interchangeable.

L295-298: Please rephrase and condense the findings from Ritchie et al. Writing “they compared a with b, finding higher values in a and lower values in b” is not recommended.

L310: Consider “suitable” instead of “necessary”.

L323: If the reviewer is not mistaken, LPM stands for Local Position Measurement (you did not introduce this and other abbreviations) and is not defined by the system that is applied to identify the location. Please check and correct in case.

L334: The reviewer suggests being careful with “must” in this context. Consider “should” or “is recommended”

L344: Is it really NEUROMUSCULAR load?

L351: Sentence is unclear. Add units to impact numbers. What means “greater impacts ARE FROM x±y”? Rephrase. Reword “under-19”/”under-15”.

L353-355: Change to “due to lower intensity of physical contacts in soccer compared with American football”

L356: Therefore instead of thus

L359: most FREQUENTLY used. Also, replace “that” by “, which” (with comma)

L360-367: Rephrase these two sentences. For example: “For comparison between sports disciplines, the variable PLTM is normalized by total session time [min]. Studies that included time normalized PLTM reported different workloads across sports (soccer: x, netball: y…)”

L372: Reword “which of them most contributes”.

L375-376: Reword “plane where the movement is produced”.

L378-382: Shorten and clarify the sentence and statements made.

L386: Shorten to “These indexes”

L387: Change “but with the implementation of” to “applying”.

L388: Simplify (e.g. “This makes the comparability of data from different devices difficult. The result is a […]”.

L440-441: The review did not assess the state of validity and reliability of workload monitoring and cannot draw conclusions if the existent research sufficiently covers this concern, right? You may elaborate this in an appropriate section to allow such conclusion. The reviewer recommends such addition rather than removing this conclusion to strengthen the value of the current manuscript.

L447: “LPS” seems to be a typo. Probably, “LPM” was meant.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Philip X. Fuchs

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Aug 25;15(8):e0236643. doi: 10.1371/journal.pone.0236643.r002

Author response to Decision Letter 0


16 May 2020

Dear Editor,

We have carefully considered all reviewers' considerations of the paper (PONE-D-19-33961). Please find enclosed our detailed answers to reviewers' queries. The authors declare that the manuscript is original and has not been considered for publication elsewhere. Additionally, the authors had approved the paper for release and agree with its content.

All responses to the specific reviewers and editor comments are attached in the document Response_Reviewers.pdf

Kindly regards

Attachment

Submitted filename: Response_Reviewers.pdf

Decision Letter 1

Cristina Cortis

8 Jun 2020

PONE-D-19-33961R1

Accelerometry as a method for external workload monitoring in invasion team sports. A systematic review

PLOS ONE

Dear Dr. Gómez-Carmona,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 23 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Cristina Cortis, Ph.D.

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors did a good job editing the manuscript in accordance with my previous comments and implementing the number of scientific databases revised for this systematic review The rationale of the study within the introduction section, the results section and some paragraphs of the discussion section have been better developed. In my opinion, some amendments are still required to improve the quality of the manuscript. In addition, I would suggest a further proofread of the entire manuscript as it still presents some grammatical errors and, in some cases (especially in the discussion section), poorly fluid and clear sentences.

Continuous line numbering has not been used, please remember to do this step in your future submissions as stated in the authors’ guidelines.

Specific comments are listed below.

ABSTRACT

Page 2, Line 4-6. Please include “1)” and “2)” before each aim.

P2, L17. “due to it is” does not sound very fluent. Please edit.

INTRODUCTION

P2- first line. “Load” should be “workload”. I still noticed the use of “load” in some sentences. Please replace it with “workload” where needed.

P2- second line. “decreasing” should be “to decrease”.

P2 – line 5-6 of introduction. “Workload” instead of “load”.

P3 L4-5. This sentence should be edited stating that current literature suggests to adopt strategies to monitor and quantify both internal and external workload sustained during training and competitions.

P3 L14. I do not agree with authors stating that current methodologies are “without restrictions”. This should be removed as this is not true. For example, in some professional basketball leagues the use of microsensors during competitions is not allowed (e.g. basketball).

P4 L8-12. This sentence is very hard to read and should be edited and/or splitted.

P4 L12-14. I do not fully agree with this statement as TMA in some cases can be more adequate for workload (and not “load” here - edit) quantification. Authors should consider differentiating manual than automatic and semi-automatic systems of TMA. Manual TMA can be used to identify static movements performed with high-intensity efforts (e.g. body contacts) better than accelerometers, while I agree that automatic video-based analysis can underestimate workload. Edit this section accordingly.

RESULTS

P7 L3. Should “1373” be “1371”? Please check articles numbers in this section.

DISCUSSION

P12 L2-4. Please do not repeat the aim of the study here. Include a general statement to resume what has been included in this systematic review.

P12 L25. “To possibility” should be “to permit”. Please edit.

P12 L26-29. The contrasting results may be also a consequence of different weekly schedules adopted. Competition formats (e.g. 1 game per week vs 2-3 games per week) considerably affect the workload outcomes, thus I suggest including this reasoning to justify the differences between these studies.

P14 L8-9. The abbreviation “GNSS” and “LPM” are required here. Please check the entire manuscript for the use of correct abbreviations.

P15 L10. Please edit with something like: the impacts registered >5G range from .. to ..

P15 L13. “in soccer” is repeated twice.

P15 L10-14. These differences can be also a consequence of different game duration and format.

P15 L21-25. If reporting ranges, include first the lower value and then the higher (i.e. 7.6-9.9 and not 9.9-7.6). Furthermore, “y” after ref 46 should be removed.

P15 L26. “Neuromuscular” should be replaced with “external”.

P15 L18-28. Can these ranges be a consequence of the different playing position? Consider including this reasoning here.

P15 last line. “and which is most..” appears to be quite disconnected. Please rephrase and include reference.

P16 L2-6. This sentence is too general; authors should include how to reach these results.

P16 L9. Accumulative or cumulative?

P16 L22-23. This sentence does not appear grammatically correct. Please edit for clarity.

P16 Last sentence. Please rephrase this sentence for clarity.

P17 L4-6. This sentence should be rephrased as it is not fluid and clear.

P17 L8-14. While I can understand the reasoning of authors here, the readers could be quite confuse from these sentences. Please rephrase for clarity.

P17 L17. Allows

P17 L19-21. This sentence is not clear enough. Are you referring that only 25.4% of studies reported BOTH validity and reliability?

P17 L21-25. Please rephrase this sentence as there are too many repetitions. Make this sentence clearer.

P18 L4-7. Maybe consider including “in different context and sports” to conclude this sentence.

P19 L9-11. I do not agree with this reasoning here. sRPE model is applied to quantify internal workload, which is a different variable than external workload. Why should we compare two different models measuring different variables? Please remove any comparison of accelerometers with sRPE model.

P19 L11. This comment refers to the entire manuscript. Consider a better use of RPE as in some occasions it has been used wrongly. Overall, RPE is not a load measurement; it is the rating of perceived exertion. Session RPE (sRPE) is the rating of perceived exertion for an entire training/competition session. sRPE workload is the workload quantified using the sRPE method. It is fundamental to use correct terms within a systematic review. See the following reference and edit within the manuscript accordingly.

Reference: Impellizzeri FM, Marcora SM, Coutts AJ. Internal and External Training Load: 15 Years On. Int J Sports Physiol Perform. 2019 Feb 1;14(2):270-273. doi: 10.1123/ijspp.2018-0935. Epub 2019 Jan 6.

P19 L11-21. According to my previous comment (P4 L12-14) I do not fully agree with this statement as TMA in some cases can be more adequate for workload (and not “load” here - edit) quantification. Authors should consider differentiating manual than automatic and semi-automatic systems of TMA. Manual TMA can be used to identify static movements performed with high-intensity efforts (e.g. body contacts, low jumps) better than accelerometers (that do not measure low static movements without important accelerations), while I agree that automatic video-based analysis can underestimate workload. Edit this section accordingly.

Reviewer #2: The reviewer thanks for the quick and solid revision of the submitted manuscript. The authors addressed all comments and did a great job in the implementation. Some of the new additions are very valuable.

There are few remaining concerns related to old and new parts of the manuscript that can easily be fixed. After such minor revision, the reviewer suggests that there is no further reviewing round required.

First, there are issues with the pdf file received for revision that make revision difficult. The reviewer cannot tell if this is due to technical problems or caused by the authors. Therefore, addressing both authors and editor, the problems should be fixed in future submissions and reviewing processes. The problems are:

1. The pdf for revision does not include line numbers any longer.

2. The changes highlighted in red to not show the original text that was removed (in contrast to the changes highlighted in blue; these changes were completely tracked).

3. Some of the previous reviewer’s comments are incorrectly presented. Examples are:

3.1. R2_SC5. L52-52: The reviewer’s comment was not “Third, “to explain” can be replaced by “to explain” as it was claimed. The reviewer’s comment was “Third, “with the purpose of explaining" can be replaced by “to explain".”

3.1. R2_SC8. L65: The reviewer’s comment was not “Shorten: “to obtain” instead of “to obtain””. The reviewer’s comment was “Shorten: “to obtain” instead of “with the aim of obtaining””

Due to missing line numbers, the reviewer apologies to refer to chapters, paragraphs, and sentences.

Second, to the authors: When responding to comments in such way “We really appreciate your suggestions. All of them have been considered to improve the final version of the manuscript”, please inform where and how such considerations were implemented, especially for general comments that do not refer to specific lines.

Abstract

Correct is as it was suggested “A great number […] makeS” because ONE number is the subject in this sentence.

Methods

Study design and Search strategy

1. Sentence: Change “peer-reviewed manuscripts (scientific papers)” to “peer-reviewed, scientific papers” because, technically, a manuscript is not the same as a paper and not all peer-reviewed products are scientific products and vice-versa; plus, it is shorter.

3. Paragraph: “genres” is assumed to be a typo. Change to “gender” or “sex” and be consistent in which one of the two is the appropriate to be used in this manuscript.

Quality of the studies

1. Paragraph: The last sentence “In the present study, a value of 0.93 was obtained […]” is a result of this study and should be moved to the results section. In the methods, only state that Kappa and 95% CI were calculated.

Results

Competition vs. Training

2. Paragraph: 2. Sentence: Change to “Most studies […] and DID not PROVIDE DISTINCT training […]”

2. Paragraph: Last sentence: Change “to possibility the comparisons between sports contexts” to “to allow for comparison between sports contexts”

3. Paragraph: 1. Sentence: The reviewer thinks it should be “in training than IN competition”. Also, remove “but” and write “four OTHER articles”.

3. Paragraph: 2. Sentence: It is clarified now, but the reviewer suggests rephrasing as follows: “[…] individualize the training sessions accounting for conditions (e.g. day […]”

3. Paragraph: Last sentence: Please make a full stop before and after Montgomery’s findings. Then replace Ritchie’s findings by: “Ritchie et al. [51] found greater workload in training compared with matches during the pre-season (PL: 19851985±745 vs. 1010±290) and the opposite during the in-season (PL: 1014±383 vs. 1320±195).”

Device location

2. Paragraph, new change: There is a wrong full stop after “[13,46]” and before “or by”; remove it. Change “Local Position Measurement (x/y axis)” to “horizontal Local Position Measurement (LPM)”.

Accelerometry-based workload indexes

1. Paragraph, middle: Change “are from” to “range from”. What are these numbers used in soccer? If it was the number of occurrences, then write “the NUMBER OF impacts”. If it was the actual impacts, use a unit.

2. Paragraph: There seems to be a mistake where, in the list of sports, one sport between soccer and netball is referred to as “y”. It is the one backed-up by reference number 84.

Accelerometer technical features

2. Paragraph, 2. Sentence: First, change to “Most studies”. Second, the sentence is grammatically wrong, and its meaning is unclear. Consider: “Most studies showed that triaxial accelerometers use inertia sensors”

2. Paragraph, 3. Sentence: Change to “[…] detect three-dimensional movement and, consequently, to calculate the external workload index, which requires the acceleration in the three axes”.

2. Paragraph, 4. Sentence: Change to “[…] studies specified the number of accelerometers used in the devices.”

2. Paragraph, 5. Sentence: Replace by “Moreover, the output range of each accelerometer is important and should be specified.”

2. Paragraph, 6. Sentence: it states “four accelerometers with different output ranges” but then two are identical (i.e. ±16g). Please correct by removing “different”.

3. Paragraph: That is indeed worrying. Please add one short clarification if studies, that did not report validity and reliability, did refer to literature reference for this purpose instead (yes/no?). In the subsequent paragraph you state that some studies did refer to inappropriate investigations. That means some do use references. So, simply state how many did (in percentage of the reviewed studies). That is enough.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Philip X. Fuchs

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Aug 25;15(8):e0236643. doi: 10.1371/journal.pone.0236643.r004

Author response to Decision Letter 1


13 Jun 2020

Dear Editor,

We have carefully considered all reviewers' considerations of the paper (PONE-D-19- 33961_R1). Please find enclosed our detailed answers to reviewers' queries. The authors declare that the manuscript is original and has not been considered for publication elsewhere. Additionally, the authors had approved the paper for release and agree with its content.

All answer to reviewers' queries was addressed in the Response Reviewers document.

Kindly regards

Attachment

Submitted filename: Response_Reviewers.pdf

Decision Letter 2

Cristina Cortis

2 Jul 2020

PONE-D-19-33961R2

Accelerometry as a method for external workload monitoring in invasion team sports. A systematic review

PLOS ONE

Dear Dr. Gómez-Carmona,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Both reviewers suggested accepting the paper after few minor corrections. Therefore, I invite the authors to carefully consider all the suggestions and make a final checks for syntax and grammar.

Please submit your revised manuscript by Aug 16 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Cristina Cortis, Ph.D.

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors did a big effort editing the manuscript during the revision process. The manuscript has been greatly improved and will be a valuable addition to the literature. In my opinion, the manuscript should be considered acceptable for publication. I would recommend a final check for grammar, spelling, and punctuation mistakes during the editorial editing/formatting process (e.g. page 3, line 5 “suggestS”).

Reviewer #2: General comment:

The authors addressed all comments and fixed most issues. Some new mistakes emerged in the adaptations. For all cases, the reviewer provides concrete solutions.

In the specific comments, the reviewer refers to page and line numbers of the revised manuscript showing the tracked changes.

The reviewer suggests acceptance of the manuscript after the implementation of the provided solutions.

Specific comments:

Methods

P5, L2: Change “manuscript” to “paper” as the currently submitted piece of work is a manuscript (L1) that reviews published papers. This is how terms are correct. When published, a manuscript is a paper.

Discussion

P13, L25: A new error appeared after revision: Correct is “did not provide” (not: provideD)

P14, L3-4: The meaning of the new adaptation is unclear to me (studies are no consequence of different schedules!). The sentence is also grammatically incorrect. The reviewer can just assume that the authors meant something like: “Higher competition workload reported in some studies may be the consequence of differences in weekly schedules, not accounting for conditions […]” If this message is in line with the authors’ intentions, then I recommend to use this phrase.

P14, L15+16: 1. In both brackets you need to write “(PL: [numbers])”, otherwise no one knows what these numbers are. 2. You may change “in-season” to “competitive season”.

P15, L14+15: Why was “Global Navigation Satellite Systems” and “Local Position Measurement” replaced by short terms? Check if the short terms have been introduced previously, otherwise introduce them here

P15, L15: Remove “(x/y axis)” because, first, this is redundant and, second, horizontal is the better description anyway because x/y is a matter of definition and could be anything (therefore, would require a definition).

P16, L16-18: Previous suggestion was misunderstood, and adaptations are not correct anymore (the threshold does not range!). Change to full stop after the rugby and American football sentence (L16). Then, “In soccer, the detection threshold is 5G, and the number of impacts range from 490±310 to 613±329 [83].”

P18, L7: Change LESS sampling rate and accuracy to LOWER sampling rate and accuracy.

P18, L22-24: Remove “Moreover” and “that compose the device” and change to “The number of accelerometers is only important if the output range […]. Do not mess up the order in output range/range output.

P19, L1: Here is also incorrectly written “range output”. Change to “output range”.

P19, L19-23: Change to “Among studies that cited the reliability and validity of accelerometers, 15 investigations (i.e. 12.7%) cited the reliability and validity of other devices that were not used in the respective research.”

P19, L28-29: Change to “NOTEWORTHY, 34.7% of THE studies DID not report [not: reportED!] THE validity or reliability and did also not refer to literature FINDINGS for this purpose.”

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Philip X. Fuchs

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Aug 25;15(8):e0236643. doi: 10.1371/journal.pone.0236643.r006

Author response to Decision Letter 2


3 Jul 2020

Dear Editor,

We have carefully considered all reviewers' considerations of the paper (PONE-D-19-33961_R2). Please find enclosed our detailed answers to reviewers' queries. The authors declare that the manuscript is original and has not been considered for publication elsewhere. Additionally, the authors had approved the paper for release and agree with its content.

All responses to reviewers' considerations have been attached in Response to Reviewers document.

Kindly regards

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 3

Cristina Cortis

13 Jul 2020

Accelerometry as a method for external workload monitoring in invasion team sports. A systematic review

PONE-D-19-33961R3

Dear Dr. Gómez-Carmona,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Cristina Cortis, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: All suggestions were flawlessly implemented. The manuscript can be accepted for publication. The editorial board should correct two grammatical errors:

p.16, l.13: Correct would be "the numberS (plural!!) of impacts range from ... to ..."

p.21, l.7: This change is incorrect (i.e. "wrote"). The previous "written" is correct: "studies [...] written in English were included"

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Philip X. Fuchs

Acceptance letter

Cristina Cortis

3 Aug 2020

PONE-D-19-33961R3

Accelerometry as a method for external workload monitoring in invasion team sports. A systematic review

Dear Dr. Gómez-Carmona:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Cristina Cortis

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Selected articles in goal striking games.

    (DOCX)

    S2 Table. Selected articles in goal throwing games.

    (DOCX)

    S3 Table. Selected articles in try-scoring games.

    (DOCX)

    S4 Table. Quality criteria used to analyze the quantitative publications (extracted from Law et al. [37]).

    (DOCX)

    S1 File. PRISMA 2009 checklist.

    (DOC)

    S2 File. Search database output.

    (XLSX)

    Attachment

    Submitted filename: Response_Reviewers.pdf

    Attachment

    Submitted filename: Response_Reviewers.pdf

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES