Skip to main content
BMJ Open Sport & Exercise Medicine logoLink to BMJ Open Sport & Exercise Medicine
. 2020 Aug 24;6(1):e000794. doi: 10.1136/bmjsem-2020-000794

Validation methods for global and local positioning-based athlete monitoring systems in team sports: a scoping review

Live Steinnes Luteberget 1,, Matthias Gilgien 1
PMCID: PMC7520549  PMID: 33062300

Abstract

Background/Objective

Global navigation satellite systems (GNSS) and local positioning systems (LPS) are to date common tools to measure external training load in athletes. The aim of this scoping review was to map out and critically appraise the methods used to validate different GNSS and LPS used in team sports.

Method

A total of 48 studies met the eligibility criteria and were included in the review. The reference systems applied in the validations, and the parameters investigated were extracted from the studies.

Results

The results show a substantial range of reference systems used to validate GNSS and LPS and a substantial number of investigated parameters. The majority of the validation studies have employed relatively simple field-based research designs, with use of measure tape/known distance as reference measure for distance. Timing gates and radar guns were frequently used as reference system for average and peak speed. Fewer studies have used reference system that allow for validation of instantaneous dynamic position, such as infrared camera-based motion capture systems.

Conclusions

Because most validation studies use simple and cost-effective reference systems which do not allow to quantify the exact path athletes travel and hence misjudge the true path length and speed, caution should be taken when interpreting the results of validation studies, especially when comparing results between studies. Studies validating instantaneous dynamic position-based measures is warranted, since they may have a wider application and enable comparisons both between studies and over time.

Keywords: Assessing physiological demands of physical activity, validation, sports analysis in different types of sports

INTRODUCTION

Objective analyses of physical training load in team sports can provide better understanding of the specific physical demands of a sport, the physical development of players over time, health and performance, and can help to improve training practices.1 2 Different methods for time-motion analysis, such as hand notation and video analysis, have been used to objectively assess training load for many decades. However, the time-consuming nature of such analysis has restricted its use.3 The development of wearable athlete monitoring systems has made objective athlete monitoring more available in team sports. Most wearable athlete monitoring systems consist of a global navigation satellite system (GNSS) for outdoor use or a local positioning system (LPS) for indoor use. GNSS and LPS systems provide meaningful position-based measures such as speed or path length for team sports. The use of GNSS-based and LPS-based athlete monitoring systems is now commonplace in team sports, and the number of research publications related to the application of these technologies in team sports is high and increasing exponentially (figure 1). Wearable athlete monitoring systems often also include inertial sensors, such as accelerometers and gyroscopes. These are typically used to measure acceleration and parameters based on acceleration. This article does not address inertial sensors but focuses on GNSS/LPS technology.

Figure 1.

Figure 1

The increase in publications in the area of team sports and GNSS/LPS technology from 2000 to 2019. The figure was constructed using the ‘europepmc’ package in R. The whole code, including search words, can be found at the Open Science Framework (URL: https://osf.io/3h8qa/).

The large number of GNSS and LPS system applications in sport teams and research emphasise the importance of the question of whether these systems are sufficiently validated and can accurately measure what they are intended to measure. Good internal and external validity4 of data collection systems (eg, LPS or GNSS) applied in sports is important to allow meaningful analysis, enhance coaching and build trust between athletes, coaches and scientists in the application of such systems.5 One main reason why wearable athlete monitoring systems are applied in team sport is that they allow collection of data during real-life training and competition4 and hence substantially improve external validity compared to investigations in laboratory settings. The internal validity of a system is equally important. It reflects the ability to accurately measure what the system intends to measure.6 If the internal validity of a system is not adequate, training load can be overestimated or underestimated, and the application of such measurement systems may cause harm to athletes by the prescription of inadequate training, leading to decreased performance and/or increased health risks.5 7

Both GNSS and LPS are prone to measurement error, and there are many factors that can influence position validity. Calculation of the GNSS or LPS position of a wearable athlete monitoring system (receiver) is based on position and time information from satellites circulating around the earth (for GNSS) or local nodes mounted around the field of play (for LPS). Satellites and nodes emit an electromagnetic signal that is received by the receiver on the athlete. From these signals, there are several techniques that can be used to calculate instantaneous position, such as time-of-flight, time-difference-of-arrival, angle-of-arrival and received signal strength.8 GNSS use time-of-flight, while LPS vary between different systems in which technique they use. The main device-related factors that influence the validity of this kind of position measurement include antenna and board type, number of satellites/nodes used for position calculation, signal type used, processing method, measurement frequency and parameter calculation process.9 10 Since wearable tracking devices applied in sports should be small, light and user-friendly, the manufacturers of such devices optimise the trade-off between system performance, form factor, handling simplicity and cost. Due to these manufacturing compromises and the continuous system improvements in hardware and firmware, data processing and parameters, the validity of such systems needs to be investigated prior to use. To date, several validity studies have been published for GNSS,11 and to a lesser extent for newer LPS12 in team sports. The GNSS studies11 show a large range of standards (hereafter called reference systems) applied to validate wearable athlete monitoring systems and the parameters investigated.

In recognition of the importance validity has in match and training analysis in team sports, and the apparent range of validation methods applied in GNSS/LPS studies, this scoping review aims to present and critically appraise the methods used to validate the various GPS and LPS used in team sports.

METHOD

Review protocol

The protocol for this review is available at the Open Science Framework (URL: https://osf.io/3wn82/), where both the protocol and the full search strategy can be found (URL: https://osf.io/rmcgf/). This review was conducted and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews.13

Eligibility criteria

Articles were eligible for inclusion in this review if they (1) included investigation of validity/accuracy for GNSS or LPS and (2) were aiming to investigate this in relation to team sports. Articles were excluded if they were (1) published in a non-English language or (2) only available in conference abstract or conference proceedings format. Reviews or other studies with no primary data were not included in this scoping review.

Search strategy

A systematic electronic database search was conducted in SPORTDiscuss and PubMed for all published manuscripts prior to the search date (15.09.19). The search strategy included the following terms (and variations of these terms): ‘Global Positioning System’ OR ‘Global Navigation Satellite System’ OR ‘Local Positioning System’ AND ‘Validity’ OR ‘Accuracy’ AND ‘Team Sports’. The full search strategy can be found at the Open Science Framework (URL: https://osf.io/rmcgf/). No filters or limitations were imposed during the search.

Study selection

Search results were exported to a reference manager library (Endnote, X9.2), where duplicates were removed. The citations were then uploaded to the systematic review software DistillerSR (Evidence Partners, Ottawa, Canada). Titles and abstracts of the citations were screened for eligibility independently by two reviewers. Full texts of potentially eligible articles were retrieved before a final assessment was completed independently by the same two reviewers. Any discrepancies between reviewer eligibility assessments were resolved through discussion with a third reviewer. All three reviewers were familiar with the topic of the review.

Data extraction

GNSS/LPS specifications (brand, model and sampling frequency), sporting tasks assessed, reference system used for the validation, and parameters investigated were extracted from the included studies. Tasks were classified into four different categories: linear (straight line) tasks, non-linear tasks, team sport circuits and game-like situations (eg, small-side games). The type of reference system used to assess validity was extracted as stated in the studies. The parameters for time, averaged static position, instantaneous dynamic position, distance travelled, average speed, peak speed, instantaneous speed, average acceleration, peak acceleration and instantaneous acceleration were extracted. Other parameters, such as metabolic power or time to cover distance, were categorised as ‘other’. Data extraction was performed by two independent reviewers.

RESULTS

The database search identified 454 relevant records. Duplicates (n=76) were removed, so 378 titles and abstracts were reviewed. A total of 48 studies met the eligibility criteria and were included in the review.12 14–60 An overview of the search and selection process is presented in figure 2.

Figure 2.

Figure 2

Study selection flow chart.

The studies investigated from one to five parameters each. Distance was the most frequently investigated parameter (34 articles), followed by average and peak speed. Fewer studies investigated dynamic position, or instantaneous speed and acceleration (figure 3).

Figure 3.

Figure 3

Proportion of GNSS/LPS studies investigating different parameters.

Five different reference systems were used to investigate the validity of distance, where tape measure/known distance constituted the most frequently used reference systems. For validation of speed the reference systems applied were timing gates, radar gun and infrared camera-based motion capture systems. For the validation of acceleration only infrared camera systems were used. A summary of the results is given in table 1, while a full documentation of the different reference systems used and parameters assessed is shown in table 2 (LPS) and table 3 (GNSS).

Table 1.

Overview of different reference systems used to validate the most common performance and training load parameters

Time averaged static position Instantaneous dynamic position Distance travelled Average speed Peak speed Instantaneous speed Average acceleration Peak acceleration Instantaneous acceleration
Theodolite 2 2
Tape measure/known distance 1 19
Trundle wheel 7
Radar gun/laser gun 1 1 6 3
Timing gates 8 4 1
Infrared camera-based motion capture system 3 5 7 6 2 3 2 1
Other 1 1 1 1

Table 2.

Overview of included studies investigating validity of LPS

System(s)
model (Manufacturer)
System information
frequency, technology
Tasks Reference system Parameter
Bastida-Castilla et al 201817 WIMUPRO (Realtrack systems) 20 Hz, LPS Linear tasks
Non-linear tasks
Timing gates
Trundle wheel
Distance travelled
Average speed
Bastida-Castilla et al 201918 WIMUPRO (Realtrack systems) 20 Hz, LPS Linear tasks
Non-linear tasks
Calibration procedures of LPS Instantaneous dynamic position
Figueira et al 201828 NBN23 (Quuppa) 10 Hz, LPS Non-linear tasks Known distance Distance travelled (relative)
Frencken et al 201029 Inmotio (Inmotio Object tracking) 45 Hz, LPS Linear tasks
Non-linear tasks
Average position
Tape measure
Timing gates
Time averaged static position
Distance
Average speed
Hoppe et al (2018)31 Kinexon One (Kinexon Precision Technologies) 20 Hz, LPS Team sport circuit Tape measure
Trundle wheel
Timing gates
Distance travelled
Other
Leser at al. 201438 Ubisense (Ubisense) 4.17 Hz, LPS Game-like situations Trundle wheel Distance travelled
Link et al 201939 Inmotio (Inmotio Object tracking)
Kinexon (Kinexon Precision Technologies)
100 Hz, LPS
15 Hz, LPS
Linear tasks
Non-linear tasks
Tachymeter
Timing gates
Other
Linke et al 201840 Inmotio (Inmotio Object tracking) 45 Hz, LPS Linear tasks
Non-linear tasks Game-like situations
Infrared camera-based motion capture system Instantaneous dynamic position
Instantaneous speed
Instantaneous acceleration
Luteberget et al 201812 ClearSky T6 (Catapult Sports) 20 Hz, LPS Linear tasks
Non-linear tasks
Infrared camera-based motion capture system Instantaneous dynamic position
Distance travelled
Average speed
Instantaneous speed
Ogris et al 201245 LPM04.59 (Abatec) 45 Hz, LPS Linear tasks
Non-linear tasks Game-like situations
Infrared camera-based motion capture system Instantaneous dynamic position
Average speed
Peak speed
Rhodes et al 201452 Ubisense (Ubisense) 4 Hz, LPS†
8 Hz, LPS†
16 Hz, LPS†
Linear tasks
Non-linear tasks
Theodolite
Timing gates
Time averaged static position Distance
Average speed
Peak speed
Sathyan et al 201254 WASP system (Undisclosed) 10 Hz, LPS Linear tasks
Non-linear tasks
Theodolite
Tape measure
Time averaged static position Dynamic position (relative)
Distance travelled
Serpiello et al 201855 ClearSky T6 (Catapult Sports) 10 Hz, LPS Linear tasks
Non-linear tasks
Infrared camera-based motion capture system Distance travelled
Average speed
Peak speed
Average acceleration
Peak acceleration
Siegle et al 201356 Undisclosed 45 Hz, LPS Linear tasks Laser gun Instantaneous dynamic position
Stevens et al 201457 Inmotio (Inmotio Object Tracking) 45 Hz, LPS Linear tasks
Non-linear tasks
Infrared camera-based motion capture system Distance travelled
Average speed
Peak speed
Average acceleration
Peak acceleration

†Same unit used with different sampling frequency.

‡Studies investigating both GNSS/GPS and LPS.

A variety of different tasks are used to investigate the validity and accuracy of GNSS/LPS. Linear tasks were the most frequently used (tables 2–3) and were included in most studies. Different circuits and courses imitating team sports movements were also frequently used. Game-like situations were only used in three of the 48 included studies (tables 2–3).

Table 3.

Overview of included studies investigating validity of GNSS

References System(s)
model (Manufacturer)
System information
frequency, technology
Tasks Reference system Parameter
Akenhead et al 201414 MinimaxX S4 (Catapult Sports) 10 Hz, GPS Linear tasks Laser gun Instantaneous speed
Barbero-Álvarez et al 201015 SPI Elite (GPSports Systems) 1 Hz, GPS Linear tasks Timing gates Peak speed
Barr et al 201916 SPI HPU (GPSports Systems) 5 Hz*, GPS Linear tasks Timing gates Instantaneous speed
Bastida-Castilla et al 201817 WIMUPRO (Realtrack systems) 10 Hz, GPS Linear tasks
Non-linear tasks
Timing gates
Trundle wheel
Distance travelled
Average speed
Bastida-Castilla et al 201918 WIMUPRO (Realtrack systems) 10 Hz, GPS Linear tasks
Non-linear tasks
Calibration procedures of LPS Instantaneous dynamic position
Bataller-Cervero et al 201919 Viper (STATSports) 10 Hz, GPS Linear tasks Timing gates
Radar gun
Average speed
Instantaneous speed
Beato et al 201820 Apex 10 Hz (STATSports)
Apex 18 Hz (STATSports)
10 Hz, GNSS
18 Hz, GPS
Linear tasks
Team sport circuit
Tape measure
Radar gun
Distance travelled
Peak speed
Beato et al 201821 Viper (STATSports) 10 Hz, GPS Linear tasks
Team sport circuit
Tape measure
Radar gun
Distance travelled
Peak Speed
Beato et al 201622 Undisclosed (STATSports) 10 Hz, GPS Non-linear tasks Tape measure
Video analysis
Distance travelled
Average speed
Instantaneous speed
Castellano et al 201123 MinimaxX v4.0 (Catapult Sports) 10 Hz, GPS Linear tasks Tape measure Distance travelled
Coutts‡ Duffield 201024 SPI-10 (GPSports Systems)
SPI Elite (GPSports Systems)
WiSPI (GPSports Systems)
1 Hz, GPS
1 Hz, GPS
1 Hz, GPS
Team sport circuit Tape measure
Timing gates
Distance travelled
Peak speed
Delaney et al 201925 EVO (GPSports Systems) 10 Hz, GNSS Linear tasks
Non-linear tasks
Infrared camera-based motion capture system Average speed
Average acceleration
Duffield et al 201026 MinimaxX (Catapult Sports)
SPI Elite (GPSports Systems)
5 Hz, GPS
1 Hz, GPS
Linear tasks
Non-linear tasks
Infrared camera-based motion capture system Distance travelled
Average speed
Peak speed
Edgecomb‡ Norton 200627 SPI-10 (GPSports Systems) Undisclosed, GPS Team sport circuit Trundle wheel Distance travelled
Gray et al 201030 WI SPI elite (GPSports Systems) 1 Hz, GPS Linear tasks
Non-linear tasks
Theodolite Distance travelled
Hoppe et al (2018)31 GPEXEPRO (Exelio srl)
MinimaxX S4 (Catapult Sports)
18 Hz, GPS
10 Hz, GPS
Team sport circuit Tape measure
Trundle wheel
Timing gates
Distance travelled
Other
Jennings et al 201032 MinimaxX Team 2.5 (Catapult Sports) 1 Hz, GPS
5 Hz, GPS
Linear tasks
Non-linear tasks
Team sport circuit
Tape measure Distance travelled
Johnston et al 201433 MinimaxX S4 (Catapult Sports)
SPI-ProX (GPSports Systems)
10 Hz, GPS
10 Hz*, GPS
Team sport circuit Tape measure
Timing gates
Distance travelled
Peak speed
Johnston et al 201334 MinimaxX S3 (Catapult Sports)
MinimaxX S4 (Catapult Sports)
5 Hz, GPS
10 Hz, GPS
Team sport circuit Tape measure
Timing gates
Distance travelled
Peak speed
Johnston et al 201235 MinimaxX Team 2.5 (Catapult Sports) 5 Hz, GPS Linear tasks
Team sport circuit
Tape measure
Timing gates
Radar gun
Distance travelled
Peak speed
Köklü et al 201536 SPI ProX (GPSports Systems) 5 Hz*, GPS Linear tasks
Non-linear tasks
Tape measure
Timing gates
Distance travelled
Average speed
Lacome et al 201937 Sensoreverywhere V2 GPS (Digital simulation) 16 Hz, GPS Linear tasks Radar gun Peak speed
Linke et al 201840 SPI Pro X (GPSport Systems) 5 Hz*, GPS Linear tasks
Non-linear tasks Game-like situations
Infrared camera-based motion capture system Instantaneous dynamic position
Instantaneous speed
Instantaneous acceleration
MacLeod et al 200941 SPI Elite (GPSports Systems) 1 Hz, GPS Team sport circuit Trundle wheel
Timing gates
Distance travelled
Average speed
Muñoz-Lopez et al 201742 WIMU (Realtrack Systems) 5 Hz, GPS Linear tasks
Team sport circuit
Tape measure Distance travelled
Nagahara et al 201743 GPEXE (Exelio srl)
SPI-Pro X (GPSports Systems)
20 Hz, GPS
5 Hz*, GPS
Linear tasks Radar gun
Laser gun
Peak speed
Nikolaidis et al 201844 Johan GPS (JOHAN sports) 10 Hz, GPS Linear tasks
Non-linear tasks
Known distance Distance travelled
Padulo et al 201946 Spin GNSS (Spinitalia) 50 Hz, GNSS Linear tasks
Non-linear tasks
Tape measure
Timing gates
Distance travelled
Average speed
Petersen et al 200947 SPI-10 (GPSports Systems)
SPI-Pro (GPSports Systems)
MinimaxX (Catapult sports)
1 Hz, GPS
5 Hz, GPS
5 Hz, GPS
Linear tasks
Non-linear tasks
Known distance Distance travelled
Portas et al 201048 MinimaxX v2.5 (Catapult sports) 1 Hz, GPS
5 Hz, GPS
Linear tasks
Non-linear tasks
Team sport circuit
Trundle wheel Distance travelled
Rampinini et al 201549 SPI-Pro (GPSports Systems)
MinimaxX S4 (Catapult sports)
5 Hz, GPS
10 Hz, GPS
Linear tasks Radar gun Distance travelled
Other
Rawstorn et al 201450 SPI-Pro X (GPSports Systems) 5 Hz*, GPS Linear tasks
Non-linear tasks
Trundle wheel Distance travelled
Reinhardt et al 201951 Polar Team Pro System (Polar Electro) 10 Hz, GPS (fusion with IMU) Linear tasks Tape measure
Timing gates
Distance travelled
Other
Roe et al 201753 OptimEye S5 (Catapult Sports) 10 Hz, GNSS Linear tasks Radar gun Peak speed
Varley et al 201258 MinimaxX v2.0 (Catapult Sports)
MinimaxX v4.0 (Catapult Sports)
5 Hz, GPS
10 Hz, GPS
Linear tasks Laser gun Instantaneous speed
Vickery et al 201459 MinimaxX Team 2.5 (Catapult Sports)
MinimaxX S4 (Catapult Sports)
SPI-Pro X (GPSports Systems)
5 Hz, GPS
10 Hz, GPS
5 Hz*, GPS
Non-linear tasks Infrared camera-based motion capture system Distance travelled
Average speed
Peak speed
Waldron et al 201160 SPI-Pro (GPSports Systems) 5 Hz, GPS Linear tasks Tape measure
Timing gates
Distance travelled
Average speed
*

GNSS data interpolated to 15 Hz.

Same unit used with different sampling frequency.

Studies investigating both GNSS/GPS and LPS.

DISCUSSION

This study provides an overview of the published, peer reviewed studies investigating the validity of GNSS and LPS in team sports. Since the first validation study on GNSS in team sports was published in 2006,27 the number of validation studies has steadily increased in this field. It seems that the increasing number of validation studies is required, since the number of manufacturers and types of GNSS/LPS-devices, and with these the variety of hardware and firmware, sampling rates and data-processing methods, have increased. In total, the validity of at least 23 GNSS and six LPS models—from 17 different manufacturers—for team sports applications have been investigated in the literature.

The results show a substantial range of reference systems employed to validate GNSS and LPS, and a substantial number of parameters that were investigated. Most of the validation studies have employed relatively simple field-based research designs, using a tape measure/known distance as the reference system for distance. Timing gates and radar guns were frequently used as reference systems for average and peak speed. Fewer studies have used reference systems that allow for validation of instantaneous dynamic position, such as infrared camera-based motion capture systems.

Distance travelled and peak and average speed were the most frequently investigated parameters. The high number of studies investigating these parameters is justified by their frequent use in time-motion analyses in team sports.12 32 33 Only a few studies have investigated the validity of instantaneous dynamic position, which may be due to the unavailability of appropriate reference systems, such as infrared camera-based motion capture systems. However, some studies did not provide instantaneous dynamic position, even though the reference system applied could have provided this information.25 26 55 We believe that insight into the validity of instantaneous dynamic position could be beneficial for several reasons. First, other parameters (such as distance) are integrations or derivatives of instantaneous dynamic position and hence, deviations in position measurement are propagated to these parameters and potentially amplified by data processing, such as filtering and parameter calculation methodology. Such data processing steps will likely deviate between devices and manufacturers. Thus, appropriate validations of a system’s instantaneous dynamic position would allow comparison of the system’s ability to measure the basic parameter (position) and allow pinpointing of a) the error caused by the basic parameter (position) measurement and b) the manufacturer’s data processing. Second, parameters such as distance or speed can be affected by firmware update-related changes in the manufacturer’s data processing (typically parameter calculation and filtering). Hence, altered firmware may cause differences in the propagation parameters such as distance and speed compared with earlier firmware versions, even though the measurement of the basic parameter (position) may remain unchanged. It is likely that system improvements more often affect data processing (parameter calculation and filtering) than the basic measurement (instantaneous dynamic position), as the GNSS and LPS are often provided by a third-party manufacturer. Therefore, position could be used as a more stable long-term parameter for determining the basic validity of a system. Third, GNSS/LPS data are also used for tactical analyses, including parameters such as mean position over time and dynamic distances between players,61 62 which are based on position. Therefore, it is important that studies also investigate the validity of instantaneous position. We therefore suggest that the validity of instantaneous dynamic position should be included in validation studies, as it may have a wider application and can in the long run be both time and cost saving due to its more long-term stability across firmware versions.

Some studies lacking an appropriate reference system for instantaneous dynamic position have investigated time-averaged static positions.29 52 54 Two studies have measured positions as reference points,52 54 while one study29 applied the average measured position of the receiver as a reference. These two validation methods for static position are inherently different and may elicit vastly different results. The average position measurement obtained using the same device as the one to be validated provides only random error and cannot measure the systematic deviance from the true location. Thus, if the true static position is unknown, the relative position difference should be stated as a precision measure, not an accuracy or validity measure.

Several validation studies have used premeasured distances as reference systems for distance and average speed.20–24 28 29 31–36 42 44 46 47 51 54 60 This is a simple and cost-effective way to investigate the validity of tracking systems. However, the method is not an ideal reference system, as it is not possible to quantify the exact path travelled by the athlete as long as the athlete’s true path is not tracked instantaneously. During human locomotor tasks the individual and thus the device will seldom follow a straight line between two points. This could affect the outcome of validation studies, as is pointed out by some authors.24 Thus, smaller or larger deviations in the athlete’s position may go undetected and can lead to an underestimation or overestimation of the accuracy of the investigated system. To avoid this problem, the use of reference systems that measure the true instantaneous trajectory of the athlete’s device, such as infrared camera-based motion capture systems,12 25 26 40 45 55 59 video-based tracking,10 63–65 or, previously validated high-end GNSS devices,66 is warranted. Such reference systems also make it possible to investigate more complex tasks, such as game-like situations, which are inherently the most specific conditions to test the systems in.

Timing gates are also easy to apply and are often used as the reference system for mean speed, and in some cases peak speed15 24 33 34 and instantaneous speed16 . However, timing gates only determine mean speed in the sections between gates. Mean speed provides only limited insight in team sport applications, since it does not contribute much to the understanding of team sports, where speed constantly fluctuates as a function of the acceleration and deceleration of the athlete. Team sport analysis systems often sort speed data into ranges (speed zones) and express these as a function of time or distance as a comprehensive metric for the ‘distribution of intensity’ of the athletes’ physical load.67 Even though instantaneous speed measurements are commonly used to categorise speed as a function of time or distance, most validation studies only investigate the validity of mean speed over time. This is a serious shortcoming, since mean speed over time may not allow conclusions to be reached on the described distribution of intensity, which is based on instantaneous speed.

Some studies include the validity of peak speed; however, only a few studies have looked at the instantaneous speed over the range of a whole task. Radar guns were used in several studies to assess peak and instantaneous speed.19–21 35 37 43 49 53 56 58 The validity of radar guns during non-straight-line running is currently unknown, and they are thus used only in straight-line sprints in the current literature. Hence, a radar gun is not a suitable reference system for team sports motion, since most team sports involve mostly non-straight line motion. Reference systems such as infrared camera-based motion capture systems, video-based tracking, or previously validated high-end GNSS devices are warranted.

CONCLUSION

The most frequently investigated parameter in GNSS and LPS validity studies was distance travelled, followed by average and peak speed. Tape measure/known distance was the most frequent reference system applied. Few studies have investigated instantaneous parameters, such as instantaneous dynamic position or instantaneous speed. We discovered a large range of reference systems and methods employed to validate wearable athlete monitoring systems; thus, the appropriateness of the employed reference systems may vary, and caution should be applied when interpreting the results of validation studies, especially when comparing results between studies. More studies investigating instantaneous dynamic position may have a wider application and enable comparisons both between studies and over time.

Summary box.

What is already known?

  • The use of GNS-based or LPS-based athlete-tracking devices is exponentially increasing.

  • Validation of GNSS/LPS is important to allow meaningful analysis in sports.

What are the new findings?

  • Known distance and timing gates are the most common reference systems in GNSS/LPS validation studies.

  • Few studies have investigated instantaneous dynamic position, the raw measurements of GNSS and LPS.

  • Caution should be applied when interpreting and comparing results of different validation studies due to the large variations in current validation methods.

Acknowledgments

We would like to thank Petter Jølstad for being involved in the article selection process.

Contributors: LSL and MG contributed to the design and implementation of the research, to the analysis of the results and to the writing of the manuscript. LSL drafted the first version of the manuscript. Both authors contributed to the intellectual content of the study, manuscript writing and approved the final version of this article.

Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

Competing interests: None declared.

Ethics approval: Not applicable.

Provenance and peer review: Not commissioned; externally peer reviewed.

REFERENCES

  • 1. Dellaserra CL, Gao Y, Ransdell L. Use of integrated technology in team sports: a review of opportunities, challenges, and future directions for athletes. J Strength Cond Res 2014;28:556–73. 10.1519/JSC.0b013e3182a952fb [DOI] [PubMed] [Google Scholar]
  • 2. Cummins C, Orr R, O’Connor H, et al. Global positioning systems (GPS) and microtechnology sensors in team sports: a systematic review. Sports Med 2013;43:1025–42. 10.1007/s40279-013-0069-2 [DOI] [PubMed] [Google Scholar]
  • 3. Carling C, Bloomfield J, Nelsen L, et al. The role of motion analysis in elite soccer. Sports Med 2008;38:839–62. 10.2165/00007256-200838100-00004 [DOI] [PubMed] [Google Scholar]
  • 4. Atkinson G, Nevill AM. Selected issues in the design and analysis of sport performance research. J Sports Sci 2001;19:811–27. 10.1080/026404101317015447 [DOI] [PubMed] [Google Scholar]
  • 5. Malone JJ, Barrett S, Barnes C, et al. To infinity and beyond: the use of GPS devices within the football codes. Sci Med Football 2020;4:82–4. 10.1080/24733938.2019.1679871 [DOI] [Google Scholar]
  • 6. Thomas JR, Nelson JK, Silverman SJ. Research methods in physical activity. 6th edn. Champaign, USA: Human Kinetics, 2011. [Google Scholar]
  • 7. Foster C. Monitoring training in athletes with reference to overtraining syndrome. Med Sci Sports Exercise 1998;30:1164–8. 10.1097/00005768-199807000-00023 [DOI] [PubMed] [Google Scholar]
  • 8. Muthukrishnan K. Multimodal localisation: analysis, algortithms and experimental evaluation. University of Twente, 2009. [Google Scholar]
  • 9. Madry S. Global navigation satellite systems and their application. New York: Springer, 2015. [Google Scholar]
  • 10. Gilgien M, Sporri J, Limpach P, et al. The effect of different global navigation satellite system methods on positioning accuracy in elite alpine skiing. Sensors 2014;14:18433–53. 10.3390/s141018433 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Scott MTU, Scott TJ, Kelly VG. The validity and reliability of global positioning systems in team sport: a brief review. J Strength Cond Res 2016;30:1470–90. 10.1519/JSC.0000000000001221 [DOI] [PubMed] [Google Scholar]
  • 12. Luteberget LS, Spencer M, Gilgien M. Validity of the catapult clearsky T6 local positioning system for team sports specific drills, in indoor conditions. Front Physiol 2018;9:115–15. 10.3389/fphys.2018.00115 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018;169:467–73. 10.7326/m18-0850 [DOI] [PubMed] [Google Scholar]
  • 14. Akenhead R, French D, Thompson KG, et al. The acceleration dependent validity and reliability of 10 Hz GPS. J Sci Med Sport 2014;17:562–6. 10.1016/j.jsams.2013.08.005 [DOI] [PubMed] [Google Scholar]
  • 15. Barbero-Álvarez JC, Coutts A, Granda J, et al. The validity and reliability of a global positioning satellite system device to assess speed and repeated sprint ability (RSA) in athletes. J Sci Med Sport 2010;13:232–5. 10.1016/j.jsams.2009.02.005 [DOI] [PubMed] [Google Scholar]
  • 16. Barr M, Beaver T, Turczyn D, et al. Validity and reliability of 15 Hz global positioning system units for assessing the activity profiles of university football players. J Strength Cond Res 2019;33:1371–9. 10.1519/jsc.0000000000002076 [DOI] [PubMed] [Google Scholar]
  • 17. Bastida-Castillo A, Carmona CDG, Sánchez E, et al. Accuracy, intra- and inter-unit reliability, and comparison between GPS and UWB-based position-tracking systems used for time-motion analyses in soccer. Eur J Sport Sci 2018;18:450–7. 10.1080/17461391.2018.1427796 [DOI] [PubMed] [Google Scholar]
  • 18. Bastida-Castillo A, Gomez-Carmona CD, De La Cruz Sanchez E, et al. Comparing accuracy between global positioning systems and ultra-wideband-based position tracking systems used for tactical analyses in soccer. Eur J Sport Sci 2019;1–9. 10.1080/17461391.2019.1584248 [DOI] [PubMed] [Google Scholar]
  • 19. Bataller-Cervero AV, Gutierrez H, DeRentería J, et al. Validity and reliability of a 10 Hz GPS for assessing variable and mean running speed. J Hum Kinet 2019;67:17–24. 10.2478/hukin-2018-0084 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Beato M, Coratella G, Stiff A, et al. The validity and between-unit variability of GNSS units (STATSports Apex 10 and 18 Hz) for measuring distance and peak speed in team sports. Front Physiol 2018;9:1288 10.3389/fphys.2018.01288 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Beato M, Devereux G, Stiff A. Validity and reliability of global positioning system units (STATSports Viper) for measuring distance and peak speed in sports. J Strength Cond Res 2018;32:2831–7. 10.1519/JSC.0000000000002778 [DOI] [PubMed] [Google Scholar]
  • 22. Beato M, Bartolini D, Ghia G, et al. Accuracy of a 10 Hz GPS unit in measuring shuttle velocity performed at different speeds and distances (5–20 M). J Hum Kinet 2016;54:15–22. 10.1515/hukin-2016-0031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Castellano J, Casamichana D, Calleja-Gonzalez J, et al. Reliability and accuracy of 10 Hz GPS devices for short-distance exercise. J Sports Sci Med 2011;10:233–4. PMID: 24137056 [PMC free article] [PubMed] [Google Scholar]
  • 24. Coutts AJ, Duffield R. Validity and reliability of GPS devices for measuring movement demands of team sports. J Sci Med Sport 2010;13:133–5. 10.1016/j.jsams.2008.09.015 [DOI] [PubMed] [Google Scholar]
  • 25. Delaney JA, Wileman TM, Perry NJ, et al. The validity of a global navigation satellite system for quantifying small-area team-sport movements. J Strength Cond Res 2019;33:1463–6. 10.1519/jsc.0000000000003157 [DOI] [PubMed] [Google Scholar]
  • 26. Duffield R, Reid M, Baker J, et al. Accuracy and reliability of GPS devices for measurement of movement patterns in confined spaces for court-based sports. J Sci Med Sport 2010;13:523–5. 10.1016/j.jsams.2009.07.003 [DOI] [PubMed] [Google Scholar]
  • 27. Edgecomb S, Norton K. Comparison of global positioning and computer-based tracking systems for measuring player movement distance during Australian football. J Sci Med Sport 2006;9:25–32. 10.1016/j.jsams.2006.01.003 [DOI] [PubMed] [Google Scholar]
  • 28. Figueira B, Goncalves B, Folgado H, et al. Accuracy of a basketball indoor tracking system based on standard bluetooth low energy channels (NBN23((R))). Sensors 2018;18:1940 10.3390/s18061940 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Frencken WGP, Lemmink KAPM, Delleman NJ. Soccer-specific accuracy and validity of the local position measurement (LPM) system. J Sci Med Sport 2010;13:641–5. 10.1016/j.jsams.2010.04.003 [DOI] [PubMed] [Google Scholar]
  • 30. Gray A, Jenkins D, Andrews M, et al. Validity and reliability of GPS for measuring distance travelled in field-based team sports. J Sports Sci 2010;28:1319–25. 10.1080/02640414.2010.504783 [DOI] [PubMed] [Google Scholar]
  • 31. Hoppe MW, Baumgart C, Polglaze T, et al. Validity and reliability of GPS and LPS for measuring distances covered and sprint mechanical properties in team sports. PLoS One 2018;13:e0192708 10.1371/journal.pone.0192708 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Jennings D, Cormack S, Coutts AJ, et al. The validity and reliability of GPS units for measuring distance in team sport specific running patterns. Int J Sports Physiol Perform 2010;5:328–41. 10.1123/ijspp.5.3.328 [DOI] [PubMed] [Google Scholar]
  • 33. Johnston RJ, Watsford ML, Kelly SJ, et al. Validity and interunit reliability of 10 Hz and 15 Hz GPS units for assessing athlete movement demands. J Strength Cond Res 2014;28:1649–55. 10.1519/JSC.0000000000000323 [DOI] [PubMed] [Google Scholar]
  • 34. Johnston RJ, Watsford ML, Pine MJ, et al. Assessment of 5 Hz and 10 Hz GPS units for measuring athlete movement demands. Int J Perform Anal Sport 2013;13:262–74. 10.1080/24748668.2013.11868646 [DOI] [Google Scholar]
  • 35. Johnston RJ, Watsford ML, Pine MJ, et al. The validity and reliability of 5-Hz global positioning system units to measure team sport movement demands. J Strength Cond Res 2012;26:758–65. 10.1519/JSC.0b013e318225f161 [DOI] [PubMed] [Google Scholar]
  • 36. Köklü Y, Arslan Y, Alemdaroglu U, et al. Accuracy and reliability of SPI ProX global positioning system devices for measuring movement demands of team sports. J Sports Med Phys Fitness 2015;55:471–7. PMID: 25303067 [PubMed] [Google Scholar]
  • 37. Lacome M, Peeters A, Mathieu B, et al. Can we use GPS for assessing sprinting performance in rugby sevens? A concurrent validity and between-device reliability study. Biol Sport 2019;36:25–9. 10.5114/biolsport.2018.78903 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Leser R, Schleindlhuber A, Lyons K, et al. Accuracy of an UWB-based position tracking system used for time-motion analyses in game sports. Eur J Sport Sci 2014;14:635–42. 10.1080/17461391.2014.884167 [DOI] [PubMed] [Google Scholar]
  • 39. Link D, Weber M, Linke D, et al. Can positioning systems replace timing gates for measuring sprint time in ice hockey? Front Physiol 2018;9:1882 10.3389/fphys.2018.01882 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Linke D, Link D, Lames M. Validation of electronic performance and tracking systems EPTS under field conditions. PLoS One 2018;13:e0199519 10.1371/journal.pone.0199519 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41. MacLeod H, Morris J, Nevill A, et al. The validity of a non-differential global positioning system for assessing player movement patterns in field hockey. J Sports Sci 2009;27:121–8. 10.1080/02640410802422181 [DOI] [PubMed] [Google Scholar]
  • 42. Muñoz-Lopez A, Granero-Gil P, Pino-Ortega J, et al. The validity and reliability of a 5-hz GPS device for quantifying athletes’ sprints and movement demands specific to team sports. J Hum Sport & Exercise 2017;12:156–66. 10.14198/jhse.2017.121.13 [DOI] [Google Scholar]
  • 43. Nagahara R, Botter A, Rejc E, et al. Concurrent validity of GPS for deriving mechanical properties of sprint acceleration. Int J Sports Physiol Perform 2017;12:129–32. 10.1123/ijspp.2015-0566 [DOI] [PubMed] [Google Scholar]
  • 44. Nikolaidis PT, Clemente FM, van der Linden CMI, et al. Validity and reliability of 10-Hz global positioning system to assess in-line movement and change of direction. Front Physiol 2018;9:228 10.3389/fphys.2018.00228 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Ogris G, Leser R, Horsak B, et al. Accuracy of the LPM tracking system considering dynamic position changes. J Sports Sci 2012;30:1503–11. 10.1080/02640414.2012.712712 [DOI] [PubMed] [Google Scholar]
  • 46. Padulo J, Iuliano E, Brisola G, et al. Validity and reliability of a standalone low-end 50-Hz GNSS receiver during running. Biol Sport 2019;36:75–80. 10.5114/biolsport.2019.79974 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Petersen C, Pyne D, Portus M, et al. Validity and reliability of GPS units to monitor cricket-specific movement patterns. Int J Sports Physiol Perform 2009;4:381–93. 10.1123/ijspp.4.3.381 [DOI] [PubMed] [Google Scholar]
  • 48. Portas MD, Harley JA, Barnes CA, et al. The validity and reliability of 1-Hz and 5-Hz global positioning systems for linear, multidirectional, and soccer-specific activities. Int J Sports Physiol Perform 2010;5:448–58. 10.1123/ijspp.5.4.448 [DOI] [PubMed] [Google Scholar]
  • 49. Rampinini E, Alberti G, Fiorenza M, et al. Accuracy of GPS devices for measuring high-intensity running in field-based team sports. Int J Sports Med 2015;36:49–53. 10.1055/S-0034-1385866 [DOI] [PubMed] [Google Scholar]
  • 50. Rawstorn JC, Maddison R, Ali A, et al. Rapid directional change degrades GPS distance measurement validity during intermittent intensity running. PLoS One 2014;9:e93693 10.1371/journal.pone.0093693 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Reinhardt L, Schwesig R, Lauenroth A, et al. Enhanced sprint performance analysis in soccer: new insights from a GPS-based tracking system. PLoS One 2019;14:e0217782 10.1371/journal.pone.0217782 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Rhodes J, Mason B, Perrat B, et al. The validity and reliability of a novel indoor player tracking system for use within wheelchair court sports. J Sports Sci 2014;32:1639–47. 10.1080/02640414.2014.910608 [DOI] [PubMed] [Google Scholar]
  • 53. Roe G, Darrall-Jones J, Black C, et al. Validity of 10-HZ GPS and timing gates for assessing maximum velocity in professional rugby union players. Int J Sports Physiol Perform 2017;12:836–9. 10.1123/ijspp.2016-0256 [DOI] [PubMed] [Google Scholar]
  • 54. Sathyan T, Shuttleworth R, Hedley M, et al. Validity and reliability of a radio positioning system for tracking athletes in indoor and outdoor team sports. Behav Res Methods 2012;44:1108–14. 10.3758/s13428-012-0192-2 [DOI] [PubMed] [Google Scholar]
  • 55. Serpiello FR, Hopkins WG, Barnes S, et al. Validity of an ultra-wideband local positioning system to measure locomotion in indoor sports. J Sports Sci 2018;36:1727–33. 10.1080/02640414.2017.1411867 [DOI] [PubMed] [Google Scholar]
  • 56. Siegle M, Stevens T, Lames M. Design of an accuracy study for position detection in football. J Sports Sci 2013;31:166–72. 10.1080/02640414.2012.723131 [DOI] [PubMed] [Google Scholar]
  • 57. Stevens TGA, De Ruiter CJ, Van Niel C, et al. Measuring acceleration and deceleration in soccer-specific movements using a local position measurement (lpm) system. Int J Sports Physiol Perform 2014;9:446–56. 10.1123/IJSPP.2013-0340 [DOI] [PubMed] [Google Scholar]
  • 58. Varley MC, Fairweather IH, Aughey RJ. Validity and reliability of GPS for measuring instantaneous velocity during acceleration, deceleration, and constant motion. J Sports Sci 2012;30:121–7. 10.1080/02640414.2011.627941 [DOI] [PubMed] [Google Scholar]
  • 59. Vickery WM, Dascombe B, Baker JD, et al. Accuracy and reliability of gps devices for measurement of sports-specific movement patterns related to cricket, tennis, and field-based team sports. J Strength Cond Res 2014;28:1697–705. 10.1519/JSC.0000000000000285 [DOI] [PubMed] [Google Scholar]
  • 60. Waldron M, Worsfold P, Twist C, et al. Concurrent validity and test-retest reliability of a global positioning system (GPS) and timing gates to assess sprint performance variables. J Sports Sci 2011;29:1613–19. 10.1080/02640414.2011.608703 [DOI] [PubMed] [Google Scholar]
  • 61. Gonçalves BV, Figueira BE, Maçãs V, et al. Effect of player position on movement behaviour, physical and physiological performances during an 11-a-side football game. J Sports Sci 2014;32:191–9. 10.1080/02640414.2013.816761 [DOI] [PubMed] [Google Scholar]
  • 62. Aguiar M, Gonçalves B, Botelho G, et al. Footballers’ movement behaviour during 2-, 3-, 4- and 5-a-side small-sided games. J Sports Sci 2015;33:1259–66. 10.1080/02640414.2015.1022571 [DOI] [PubMed] [Google Scholar]
  • 63. Gilgien M, Spörri J, Chardonnens J, et al. Determination of external forces in alpine skiing using a differential global navigation satellite system. Sensors 2013;13:9821–35. 10.3390/s130809821 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64. Gilgien M, Spörri J, Chardonnens J, et al. Determination of the centre of mass kinematics in alpine skiing using differential global navigation satellite systems. J Sports Sci 2015;33:960–9. 10.1080/02640414.2014.977934 [DOI] [PubMed] [Google Scholar]
  • 65. Fasel B, Spörri J, Gilgien M, et al. Three-dimensional body and centre of mass kinematics in alpine ski racing using differential GNSS and inertial sensors. Remote Sens 2016;8:671 10.3390/rs8080671 [DOI] [Google Scholar]
  • 66. Gløersen Ø, Kocbach J, Gilgien M. Tracking performance in endurance racing sports: evaluation of the accuracy offered by three commercial GNSS receivers aimed at the sports market. Front Physiol 2018;9 10.3389/fphys.2018.01425 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67. Malone JJ, Lovell R, Varley MC, et al. Unpacking the black box: applications and considerations for using GPS devices in sport. Int J Sports Physiol Perform 2016;1–30. 10.1123/ijspp.2016-0236 [DOI] [PubMed] [Google Scholar]

Articles from BMJ Open Sport — Exercise Medicine are provided here courtesy of BMJ Publishing Group

RESOURCES