Skip to main content
Springer logoLink to Springer
. 2026 Jan 23;54(5):1494–1503. doi: 10.1007/s10439-026-03991-4

Comparison of Six Data Cleaning Methods for Determining Repetitive Head Impact Exposure in Youth Tackle Football

Samantha DeAngelo 1,2, Adam Culiver 3,4, Enora Le Flao 1,2,5, Nick Shoaf 1, Durshil Doshi 1, Ryan Tracy 1, Nii-Ayi Aryeetey 6, Anna Quatrale 6, Carly Smith 1,2, Jianing Ma 7, Jeff Pan 7, Jingzhen Yang 2,8, Sean C Rose 2,9, James Onate 1,2,5, Nathan Edwards 5, Zeynep Saygin 2,6, Jaclyn B Caccese 1,2,10,✉
PMCID: PMC13004607  NIHMSID: NIHMS2154539  PMID: 41575729

Abstract

Purpose

Instrumented mouthguards (iMGs) are commonly used to quantify head acceleration event (HAE) exposure, but accurate interpretation requires rigorous data cleaning methods. This study compared six data cleaning methods for determining HAE rates and magnitudes, as well as cleaning method validity compared to the 5th method video verification in youth tackle football.

Methods

Fifty athletes (ages 8-12) wore Impact Monitoring Mouthguards during games across one season. Six data cleaning methods were applied to HAEs, including uncleaned data, time-windowing, proprietary classification algorithms, video verification, and combinations thereof. Impact rate, peak linear acceleration (PLA), and peak rotational velocity (PRV) were compared across methods using rate ratios, and intra-class correlation coefficients (ICCs), and non-parametric analyses.

Results

Data cleaning methods significantly influenced HAE rate but had minimal effect on magnitude. The uncleaned dataset produced the highest HAE rate (67.75 per athlete exposure), while the most stringent method (i.e., time-windowed, proprietary algorithm-classified, video-verified data) yielded the lowest (0.70 per athlete exposure). Although the time-windowed, proprietary algorithm-classified data demonstrated high specificity (0.96), it demonstrated low sensitivity (0.37) and positive predictive value (0.39) when compared to video-verified data. Differences in PLA across methods were not significant; only one significant difference in PRV was observed.

Conclusions

These findings highlight the impact of data cleaning on HAE quantification in youth tackle football. Although video verification remains best practice, it is resource intensive. Time-windowed, algorithm-classified data may serve as an efficient proxy in similar cohorts, though researchers should recognize its limitations. Findings support the need for standardized data cleaning methods and transparent reporting to ensure accurate and comparable HAE exposure estimates.

Keywords: Head acceleration events, Sensor validation, Concussion, Video verification

Introduction

In the United States, over two million youth athletes participate in tackle football annually [1, 2]. However, overall youth sport participation is declining, with football experiencing the steepest drop [3, 4]. Recently, concerns have grown regarding the potential neurodevelopmental effects of sustaining repetitive head impacts (RHIs) during critical periods of neurodevelopment [5, 6]. While football safety discussions have historically focused on concussions, increasing attention is now being directed toward RHIs, which occur without immediate symptoms or clinical diagnosis. RHIs are a routine part of normal play, raising significant concern about their cumulative effects over time [6].

Studies investigating the effects of RHIs in humans have produced conflicting findings. Some report microstructural brain changes and short-term functional impairments, [7–17] while others find minimal link between RHI exposure and short-term outcomes [18–24]. Similarly, findings on the long-term effects are heterogeneous, and few studies have specifically addressed long-term outcomes in tackle football players who only played at the youth level [25–29]. These discrepancies suggest that factors such as the timing, frequency, and magnitude of RHIs may influence the extent of impairment, [30–32] highlighting the importance of accurately quantifying RHI exposure to better understand its potential impact.

Concerns regarding RHI exposure have led to the adoption of monitoring strategies using wearable sensors. These devices, typically containing accelerometers and gyroscopes, record head acceleration events (HAEs) to estimate the skull–and by extension, brain–movement during RHIs in real time. HAE typically refers to sensor-recorded data and will be used throughout this paper to denote RHIs. Several types of wearable devices have been used in studies, including skin-based sensors, headband-affixed sensors, helmet-affixed sensors, and instrumented mouthguards (iMGs) [33–38]. These wearable devices have undergone both laboratory validation, using controlled impacts on instrumented head forms, and on-field validation, where HAEs are matched with observed impacts on video [35, 37]. In tackle football, the Head Impact Telemetry System (HIT) has been the most widely used system, embedding accelerometers inside helmets [38]. However, proper helmet fit is critical to avoid measuring helmet movement rather than true skull motion—a concern that similarly affects headband- and skin-based sensors [39, 40]. iMGs are worn on the teeth, providing a more direct coupling to the skull [35, 41]. Among available iMGs, Prevent Biometrics’ Impact Monitor Mouthguard has demonstrated similar or better kinematic accuracy and on-field performance compared to other commercially available options [35, 42, 43].

Despite advancements in sensor technology, inaccuracies and inconsistencies in HAE data collection remain a significant challenge. A primary concern is the inclusion of false-positive HAE recordings, where the iMG recordings do not represent true head movement, as this has been shown to over-estimate the count and magnitude of HAEs [40, 44]. To address this, researchers use data cleaning techniques to improve the validity of reported exposures [33, 36, 45, 46]. The Consensus head acceleration measurement practices (CHAMP) guidelines recommend two primary methods: time-windowing and video verification [46]. Time-windowing involves removing HAEs recorded outside of active play periods (e.g., before and after the game, halftime, and timeouts), while video verification involves matching each sensor-recorded HAE to synchronized video footage to confirm its occurrence [46]. Although video verification methods improve data quality, there are inherent limitations in video verification methods and as such, video verification is considered a best practice rather than a gold standard. Additionally, video verification methods are labor-intensive, requiring significant personnel training, time, and effort.

Many commercially available iMGs, use proprietary “black-box” classification algorithms designed to automatically filter out false positive HAEs.[45–48] These algorithms aim to reduce the burden of manual data cleaning by identifying true HAEs without requiring extensive post-processing. However, few studies have rigorously evaluated the accuracy of these algorithms compared with manual methods.[32, 49] As the use of wearable devices becomes increasingly common, establishing standardized, efficient, and valid data cleaning procedures is critical for enabling consistent comparisons of HAE exposure across studies.

The primary purpose of this study was to evaluate the validity of six common data cleaning methods for iMG-measured HAEs in youth tackle football, using video verification as the criterion measure. A secondary objective was to investigate the downstream effects of each method on HAE rate and magnitude to understand how data validity influences these common outcome measures of HAE exposure. We hypothesized that data cleaning method would affect validity, rate, and magnitude.

Materials and Methods

Study Design

This was a prospective observational study.

Participants

Athletes from a single American youth tackle football program (3rd-6th grade) were invited to participate in the study. A total of 67 athletes aged 8 to 12 years enrolled in the study, but 8 dropped out due to iMG discomfort, our primary analysis included 50 total athletes. All participants provided written assent and parents provided written parental informed consent. This study was approved by The Ohio State University Institutional Review Board.

Instrumentation

Participants wore either custom-fit (n = 50) or boil-and-bite (n = 9) Impact Monitoring Mouthguard (V2; Prevent Biometrics, Edina, MN). Custom-fit iMGs were made from 3D scans obtained using an intraoral scanner (i-Tero, AZ, USA), while boil-and-bite iMGs were fit by placing the iMG in boiling water for 20 seconds, aligning the iMG to the teeth and allowing it to set in the mouth for 30 seconds, followed by a cold-water rinse.[50] Athletes who had braces (n = 7) or were not present when 3D scans were obtained (n = 2) wore boil-and-bite iMGs, all other athletes used custom-fit iMGs. Due to resulting data discrepancies observed in the boil-and-bite group, particularly among athletes with braces, likely due to poor fit, only data from the custom-fit iMGs are included in the primary analysis (n = 50). The data from the total sample (n = 59) and from only boil-and-bite iMGs (n = 9) are provided for comparison in the Supplementary Material.

Each iMG was equipped with a tri-axial accelerometer and gyroscope, both sampling at 3200 Hz, capable of measuring linear acceleration up to 200 g per axis and rotational velocity up to 35 rad/s per axis. The iMGs triggered recording when linear acceleration exceeded 8 g on any single axis and recorded 10 ms before and 40 ms after the trigger event. All impacts were processed through Prevent Biometrics’ proprietary algorithm (Software Version 2.1.24-38), which includes filtering, transformation to the head center of gravity, and correction factor application based on the algorithm-determine quality class. An inclusion threshold on the processed peak linear acceleration (PLA) of 10 g was utilized in this study, consistent with common practice in sports research to distinguish impact-HAEs from non-impact events.[51, 52] The PLA and peak rotational velocity (PRV) provided by the manufacturer were used for all analyses.

Data Collection Sessions

Participants wore iMGs during the 2023 season for one to eight games. Although athletes practiced together, games were played separately by three grade-based teams (i.e., 3rd/4th grade, 5th grade, and 6th grade), totaling 20 games. A research team member attended each game to distribute and collect iMGs, video record the game, monitor iMG compliance, and maintain device functionality, including charging, sanitization, and synchronization with video. Athlete attendance was documented to calculate athlete exposures, defined as one athlete participating in one game while wearing a functioning iMG. Proper iMG wear during games was monitored by the on-field referees as part of league standards.

Video Recording

All games were video recorded with a Sony 4k Cyber-Shot RX100 camera (Sony, Tokyo, Japan) 50 frames/s and a resolution of 1080 p from the best vantage point at each field. At the start of each recording, an iPhone clock (Apple, Cupertino, CA) was displayed to time-synchronize the video and iMG data collected through the Prevent Biometrics app. Video recordings were used for both time-windowing (i.e., recording active play periods and removing breaks such as halftime and timeouts) and for guided video verification of HAEs.

RHI Data Synchronization

We synchronized video recordings with IMG data using a two-step process. During data collection, a phone displaying the world clock, with a 1 minute resolution, was displayed on video. In the first step, this was used to coarsely align the HAE timestamps on the video timeline. In the second step, we identified a specific head impact that was both recorded by the IMG and clearly visible on the video footage. This impact served as a "ground truth" event, and was used to recalculate the precise alignment between the HAE timestamps and the video timeline.

Data Cleaning & Analysis

Six data cleaning methods were applied to iMG data (Table 1). For all Methods only iMG recorded HAEs over the 10 g inclusion threshold were included (visually identifiable HAEs that did not trigger iMG recordings were not included).For each data cleaning method, impact count and impact rate (impact count/athlete exposure) were calculated. To compare rates, methods were compared using impact rate ratios (Method A Impact Rate/Method B Impact Rate), with corresponding 95% confidence intervals (CIs), and two-way mixed-effects intraclass correlation coefficients (ICCs) for absolute agreement [53, 54]. Impact rate ratios with 95% CIs not containing 1.0 were considered statistically significant. ICCs were interpreted as follows: < 0.5 indicated poor agreement, between 0.5 and 0.75 indicated moderate agreement, between 0.75 and 0.9 indicated good agreement, and > 0.9 indicated excellent agreement. To establish validity, sensitivity, specificity, and positive predictive value (PPV) were calculated for all methods with Method 5 (video verification) as the reference. This was done to compare the current best practice of video verification to the other presented cleaning methods.[55] True positives were defined as HAEs classified as true by both Method 5 (video verification) and the compared method. False positives were defined as HAEs classified as false by Method 5 but true by the compared method. False negatives were defined as HAEs classified as true by Method 5 but false by the compared method. True negatives were defined as HAEs classified as false by both Method 5 and the compared method. Differences in impact magnitudes (i.e., player median PLA and median PRV) across methods were analyzed using a Related-Samples Friedman’s Two-Way ANOVA with significance adjusted using a Bonferroni correction.

Table 1.

Description of six data cleaning methods analyzed

Method Number Description
Method 1 All HAEs without cleaning, regardless of classification or timing.
Method 2 Time-windowed HAEs limited to active game play, excluding periods before the start of the game, after the end of the game, and during breaks (e.g., halftime, time outs).
Method 3 HAEs classified as true positives by prevent biometrics’ proprietary classification algorithm without time-windowing.
Method 4 Time-windowed HAEs classified as true positives by Prevent Biometrics’ proprietary classification algorithm.
Method 5 Video verification, where a trained research team member performed a guided video review of all time-windowed HAEs recorded by the IMGs in Sportscode (Hudl, Lincoln, NE) and coded HAEs as true or false positive based on observable contact synchronized to the recorded game footage. Only iMG recorded HAEs were included (visually identifiable HAEs that did not trigger iMG recordings were not included). HAEs recorded by iMGs that occurred outside of the camera view (n = 90) and could not be verified were excluded from analyses.
Method 6 Time-windowed, HAEs classified as true positives by both the Prevent Biometrics’ proprietary classification algorithm and confirmed through video verification.

Inter-rater reliability for video verification was determined from six games independently reviewed by two raters. Across the six games, Rater 1 classified 124 HAEs and Rater 2 classified 167 HAEs as true positive impacts, resulting in excellent agreement, with an ICC of 0.950 (95% CI: 0.902-0.975; p < 0.001). Out of 4921 recorded HAEs, 100 were identified as true HAEs by both raters, while 91 resulted in discrepancy between raters.

Results

Data from 50 athletes whose custom-fit iMGs successfully recorded HAEs during the season were included in the analysis (9 athletes who had boil-and-bite iMGs are included in the Supplementary Material; total n = 59, mean age = 10.2 ± 1.0 years, height = 145.7 ± 10.7 cm, mass = 40.8 ± 9.1 kg). Across the 50 athletes, a total of 232 athlete-exposures were recorded across 20 games, with athletes participating in one to eight games each. Among the six data cleaning methods, Method 6 (time-windowed, HAEs confirmed by both proprietary algorithm and video verification) resulted in the lowest HAE count and rate per athlete exposure (Table 2). Impact rate ratios differed significantly across all data cleaning methods except between Methods 4 (time-windowed, algorithm-classified HAEs) and 5 (video verification) (Table 2). The smallest difference was observed between Methods 4 and 5, while the largest difference was observed between Methods 1 (uncleaned) and 6. ICCs indicated good agreement (0.836) between Method 3 (algorithm-classified HAEs without time windowing) and 4. All other ICCs indicated less than or equal to moderate agreement (Table 2).

Table 2.

Comparison of head acceleration event (HAE) exposure across six data cleaning methods

Method Impact number Impact rate (95% CI) Compared method Impact rate ratio (95% CI) ICC (95% CI)

1

(Uncleaned)

15719 67.75 (59.52-77.13) 2 2.36 (2.29-2.43)* 0.632 (0.381-0.786)*
3 25.23 (23.29-27.33)* 0.008 (− 0.205-0.242)
4 37.43 (33.97-41.23)* 0.004 (− 0.207-0.238)
5 35.40 (32.22-38.91)* 0.010 (− 0.202-0.244)
6 96.44 (82.65-112.53)* 0.001 (− 0.208-0.234)

2

(time-windowed HAEs only)

6666 28.73 (25.21-32.75) 3 10.70 (9.86-11.62)* 0.012 (− 0.205-0.249)
4 15.87 (14.38-17.52)* 0.009 (− 0.205-0.243)
5 15.01 (13.64-16.53)* 0.024 (− 0.191-0.259)
6 40.90 (35.01-47.77* 0.002 (− 0.208-0.234)

3

(algorithm-classified HAEs without time windowing)

623 2.69 (2.31-3.12) 4 1.48 (1.31-1.68)* 0.836 (0.612-0.921)*
5 1.40 (1.24-1.58)* 0.424 (0.175-0.623)*
6 3.82 (3.22-4.54)* 0.284 (− 0.002-0.525)*

4

(algorithm-classified HAEs with time windowing)

420 1.81 (1.54-2.13) 5 0.95 (0.83-1.08) 0.505 (0.271-0.684)*
6 2.58 (2.15-3.09)* 0.476 (0.142-0.693)*

5

(video verification)

444 1.91 (1.63-2.24) 6 2.72 (2.28-3.26)* 0.386 (0.003-0.645*

6

(HAEs confirmed by both proprietary classification algorithm and video verification)

163 0.70 (0.58-0.86)

Impact count and impact rate per athlete exposure are presented for each data cleaning method. Impact rate ratios (Impact rate for method A divided by impact rate for method B and intraclass correlation coefficients (ICCs) with 95% confidence intervals CI were calculated to assess agreement between methods. ICCs were interpreted as follows: < 0.5 = poor agreement, 0.5–0.75 = moderate agreement, 0.75–0.90 = good agreement, > 0.90 = excellent agreement. *indicates a significant difference was observed. HAE  head acceleration event

Sensitivity, specificity and PPV results are presented in Table 3. Sensitivity, specificity and PPV were calculated with Method 5 as the reference criteria. Methods 1, 2 and 6 resulted in the highest sensitivity value of 1, while methods 3 and 4 resulted in lower sensitivity (0.37). Method 3 resulted in the highest specificity value (0.97), followed by method 4 (0.96). For PPV, method 4 resulted in the highest value (0.39), followed by method 3 (0.26).

Table 3.

Measures of validity across four data cleaning methods with Method 5 (video verification) as the criterion

Method compared to method 5 (Video-verification) Sensitivity Specificity Positive predictive value (PPV)
1 (Uncleaned) 1.00 0.00 0.03
2 (time-windowed HAEs only) 1.00 0.60 0.07
3 (algorithm-classified HAEs without time windowing) 0.37 0.97 0.26
4 (algorithm-classified HAEs with time windowing) 0.37 0.96 0.39
6 (HAEs confirmed by both proprietary classification algorithm and video verification) 1.00 N/A 1.00

Sensitivity, specificity and positive predictive value (PPV) are presented for methods one through six. Method 5 (video-verification) is used as the reference criteria

No significant differences in PLA were observed across data cleaning methods (Table 4). For PRV, only one significant difference was observed, between Method 1 and Method 3 (Table 5); all other pairwise comparisons were not statistically significant.

Table 4.

Comparison of peak linear acceleration (PLA) across six data cleaning methods

Peak linear acceleration (PLA, g)
Method Median 25th percentile 75th percentile Compared method Corrected
p-value

1

(Uncleaned)

14.6 13.6 16.7 2 1.000
3 1.000
4 1.000
5 1.000
6 1.000

2

(time-windowed HAEs only)

15.0 13.5 16.0 3 1.000
4 1.000
5 1.000
6 1.000

3

(algorithm-classified HAEs without time windowing)

13.9 12.7 16.7 4 1.000
5 1.000
6 1.000

4

(algorithm-classified HAEs with time windowing)

13.9 12.6 15.9 5 1.000
6 1.000

5

(video verification)

14.3 12.8 17.1 6 1.000

6

(HAEs confirmed by both proprietary classification algorithm and video verification)

14.4 11.9 15.9

Median peak linear acceleration (PLA) values are presented for each data cleaning method. Differences in PLA across methods were assessed using a related-samples Friedman’s Two-Way ANOVA with significance values adjusted by a Bonferroni correction

Table 5.

Comparison of peak rotational velocity (PRV) across six data cleaning methods

Peak rotational velocity (PRV, rad/s)
Method Median 25th percentile 25th percentile Compared method Corrected
p-value

1

(uncleaned)

8.5 6.5 10.1 2 1.000
3 0.003 *
4 0.268
5 1.000
6 1.000

2

(time-windowed HAEs only)

8.5 6.2 9.8 3 0.063
4 1.000
5 1.000
6 1.000

3

(algorithm-classified HAEs without time windowing)

6.5 4.8 9.4 4 1.000
5 0.449
6 0.672

4

(algorithm-classified HAEs with time windowing)

7.2 5.3 10.0 5 1.000
6 1.000

5

(video verification)

7.2 6.0 10.4 6 1.000

6

(HAEs confirmed by both proprietary classification algorithm and video verification)

7.4 5.6 8.8

Median peak rotational velocity (PRV) values are presented for each data cleaning method. Differences in PRV across methods were assessed using a related-samples Friedman’s Two-Way ANOVA with significance values adjusted by a Bonferroni correction. *indicates a significant difference was observed

Discussion

The primary purpose of this study was to evaluate the validity of several common data cleaning methods for iMG-measured HAEs in youth tackle football, using video verification as the criterion measure. A secondary objective was to investigate the downstream effects of each method on HAE rate and magnitude to understand how data validity influences these common outcome measures of HAE exposure. Partially consistent with our hypothesis, the data cleaning method significantly influenced HAE validity and rate but had minimal effects on HAE magnitudes.

Overall, results for the measures of validity (sensitivity, specificity and PPV) varied based on data cleaning method. Method 1 (uncleaned) represented the full dataset and all subsequent Methods contained HAEs included in the Method 1 dataset. Not surprisingly, Methods 1 and 2 resulted in very high sensitivity but very low specificity and PPV, recording all HAEs and not filtering out false positives. In contrast, Methods 3 and 4 resulted in high specificity but had relatively lower sensitivity and PPV. These findings suggest that although the proprietary algorithm effectively filters out false positives, it also misclassifies a substantial proportion of true HAEs in our cohort of athletes. Prior work has shown that between 14 and 40% of true HAEs may be incorrectly discarded by iMG algorithms, [35, 47, 52–54] particularly when iMGs are poorly coupled to the teeth. Inadequate coupling reduces the quality of the biomechanical recordings, increasing the likelihood that true HAEs are filtered out by the proprietary algorithm [37]. Specifically, Method 4 was identified by our research team as a time-efficient method compared to video verification however, our results suggest relying solely on algorithm-classified data risks underestimating exposure. When feasible, video verification remains essential for ensuring accurate HAE counts which is currently in accordance with the CHAMP guidelines [46].

A secondary aim was to quantify the extent to which HAE rates vary across methods. We used rate ratios to examine relative differences in HAE rates (i.e., group-level proportional differences), while ICCs assessed the consistency of exposure rankings across methods (i.e., individual-level consistency). Because these metrics capture different aspects of agreement, discrepancies between them were expected. We observed significant differences in both impact rate and impact rate ratio across all data cleaning methods, except for Methods 4 (algorithm-classified HAEs with time windowing) and 5 (video verification), suggesting that time-windowed, algorithm-classified methods may serve as a practical proxy when resources are limited. However, researchers should interpret findings with caution and acknowledge potential limitations, as noted above. As expected, Method 1 (uncleaned) resulted in the highest HAE count and impact rate, whereas Method 6 (HAEs confirmed by both proprietary classification algorithm and video verification) yielded the lowest. Notably, Method 2 (time-windowed HAEs only) resulted in approximately 15 times more HAEs than Method 5, reinforcing prior findings that time-windowing alone substantially overestimates true exposure compared to video verification, likely due to false positive HAEs occurring during active game play [53, 56–59]. ICCs results represent good agreement between Method 3 (algorithm-classified HAEs without time windowing) and Methods 4. These results suggest that while these methods may not agree on exact HAE counts, they are consistent in identifying which athletes experienced the most exposure.

In contrast to HAE rate, HAE magnitude (i.e., PLA and PRV) was surprisingly consistent across the data cleaning methods, a finding that contradicted our hypothesis that methods retaining more false positives would yield significantly inflated values [40, 44]. While a slight trend of higher magnitudes in the least restrictive methods (1 and 2) was observed, the general lack of statistical significance carries a critical implication that magnitude distributions are not reliable indicators of overall dataset validity. Although a combined approach like Method 6, which uses both video and biomechanical criteria, likely provides the most accurate PLA and PRV values for confirmed true positive events, a dataset contaminated with false positives can still present a statistically similar magnitude profile to a clean one. This underscores the danger of relying on outcome measures to assess data quality, especially if HAE magnitude is being considered separately from HAE rate.

This study has several limitations. First, our sample included only youth tackle football players aged 8-12 years, limiting generalizability to other age groups or sports. Collegiate tackle football athletes typically sustain more frequent and higher-magnitude HAEs, [60] so data cleaning method effects may differ. Second, only one HAE monitoring system (i.e., Prevent Biometrics) and one version of the device and procession algorithm were used; results may not apply to other devices or past and future versions of the algorithms. For our primary analysis, we excluded athletes who wore boil-and-bite iMGs due to data discrepancies for athletes with braces. We have included both the full (n = 59) and the boil-and-bite only (n = 9) results in the Supplementary Material. Of all 2398 boil-and-bite iMG-recorded HAEs, only 2 HAEs were deemed true positives by the proprietary-algorithm. This suggests that braces highly impact the outcomes of the proprietary algorithm classification, therefore the validity of the data from athletes with braces may be compromised. Additionally, we recognize the potential limitations of choosing a 10g inclusion threshold which may mis-represent some contact versus non-contact events. We chose this cutoff due to its common use as an impact threshold in the literature [52]. Device malfunction and athlete attrition contributed to data loss, which limited the athlete exposures available for analysis. Furthermore, we acknowledge that iMGs stand the potential to underestimate HAE counts if HAEs fail to meet PLA thresholds or due to sensor error [61–63]. Because we did a guided video verification process, our data set does not include false negative HAEs that were not recorded by the iMGs. Additionally, although video verification is considered the current best practice, there are inherent limitations of this method, such as issues with camera placement, field of view, and rater variability. Our single-camera setup contrasts with CHAMP recommendations for multi-angle views.[46] Distinguishing true from false positive impacts based solely on video footage can introduce uncertainty. Despite excellent inter-rater reliability, we observed a 91-HAE difference between raters over 6 games, highlighting challenges with video review [46]. We have attempted to mitigate discrepancies moving forward through improvement in training techniques and increased practice before starting the video verification process.

In conclusion, data cleaning methods have a substantial impact on HAEs rate but a limited effect on median HAE magnitude in youth tackle football games. When comparing to the current best practice of video verification, the Prevent Biometrics’ proprietary algorithm combined with time windowing demonstrated high specificity but low sensitivity and PPV. Although this method represents an efficient approximation, video verification likely remains the most accurate method for validating exposure. These findings highlight the importance of transparent reporting and standardization of HAE data cleaning methods to ensure comparability across studies utilizing iMGs.

Author Contributions

All authors have been involved in (1) the conception and design of the study, or acquisition of data, or analysis and interpretation of data, (2) drafting the article or revising it critically for important intellectual content, (3) final approval of the version to be submitted

Funding

This work was supported by the National Institutes of Health (NIH), Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), under Award Number R01HD110401.

Data Availability

Datasets generated and analyzed during the current study will be available in the DASH repository.

Declarations

Conflict of interest

No conflicts to report.

Ethical Approval

This study was approved by The Ohio State University Institutional Review Board (IRB #2021H0083). All procedures were conducted in accordance with the ethical standards of the IRB and with the principles outlined in the Declaration of Helsinki. Informed consent was obtained from all participants (assent) and parents or legal guardians (consent) prior to their participation in the study.

Consent to participate

Participants provided written assent and parents or legal guardians provided written parental consent prior to participation.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Waltzman, D., K. Sarmiento, and J. Daugherty. Factors that may influence Americans’ views on when children should start playing tackle football. J Athl Train. 59(1):22–29, 2024. 10.4085/1062-6050-0004.23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.“Ages 13-17 - State of Play 2020,” Project Play. Accessed: May 22, 2025. [Online]. Available: https://projectplay.org/state-of-play-2020/ages-13-17
  • 3.“State of Play 2024,” Project Play. Accessed: Jan. 15, 2025. [Online]. Available: https://projectplay.org/state-of-play-2024-introduction
  • 4.Macy, J. T., K. Kercher, J. A. Steinfeldt, and K. Kawata. Fewer US adolescents playing football and public health: a review of measures to improve safety and an analysis of gaps in the literature. Public Health Rep. 136(5):562–574, 2021. 10.1177/0033354920976553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Alosco, M. L., and R. A. Stern. Youth exposure to repetitive head impacts from tackle football and long-term neurologic outcomes: a review of the literature, knowledge gaps and future directions, and societal and clinical implications. Semin. Pediatr. Neurol. 30:107–116, 2019. 10.1016/j.spen.2019.03.016. [DOI] [PubMed] [Google Scholar]
  • 6.McAllister, T., and M. McCrea. Long-term cognitive and neuropsychiatric consequences of repetitive concussion and head-impact exposure. J. Athl. Train. 52(3):309–317, 2017. 10.4085/1062-6050-52.1.14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Bahrami, N., et al. Subconcussive head impact exposure and white matter tract changes over a single season of youth football. Radiology. 281(3):919–926, 2016. 10.1148/radiol.2016160564. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.DeSimone, J. C., et al. Mapping default mode connectivity alterations following a single season of subconcussive impact exposure in youth football. Human Brain Mapp. 42(8):2529–2545, 2021. 10.1002/hbm.25384. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Puvvada, S. K., et al. Relationship between time-weighted head impact exposure on directional changes in diffusion imaging in youth football players. Ann Biomed Eng. 49(10):2852–2862, 2021. 10.1007/s10439-021-02862-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Miller, L. E., et al. Cumulative strain-based metrics for predicting subconcussive head impact exposure–related imaging changes in a cohort of American youth football players. J Neurosurg Pediatr. 29(4):387–396, 2022. 10.3171/2021.10.PEDS21355. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Hack, L., B. Singh, F. Binkofski, and I. Helmich. Repetitive subconcussive head impacts in sports and their impact on brain anatomy and function: a systematic review. Int. J. Sports Med. 45:871–883, 2024. 10.1055/a-2342-3604. [DOI] [PubMed] [Google Scholar]
  • 12.McKee, A. C., M. Alosco, and B. R. Huber. Repetitive head impacts and chronic traumatic encephalopathy. Neurosurg Clin N Am. 27(4):529–535, 2016. 10.1016/j.nec.2016.05.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Montenigro, P. H., et al. Clinical subtypes of chronic traumatic encephalopathy: literature review and proposed research diagnostic criteria for traumatic encephalopathy syndrome. Alzheimers Res Ther. 6(5):68, 2014. 10.1186/s13195-014-0068-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Miyashita, T. L., E. Diakogeorgiou, and K. Marrie. Correlation of head impacts to change in balance error scoring system scores in division I men’s Lacrosse players. Sports Health. 9(4):318–323, 2017. 10.1177/1941738116685306. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Miyashita, T. L., E. Diakogeorgiou, and K. Marrie. The role of subconcussive impacts on sway velocities in division I men’s Lacrosse players. Sports Biomech. 19(2):180–188, 2020. 10.1080/14763141.2018.1458892. [DOI] [PubMed] [Google Scholar]
  • 16.Breedlove, K. M., et al. Detecting neurocognitive and neurophysiological changes as a result of subconcussive blows among high school football athletes. Athl. Train. Sports Health Care. 6(3):119–127, 2014. 10.3928/19425864-20140507-02. [Google Scholar]
  • 17.Belanger, H. G., R. D. Vanderploeg, and T. McAllister. Subconcussive blows to the head: a formative review of short-term clinical outcomes. J Head Trauma Rehabil. 31(3):159–166, 2016. 10.1097/HTR.0000000000000138. [DOI] [PubMed] [Google Scholar]
  • 18.Bonke, E. M., J. Southard, T. A. Buckley, C. Reinsberger, I. K. Koerte, and D. R. Howell. The effects of repetitive head impacts on postural control: a systematic review. J. Sci. Med. Sport. 24(3):247–257, 2021. 10.1016/j.jsams.2020.09.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Nilsson, K. J., et al. repetitive head impacts in youth football: description and relationship to white matter structure. Sports Health. 11(6):507–513, 2019. 10.1177/1941738119865264. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Gysland, S. M., J. P. Mihalik, J. K. Register-Mihalik, S. C. Trulock, E. W. Shields, and K. M. Guskiewicz. The relationship between subconcussive impacts and concussion history on clinical measures of neurologic function in collegiate football players. Ann Biomed Eng. 40(1):14–22, 2012. 10.1007/s10439-011-0421-3. [DOI] [PubMed] [Google Scholar]
  • 21.Murray, N. G., et al. Repetitive head impacts do not affect postural control following a competitive athletic season. Int. J. Psychophysiol. 132:81–86, 2018. 10.1016/j.ijpsycho.2017.09.018. [DOI] [PubMed] [Google Scholar]
  • 22.Caccese, J. B., et al. Effects of repetitive head impacts on a concussion assessment battery. Med. Sci.Sports & Exerc. 51(7):1355, 2019. 10.1249/MSS.0000000000001905. [DOI] [PubMed] [Google Scholar]
  • 23.Talavage, T. M., et al. Functionally-detected cognitive impairment in high school football players without clinically-diagnosed concussion. J. Neurotrauma. 31(4):327–338, 2014. 10.1089/neu.2010.1512. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Meehan, W. P., et al. Division III collision sports are not associated with neurobehavioral quality of life. J Neurotrauma. 33(2):254–259, 2016. 10.1089/neu.2015.3930. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Jones, S. A. V., R. W. Breakey, and P. J. Evans. Heading in football, long-term cognitive decline and dementia: evidence from screening retired professional footballers. British J. Sports med. 2014. 10.1136/bjsports-2013-092758. [DOI] [PubMed] [Google Scholar]
  • 26.Alosco, M. L., et al. Late contributions of repetitive head impacts and TBI to depression symptoms and cognition. Neurology. 95(7):e793–e804, 2020. 10.1212/WNL.0000000000010040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Roberts, A. L., et al. Exposure to American football and neuropsychiatric health in former national football league players: findings from the football players health study. Am J Sports Med. 47(12):2871–2880, 2019. 10.1177/0363546519868989. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Rose, S. C., K. O. Yeates, J. T. Nguyen, N. M. Pizzimenti, P. M. Ercole, and M. T. McCarthy. Exposure to head impacts and cognitive and behavioral outcomes in youth tackle football players across 4 seasons. JAMA Network Open.4(12):e2140359, 2021. 10.1001/jamanetworkopen.2021.40359. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.McCrory, P., et al. Consensus statement on concussion in sport—the 5th international conference on concussion in sport held in Berlin, October 2016. Br J Sports Med. 51(11):838–847, 2017. 10.1136/bjsports-2017-097699. [DOI] [PubMed] [Google Scholar]
  • 30.Stemper, B. D., et al. Comparison of head impact exposure between concussed football athletes and matched controls: evidence for a possible second mechanism of sport-related concussion. Ann Biomed Eng. 47(10):2057–2072, 2019. 10.1007/s10439-018-02136-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Rowson, S., et al. Correlation of concussion symptom profile with head impact biomechanics: a case for individual-specific injury tolerance. J. Neurotrauma. 35(4):681–690, 2018. 10.1089/neu.2017.5169. [DOI] [PubMed] [Google Scholar]
  • 32.Le Flao, E., G. P. Siegmund, and R. Borotkanics. Head impact research using inertial sensors in sport: a systematic review of methods, demographics, and factors contributing to exposure. Sports Med. 52(3):481–504, 2022. 10.1007/s40279-021-01574-y. [DOI] [PubMed] [Google Scholar]
  • 33.Arbogast, K. B., et al. Consensus head acceleration measurement practices (CHAMP): origins, methods, transparency and disclosure. Ann Biomed Eng. 50(11):1317–1345, 2022. 10.1007/s10439-022-03025-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.O’Connor, K. L., S. Rowson, S. M. Duma, and S. P. Broglio. Head-impact-measurement devices: a systematic review. J. Athl Train. 52(3):206–227, 2017. 10.4085/1062-6050.52.2.05. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Kieffer, E. E., M. T. Begonia, A. M. Tyson, and S. Rowson. A two-phased approach to quantifying head impact sensor accuracy: in-laboratory and on-field assessments. Ann Biomed Eng. 48(11):2613–2625, 2020. 10.1007/s10439-020-02647-1. [DOI] [PubMed] [Google Scholar]
  • 36.Gabler, L., et al. Consensus head acceleration measurement practices (CHAMP): laboratory validation of wearable head kinematic devices. Ann Biomed Eng. 50(11):1356–1371, 2022. 10.1007/s10439-022-03066-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Bartsch, A. J., et al. Laboratory and on-field data collected by a head impact monitoring mouthguard. Annu Int Conf IEEE Eng Med Biol Soc. 2019:2068–2072, 2019. 10.1109/EMBC.2019.8856907. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Campbell, K. R., et al. Head impact telemetry system’s video-based impact detection and location accuracy. Med Sci Sports Exerc. 52(10):2198–2206, 2020. 10.1249/MSS.0000000000002371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Wu, L. C., et al. In vivo evaluation of wearable head impact sensors. Ann Biomed Eng. 44(4):1234–1245, 2016. 10.1007/s10439-015-1423-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Le Flao, E., G. P. Siegmund, S. Lenetsky, and R. Borotkanics. Quality issues in kinematic traces from three head impact sensors in boxing: prevalence, effects, and implications for exposure assessment. Ann Biomed Eng. 53(3):658–672, 2025. 10.1007/s10439-024-03647-1. [DOI] [PubMed] [Google Scholar]
  • 41.Tierney, G., et al. “Quantifying head acceleration exposure via instrumented mouthguards (iMG): a validity and feasibility study protocol to inform iMG suitability for the TaCKLE project”, BMJ Open Sport Exerc Med, 7(3). Sept. 2021. 10.1136/bmjsem-2021-001125. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.B. Jones et al., (2022) “Ready for impact? A validity and feasibility study of instrumented mouthguards (iMGs),” 10.1136/bjsports-2022-105523. [DOI] [PubMed]
  • 43.Liu, Y., et al. Validation and comparison of instrumented mouthguards for measuring head kinematics and assessing brain deformation in football impacts. Ann Biomed Eng. 48(11):2580–2598, 2020. 10.1007/s10439-020-02629-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Luke, D., R. Kenny, D. Bondi, A. C. Clansey, and L. C. Wu. On-field instrumented mouthguard coupling. J. Biomech.162:111889, 2024. 10.1016/j.jbiomech.2023.111889. [DOI] [PubMed] [Google Scholar]
  • 45.Rowson, S., et al. Consensus head acceleration measurement practices (CHAMP): study design and statistical analysis. Ann Biomed Eng. 50(11):1346–1355, 2022. 10.1007/s10439-022-03101-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Kuo, C., et al. On-field deployment and validation for wearable devices. Ann Biomed Eng. 50(11):1372–1388, 2022. 10.1007/s10439-022-03001-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Gabler, L. F., et al. On-field performance of an instrumented mouthguard for detecting head impacts in american football. Ann Biomed Eng. 48(11):2599–2612, 2020. 10.1007/s10439-020-02654-2. [DOI] [PubMed] [Google Scholar]
  • 48.Wu, L. C., et al. Detection of American football head impacts using biomechanical features and support vector machine classification. Sci Rep. 8(1):855, 2017. 10.1038/s41598-017-17864-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Patton, D., et al. Head impact sensor studies in sports: a systematic review of exposure confirmation methods. Ann Biomed Eng. 48(11):2497–2507, 2020. 10.1007/s10439-020-02642-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.“Hybrid Fitting Instructions.” [Online]. Available: chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://preventbiometrics.com/wp-content/uploads/2021/06/Hybrid-Fitting-Instructions.pdf
  • 51.Funk, J. R., J. M. Cormier, C. E. Bain, H. Guzman, E. Bonugli, and S. J. Manoogian. Head and neck loading in everyday and vigorous activities. Ann Biomed Eng. 39(2):766–776, 2011. 10.1007/s10439-010-0183-3. [DOI] [PubMed] [Google Scholar]
  • 52.King, D., P. Hume, C. Gissane, M. Brughelli, and T. Clark. The influence of head impact threshold for reporting data in contact and collision sports: systematic review and original data analysis. Sports Med. 46(2):151–169, 2016. 10.1007/s40279-015-0423-7. [DOI] [PubMed] [Google Scholar]
  • 53.Le, R. K., L. B. Lempke, M. N. Anderson, R. S. Johnson, J. D. Schmidt, and R. C. Lynall. Quantifying head impact biomechanical differences between commonly employed cleaning levels: a critical research interpretation consideration. Brain Injury. 37(10):1173–1178, 2023. 10.1080/02699052.2023.2211351. [DOI] [PubMed] [Google Scholar]
  • 54.Koo, T. K., and M. Y. Li. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 15(2):155–163, 2016. 10.1016/j.jcm.2016.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.J. Shreffler and M. R. Huecker, (2025) “Diagnostic testing accuracy: sensitivity, specificity, predictive values and likelihood ratios,” in StatPearls, Treasure Island (FL): StatPearls Publishing. [Online]. Available: http://www.ncbi.nlm.nih.gov/books/NBK557491/ [PubMed]
  • 56.Cortes, N., et al. Video analysis verification of head impact events measured by wearable sensors. Am J Sports Med. 45(10):2379–2387, 2017. 10.1177/0363546517706703. [DOI] [PubMed] [Google Scholar]
  • 57.Patton, D. A., C. M. Huber, C. C. McDonald, S. S. Margulies, C. L. Master, and K. B. Arbogast. Video confirmation of head impact sensor data from high school soccer players. Am J Sports Med. 48(5):1246–1253, 2020. 10.1177/0363546520906406. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Lamond, L. C., J. B. Caccese, T. A. Buckley, J. Glutting, and T. W. Kaminski. Linear acceleration in direct head contact across impact type, player position, and playing scenario in collegiate women’s soccer players. J Athl Train. 53(2):115–121, 2018. 10.4085/1062-6050-90-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Press, J. N., and S. Rowson. Quantifying head impact exposure in collegiate women’s soccer. Clin. J. Sport Med. 27(2):104, 2017. 10.1097/JSM.0000000000000313. [DOI] [PubMed] [Google Scholar]
  • 60.Choi, G. B., et al. Head impact exposure in youth and collegiate American football. Ann Biomed Eng. 50(11):1488–1497, 2022. 10.1007/s10439-022-02974-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Wang, T., R. Kenny, and L. C. Wu. Head impact sensor triggering bias introduced by linear acceleration thresholding. Ann Biomed Eng. 49(12):3189–3199, 2021. 10.1007/s10439-021-02868-y. [DOI] [PubMed] [Google Scholar]
  • 62.Tooby, J., et al. When to pull the trigger: conceptual considerations for approximating head acceleration events using instrumented mouthguards. Sports Med. 54(6):1361–1369, 2024. 10.1007/s40279-024-02012-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Patton, D. A., C. M. Huber, S. S. Margulies, C. L. Master, and K. B. Arbogast. Comparison of video-identified head contacts and sensor-recorded events in high school soccer. J Appl Biomech. 37(6):573–577, 2021. 10.1123/jab.2021-0191. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Datasets generated and analyzed during the current study will be available in the DASH repository.


Articles from Annals of Biomedical Engineering are provided here courtesy of Springer

RESOURCES