Abstract
Background:
Although some studies have observed a relationship between age of first exposure (AFE) to American football and long-term outcomes, recent findings in collegiate athletes did not observe a relationship between AFE and more intermediate outcomes at early adulthood. This, however, requires independent replication.
Hypothesis:
There will be no association between AFE to football and behavioral, cognitive, emotional/psychological, and physical functioning in high school and collegiate athletes.
Study Design:
Cross-sectional study.
Level of Evidence:
Level 3.
Methods:
Active high school and collegiate football players (N = 1802) underwent a comprehensive preseason evaluation on several clinical outcome measures. Demographic and health variables that significantly differed across AFE groups were identified as potential covariates. General linear models (GLMs) with AFE as the independent variable were performed for each clinical outcome variable. Similar GLMs that included identified covariates, with AFE as the predictor, were subsequently performed for each clinical outcome variable.
Results:
After controlling for covariates of age, concussion history, race, and a diagnosis of ADHD, earlier AFE (<12 vs ≥12 years) did not significantly predict poorer performance on any clinical outcome measures (all P > 0.05). A single statistically significant association between AFE group and somatization score was recorded, with AFE <12 years exhibiting lower levels of somatization.
Conclusion:
In a large cohort of active high school and collegiate football student-athletes, AFE before the age of 12 years was not associated with worse behavioral, cognitive, psychological, and physical (oculomotor functioning and postural stability) outcomes.
Clinical Relevance
The current findings suggest that timing of onset of football exposure does not result in poorer functioning in adolescence and young adults and may contribute to resilience through decreased levels of physically related psychological distress.
Keywords: adolescence, sports, football, concussion, traumatic brain injury, age of first exposure
Societal concern regarding participation in football has significantly increased in recent years, with particular focus on the long-term adverse outcomes associated with football participation at all levels of play.6,27,49 This movement has resulted in legislation to set minimum ages on participation in youth football32 and decreased participation in youth and high school football nationally, with 19.2% less enrollment from 2011-2016 among children aged 6 to 17 years.45 A recent survey of counseling practices and attitudes of pediatricians revealed virtually universal concern regarding concussion and contact sport participation among parents (97%).17 Furthermore, the study showed that 77% of pediatricians would not allow their child to play tackle football and 52% would not allow their child to play full contact sports at all.17
Prior studies have demonstrated an association between prior participation in elite-level football and a number of negative behavioral, emotional, and cognitive outcomes, suggestively attributable to chronic traumatic encephalopathy.35-38,47,52 The potential of adverse outcomes associated with football participation has been extended down from the elite level, with some evidence to suggest that initial participation at an earlier age, or age of first exposure (AFE), may eventually be associated with adverse long-term outcomes. Stamm et al51 reported that AFE before the age of 12 years was associated with poorer performance on cognitive measures of executive functioning, learning, and single-word reading in a small cohort of 42 former NFL players in the 5th to 7th decade of life. Similarly, Alosco et al1 revealed an association between AFE before the age of 12 years and self-reported executive functioning, apathy, and depressive symptoms. In a separate study, through retrospective informant telephone interviews, Alosco et al1 also reported that AFE before the age of 12 years was associated with earlier onset of neuropsychiatric behavioral and cognitive symptoms among 246 former tackle football players with a mean age of approximately 50 years. A number of reviews have highlighted several limitations of these studies, such as uncontrolled confounding variables and retrospective study designs possibly introducing recall bias, which could artificially inflate associations between reported concussion histories and self-reported behavioral, cognitive, and emotional symptoms.18,25,30,31
While several studies have examined the relationship between AFE and multiple long-term outcomes in former athletes, no research to date has examined the relationship between AFE and more intermediate outcomes at early adulthood. Preliminary evidence suggests the process instigating long-term adverse outcomes may occur earlier in development. For example, immediate effects of participation in youth football have been observed, with changes noted in white matter integrity,14 cortical/deep gray matter,20 and default mode network connectivity,54 which were associated with changes in memory scores in nonconcussed high school football players over the course of a single season. The purpose of the current study was to examine the relationship between AFE and intermediate (ie, in adolescence/young adulthood) behavioral, cognitive, emotional/psychological, and physical (oculomotor functioning and postural stability) outcomes.
Methods
Participants
Participants were football players from 9 high schools and 4 colleges in southeastern Wisconsin enrolled in the prospective Project Head to Head 1 (PH2H1) and/or Project Head to Head 2 (PH2H2) studies between August 2012 and September 2017 (see also LaRoche et al29 and Nelson et al39,40). PH2H1 and PH2H2 were both composed of samples from the same 9 high schools and 4 colleges in southeastern Wisconsin. Essentially, PH2H2 was an extension if PH2H1, with more clinical variables included as part of the battery administered. To maintain generalizability, exclusion criteria involved only 2 factors, invalid performance on computerized neurocognitive tests (CNT) and those in which AFE could not be obtained (ie, age or years of participation was not provided). Athletes who failed to produce a valid CNT profile at baseline (n = 53) or who did not list their age (n = 57) were excluded from the analysis, yielding a final sample of 1802 football players for analysis (Figure 1). Comparison between the maintained sample and those excluded did not significantly differ across AFE groups, χ2(1) = 1.57, P = 0.21.
Figure 1.
Flowchart of final sample for analysis.
Procedures
Baseline assessments took place before the start of regular football activity, lasted approximately 90 minutes, and were conducted at each athlete’s school. No participants reported a recent concussion (ie, within 3 months). Baseline testing group sizes ranged from 1 to 20 athletes, with multiple research assistants present for each to allow for 1-on-1 proctoring of the assessments. Each athlete was read a standardized script at the beginning of the baseline testing session and before each of the CNTs about the importance of valid baseline tests. Adult athletes and parents of minor athletes completed informed consent, and minor participants completed assent before their first evaluation. All study procedures were approved by the Medical College of Wisconsin’s institutional review board.
Measures
Data were collected through assessment procures noted above and an in-depth historical interview; which included demographics, sport participation, and medical and concussion history (Table 1). AFE was the primary independent variable of interest and was derived from participants’ response to questions about the number of years participating in the sport and current age (ie, years of participation subtracted from age). Following precedent from prior literature,1,2,46,50,51 AFE was dichotomized into 2 groups: AFE before the age of 12 years (AFE < 12) and at/ after the age of 12 years (AFE ≥ 12). However, sensitivity analyses described below were also performed to ensure that dichotomizing this variable did not mask otherwise significant effects. Given that a number of factors, such as attention-deficit/hyperactivity disorder (ADHD),3,8,9,19,59 race,22,56 age,7,11,42 and self-reported concussion history,12,42 have been associated with several clinical outcome variables noted above, a number of demographic, sport, and medical history variables were examined as potential covariates (Table 1).
Table 1.
Demographic information for total sample and AFE groups
n | Total Samplea (n = 1802) | AFE < 12a (n = 1249) | AFE ≥ 12a (n = 553) | P b | d/Phic,d | |
---|---|---|---|---|---|---|
Age, y | 1802 | 17.99 ± 1.83 | 17.81 ± 1.78 | 18.41 ± 1.88 | <0.001 | 0.328 |
Race | 1802 | <0.001 | 0.117 | |||
White | 1359 (75.4) | 983 (78.8) | 376 (68.0) | |||
Black/African American | 361 (20.0) | 218 (17.5) | 143 (25.9) | |||
Asian, Native Hawaiian/ Pacific Islander, American Indian, unknown | 82 (4.6) | 48 (3.8) | 57 (5.5) | |||
Height, inches | 1799 | 71.31 ± 2.78 | 71.23 ± 2.74 | 71.49 ± 2.85 | 0.063 | |
Weight, lbs | 1801 | 200.63 ± 42.74 | 198.92 ± 41.70 | 204.49 ± 44.77 | 0.013 | 0.040 |
ADHD+ | 1800 | 171 (9.5) | 106 (8.5) | 65 (11.8) | 0.030 | 0.044 |
Prescribed medication for ADHD e | 93 | 56 (60.2) | 40 (64.5) | 16 (51.6) | 0.231 | |
LD | 1799 | 32 (1.8) | 22 (1.8) | 10 (1.8) | 0.950 | |
IEP | 1786 | 107 (6.0) | 72 (5.8) | 35 (6.4) | 0.600 | |
Autism spectrum disorder | 1795 | 3 (0.2) | 2 (0.2) | 1 (0.2) | 0.919 | |
History of meningitis | 1069 | 4 (0.4) | 1 (0.1) | 3 (0.9) | 0.056 | |
Balance disorder | 1063 | 1 (0.1) | 1 (0.1) | 0 (0.0) | 0.503 | |
Seizure disorder | 1801 | 13 (0.7) | 11 (0.9) | 2 (0.4) | 0.229 | |
Vision problems (not glasses) | 1798 | 31 (1.7) | 21 (1.7) | 10 (1.8) | 0.844 | |
Hearing problems | 1798 | 53 (2.9) | 32 (2.6) | 21 (3.8) | 0.156 | |
Stroke | 1797 | 2 (0.1) | 1 (0.1) | 1 (0.2) | 0.552 | |
Diabetes | 1799 | 12 (0.7) | 10 (0.8) | 2 (0.4) | 0.289 | |
Psychiatric diagnosis (Y/N) | 1800 | 12 (0.7) | 10 (0.8) | 2 (0.4) | 0.290 | |
Mood Disorder/Depression/ Bipolar | 3 | 1 (10.0) | 2 (100.0) | |||
Anxiety | 8 | 8 (80.0) | 0 (0.0) | |||
Psychotic disorder/ Schizophrenia | 1 | 1 (10.0) | 0 (0.0) | |||
Migraine disorder | 1793 | 88 (4.9) | 54 (4.3) | 34 (6.2) | 0.097 | |
Headache (nonmigraine) disorder | 1802 | 89 (4.9) | 65 (5.2) | 24 (4.3) | 0.435 | |
Sleep disorder | 1789 | 20 (1.1) | 12 (1.0) | 8 (1.5) | 0.355 | |
Household SES (range: 8-66) | 1739 | 46.49 ± 10.36 | 46.92 ± 10.00 | 45.52 ± 11.10 | 0.013 | 0.132 |
Total No. of prior concussions | 1802 | 0.78 ± 1.27 | 0.83 ± 1.32 | 0.68 ± 1.15 | 0.065 | |
Duration since last concussion, mo | 752 | 33.87 ± 76.95 | 34.99 ± 88.44 | 30.83 ± 26.03 | 0.514 | |
Number of diagnosed SRCs | 1797 | |||||
0 | 1183 (65.8) | 797 (64.0) | 386 (70.1) | 0.041 | 0.060 | |
1 | 418 (23.3) | 304 (24.4) | 114 (20.7) | |||
2+ | 196 (10.9) | 145 (11.6) | 51 (9.3) | |||
Number of undiagnosed SRCs | 1785 | 0.092 | 0.052 | |||
0 | 1555 | 1555 (87.1) | 1067 (86.1) | 488 (89.4) | ||
1 | 153 | 153 (8.6) | 118 (9.5) | 35 (6.4) | ||
2+ | 77 | 77 (4.3) | 54 (4.4) | 23 (4.2) | ||
Number of diagnosed non-SRCs | 1775 | 0.06 ± 0.24 | 0.06 ± 0.23 | 0.05 ± 0.25 | 0.814 | |
Typical number of hours of sleep | 1794 | 7.35 ± 1.01 | 7.39 ± 1.03 | 7.26 ± 0.95 | 0.009 | 0.131 |
Average weekly alcoholic drinks | 238 | 5.51 ± 6.74 | 5.29 ± 6.85 | 6.06 ± 6.48 | 0.432 | |
Prescription medications (Y/N) | 1798 | 334 (18.6) | 239 (19.2) | 95 (17.2) | 0.429 | |
Antidepressants | 1802 | 6 (0.3) | 3 (0.2) | 3 (0.5) | 0.304 | |
Antianxiety | 1802 | 18 (1.0) | 12 (1.0) | 6 (1.1) | 0.807 | |
Antipsychotic | 1802 | 0 (0.0) | 0 (0.0) | 0 (0.0) | 1.000 | |
Narcotic/Pain | 1802 | 33 (1.8) | 20 (1.6) | 13 (2.4) | 0.274 | |
Nonnarcotic/Pain | 1802 | 5 (0.3) | 4 (0.3) | 1 (0.2) | 0.604 | |
Sleep aid/Sedative | 1802 | 90 (5.0) | 69 (5.5) | 21 (3.8) | 0.121 | |
Psychostimulant | 1802 | 32 (3.0) | 25 (3.4) | 7 (2.1) | 0.260 | |
Allergy | 1802 | 41 (3.8) | 27 (3.7) | 14 (4.2) | 0.650 | |
Asthma | 1802 | 44 (4.1) | 29 (3.9) | 15 (4.5) | 0.644 | |
Acid reflux | 1802 | 7 (0.7) | 6 (0.8) | 1 (0.3) | 0.339 | |
WTAR score | 1798 | 32.12 ± 7.29 | 32.18 ± 7.07 | 31.98 ± 7.76 | 0.590 | |
Position | 1699 | |||||
Offensive lineman | 287 (16.9) | 201 (16.9) | 86 (16.8) | |||
Quarterback/Wide receiver | 393 (23.1) | 269 (22.7) | 124 (24.2) | |||
Defensive lineman | 284 (16.7) | 176 (14.8) | 108 (21.1) | |||
Linebacker | 267 (15.7) | 199 (16.8) | 68 (13.3) | |||
Defensive back | 301 (17.7) | 220 (18.5) | 81 (15.8) | |||
Running back | 167 (9.8) | 121 (10.2) | 46 (9.0) |
ADHD, attention-deficit/hyperactivity disorder; AFE, estimated age of first exposure; IEP, individualized education plan; LD, learning disorder; SES, socioeconomic status; SRC, sports-related concussion; WTAR, Wechsler Test of Adult Reading; Y/N, yes/no.
Information presented as mean ± SD or as number (percentage).
P value for tests of AFE group differences across demographic and history variables. Chi-square tests were performed for categorical and independent-samples t tests were performed for continuous variables. Boldfaced P value indicates potential covariates significant at the <0.10 level.
Cohen d effect size interpretation: small = 0.2, medium = 0.5, large = 0.8.
Phi effect size interpretation: [df = 1] small = 0.07, medium = 0.21, large = 0.35.
Percentage of those who answered this question.
Outcomes of interest included a number of clinical symptom report, neuropsychological, and physical measures. Self-report symptom measures included the Sport Concussion Assessment Tool (SCAT)34 and subscales of the Brief Symptom Inventory–18 (BSI-18; somatization, depression, and anxiety),15 a measure of internalizing psychopathology and somatic symptoms. For a subset of the sample that comprised the second phase of the study (ie, PH2H2), the Brief Sensation Seeking Scale,23 and Disinhibition-11, an 11-item content-representative subset of the 20-item Externalizing Spectrum Inventory43 with high correlation with the original measure (r ≈ 0.90; C. Patrick, personal communication, September 21, 2017) were added to the battery as well (Table 2).
Table 2.
General linear models examining AFE groups across clinical outcome variables
Total Sample | AFE < 12 | AFE ≥ 12 | F | P a | b | |
---|---|---|---|---|---|---|
SCAT3 symptom score (n = 1779) c | 3.51 (5.77) | 3.42 (5.68) | 3.70 (5.98) | 0.88 | 0.349 | 0.0 |
SAC total score (n = 1771) c | 26.27 (2.16) | 26.03 (2.17) | 26.20 (2.15) | 0.78 | 0.377 | 0.0 |
BESS total score (n = 1772) c | 12.13 (4.82) | 12.11 (4.71) | 12.15 (5.07) | 0.02 | 0.885 | 0.0 |
ImPACT composite scores | ||||||
Verbal memory (n = 1532) c | 83.54 (10.70) | 83.66 (10.64) | 83.26 (10.82) | 0.45 | 0.5 | 0.0 |
Visual memory (n = 1532) c | 76.42 (13.01) | 77.01 (13.04) | 75.12 (12.87) | 6.98 | 0.008 | 0.005 |
Visual motor speed (n = 1532) c | 38.68 (6.52) | 38.83 (6.47) | 38.38 (6.64) | 1.54 | 0.211 | 0.001 |
Reaction time (n = 1532) c | 0.58 (0.08) | 0.58 (0.08) | 0.59 (0.09) | 0.51 | 0.51 | 0.0 |
BSI-18 somatization (raw; n = 1779) c | 0.91 (1.66) | 0.86 (1.52) | 1.04 (1.94) | 4.40 | 0.036 | 0.002 |
BSI-18 depression (raw; n = 1779) c | 1.15 (2.21) | 1.11 (2.14) | 1.24 (2.07) | 1.24 | 0.266 | 0.001 |
BSI-18 anxiety (raw; n = 1779) c | 1.19 (1.95) | 1.16 (2.0) | 1.26 (1.85) | 0.99 | 0.319 | 0.001 |
TMT A (sec; n = 1046) d | 22.37 (7.07) | 22.24 (6.91) | 22.66 (7.41) | 0.81 | 0.369 | 0.001 |
TMT B (sec; n = 1046) d | 57.00 (19.5) | 56.35 (19.37) | 58.46 (19.73) | 2.611 | 0.106 | 0.002 |
King Devick (n = 526) d | 46.84 (8.55) | 46.68 (8.58) | 47.19 (8.52) | 0.40 | 0.526 | 0.001 |
DIS-11 (n = 1078) d | 5.58 (5.16) | 5.60 (5.45) | 5.53 (4.44) | 0.05 | 0.82 | 0.0 |
BSSS (n = 1078) d | 26.87 (6.21) | 26.93 (6.08) | 26.73 (6.49) | 0.23 | 0.63 | 0.0 |
WAIS-IV symbol search (raw; n =1038) d | 36.39 (6.38) | 36.29 (6.25) | 36.61 (6.68) | 0.53 | 0.47 | 0.001 |
WAIS-IV coding (raw; n =1038) d | 69.32 (11.60) | 68.95 (11.29) | 70.13 (12.23) | 2.31 | 0.129 | 0.002 |
ACT scores (n = 1326) c | 22.64 (3.52) | 22.74 (3.45) | 22.64 (3.522) | 2.23 | 0.135 | 0.002 |
ACT, American College Testing; BESS, Balance Error Scoring System; BSI-18, Brief Symptom Inventory; BSSS, Brief Sensation Seeking Scale; DIS-11, Disinhibition-11; ImPACT, Immediate and Post-Concussion Assessment and Cognitive Testing; SAC, Standardized Assessment of Concussion; SCAT3, Sport Concussion Assessment Tool third edition; TMT A/B, Trail Making Test; WAIS, Wechsler Adult Intelligence Scale–Fourth Edition.
Boldfaced P value indicates a significant relationship between AFE and clinical outcome at the <0.05 level.
Partial eta-square () effect size interpretation: small = 0.01, medium = 0.06, large = 0.14.
Measures included as part of Projects Head to Head I and II.
Measures added as part of Project Head to Head II.
Cognitive and neuropsychological measures included the Standardized Assessment of Concussion (SAC),33 the Immediate Post-Concussion and Cognitive Testing (ImPACT)24 online neurocognitive test battery, Trail Making Test A and B (TMT A and B),44 Wechsler Test of Adult Reading, and Wechsler Adult Intelligence Scale-IV (WAIS-IV) Processing Speed Index subtests (Coding and Symbol Search).57 Similar to above, the TMT and WAIS-IV subtests were added to phase II of the study, with these latter measures included to provide more measurement of cognitive domains known to be affected by concussion (ie, executive functioning and processing speed).10 Physical functioning included a measure of postural stability (the Balance Error Scoring System)21 and oculomotor functioning (ie, King Devick Test; Table 2).41 Additionally, self-reported standardized American College Testing (ACT) scores were included as a measure of academic achievement. A select number of participants had not yet completed the ACT (eg, sophomore in high school) or did not report their score (n = 476).
Analyses
Our primary interest was to determine if AFE was predictive of any clinical outcomes assessed in this high school and collegiate athlete sample. However, we anticipated that AFE may be related to demographic or other variables and that such confounding variables might obscure relationships between AFE and outcomes of interest. Potential covariates included several demographic and medical history variables collected. To select variables for inclusion as covariates in our primary analyses, the 2 AFE groups were compared on demographic and history variables, with t tests used for continuous and chi-squared analyses for categorical data. Variables that significantly differed across groups were then entered into a multivariable binary logistic regression with AFE <12 and ≥12 as the dependent variable to reduce redundancy of covariate predictors and removal of variables that were no longer significant, controlling for extraneous variance in the subsequent regressions.
Next, we undertook our primary analyses of interest. First, single-predictor general linear models (GLMs) were computed to estimate the effect of AFE (<12 and ≥12) on several clinical outcome variables in high school and collegiate football players. Outcome variables included the various measures of behavioral, cognitive, emotional/ psychological, and physical functioning highlighted above. Second, the same models were run again, this time including as independent variables both AFE and covariates identified earlier as demonstrating significant differences across the 2 AFE groups. Although dependent variables were generally not normally distributed, the estimated parameters and corresponding 95% CI estimates are generally robust to violations of this assumption within larger sample sizes.16,48 Additionally, sensitivity analyses were performed to assess the effect of different distribution models (eg, negative binomial regression) on the associations between predictors and outcomes. These analyses suggested that the nature of associations was not meaningfully changed with different model distributions, and as such, GLMs were maintained for all analyses in order to be able to compare effect sizes across outcomes.
Results
Demographic, medical/treatment history, and sport information (eg, SRC history and football position) on the sample is provided in Table 1. The mean sample age was 17.99 years (SD = 1.83) and the average AFE was 10.11 years (SD = 2.96), with roughly 70% of the sample reporting AFE before age 12 years. The AFE (<12 and ≥12) groups significantly differed across a number of these variables, including age, race, weight, a diagnosis of ADHD, household socioeconomic status (SES), number of diagnosed sports-related concussions (SRCs), number of undiagnosed SRCs, and typical hours of sleep per night. A sensitivity analyses was performed in order to examine the relationship between these variables and AFE as a continuous variable. Results showed that many of the variables maintained their significant associations with AFE, with the exception of weight and household SES. Regardless, all significant variables were included in a multivariable binary logistic regression with AFE group as the dependent variable. Results indicated that 4 variables independently predicted whether participants had begun football participation <12 or ≥12 years of age, χ2(8) = 86.81, P < 0.001: age, history of SRC, diagnosis of ADHD, and race (Table 3).
Table 3.
Binary logistic regression of potential covariates and AFE group a
B | SE | Wald | P b | Exp (B) | 95% CI Lower Limit | 95% CI Upper Limit | |
---|---|---|---|---|---|---|---|
Age | 0.211 | 0.033 | 40.46 | <0.001 | 1.235 | 1.157 | 1.317 |
Weight | 0.001 | 0.001 | 0.17 | 0.678 | 1.001 | 0.998 | 1.003 |
Household SES | −0.006 | 0.005 | 1.31 | 0.253 | 0.994 | 0.984 | 1.004 |
Number of diagnosed SRC | −0.180 | 0.072 | 6.25 | 0.012 | 0.835 | 0.725 | 0.962 |
Number of undiagnosed SRC | −0.159 | 0.090 | 3.13 | 0.077 | 0.853 | 0.715 | 1.017 |
Typical hours of sleep | −0.035 | 0.058 | 0.37 | 0.543 | 0.966 | 0.862 | 1.081 |
ADHD+ | 0.488 | 0.180 | 7.35 | 0.007 | 1.629 | 1.145 | 2.319 |
Race | 0.399 | 0.098 | 16.56 | <0.001 | 1.490 | 1.230 | 1.806 |
ADHD, attention-deficit/hyperactivity disorder; AFE, age of first exposure; SES, socioeconomic status; SRC, sports-related concussion.
Model: χ2(8) = 86.81, P < 0.001, Nagelkerke R 2 = 0.07.
Boldfaced P value indicates covariates that remained significant in the multivariable regression at the <0.05 level.
Single-predictor GLM models predicting clinical outcomes from the AFE group revealed significant effects for 2 outcome measures. Specifically, those who began playing football before the age of 12 years exhibited significantly higher visual memory scores, F = 6.98, P < 0.01, = 0.01 (Table 2). Additionally, AFE <12 was associated with significantly lower somatization symptom endorsement, F = 4.4, P = 0.04, = 0.002. GLMs containing the 4 identified covariates along with AFE were performed for each clinical outcome. Once covariates were included in the GLMs, AFE <12 remained significantly associated with lower levels of somatization F = 11.39, P = 0.01, = 0.01, while the effect of AFE on visual memory was no longer significant (P = 0.11), nor was any other outcome predicted newly by AFE (Table 4).
Table 4.
General linear models including AFE groups and covariates across clinical variables
AFE |
Age |
Race |
ADHD+ |
Prior SRC |
||||||
---|---|---|---|---|---|---|---|---|---|---|
P a | b | P | P | P | P | |||||
BSI-18 | ||||||||||
Somatization | 0.001 | 0.006 | 0.084 | 0.003 | <0.001 | 0.031 | 0.153 | 0.001 | 0.002 | 0.007 |
Depression | 0.225 | 0.001 | 0.259 | 0.002 | 0.186 | 0.001 | 0.758 | 0.000 | 0.013 | 0.005 |
Anxiety | 0.166 | 0.001 | 0.016 | 0.003 | 0.906 | 0.000 | <0.001 | 0.008 | 0.013 | 0.005 |
ImPACT composite score | ||||||||||
Verbal memory | 0.733 | 0.000 | 0.001 | 0.010 | 0.098 | 0.002 | 0.019 | 0.004 | 0.299 | 0.002 |
Visual memory | 0.109 | 0.002 | <0.001 | 0.016 | 0.218 | 0.001 | <0.001 | 0.008 | 0.206 | 0.002 |
Visual motor speed | 0.176 | 0.001 | <0.001 | 0.039 | <0.001 | 0.025 | 0.174 | 0.001 | 0.110 | 0.003 |
Reaction Time | 0.681 | 0.000 | <0.001 | 0.036 | <0.001 | 0.012 | 0.132 | 0.001 | 0.543 | 0.010 |
Trail Making Test | ||||||||||
A | 0.146 | 0.002 | <0.001 | 0.019 | <0.001 | 0.016 | 0.566 | 0.000 | 0.074 | 0.005 |
B | 0.107 | 0.003 | 0.003 | 0.009 | <0.001 | 0.054 | 0.047 | 0.004 | 0.832 | 0.000 |
WAIS-IV | ||||||||||
Symbol search | 0.788 | 0.000 | <0.001 | 0.019 | <0.001 | 0.015 | 0.022 | 0.005 | 0.653 | 0.001 |
Coding | 0.494 | 0.000 | <0.001 | 0.043 | 0.006 | 0.010 | <0.001 | 0.012 | 0.375 | 0.002 |
SCAT3 symptom severity score | 0.113 | 0.001 | 0.117 | 0.002 | <0.001 | 0.013 | <0.001 | 0.010 | 0.001 | 0.007 |
SAC total score | 0.955 | 0.000 | <0.001 | 0.029 | 0.163 | 0.001 | <0.001 | 0.015 | 0.014 | 0.005 |
BESS total score | 0.692 | 0.000 | 0.093 | 0.003 | 0.002 | 0.006 | 0.074 | 0.002 | 0.901 | 0.000 |
King Devick | 0.272 | 0.002 | 0.351 | 0.002 | 0.414 | 0.003 | 0.225 | 0.003 | 0.177 | 0.007 |
ACT score | 0.909 | 0.000 | 0.182 | 0.001 | <0.001 | 0.098 | <0.001 | 0.014 | 0.028 | 0.005 |
DIS-11 | 0.814 | 0.000 | 0.001 | 0.011 | 0.201 | 0.003 | 0.001 | 0.010 | 0.006 | 0.010 |
BSSS | 0.607 | 0.000 | 0.247 | 0.0001 | <0.001 | 0.021 | 0.290 | 0.001 | 0.934 | 0.000 |
ACT, American College Testing; ADHD, attention-deficit/hyperactivity disorder; AFE, age of first exposure; BESS, Balance Error Scoring System; BSI-18, Brief Symptom Inventory; BSSS, Brief Sensation Seeking Scale; DIS-11, Disinhibition-11; ImPACT, Immediate and Post-Concussion Assessment and Cognitive Testing; SAC, Standardized Assessment of Concussion; SCAT3, Sport Concussion Assessment Tool third edition; SRC, sports-related concussion; WAIS, Wechsler Adult Intelligence Scale.
Boldfaced P value indicates a significant relationship between AFE or covariate and clinical outcome at the <0.05 level.
Partial eta-square () effect size interpretation: small = 0.01, medium = 0.06, large = 0.14.
Discussion
In a large sample of over 1800 active high school and collegiate football players, the current study failed to find any meaningful associations between AFE to football before the age of 12 years and several measures of behavioral, cognitive, emotional/ psychological, and physical functioning. Ultimately, when using psychometrically validated measures, there were no adverse outcomes during adolescence/young adulthood associated with football participation before the age of 12 years. A single significant relationship was identified, in which football participation before the age of 12 years was associated with lower severity of somatic symptoms.
The current findings that AFE is not associated with worse behavioral, cognitive, psychological, or physical functioning extends upon previous studies, which failed to find any associations between similar measures of functioning during adolescence/early adulthood and contact sport participation. Specifically, Katz et al26 observed better ImPACT verbal and visual memory scores, SCAT symptom endorsement (ie, lower symptom endorsement), and BSI-18 scores (ie, lower scores) among 15,681 contact sport athletes on baseline testing; but worse ImPACT reaction time and SAC total scores. Furthermore, Houck et al22 demonstrated that amount of participation, or years exposed to sport, was not associated with any metrics of cognitive functioning on ImPACT in 87 collegiate football players. Given that statistical tests will very likely demonstrate significant differences with a large enough sample size,53 the lack of association between AFE and clinical outcomes in the current sample is particularly revealing. The current sample contained more than adequate power to detect even rather small effects, suggesting that there is close to or essentially no effect whatsoever.53
Unlike the present study, which investigated active high school and collegiate athletes, prior studies reporting significant relationships between earlier exposure (AFE <12) to football and eventual poorer cognitive and emotional outcomes have focused on older adults.1,2,46,50 At this point, the gap between a lack of adverse outcomes earlier in development and adverse sequelae reported among those later in life is unclear. Efforts have been employed to better understand the potential underlying process in vivo during the earlier stages of development. For example, using diffusion tensor imaging, multiple studies have observed a significant association between a quantified, objective measure of head impact exposure and changes in fractional anisotropy across multiple white matter tracts, with medium to large effect sizes,5,13,28 suggesting a possible dose-dependent response relationship. These studies may provide important insights into the relationship between exposure and adverse outcomes later in life, as the football players included within the above-cited studies did not sustain a concussion over the course of the measured season.
Furthermore, the microstructural changes associated with cumulative impact exposure over the course of a single high school football season observed by Davenport et al13 is particularly important, as the football players had multiple years of prior football experience and exhibited changes in white matter tracks, even in the absence of clinical changes over the course of the season (ie, no significant decline or change in cognitive functioning on ImPACT). This may be especially relevant to the current study, where, although associations between AFE and several outcomes were not observed, AFE could still possibly be correlated with underlying microstructural changes earlier in development. However, Davenport et al13 advise that the pathological implications of these metrics are not well understood and that interpretations should be made with caution.
The current study also emphasized the importance of controlling for preexisting demographic and medical variables when attempting to examine the effect of AFE to football. AFE was more strongly and consistently associated with demographics and medical history than clinical outcome measures. This suggests that there is a need to account for confounding variables such as demographics when looking at clinical outcomes between AFE groups. This is especially true, as the covariates identified in the current investigation were significantly associated with several clinical outcomes. This is consistent with several prior studies, which observed similar effects of preexisting or medical histories and performance/scores on measures of behavioral, cognitive, psychological, physical, and general symptoms measures. Specifically, ADHD,3,8,9,19,59 race,22,56 age,7,11,42 and self-reported concussion history12,42 have been associated with several clinical outcome variables noted above. The importance of controlling for preexisting conditions becomes even more crucial when attempting to investigate the long-term effects of AFE, as medical histories become ever more complex in older age.
In addition to clinical outcomes, previous studies have examined the relationship between AFE and football before the age of 12 years and neuroimaging metrics.46,51 For example, using diffusion tensor imaging, Stamm et al51 observed a significant relationship between AFE <12 and football and altered white matter microstructure in the corpus callosum within 40 former professional football players. Additionally, younger AFE (continuous variable) was mildly associated with subcortical structural changes; specifically, right thalamic volumes.46 Future research examining the effect of AFE on brain structure and function using advanced neuroimaging metrics in the current cohort of high school and collegiate athletes is currently in process. Future work should look to identify the mechanistic relationship between AFE and brain function. In interpreting longitudinal neuroimaging studies, it is important to consider the influence of not only exposure but also normal development, exercise, and so on to allow one to understand to what degree changes represent problematic/abnormal phenomena that may have negative clinical implications. Additionally, future work should look to further investigate any mechanistic relationship between earlier AFE and lower levels of somatic symptom endorsement. One possibility is the previously identified protective effect of sport participation on psychological dysfunction/symptomology4 and physical well-being (ie, lower rates of obesity) in young adulthood.55
This study has important limitations worth noting. A limitation exists within the self-report nature of some data. First, as with most other studies within this subject area, AFE was reliant on athletes’ self-report of years of participation and exposure history. Additionally, it is worth noting that reliability of self-reported concussion history can be variable. In a study of athletes ranging from age 13 to age 18 years, approximately 20% exhibited inconsistency in reported concussion history over a 2-year period.58 Additionally, other sport participation throughout development was not accounted for in the current investigation. While it is possible for a compounding effect of football, plus additional contact sport participation, to influence clinical outcome measures of the study, the null effect of greater exposure to football (ipso facto, football at an earlier age) observed in the current study decreased this possibility. Furthermore, a high correlation of AFE and overall exposure in the current sample (r = 0.80) does make it difficult to differentiate the influence of each factor. However, given the null results, the need to deconstruct observed effects is not critical (ie, if an AFE effect was observed, it would be difficult to attribute results directly to AFE or total exposure). Finally, the results from the current study do not necessarily negate previous findings suggesting that adverse long-term outcomes may be associated with earlier AFE in a select subset of former athletes. Rather, the current study suggests that changes are not evident in adolescence and early adulthood.
As highlighted above, in a prior study 52% of pediatricians reported that they would not allow their child to play full contact sports.17 With the well-documented benefits of youth sport participation,4,55 it is essential that clinical education provided, public policy, and organizational guidelines comprehensively account for factors that may influence adverse outcomes often associated with contact sport and football participation. Currently active athletes who participated in football before the age of 12 years do not exhibit worse behavioral, cognitive, psychological, or physical (oculomotor and postural stability) functioning during high school and collegiate age years. Furthermore, athletes who participated in football before the age of 12 years are less likely to endorse symptoms of somatization. These findings suggest that previously recorded long-term adverse outcomes associated with earlier AFE later in life are not apparent earlier in development. Further research is needed to better understand the potential underlying mechanisms and processes that account for the differential effects of AFE through development.
Footnotes
The following authors declared potential conflicts of interest: This work was supported by the Defense Health Program under the Department of Defense Broad Agency Announcement for Extramural Medical Research through Award No. W81XWH-14-1-0561. The REDCap electronic database used for this project was supported by the National Center for Advancing Translational Sciences, National Institutes of Health (NIH), Award Number UL1TR001436. Opinions, interpretations, conclusions, and recommendations are those of the author and are not necessarily endorsed by the Department of Defense or the NIH.
References
- 1. Alosco ML, Kasimis AB, Stamm JM, et al. Age of first exposure to American football and long-term neuropsychiatric and cognitive outcomes. Transl Psychiatry. 2017;7:e1236. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Alosco ML, Mez J, Tripodis Y, et al. Age of first exposure to tackle football and chronic traumatic encephalopathy. Ann Neurol. 2018;83:886-901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Asken BM, Snyder AR, Clugston JR, Gaynor LS, Sullan MJ, Bauer RM. Concussion-like symptom reporting in non-concussed collegiate athletes. Arch Clin Neuropsychol. 2017;32:963-971. [DOI] [PubMed] [Google Scholar]
- 4. Babiss LA, Gangwisch JE. Sports participation as a protective factor against depression and suicidal ideation in adolescents as mediated by self-esteem and social support. J Dev Behav Pediatr. 2009;30:376-384. [DOI] [PubMed] [Google Scholar]
- 5. Bahrami N, Sharma D, Rosenthal S, et al. Subconcussive head impact exposure and white matter tract changes over a single season of youth football. Radiology. 2016;281:919-926. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Barr WB. An evidence based approach to sports concussion: confronting the availability cascade. Neuropsychol Rev. 2013;23:271-272. [DOI] [PubMed] [Google Scholar]
- 7. Brett BL, Solomon GS. Comparison of neurocognitive performance in contact and noncontact nonconcussed high school athletes across a two-year interval. Dev Neuropsychol. 2017;42:70-82. [DOI] [PubMed] [Google Scholar]
- 8. Cook NE, Huang DS, Silverberg ND, et al. Baseline cognitive test performance and concussion-like symptoms among adolescent athletes with ADHD: examining differences based on medication use. Clin Neuropsychol. 2017;31:1341-1352. [DOI] [PubMed] [Google Scholar]
- 9. Cottle JE, Hall EE, Patel K, Barnes KP, Ketcham CJ. Concussion baseline testing: preexisting factors, symptoms, and neurocognitive performance. J Athl Train. 2017;52:77-81. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Covassin T, Elbin RJ. The cognitive effects and decrements following concussion. Open Access J Sports Med. 2010;1:55-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Covassin T, Elbin RJ, Harris W, Parker T, Kontos A. The role of age and sex in symptoms, neurocognitive performance, and postural stability in athletes after concussion. Am J Sports Med. 2012;40:1303-1312. [DOI] [PubMed] [Google Scholar]
- 12. Covassin T, Moran R, Wilhelm K. Concussion symptoms and neurocognitive performance of high school and college athletes who incur multiple concussions. Am J Sports Med. 2013;41:2885-2889. [DOI] [PubMed] [Google Scholar]
- 13. Davenport EM, Apkarian K, Whitlow CT, et al. Abnormalities in diffusional kurtosis metrics related to head impact exposure in a season of high school varsity football. J Neurotrauma. 2016;33:2133-2146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Davenport EM, Whitlow CT, Urban JE, et al. Abnormal white matter integrity related to head impact exposure in a season of high school varsity football. J Neurotrauma. 2014;31:1617-1624. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Derogatis LR. Brief Symptom Inventory 18 (BSI-18): Administration, Scoring, and Procedures Manual. Bloomington, MN: Pearson; 2001. [Google Scholar]
- 16. Field A. Discovering Statistics Using SPSS. 3rd ed. Thousand Oaks, CA: Sage; 2009. [Google Scholar]
- 17. Fishman M, Taranto E, Perlman M, Quinlan K, Benjamin HJ, Ross LF. Attitudes and counseling practices of pediatricians regarding youth sports participation and concussion risks. J Pediatr. 2017;184:19-25. [DOI] [PubMed] [Google Scholar]
- 18. Gardner A, Iverson GL, McCrory P. Chronic traumatic encephalopathy in sport: a systematic review. Br J Sports Med. 2014;48:84-90. [DOI] [PubMed] [Google Scholar]
- 19. Gardner RM, Yengo-Kahn A, Bonfield CM, Solomon GS. Comparison of baseline and post-concussion ImPACT test scores in young athletes with stimulant-treated and untreated ADHD. Phys Sportsmed. 2017;45:1-10. [DOI] [PubMed] [Google Scholar]
- 20. Gong NJ, Kuzminski S, Clark M, et al. Microstructural alterations of cortical and deep gray matter over a season of high school football revealed by diffusion kurtosis imaging. Neurobiol Dis. 2018;119:79-87. [DOI] [PubMed] [Google Scholar]
- 21. Guskiewicz KM, Ross SE, Marshall SW. Postural stability and neuropsychological deficits after concussion in collegiate athletes. J Athl Train. 2001;36:263-273. [PMC free article] [PubMed] [Google Scholar]
- 22. Houck Z, Asken B, Clugston J, Perlstein W, Bauer R. Socioeconomic status and race outperform concussion history and sport participation in predicting collegiate athlete baseline neurocognitive scores. J Int Neuropsychol Soc. 2018;24:1-10. [DOI] [PubMed] [Google Scholar]
- 23. Hoyle RH, Stephenson MT, Palmgreen P, Lorch EP, Donohew RL. Reliability and validity of a brief measure of sensation seeking. Pers Individ Diff. 2002;32:401-414. [Google Scholar]
- 24. ImPACT Applications. Immediate post-concussion assessment testing (ImPACT) test: administration and interpretation manual. https://pulse-static-files.s3.amazonaws.com/ecb/document/2017/02/07/a05aa3da-93d7-4fff-b9cb-2fb3a89c960f/IMPACT-interpretation-manual.pdf. Accessed December 12, 2018.
- 25. Janigro D. Tau in chronic traumatic encephalopathy. JAMA Neurol. 2018;75:381. [DOI] [PubMed] [Google Scholar]
- 26. Katz BP, Kudela M, Harezlak J, et al. Baseline performance of NCAA athletes on a concussion assessment battery: a report from the CARE Consortium. Sports Med. 2018;48:1971-1985. [DOI] [PubMed] [Google Scholar]
- 27. Kuhn AW, Yengo-Kahn AM, Kerr ZY, Zuckerman SL. Sports concussion research, chronic traumatic encephalopathy and the media: repairing the disconnect. Br J Sports Med. 2017;51:1732-1733. [DOI] [PubMed] [Google Scholar]
- 28. Kuzminski SJ, Clark MD, Fraser MA, et al. White matter changes related to subconcussive impact frequency during a single season of high school football. AJNR Am J Neuroradiol. 2018;39:245-251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. LaRoche AA, Nelson LD, Connelly PK, Walter KD, McCrea MA. Sport-related concussion reporting and state legislative effects. Clin J Sport Med. 2016;26:33-39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Manley G, Gardner AJ, Schneider KJ, et al. A systematic review of potential long-term effects of sport-related concussion. Br J Sports Med. 2017;51:969-977. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Maroon JC, Winkelman R, Bost J, Amos A, Mathyssek C, Miele V. Chronic traumatic encephalopathy in contact sports: a systematic review of all reported pathological cases. PLoS One. 2015;10:e0117338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. McCarty K. Youth athletics: Safe Youth Football Act. Article 2.7. Vol 124241 March 20, 2018, ed; 2018. [Google Scholar]
- 33. McCrea M, Kelly JP, Randolph C, et al. Standardized assessment of concussion (SAC): on-site mental status evaluation of the athlete. J Head Trauma Rehabil. 1998;13:27-35. [DOI] [PubMed] [Google Scholar]
- 34. McCrory P, Meeuwisse WH, Aubry M, et al. Consensus statement on concussion in sport: the 4th International Conference on Concussion in Sport held in Zurich, November 2012. Br J Sports Med. 2013;47:250-258. [DOI] [PubMed] [Google Scholar]
- 35. McKee AC, Daneshvar DH, Alvarez VE, Stein TD. The neuropathology of sport. Acta Neuropathol. 2014;127:29-51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. McKee AC, Stern RA, Nowinski CJ, et al. The spectrum of disease in chronic traumatic encephalopathy. Brain. 2013;136(pt 1):43-64. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Mez J, Daneshvar DH, Kiernan PT, et al. Clinicopathological evaluation of chronic traumatic encephalopathy in players of American football. JAMA. 2017;318:360-370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Montenigro PH, Baugh CM, Daneshvar DH, et al. Clinical subtypes of chronic traumatic encephalopathy: literature review and proposed research diagnostic criteria for traumatic encephalopathy syndrome. Alzheimers Res Ther. 2014;6:68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Nelson LD, LaRoche AA, Pfaller AY, et al. Prospective, head-to-head study of three computerized neurocognitive assessment tools (CNTs): reliability and validity for the assessment of sport-related concussion. J Int Neuropsychol Soc. 2016;22:24-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Nelson LD, Tarima S, LaRoche AA, et al. Preinjury somatization symptoms contribute to clinical recovery after sport-related concussion. Neurology. 2016;86:1856-1863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Oride MK, Marutani JK, Rouse MW, DeLand PN. Reliability study of the Pierce and King-Devick saccade tests. Am J Optom Physiol Opt. 1986;63:419-424. [DOI] [PubMed] [Google Scholar]
- 42. Paniccia M, Wilson KE, Hunt A, et al. Postural stability in healthy child and youth athletes: the effect of age, sex, and concussion-related factors on performance. Sports Health. 2018;10:175-182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Patrick CJ, Kramer MD, Krueger RF, Markon KE. Optimizing efficiency of psychopathology assessment through quantitative modeling: development of a brief form of the Externalizing Spectrum Inventory. Psychol Assess. 2013;25:1332-1348. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Reitan RM, Wolfson D. The Halstead-Reitan Neuropsychological Test Battery: Therapy and Clinical Interpretation. Tucson, AZ: Neuropsychological Press; 1985. [Google Scholar]
- 45. Russo RD. New version of football targets falling youth participation. USA Today. https://www.usatoday.com/story/sports/ncaaf/2017/10/15/new-version-of-football-targets-falling-youth-participation/106686076/. Accessed September, 2018.
- 46. Schultz V, Stern RA, Tripodis Y, et al. Age at first exposure to repetitive head impacts is associated with smaller thalamic volumes in former professional American football players. J Neurotrauma. 2018;35:278-285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Seichepine DR, Stamm JM, Daneshvar DH, et al. Profile of self-reported problems with executive functioning in college and professional football players. J Neurotrauma. 2013;30:1299-1304. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Shao J. Mathematical Statistics. 2nd ed. New York, NY: Springer; 2003. [Google Scholar]
- 49. Solomon GS, Sills A. Chronic traumatic encephalopathy and the availability cascade. Phys Sportsmed. 2014;42:26-31. [DOI] [PubMed] [Google Scholar]
- 50. Stamm JM, Bourlas AP, Baugh CM, et al. Age of first exposure to football and later-life cognitive impairment in former NFL players. Neurology. 2015;84:1114-1120. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Stamm JM, Koerte IK, Muehlmann M, et al. Age at first exposure to football is associated with altered corpus callosum white matter microstructure in former professional football players. J Neurotrauma. 2015;32:1768-1776. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Stern RA, Daneshvar DH, Baugh CM, et al. Clinical presentation of chronic traumatic encephalopathy. Neurology. 2013;81:1122-1129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Sullivan GM, Feinn R. Using effect size—or why the P value is not enough. J Grad Med Educ. 2012;4:279-282. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54. Talavage TM, Nauman EA, Breedlove EL, et al. Functionally-detected cognitive impairment in high school football players without clinically-diagnosed concussion. J Neurotrauma. 2014;31:327-338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55. Turner RW, Cockrell Skinner A, Perrin EM, Polimis K, Coyne-Beasley T. High school sports participation: risk and protective factors for early adulthood physical activity and obesity in a representative longitudinal study. J Adolesc Health. 2014;54(suppl 2):S79-S80. [Google Scholar]
- 56. Wallace J, Covassin T, Beidler E. Sex differences in high school athletes’ knowledge of sport-related concussion symptoms and reporting behaviors. J Athl Train. 2017;52:682-688. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57. Wechsler D. Wechsler Adult Intelligence Scale. 4th ed. San Antonio, TX: Psychological Corporation; 2008. [Google Scholar]
- 58. Wojtowicz M, Iverson GL, Silverberg ND, et al. Consistency of self-reported concussion history in adolescent athletes. J Neurotrauma. 2017;34:322-327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59. Zuckerman SL, Lee YM, Odom MJ, Solomon GS, Sills AK. Baseline neurocognitive scores in athletes with attention deficit-spectrum disorders and/or learning disability. J Neurosurg Pediatr. 2013;12:103-109. [DOI] [PubMed] [Google Scholar]