Abstract
Aim:
Athletic pre-season testing can establish functional baseline for comparison following concussion. Whether impacts of future concussions may be foretold by such testing is little known.
Materials & methods:
Two sets of models for a significant burden of concussion were generated: a traditional approach using a series of logistic regressions, and a penalized regression approach using elastic net.
Results:
3091 youth and adult athletes were baseline-assessed. 90 subsequently experienced concussion and 35 were still experiencing a significant burden of concussion when tested within two weeks. Both models associated prior history of head injury and visual attention-related metrics with a significant burden of concussion.
Conclusion:
Pre-season testing of visual attention may identify athletes who are at risk for significant sports-related concussion.
Keywords: mild traumatic brain injury, oculomotor, predictive modelling, preseason assessment, sports concussion
Plain language summary
Athletic pre-season testing can establish functional baseline for comparison following concussion and may predict impacts of future concussions. In this study, 3,091 youth and adult athletes were baseline-assessed. 90 subsequently experienced concussion and 35 were still experiencing a significant burden of concussion when tested within two weeks. A statistical model and a machine-learning model both associated prior history of head injury and visual attention-related metrics with a significant burden of concussion. Pre-season testing of visual attention may identify athletes who are at risk for significant sports-related concussion.
Tweetable abstract
Pre-season testing of visual attention may identify athletes who are at risk for significant sports-related concussion
Concussion is a common occurrence in high school and collegiate sports, with overall rates reported between 0.23 and 0.43 per 1000 athletic exposure respectively [1]. Various premorbid predictors of sports-related concussion and prolonged recovery have been studied [2–6], but the findings related to factors that may increase the risk and burden of concussion are sparse and inconsistent [7–10]. Recent attempts to model risk have shown modest utility and relatively poor effect sizes [11]. Most individuals recover from concussion within weeks [12–14], but even a brief period of symptoms may interfere with return to play, work, school, and everyday routines and obligations. Identifying athletes at risk for significant post-concussion symptoms allows for prognostic counseling and may guide return to play via targeted training approaches.
Here, we retrospectively analyzed data from a larger concussion-related project with a particular focus on a normative characterization of attention-dependent oculomotor performance in a variety of military and civilian groups using a broad assessment battery [15,16]. The project was motivated by the premise that attention dysfunction is a common sequela of a concussion [17–19]. Some of the results from this project, not overlapping with the current study, have been published elsewhere [20–23]. In the current study we address the possibility that a deficit in attentional reserve makes one more prone to a significant, high symptom report, concussion.
Attention is multi-faceted and supported by interdependent neural subprocesses [24,25]. It is also known that there is a large overlap between the neural networks for attentional and oculomotor controls [26–28]. Bringing and maintaining an object of interest on the fovea with saccade and smooth pursuit eye movements are not an automatic response to retinal inputs but are guided by complex processes including attention, memory and expectation [27–29]. This account is closely associated with the profound dependence of human vision on capturing selective images on the fovea and the required precision in eye movement control to achieve this goal. In sports, critical to performance is sustained attention via anticipatory neural coordination, i.e., the ability to dynamically synchronize visual input and motor output [30,31]. Pursuit eye movement demands dynamic synchronization of external visual events and eye movement commands by forming internal spatiotemporal prediction of the target trajectory [30,32]. Since eye movements can be easily, accurately, and objectively recorded, eye movement performance metrics of predictive pursuit may provide an objective assessment of anticipatory attention function [30].
The extensive battery of baseline assessments allowed us to consider a broad variety of domains as potentially influencing the burden of a concussion. In addition to oculomotor performance, we assessed neurocognitive functioning, psychological and mood symptoms. We measured the presence of symptoms common to concussion in all cases, whether or not there was a prior reported head injury, to determine their global predictive power. Importantly, we avoided the reliance on restrictive inclusion criteria that is common in similar investigations, instead retaining subjects with history of head injury, with attention-deficit/hyperactivity disorder (ADHD), and with several other conditions that might otherwise preclude entry into research, strengthening the generalizability of our findings. Although ADHD specifically is recognized as a risk factor for concussion and a possible predictor of poorer outcomes [33–37], in this study, we regard the condition as part of more generalizable attention issues rather than an isolated confounder.
The large pool of potential explanatory variables available in a baseline battery such as ours can pose analytic challenges to identify those with predictive utility. Standard linear and logistic regression techniques may suffer from problems of overfitting and multicollinearity, even when using stepwise selection [38]. Penalized regression approaches such as least absolute shrinkage and selection operator (LASSO) and elastic net address these problems by setting a limiting factor that constrains the sum of the regression coefficients, reducing the number of retained variables by setting regression coefficients to zero for unnecessary variables. The method is impervious to multicollinearity; further, elastic net improves on LASSO by allowing more precise determination of the limiting factor [39].
While penalized regression techniques are not new, they are somewhat underutilized in the literature on clinical and applied medicine. An additional objective of this study is to demonstrate the differences in model output between the standard and penalized regression approaches. We will present the approaches in parallel and then compare the fitted models directly. We expected that the penalized regression approach would show both procedural (i.e., more straightforward variable selection, reduced data manipulation) and explanatory (i.e., superior fit and predictive indices) advantages compared with the standard approach.
The aims of the current study were (a) to identify which factors assessed at baseline, if any, were associated with increased acute symptom burden of concussion during the subsequent season, and (b) to explore the model outputs of a machine-learning approach compared with more traditional analytic methods. These aims were examined by building as broad a model as possible based on an extensive pre-season dataset from a highly generalizable group of athletes, some of whom subsequently experienced concussive injury.
Materials & methods
Study population
Male and female athletes were recruited via coordinated outreach effort to schools and community organizations. The inclusion criteria were participation in organized competitive athletic activity, age 12–30 years, normal or corrected-to-normal vision, and for athletes over the age of 18 years, a high school diploma or equivalent, or expected timely high school graduation. Potential participants were screened for eligibility through telephone and in-person interviews. All participants were required to have good English proficiency. Individuals were excluded for eye-sight abnormalities precluding assessment, such as amblyopia, uncorrected near- or far-sightedness and macular degeneration.
Study protocol
The subject enrollment, consent process, and testing protocols were approved by the institutional review boards of Weill Cornell Medical College (NY, USA) and Stanford University (CA, USA). In collaboration with school, university and community athletic organizations in respective local areas, athletes were enrolled and baseline tested. Prior to data collection, written informed consent by adult subjects, or legal guardians of minor subjects with the minors' assent, was obtained in accordance with the Declaration of Helsinki. Participants subsequently identified by a trainer, coach, or other team staff with concussion underwent post-injury testing within 2 weeks of injury. A concussion was defined as an event of blunt impact on the head, with loss of consciousness, post-traumatic amnesia, or at least one of the following symptoms: dizziness, nausea, headaches, balance problems, blurred or double vision, or feeling dazed/confused. Although for the purpose of this research we did not rely on formal medical diagnosis of concussion necessary for clinical management of the injury, this definition is consistent with the guidance of the American Academy of Neurology [40]. Data collection spanned from September of 2012 through September of 2016.
Primary measures
Neurocognitive testing
The Simple Reaction Time (SRT) module from the Automated Neuropsychological Assessment Metrics Version 4 (ANAM) [41] and the Trail Making test (TRAILS) [42]. The SRT module was specifically chosen for its previously reported potential utility in concussion management [43,44]; other ANAM modules were not deployed.
Symptom questionnaires
The Rivermead Post-concussion Symptoms Questionnaire (RPQ) [21,45] and the Brain Injury Screening Questionnaire (BISQ) [46].
Part II of the BISQ contains a list of 100 self-reported common post-concussion symptoms representing four factors: attention-memory, mood/anxiety/depression, impulsivity/aggression, and physical symptoms. Average scores across the items in each factor ranged from 0 to 3 determined in terms of the probability of exposure to traumatic brain injury (TBI), with 0 indicating no probability (i.e., no symptoms) and 3 high probability (i.e., consistent symptoms). Norms were established by the instrument's authors based on the ability to distinguish known cases of TBI from depression, chronic pain and normal control cases; a cutoff of 0.5 SD above the TBI mean from the normative data was identified as an appropriate cutoff to distinguish TBI. For this study, we focused on the attention-memory score which according to the instrument's authors is the score that best differentiates TBI from other groups [46,47], and is based on mean frequency of experiencing 28 common post-concussion symptoms such as ‘thinking slowly’, ‘difficulty making decisions’ and ‘reading slowly’. The attention-memory factor score cutoff of 0.53, the score corresponding to the cutpoint recommended by the study authors, was used to identify athletes with moderate-severe post-concussive symptom burdens at the time of testing [47].
Psychological & mood scales
Center for Epidemiological Studies Depression Scale (CES-D) [48]; Beck Anxiety Inventory (BAI) [49]; BAI-Youth (BAI-Y) [50]; Beck Depression Inventory-Youth (BDI-Y) [50]; Conners Adult ADHD Rating Scales Self-report: Short Version (CAARS) [51]; and Conners 3rd Edition (Conners 3) for pediatric ADHD [52] (Pearson Clinical, San Antonio, TX).
Predictive pursuit eye movement
Pursuit eye movement performance was assessed with a circular tracking paradigm, following the protocol described previously [30]. Data were collected binocularly at a 500 Hz sampling rate using a video-based eye tracker (EyeLink 1000, SR Research Ltd., Mississauga, Canada) under normal room lighting. The stimulus was a target moving along a circular trajectory with a 10° radius at 0.4 Hz on a computer monitor. Collected eye movement data were screened with an automated algorithm for >10% of missing data, artifacts associated with inadequate quality of calibration, or poor head stabilization during recording as evidenced by a large change in visual fixation records and were also visually inspected [15,20]. Performance was characterized in terms of the instability of the gaze on the target (standard deviations [SDs] of gaze positional errors in radial and tangential directions of the target trajectory), average radial error, average phase lag or lead relative to the target, and the ratios of smooth pursuit velocity to the target velocity in the horizontal and vertical directions (horizontal and vertical gains).
Statistical analysis
We conducted two analytic approaches in parallel: a traditional method using a series of logistic regression models, and a machine learning approach using penalized regression. While machine learning analyses are slowly gaining popularity in medical research, there remain concerns regarding the purely data-driven nature of the method, as opposed to the more theory- or hypothesis-guided nature of traditional approaches. We aimed to examine whether the two approaches would demonstrate converging findings, and to evaluate the differences among the methods. Throughout, our focus is on comparing the model outputs produced by the two analytic approaches, rather than an in-depth review of the statistical properties of each (but see [38,39]).
We took a sequential approach to narrow down the large set of baseline measures for use in a streamlined final model. The pre-injury characteristics were grouped into sets of construct-consistent domains: demographic characteristics, head injury history, circular pursuit eye movement parameters, cognitive assessments, common concussion symptoms, and psychological and mood symptoms. In a series of multiple logistic regression models, each set of candidate variables was examined for the ability to distinguish between athletes with significant post-concussion symptoms and those without concussion. Individual variables within each domain were retained for testing in the final summary model if they met the threshold p < 0.10 defined in terms of the null hypothesis that the candidate variable had no relation to the symptomatic versus non-concussion grouping. We used this threshold for retention on the basis that, for the purposes of model specification, the risk of type II error was of higher concern than type I error, since candidate variables that did not act as useful predictors of injury would be discarded after examination of the summary model. Odds ratios (ORs) were calculated to determine effect sizes. We constructed a summary model based on the variables retained from each of the domain-specific models. The final set of variables in this summary model was examined for its ability to predict, based on baseline assessments, which athletes would experience post-concussive symptoms following subsequent head injury.
This sequential approach was used to address a common problem: narrowing down a large set of variables – many of which were intercorrelated – to a number appropriate to the size of the sample, while avoiding the problem of multicollinearity. Recent adaptations of machine learning techniques suggested an alternate approach to identifying which of the large set of baseline characteristics might show utility as a predictor of concussion. Penalized regression approaches such as LASSO are used to identify a tuning parameter, lambda, that applies shrinkage to the estimated coefficients such that some approach 0 and are dropped from the model. Elastic net is a related technique that has been shown to outperform LASSO with highly correlated predictors [39]. Given the strong association among concussion-related symptoms in our predictor set, we chose this latter approach. We randomly split the dataset into 70% training data and 30% testing data, and then entered the full set of baseline predictors into a logistic elastic net regression model with tenfold cross validation on the training dataset. After identifying the optimal lambda to determine the final set of predictors, we applied the resulting model to the testing dataset. We then tested the elastic net-determined set of predictors in a standard logistic regression to directly compare the findings to the traditional approach described above, examining pseudo R2 and misclassification errors as indices of predictive utility. Finally, we submitted both logistic regression logits (traditional and elastic net-derived) to area under the curve (AUC) analysis on their receiver operating characteristic curves to determine the relative explanatory power of the final fitted models [53,54]. Analyses were performed in SPSS v.25 (IBM SPSS Statistics for Windows, Version 25.0., NY, USA) and Stata 16 (Stata Statistical Software: Release 16, TX, USA).
Results
A total of 3091 athletes underwent baseline testing and 90 (2.9%) were reported to have sustained a concussion. This rate was roughly comparable to those reported in the literature [1,55,56]. The post-concussion assessment for one athlete occurred outside of the 14-day window; this participant was excluded from analysis. As reported previously [21], the remaining 89 athletes were evaluated within 2 weeks following injury, with testing ranging from the day of injury to 14 days after injury ( = 5.8 ± 3.5).
It was expected that time since injury would contribute to recovery. However, this expectation was not confirmed. Using the BISQ Attention-Memory subscale, 35 cases (39% of concussion cases, 1.1% of the total sample) were identified as experiencing post-concussive symptoms at the time of testing, and the remaining 54 cases were identified as having their initial symptoms resolved before the testing. If athletes had been impacted by their concussion in a random and unbiased fashion and recovering gradually, those identified as still experiencing significant symptoms at the time of testing should have been more likely to be among the ones tested early within the 14-day window, yet there was no difference in time-to-testing between the two groups (t[87] = 0.47, p = 0.64). The BISQ subscale scores plotted against the time between injury and testing had a slope of 0.0002 per day, which was non-significantly different from zero (t[87] = 0.012, p = 0.99). Thus, to study the impacts of concussions in athletes, we chose the final sample consisting of 35 concussed athletes and 3001 non-concussed athletes for a total n = 3036 (Figure 1).
Figure 1. . Participant flow diagram.
Characteristics of the sample
Athletes were likely to be Caucasian (53%), and male (62%). Age ranged from 12–30 years ( = 18.6 ± 3.0), with 11% aged 12–14 years, 16% aged 15–17 years, and the remaining 73% aged 18 years and over. About a quarter (28%) reported a prior head injury, 9% reported having a learning disability, 7% reported psychiatric diagnosis, and 4% reported a neurological diagnosis. Non-concussed athletes and athletes with significant post-concussive symptoms did not differ on any of these characteristics, but the latter group of athletes were younger (p = 0.032) and had a higher rate of prior head injury (about half with post-concussive symptoms vs about one quarter of non-concussed; p = 0.002) (Table 1). Data on the timing of prior head injury were not collected.
Table 1. . Sample characteristics.
| Non-concussed athletes | Athletes with significant post-concussive symptoms | |
|---|---|---|
| Age (years), (SD) | 18.6 (3.0)† | 17.5 (2.9)† |
| History of head injury | 27.5%† | 51.4%† |
| Caucasian | 52.9% | 40.0% |
| Male | 62.1% | 51.4% |
| Learning disability | 8.5% | 8.6% |
| Psychiatric disorders | 7.2% | 8.6% |
| Neurological disorders | 3.5% | 5.7% |
p < 0.05.
Preliminary models
The following five logistic regression models were examined for candidate variables' ability to distinguish between athletes with significant post-concussion symptoms from those without concussion.
Model 1: demographic & head injury history
Candidate variables were: age; history of head injury; race; sex; and learning disability. Age (p = 0.06, OR = .874) and history of head injury (p = 0.001, OR = 3.47) were retained.
Model 2: circular pursuit eye movement parameters
Note eye movement records of 821 cases were deemed invalid by the automated screening algorithm, and were dropped from this analysis. We retained these cases in the other preliminary models since we had not yet determined if any of the circular pursuit parameters would be included in the final model. Individuals missing eye movement data did not differ significantly on any study variables except that missing cases were younger (p < 0.001) and had a lower rate of prior head injury (p = .005), which reinforces that missingness was likely not due to cognitive factors. 817 of the 821 were non-concussed. Candidate variables were: SD radial; SD tangential; mean radial error; mean phase error; horizontal gain; and vertical gain. SD radial (p = 0.04, OR = 4.59) was retained.
Model 3: cognitive assessments
Candidate variables were: SRT median reaction time (RT); SRT SD of RT; SRT throughput; TRAILS A time; TRAILS B time; TRAILS A errors; TRAILS B errors; TRAILS A standard score; and TRAILS B standard score. None met the threshold for retention.
Model 4: symptoms common to concussion
Candidate variables were individual items from the RPQ: headaches; dizziness; nausea; noise; sleep; fatigue; irritable; depressed; frustrated; forgetfulness; concentration; longer to think; vision; light; double vision; and restlessness. We also considered the three additional items included in our implementation of RPQ (Maruta et al. 2018a): balance; mental fogginess; and drowsiness. Noise (p = 0.036, OR = 1.63), sleep (p = 0.078, OR = 1.39) and irritable (p = 0.049, OR = 1.59) were retained.
Model 5: psychological & mood symptoms
Candidate variables were: BAI anxiety; BAI-Y anxiety; CES-D depression; BDI-Y depression; Conners 3 inattention; Conners 3 hyperactive/impulsivity; Conners 3 learning problems; Conners 3 defiance/aggression; Conners 3 family relations; CAARS inattention; CAARS hyperactivity/restlessness; CAARS impulsivity; CAARS problems with self-concept; and CAARS ADHD Index. BAI anxiety (p = 0.05, OR = 1.08) and Conners 3 inattention (p = 0.05, OR = 1.04) were retained.
Summary model
Taking preliminary models into account, a summary model was created to combine all candidate predictors that met the p < .10 criteria. Measures that differed between adult and pediatric cases were harmonized based on Z scores (for BAI/BAI-Y) or T scores (for Connors 3/CAARS) for inclusion into the summary model. The final model is presented in Table 2. The overall model was significantly associated with the likelihood of significantly symptomatic concussion (χ2 [8] = 40.53, p < 0.001, pseudo R2 = 0.13), with several individual baseline characteristics showing significant associations with taxing post-concussive symptoms.
Table 2. . Summary model of selected candidate predictors.
| B | SE | p-value | Odds ratio | 95% CI | |
|---|---|---|---|---|---|
| Age | -0.13 | 0.07 | 0.055 | 0.875 | 0.76–1.00 |
| History of head injury | 1.15 | 0.38 | 0.003 | 3.152 | 1.49–6.66 |
| SD radial | 0.94 | 0.39 | 0.016† | 2.553 | 1.19–5.46 |
| ADHD inattention‡ | 0.04 | 0.02 | 0.043† | 1.035 | 1.00–1.07 |
| Anxiety§ | -0.06 | 0.17 | 0.728 | 0.944 | 0.68–1.31 |
| Noise§ | 0.39 | 0.20 | 0.047† | 1.479 | 1.00–2.18 |
| Sleep§ | 0.20 | 0.19 | 0.292 | 1.217 | 0.85–1.75 |
| Irritable§ | 0.11 | 0.20 | 0.565 | 1.120 | 0.76–1.65 |
p < 0.05.
Standardized subscale score from Connors/CAARS.
RPQ items.
CI: Confidence interval; SE: Standard error.
Prior head injury (OR = 3.15, p = 0.003) and increased SD radial, representing gaze instability (OR = 2.55, p = 0.016) showed the strongest associations with the presence of significant post-concussive symptoms following injury. Baseline SD radial scores did not differ for those with (0.668 ± 0.323) or without (0.679 ± 0.291) prior head injury (t(2251) <1, ns), so the predictive utility of SD radial does not appear to be related to incomplete recovery from prior injury. Further, baseline SD radial scores were unrelated to baseline sleep complaints (r = -0.002, ns), ruling out sleep deprivation as an explanatory factor. ADHD Inattention (OR = 1.04, p = 0.043) and noise sensitivity (OR = 1.48, p = 0.047) also were also significantly associated with semi-persistent symptoms following concussion. Age is marginally significant (OR = 0.88, p = 0.055), suggesting that younger age is associated with taxing post-concussive symptoms. Preinjury anxiety, sleep symptoms, and irritability did not significantly increase the likelihood of experiencing post-concussive symptoms, but their presence increased the overall predictive ability of the model and so they were retained.
Elastic net analysis
We ran the elastic net analysis on the 70% training dataset, which contained 1551 cases after missing data were omitted. Two criteria determined selection of the optimal lambda and associated model coefficients: minimizing the Bayesian information criterion (BIC) and maximizing variance explained, operationalized as the in-sample deviance ratio. After evaluating these criteria, we selected a model with alpha = 0.50, lambda = .0027, BIC = 279.55, deviance ratio = 0.108. Retained predictors for the model is presented in Table 3.
Table 3. . Elastic net model on training sample.
| Coef. | Odds ratio | |
|---|---|---|
| History of head injury | 0.58 | 1.79 |
| SD radial | 0.32 | 1.37 |
| ADHD inattention† | 0.16 | 1.17 |
| Age | -0.14 | 0.87 |
| Noise‡ | 0.19 | 1.21 |
| Light‡ | -0.07 | 0.93 |
| Dizziness‡ | 0.11 | 1.12 |
| TMT A Errors | -0.01 | 0.99 |
| TMT B Errors | -0.24 | 0.78 |
Standardized subscale score from Connors/CAARS.
Rivermead items.
CI: Confidence interval; SE: Standard error.
The results are strikingly similar to the summary model using standard logistic regression: history of head injury, ADHD inattention, SD radial, age, and noise are again retained as predictors, along with two additional common concussion symptoms, dizziness and light sensitivity, as well Trails A and B Errors. Applying the model to the 30% testing dataset of 662 cases, the model retained consistent explanatory power, with deviance ratio = 0.11.
Standard logistic regression results of the final model for the full sample, using the predictors derived from the elastic net model, are presented in Table 4. The overall model was significant (χ2 [9] = 48.35, p < .001, pseudo R2 = 0.15). History of head injury, ADHD inattention, SD radial, and trails B Errors were statistically significant predictors of a concussion burden, with age and noise marginally significant (p = 0.057 and 0.056, respectively).
Table 4. . Logistic regression from elastic net model on full sample.
| B | SE | p-value | Odds ratio | 95% CI | |
|---|---|---|---|---|---|
| History of head injury | 1.18 | 0.38 | 0.002† | 3.27 | 1.54–6.95 |
| SD radial | 0.89 | 0.38 | 0.020† | 2.43 | 1.15–5.14 |
| ADHD inattention‡ | 0.04 | 0.02 | 0.012† | 1.04 | 1.01–1.08 |
| Age | -0.13 | 0.07 | 0.057 | 0.88 | 0.77–1.00 |
| Noise§ | 0.45 | 0.24 | 0.056 | 1.57 | 0.99–2.49 |
| Light§ | 0.15 | 0.23 | 0.519 | 1.16 | 0.74–1.83 |
| Dizziness§ | 0.09 | 0.24 | 0.713 | 1.09 | 0.69–1.73 |
| TMT A errors | -0.39 | 0.41 | 0.337 | 0.67 | 0.30–1.51 |
| TMT B errors | -0.65 | 0.30 | 0.027† | 0.52 | 0.29–0.93 |
p < 0.05.
Standardized subscale score from Connors/CAARS.
RPQ items.
CI: Confidence interval; SE: Standard error.
Comparison of models
Given the overlap in retained variables, predictive capability of the two models are quite close, with the elastic net model performing slightly better: pseudo R2summary = 0.13 and pseudo R2elastic net = 0.16. We calculated AUC for the summary and elastic net logits. Again the elastic net model was slightly superior: AUCsummary = 0.76 and AUCelastic net = 0.78. Notably, the elastic net approach required many fewer steps to arrive at a comparable model, skipping the cumbersome iterative method used to narrow down sets of predictors in the traditional approach.
Discussion
We examined a large and broadly generalizable cohort of athletes to provide evidence for pre-existing and measurable baseline characteristics associated with risk of taxing symptoms if concussed during the ensuing season. The potential predictive characteristics represented a diverse set of factors including demographics; current and prior physical, neurological, psychiatric, and mood conditions; standardized neurocognitive testing; and, unique to this investigation, pursuit eye movement. Inclusion of the pursuit eye movement task allowed us to examine the particular role of anticipatory attention in the burden of concussion. The specific pursuit eye movement metric identified in the models, SD radial, has been previously associated with sleep deprivation and cognitive fatigue [57,58]; the current findings suggest its utility in predicting an increased burden of sports-related concussion.
We compared results built on traditional and machine-learning-based analytic techniques. The approaches led to models of similar content and explanatory power, reinforcing confidence in the findings. The elastic net regularized regression model is an illustration that these techniques have great utility in the clinical and applied medicine literature, and we hope its use here will inspire more widespread adoption of the technique. These findings are novel in the ability to identify premorbid factors that are specifically associated with an increased symptom burden during the acute post-concussion phase, as opposed to examining any occurrence of head injury whether or not it results in semi-persistent symptoms [59].
To be clear, the models presented here do not provide a causal explanation for sports-related concussion. Rather, the models highlight the key role of attention in an early phase of post-concussion trajectory. Most self-reported symptoms resolve quickly, but this outlook does not mean that concussion is resolved [60]. We thus selected 35 athletes who were still experiencing a significant burden of concussion at the time of testing so that we would be able to isolate predictive baseline characteristics. Indeed, the only statistically significant predictors common to both final models besides prior head injury were two attention-related variables, namely, SD radial and ADHD Inattention. It is possible that a prior head injury is related, perhaps bi-directionally, to attention problems in that the deficit in attentional reserve at baseline could potentially be the result of a prior head injury. We were not able to delve into such relations because of the limitation in the sample size, but effects of repeat concussion remain an important question. The design of the study, which assessed over 3,000 athletes, led us to expect a larger pool of athletes with significant post-concussion symptoms. What is good news clinically can be challenging from a research perspective. While most of the concussed athletes were expected to make a good functional recovery, presently we were not able to study longitudinal outcomes. Still, we believe that the current findings point to fruitful areas for further investigation.
Other study limitations include the specialized sample – this study examined concussion in young athletes and it is unclear whether these findings are generalizable to varieties of mechanisms of injury or other ages. Eye movement was recorded binocularly at a high sampling rate using research-grade equipment, but technological advancements are easing access to such measures. At the time of data collection, we lacked the means to screen for the validity of eye movement records. High-resolution eye tracking technology is evolving. Improvements in eye tracking technology supplemented by immediately screening the data with an automated algorithm should reduce the technical failure rate. Further research is needed to validate these findings in heterogeneous populations in a variety of settings including non-athletes. Additionally, further studies are needed to determine whether training strategies addressing deficits in eye movement subsequently reduce subsequent head injury and symptom burdens.
Conclusion
A better understanding of different post-concussion trajectories should improve individual athletes' readiness to deal with the period of transition to recovery or chronic symptom development. This study is novel in asking whether a preseason assessment can improve the prediction of post-concussion trajectories. Comprehensive testing including visual attention at the beginning of season may identify athletes who are at risk for an increased symptom burden of sports-related concussion. Understanding baseline attention characteristics may aid prognostic counseling.
Summary points.
We examined a large and broadly generalizable cohort of athletes to provide evidence for pre-existing and measurable baseline characteristics associated with risk of significant symptoms if concussed during the ensuing season.
We compared results built on traditional and machine-learning based analytic techniques.
Both traditional and machine-learning modeling approaches associated prior history of head injury and visual and other attention-related metrics with a risk of significant concussion symptoms.
Findings are novel in the ability to identify premorbid factors that are specifically associated with a risk of increased symptom burden during the acute post-concussion phase.
Objective visual attention testing at the beginning of season may identify athletes are at risk for an increased burden of sports-related concussion.
Understanding the baseline characteristics in athletes is key to direct prognostic counseling.
Machine-learning based analytic techniques have great utility in clinical and applied medicine.
Footnotes
Author contributions
All authors were involved with the conception of the study, result interpretation, manuscript writing and editing. LA Spielman performed all statistical analyses.
Financial disclosure
This study was funded by US Department of Defense contracts W911QY-12-C-0005 and W911QY-14-C-0086. The authors have no other relevant affiliations or financial involvement with any organization or entity with a financial interest in or financial conflict with the subject matter or materials discussed in the manuscript apart from those disclosed.
Competing interests disclosure
J Ghajar is founder of NeuroSync, Inc. LA Spielman has a consulting agreement with NeuroSync. J Maruta holds stock option in NeuroSync. J Ghajar is the inventor of US7384399, and J Ghajar and J Maruta are inventors of US15585057 and EP3032998, potentially related to the subject matter described in this article. The authors have no other competing interests or relevant affiliations with any organization or entity with the subject matter or materials discussed in the manuscript apart from those disclosed.
Writing disclosure
No writing assistance was utilized in the production of this manuscript.
Ethical conduct of research
The authors state that they have obtained appropriate institutional review board approval or have followed the principles outlined in the Declaration of Helsinki for all human or animal experimental investigations. In addition, for investigations involving human subjects, informed consent has been obtained from the participants involved.
Open access
This work is licensed under the Creative Commons Attribution 4.0 License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
References
Papers of special note have been highlighted as: • of interest; •• of considerable interest
- 1.Daneshvar DH, Nowinski CJ, McKee AC, Cantu RC. The epidemiology of sport-related concussion. Clin. Sports Med. 30(1), 1–17 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Abrahams S, Fie SM, Patricios J, Posthumus M, September AV. Risk factors for sports concussion: an evidence-based systematic review. Br. J. Sports Med. 48(2), 91–97 (2014). [DOI] [PubMed] [Google Scholar]
- 3.Fehr SD, Nelson LD, Scharer KR et al. Risk factors for prolonged symptoms of mild traumatic brain injury: a pediatric sports concussion clinic cohort. Clin. J. Sport Med. 29(1), 11–17 (2019). [DOI] [PubMed] [Google Scholar]
- 4.Nelson LD, Furger RE, Ranson J et al. Acute clinical predictors of symptom recovery in emergency department patients with uncomplicated mild traumatic brain injury or non-traumatic brain injuries. J. Neurotrauma 35(2), 249–259 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Scopaz KA, Hatzenbuehler JR. Risk modifiers for concussion and prolonged recovery. Sports Health Multidiscip. Approach. 5(6), 537–541 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Sufrinko AM, Marchetti GF, Cohen PE, Elbin RJ, Re V, Kontos AP. Using acute performance on a comprehensive neurocognitive, vestibular, and ocular motor assessment battery to predict recovery duration after sport-related concussions. Am. J. Sports Med. 45(5), 1187–1194 (2017). [DOI] [PubMed] [Google Scholar]
- 7.Hides JA, Franettovich Smith MM, Mendis MD et al. Self-reported concussion history and sensorimotor tests predict head/neck injuries. Med. Sci. Sports Exerc. 49(12), 2385–2393 (2017). [DOI] [PubMed] [Google Scholar]
- 8.Wetzel PA, Lindblad AS, Raizada H et al. Eye tracking results in postconcussive syndrome versus normative participants. Investig. Opthalmology Vis. Sci. 59(10), 4011 (2018). [DOI] [PubMed] [Google Scholar]
- 9.Putukian M, Riegler K, Amalfe S, Bruce J, Echemendia R. Preinjury and postinjury factors that predict sports-related concussion and clinical recovery time. Clin. J. Sport Med. 31(1), 15–22 (2021). [DOI] [PubMed] [Google Scholar]
- 10.Tsushima WT, Siu AM, Ahn HJ, Chang BL, Murata NM. Incidence and risk of concussions in youth athletes: comparisons of age, sex, concussion history, sport, and football position. Arch. Clin. Neuropsychol. Off. J. Natl Acad. Neuropsychol. 34(1), 60–69 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Brett BL, Kuhn AW, Yengo-Kahn AM, Solomon GS, Zuckerman SL. Risk factors associated with sustaining a sport-related concussion: an initial synthesis study of 12,320 student-athletes. Arch. Clin. Neuropsychol. Off. J. Natl Acad. Neuropsychol. 33(8), 984–992 (2018). [DOI] [PubMed] [Google Scholar]
- 12.McCrea M, Guskiewicz KM, Marshall SW et al. Acute effects and recovery time following concussion in collegiate football players: the NCAA Concussion Study. JAMA 290(19), 2556–2563 (2003). [DOI] [PubMed] [Google Scholar]
- 13.Slobounov S, Slobounov E, Sebastianelli W, Cao C, Newell K. Differential rate of recovery in athletes after first and second concussion episodes. Neurosurgery 61(2), 338–344 discussion 344 (2007). [DOI] [PubMed] [Google Scholar]
- 14.Thomas DG, Apps JN, Hoffmann RG, McCrea M, Hammeke T. Benefits of strict rest after acute concussion: a randomized controlled trial. Pediatrics 135(2), 213–223 (2015). [DOI] [PubMed] [Google Scholar]
- 15.Maruta J, Spielman LA, Rajashekar U, Ghajar J. Visual tracking in development and aging. Front. Neurol. 8, 640 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Maruta J, Spielman LA, Ghajar J. Visuomotor synchronization: military normative performance. Mil. Med. usab320 (2021). [DOI] [PubMed] [Google Scholar]
- 17.Binder LM. A review of mild head trauma. Part II: clinical implications. J. Clin. Exp. Neuropsychol. 19(3), 432–457 (1997). [DOI] [PubMed] [Google Scholar]
- 18.Carney N, Ghajar J, Jagoda A et al. Concussion guidelines Step 1: systematic review of prevalent indicators. Neurosurgery 75(Suppl. 1), S3–S15 (2014). [DOI] [PubMed] [Google Scholar]
- 19.Wallesch C-W, Curio N, Kutz S, Jost S, Bartels C, Synowitz H. Outcome after mild-to-moderate blunt head injury: effects of focal lesions and diffuse axonal injury. Brain Inj. 15(5), 401–412 (2001). [DOI] [PubMed] [Google Scholar]
- 20.Maruta J, Spielman LA, Rajashekar U, Ghajar J. Association of visual tracking metrics with post-concussion symptomatology. Front. Neurol. 9, 611 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Maruta J, Lumba-Brown A, Ghajar J. Concussion subtype identification with the Rivermead Post-concussion Symptoms Questionnaire. Front. Neurol. 9, 1034 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Mallott JM, Palacios EM, Maruta J, Ghajar J, Mukherjee P. Disrupted white matter microstructure of the cerebellar peduncles in scholastic athletes after concussion. Front. Neurol. 10, 518 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Maruta J, Mallott JM, Sulioti G, Ghajar J, Palacios EM, Mukherjee P. Concussion Disrupts normal brain white matter microstructural symmetry. Front. Neurol. 11, 548220 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Knudsen EI. Fundamental components of attention. Annu. Rev. Neurosci. 30, 57–78 (2007). [DOI] [PubMed] [Google Scholar]
- 25.Petersen SE, Posner MI. The attention system of the human brain: 20 years after. Annu. Rev. Neurosci. 35, 73–89 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Corbetta M, Akbudak E, Conturo TE et al. A common network of functional areas for attention and eye movements. Neuron. 21(4), 761–773 (1998). [DOI] [PubMed] [Google Scholar]
- 27.Pierrot-Deseilligny C, Milea D, Müri RM. Eye movement control by the cerebral cortex. Curr. Opin. Neurol. 17(1), 17–25 (2004). [DOI] [PubMed] [Google Scholar]
- 28.Ohlendorf S, Kimmig H, Glauche V, Haller S. Gaze pursuit, “attention pursuit” and their effects on cortical activations. Eur. J. Neurosci. 26(7), 2096–2108 (2007). [DOI] [PubMed] [Google Scholar]
- 29.Krauzlis RJ. The control of voluntary eye movements: new perspectives. Neurosci. Rev. J. Bringing Neurobiol. Neurol. Psychiatry. 11(2), 124–137 (2005). [DOI] [PubMed] [Google Scholar]
- 30.Maruta J, Heaton KJ, Kryskow EM, Maule AL, Ghajar J. Dynamic visuomotor synchronization: quantification of predictive timing. Behav. Res. Methods. 45(1), 289–300 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]; • Describes the rationale and methods of the circular visual tracking test used in this report.
- 31.Ghajar J, Ivry RB. The predictive brain state: asynchrony in disorders of attention? The Neuroscientist. 15(3), 232–242 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Lencer R, Trillenberg P. Neurophysiology and neuroanatomy of smooth pursuit in humans. Brain Cogn. 68(3), 219–228 (2008). [DOI] [PubMed] [Google Scholar]
- 33.Alosco ML, Fedor AF, Gunstad J. Attention deficit hyperactivity disorder as a risk factor for concussions in NCAA division-I athletes. Brain Inj. 28(4), 472–474 (2014). [DOI] [PubMed] [Google Scholar]
- 34.Biederman J, Feinberg L, Chan J et al. Mild traumatic brain injury and attention-deficit hyperactivity disorder in young student athletes. J. Nerv. Ment. Dis. 203(11), 813–819 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Gunn BS, McAllister TW, McCrea MA, Broglio SP, Moore RD. CARE Consortium Investigators. Neurodevelopmental Disorders and Risk of Concussion: Findings from the National Collegiate Athletic Association Department of Defense Grand Alliance Concussion Assessment, Research, and Education (NCAA-DOD CARE) Consortium (2014–2017). J. Neurotrauma 39(5–6), 379–389 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Lambert M, Marshall C, Holahan MR. Predictors of concussion outcomes in individuals with ADHD. J. Head Trauma Rehabil. 36(2), 120–127 (2021). [DOI] [PubMed] [Google Scholar]
- 37.Aggarwal SS, Ott SD, Padhye NS, Schulz PE. Sex, race, ADHD, and prior concussions as predictors of concussion recovery in adolescents. Brain Inj. 34(6), 809–817 (2020). [DOI] [PubMed] [Google Scholar]
- 38.Bursac Z, Gauss CH, Williams DK, Hosmer DW. Purposeful selection of variables in logistic regression. Source Code Biol. Med. 3(1), 17 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]; •• Identifies control points in the variable selection process in logistic regression.
- 39.Zou H, Hastie T. Regularization and variable selection via the elastic net. J. R. Stat. Soc. Ser. B Stat. Methodol. 67(2), 301–320 (2005). [Google Scholar]; •• Demonstrates the improved machine-learning regression technique.
- 40.Giza CC, Kutcher JS, Ashwal S et al. Summary of evidence-based guideline update: evaluation and management of concussion in sports: report of the Guideline Development Subcommittee of the American Academy of Neurology. Neurology 80(24), 2250–2257 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Reeves D, Winter K, Bleiberg J, Kane R. ANAM® genogram: historical perspectives, description, and current endeavors. Arch. Clin. Neuropsychol. 22, 15–37 (2007). [DOI] [PubMed] [Google Scholar]
- 42.Reitan RM. Validity of the Trail Making Test as an indicator of organic brain damage. Percept. Mot. Skills. 8(3), 271–276 (1958). [Google Scholar]
- 43.Cernich A, Reeves D, Sun W, Bleiberg J. Automated Neuropsychological Assessment Metrics sports medicine battery. Arch. Clin. Neuropsychol. Off. J. Natl Acad. Neuropsychol. 22(Suppl. 1), S101–S114 (2007). [DOI] [PubMed] [Google Scholar]
- 44.Kelly MP, Coldren RL, Parish RV, Dretsch MN, Russell ML. Assessment of acute concussion in the combat environment. Arch. Clin. Neuropsychol. Off. J. Natl Acad. Neuropsychol. 27(4), 375–388 (2012). [DOI] [PubMed] [Google Scholar]
- 45.King NS, Crawford S, Wenden FJ, Moss NEG, Wade DT. The Rivermead Post Concussion Symptoms Questionnaire: a measure of symptoms commonly experienced after head injury and its reliability. J. Neurol. 242(9), 587–592 (1995). [DOI] [PubMed] [Google Scholar]
- 46.Gordon WA, Haddad L, Brown M, Hibbard MR, Sliwinski M. The sensitivity and specificity of self-reported symptoms in individuals with traumatic brain injury. Brain Inj. 14(1), 21–33 (2000). [PubMed] [Google Scholar]; • Describes the Brain Injury Screening Questionnaire (BISQ) traumatic brain injury (TBI) screening tool used in this report.
- 47.Gordon WA, Spielman LA, Hahn-Ketter AE, Sy KTL. The relationship between traumatic brain injury and criminality in juvenile offenders. J. Head Trauma Rehabil. 32(6), 393–403 (2017). [DOI] [PubMed] [Google Scholar]; • Describes factor analysis of 100 symptoms of TBI covered by the BISQ.
- 48.Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl. Psychol. Meas. 1(3), 385–401 (1977). [Google Scholar]
- 49.Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J. Consult. Clin. Psychol. 56(6), 893–897 (1988). [DOI] [PubMed] [Google Scholar]
- 50.Beck J, Beck A, Jolly J. Beck youth inventories manual. The Psychological Corporation, TX, USA: (2001). [Google Scholar]
- 51.Conners CK, Erhardt D, Sparrow EP. Conners' adult ADHD rating scales (CAARS): technical manual. Multi-Health Systems, North Tonawanda, NY, USA: (1999). [Google Scholar]
- 52.Conners CK. Conners 3rd edition manual. Multi-Health Systems, Toronto, Canada: (2008). [Google Scholar]
- 53.Liew BXW, Kovacs FM, Rügamer D, Royuela A. Machine learning versus logistic regression for prognostic modelling in individuals with non-specific neck pain. Eur. Spine J. Off. Publ. Eur. Spine Soc. Eur. Spinal Deform. Soc. Eur. Sect. Cerv. Spine Res. Soc. 31(8), 2082–2091 (2022). [DOI] [PubMed] [Google Scholar]
- 54.Zheng D, Hao X, Khan M et al. Comparison of machine learning and logistic regression as predictive models for adverse maternal and neonatal outcomes of preeclampsia: a retrospective study. Front. Cardiovasc. Med. 9, 959649 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Guskiewicz KM, Weaver NL, Padua DA, Garrett WE. Epidemiology of concussion in collegiate and high school football players. Am. J. Sports Med. 28(5), 643–650 (2000). [DOI] [PubMed] [Google Scholar]
- 56.Pfister T, Pfister K, Hagel B, Ghali WA, Ronksley PE. The incidence of concussion in youth sports: a systematic review and meta-analysis. Br. J. Sports Med. 50(5), 292–297 (2016). [DOI] [PubMed] [Google Scholar]
- 57.Heaton KJ, Maule AL, Maruta J, Kryskow EM, Ghajar J. Attention and visual tracking degradation during acute sleep deprivation in a military sample. Aviat. Space Environ. Med. 85(5), 497–503 (2014). [DOI] [PubMed] [Google Scholar]
- 58.Maruta J, Spielman LA, Tseretopoulos ID, Hezghia A, Ghajar J. Possible medication-resistant deficits in adult ADHD. J. Atten. Disord. 21(14), 1169–1179 (2017). [DOI] [PubMed] [Google Scholar]
- 59.Hodgkins P, Montejano L, Sasané R, Huse D. Risk of injury associated with attention-deficit/hyperactivity disorder in adults enrolled in employer-sponsored health plans: a retrospective analysis. Prim. Care Companion CNS Disord. 13(2), PCC.10m01031 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Broglio SP, Liebel SW, Zhou W et al. Time to recovery as measured on clinical assessments after sport-related concussion. N. Engl. J. Med. 388(18), 1717–1719 (2023). [DOI] [PubMed] [Google Scholar]

