Abstract
Undiagnosed concussions increase the risk of additional concussion and persistent symptoms from concussion. Because there are no reliable objective markers of concussion, self-reporting of subjective and non-visible symptoms are critical to ensuring proper concussion management. For this reason, educational interventions target concussion reporting, but the majority of studies have examined the efficacy of single educational interventions or compared interventions to one another. This randomized crossover study sought to identify whether there was benefit to administering multiple concussion education programs in tandem, back to back. The study randomized 313 male high school football players to first receive CrashCourse concussion education (CC) or Centers for Disease Control and Prevention video concussion education (CDC) followed by crossover with the other education. Athlete concussion-reporting intention, attitudes, subjective norms, perceived behavioral control, and enjoyment of education were assessed at baseline and after each intervention. There were statistically significant improvements across all measures, both after single intervention and crossover (all p < 0.001). Secondary analyses examining differences between education found that athletes reported higher enjoyment of concussion education immediately after participating in CC, as compared to CDC (p < 0.001). These findings demonstrate an additive benefit to implementing CC and CDC education in tandem, without decrement in enjoyment of concussion education after experiencing dual educations; in fact, enjoyment of concussion education improved after receiving education programs back to back. These educational programs appear to complement one another, and the results support the use of multi-modal concussion education to differentially target and maximize concussion reporting.
Keywords: concussion, education, prevention, reporting
Introduction
An estimated 1.1 million to 1.9 million concussions occur annually in children 18 years or younger in the United States, with an estimated 0.5 million to 1.2 million of these concussions not properly diagnosed.1,2 These underdiagnosed concussions increase the risk of subsequent concussion or persistent symptoms from concussion, especially when an athlete continues to participate in activities with a high risk of traumatic brain injury (TBI).3–8 Given the increased risks of successive concussion and prolonged recovery associated with ongoing play, undiagnosed concussions pose a serious public health issue.9
The manifestations of concussions can often be difficult to observe or characterize, and many athletes under-report concussion symptoms and return to play.2,4,10,11 Proactive measures, such as concussion education and increased youth awareness, may serve to improve concussion reporting and minimize the risk of successive TBI.12–16 As a result, multiple concussion education programs have been created, each of which present content uniquely.
Because of the complexities associated with measuring concussion-reporting behavior change, studies have evaluated the efficacy of concussion education programs using outcomes proximally related to behaviors, by either examining effects on concussion knowledge, or constructs derived from the theory of planned behavior (TPB; Fig. 1).12,13,15,17–21 TPB, first described by Ajzen in 1991, aims to identify the factors associated with behavior change. TPB posits that behavioral changes are signaled by behavioral intention (motivation), which is directly influenced by behavioral beliefs (attitudes about reporting), normative beliefs (subjective and social approval of reporting), and perceived behavioral control (understanding how to report).22
FIG. 1.
Theory of planned behavior in the context of concussion reporting.22
Over the past 30 years, TPB has been tested in a variety of contexts.23 Previous work demonstrates that TPB can be a useful predictive model for adolescent concussion-reporting behavior, with all three constructs (attitudes, subjective norms, and perceived behavioral control) associated with concussion-reporting intention (motivation) and concussion reporting (behavior change).12,13,20,24,25 Few studies have directly compared the efficacy of different education programs; these studies demonstrated that athletes who experience different concussion education programs have variable improvement in concussion-reporting intention, concussion attitudes, subjective norms, and perceived behavioral control.13,26
There may, however, be benefits to administering multiple concussion education programs to improve concussion reporting.15 Each educational intervention has a different format with different foci and, as a result, may have different strengths in influencing constructs related to the reporting decision. The benefit of administering multiple educational interventions has not been previously assessed. A common concern with implementing multiple interventions is that the learner may be overburdened, resulting in less satisfaction with an educational program, and thus less compliance.27 Additionally, different concussion education programs may be preferentially enjoyed by different learners; there is evidence that concussion education enjoyment may have a moderating effect on concussion reporting.28
Over the past 10 years, the most commonly used concussion education resources in the United States have been created and provided by the Centers for Disease Control and Prevention (CDC). In 2010, the CDC partnered with the National Federation of State High School Associations (NFHS) to release the free “Concussion in Sports” course, which has been viewed >2.2 million times.29
Since launching in September 2018, the CrashCourse (CC) concussion education has been widely adopted, including by the majority of U.S. youth football organizations (e.g., U.S. Football, American Youth Football and Pop Warner), various U.S. Olympic Committees (e.g., U.S. Speedskating, U.S. Field Hockey, and U.S. Wrestling), medical organizations (e.g., Brain Injury Association of America, Lucille Packard Children's Hospital Stanford), and several U.S. high schools (e.g., state high school athletic associations of North Carolina and Arkansas).30 A recent randomized controlled trial demonstrated that athletes randomized to CC reported greater intent to report concussion, more knowledge, and improved concussion-reporting attitudes when compared to CDC video and written materials.13
The present study sought to evaluate the potential benefits of receiving dual concussion education programs, with persons randomized to first receive either CDC or CC, followed by crossover with the other education program. We hypothesized that athletes would improve in concussion-reporting intention, attitudes, subjective norms, perceived behavioral control, and enjoyment of education, after one educational intervention, with significantly greater gains after the second educational program. Secondary analyses were performed to evaluate differences in outcomes between the two programs.
Methods
Participants
Participants were male athletes from seven high school football teams in Colorado. These schools were varied in terms of racial composition (minority enrollment ranging from 18% to 94%; mean, 38%) and socioeconomic status (percent of students qualifying for free lunch ranging from 8% to 86%; mean, 26%). Participants were included if they were in attendance for practice on the study date and provided signed assent and parental consent. Participants were excluded if they did not complete >50% of the questionnaires. In total, 349 participants were screened for inclusion; 14 did not provide a signed parental consent and 13 were absent on the initial study date. Nine athletes were excluded because of incomplete participation. Figure 2 outlines study enrollment. Participation in this research study was entirely voluntary and not a pre-requisite for football participation to meet concussion education guidelines. All research activities were reviewed and approved by the Stanford Medicine Institutional Review Board.
FIG. 2.
Study enrollment and randomization. CC, CrashCourse concussion education; CDC, Centers for Disease Control and Prevention video-based concussion education.
Design
All participants (n = 313) completed study questionnaires and education on individual computers in July 2019. Participants first completed baseline study questionnaires before being randomized with a computer-based random number generator to be assigned to one of two groups: CC-First or CDC-First. CC-First (n = 146) received the CC concussion education curriculum followed by the CDC/NFHS “Concussion in Sports” video curricula. CDC-First (n = 167) received the CDC curriculum followed by CC. All athletes completed a post-education questionnaire immediately after exposure to the first educational curricula and another questionnaire immediately after exposure to the second educational curricula. Two research team members were present for the entirety of the administration to monitor students and were provided guidelines with escalating actions in case of disruptive behavior.
Interventions
CrashCourse concussion education
In September 2018, the 501(c)3 non-profit organization, TeachAids, released a free video-based concussion education program. CC was created with a user-centered formative design process by iteratively incorporating feedback from hundreds of athletes, coaches, athletic trainers, education researchers, and scientific experts. The resulting 12-min video places the learner in a first-person game situation, where they experience a concussion and are presented with the choice to “Stay in the Game” or “Take a Knee” and be evaluated. The consequences of the learner's decision are further explored. Subsequently, the consequences of the alternate decision are shown, ensuring that learners are provided all information. Learners are taught to recognize concussion signs and symptoms, understand the importance of reporting, and seek medical attention for diagnosis and management. This narrative-driven interactive program is guided by near-peer Division I collegiate football players.30
Centers for Disease Control and Prevention /National Federation of State High School Associations “Concussion in Sports” video
The CDC and NFHS partnered in 2010 to release the free “Concussion in Sports” online course, which was subsequently revised in 2018.29 The content is geared toward student-athletes, parents, and coaches. These materials engage learners by incorporating 25 min of videos and six slides, followed by nine questions, to teach learners concussion signs and symptoms, highlight the effects of sports-related concussion, and provides protocols to manage a suspected concussion including how to help players return to play safely after a concussion. The course is hosted by Michael Koester, MD, chair of the NFHS Sports Medicine Advisory Committee.31
Outcomes
All outcomes, except perceived behavioral control, were assessed based on athlete responses to questions on a 5-point Likert scale, from 1 = “strongly disagree” to 5 = “strongly agree,” using TPB-informed questions informed by past work.22,24,32,33 Each question was individually chosen to ensure construct validity while maximizing assessment brevity. When multiple questions were asked related to a single construct, internal consistency was assessed, with Cronbach's alpha reported, and scores were averaged. The text of the specific questions asked of each athlete are below.
Concussion-reporting intention
Athletes were asked to rate, “If I think I may have a concussion, I intend to report it to a medical professional (doctor, athletic trainer, nurse)” and “if my teammates think they may have a concussion, they would report it to a medical professional (doctor, athletic trainer, nurse)” (Cronbach's alpha = 0.86).
Concussion-reporting attitudes
Athletes were asked to rate, “I understand the importance of telling someone if I suspect I have a concussion.”
Subjective norms
Athletes were asked to rate, “If I report what I suspect might be a concussion, my teammates would think I made the right decision”; “if I report what I suspect might be a concussion, my parents would think I made the right decision”; and “if I report what I suspect might be a concussion, my coaches would think I made the right decision” (Cronbach's alpha = 0.88).
Perceived behavioral control
Perceived behavioral control was assessed based on athlete responses to three questions on a 100-point scale, from 1 = “cannot do” to 100 = “definitely can do,” adapted from previous work.34 Specifically, athletes were asked to rate whether, “I can identify when I have a concussion”; “I can immediately tell a medical professional that I have a concussion”; and “I can eventually tell a medical professional that I have a concussion.” Scores were averaged to create a composite score (Cronbach's alpha = 0.89).
Enjoyment of education
Athletes were asked to rate, “I am satisfied with the concussion education I have received” and “I enjoyed the concussion education I have received” (Cronbach's alpha = 0.76).
Statistical analysis
Independent-samples t-tests (continuous measures) or chi-square (categorical measures) were used to assess demographic differences between athletes randomized to CC-First and CDC-First. Fisher's exact test was used in place of chi-square when expected cell values were <5. For primary and secondary outcomes, repeated measures analysis of variance (ANOVA), with one between-subjects factor (randomization group) and one within-subject factor (time points: i.e., pretest, following first education, and following second education). Post hoc testing examined pair-wise differences between time points. Secondary analyses via repeated-measures ANOVA examined differences between education formats by including one between-subjects factor (education type) and one within-subject factor (time point). When sphericity could not be assumed, Greenhouse-Geisser corrections were applied. Although these analyses assume normality, an advantage of repeated measures ANOVA is that it is robust to violations of normality, particularly with sample sizes >20. To account for multiple comparisons, false discovery rate p-values were calculated based on the Benjamini-Hochberg procedure and are presented for analyses of all primary or secondary outcomes. Analyses were performed using IBM SPSS Statistics (Version 20.0; IBM Corp., Armonk, NY) or R software (Version 3.6; R Foundation for Statistical Computing).
Results
Demographic information is provided in Table 1. Athletes were 13.1% freshman, 28.3% sophomore, 26.9% juniors, and 31.7% seniors (of note, in the United States, freshmen typically begin high school at ages 14–15 and are seniors at ages 17–18). They started playing football at an average age of 9.4 ± 3.0 years and had played football for an average of 6.5 ± 3.1 years. There were no significant differences in grade, football position, duration of football career, or age of starting football between athletes randomized to receive CC-First and CDC-First. Please see the Supplementary Materials for demographic differences in baseline measures.
Table 1.
Demographics and Characteristics of Study Participants
| |
Education format |
|
|
|
|---|---|---|---|---|
| CC-First (n = 145a) | CDC-First (n = 167) | Overall (n = 312) | p valueb | |
| Grade (%) | 0.40 | |||
| Freshman | 19 (13.1) | 32 (19.2) | 51 (16.3) | |
| Sophomore | 41 (28.3) | 51 (30.5) | 92 (29.5) | |
| Junior | 39 (26.9) | 37 (22.2) | 76 (24.4) | |
| Senior | 46 (31.7) | 47 (28.1) | 93 (29.8) | |
| Position (%) | 0.58 | |||
| Defensive back | 16 (11.0) | 27 (16.2) | 43 (13.8) | |
| Defensive line | 21 (14.5) | 21 (12.6) | 42 (13.5) | |
| Fullback | 1 (0.7) | 2 (1.2) | 3 (1.0) | |
| Kicker | 2 (1.4) | 0 (0.0) | 2 (0.6) | |
| Linebacker | 23 (15.9) | 26 (15.6) | 49 (15.7) | |
| Offensive line | 24 (16.6) | 35 (21.0) | 59 (18.9) | |
| Quarterback | 8 (5.5) | 8 (4.8) | 16 (5.1) | |
| Running back | 15 (10.3) | 15 (9.0) | 30 (9.6) | |
| Tight end | 2 (1.4) | 5 (3.0) | 7 (2.2) | |
| Wide receiver | 33 (22.8) | 28 (16.8) | 61 (19.6) | |
| Years of football | 6.5 ± 3.1 | 5.9 ± 3.2 | 6.1 ± 3.2 | 0.07 |
| Age started football | 9.4 ± 3.0 | 9.8 ± 3.0 | 9.6 ± 3.0 | 0.36 |
One participant randomized to receive CC-First did not complete demographic information.
Independent-samples t-tests for continuous data, or chi-square analyses for categorical data, were used to assess demographic differences between groups.
CC, CrashCourse concussion education; CDC, Centers for Disease Control and Prevention video materials.
Table 2.
The Relationship between Concussion Education Administered at Each Time Point and Primary and Secondary Outcomes
| All athletes (n = 313) | CC-First (n = 146) | CDC-First (n = 167) | p valuea | |
|---|---|---|---|---|
| Concussion-reporting intention | 0.05 | |||
| Baseline (95% CI) | 4.0 (3.9, 4.1) | 4.0 (3.8, 4.1) | 4.1 (4.0, 4.2) | |
| After first education (95% CI) | 4.4 (4.3, 4.5) | 4.4 (4.3, 4.5) | 4.4 (4.3, 4.5) | |
| After second education (95% CI) | 4.6 (4.5, 4.7) | 4.6 (4.5, 4.7) | 4.5 (4.5, 4.6) | |
| p value across all time pointsb | <0.001 | <0.001 | <0.001 | |
| p value baseline to first education | <0.001 | <0.001 | <0.001 | |
| p value first to second education | <0.001 | <0.001 | <0.001 | |
| Concussion attitudes | 0.53 | |||
| Baseline (95% CI) | 4.4 (4.3, 4.5) | 4.4 (4.3, 4.5) | 4.4 (4.3, 4.5) | |
| After first education (95% CI) | 4.6 (4.6, 4.7) | 4.7 (4.6, 4.7) | 4.6 (4.5, 4.7) | |
| After second education (95% CI) | 4.7 (4.7, 4.8) | 4.7 (4.6, 4.8) | 4.7 (4.6, 4.8) | |
| p value across all time pointsb | <0.001 | <0.001 | <0.001 | |
| p value baseline to first education | <0.001 | 0.001 | <0.001 | |
| p value first to second education | <0.001 | <0.001 | <0.001 | |
| Concussion-reporting norms | 0.53 | |||
| Baseline (95% CI) | 4.3 (4.2, 4.4) | 4.3 (4.2, 4.4) | 4.3 (4.2, 4.4) | |
| After first education (95% CI) | 4.5 (4.5, 4.6) | 4.6 (4.5, 4.6) | 4.5 (4.4, 4.6) | |
| After second education (95% CI) | 4.7 (4.6, 4.7) | 4.7 (4.6, 4.8) | 4.6 (4.5, 4.7) | |
| p value across all time pointsb | <0.001 | <0.001 | <0.001 | |
| p value baseline to first education | <0.001 | <0.001 | <0.001 | |
| p value first to second education | <0.001 | <0.001 | <0.001 | |
| Concussion perceived behavioral control | 0.53 | |||
| Baseline (95% CI) | 68.9 (66.6, 71.0) | 69.8 (66.6, 73.0) | 67.9 (64.8, 70.9) | |
| After first education (95% CI) | 79.9 (77.9, 81.9) | 80.4 (77.5, 83.3) | 79.5 (76.8, 82.2) | |
| After second education (95% CI) | 85.4 (83.6, 87.2) | 86.6 (84.0, 89.2) | 84.3 (81.8, 86.7) | |
| p value across all time pointsb | <0.001 | <0.001 | <0.001 | |
| p value baseline to first education | <0.001 | <0.001 | <0.001 | |
| p value first to second education | <0.001 | <0.001 | <0.001 | |
| Concussion-education enjoyment | 0.01 | |||
| Baseline (95% CI) | 3.5 (3.4, 3.6) | 3.5 (3.3, 3.6) | 3.5 (3.4, 3.6) | |
| After first education (95% CI) | 4.3 (4.3, 4.4) | 4.4 (4.3, 4.5) | 4.2 (4.1, 4.3) | |
| After second education (95% CI) | 4.6 (4.5, 4.6) | 4.6 (4.5, 4.7) | 4.6 (4.5, 4.7) | |
| p value across all time pointsb | <0.001 | <0.001 | <0.001 | |
| p value baseline to first education | <0.001 | <0.001 | <0.001 | |
| p value first to second education | <0.001 | <0.001 | <0.001 | |
False discovery rate p values were calculated based on the Benjamini-Hochberg procedure to account for multiple comparisons. p values in bold indicate significant differences.
Represents results of repeated-measures ANOVA with one between-subjects factor (the outcome being evaluated) and one within-subject factor (time point).
Represents the results of post hoc ANOVA.
CI, confidence interval; ANOVA, analysis of variance.
Concussion-reporting intention
Athlete concussion-reporting intention significantly improved (Fig. 3A; omnibus, p < 0.001), from 4.0 ± 0.8 to 4.4 ± 0.6, after the first educational intervention (p < 0.001) and significantly improved again to 4.6 ± 0.6 after the second educational intervention (p < 0.001). There was no difference between concussion education administered (p = 0.05).
FIG. 3.
Changes in proxies of concussion-reporting intention after each educational intervention. Significance bars indicate significant differences for: all participants (black), the group randomized to receive CC-First (light red), the group randomized to receive CDC-First (light blue), immediately before and after each CC intervention (dark red), and immediately before and after each CDC intervention (blue). Error bars indicate 95% confidence intervals at each point. CC, CrashCourse concussion education; CDC, Centers for Disease Control and Prevention video-based concussion education.
Concussion-reporting attitudes
Attitudes about concussion reporting significantly improved (Fig. 3B; omnibus, p < 0.001) from 4.4 ± 0.7 to 4.6 ± 0.5 after the first educational intervention (p < 0.001) and significantly improved again to 4.7 ± 0.5 after the second educational intervention (p < 0.001). There was no difference between concussion education administered (p = 0.53).
Subjective norms
Athlete subjective norms related to concussion reporting significantly improved (Fig. 3C; omnibus, p < 0.001), from 4.3 ± 0.6 to 4.5 ± 0.5, after the first educational intervention (p < 0.001) and significantly improved again to 4.7 ± 0.5 after the second educational intervention (p < 0.001). There was no difference between concussion education administered (p = 0.53).
Perceived behavioral control
Athlete perceived behavioral control about concussion reporting significantly improved (Fig. 3D; omnibus, p < 0.001), from 68.8 ± 19.9 to 79.9 ± 17.7, after the first educational intervention (p < 0.001) and significantly improved again to 85.4 ± 16.2 after the second educational intervention (p < 0.001). There was no difference between concussion education administered (p = 0.53).
Enjoyment of education
Athlete enjoyment of concussion education significantly improved (Fig. 3E; omnibus, p < 0.001), from 3.5 ± 0.8 to 4.3 ± 0.6, after the first educational intervention (p < 0.001) and significantly improved again to 4.6 ± 0.6 after the second educational intervention (p < 0.001). There were significant differences by education administered and time (p = 0.01), with athletes reporting enjoyment of 4.5 ± 0.5 immediately after receiving CC and athletes reporting enjoyment of 4.4 ± 0.6 immediately after receiving CDC.
Discussion
This present study found that all measured concussion-related outcomes improved after both concussion programs and were further improved after a second educational module. There were also improvements in TPB constructs proximally related to concussion reporting, namely concussion-reporting ntention, concussion attitudes, perceived norms, and perceived behavioral control. These changes occurred regardless of education administered. Importantly, there were additional increases associated with administering a second education. This study was uniquely able to assess these changes because of its randomized crossover design, ensuring that athletes could serve as their own controls, while they all received both educational interventions.
There are several explanations for why providing different educational interventions in tandem provide additive benefit. There may be a benefit to reinforcing ideas, especially because repeated messaging from different sources lends further credibility to the message. Also, because each intervention was created to be as parsimonious as possible, there are ideas emphasized in one education that may have been left out of the other, often because of time constraints. Experiencing multiple programs allows the learner to have a more comprehensive education about the importance of concussion reporting.
There has been concern that learners would experience fatigue when experiencing prolonged education,27 or that additional education may result in a resistance to the desired behavior.35 However, this study demonstrates that the benefits associated with providing multiple education programs do not come at the expense of athlete enjoyment; athletes actually reported significant increases in their enjoyment and satisfaction with the concussion education programs that they had received, even after receiving the second of two educational interventions back to back.
The present study analyzed the effect of these educational programs sequentially, back to back. However, there may be benefits to intervening at different time points throughout a season.15 For example, a more in-depth education may be best suited for the beginning of a season, with refreshers administered periodically throughout the season. Now that the benefit of multiple educational interventions has been demonstrated generally, further work can explore optimal timing.
Interestingly, the only outcome that significantly differed between education types was enjoyment of the concussion education received. The lack of other differences between CC and CDC educational materials differs from previous studies evaluating these programs.13 This discrepancy may be related to the lack of longitudinal follow-up in the present study. Specifically, previous work randomized athletes to receive an educational intervention and evaluated for sustained improvements in concussion-reporting–related outcomes at 1 month. Although the crossover design in the present study allowed all athletes to serve as their own control, the extent to which improvements persisted over time could not be assessed because all athletes received both educational interventions. However, the observation that athletes exhibited a relative preference to CC over CDC is relevant given that research in other fields has demonstrated a relationship between enjoyment and behavior change.36–39
Additionally, recent work has demonstrated a moderating effect of educational enjoyment on concussion-reporting intention.28 Because every state mandates that its athletes receive concussion education, learners may be less excited about participation in the education.40 The role of educational enjoyment is likely an important factor in ensuring engagement and maximizing learning.28,41,42
There are several limitations to the present study, in addition to the aforementioned inability to track retention of changes inherent to the crossover design. The present study only measured constructs related to TPB, rather than true behavior change. Although changes in concussion-reporting intention has been estimated to account for 20% of concussion-reporting behavior,24 the clinical relevance of a specific change in intention to report concussions, assessed with a Likert scale, is uncertain. However, given estimates of >1 million unreported concussions,1,2,4 and the risk of prolonged recovery associated with improperly managed injuries,3,5,8,9 even a small improvement in concussion reporting would yield significant public health benefits. Participants may have also responded in a manner that they perceive is “preferred,” but their responses may not reflect true concussion-reporting intention.
Additionally, all participants were recruited from schools in a single region in the United States; this lack of geographical diversity may limit applicability given that athletic culture, attitudes, and beliefs exhibit significant regional variation. Additionally, all the athletes were male, and were football players, further limiting generalizability beyond these groups. Also, the number of demographical questions asked was limited, because the study required all participants to complete two concussion education programs (both CC and CDC) and three questionnaires (baseline, post-education 1, and post-education 2) in a single session, meaning that additional group differences could not be explored. As such, differences based on race, socioeconomic status, and other factors potentially relevant to concussion reporting could not be explored. However, the schools that athletes were recruited from represent a wide range of racial and socioeconomic diversity. Finally, both educational programs were video-based interventions; it is likely that mixing educational formats would have different results.
Conclusion
This study showed that implementing two different educational programs in tandem results in greater improvements in TPB constructs related to concussion reporting, as compared to a single education alone. Additionally, contrary to concerns of fatigue after participating in multiple educational interventions, athletes reported greater enjoyment and satisfaction with the concussion education they received after both interventions in tandem. Given the largely invisible nature of concussion manifestation and the important role of athlete reports in concussion identification, concussion education plays an important role in improving concussion self-reporting. Future studies evaluating the optimal timing, setting, duration, and other contextual factors for repeat concussion education are warranted.
Supplementary Material
Acknowledgments
Special thanks to: Coach Dick Gould, for his fearless leadership and determination to bring concussion education to the global sports community. In addition, thanks to the research team who made this study possible: Piper Acuff, Mikayla Brown, Angelina Lo, and Lea-Tereza Tenekedjieva.
Abbreviations Used
- ANOVA
analysis of variance
- CC
CrashCourse
- CDC
Centers for Disease Control and Prevention
- NFHS
National Federation of State High School Associations
- TBI
traumatic brain injury
- TPB
theory of planned behavior
Funding Information
This study was funded by the Taube Stanford Concussion Collaborative with Lucile Packard Children's Hospital Stanford. The funding agency was not involved with study design; the collection, analysis, and interpretation of data; the writing of the report; or the decision to submit the manuscript for publication.
Author Disclosure Statement
P.S. is founder and CEO for the non-profit, TeachAids, where she receives a salary of $1 per year. The following authors have a non-reimbursed relationship as medical advisors for CrashCourse: D.H.D., M.Y., R.D.P., S.G., G.A.G., J.G., and L.M.S. C.M.B. previously received funding from the NCAA as a graduate student research grant recipient, the Datalys Center for Sports Injury Research and Prevention as a graduate student research grant recipient, and through the Football Players' Health Study at Harvard, which is funded by the NFL Players' Association. R.C. is a paid consultant to the NFL Head Neck and Spine Committee, NOCSAE, Concussion Legacy Foundation, royalties from book publications, and compensation from expert legal opinion. He is a member of the Mackey-White Committee of the NFL Players Association. R.Z. serves on scientific advisory boards for Oxeia BioPharma, ElMIndA, and MYOMO; serves on the editorial board of Journal of Neurotrauma; receives publishing royalties for Brain Injury Medicine: Principles and Practice (Demos, 2013) and Physical Medicine and Rehabilitation—A Comprehensive Review (Oakstone); and receives research support from the NIH, NIDILRR, USARMC, and the Football Players Health Study at Harvard funded, in part, by the NFL Players' Association.
Supplementary Material
Cite this article as: Daneshvar, DH, Baugh, CM, Lama, RD, Yutsis, M, Pea, RD, Goldman, S, Grant, GA, Cantu, RC, Sanders, LM, Zafonte, RD, Hainline, B, and Sorcar, P (2021) Participating in two video concussion education programs sequentially improves concussion-reporting intention. Neurotrauma Reports 2:1, 581–591, DOI:10.1089/neur.2021.0033.
References
- 1. Bryan, M.A., Rowhani-Rahbar, A., Comstock, R.D., and Rivara, F., Seattle Sports Concussion Research Collaborative. (2016). Sports- and recreation-related concussions in US youth. Pediatrics 138, e20154635. [DOI] [PubMed] [Google Scholar]
- 2. Daneshvar, D.H., Nowinski, C.J., McKee, A., and Cantu, R.C. (2011). The epidemiology of sport-related concussion. Clin. Sports Med. 30, 1–17, vii. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Cover, R., Roiger, T., and Zwart, M.B. (2018). The lived experiences of retired collegiate athletes with a history of 1 or more concussions. J. Athl. Train. 53, 646–656. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Meehan, W.P., Mannix, R.C., O'Brien, M.J., and Collins, M.W. (2013). The prevalence of undiagnosed concussions in athletes. Clin. J. Sport Med. 23, 339–342. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Giza, C.C., and Hovda, D.A. (2014). The new neurometabolic cascade of concussion. Neurosurgery 75, Suppl. 4, S24–S33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. McCrea, M., Broglio, S., McAllister, T., Zhou, W., Zhao, S., Katz, B., Kudela, M., Harezlak, J., Nelson, L., Meier, T., Marshall, S.W., and Guskiewicz, K.M. (2020). Return to play and risk of repeat concussion in collegiate football players: comparative analysis from the NCAA Concussion Study (1999–2001) and CARE Consortium (2014–2017). Br. J. Sports Med. 54, 102–109. [DOI] [PubMed] [Google Scholar]
- 7. Guskiewicz, K.M., Weaver, N.L., Padua, D.A., and Garrett, W.E. (2000). Epidemiology of concussion in collegiate and high school football players. Am. J. Sports Med. 28, 643–650. [DOI] [PubMed] [Google Scholar]
- 8. Guskiewicz, K.M., McCrea, M., Marshall, S.W., Cantu, R.C., Randolph, C., Barr, W., Onate, J.A., and Kelly, J.P. (2003). Cumulative effects associated with recurrent concussion in collegiate football players: the NCAA Concussion Study. JAMA 290, 2549–2555. [DOI] [PubMed] [Google Scholar]
- 9. Harmon, K.G., Drezner, J.A., Gammons, M., Guskiewicz, K.M., Halstead, M., Herring, S.A., Kutcher, J.S., Pana, A., Putukian, M., and Roberts, W.O. (2013). American Medical Society for Sports Medicine position statement: concussion in sport. Br. J. Sports Med. 47, 15–26. [DOI] [PubMed] [Google Scholar]
- 10. Sabatino, M.J., Ccrp, Zynda, A.J., and Miller, S. (2018). Same-day return to play after pediatric athletes sustain concussions. Pediatrics 141, 203–203. [Google Scholar]
- 11. Bookbinder, H.A., Houston, M.N., Peck, K.Y., Habecker, S., Colsant, B.J., Kelly, T.F., Roach, S.P., Malvasi, S.R., McGinty, G.T., Campbell, D.E., Svoboda, S.J., and Cameron, K.L. (2020). Factors associated with delayed concussion reporting by United States service academy cadets. J. Athl. Train. 55, 843–849. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Register-Mihalik, J.K., Marshall, S.W., Kay, M.C., Kerr, Z.Y., Peck, K.Y., Houston, M.N., Linnan, L.A., Hennink-Kaminski, H., Gildner, P., Svoboda, S.J., and Cameron, K.L. (2020). Perceived social norms and concussion-disclosure behaviours among first-year NCAA student-athletes: implications for concussion prevention and education. Res. Sports Med. 29, 1–11. [DOI] [PubMed] [Google Scholar]
- 13. Daneshvar, D.H., Yutsis, M., Baugh, C.M., Pea, R.D., Goldman, S., Grant, G.A., Ghajar, J., Sanders, L.M., Chen, C., Tenekedjieva, L.-T., Gurrapu, S., Zafonte, R.D., and Sorcar, P. (2021). Evaluating the effect of concussion education programs on intent to report concussion in high school football. J. Athl. Train. 56, 1197–1208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Kroshus, E., and Baugh, C.M. (2016). Concussion education in U.S. collegiate sport: what is happening and what do athletes want? Health Educ. Behav. 43, 182–190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Kroshus, E., and Chrisman, S.P.D. (2019). A new game plan for concussion education. Health Educ. Behav. 46, 916–921. [DOI] [PubMed] [Google Scholar]
- 16. Kroshus, E., Cameron, K.L., Coatsworth, J.D., D'Lauro, C., Kim, E., Lee, K., Register-Mihalik, J.K., Milroy, J.J., Roetert, E.P., Schmidt, J.D., Silverman, R.D., Warmath, D., Wayment, H.A., and Hainline, B. (2020). Improving concussion education: consensus from the NCAA-Department of Defense Mind Matters Research & Education Grand Challenge. Br. J. Sports Med. 54, 1314–1320. [DOI] [PubMed] [Google Scholar]
- 17. Bagley, A.F., Daneshvar, D.H., Schanker, B.D., Zurakowski, D., d'Hemecourt, C.A., Nowinski, C.J., Cantu, R.C., and Goulet, K. (2012). Effectiveness of the SLICE program for youth concussion education. Clin. J. Sport Med. 22, 385–389. [DOI] [PubMed] [Google Scholar]
- 18. Hickling, A., Mallory, K.D., Wilson, K.E., Del Fernandes, R., Fuselli, P., Reed, N., Barnes, K., Cowle, S., Ellis, M.J., Hung, R., Hunt, A.W., Hutchison, M.G., Kawasoe, B., Kay, G., Kourtis, G., Kraetschmer, N., Kroshus, E., Louis, R., MacPhee, J., Markham, C., Provvidenza, C.F., Russell, K., Scratch, S.E., Sheps, G., Tanenbaum, B., Weiser, P., and Zemek, R.; Youth Concussion Awareness Network (You-CAN) Team. (2020). The Youth Concussion Awareness Network (You-CAN)—a school-based peer-led intervention to improve concussion reporting and social support: the protocol for a cluster randomized trial. BMC Public Health 20, 186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Kroshus, E., Baugh, C.M., Daneshvar, D.H., Nowinski, C.J., and Cantu, R.C. (2015). Concussion reporting intention: a valuable metric for predicting reporting behavior and evaluating concussion education. Clin. J. Sport Med. 25, 243–247. [DOI] [PubMed] [Google Scholar]
- 20. Register-Mihalik, J.K., Linnan, L.A., Marshall, S.W., Valovich McLeod, T.C., Mueller, F.O., and Guskiewicz, K.M. (2013). Using theory to understand high school aged athletes' intentions to report sport-related concussion: implications for concussion education initiatives. Brain Inj. 27, 878–886. [DOI] [PubMed] [Google Scholar]
- 21. Sullivan, L., Pursell, L., and Molcho, M. (2018). Evaluation of a theory-based concussion education program for secondary school student-athletes in Ireland. Health Educ. Res. 33, 492–504. [DOI] [PubMed] [Google Scholar]
- 22. Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes 50, 179–211. [Google Scholar]
- 23. Glanz, K., Rimer, B.K., and Viswanath, K. (eds). (2008). Health Behavior and Health Education: Theory, Research, and Practice. Jossey-Bass: San Francisco, CA. [Google Scholar]
- 24. Kroshus, E., Baugh, C.M., Daneshvar, D.H., and Viswanath, K. (2014). Understanding concussion reporting using a model based on the theory of planned behavior. J. Adolesc. Health 54, 269–274.e2. [DOI] [PubMed] [Google Scholar]
- 25. Register-Mihalik, J.K., Cameron, K.L., Kay, M.C., Kerr, Z.Y., Peck, K.Y., Houston, M.N., Linnan, L.A., Hennink-Kaminski, H., Gildner, P., Svoboda, S.J., and Marshall, S.W. (2019). Determinants of intention to disclose concussion symptoms in a population of U.S. military cadets. J. Sci. Med. Sport 22, 509–515. [DOI] [PubMed] [Google Scholar]
- 26. Schmidt, J.D., Weber, M.L., Suggs, D.W., Bierema, L., Miller, L.S., Reifsteck, F., Courson, R., Hoff, R., Dill, K., and Dunham, J. (2019). Improving concussion reporting across National College Athletic Association divisions using a theory-based, data-driven, multimedia concussion education intervention. J. Neurotrauma 37, 593–599. [DOI] [PubMed] [Google Scholar]
- 27. Audrit, H., Beauchamp, M.H., Tinawi, S., Laguë-Beauvais, M., and de Guise, E. (2020). Development and description of SAAM intervention: a brief, multidimensional and psycho-educational intervention for adults with mild traumatic brain injury. Ann. Phys. Rehabil. Med. 64, 101424. [DOI] [PubMed] [Google Scholar]
- 28. Daneshvar, D.H., Baugh, C.M., Yutsis, M., Pea, R.D., Goldman, S., Grant, G.A., Cantu, R.C., Sanders, L.M., Chen, C.L., Lama, R.D., Zafonte, R.D., and Sorcar, P. (2021). Athlete enjoyment of prior education moderates change in concussion-reporting intention after interactive education. Inquiry 58, 469580211022641. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. The National Federation of State High School Associations. (2018). Three Revised Online Courses, Including “Concussion in Sports,” Available for Free on NFHS Learning Center [cited 2021 Mar 26 ]. www.nfhs.org/articles/three-revised-online-courses-including-concussion-in-sports-available-for-free-on-nfhs-learning-center/ (Last accessed November 29, 2021).
- 30. TeachAids. (date unknown). CrashCourse free concussion education products. TeachAids: Palo Alto, CA. https://teachaids.org/for-concussions/products/ (Last accessed November 29, 2021).
- 31. The National Federation of State High School Associations. ([date unknown]). Concussion in Sports [cited 2021 Mar 26 ]. nfhslearn.com/courses/61151. (Last accessed November 29, 2021).
- 32. Kroshus, E., Garnett, B.R., Baugh, C.M., and Calzo, J.P. (2016). Engaging teammates in the promotion of concussion help seeking. Health Educ. Behav. 43, 442–451. [DOI] [PubMed] [Google Scholar]
- 33. Baugh, C.M., Meehan, W.P., Kroshus, E., McGuire, T.G., and Hatfield, L.A. (2019). College football players less likely to report concussions and other injuries with increased injury accumulation. J. Neurotrauma 36, 2065–2072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Bandura, A. (1989). Regulation of cognitive processes through perceived self-efficacy. Dev. Psychol. 25, 729–735. [Google Scholar]
- 35. Ennett, S.T., Tobler, N.S., Ringwalt, C.L., and Flewelling, R.L. (1994). How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations. Am. J. Public Health 84, 1394–1401. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Chao, C.-M. (2019). Factors determining the behavioral intention to use mobile learning: an application and extension of the UTAUT model. Front. Psychol. 10, 1652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Perski, O., Lumsden, J., Garnett, C., Blandford, A., West, R., and Michie, S. (2019). Assessing the psychometric properties of the digital behavior change intervention engagement scale in users of an app for reducing alcohol consumption: evaluation study. J. Med. Internet Res. 21, e16197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Takacs, Z.K., and Kassai, R. (2019). The efficacy of different interventions to foster children's executive function skills: a series of meta-analyses. Psychol. Bull. 145, 653–697. [DOI] [PubMed] [Google Scholar]
- 39. Tibubos, A.N., Rohrmann, S., and Ringeisen, T. (2019). How students learn to moderate group work: the role of enjoyment and boredom. J. Psychol. 153, 628–648. [DOI] [PubMed] [Google Scholar]
- 40. Concannon, L.G. (2016). Effects of legislation on sports-related concussion. Phys. Med. Rehabil. Clin. N. Am. 27, 513–527. [DOI] [PubMed] [Google Scholar]
- 41. Arakkal, A.T., Barón, A.E., Lamb, M.M., Fields, S.K., and Comstock, R.D. (2020). Evaluating the effectiveness of traumatic brain injury state laws among high school athletes. Inj. Epidemiol. 7, 12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Sullivan, L., Harvey, H.H., Smith, G.A., and Yang, J. (2020). Putting policy into practice: school-level compliance with and implementation of state concussion laws. J. Public Health Manag. Pract. 26, Suppl. 2, S84–S92. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.



