International Olympic Committee (IOC) Sport Mental Health Assessment Tool 1 (SMHAT-1) and Sport Mental Health Recognition Tool 1 (SMHRT-1): towards better support of athletes’ mental health

Abstract

Objectives

To develop an assessment and recognition tool to identify elite athletes at risk for mental health symptoms and disorders.

Methods

We conducted narrative and systematic reviews about mental health symptoms and disorders in active and former elite athletes. The views of active and former elite athletes (N=360) on mental health symptoms in elite sports were retrieved through an electronic questionnaire. Our group identified the objective(s), target group(s) and approach of the mental health tools. For the assessment tool, we undertook a modified Delphi consensus process and used existing validated screening instruments. Both tools were compiled during two 2-day meeting. We also explored the appropriateness and preliminary reliability and validity of the assessment tool.

Sport Mental Health Assessment Tool 1 and Sport Mental Health Recognition Tool 1

The International Olympic Committee Sport Mental Health Assessment Tool 1 (SMHAT-1) was developed for sports medicine physicians and other licensed/registered health professionals to assess elite athletes (defined as professional, Olympic, Paralympic or collegiate level; aged 16 years and older) potentially at risk for or already experiencing mental health symptoms and disorders. The SMHAT-1 consists of: (i) triage with an athlete-specific screening tool, (ii) six subsequent disorder-specific screening tools and (iii) a clinical assessment (and related management) by a sports medicine physician or licensed/registered mental health professional (eg, psychiatrist and psychologist). The International Olympic Committee Sport Mental Health Recognition Tool 1 (SMHRT-1) was developed for athletes and their entourage (eg, friends, fellow athletes, family and coaches).

Conclusion

The SMHAT-1 and SMHRT-1 enable that mental health symptoms and disorders in elite athletes are recognised earlier than they otherwise would. These tools should facilitate the timely referral of those athletes in need for appropriate support and treatment.

Introduction

Mental health symptoms and disorders include those involving anxiety, depression or substance misuse.¹ Their prevalence in elite athletes is substantial, and similar to their prevalence in the general population. It ranges from 19% for alcohol misuse to 34% for anxiety/depression for active elite athletes and from 16% for distress to 26% for anxiety/depression for former elite athletes.¹ During an elite sport career, generic and sport-specific stressors might increase the risk of mental health symptoms and disorders.^2–4 Adverse life events, severe musculoskeletal injuries and related surgeries with long recovery periods are associated with mental health symptoms and disorders.^2–4 Transitioning out of elite sport is also difficult for many former athletes.^2–4

In 2017, the International Olympic Committee (IOC) selected an international expert panel comprising 27 individuals to thoroughly review the available scientific literature regarding mental health symptoms and disorders among active and former elite athletes (professional, Olympic or collegiate level). These 27 experts were invited by the IOC to a 2.5-day consensus meeting in November 2018 in Lausanne, Switzerland. Scientific and clinical findings were presented and discussed, ultimately leading to the International Olympic Committee consensus statement on mental health in elite athletes.⁵ One of the main recommendations embedded in the IOC consensus statement was the need to appropriately screen for mental health symptoms and disorders in elite athletes throughout their career to ensure that affected athletes ultimately receive the support and treatment they need.⁵ Following the consensus meeting, the IOC established the Mental Health Working Group (MHWG) with 11 international experts (10 of whom were involved in the IOC consensus statement) aiming in part to develop an assessment and recognition tool for the early identification of elite athletes potentially at risk for experiencing mental health symptoms and disorders. This article describes the evidence-based and practice-based development of the tools. It also presents the preliminary reliability and validity, utility and feasibility of the assessment tool.

Methods

We applied the Intervention Mapping and Knowledge Transfer Scheme to develop the assessment and recognition tool.^6–10 We undertook the following steps: (A) reviewing the scientific literature on mental health symptoms and disorders in elite athletes; (B) assessing the views of active and former elite athletes (inclusive of members of the athletes’ entourage) regarding mental health symptoms and disorders; (C) formulating the objective(s), target group(s) and approach of the tools; (D) selecting the content of the tools and their development; and (E) assessing the appropriateness and preliminary reliability and validity of the assessment tool.

Step A: Review of the scientific literature

Authors of the IOC consensus statement conducted narrative and systematic reviews regarding the prevalence, diagnosis, screening, treatment and management of mental health symptoms and disorders in elite sports. Search strategies were applied in relevant electronic databases (eg, PubMed, SportDiscus, PSycINFO, Scopus and Cochrane) for articles published in November 2018, utilising predefined eligibility criteria. Data from the included articles were extracted within standardised extraction forms and risk of bias of the included studies was described. When applicable, meta-analyses were performed, and pooled estimates were calculated.

Step B: Views of active and former elite athletes (including members of the athletes’ entourage)

We gathered the views of active and former elite athletes, inclusive of their entourage, on concepts related to mental health symptoms and disorders in elite athletes via a short electronic questionnaire (Mentimeter, Stockholm, Sweden) at (i) the IOC International Athletes’ Forum (April 2019, Lausanne, Switzerland) and (ii) the International Paralympic Committee’s Athletes’ Forum (November 2019, Colorado Springs, USA). The attendees (N=360) were either (i) active and former elite athletes (as members of National Olympic Committee and National Paralympic Committee athletes’ commissions), (ii) coaches in elite sports or (iii) representatives of sport governing bodies. The IOC MHWG submitted six questions and statements in English (sole language of these forums) to the audience as follows:

1. What is the first word that comes to your mind when you hear the words ‘mental health symptoms’?

2. Which is the first group you turn to when you feel low?

3. Who is most important to the protection of athletes’ mental health?

4. In elite sports, no one wants to talk about mental health problems (scored on 5-point scale, from ‘strongly disagree’ to ‘strongly agree’).

5. There is no recognition of mental health problems in my sport (scored on 5-point scale, from ‘strongly disagree’ to ‘Strongly agree’).

6. There should be routine screenings for mental health problems by medical staff in my sport (‘yes’ or ‘no’).

The IOC Medical and Scientific Committee provided institutional approval. Descriptive analyses (frequency) were conducted with the answers to these questions and statements.

Step C: Objective(s), target group(s) and approach

During a 2-day meeting of the IOC MHWG in April 2019 in Lausanne (Switzerland), we defined the objective(s), target group(s) and approach of the tools. Participants of the meeting were international experts with specialised training, skills and experience in a wide range of relevant domains, including but not limited to psychiatry, sports medicine, psychometrics and elite sport itself. We combined the information gathered from the scientific literature (step A) with the view of elite athletes and their entourage (step B), and relied on existing mental health screening and awareness tools used in sports for other domains such as concussion, harassment and abuse and relative energy deficiency in sport.^11–13

Step D: Content and development

We selected the content and design of the tools during two 2-day meeting of the IOC MHWG held in Lausanne (Switzerland) in April and June 2019 (see step C). First, we considered the reproducibility, validity, practicality (ie, assessment time), use and applicability of existing screening instruments in the context of elite sports. Next, 15 independent experts gauged the appropriateness of the selected existing screening instruments through an expert rating process (ethical approval provided by the University of Washington’s Institutional Review Board). These experts were either (1) authors of the International Olympic Committee consensus statement on mental health in elite athletes and related specific narrative and systematic reviews of the scientific literature (see step A) or (2) licensed mental health professionals who are members of the Big Sky Sport Psychology Group and/or the Collegiate Clinical/Counselling Sport Psychology Association. Via an anonymous online survey, these experts were asked to indicate the extent to which they disagreed or agreed with the selection of the screening instruments on a 5-point Likert scale (from ‘1’ as ‘strongly disagree’ to ‘5’ as ‘strongly agree’).

Next, we conducted a modified Delphi consensus process to evaluate a provisional version of the assessment tool (ethical approval provided by the University of Washington’s Institutional Review Board).^14–19 Via an anonymous online survey, the experts were asked to provide quantitative and qualitative feedback on the seven components in this provisional version (introductory text and the six components labelled as ‘Action’). The online survey contained an embedded screenshot of the specific tool component on which feedback was being elicited, followed by two questions: (i) how clinically useful is the specific component and (ii) how feasible is the specific component for its application in elite sport settings. Each question was scored on a 9-point scale (from ‘1’ for ‘not useful/feasible’ to ‘9’ for ‘extremely useful/feasible’) with the opportunity for open-ended written feedback.²⁰ Descriptive statistics for both questions were calculated for each specific tool component, and open-ended feedback was compiled. A priori thresholds for component-level consensus were set as (1) mean score of greater than 7, (2) at least 70% of respondents with a score of greater than 7 and (3) a coefficient of variation (CV) of less than 0.50.^20–22 The IOC MHWG and Delphi process facilitator (EK) reviewed and synthetised the results of the first round of Delphi voting, including reviewing open-ended participant comments to identify emergent themes related to lack of participant-rated utility or feasibility.²³

Tool components meeting a priori thresholds for both usefulness and feasibility were not modified. Tool components not reaching numeric consensus thresholds were discussed, with a focus on themes emergent from the qualitative participant feedback.²⁴ Following modifications, these steps were repeated.

Step E: Appropriateness and preliminary reliability and validity

We explored (i) the appropriateness of the assessment tool among sport medicine physicians and (ii) its preliminary reliability and validity among professional footballers.

Sport medicine physicians (N=43) participating in the International Federations Medical Commission Chairpersons Meeting (March 2020, Monaco; institutional approval provided by the IOC Medical and Scientific Committee) were asked to assess the appropriateness of the assessment tool following application to two hypothetical cases. Their evaluation was collected electronically (Mentimeter, Stockholm, Sweden) through eight statements (eg, ‘The tool will be useful for health professionals working in the context of elite sports’) rated on a 4-point scale (strongly disagree, disagree, agree and strongly agree). Participants also provided qualitative feedback.

The preliminary reliability and validity of the screening instruments selected for the assessment tool were evaluated through an observational study based on a cross-sectional design conducted among male-identified and female-identified professional footballers from Australian A-League and W-League (ethical approval provided by the Medical Ethics Review Committee of the Amsterdam University Medical Centers, location AMC; W18_340#18.387). Participants (men: N=149, mean age: 24 years, mean career duration: 6 years; women: N=132, mean age: 23 years, mean career duration: 5 years) were asked to complete the screening instruments for the tool, in addition to the validated Kessler Distress questionnaire (K10).²⁵ Internal consistency (degree of inter-relatedness among items) of each screening instrument was ascertained, being expressed with Cronbach’s alpha (α≥0.70 considered as good; 0.60 < α<0.70 considered as moderate; r≤0.59 considered as low and thresholds lower with fewer items).²⁶ When applicable, convergent validity with K10 was calculated and expressed with Pearson correlation coefficients (r≥0.60 considered as good; 0.60<r < 0.30 considered as moderate and r≤0.30 considered as low) while a series of area under receiver operating characteristic curves was undertaken to evaluate the existing cut-off scores relative to the K10 cut-off scores for moderate distress (K10 ≥16), high distress (K10 ≥22) and very high distress (K10 ≥30) separately (AUC ≥0.90 considered as very good; AUC ≥0.80 considered as good and AUC ≥0.70 considered as fair).^{26 27} Analysis of misclassification (false negative rate) between selected screening instruments was also undertaken.

Patient and public involvement

Active and former elite athletes, inclusive of their entourage (eg, athletes’ representatives, coaches, representatives of governing bodies and sports medicine physicians), were involved in developing the tool and assessing its validation and appropriateness.

Results

Step A: Reviewing the scientific literature

In total, 14 689 citations were identified and screened by the international experts, leading ultimately to the International Olympic Committee consensus statement on mental health in elite athletes and 11 related publications.1 5 28–37 All available evidence was published in two issues of the British Journal of Sports Medicine.

Step B: View of active and former elite athletes (including entourage)

The participants in the IOC International Athletes’ Forum associated a wide range of words with the term ‘mental health symptoms’ (figure 1). Nearly 55% of respondents mentioned the word ‘depression’, 33% the word ‘stress’, and 20% the words ‘anxiety’ or ‘pressure’. They reported that they would approach friends and fellow athletes (50%), family (40%) and coaches (8%) when experiencing mental health symptoms. Participants identified coaches (55%), parents and friends (25%) and medical team (9%) as important facilitators of athletes’ mental health. Nearly two-thirds of the participants agreed that talking about mental health symptoms was taboo in elite sports and that there was no recognition of these symptoms in their sport. Ninety per cent were in favour of routine screenings by the medical team for mental health symptoms in their sport.

Figure 1.

Word cloud of the view of athletes (including entourage) about mental health symptoms.

Step C: Objective(s), target group(s) and approach

Based on steps A and B, the IOC MHWG formulated the following objective for the assessment tool: to assess elite athletes (defined as professional, Olympic, Paralympic or collegiate level; aged 16 years and older) potentially at risk for (ie, exposed to one or more stressors), or already experiencing, mental health symptoms and disorders to facilitate timely management and/or referral to adequate support and/or treatment. We established that the assessment tool should be used only by sports medicine physicians and other licensed/registered health professionals, and we defined a three-step approach (step 1: triage; step 2: screening and step 3: intervention and (re)assessment).

Step D: Content and development

We selected an existing validated screening instrument (available freely in the public domain) for the triage step (step 1) and six existing validated screening instruments (available freely in the public domain), related to the most prevalent mental health symptoms in elite sports, for the screening step (step 2).^{1 5} Combined with a final section on intervention and r(e)assessment (step 3), we developed a provisional version of the assessment tool called the IOC Sport Mental Health Assessment Tool (SMHAT).

Each of the screening tools included in the SMHAT were rated as ‘appropriate’ or ‘very appropriate’ (scores of 4 or 5 on a 5-point scale) by more than 73% of experts, and five of the seven had mean scores of >4.00. The two lowest scoring scales were athlete distress, as measured by the Athlete Psychological Strain Questionnaire (APSQ: mean=3.80, SD=1.15, 73% ‘appropriate’ or ‘very appropriate’), and depression, as measured by the Patient Health Questionnaire-9 (PHQ-9) (mean=3.93, SD=1.33, 80% ‘appropriate’ or ‘very appropriate’). Despite the expressed concerns about the APSQ’s sensitivity and specificity in identifying athletes who require further screening, the IOC MHWG elected to retain this measure because evidence about the APSQ’s psychometrics was imminently to be published.^{37 38} Concern was also expressed about the utility of the PHQ-9 to measure more subtle subclinical issues. The IOC MHWG elected to retain the PHQ-9 because it is one of the commonly used instruments in the context of elite sports which has been validated across different cultures and languages.

In the first round of the Delphi consensus process, one component that did not meet a priori thresholds for both utility and feasibility was ‘step 3b’ (clinical assessment and management, mean utility score=6.87, SD=2.23, 67%>7, CV=32.50; mean feasibility score=6.93, SD=1.28, 73%>7, CV=18.46). There were concerns about the required expertise for this step. No alteration to this component was made because the IOC MHWG strongly believed that sport medicine physicians working with elite athletes should have sufficient competency to conduct a clinical assessment and define a management plan. Two other components did not meet thresholds for consensus feasibility. The introduction (mean=6.60, SD=1.40, 53%>7, CV=21.27) was described as being too long and difficult to read in the context of clinical practice. In response, the IOC MHWG edited this section to streamline and facilitate understanding. Concerns were also expressed about the additional screening tools for mental health symptoms and disorders (mean=6.60, SD=2.03, 67%>7, CV=30.73). The IOC MHWG elected to not change this section because these additional screening tools are not mandatory and are only suggestions for clinicians to consider.

The revised SMHAT was shared with the same pool of experts for an additional round of rating on the two edited components. Utility and feasibility of the edited introduction exceeded consensus thresholds. Utility of step 3b (clinical assessment and management) also exceeded consensus thresholds (mean=8.14, SD=1.21, 85.71%>7, CV=14.92), while feasibility did not exceed the threshold (mean=6.71, SD=2.06, 71.43%>7, CV=30.66). Feasibility concerns for this section continued to relate to the level of training of the person making this assessment. The IOC MHWG elected to leave this component unaltered, in recognition of the challenge of having access to licensed mental health professionals in sport settings.⁵ Another consideration is that we developed a separate tool to facilitate recognition and triage of mental health concerns for use by non-clinical personnel.

The Sport Mental Health Assessment Tool 1

Based on three steps (figure 2), the SMHAT-1 (first version; intended to be updated in the future) allows for early stage identification of those athletes in need of mental health treatment. The SMHAT-1 can be used by sports medicine physicians and other licensed/registered health professionals, but the clinical assessment (and related management) within the SMHAT-1 (see step 3b) must be conducted by sport medicine physicians and/or licensed/registered mental health professionals, including clinically trained sport psychologists. Physical therapists, athletic trainers and not clinically trained sport psychologists working with a sports medicine physician can use the SMHAT-1, but any guidance or intervention should remain the responsibility of their sports medicine physician.

Figure 2.

Flow chart of the International Olympic Committee Sport Mental Health Assessment Tool 1.

Step 1: triage

The APSQ assesses sport-related psychological distress and is used for a first triage.³⁸ The APSQ is a brief, self-report rating scale specific to the sport context and relying on 10 items (eg, ‘During the past 4 weeks, I could not stop worrying about injury or my performance’) scored on a 5-point scale (from ‘none of the time’ (1) to ‘all of the time’ (5)).³⁷ A total score ranging from 10 to 50 is calculated by summing the answers on the 10 items, with a score of 17 or more indicating an elevated or high risk for psychological distress.^{38 39} The APSQ has been validated in male and female athletes (area under curve value >0.90).^{38 39} In case of a negative triage, no further action is needed, while a positive triage leads to the subsequent step (step 2: Screening).

Step 2: screening

In case of a positive triage, athletes proceed to step 2 and are assessed on six disorder-specific screening questionnaires:

• General Anxiety Disorder-7 (GAD-7): assesses the presence of symptoms of anxiety.⁴⁰

• Patient Health Questionnaire-9 (PHQ-9): assesses the presence of symptoms of depression.^{41 42}

• Athlete Sleep Screening Questionnaire (ASSQ): assesses the presence of sleep disturbance.^43–45

• Alcohol Use Disorders Identification Test Consumption (AUDIT-C): assesses the presence of alcohol misuse.^46–48

• Cutting Down, Annoyance by Criticism, Guilty Feeling, and Eye-openers Adapted to Include Drugs (CAGE-AID): assesses the presence of substance misuse, being slightly adapted for the SMHAT (no focus on alcohol use as already explored with the AUDIT-C; additional question to explore which substance was used).^49–54

• Brief Eating Disorder in Athletes Questionnaire (BEDA-Q): assesses the presence of disordered eating.⁵⁵

Further information about these existing validated screening questionnaires (including psychometric properties) is presented in online supplementary material. If all screening questionnaires are negative, the administrator proceeds to step 3a (brief intervention and monitoring, given the report of elevated psychological distress at step 1: triage). If one or more screening questionnaires are positive (or if a positive answer is given on item 9 of the PHQ-9), the administrator proceeds to step 3b (clinical assessment and management).

Step 3a: brief intervention and monitoring

Based on the athlete’s history/record and on the information provided in steps 1 and 2, the administrator might refer the athlete to a brief intervention such as psychoeducation, mindfulness, meditation, mental skills training or stress control. Depending on the progress of the athlete and after the completion of the brief intervention(s), the administrator should consider readministering the APSQ. In the case of a negative APSQ, no further action is needed, while another positive APSQ leads to step 3b (assessment and management).

Step 3b: clinical assessment and management

Considering the previous outcomes (steps 1 and 2), a comprehensive clinical assessment is conducted by a sport medicine physician and/or licensed/registered mental health professional (eg, psychiatrist and clinical psychologist) to obtain additional relevant information (eg, mental health history, history of and/or presence of harassment/abuse within or outside of sports) and ultimately to identify a clinical diagnosis. For each of these diagnoses, severity and complexity, as well as diagnostic uncertainty and previous treatment non-response, are assessed. If the sports medicine physician does not feel comfortable determining the severity and/or complexity of a given athlete’s diagnosis, then referral to a licensed/registered mental health professional may be made. Based on all available information, the sport medicine physician and/or licensed/registered mental health professional chooses one of the following three actions:

1. In cases that are neither severe nor complex and where there is no diagnostic uncertainty nor history of previous non-responsive to treatment, then treatment/support can be provided by a sports medicine/primary care physician. The physician should refer to the International Olympic Committee consensus statement on mental health in elite athletes for specific guidance on treatment modalities.⁵

2. In cases of diagnostic uncertainty or when further information might be useful, additional screening questionnaires for other mental health symptoms and disorders, including but not limited to attention-deficit/hyperactivity disorder, bipolar disorder, post-traumatic stress disorder, gambling disorder and/or psychosis, can be considered prior to definitive diagnosis and the creation of a management/intervention plan.^56–66

3. In cases that are severe, complex, diagnostically uncertain even after additional screening is completed and/or non-responsive to treatment, we recommend referral of the athlete to a licensed/registered mental health professional (eg, clinical psychologist or psychiatrist).

The SMHAT-1 should be embedded within the precompetition period (ie, ideally a few weeks after the start of sport training), as well as within the mid-season and end-season period. The SMHAT-1 can also be used when the athlete experiences any significant life event such as major injury/illness, surgery, unexplained performance concern, suspected harassment/abuse, after a major competition, at the end of a competitive cycle, or when transitioning out of sport. The SMHAT-1 is available as a paper version (online supplementary appendix); however, the triage and screening (steps 1 and 2) are designed to be ideally embedded in a privacy-secured online platform. The SMHAT-1 can be freely copied in its current form for distribution to individuals, teams, groups and organisations. Any revision requires the approval by the IOC MHWG. To strengthen its multicultural use, we encourage the translation of the SMHAT-1 in collaboration with the IOC MHWG. The SMHAT-1 should not be re-branded or sold for commercial gain.

The Sport Mental Health Recognition Tool 1

Since the athletes’ entourage (eg, friends, fellow athletes, family and coaches) were identified as essential supports for athletes mental health (see step 3b), the IOC MHWG developed the IOC Sport Mental Health Recognition Tool 1 (SMHRT-1, first version; intended to be updated in the future), a recognition tool to be used by athletes coaches, family members and all other members of the athlete’s entourage. The objective of the SMHRT-1 is to facilitate early detection of mental health symptoms in elite athletes (professional, Olympic, Paralympic or collegiate level; aged 16 years and older) to promote help-seeking for those athletes in need of assistance from a sports medicine physician or other licensed/registered health professional and to facilitate further assessment and subsequent treatment as applicable.

The SMHRT-1 relies on the observation of significant and/or persistent thoughts, feelings, behaviours and/or physical changes in athletes. In cases where those are observed, the athletes should be directed to a sports medicine physician or licensed/registered health professional for mental health screening with the SMHAT-1. Within the SMHRT-1, several items constituting red flags were also identified (eg, comments related to harming self or others), which warrant immediate help-seeking and possible crisis management. The SMHRT-1 is available in paper format (online supplementary appendix) and can be freely copied in its current form for distribution to individuals, teams, groups and organisations. Any revision requires the specific approval by the IOC MHWG while any translation should be reported to the IOC MHWG. The SMHRT-1 should not be rebranded or sold for commercial gain.

Step E: Appropriateness and preliminary reliability and validity

More than 90% of participants in the International Federations Medical Commission Chairpersons Meeting agreed that the SMHAT-1 would be useful for sports medicine physicians and other licensed/registered health professionals working in the context of elite sports. Around 55% of respondents were positive about the ease of use of the SMHAT-1, mentioning especially that translation in different languages is needed. Nearly 90% stated that the three-step approach of the SMHAT-1 was appropriate, while each single step was also assessed positively: 93% for step 1 (triage); 100% for step 2 (screening); 85% for step 3a (brief intervention); 83% for step 3b (clinical assessment); 63% for additional screening in step 3b.

Internal consistency was moderate to good for the APSQ (men: α=0.81; women: α=0.84), GAD-7 (men: α=0.91; women: α=0.88), PHQ-9 (men: α=0.87; women: α=0.83), ASSQ (men: α=0.72; women: α=0.67), AUDIT-C (men: α=0.74; women: α=0.66) and CAGE-AID (men: α=0.69; women: α=0.66). Internal consistency was low for the BEDA-Q (men: α=0.59; women: α=0.66). Convergent validity between APSQ and K10 was good to very good in both male-identified and female-identified professional footballers (r=0.70–0.73, p<0.01; AUC=0.87–0.96, p<0.01). The APSQ applied at step 1 (triage) identified 57.1% (N=160) of the sample requiring progression to step 2 (screening). Overall, the APSQ performed well in case detection for the six screening instruments at step 2 (table 1). The APSQ correctly detected all positive screened cases for the GAD-7, PHQ-9 and CAGE-AID, while only a small proportion of cases was misclassified for the AASQ (5%), AUDIT-C (16%) and BEDA-Q (11%).

Table 1.

Misclassification of the APSQ at step 1 (triage) for six instruments at step 2 (screening)

	Positive cases detected at step 1 (APSQ) and at step 2	Positive cases not detected at step 1 (APSQ) but detected at step 2
GAD-7	N=18 (6%)	N=0 (0%)
PHQ-9	N=24 (9%)	N=0 (0%)
ASSQ	N=61 (22%)	N=14 (5%)
AUDIT-C	N=88 (32%)	N=44 (16%)
CAGE-AID	N=5 (2%)	N=0 (0%)
BEDA-Q	N=77 (28%)	N=32 (11%)

APSQ, Athlete Psychological Strain Questionnaire; ASSQ, Athlete Sleep Screening Questionnaire; AUDIT-C, Alcohol Use Disorders Identification Test Consumption; BEDA-Q, Brief Eating Disorder in Athletes Questionnaire; CAGE-AID, Cutting Down, Annoyance by Criticism, Guilty Feeling, and Eye-openers Adapted to Include Drugs; GAD-7, General Anxiety Disorder-7; N, number; PHQ-9, Patient Health Questionnaire-9.

Discussion

In response to a recommendation of the International Olympic Committee consensus statement on mental health in elite athletes, the SMHAT-1 and SMHRT-1 were developed to provide tools to assess and manage mental health symptoms and disorders in elite athletes throughout their sporting career. For the SMHAT-1, the IOC MHWG strived to select existing validated screening questionnaires for mental health symptoms and disorders that were developed for and validated in an (elite) athlete population. However, such questionnaires are rather scarce. Within the SMHAT-1, only 3 out of the 12 screening questionnaires are athlete-specific. One of them is the APSQ, which is used as triage to assess sport-related psychological distress.^{38 39} The APSQ was recently developed for and validated in professional athletes, focusing particularly on the sport environment. Therefore, it is possible that mental health symptoms and disorders that manifest outside the sport environment might not be captured with this questionnaire. Another screening questionnaire developed for and validated in an (elite) athlete population is the BEDA-Q, which assesses the presence of disordered eating.⁵⁵ However, the BEDA-Q has no established cut-off, and therefore the authors proposed a cut-off of 4 or more based on the data presented in this article. It is important to emphasise that a positive screening on any disorder-specific screening questionnaires does not automatically provide a diagnosis for the disorder, but it is a prompt for further clinical evaluation. For the other screening questionnaires that were developed for and validated in non-athlete populations, their psychometric properties (especially sensitivity and specificity) might differ when used in an (elite) athlete population.

The SMHAT-1 and SMHRT-1 are the first versions of the tools to identify elite athletes at risk for experiencing mental health symptoms and disorders. Analogous to sport concussion and its assessment (SCAT) and recognition (CRT) tools,¹¹ the IOC MHWG intends to revise the SMHAT-1 and SMHRT-1 in the future as needed, concurrent with an anticipated updating of the International Olympic Committee consensus statement on mental health in elite athletes. Until then, the IOC MHWG recommends further validation of the SMHAT-1’s underlying screening questionnaires, and the analysis of practicality and utility in a variety of elite athlete populations across different sports and countries.

The SMHAT-1 should be part of a regular screening programme, in parallel with, for example, musculoskeletal and cardiovascular screening. As the use of the SMHAT-1 is likely to increase the number of referrals, it is important to have sport-specific mental health supports in place for the care of athletes. We strongly recommend collaboration between sport medicine physicians and mental health professionals (eg, psychologists and psychiatrists). Furthermore, education about mental health symptoms and disorders in elite athletes as well as the use of the SMHAT-1 has been developed by the IOC to improve the clinical competency of sports medicine physicians and other licensed/registered health professionals. Ideally this education should be embedded within their respective professional school curricula. For all other members of the athletes’ entourage, the SMHRT-1 can be used to increase focus on the mental health of elite athletes.

Several limitations of our approach should be acknowledged. First, information gathered through questionnaires in the SMHAT-1 remains self- reported and thus its external validity depends on the accuracy of the respondent’s answers. Second, some of the existing validated screening questionnaires selected for the SMHAT-1 were developed for and validated in non-athlete populations. Third, the triage step in the SMHAT-1 relies on the APSQ. While this questionnaire includes athlete-specific questions within an athletic context and has been validated in several populations of elite athletes, the APSQ (as most other existing screening instruments) does not reach 100% sensitivity and 100% specificity. This implies the possibility of obtaining false negatives and false positives in the triage step of the SMHAT-1. Fourth, the SMHAT-1 should be used by sports medicine physicians and other licensed/registered health professionals, while subsequent referral to a clinical psychologist or psychiatrist in particular cases is advised. In some countries, such a referral might not always be possible. Fifth, the SMHAT-1 and SMHRT-1 are currently available only in English. Translations (and related validation studies) should be made available in the future, which aligns with the ambition of the IOC. Lastly, the SMHAT-1 was preliminarily validated among professional footballers (men and women) from one country. Future validation studies should be conducted among athletes from other sport disciplines and cultures, while the use and application of the SMHAT-1 longitudinally should be evaluated. This is the intention of the IOC and its MHWG.

Conclusion

Following the International Olympic Committee consensus statement on mental health in elite athletes, we developed the SMHAT-1 and SMHRT-1 to identify elite athletes at risk for or already experiencing mental health symptoms and/or disorders. These tools should facilitate the timely referral of those athletes in need for appropriate support and treatment. This initiative aligns with the IOC’s commitment to improve the mental health of elite athletes.

What are the findings?

• The International Olympic Committee Sport Mental Health Assessment Tool 1 (IOC SMHAT-1) was developed to identify elite athletes at risk for or already experiencing mental health symptoms and disorders, to facilitate timely referral of those in need to adequate support and treatment.

• IOC SMHAT-1 should be used by sports medicine physicians and other licensed/registered health professionals during the precompetition period (ie, ideally a few weeks after the start of sport training) and when any significant event for an athlete occurs (eg, major injury/illness, unexplained performance concern, end of competitive cycle, suspected harassment/abuse, adverse life event and transitioning out of sport).

• The IOC Sport Mental Health Recognition Tool 1 was developed for athletes, coaches, family members and all other members of the athlete’s entourage to facilitate early detection of mental health symptoms in athletes to promote help-seeking for those in need.

How might it impact on clinical practice in the future?

• The use of the SMHAT-1 by licensed/registered health professionals (especially sports medicine physicians) and the SMHRT-1 by athletes and all members of their entourage should enable the identification of elite athletes at risk for experiencing mental health symptoms and disorders and facilitate the timely referral of those athletes in need for appropriate support and treatment.