Abstract
Introduction:
The Road to Mental Readiness (R2MR) Mental Health Continuum Model (MHCM) is a mental health self-monitoring tool that allows individuals to self-map their mental health status on six domains using descriptors ranging in severity from healthy to reacting, injured, ill. The goals were to improve the validity of this tool by adding sub-domain descriptors from each domain (Study 1) and assessing whether the addition of these sub-domain descriptors to the domain descriptors resulted in more accurate self-mapping along the MHCM (Study 2).
Methods:
In Study 1, 159 Regular Force members completed a matching task in which they were presented with descriptors and asked to select the MHCM anchor that each belonged to. In Study 2, 274 Regular Force members completed several validated scales and mapped themselves on the MHCM using the descriptors selected in Study 1.
Results:
In Study 1, subsets of sub-domain descriptors were selected that optimized the accuracy mapping scores for all domains and most anchor categories. In Study 2, the addition of sub-domain descriptors enhanced the validity of the MHCM tool for all domains and was associated with the highest correlations with validated scales; most coefficients exceeded concurrent validity thresholds.
Discussion:
These findings provide initial support for the enhanced validity of a MHCM tool that should allow military members to better identify changes in their mental health status.
Key words: mental health, military members, mobile applications, resilience, self-assessment
Lay Summary
Two studies were completed to provide an initial enhancement to the Road to Mental Readiness program’s Mental Health Continuum Model, a tool that helps military members to better understand, and detect changes in, their mental health and that more appropriately guides individuals to take the relevant action to address mental health concerns.
Abstract
Introduction :
Le modèle de continuum de la santé mentale (MCSM) En route vers la préparation mentale est un outil d’autoévaluation de la santé mentale qui permet d’autoévaluer la santé mentale en six domaines à l’aide de descripteurs dont la gravité varie entre en santé, en réaction, blessé, malade. L’objectif de cette étude consistait à améliorer la validité de cet outil par l’ajout de descripteurs de sous-domaines pour chacun des domaines (étude 1) et à évaluer si cet ajout permettait d’obtenir une autoévaluation plus précise selon le MCSM (étude 2).
Méthodologie :
Dans l’étude 1, 159 membres des Forces régulières ont effectué une tâche d’appariement au cours de laquelle on leur a présenté des descripteurs et on les a invités à sélectionner le volet du MCSM auquel chacun appartenait. Dans l’étude 2, 274 membres des Forces régulières ont rempli plusieurs échelles validées et se sont placés dans le MCSM au moyen des descripteurs sélectionnés dans l’étude 1.
Résultats :
Dans l’étude 1, des sous-échelles des descripteurs de sous-domaines ont été sélectionnées afin d’optimiser la précision des scores d’analyse pour tous les domaines et la plupart des volets. Dans l’étude 2, l’ajout de descripteurs de sous-domaines, qui a accru la validité de l’outil de MCSM dans tous les domaines, était associé aux meilleures corrélations à des échelles validées; la plupart des coefficients dépassaient les seuils de validité concomitants.
Discussion :
Ces résultats procurent une première corrélation de la validité accrue d’un outil de MCSM qui devrait permettre aux membres militaires de mieux détecter les modifications à leur santé mentale.
Mots-clés : applications mobiles, autoévaluation, membres militaires, santé mentale, résilience
Introduction
Mental health training in the Canadian Armed Forces: the Road to Mental Readiness program
The mental health of Canadian Armed Forces (CAF) personnel is critical to their operational readiness.1 Relative to the general Canadian population, military members are at higher risk for the development of certain psychological disorders, and the nature of their work increases their risk for exposure to traumatizing and morally injurious events.2 The CAF has provided various programs and services focused on both the prevention and the treatment of mental health issues, including the Road to Mental Readiness (R2MR), an evidence-informed comprehensive mental health training and education program that has been effective in increasing mental health literacy and knowledge of mental skills and coping strategies and in improving attitudes toward care seeking and stigma reduction.3–6 In line with evidence suggesting that repeated application and practice of skills in the training environment improves retention and effectiveness,7,8 R2MR has developed tools to support the continued application of mental skills beyond the classroom, including a self-monitoring tool called the Mental Health Continuum Model (MHCM).
The MHCM was developed in collaboration with the U.S. Marine Corps in 2008,9,10 as part of organization-wide efforts (by both U.S. and Canadian militaries) to create a common language and classification system for understanding stress that could be adopted by military members, leaders, family, and health professionals. It allows users to self-map their mental health status on six well-being domains (addictions, emotional well-being, performance and functioning, physical well-being, sleep, and social well-being) along a continuum that ranges in severity across four colour-coded anchors: healthy (green), reacting (yellow), injured (orange), and ill (red). The conceptualization of the MHCM was based on the understanding that, although epidemiological research has focused predominantly on dichotomous outcomes resulting from stress exposure (i.e., the presence or absence of disease), continuous assessments of stress-exposed members’ symptom burden revealed a broad distribution of distress, and such symptoms change over time.11–14 Indeed, conceptualizing mental health as a continuum ranging from mental health to mental illness more accurately captures the nature of psychological functioning and well-being.15–18
The MHCM tool provides a framework for individuals to monitor their mental health status, identify mental health concerns, and recognize when to take the appropriate action to address these concerns.19 Research with Royal Canadian Mounted Police cadets has demonstrated the effectiveness of regular mental health monitoring in improving mental health disorder symptom reporting.20 Through this tool, CAF personnel are provided with mental health education that normalizes mental health fluctuations, creates an expectation of recovery and wellness, and highlights actions that individuals can take to maintain or regain their mental fitness. Given the stated preference of many CAF personnel to manage their own mental health conditions,21 the MHCM helps them to distinguish between early distress that can often be self-managed and more persistent symptoms that require professional assistance. Indeed, an online intervention found that depicting mental health and mental illness as a continuum, rather than as a dichotomy, was associated with reductions in stigma.22
An initial study was conducted by D’Agata and colleagues to assess the validity of the current MHCM.23 These researchers evaluated the extent to which self-mapping scores were correlated with validated scales in each domain and the extent to which CAF members could match the appropriate descriptors to their correct anchors. With respect to this matching task, they found that although matching accuracy was high for the healthy descriptors, it decreased for the descriptors for the reacting, injured, and ill anchors, suggesting potential issues with the face validity of the descriptors themselves. In terms of the self-mapping task (having participants select the descriptors that best described themselves), the authors found adequate agreement between MHCM self-mapping and the validated measures. Although the validated scale scores strongly predicted group membership for the healthy anchor, these rates decreased for the reacting, injured, and ill anchors, suggesting that participants might be underestimating their symptom severity on the current version of the MHCM tool. Altogether, these findings indicate that modifications to the descriptors might improve the validity of the current MHCM.
Current research
Our main goal was to improve the validity of the MHCM. Specifically, we were interested in evaluating whether the addition of sub-domain descriptors, in addition to revising the current domain descriptors, would improve the accuracy of self-mapping to the MHCM domains. The aim of the revisions was to improve the differentiation of the descriptors or response options by drawing on standardized scale content and construction. In Study 1, we tested the accuracy of the revised general domain descriptors and new sub-domain descriptors, identifying those with the highest accuracy rates. Then, in Study 2, we evaluated whether presenting these sub-domain descriptors in addition to the general domain descriptors (new vs. old) resulted in more accurate self-mapping along the MHCM relative to the general domain descriptors alone.
Methods
Study 1
Descriptor revisions
New general and sub-domain descriptors were created by a R2MR working group in 2020, based on a content analysis of relevant scales in each domain, and further revised by the authors.
Participants and procedure
Email invitations were sent to a random sample of 545 Regular Force CAF members in October 2023, and 159 participants completed the online survey (18% in French) using the Department of National Defence’s Qualtrics platform. No demographic information was collected from participants. Ethics approval for this project was obtained from the Department of National Defence’s Social Science Research Review Board. Participants were presented with four randomly selected descriptors from each domain one at a time, along with the domain title, and selected the anchor (healthy, reacting, injured, ill, or none) that each belonged to. The descriptor and domain order were randomized.
Results and discussion
Proportions associated with assigning each descriptor to each anchor were calculated, followed by mean accuracy scores for the four anchors and then mean accuracy scores for each descriptor overall. Our goal was to identify at least one descriptor per sub-domain, with accuracy rates above 8.3% representing greater-than-chance responding (because each anchor had 12 possible combinations of responses). Thus, we ensured that descriptors had greater than 10% accuracy on most anchors. However, this study was under-powered, so we also ensured that decisions were conceptually informed. For each domain, we calculated whether the results would be improved with the inclusion or exclusion of particular sub-domain descriptors by examining unique combinations of sub-domain descriptors with each of the domain descriptors. These findings are reported where relevant. The full results are presented in Supplementary Table 1.
Addictions
The domain descriptor demonstrated good accuracy (44.9% overall). We selected three sub-domain descriptors that demonstrated the highest overall accuracy (strong desire and causes life problems), that demonstrated better spread across anchors, particularly the injured and ill domains (difficulty to stop or go without), or both.
Emotional well-being
The domain descriptor performed well (51.1% overall). We wanted to ensure that the two central components of anxiety were represented in the anxiety sub-domain: 1) feelings of restlessness, nervousness, and being on edge and 2) inability to control and stop worrying.24 One of the descriptors captured feelings of restlessness and nervousness but did not perform as well as others. We revised the item to also include being on edge. We added one descriptor that captured the frequency of worrying thoughts and ability to stop worrying thoughts. For the posttraumatic stress disorder (PTSD) sub-domain, we retained the highest performing descriptor that captured the ability to feel love for others (55.1% overall). However, we also wanted to capture other core components of PTSD, including intrusive memories, thoughts and behavioural avoidance, and problematic anger.25,26 Three descriptors were added to this sub-domain to capture these components. For the depression sub-domain, we retained one of the higher performing descriptors (self-hatred). Although the hopelessness descriptor had low accuracy for the injured category, we retained it given its clinical relevance. We also added an item to capture anhedonia.
Performance and functioning
The general descriptor for this domain did not perform well (23% overall). We retained two sub-domain descriptors that captured talking negatively about work and spending more time at work than with family and friends, both of which performed well. We selected one resilience descriptor that captured difficulties in bouncing back from stressors and modified one that captured one’s ability to manage daily stress.
Physical well-being
The general descriptor performed adequately (30.8%). Regarding the physical symptoms of stress, we created a combined descriptor rather than selecting a subset of physical symptoms. The individual descriptors performed adequately (28.0%-49.8% overall). We also retained the activities-limited-because-of-physical-health descriptor that performed well (38.6% overall).
Sleep
The general domain descriptor performed well (40.7% overall). We selected the top performing descriptors for the sleep disturbance and sleep-related impairment sub-domains: trouble falling asleep, staying asleep, or waking too early and activities being disturbed by poor sleep. We combined the worry/sad at bedtime and stress-disturbing-sleep descriptors into a new overall worry, sadness, or stress-disturbs-sleep descriptor.
Social well-being
The domain descriptor for this domain performed well (40.4% overall). The top performing descriptor from each sub-domain was selected and included belonging to a community, having close supportive relationships, and having people to turn to for support.
Overall, our selected descriptors improved the accuracy of mapping scores for all the domains and for most of the anchor categories. All accuracy rates were lower than those previously reported except for the injured category for emotional well-being. However, there are methodological differences; for example, we used a multi-response method compared with a single-choice-response method (where chance accuracy is 8.3% vs. 20.0%, respectively). All our anchors had overall accuracy rates well above 8.3% (ranging from 29.0% for the ill category to 63.5% for the healthy category). In addition, our descriptors were presented in isolation, compared with presenting all four descriptors simultaneously. Another indicator of the descriptors’ validity is their utility in helping participants gain an accurate understanding of their well-being, which was the goal of Study 2.
Methods
Study 2
Participants and procedure
A total of 750 Regular Force members were invited to complete this online study in February 2024 (Study 2a). However, because of an error in data collection in which the social well-being domain scale was omitted from the initial survey, we emailed another 750 Regular Force members to complete a second survey (Study 2b) for the social well-being domain measures. For Study 2a, 183 participants completed the survey; however, 22 were removed for failing attention tests. Thus, Study 2a had a final sample of 161 participants (13% completed the study in French). Participants were mostly men (75%); many were between ages 35 and 44 years (39.8%) and had a post-secondary education (73.4%). Many were junior non-commissioned members (34.4%), were in the army (53.1%), and had on average 15.12 years of service (SD = 8.97). Most participants were not in a mental-health-related occupation (89.1%), had sought mental health treatment or services while serving in the CAF (62.5%), and had received R2MR training in the past (63.3%).
For Study 2b, 113 participants had completed some portion of the survey (15% in French). Their demographic profile was similar to that of the participants in Study 2a. Descriptive statistics for both samples are provided in Supplementary Table 2.
The experiment had several randomization settings within Qualtrics. For the sub-domain descriptors, participants chose the single response that best represented their current state (a multiple-choice format). See Figure 1 for a screenshot of the mapping task for the emotional well-being domain and the anger descriptor set for the PTSD sub-domain. The domain descriptors presented participants with the descriptors alongside the MHCM coloured banner; they ranged from healthy (green) to ill (red) and had a slider response scale (with scores ranging from 1 to 100) to indicate where along the continuum they fell (see Figure 2 for a screenshot).
Figure 1.
Sample sub-domain descriptor presentation for the mapping task
Figure 2.
Sample domain descriptor presentation for the mapping task
Measures
All measures were selected for having demonstrated strong psychometrics properties and for being validated in both English and French. Descriptive statistics for all scale scores are provided in Supplementary Table 3.
Addiction (alcohol consumption). The Alcohol Use Disorders Identification Test (AUDIT) is a 10-item scale created by the World Health Organization to assess alcohol consumption.27,28 Total scores range from 0 to 40, with 1–7 indicating low-risk consumption, 8–14 indicating hazardous or harmful consumption, and 15 or higher indicating potential moderate to severe alcohol use disorder.
Addiction (gambling motives). The Gambling Motives Questionnaire-Financial (GMQ-F) contains 15 reasons for engaging in gambling behaviour.29,30 Respondents indicate their frequency of each on a scale ranging from 1 (almost never/never) to 4 (almost always). Scale scores are calculated by taking the mean of the 15 items, with higher scores indicating greater engagement in gambling.
Emotional well-being (psychological distress). The Kessler Psychological Distress (K6) scale is a screening instrument for the identification of possible mental illness; it assesses the frequency of non-specific psychological distress in the past 30 days.31,32 Participants indicate the extent to which they have experienced symptoms by selecting a response on a scale ranging from 0 (none of the time) to 4 (all of the time). Scores are calculated by taking the sum of the six items, with a cut-off of 13 or more indicating the likely presence of a serious mental illness.
Emotional well-being (suicidal ideation). The Suicidal Ideation Attributes Scale (SIDAS) is a five-item suicidal ideation screening tool on which participants indicate the extent to which they have experienced forms of ideation in the past month on a scale ranging from 1 to 10.33,34 The total score is calculated by taking the sum of responses, and higher scores indicate greater ideation. A score greater than 1 indicates a risk of suicidal behaviour, and a score of 21 or higher indicates a high risk of suicidal behaviour.
Performance and functioning. The Utrecht Work Engagement Scale-9 (UWES-9) contains nine statements about feelings related to work,35,36 with responses indicated on a scale ranging from 1 (almost) to 6 (always). Scores are calculated by taking the sum of items, with higher scores reflecting higher workplace engagement.
Physical well-being. Using the 15-item Physical Health Questionnaire (PHQ-15),37 participants indicate the extent to which they experienced 15 physical symptoms during the past 7 days on a scale ranging from 1 (not at all) to 4 (constantly).
Sleep. The Sleep Condition Indicator (SCI) is a screening tool for insomnia disorder. Eight questions capture sleep habits during the past month,38,39 and responses are indicated on a five-point scale. Total scores are calculated by summing all items, with higher scores reflecting better-quality sleep, and low mean scores (0–2) reflecting the threshold for insomnia disorder in the Diagnostic and Statistical Manual of Mental Disorders (5th ed.).25
Social well-being. The Multidimensional Scale of Perceived Social Support (MSPSS) assesses an individual’s perceptions of social support from close others.40,41 It has 13 items, and responses are indicated on a scale ranging from 1 (very strongly disagree) to 7 (very strongly agree). Scores are calculated by taking the mean of all items, with higher scores reflecting higher social support.
Results
Correlation analyses
We compared the self-mapping scores from each condition with validated scale scores within domains (see Supplementary Table 4). We standardized all descriptor mapping scores and then created aggregate scores by taking the average of respective items. Correlations of 0.75 or higher indicate adequate concurrent validity.42 For all domains, we also examined whether removing particular sub-domain descriptors improved findings. In addition, gender did not moderate these findings when examining correlation coefficients separately for men and women.
For addictions, the AUDIT was most strongly and significantly correlated with the old domain plus the sub-domain descriptors. The GMQ-F was not significantly correlated with the self-mapping conditions. For emotional well-being, both validated measures (K6 and SIDAS) were most highly and significantly correlated with the new domain plus sub-domain descriptors condition (exceeding 0.75 for the K6). For physical well-being, the PHQ-15 was most strongly and significantly correlated with the new domain plus sub-domain descriptor condition (exceeding 0.75). For performance, the UWES-9 was most strongly correlated with the old domain descriptor alone. However, by retaining the two descriptors significantly correlated with the UWES-9 (ability to focus energy and attention to achieve work objectives and talking negatively about one’s work), correlations for the two sub-descriptor conditions exceeded the previous highest values, with the new domain plus area descriptors most strongly correlated with the UWES-9. For sleep, the SCI was most strongly and significantly correlated with the new domain plus area descriptors (exceeding 0.75). For social well-being, the MSPSS was most strongly and significantly correlated with the old domain plus the sub-domain descriptor condition.
All coefficients for the selected descriptor conditions were higher than those reported by D’Agata and colleagues,23 meaning that the descriptor scores were more highly correlated with validated measures in each of those domains than the previous descriptors, lending support for the improved validity of the revised MHCM tool (see Table 1). The retained descriptors for this revised MHCM tool are presented in Supplementary Table 4. Alternate presentations are also included in the supplemental file (Supplementary Figures 1–7).
Table 1.
Pearson correlations among standardized MHCM spectrum scores and validated scale scores by descriptor condition
| Domain and scale | Condition |
|||
|---|---|---|---|---|
| Old domain | New domain | Old + sub-domain | New + sub-domain | |
| Addictions | ||||
| AUDIT | 0.46* | 0.40* | 0.59* | 0.34† |
| GMQF | 0.14 | 0.21 | 0.20 | 0.26 |
| Emotional Well-Being | ||||
| K6 | 0.45* | 0.63* | 0.78* | 0.90 * |
| SIDAS | 0.48* | 0.59* | 0.51* | 0.61 * |
| Performance & Functioning | ||||
| UWES-9 (all sub-domain descriptors) | −0.56* | −0.51* | −0.46* | −0.40* |
| UWES-9 (sub-domain descriptors 1 and 2 only) | −0.56* | −0.51* | −0.63* | −0.69* |
| Physical Well-Being — PHQ-15 | 0.64* | 0.58* | 0.62* | 0.86 * |
| Sleep — SCI | −0.74* | −0.80* | 0.82* | 0.89* |
| Social Well-Being — MSPSS | −0.67* | −0.22 | −0.86‡ | −0.37* |
Note: Boldface indicates the experimental conditions with the best set of descriptors that were retained.
*p < 0.01.
†p < 0.05.
‡p < 0.001.
MHCM = Mental Health Continuum Model; AUDIT = Alcohol Use Disorders Identification Test; GMQF = Gambling Motives Questionnaire-Financial; K6 = Kessler Psychological Distress; SIDAS = Suicidal Ideation Attributes Scale; UWES-9 = Utrecht Work Engagement Scale; PHQ-15 = 15-item Physical Health Questionnaire; SCI = Sleep Condition Indicator; MSPSS = Multidimensional Scale of Perceived Social Support.
Mean scores on validated measures and MHCM anchors
We examined mean scale scores according to overall MHCM anchor scores and against scale cut-off criteria (see Supplementary Table 5). For all domains, means increased or decreased as expected for each anchor category. The mean AUDIT score for the injured group met the criteria for hazardous and harmful drinking, whereas those for the other groups did not. Regarding psychological distress, those who self-assessed as ill on average for the emotional well-being domain met the cut-off indicating a potential psychological disorder, whereas the other groups did not.
Predicted group membership of validated measures
We examined whether the scale scores significantly predicted overall MHCM mapping to the four anchors (see Table 2). Overall, the rates for correctly classifying participants’ overall domain anchors according to validated measures in those areas ranged between 36.7% and 61.5%, which were lower than those previously reported (although our analyses were more under-powered). Our findings align with previous research in that correct classification rates for the healthy and ill categories were highest and those for the reacting category were low. However, our classification rates for the injured category were higher on average than those previously reported. Also consistent with D’Agata and colleagues,23 these findings improved when we collapsed the reacting and injured categories, suggesting that individuals struggle more with distinguishing between these states.
Table 2.
Correct classification of participants’ MCHM overall domain anchors based on validated scales
| Domain and variable (scale) | Wilks’ Λ | N | χ2 | df | Classification, % |
||||
|---|---|---|---|---|---|---|---|---|---|
| Total | Healthy | Reacting | Injured | Ill | |||||
| Addictions: Alcohol (AUDIT) | 0.82 | 108 | 24.81* | 2 | 56.6 | 64.3 | 47.5 | — | — |
| Emotional Well-Being | |||||||||
| Distress (K6) | 0.39 | 56 | 50.14* | 3 | 57.1 | 92.3 | 50.0 | 37.5 | 66.7 |
| Suicidal Ideation (SIDAS) | 0.57 | 51 | 26.71* | 3 | 45.1 | 91.7 | 8.7 | 61.5 | 66.7 |
| Performance & Functioning: Work Engagement (UWES-9) | 0.55 | 59 | 33.30* | 3 | 54.2 | 85.7 | 52.9 | 37.5 | 100.0 |
| Physical Well-Being: Physical Health (PHQ-15) | 0.70 | 49 | 16.07* | 3 | 36.7 | 62.5 | 47.1 | 5.6 | 66.7 |
| Sleep: Sleep (SCI) | 0.30 | 65 | 73.46* | 3 | 61.5 | 77.8 | 40.0 | 69.6 | 87.5 |
| Social Well-Being: Social Support (MSPSS) | 0.39 | 51 | 45.12* | 3 | 49.0 | 76.9 | 29.2 | 71.4 | 42.9 |
Note: Dashes indicate no participants mapped to that anchor.
p < 0.001
MCHM = Mental Health Continuum Model; AUDIT = Alcohol Use Disorders Identification Test; K6 = Kessler Psychological Distress; SIDAS = Suicidal Ideation Attributes Scale; UWES-9 = Utrecht Work Engagement Scale; PHQ-15 = 15-item Physical Health Questionnaire; SCI = Sleep Condition Indicator; MSPSS = Multidimensional Scale of Perceived Social Support.
Mental health screening scales with established cut-off scores
Finally, we examined the relationships between total MHCM anchor scores and the proportion of individuals who screened positive for a potential psychological disorder, suicidal ideation, hazardous and harmful alcohol use, and insomnia disorder. A total of 19.6% of those sampled (n = 56) screened positive on the K6 for a psychological disorder. Of those who screened positive, none self-assessed as healthy, 18.0% self-assessed as reacting, 54.5% as injured, and 27.3% as ill. Of those who screened negative, 28.9% self-assessed as healthy, 48.9% as reacting, 22.2% as injured, and none as ill. The single individual who screened positive for suicidal ideation self-assessed as ill on the MHCM. Of those who screened negative, 24.0% self-assessed as healthy, 46.0% as reacting, 26.0% as injured, and 4.0% as ill. Of those who screened positive for hazardous and harmful alcohol use (22.2% of those sampled; n = 54), 8.3% self-assessed as healthy, 83.3% as reacting, and 8.3% as injured. Of those who screened negative for hazardous and harmful alcohol use, 54.8% self-assessed as healthy, 42.9% as reacting, and 2.4% as injured. The single individual who screened positive for insomnia disorder self-assessed as ill on the sleep domain overall. In contrast, of those who screened negative, 14.0% self-assessed as healthy, 39.0% as reacting, 35.9% as injured, and 10.9% as ill.
General discussion
An initial study assessing the validity of the MHCM self-monitoring tool indicated that although the tool was performing adequately in some areas, further enhancements to the tool should be made. We proposed the addition of sub-domain descriptors in addition to revising the domain descriptors. The purpose of this two-study project was to identify the most valid subsets of sub-domain descriptors with the highest accuracy rates to include in Study 2 and then to evaluate the validity of this improved version of the MHCM.
Summary of findings
In Study 1, the selected descriptors improved the overall accuracy of mapping scores for all the domains. Although our accuracy rates were lower than those previously reported, our matching task was also methodologically more challenging. Overall, participants could categorize the descriptors with their appropriate anchors at well above chance level and with the pattern of findings mirroring those of D’Agata and colleagues.23 Participants found the injured and ill descriptors more difficult to decipher and the healthy descriptors easiest to categorize.
In Study 2, we found that the addition of sub-domain descriptors enhanced the validity of the MHCM tool for all domains, such that the overall MHCM anchor scores were associated with higher correlations with validated domain measures, and four of the six domains had coefficients exceeding a concurrent validity threshold. We also found that mean scores on validated scales increased or decreased as expected across the MHCM anchors for all domains, lending further credibility to its validity, that those who self-assessed as injured in addictions met the criteria for hazardous and harmful drinking, and that those who self-assessed as ill for emotional well-being met the cut-off for a potential psychological disorder.
Our rates for correctly classifying participants’ overall domain anchors according to validated scales were lower than those previously reported, but our analyses were more under-powered. Nonetheless, our findings align with those of previous research in that classification rates for the healthy and ill categories were highest, and some individuals still struggled with distinguishing between the ill and injured states.
Finally, we found evidence for the potential validity of some domain descriptors in being able to discriminate between those who screened positive versus negative for potential disorders: 1) the emotional well-being descriptors for a likely psychological disorder and suicide ideation, 2) the addictions descriptors for those with and without problematic alcohol use, and 3) the sleep descriptors for potential insomnia disorder.
Strengths and limitations
Strengths of this research include that the descriptors generated and selected were based on validated scales in those respective areas and were conceptually relevant. Although the MHCM is not meant to serve as a diagnostic tool, we ensured that the domain most closely tied to mental health (emotional well-being) contained descriptors that cover the central components of anxiety, depression, and PTSD. In this way, if an individual is experiencing any of these symptoms, the MHCM tool should help individuals to identify them to some degree. In addition, our surveys were rigorous in their design, ensuring that randomization was applied whenever possible to limit the impact of response biases, order effects, self-consistency effects, and other confounding variables.
However, these strengths are qualified by some limitations. Although many analyses were well powered (e.g., correlations with validated scales, t-tests), some analyses were under-powered (i.e., discriminant functions for classifications, estimating descriptor parameters in the mapping task). This posed challenges in adequately comparing our classification rates with those previously reported and in our ability to project these findings beyond our samples. We did not find evidence to suggest that gender moderates these findings; however, a more robust assessment of fit based on demographic variables was not possible with this sample. It is worth noting, however, that our sample characteristics reflected what we would expect from a typical sample of CAF Regular Force members (i.e., more men and those younger and of lower rank, more army and fewer navy uniformed members, and more members with post-secondary education relative to those without post-secondary education).43 Future work should focus on the potential utility of this version of the MHCM with a larger sample and based on relevant demographic variables.
Implications and future directions
The MHCM is a critical educational tool in the CAF, which highlights the continuous nature of mental health and the development of, and recovery from, mental illness. This tool promotes the idea that fluctuations between healthy and more distressed states is common, that movement in both directions is possible, and that ultimately there is always the possibility of a return to full health and functioning when temporary or more severe distress is experienced. The practical utility of this tool is to help increase members’ awareness and monitoring of their mental health status and to be able to identify changes in their health and performance. Such self-monitoring can help individuals to identify either existing or developing mental health concerns and then prompt individuals to take the appropriate action (e.g., seeking mental health treatment, seeking social support) to address these concerns.
These findings will have direct practical implications for the design of the MHCM tool in the R2MR mobile application, in addition to how the MHCM is taught in R2MR courseware. Learning about the various areas in each domain in which mental health symptoms and distress can present or manifest can help provide members with greater mental health literacy and identify signs of distress in themselves and others. Many forms of the MHCM model are currently being used by other organizations.44–46 These findings could have implications for how others are currently conceptualizing, framing, and educating others on the MHCM.
One notable finding consistent with that reported by D’Agata and colleagues was that individuals had a more difficult time distinguishing between the injured and ill states and that collapsing across these anchors improved classification rates by validated scales.23 Although a three-anchor continuum might possibly more parsimoniously categorize individuals, there is conceptual value in maintaining a distinction between injured and ill states when the goal is early detection of more persistent impairments in functioning and mental illness symptomatology and early care seeking. Recognizing when distress is treatment worthy (i.e., mental health literacy) is a predictor of care seeking behaviour, with delays in distress recognition linked with poorer treatment outcomes.47–52
In addition, the stigma surrounding mental illness is still a prevalent concern in military populations.53 In this way, the injured category provides an alternate and potentially less threatening choice than the more severe ill category, allowing individuals to acknowledge their distress and be encouraged to seek care while acknowledging biases (including self-stigma) that might prevent them from wanting to identify with the ill state. This would be an interesting avenue of research, in regard to assessing the relationships among stigma and MHCM mapping.
Conclusion
Through this research, we were able to enhance the MHCM tool by adding sub-domain descriptors that describe various states of functioning within each of the six domains of well-being. This enhanced MHCM should allow individuals to better map themselves along the continuum, identify detailed changes in their mental health status, and take the relevant action (e.g., engage in recovery strategies, seek social support, and seek mental treatment).
Supplementary Material
Acknowledgments
Competing Interests
The authors have nothing to disclose.
Ethics Approval
This study was approved by the Social Science Research Review Board, Ottawa, Ontario, Canada, on April 11, 2023.
Informed Consent
N/A
Registry and Registration no. of the Study/Trial
N/A
Animal Studies
N/A
Peer Review
This manuscript has been peer reviewed.
Biographies
Valerie M. Wood,, PhD, is a research and evaluation specialist for the Road to Mental Readiness program in the Canadian Forces Health Services Group, Department of National Defence. Her research has mainly focused on understanding individual differences in, and ways to support, the mental health, resilience, and well-being of military members and their families.
Suzanne Bailey, MSW, served in the Canadian Armed Forces as a social work officer and currently works with the Department of National Defence as the team lead for curriculum development for the Road to Mental Readiness (R2MR) program. As one of the founders of the R2MR program, she has been fortunate to lead and contribute to the development and delivery of mental health and mental performance training for Canadian Armed Forces personnel since 2008.
Kimberly Guest, MSW, has been practising clinical social work since 1995 after receiving her bachelor of social work from Carleton University in 1995 and her Master of Social Work from the University of Calgary in 1998. Kimberly is the Senior Curriculum Developer for the Road to Mental Readiness program, providing resilience and mental health curricula for the Canadian Armed Forces. Kimberly has always believed in the importance of education and early intervention in preventing long-term suffering and loss.
Funding Statement
No funding was received for this article.
References
- 1.Department of National Defence . Strong, secure, engaged: Canada’s defence policy [Internet]. Ottawa: Department of National Defence; 2017. [cited 2024 Jun 2]. Available from: www.canada.ca/content/dam/dnd-mdn/documents/reports/2018/strong-secure-engaged/canada-defence-policy-report.pdf [Google Scholar]
- 2.Rusu C, Zamorski MA, Boulos D, et al. Prevalence comparison of past-year mental disorders and suicidal behaviours in the Canadian Armed Forces and the Canadian general population. Can J Psychiatry. 2016;61 Suppl 1:46S–55S. 10.1177/0706743716628856 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Department of National Defence . The Road to Mental Readiness [Internet]. Ottawa: Department of National Defence; 2023. [cited 2024 Jun 2]. Available from: www.canada.ca/en/department-national-defence/services/benefits-military/health-support/road-to-mental-readiness.html [Google Scholar]
- 4.Zamorski MA, Guest K, Bailey S, et al. Beyond battlemind: evaluation of a new mental health training program for Canadian forces personnel participating in third-location decompression. Mil Med. 2012. Nov 1;177(11):1245–53. 10.7205/milmed-d-12-00064 [DOI] [PubMed] [Google Scholar]
- 5.Lee JE, Boulos D, Sudom K. Exposure to mental health training and variations in work strain, coping, and positive mental health in the Canadian military. Mil Behav Health. 2020. Apr 2;8(2):171–80. 10.1080/21635781.2019.1664355 [DOI] [Google Scholar]
- 6.Fikretoglu D, Liu A, Nazarov A, et al. A group randomized control trial to test the efficacy of the Road to Mental Readiness (R2MR) program among Canadian military recruits. BMC Psychiatry. 2019. Dec;19:326. 10.1186/s12888-019-2287-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Bouchard S, Bernier F, Boivin É, et al. Using biofeedback while immersed in a stressful videogame increases the effectiveness of stress management skills in soldiers. PloS One. 2012. Apr 27;7(4):e36169. 10.1371/journal.pone.0036169 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Driskell JE, Copper C, Moran A. Does mental practice enhance performance? J Appl Psychol. 1994. Aug;79(4):481–92. 10.1037//0021-9010.79.4.481 [DOI] [Google Scholar]
- 9.Bailey S. The Canadian Forces Health Services Road to Mental Readiness Program. Med Corps Int Forum. 2015;2;37–48. [Google Scholar]
- 10.Nash WP, Steenkamp M, Conoscenti L, et al. The stress continuum model: a military organizational approach to resilience and recovery. In Southwick SM, Litz BT, Charney D, Friedman MJ, eds. Resilience and mental health: challenges across the lifespan. Cambridge: Cambridge University Press; 2011. p. 238–52. 10.1017/cbo9780511994791.018 [DOI] [Google Scholar]
- 11.Shalev AY. Acute stress reactions in adults. Biol Psychiatry. 2002. Apr 1;51(7):532–43. 10.1016/s0006-3223(02)01335-5 [DOI] [PubMed] [Google Scholar]
- 12.Bonanno GA, Galea S, Bucciarelli A, et al. Psychological resilience after disaster: New York City in the aftermath of the September 11th terrorist attack. Psychol Sci. 2006. Mar;17(3):181–6. 10.1111/j.1467-9280.2006.01682.x [DOI] [PubMed] [Google Scholar]
- 13.Bonanno GA. Loss, trauma, and human resilience: have we underestimated the human capacity to thrive after extremely aversive events? Am Psychol. 2004. Jan;59(1):20–8. 10.1037/0003-066x.59.1.20 [DOI] [PubMed] [Google Scholar]
- 14.Dickstein BD, Suvak M, Litz BT, et al. Heterogeneity in the course of posttraumatic stress disorder: trajectories of symptomatology. J Trauma Stress. 2010. Jun;23(3):331–9. 10.1002/jts.20523 [DOI] [PubMed] [Google Scholar]
- 15.Keyes CL. The mental health continuum: from languishing to flourishing in life. J Health Soc Behav. 2002. Jun 1;43(2):207–22. 10.2307/3090197 [DOI] [PubMed] [Google Scholar]
- 16.Johns LC, Van Os J. The continuity of psychotic experiences in the general population. Clin Psychol Rev. 2001. Nov 1;21(8):1125–41. 10.1016/s0272-7358(01)00103-9 [DOI] [PubMed] [Google Scholar]
- 17.Hankin BL, Fraley RC, Lahey BB, et al. Is depression best viewed as a continuum or discrete category? A taxometric analysis of childhood and adolescent depression in a population-based sample. J Abnorm Psychol. 2005. Feb;114(1):96–110. 10.1037/0021-843x.114.1.96 [DOI] [PubMed] [Google Scholar]
- 18.Saha TD, Chou SP, Grant BF. Toward an alcohol use disorder continuum using item response theory: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Psychol Med. 2006. Jul;36(7):931–41. 10.1017/s003329170600746x [DOI] [PubMed] [Google Scholar]
- 19.Granek JA, Jarmasz J, Boland H, et al. Mobile applications for personalized mental health resiliency training. Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC); 2016. Nov 28-Dec 2; Orlando, FL. [Google Scholar]
- 20.Shields RE, Teckchandani TA, Asmundson GJ, et al. Daily survey participation and positive changes in mental health symptom scores among Royal Canadian Mounted Police Cadets. Front Psychol. 2023. Aug 4;14:1145194. 10.3389/fpsyg.2023.1145194 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Thériault F, Gabler K, Naicker K. Health and Lifestyle Information Survey of Canadian Forces Personnel 2013/2014 — Regular Force report. Ottawa: Department of National Defence; 2016. [Google Scholar]
- 22.Schomerus G, Angermeyer MC, Baumeister SE, et al. An online intervention using information on the mental health-mental illness continuum to reduce stigma. Eur Psychiatry. 2016. Feb;32:21–7. 10.1016/j.eurpsy.2015.11.006 [DOI] [PubMed] [Google Scholar]
- 23.D’Agata M, Nazarov A, Granek JA. Subjective self-mapping in the Mental Health Continuum Model (MHCM). Ottawa: Defence Research and Development Canada; 2019. June. Scientific Report DRDC-RDDC-2018-R294. [Google Scholar]
- 24.Kroenke K, Spitzer RL, Williams JB, et al. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146(5):317–25. 10.7326/0003-4819-146-5-200703060-00004 [DOI] [PubMed] [Google Scholar]
- 25.American Psychiatric Association . Posttraumatic stress disorder. In: Diagnostic and statistical manual of mental disorders. 5th ed. Washington (DC): American Psychiatric Publishing; 2013. [Google Scholar]
- 26.Sayer NA, Noorbaloochi S, Frazier P, et al. Reintegration problems and treatment interests among Iraq and Afghanistan combat veterans receiving VA medical care. Psychiatr Serv. 2010. Jun;61(6):589–97. 10.1176/appi.ps.61.6.589 [DOI] [PubMed] [Google Scholar]
- 27.Allen JP, Reinert DF, Volk RJ. The Alcohol Use Disorders Identification Test: an aid to recognition of alcohol problems in primary care patients. Prev Med. 2001. Nov;33(5):428–33. 10.1006/pmed.2001.0910 [DOI] [PubMed] [Google Scholar]
- 28.Gache P, Michaud P, Landry U, et al. The Alcohol Use Disorders Identification Test (AUDIT) as a screening tool for excessive drinking in primary care: reliability and validity of a French version. Alcohol Clin Exp Res. 2005. Nov;29(11):2001–7. 10.1097/01.alc.0000187034.58955.64 [DOI] [PubMed] [Google Scholar]
- 29.Dechant K. Show me the money: incorporating financial motives into the Gambling Motives Questionnaire. J Gambl Stud. 2014. Dec;30(4):949–65. 10.1007/s10899-013-9386-5 [DOI] [PubMed] [Google Scholar]
- 30.Devos G, Challet-Bouju G, Burnay J, et al. Adaptation and validation of the Gambling Motives Questionnaire-Financial (GMQ-F) in a sample of French-speaking gamblers. Int Gambl Stud. 2017. Jan 2;17(1):87–101. 10.1080/14459795.2016.1264080 [DOI] [Google Scholar]
- 31.Kessler RC, Andrews G, Colpe LJ, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002. Aug;32(6):959–76. 10.1017/s0033291702006074 [DOI] [PubMed] [Google Scholar]
- 32.Turgeon J, Turgeon S, Marleau J. Évaluation des propriétés psychométriques de l’échelle abrégée de Kessler (K6) parmi les adolescents québécois. Santé Ment Qué. 2022;47(1):289–308. 10.7202/1094155ar [DOI] [PubMed] [Google Scholar]
- 33.Van Spijker BA, Batterham PJ, Calear AL, et al. The Suicidal Ideation Attributes Scale (SIDAS): community-based validation study of a new scale for the measurement of suicidal ideation. Suicide Life Threat Behav. 2014. Aug;44(4):408–19. 10.1111/sltb.12084 [DOI] [PubMed] [Google Scholar]
- 34.Gauvin G, Bardon C, Côté LP. Psychometric validation of the French version of the Suicidal Ideation Attributes Scale (SIDAS-FR). Death Stud. 2022. Nov 26;46(10):2404–12. [DOI] [PubMed] [Google Scholar]
- 35.Schaufeli WB, Bakker AB, Salanova M. The measurement of work engagement with a short questionnaire: a cross-national study. Educ Psychol Meas. 2006. Aug;66(4):701–16. [Google Scholar]
- 36.Zecca G, Györkös C, Becker J, et al. Validation of the French Utrecht Work Engagement Scale and its relationship with personality traits and impulsivity. Eur Rev Appl Psychol. 2015. Jan 1;65(1):19–28. 10.1016/j.erap.2014.10.003 [DOI] [Google Scholar]
- 37.Schat AC, Kelloway EK, Desmarais S. The Physical Health Questionnaire (PHQ): construct validation of a self-report scale of somatic symptoms. J Occup Health Psychol. 2005. Oct;10(4):363–81. 10.1037/1076-8998.10.4.363 [DOI] [PubMed] [Google Scholar]
- 38.Espie CA, Kyle SD, Hames P, et al. The Sleep Condition Indicator: a clinical screening tool to evaluate insomnia disorder. BMJ Open. 2014. Mar 1;4(3):e004183. 10.1136/bmjopen-2013-004183 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Vézina-Im LA, Morin CM, Turcotte S, et al. Validation de la version française du Sleep Health Index: l’index sur la santé du sommeil. Méd Sommeil. 2022. Jun 1;19(2):78–88. 10.1016/j.msom.2021.11.003 [DOI] [Google Scholar]
- 40.Zimet GD, Dahlem NW, Zimet SG, et al. The Multidimensional Scale of Perceived Social Support. J Personal Assess. 1988. Mar 1;52(1):30–41. 10.1207/s15327752jpa5201_2 [DOI] [Google Scholar]
- 41.Denis A, Callahan S, Bouvard M. Evaluation of the French version of the Multidimensional Scale of Perceived Social Support during the postpartum period. Matern Child Health J. 2015. Jun;19:1245–51. 10.1007/s10995-014-1630-9 [DOI] [PubMed] [Google Scholar]
- 42.Kline P. Handbook of psychological testing. 2nd ed. London: Routledge; 2013. Nov 12. 10.4324/9781315812274 [DOI] [Google Scholar]
- 43.Park J. A profile of the Canadian Forces. Perspect Labour Income. 2008; 9(7):17–30. [Google Scholar]
- 44.Szeto A, Dobson KS, Knaak S. The road to mental readiness for first responders: a meta-analysis of program outcomes. Can J Psychiatry. 2019. Jun;64 Suppl 1:18S–29S. 10.1177/0706743719842562 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.University of Waterloo . Mental health self-screening [Internet]. Thrive Toolbox; ND: [cited 2024 Nov 19]. Available from: https://uwaterloo.ca/mechanical-mechatronics-engineering/mme-wellness-program/get-help-now/mental-health-self-screening [Google Scholar]
- 46.Mental Health Commission of Canada . Continuum self-check [Internet]. Ottawa: Opening Minds; 2024. [cited 2024 Nov 19]. Available from: https://openingminds.org/mental-health-continuum-self-check/ [Google Scholar]
- 47.Meltzer PB, Brugha T, Farrell M, et al. The reluctance to seek treatment for neurotic disorders. J Mental Health. 2000. Jan 1;9(3):319–27. 10.1080/jmh.9.3.319.327 [DOI] [PubMed] [Google Scholar]
- 48.Wells JE, Robins LN, Bushnell JA, et al. Perceived barriers to care in St. Louis (USA) and Christchurch (NZ): reasons for not seeking professional help for psychological distress. Soc Psychiatry Psychiatr Epidemiol. 1994. Jul;29:155–64. 10.1007/bf00802012 [DOI] [PubMed] [Google Scholar]
- 49.de Diego-Adeliño J, Portella MJ, Puigdemont D, et al. A short duration of untreated illness (DUI) improves response outcomes in first-depressive episodes. J Affect Disord. 2010. Jan 1;120(1–3):221–5. 10.1016/j.jad.2009.03.012 [DOI] [PubMed] [Google Scholar]
- 50.Dell’Osso B, Glick ID, Baldwin DS, et al. Can long-term outcomes be improved by shortening the duration of untreated illness in psychiatric disorders: a conceptual framework. Psychopathol. 2013;46(1):14–21. 10.1159/000338608 [DOI] [PubMed] [Google Scholar]
- 51.Paulus DJ, Wadsworth LP, Hayes-Skelton SA. Mental health literacy for anxiety disorders: how perceptions of symptom severity might relate to recognition of psychological distress. J Public Ment Health. 2015. Jun 15;14(2):94–106. 10.1108/jpmh-09-2013-0064 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Schomerus G, Stolzenburg S, Freitag S, et al. Stigma as a barrier to recognizing personal mental illness and seeking help: a prospective study among untreated persons with mental illness. Eur Arch Psychiatry Clinic Neurosci. 2019. Jun 1;269:469–79. 10.1007/s00406-018-0896-0 [DOI] [PubMed] [Google Scholar]
- 53.Weeks M, Zamorski MA, Rusu C, et al. Mental illness-related stigma in Canadian military and civilian populations: a comparison using population health survey data. Psychiatr Serv. 2017. Jul 1;68(7):710–6. 10.1176/appi.ps.201600398 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.


