Abstract
Given the high rates of suicide among military personnel and the need to characterize suicide risk factors associated with mental health service use, this study aimed to identify suicide-relevant factors that predict: (1) treatment engagement and treatment adherence, and (2) suicide attempts, suicidal ideation, and major depressive episodes in a military sample. Army recruiters (N = 2596) completed a battery of self-report measures upon study enrollment. Eighteen months later, information regarding suicide attempts, suicidal ideation, major depressive episodes, and mental health visits were obtained from participants’ military medical records. Suicide attempts and suicidal ideation were very rare in this sample; negative binomial regression analyses with robust estimation were used to assess correlates and predictors of mental health treatment visits and major depressive episodes. More severe insomnia and agitation were significantly associated with mental health visits at baseline and over the 18-month study period. In contrast, suicide-specific hopelessness was significantly associated with fewer mental health visits. Insomnia severity was the only significant predictor of major depressive episodes. Findings suggest that assessment of sleep problems might be useful in identifying at-risk military service members who may engage in mental health treatment. Additional research is warranted to examine the predictive validity of these suicide-related symptom measures in a more representative, higher suicide risk military sample.
Keywords: Suicide, Depression, Sleep, Agitation, Treatment engagement
1. Introduction
Suicide has become a growing problem in the U.S. military, with research indicating that service members die by suicide at higher rates than civilians (Kuehn, 2009). These elevated rates may be due, in part, to risk factors unique to military personnel, such as military-specific stress (e.g., exposure to killing, physical wounds), greater access to lethal means (e.g., firearms), and demographic composition (e.g., predominantly young males; Nock et al., 2013; Schoenbaum et al., 2014). Consequently, the development of military suicide prevention strategies has become a public health priority, motivating a marked increase in research in this area (U.S. Department of Health and Human Services [HHS], 2012). In particular, connecting at-risk service members to care has been identified as critical to suicide prevention efforts (Kuehn, 2009; Brenner and Barnes, 2012).
Although interventions to reduce suicide risk have yielded promising results among military populations (Britton et al., 2012; Knox et al., 2012; Rudd et al., 2015; Trockel et al., 2015), many service members remain reluctant to engage with mental health services, often due to stigma, negative beliefs about treatment, and concerns about career impact (Vogt, 2011; Blais et al., 2014; Britt et al., 2015). Thus, efforts must be made to understand patterns and predictors of mental health service use among military personnel, especially those at elevated suicide risk.
As an initial step towards enhancing treatment engagement among at-risk service members, it may be helpful to identify suicide risk factors associated with greater help-seeking behaviors. To maximize utility, symptoms used to screen for suicide risk should signal short-term, acute risk rather than long-term risk. Longer-term risk factors may be informative by revealing mechanisms by which risk is conferred, identifying at-risk sociodemographic or psychiatric groups (see Nock et al., 2008 for review), and informing public health prevention approaches (e.g., reducing access to means for suicide; Mann et al., 2005). However, in clinical settings, acute warning signs are arguably more useful in informing risk level categorization and treatment provision. Detection of acute warning signs may also be useful in gatekeeper training approaches to suicide prevention (e.g., equipping unit leaders to identify at-risk unit members).
In considering the vast body of suicide risk factors, there are at least five short-term risk symptoms assessable via brief, self-report survey: (1) agitation; (2) insomnia; (3) suicide-specific hopelessness; (4) talk about suicide/reported suicidal ideation; and (5) interpersonal theory of suicide constructs (i.e., perceived burdensomeness, thwarted belongingness, and capability for suicide). Each of these factors is supported by a body of literature justifying its selection as a focus of suicide risk screening (Chu et al., 2015). Agitation has been shown to be a precursor to suicidal behaviors (Fawcett et al., 1990), correlated with near-lethal attempts (Hall and Platt, 1999), and related to higher suicidality among individuals with a higher capability for suicide (Ribeiro et al., 2015). Insomnia is also a robust predictor of future suicide risk, including among military samples (Fawcett et al., 1990; Bernert et al., 2005, 2014; Ribeiro et al., 2012), even when controlling for depression and hopelessness (Ribeiro et al., 2012). Relatedly, hopelessness appears to play an integral role both in the emergence and maintenance of suicidal thoughts (Beck, 1986; Rudd et al., 2001). Suicidal ideation itself and disclosure of ideation have also been well-established as warning signs for suicide (Rudd et al., 2006). Finally, the interpersonal theory of suicide (Joiner, 2005; Van Orden et al., 2010) proposes that three constructs interact to confer risk for suicide: capability for suicide (i.e., heightened pain tolerance, fearlessness about death), thwarted belongingness (i.e., unmet need to belong), and perceived burdensomeness (i.e., feeling like a burden on others). Capability for suicide may especially be impacted by military service (Selby et al., 2010), and there is evidence for the association between suicidal history and these constructs among service members (Bryan et al., 2010).
1.1. The present study
Research identifying suicide risk factors associated with treatment engagement is critical to examine within a military sample since mental health services are more readily available and accessible in this population relative to civilians, for whom structural barriers are potent (Bruffaerts et al., 2011). Utilizing a large, diverse sample of U.S. Army recruiters, this study aimed to identify suicide-related factors: (1) associated with treatment engagement and adherence; and (2) predicting future suicide risk in a military sample (i.e., attempts, ideation, major depressive episodes [MDEs]). Due to a dearth of research examining the relationship between these variables and treatment engagement indices, a priori hypotheses were not posited.
This study examined predictors of any type of mental health care visits as well as visits excluding standard mental health screenings (i.e., Pre-Post-Deployment Health Assessments to detect deployment-related health concerns) to identify factors predicting voluntary visits. With regard to utilizing depression as an outcome measure, although most individuals with depression will not die by suicide (Bostwick and Pankratz, 2000), depression treatment is a key avenue for suicide prevention since it is one of the most common psychiatric disorders among suicide decedents (Cavanagh et al., 2003) and is highly treatable (Mann et al., 2005). As a result, although MDEs are not the suicide risk factor with the greatest specificity, taking into account the potentially low rates of suicide ideation and attempts in this sample—both of which are rare in the general population—MDEs were included at the study’s outset as an additional outcome measure, with consideration that depression is related to but not the sole contributor to suicide risk.
2. Material and method
2.1. Participants
A total of 3391 Army recruiters and recruiter candidates enrolled in the study and completed baseline self-report measures. Only those with available medical record data (N = 2596) were included in analyses. There were no statistically significant demographic differences between those with missing medical record data and those included in the study. Included participants were primarily male (92.2%) and ranged from 20 to 57 years of age (M = 29.8, SD = 4.8; see Table 1). Regarding race/ethnicity, 66.4% identified as White/Caucasian, 14.8% as Black/African American, 13.4% as Hispanic/Latino, 2.8% as Asian, 1.4% as Native Hawaiian/Other Pacific Islander, and 1.2% as American Indian/Alaska Native.
Table 1.
Participant demographics and characteristics (N = 2596).
| Characteristic | Valid % |
|---|---|
| Sex | |
| Male | 92.2% |
| Female | 7.8% |
| Age (M = 29.8, SD = 4.8) | |
| 18–24 | 12.6% |
| 25–34 | 72.2% |
| 35–44 | 14.5% |
| 45–54 | 0.7% |
| 55–64 | <0.1% |
| Race/Ethnicity | |
| American Indian or Alaska Native | 1.2% |
| Asian | 2.8% |
| Black or African American | 14.8% |
| Hispanic or Latino | 13.4% |
| Native Hawaiian or Other Pacific Islander | 1.4% |
| White or Caucasian | 66.4% |
| Rank | |
| Sergeant | 39.3% |
| Staff Sergeant | 46.7% |
| Sergeant First Class | 7.1% |
| First Sergeant/Master Sergeant | 1.4% |
| Command Sergeant Major/Sergeant Major | <0.1% |
| Second Lieutenant | <0.1% |
| Captain | 5.4% |
2.2. Measures
Due to study setting constraints, factor analyses of previous datasets were used to select a subset of items from each self-report measure to comprise a brief assessment battery.
2.2.1. Acquired Capability for Suicide Scale (ACSS; Van Orden et al., 2008; Ribeiro et al., 2014)
An abbreviated 4-item version of the ACSS assessed perceived fearlessness about death and physical pain tolerance. Respondents rated four items (e.g., “I am not afraid to die”) on a 5-point Likert scale. Total scores on the abbreviated ACSS range from 0 to 16, with higher scores indicating greater perceived pain tolerance and fearlessness about death. Previous research supports the ACSS as an internally consistent measure with good convergent, discriminant, and construct validity (Ribeiro et al., 2014). This study’s abbreviated ACSS demonstrated adequate internal consistency (α = 0.76).
2.2.2. Brief Agitation Measure (BAM; Ribeiro et al., 2011)
The BAM is a 3-item self-report questionnaire that asks participants to rate items (e.g., “I want to crawl out of my skin”) on a 7-point Likert scale. BAM total scores range from 3 to 21, with higher scores indicating increased agitation. Previous research has shown that the BAM has good internal consistency and convergent validity (Ribeiro et al., 2011), and it also demonstrated good internal consistency within this study (α = 0.85).
2.2.3. Depressive Symptom Inventory—Suicidality Subscale (DSI-SS; Metalsky and Joiner, 1997)
The DSI-SS is a self-report measure consisting of 4 items assessing suicidal thoughts, perceived control over these thoughts, suicide attempt plans, and suicidal urges. Participants rate each item on a 4-point Likert scale. Total scores range from 0 to 12, and higher scores are associated with increasing severity of suicidal symptoms. Research supports the DSI-SS’ construct validity and internal consistency (Joiner et al., 2002). Within this study, the DSI-SS demonstrated modest internal consistency (α = 0.70).
2.2.4. Interpersonal Needs Questionnaire (INQ1; Van Orden et al., 2012)
An adapted version of the INQ was used to measure thwarted belongingness (INQ-TB; 4 items) and perceived burdensomeness (INQ-PB; 4 items), with responses occurring on a 7-point response scale. Previous research has found good internal consistency for the belongingness (α = 0.85) and burdensomeness items (α = 0.89) in the 15-item version of the INQ (Van Orden et al., 2012), which was also demonstrated in this sample (α = 0.90 and 0.87, respectively).
2.2.5. Insomnia Severity Index (ISI; Bastien et al., 2001)
A 5-item version of the 7-item ISI assessed insomnia symptom severity. Individuals rated various sleep complaints (e.g., difficulty falling asleep) on a 0 to 4 scale. Total scores on the abbreviated ISI range from 0 to 20, with higher total scores indicating greater insomnia severity. Previous research supports the validity and internal consistency of the ISI (Bastien et al., 2001; Morin et al., 2011). This study’s abbreviated ISI demonstrated good internal consistency (α = 0.87).
2.2.6. Suicide Cognitions Scale (SCS; Rudd et al., 2008)
An abbreviated 10-item version of the 25-item SCS assessed suicide-specific hopelessness along three subscales: unlovability, unbearability, and unsolvability (Ellis and Rufino, 2015). Individuals rate the extent to which they agree or disagree with each item using a 1 to 5 scale, with higher scores indicating greater suicide-specific hopelessness. Previous research supports the validity and reliability of the SCS as a measure of suicide-related cognitions among military personnel (Bryan et al., 2014). The independent subscales did not demonstrate adequate internal consistency (αs <0.60); thus, only the SCS total score was utilized in analyses (α = 0.87).
2.3. Procedures
Participants were recruited from Army recruiter courses at the U.S. Recruiting and Retention School at Fort Jackson, South Carolina. Individuals electing to participate in the study completed self-report measures as a subset of a larger battery of non-research assessments in an orientation survey. Then, demographics data and information regarding number of mental health visits, MDEs, and episodes of suicide ideation and attempts both (1) prior to study enrollment and (2) during the 18-months study period were obtained from participants’ military medical records. MDEs were defined using DSM-IV-TR diagnostic criteria and were assessed by military psychiatrists, along with episodes of suicide ideation and attempts. No compensation was provided for study participation. All participants provided informed consent after the nature of the procedures had been fully explained. The Institutional Review Boards (IRB) of Fort Jackson and the university leading the investigation approved all procedures. The investigation was carried out in accordance with the latest version of the Declaration of Helsinki.
2.4. Data analytic plan
Due to the low rate of suicide ideation and attempts (<0.001% of participants) during the study, of our three suicide risk outcome measures, only MDE recurrences were evaluated. Due to the inclusion of over-dispersed count variables, negative binomial regression analyses with a robust estimation was used to assess the extent to which self-report measures were associated with the number of any type of mental health visits, mental health visits excluding standard screenings, and MDEs occurring (1) prior to study enrollment and (2) over 18 months, controlling for baseline mental health visits and MDEs. Consistent with similar prospective studies (e.g., Ribeiro et al., 2012), we controlled for these baseline variables to determine the unique contributions of suicide-related symptoms after accounting for the variance in our outcomes explained by their baseline values. An incidence rate ratio (IRR)2 was yielded for each predictor in each analysis. Between-predictor intercorrelations were in an acceptable range (VIF<5). Missing data analyses revealed that those with missing medical record data at follow-up were more likely to have had a prior MDE (t[1727] = 4.0, p < 0.001) and reported greater baseline agitation (t[1415] = 2.1, p = 0.033) and capability for suicide (t[1279] 2.7, p = 0.006). Sensitivity analyses revealed that we were powered to detect a minimum IRR of 1.013 (Power [1-β]>80%, Type 1 error [α] <0.05). Analyses were conducted using SPSS 20.0.0.
3. Results
3.1. Descriptive statistics
Table 2 presents descriptive statistics and intercorrelations for all self-report measures and outcome variables. The DSI-SS and SCS score distributions, in particular, had significant positive skews, which were expected given that suicidal ideation and cognitions are relatively rare. Since all measures assessed suicide-related symptoms, it is unsurprising that many were significantly associated with each other. Of note, the mean score for the DSI-SS was particularly low (M = 0.03, SD = 0.28). This may represent an accurate picture of this sample since Army recruiters are considered relatively high-functioning and required to receive treatment for psychiatric problems before beginning recruiting duties; thus, they may have lower suicidal ideation than other personnel. These low scores may also be related to a reluctance to disclose suicidal thoughts (Anestis and Green, 2015), but this was not directly probed.
Table 2.
Means, standard deviations, normality statistics, and intercorrelations of self-report measures, major depressive episodes, and mental health visits.
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1. ACSS | 1.00 | ||||||||||||
| 2. BAM | 0.04* | 1.00 | |||||||||||
| 3. DSI-SS | 0.03 | 0.23** | 1.00 | ||||||||||
| 4. INQ-PB | −0.01 | 0.42** | 0.33** | 1.00 | |||||||||
| 5. INQ-TB | −0.03 | 0.35** | 0.22** | 0.37** | 1.00 | ||||||||
| 6. ISI | 0.11** | 0.41** | 0.11** | 0.22** | 0.28** | 1.00 | |||||||
| 7. SCS | −0.01 | 0.42** | 0.53** | 0.56** | 0.34** | 0.21** | 1.00 | ||||||
| 8. MDE (T1) | −0.01* | 0.11** | 0.06** | 0.07** | 0.10** | 0.11** | 0.05** | 1.00 | |||||
| 9. MDE (T2) | −0.01* | 0.06** | 0.04** | 0.06** | 0.06** | 0.08** | 0.06** | 0.12** | 1.00 | ||||
| 10. MHV (T1) | 0.01 | 0.11** | 0.05** | 0.04* | 0.07** | 0.13** | 0.03 | 0.45** | 0.11** | 1.00 | |||
| 11. MHV (T2) | 0.03 | 0.10** | 0.04* | 0.06** | 0.06** | 0.11** | 0.04* | 0.07** | 0.39** | 0.11** | 1.00 | ||
| 12. NS-MHV (T1) | −0.01 | 0.09** | 0.04* | 0.02 | 0.02 | 0.08** | 0.02 | 0.33** | 0.07** | 0.73** | 0.09** | 1.00 | |
| 13. NS-MHV (T2) | 0.03 | 0.10” | 0.04* | 0.06** | 0.05 | 0.11** | 0.04* | 0.05** | 0.36** | 0.11** | 0.98** | 0.09** | 1.00 |
| M | 9.61 | 4.37 | 0.03 | 4.45 | 7.22 | 4.45 | 10.36 | 0.18 | 0.03 | 5.14 | 2.17 | 2.83 | 2.10 |
| SD | 3.24 | 2.56 | 0.28 | 1.77 | 4.50 | 3.70 | 1.72 | 0.60 | 0.25 | 8.46 | 10.21 | 7.11 | 10.06 |
| Range | 0–16 | 3–21 | 0–7 | 4–28 | 4–28 | 0–20 | 10–35 | 0–13 | 0–4 | 0–101 | 0–179 | 0–101 | 0–179 |
| Skew | −0.28 | 2.58 | 13.61 | 6.67 | 2.04 | 0.89 | 7.50 | 7.33 | 9.49 | 4.38 | 9.05 | 5.80 | 9.23 |
| Kurtosis | 0.11 | 7.97 | 239.05 | 60.89 | 4.93 | 0.33 | 69.69 | 105.38 | 99.44 | 26.84 | 104.81 | 47.47 | 109.57 |
| α | 0.76 | 0.85 | 0.70 | 0.87 | 0.90 | 0.87 | 0.87 | - | - | - | - | - | - |
p < 0.05;
p < 0.01.
Note: ACSS = Acquired Capability for Suicide Scale, BAM = Brief Agitation Measure, DSI-SS = Depressive Symptom Inventory–Suicidality Subscale, INQ-PB = Interpersonal Needs Questionnaire–Perceived Burdensomeness, INQ-TB = Interpersonal Needs Questionnaire–Thwarted Belongingness, ISI = Insomnia Severity Index, SCS = Suicide Cognitions Scale, MDE = Major Depressive Episode, NS = Non-Standard, MHV = Mental Health Visits.
3.2. Mental health visits of any type
3.2.1. Baseline
Negative binomial regression analyses revealed that scores on BAM agitation (IRR = 1.033; 95% CI: 1.007–1.060; p = 0.013), ISI insomnia (IRR = 1.028; 95% CI: 1.011–1.045; p = 0.001), and SCS hopelessness (IRR 0.967; 95% CI: 0.940–0.995 p = 0.020) were significantly associated with the number of visits at study enrollment, controlling for number of past MDEs (see Table 3).
Table 3.
Negative binomial regression results for any type of past mental health visits at baseline and during 18-month study period.
| Variable | Baseline | 18 Month follow-up | ||||
|---|---|---|---|---|---|---|
| IRR | 95% CI | p | IRR | 95% CI | p | |
| ACSS | 1.010 | 0.994, 1.026 | 0.207 | 1.045 | 0.992, 1.102 | 0.099 |
| BAM | 1.033* | 1.007, 1.060 | 0.013 | 1.091* | 1.004, 1.185 | 0.040 |
| DSI-SS | 1.106 | 0.926, 1.321 | 0.265 | 1.020 | 0.683, 1.522 | 0.923 |
| INQ-PB | 0.991 | 0.967, 1.016 | 0.493 | 0.996 | 0.928, 1.069 | 0.906 |
| INQ-TB | 0.999 | 0.986, 1.011 | 0.824 | 1.004 | 0.968, 1.043 | 0.816 |
| ISI | 1.028** | 1.011, 1.045 | 0.001 | 1.080** | 1.030, 1.132 | 0.001 |
| SCS | 0.967* | 0.940, 0.995 | 0.020 | 0.913* | 0.839, 0.993 | 0.033 |
| MDE (T1) | 2.466** | 2.210, 2.752 | <0.001 | 1.029 | 0.758, 1.398 | 0.853 |
| MDE (T2) | - | - | - | 4.643** | 3.390, 6.360 | <0.001 |
| MHV (T1) | - | - | - | 1.033** | 1.014, 1.053 | 0.001 |
p < 0.05;
p < 0.01.
Note: ACSS = Acquired Capability for Suicide Scale, BAM = Brief Agitation Measure, DSI-SS = Depressive Symptom Inventory–Suicidality Subscale, INQ-PB = Interpersonal Needs Questionnaire–Perceived Burdensomeness, INQ-TB = Interpersonal Needs Questionnaire–Thwarted Belongingness, ISI = Insomnia Severity Index, SCS = Suicide Cognitions Scale, MDE = Major Depressive Episode, MHV = Mental Health Visits.
3.2.2. Follow-up
Scores on BAM agitation (IRR = 1.091; 95% CI: 1.004–1.185; p = 0.040), ISI insomnia (IRR = 1.080; 95% CI: 1.030–1.132; p = 0.001), and SCS hopelessness (IRR 0.913; 95% CI: 0.839–0.993; p = 0.033) were the only significant predictors of the number of any type of mental health visits at follow-up, controlling for mental health visits at baseline and MDEs at baseline and follow-up (see Table 3).
3.3. Mental health visits excluding standard assessment visits
3.3.1. Baseline
Controlling for past MDEs, BAM agitation (IRR = 1.052; 95% CI: 1.010–1.095; p = 0.014), INQ-PB perceived burdensomeness (IRR = 0.930; 95% CI: 0.874–0.990; p = 0.023), and ISI insomnia (IRR 1.028; 95% CI: 1.004–1.053; p = 0.021) were significantly associated with the number of treatment visits at study entry, excluding standard physical/mental health assessments (see Table 4).
Table 4.
Negative binomial regression for any past mental health visits, excluding standard assessments, at baseline and during 18-month study period.
| Variable | Baseline | 18 Month follow-up | ||||
|---|---|---|---|---|---|---|
| IRR | 95% CI | p | IRR | 95% CI | p | |
| ACSS | 0.992 | 0.969, 1.016 | 0.504 | 1.050 | 0.994, 1.108 | 0.081 |
| BAM | 1.052* | 1.010, 1.095 | 0.014 | 1.090* | 1.005, 1.183 | 0.038 |
| DSI-SS | 0.974 | 0.794, 1.196 | 0.803 | 1.055 | 0.684, 1.629 | 0.809 |
| INQ-PB | 0.930* | 0.874, 0.990 | 0.023 | 0.997 | 0.929, 1.069 | 0.928 |
| INQ-TB | 0.991 | 0.971, 1.012 | 0.414 | 1.005 | 0.966, 1.046 | 0.805 |
| ISI | 1.028* | 1.004, 1.053 | 0.021 | 1.085** | 1.032, 1.140 | 0.001 |
| SCS | 1.016 | 0.966, 1.069 | 0.535 | 0.915* | 0.839, 0.998 | 0.045 |
| MDE (T1) | 2.871** | 2.456, 3.357 | <0.001 | 1.068 | 0.810, 1.408 | 0.641 |
| MDE (T2) | - | - | - | 4.499** | 3.272, 6.186 | <0.001 |
| NS MHV (T1) | - | - | - | 1.030** | 1.010, 1.051 | 0.004 |
p < 0.05;
p < 0.01.
Note: ACSS = Acquired Capability for Suicide Scale, BAM = Brief Agitation Measure, DSI-SS = Depressive Symptom Inventory–Suicidality Subscale, INQ-PB = Interpersonal Needs Questionnaire–Perceived Burdensomeness, INQ-TB = Interpersonal Needs Questionnaire–Thwarted Belongingness, ISI=Insomnia Severity Index, SCS = Suicide Cognitions Scale, MDE = Major Depressive Episode, NS = Non-Standard, MHV = Mental Health Visits.
3.3.2. Follow-up
Scores on BAM agitation (IRR = 1.090; 95% CI: 1.005–1.183; p = 0.038), ISI insomnia (IRR = 1.085; 95% CI: 1.032–1.140; p = 0.001), and SCS hopelessness (IRR = 0.915; 95% CI: 0.839–0.998; p = 0.045) significantly predicted the number of visits that were not standard assessments at follow-up, controlling for non-standard mental health visits at baseline and MDEs at baseline and follow-up (see Table 4).
3.4. Major depressive episodes
3.4.1. Baseline
Only scores on ISI insomnia (IRR = 1.043; 95% CI: 1.010–1.078; p = 0.010) and INQ-TB thwarted belongingness (IRR = 1.034; 95% CI: 1.010–1.059; p = 0.005) were significantly associated with number of MDEs at study enrollment, controlling for baseline mental health visits (Table 5). In other words, for every one-unit increase in participants’ baseline ISI scores, the number of prior MDEs increased by a factor of 1.034.
Table 5.
Negative binomial regression for major depressive episodes at baseline and during 18-month study period.
| Variable | Baseline | 18 Month follow-up | ||||
|---|---|---|---|---|---|---|
| IRR | 95% CI | p | IRR | 95% CI | p | |
| ACSS | 0.986 | 0.954, 1.019 | 0.392 | 0.966 | 0.891, 1.048 | 0.408 |
| BAM | 1.022 | 0.975, 1.071 | 0.363 | 0.996 | 0.910, 1.090 | 0.930 |
| DSI-SS | 1.035 | 0.803, 1.334 | 0.790 | 0.944 | 0.543, 1.640 | 0.838 |
| INQ-PB | 1.005 | 0.957, 1.055 | 0.840 | 1.007 | 0.921, 1.101 | 0.879 |
| INQ-TB | 1.034** | 1.010, 1.059 | 0.005 | 1.041 | 0.974, 1.114 | 0.235 |
| ISI | 1.043* | 1.010, 1.078 | 0.010 | 1.104* | 1.024, 1.190 | 0.010 |
| SCS | 0.997 | 0.942, 1.056 | 0.923 | 1.058 | 0.971, 1.152 | 0.201 |
| MDE (T1) | - | - | - | 1.429* | 1.023, 1.997 | 0.037 |
| MHV (T1) | 1.075** | 1.061, 1.088 | <0.001 | 1.030** | 1.008, 1.052 | 0.008 |
p < 0.05;
p < 0.01.
Note: ACSS = Acquired Capability for Suicide Scale, BAM = Brief Agitation Measure, DSI-SS = Depressive Symptom Inventory–Suicidality Subscale, INQ-PB = Interpersonal Needs Questionnaire–Perceived Burdensomeness, INQ-TB = Interpersonal Needs Questionnaire–Thwarted Belongingness, ISI = Insomnia Severity Index, SCS = Suicide Cognitions Scale, MDE = Major Depressive Episode, MHV = Mental Health Visits.
3.4.2. Follow-up
ISI insomnia was the only significant predictor of MDEs during the study period (IRR = 1.104; 95% CI: 1.024–1.190; p = 0.010), controlling for baseline MDEs and mental health visits. That is, for every one-unit increase in participants’ baseline ISI scores, the number of MDEs experienced during the study increased by a factor of 1.104. Of note, prior MDEs also significantly predicted number of MDEs over the study period (IRR = 1.429; 95% CI: 1.023–1.997; p = 0.037). Otherwise stated, for every prior MDE, the number of MDEs experienced by a participant during the study increased by a factor of 1.429.
4. Discussion
This study identified suicide-related symptoms that bring soldiers to mental health treatment and predict treatment engagement and MDEs. Greater agitation, more severe insomnia, and lower suicide-specific hopelessness predicted the number of mental health visits at baseline and over the course of the study, above and beyond other symptoms. These three symptoms were also the only significant predictors of number of voluntary mental health visits attended across 18 months, even controlling for past visits. Finally, only insomnia was significantly associated with prior and future MDEs. These findings have implications for research and practice.
First, findings suggest that insomnia and agitation are important motivating factors both for connection and ongoing contact with mental health services, independent of MDE occurrences. One interpretation of this finding is that sleep problems and agitation are particularly distressing and consequently prompt individuals to seek services and continue attending treatment visits. However, since suicidal ideation and suicide-specific hopelessness are likely to be similarly distressing, this finding may instead signal that service members are more willing to report agitation and insomnia symptoms on self-report surveys, and, relatedly, are more comfortable seeking out services for these problems. As discussed previously, stigma is a barrier to care among military service members (Vogt, 2011; Blais et al., 2014; Britt et al., 2015), so it is understandable that military personnel may be less likely to seek support for suicide-related hopelessness or perceptions of being burdensome than for sleep problems.
Thus, sleep disturbances may represent a useful, non-stigmatizing entry point into mental health care, emphasizing the importance of its assessment by primary care providers, with whom at-risk individuals may be more likely to interface (Luoma et al., 2002). Additionally, since sleep disturbances are relatively observable, improving recognition of symptoms by laypersons may be useful, particularly in light of evidence suggesting that family and friend encouragement facilitates mental health help-seeking (Warner et al., 2008; Hipes, 2012). At-risk service members can then be referred to insomnia treatment, and perhaps, ultimately, treatment for other psychiatric symptoms. Fortunately, behavioral treatments for insomnia—which can be cost-effectively disseminated in group format—have been shown to be efficacious in treating insomnia (Edinger and Means, 2005) as well as facilitating improvements in depression and posttraumatic stress disorder (PTSD) symptoms (Manber et al., 2008, 2011; Ulmer et al., 2011). Therefore, the assessment and treatment of sleep problems may indirectly improve other mental health problems germane to military personnel.
Interestingly, individuals with greater suicide-related hopelessness—and thus, likely greater suicide risk—were less likely to seek care than those with lower hopelessness. This aligns with past literature suggesting that those with more severe suicidal symptoms are also less likely to engage in treatment (Carlton and Deane, 2000; Deane et al., 2001). Though reasons for these findings cannot be determined from our data, prior research suggests that poor coping skills and hopelessness regarding treatment effectiveness may in part explain this relationship (see Hom et al., 2015 for review). Regardless of underlying mechanisms, this finding is concerning and emphasizes the importance of following large-scale risk screening with connection of at-risk individuals to care. Motivational interviewing (Miller and Rollnick, 2013) may be particularly helpful in enhancing motivation and self-efficacy to engage in treatment.
Considering agitation as a treatment engagement predictor, there is a dearth of literature on non-pharmacological methods that therapeutically impact an agitated state. Agitation may prompt individuals to seek care, but it is also a state that may resolve with the passage of time, perhaps making it more difficult to address in a treatment setting. Due to this, while agitation may be an indicator of willingness to engage in treatment, at the present time, sleep problems may be a more helpful focus of ongoing treatment efforts (though acute agitation is clinically worrisome and pharmacological management of it, as well as ongoing assessment of its severity and co-occurrence with other suicide risk factors, should be considered).
Relatedly, these findings highlight insomnia as a potentially useful proxy for gauging future MDE risk. This aligns with longitudinal studies that have identified insomnia as a risk factor for MDEs (Ford and Kamerow, 1989; Buysse et al., 2008). Indeed, a meta-analysis of 21 studies found that insomnia conferred an approximately two-fold risk for subsequent depression (Baglioni et al., 2011). Our study extends these findings by establishing the predictive relationship between insomnia and depression in an Army recruiter sample, even after accounting for the effects for other suicide-related constructs—which has, to our knowledge, not previously been examined. While insomnia severity may have predicted MDEs because insomnia itself is a DSM-5 MDE symptom, our findings and past research suggest otherwise—past research has demonstrated a temporal relationship between insomnia and depression (see Baglioni et al., 2011 for review). Additionally, MDEs were controlled for in present analyses. Thus, our findings suggest that insomnia severity conferred risk for future MDEs in this military sample independent of other depression symptoms (e.g., agitation, suicidal ideation).
Given this, as previously noted, it may be useful to screen for clinically significant insomnia symptoms to identify service members who may benefit from treatment for sleep problems and/or depression symptoms, if present or emerging (Franzen and Buysse, 2008). As demonstrated within this study, insomnia complaints can be easily assessed using a brief self-report measure and behavioral insomnia treatments are brief and extremely effective (Edinger and Means, 2005). Thus, assessment and treatment of insomnia are feasibly incorporable into current military mental health treatment and other health settings.
4.1. Limitations and future directions
There are a number of study limitations. Because our sample was of relatively low suicide risk, these findings’ direct relevance to suicide prevention is limited, and further research is warranted to test study aims in a higher suicide risk military sample. Furthermore, in terms of our findings’ clinical utility, given the relatively small effect sizes for significant effects, we caution against over-interpretation of these results and emphasize the need for replication of these findings. However, these results represent positive preliminary work and signal that important associations may exist between these constructs. To address this study’s methodological constraints, it will be useful to utilize a more clinically heterogeneous and high-risk sample, self-report and clinician-assessed symptom data at multiple follow-up time points, measures of depression symptom severity, and explicit assessment of participants’ rationale for treatment engagement. By employing these techniques, results will likely better reflect the true magnitude of effects. Replication of findings may also inform the establishment of clinical cutoffs that will allow for the targeted study of treatment engagement among those with elevated psychiatric symptoms. Such cutoffs would also aid in identifying the extent to which a service member with clinically significant insomnia is more likely to develop depression as compared to one without marked insomnia. Additionally, it would be useful to identify clinically meaningful effect sizes for various predictors of MDEs and service use. The notable portion of missing data may have also impacted findings.
It is also important to consider the possibility that insomnia and agitation predicted mental health visits simply because they are depression symptoms, and more severe depression symptoms may prompt service members to seek care. Both are also symptoms of other psychiatric disorders, so some participants may have sought care for non-depression complaints. Still, other constructs assessed (e.g., suicidal ideation, hopelessness) are also depression symptoms but did not significantly predict mental health visits. Additionally, even when controlling for MDEs, insomnia and agitation remained significant predictors of mental health visits. This suggests that both are meaningful signifiers of willingness to engage in care. Finally, it is possible that insomnia and agitation were only associated with past mental health visits because these symptoms were unsuccessfully treated by prior care. Despite this, that these symptoms predicted future treatment visits even when controlling for past visits suggests that these are important treatment engagement motivators.
Other study limitations include its relatively long follow-up period since short-term outcomes may be more clinically useful. As such, it is recommended that outcomes are assessed within a shorter time frame (e.g., days, weeks). However, this longer follow-up period also served as a strength by enhancing our ability to assess treatment engagement behaviors and MDE onset, which may precede suicidal behaviors. The use of self-report measures at baseline but medical record data at follow-up may have also limited our ability to assess symptom fluctuations. Yet, this design likely reduced the inflation of correlations due to common method variance. Sole reliance on military medical record data was another limitation of this study since individuals may have sought care elsewhere. To circumvent barriers to disclosure, future studies would also benefit from inclusion of multiple modes of observation and implicit ideation measures (Nock and Banaji, 2007; Nock et al., 2010). Relatedly, assessment of factors impacting treatment engagement (e.g., attitudes towards care) could be incorporated in future studies.
5. Conclusion
In sum, results revealed that self-reported agitation and sleep problems were both associated with greater past engagement in mental health services and predicted greater treatment engagement over the course of 18 months, independent of other suicide-related symptoms. Insomnia severity also outperformed these other symptoms as a predictor of MDEs. Consequently, assessment of insomnia and agitation may be promising in identifying military service members both in need of and willing to engage in treatment. We look forward to additional research that addresses the gaps of this study, including further investigation into symptoms that may best predict suicidal behaviors among a higher suicide risk, more representative military sample.
Acknowledgment
This work was supported in part by a United States Army Military Operational Medicine Research Program (MOMRP) grant (W81XWH-09-1-0737); a grant from the Military Suicide Research Consortium (MSRC), an effort supported by the Office of the Assistant Secretary of Defense for Health Affairs under Award No. (W81XWH-10-2-0181); and a training grant (T32MH18921) from the National Institute of Mental Health. Opinions, interpretations, conclusions and recommendations are those of the author and are not necessarily endorsed by the Department of Defense, Department of Veterans Affairs, MSRC, or National Institute of Mental Health. We also gratefully acknowledge the critical feedback provided by the anonymous reviewers.
Role of funding source
The funding source had no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; and the decision to submit the article for publication.
Footnotes
Conflicts of interest
The authors have no conflicts of interest to disclose.
The adapted version of the INQ used within this study utilized items from the INQ-25 and INQ-15. It also included an item designed specifically to address perceived burdensomeness within a military population (“These days I think I am an asset to the people in my life”), which strongly loaded onto the perceived burdensomeness construct.
IRRs are interpreted as follows: for every one-unit increase in a suicide-related symptom, the number of observations that occurred (e.g., number of MDEs or number of treatment visits) increases by a factor of the IRR. For example, if analyses examining the ISI’s ability to predict MDEs yields an IRR of 2, this can be interpreted as follows: for every one-unit increase in the ISI, participants’ number of MDEs increase by a factor of 2.
References
- Anestis MD, Green BA, 2015. October The impact of varying levels of confidentiality on disclosure of suicidal thoughts in a sample of United States National Guard personnel. J. Clin. Psychol 71 (10), 1023–1030. [DOI] [PubMed] [Google Scholar]
- Baglioni C, Battagliese G, Feige B, Spiegelhalder K, Nissen C, Voderholzer U, et al. , 2011. Insomnia as a predictor of depression: a meta-analytic evaluation of longitudinal epidemiological studies. J. Affect Disord 135 (1e3), 10–19. [DOI] [PubMed] [Google Scholar]
- Bastien CH, Vallieres A, Morin CM, Vallieres A, Morin CM, 2001. Validation of the Insomnia Severity Index as an outcome measure for insomnia research. Sleep. Med 2 (4), 297–307. [DOI] [PubMed] [Google Scholar]
- Beck AT, 1986. Hopelessness as a predictor of eventual suicide. Ann. N. Y. Acad. Sci 487, 90–96. [DOI] [PubMed] [Google Scholar]
- Bernert RA, Joiner TE Jr., Cukrowicz KC, Schmidt NB, Krakow B, 2005. Suicidality and sleep disturbances. Sleep 28 (9), 1135–1141. [DOI] [PubMed] [Google Scholar]
- Bernert RA, Turvey CL, Conwell Y, Joiner TE, 2014. Association of poor subjective sleep quality with risk for death by suicide during a 10-year period: a longitudinal, population-based study of late life. JAMA Psychiatry 71 (10), 1129–1137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blais RK, Renshaw KD, Jakupcak M, 2014. Posttraumatic stress and stigma in active-duty service members relate to lower likelihood of seeking support. J. Trauma Stress 27 (1), 116–119. [DOI] [PubMed] [Google Scholar]
- Bostwick JM, Pankratz VS, 2000. Affective disorders and suicide risk: a reexamination. Am. J. Psychiatry 157 (12), 1925–1932. [DOI] [PubMed] [Google Scholar]
- Brenner LA, Barnes SM, 2012. Facilitating treatment engagement during high-risk transition periods: a potential suicide prevention strategy. Am. J. Public Health 102 (Suppl. S12–514). [DOI] [PMC free article] [PubMed] [Google Scholar]
- Britt TW, Jennings KS, Cheung JH, Pury CL, Zinzow HM, 2015. The role of different stigma perceptions in treatment seeking and dropout among active duty military personnel. Psychiatr. Rehabil. J 38 (2), 142–149. [DOI] [PubMed] [Google Scholar]
- Britton PC, Conner KR, Maisto SA, 2012. An open trial of motivational interviewing to address suicidal ideation with hospitalized veterans. J. Clin. Psychol 68 (9), 961–971. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bruffaerts R, Demyttenaere K, Hwang I, Chiu WT, Sampson N, Kessler RC, et al. , 2011. Treatment of suicidal people around the world. Br. J. Psychiatry 199(1), 64–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bryan CJ, Morrow CE, Anestis MD, Joiner TE, 2010. A preliminary test of the interpersonal-psychological theory of suicidal behavior in a military sample. Pers. Individ. Dif 48 (3), 347–350. [Google Scholar]
- Bryan CJ, Rudd MD, Wertenberger E, Etienne N, Ray-Sannerud BN, Morrow CE, et al. , 2014. Improving the detection and prediction of suicidal behavior among military personnel by measuring suicidal beliefs: an evaluation of the suicide cognitions scale. J. Affect Disord 159, 15–22. [DOI] [PubMed] [Google Scholar]
- Buysse DJ, Angst J, Gamma A, Ajdacic V, Eich D, Rössler W, 2008. Prevalence, course, and comorbidity of insomnia and depression in young adults. Sleep 31(4), 473–480. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carlton PA, Deane FP, 2000. Impact of attitudes and suicidal ideation on adolescents’ intentions to seek professional psychological help. J. Adolesc 23 (1), 35–45. [DOI] [PubMed] [Google Scholar]
- Cavanagh JT, Carson AJ, Sharpe M, Lawrie SM, 2003. Psychological autopsy studies of suicide: a systematic review. Psychol. Med 33 (3), 395–405. [DOI] [PubMed] [Google Scholar]
- Chu C, Klein KM, Buchman-Schmitt JM, Hom MA, Hagan CR, Joiner TE, 2015. Routinized assessment of suicide risk in clinical practice: an empirically informed update. J. Clin. Psychol 71 (12), 1186–1200. [DOI] [PubMed] [Google Scholar]
- Deane FP, Wilson CJ, Ciarrochi J, 2001. Suicidal ideation and help-negation: not just hopelessness or prior help. J. Clin. Psychol 57 (7), 901–914. [DOI] [PubMed] [Google Scholar]
- Edinger JD, Means MK, 2005. Cognitive-behavioral therapy for primary insomnia. Clin. Psychol. Rev 25 (5), 539–558. [DOI] [PubMed] [Google Scholar]
- Ellis TE, Rufino KA, 2015. A psychometric study of the suicide cognitions scale with psychiatric inpatients. Psychol. Assess 27 (1), 82–89. [DOI] [PubMed] [Google Scholar]
- Fawcett J, Scheftner WA, Fogg L, Clark DC, Young MA, Hedeker D, et al. , 1990. Time-related predictors of suicide in major affective disorder. Am. J. Psychiatry 147 (9), 1189–1194. [DOI] [PubMed] [Google Scholar]
- Ford DE, Kamerow DB, 1989. Epidemiologic study of sleep disturbances and psychiatric disorders. An opportunity for prevention? JAMA 262 (11), 1479–1484. [DOI] [PubMed] [Google Scholar]
- Franzen PL, Buysse DJ, 2008. Sleep disturbances and depression: risk relationships for subsequent depression and therapeutic implications. Dialogues Clin. Neurosci 10 (4), 473–481. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hall RC, Platt DE, 1999. Suicide risk assessment: a review of risk factors for suicide in 100 patients who made severe suicide attempts. Evaluation of suicide risk in a time of managed care. Psychosomatics 40 (1), 18–27. [DOI] [PubMed] [Google Scholar]
- Hipes C, 2012. The stigma of mental health treatment in the military: an experimental approach. Curr. Res. Soc. Psychol (5), 18. [Google Scholar]
- Hom MA, Stanley IH, Joiner TE, 2015. Evaluating factors and interventions that influence help-seeking and mental health service utilization among suicidal individuals: a review of the literature. Clin. Psychol. Rev 40, 28–39. [DOI] [PubMed] [Google Scholar]
- Joiner TE, 2005. Why People Die by Suicide Harvard University Press, Cambridge, MA. [Google Scholar]
- Joiner TE, Pfaff JJ, Acres JG, 2002. A brief screening tool for suicidal symptoms in adolescents and young adults in general health settings: reliability and validity data from the Australian National General Practice Youth Suicide Prevention Project. Behav. Res. Ther 40 (4), 471–481. [DOI] [PubMed] [Google Scholar]
- Knox KL, Stanley B, Currier GW, Brenner L, Ghahramanlou-Holloway M, Brown G, 2012. An emergency department-based brief intervention for veterans at risk for suicide (SAFE VET). Am. J. Public Health 102, 33–37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kuehn BM, 2009. Soldier suicide rates continue to rise: military, scientists work to stem the tide. JAMA 301 (11), 1111–1113. [DOI] [PubMed] [Google Scholar]
- Luoma JB, Martin CE, Pearson JL, 2002. June Contact with mental health and primary care providers before suicide: a review of the evidence. Am. J. Psychiatry 159 (6), 909e916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Manber R, Bernert RA, Suh S, Nowakowski S, Siebern AT, Ong JC, 2011. CBT for insomnia in patients with high and low depressive symptom severity: adherence and clinical outcomes. J. Clin. Sleep. Med 7 (6), 645–652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Manber R, Edinger JD, Gress JL, San Pedro-Salcedo MG, Kuo TF, Kalista T, 2008. Cognitive behavioral therapy for insomnia enhances depression outcome in patients with comorbid major depressive disorder and insomnia. Sleep 31(4), 489–495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mann JJ, Apter A, Bertolote J, Beautrais A, Currier D, Haas A, et al. , 2005. Suicide prevention strategies: a systematic review. JAMA 294 (16), 2064–2074. [DOI] [PubMed] [Google Scholar]
- Metalsky GI, Joiner TEJ, 1997. The hopelessness depression symptom questionnaire. Cogn. Ther. Res 21 (3), 359–384. [Google Scholar]
- Miller WR, Rollnick S, 2013. Motivational Interviewing: Helping People Change, third ed. Guilford Press, New York, NY. [Google Scholar]
- Morin CM, Belleville G, Bélanger L, Ivers H, Belanger L, Ivers H, 2011. The insomnia severity index: psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep 34 (5), 601–608. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nock MK, Banaji MR, 2007. Assessment of self-injurious thoughts using a behavioral test. Am. J. Psychiatry 164 (5), 820–823. [DOI] [PubMed] [Google Scholar]
- Nock MK, Borges G, Bromet EJ, Cha CB, Kessler RC, Lee S, 2008. January Suicide and suicidal behavior. Epidemiol. Rev 30, 133–154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nock MK, Deming CA, Fullerton CS, Gilman SE, Goldenberg M, Kessler RC, et al. , 2013. Suicide among soldiers: a review of psychosocial risk and protective factors. Psychiatry Interpers. Biol. Process 76 (2), 97–125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nock MK, Park JM, Finn CT, Deliberto TL, Dour HJ, Banaji MR, 2010. Measuring the suicidal mind: implicit cognition predicts suicidal behavior. Psychol. Sci 21 (4), 511–517. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Orden KA, Cukrowicz KC, Witte TK, Joiner TE, 2012. Thwarted belongingness and perceived burdensomeness: construct validity and psychometric properties of the interpersonal needs questionnaire. Psychol. Assess 24 (1), 197–215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Orden KA, Witte TK, Cukrowicz KC, Braithwaite SR, Selby EA, Joiner TE Jr., 2010. The interpersonal theory of suicide. Psychol. Rev 117 (2), 575–600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Orden KA, Witte TK, Gordon KH, Bender TW, Joiner TE, 2008. Suicidal desire and the capability for suicide: tests of the interpersonal-psychological theory of suicidal behavior among adults. J. Consult Clin. Psychol 76 (1), 72–83. [DOI] [PubMed] [Google Scholar]
- Ribeiro JD, Bender TW, Buchman JM, Nock MK, Rudd MD, Bryan CJ, et al. , 2015. An investigation of the interactive effects of the capability for suicide and acute agitation on suicidality in a military sample. Depress Anxiety 32 (1), 25c31. [DOI] [PubMed] [Google Scholar]
- Ribeiro JD, Bender TW, Selby EA, Hames JL, Joiner TE, 2011. Development and validation of a brief self-report measure of agitation: the brief agitation measure. J. Pers. Assess 93 (6), 597–604. [DOI] [PubMed] [Google Scholar]
- Ribeiro JD, Pease JL, Gutierrez PM, Silva C, Bernert RA, Rudd MD, et al. , 2012. Sleep problems outperform depression and hopelessness as cross-sectional and longitudinal predictors of suicidal ideation and behavior in young adults in the military. J. Affect Disord 136 (3), 743e750. [DOI] [PubMed] [Google Scholar]
- Ribeiro JD, Witte TK, Van Orden KA, Selby EA, Gordon KH, Bender TW, et al. , 2014. Fearlessness about death: the psychometric properties and construct validity of the revision to the acquired capability for suicide scale. Psychol. Assess 26 (1), 115e126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rudd MD, Berman AL, Joiner TE, Nock MK, Silverman MM, Mandrusiak M, et al. , 2006. Warning signs for suicide: theory, research, and clinical applications. Suicide Life Threat Behav 36 (3), 255–262. [DOI] [PubMed] [Google Scholar]
- Rudd MD, Bryan CJ, Wertenberger EG, Peterson AL, Young-McCaughan S, Mintz J, et al. , 2015. Brief cognitive-behavioral therapy effects on post-treatment suicide attempts in a military sample: results of a randomized clinical trial with 2-year follow-up. Am. J. Psychiatry 172 (5), 441–449. [DOI] [PubMed] [Google Scholar]
- Rudd MD, Joiner TE, Rajab H, 2001. Treating Suicidal Behavior: an Effective Time-limited Approach Guilford Press, New York, NY. [Google Scholar]
- Rudd MD, Schmitz B, McClenen R, Joiner T, Elkins G, 2008. Development of a measure of suicide-specific hopelessness: the suicide cognitions scale Unpubl. Manuscr.
- Schoenbaum M, Kessler RC, Gilman SE, Colpe LJ, Heeringa SG, Stein MB, et al. , 2014. Predictors of suicide and accident death in the army study to assess risk and resilience in servicemembers (Army STARRS): results from the army study to assess risk and resilience in servicemembers (Army STARRS). JAMA Psychiatry 71 (5), 493–503. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Selby EA, Anestis MD, Bender TW, Ribeiro JD, Nock MK, Rudd MD, et al. , 2010. Overcoming the fear of lethal injury: evaluating suicidal behavior in the military through the lens of the interpersonal-psychological theory of suicide. Clin. Psychol. Rev 30 (3), 298–307. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Trockel M, Karlin BE, Taylor CB, Brown GK, Manber R, 2015. Effects of cognitive behavioral therapy for insomnia on suicidal ideation in veterans. Sleep 38 (2), 259–265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- U.S. Department of Health and Human Services [HHS], 2012. Office of the Surgeon General and National Action Alliance for Suicide Prevention. National Strategy for Suicide Prevention 2012 Goals and Objectives for Action, Washington, DC. [PubMed] [Google Scholar]
- Ulmer CS, Edinger JD, Calhoun PS, 2011. A multi-component cognitive-behavioral intervention for sleep disturbance in veterans with PTSD: a pilot study. J. Clin. Sleep. Med 7 (1), 57–68. [PMC free article] [PubMed] [Google Scholar]
- Vogt D, 2011. Mental health-related beliefs as a barrier to service use for military personnel and veterans: a review. Psychiatr. Serv 62 (2), 135–142. [DOI] [PubMed] [Google Scholar]
- Warner CH, Appenzeller GN, Mullen K, Warner CM, Grieger T, 2008. Soldier attitudes toward mental health screening and seeking care upon return from combat. Mil. Med 173 (6), 563–569. [DOI] [PubMed] [Google Scholar]
