Abstract
Purpose
To determine the efficacy of behavioral and pharmacological interventions for insomnia among individuals with alcohol use disorder (AUD).
Procedures
Comprehensive literature searches of psychological, medical, and educational databases were conducted through October 2016. Eligible studies evaluated the efficacy of an insomnia intervention, included a comparison condition, sampled individuals with AUD and either insomnia disorder or complaints of insomnia, assessed sleep-related outcomes, and provided relevant statistics to calculate between-group effect sizes. Effect sizes were estimated for sleep quality, days of alcohol abstinence, and symptoms of depression. Type of intervention (behavioral versus pharmacological) was tested as a moderator of intervention efficacy.
Main Findings
Nine studies met eligibility criteria and were included in the final review and meta-analysis. Random-effects models indicated that intervention participants reported greater improvements in sleep quality (d+ =0.62, 95%CI= 0.28, 0.97) and symptoms of depression (d+ =0.52, 95%CI= 0.06, 0.98) than control participants. Participants reported significantly greater improvements in sleep quality in response to behavioral (d+ =1.20, 95%CI= 0.70, 1.70) as opposed to pharmacological (d+ =0.43, 95%CI= 0.19, 0.67) interventions. Behavioral (d+ =0.74, 95%CI= 0.31, 1.18) and pharmacological (d+ =0.08, 95%CI= −0.64, 0.78) interventions did not have significantly different effects on depressive symptoms. Neither behavioral nor pharmacological interventions improved rates of alcohol abstinence.
Conclusions
Insomnia interventions improve sleep quality and reduce symptoms of depression among individuals with comorbid AUD. Given the methodological weaknesses of studies reviewed, additional research is needed to determine the efficacy of insomnia treatment in improving rates of alcohol relapse within this population.
Keywords: sleep, drinking, alcohol dependence, depression, intervention
1. Introduction
Insomnia symptoms are common among individuals with alcohol use disorder (AUD), with rates as high as 74% among those who are actively drinking, 69% during early recovery, and 50% after four weeks of sobriety (Brower et al., 2001; Chaudhary et al., 2015; Kolla et al., 2014). Both insomnia and AUD have been associated with negative outcomes ranging from motor vehicle accidents to suicide (Bernert et al., 2015; Callaghan et al., 2013; Watson et al., 2015; Yoon-kyu et al., 2016). Together, these conditions exact substantial economic cost to the United States, with $224 per year dedicated to the management of heavy alcohol use (Bouchery et al., 2011) and approximately $100 billion spent on conditions associated with sleep disorders (Pollack et al., 2009). Thus, the co-occurrence of insomnia and AUD is prevalent and costly.
While the association between sleep and alcohol use is bidirectional (Chakravorty et al., 2016), symptoms of insomnia seem to play a unique role in the development and maintenance of substance use disorders. Difficulty initiating and maintaining sleep have been identified as prospective predictors of alcohol and other drug use in studies of children (Wong et al., 2009), adolescents (Hasler et al., 2016; Miller et al., 2017), and adults (Breslau et al., 1996; Weissman et al., 1997). Moreover, in the context of alcohol treatment, insomnia symptoms have been shown to precede and predict relapse to alcohol use (Brower et al., 2001; Malcolm et al., 2007; Smith et al., 2014). Thus, persistent insomnia symptoms may be barriers to effective, long-term recovery from AUD.
Given the negative impact of insomnia symptoms on alcohol-related outcomes, resolution of these symptoms may positively impact rates of alcohol relapse. Historically, the most common approach to insomnia treatment has been pharmacological. In general, pharmacological treatment of insomnia begins with a short- to intermediate-acting benzodiazepine receptor agonist (e.g., zolpidem or eszopiclone) (Schutte-Rodin et al., 2008). However, these medications are generally avoided for patients with AUD due to potential for abuse and risk of overdose when used in combination with alcohol (Brower, 2015). Indeed, in a survey of addiction medicine physicians, only 22% of respondents reported offering insomnia medication to the majority of their AUD patients (Friedmann et al., 2003). Given that the majority of AUD patients report insomnia symptoms (Chaudhary et al., 2015), these data suggest that pharmacological treatment options for insomnia are underutilized for patients with AUD.
Over the past two decades, behavioral interventions have been recommended as the first line of treatment for insomnia in adults (Schutte-Rodin et al., 2008; Siebern and Manber, 2011). Cognitive Behavioral Therapy for Insomnia (CBT-I), in particular, has been effective in reducing insomnia symptoms, both as a primary diagnosis and in the presence of medical and psychiatric disorders (Siebern and Manber, 2011; Smith et al., 2005). Behavioral treatments may be preferable to medication in the context of AUD because they are longer-lasting and, theoretically, may break the cycle of using substances to manage distress (Brower, 2015).
Recent reviews have summarized the clinical manifestations, etiology, assessment, and treatment of insomnia in the context of AUD (Brooks and Wallen, 2014; Brower, 2015; Chakravorty, Chaudhary, et al., 2016). However, none have quantified the impact of various insomnia treatments on sleep- and alcohol-related outcomes. To fill this gap, we used meta-analysis to summarize the empirical evidence regarding the efficacy of insomnia interventions in improving sleep quality, rates of alcohol abstinence, and symptoms of depression among individuals with AUDs. We hypothesized that insomnia treatment would improve sleep quality among patients with AUD. Given the associations between insomnia symptoms and both relapse to alcohol use (Brower, 2015) and symptoms of depression (Li et al., 2016), we also hypothesized that insomnia treatment would improve rates of alcohol abstinence and symptoms of depression among patients with AUD. Finally, because behavioral treatment has been associated with longer-term improvements in insomnia than pharmacological treatment (Mitchell et al., 2012), we hypothesized that behavioral treatment of insomnia would be more effective than pharmacological treatment in improving sleep- and alcohol-related outcomes.
2. Method
2.1. Overview
This systematic review and meta-analysis was prepared using guidelines outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA; Moher et al., 2009). The PRISMA checklist can be found in the supplementary materials.
2.2. Eligibility Criteria
Studies were included if they (a) evaluated the efficacy of an intervention designed to improve insomnia-related sleep complaints, (b) included a control or comparison condition, (c) sampled individuals with AUD, (d) sampled individuals with insomnia disorder or complaints of insomnia, (e) assessed sleep-related outcomes, and (f) provided relevant statistics to calculate between-group effect sizes. Studies were excluded if they (a) did not assess sleep and alcohol use in humans, (b) strictly reviewed the literature, (c) did not sample individuals with AUD, (d) did not evaluate a sleep intervention, (e) did not include a control or comparison condition, (f) sampled individuals who did not report a sleep complaint, (g) sampled individuals in alcohol withdrawal, or (h) did not report sleep-related outcomes (see Figure 1).
Figure 1.
PRIMSA flow diagram
2.3. Information Sources
Comprehensive searches of psychological, medical, and educational databases were conducted to identify records that reported results of insomnia interventions for individuals with AUD. Electronic databases included PsycINFO, PubMed, EMBASE, Educational Resources Information Clearinhouse (ERIC), SocIndex, Cumulative Index to Nursing and Allied Health (CINAHL), Cochrane Library, Web of Science, Global Health, and ProQuest Dissertations. The electronic bibliographic database searches were conducted in October 2016. We also reviewed the reference sections of relevant reviews for any additional manuscripts not found from the electronic database searches.
2.4. Search Strategy
The database searches were conducted using a Boolean strategy to search for terms related to insomnia and alcohol use disorders. For example, the search string for PsycINFO included the following terms: (“alcohol use disorder” OR “alcohol dependence” OR “alcohol-related disorder” OR alcohol* OR “alcohol abuse”) AND (sleep OR insomnia OR nightmare*) AND (intervention OR prevention OR treatment OR therapy OR “drug therapy” OR pharmacological OR pharmacotherapy OR medication OR “medical treatment” OR RCT). The search terms were modified as needed to meet individual database search guidelines.
2.5. Study Selection
MBM screened and reviewed articles for eligibility criteria, first reviewing titles and abstracts of all records and then requesting full texts of those that were potentially relevant. KBC and LAJSS reviewed and provided feedback on potentially relevant records. The final set of studies included in the systematic review and meta-analysis were reviewed and agreed upon by all authors.
2.6. Data Collection and Items
The authors developed a data abstraction sheet for the present study, pilot tested it on 6 randomly selected records that met eligibility criteria, and refined it accordingly. Two trained reviewers independently extracted data regarding study information (e.g., publication year and source), sample characteristics (e.g., sample size, age), design and measurement specifics (e.g., recruitment method, number of follow-ups), length and content of the intervention (e.g., behavioral or pharmacological, inclusion of sleep education), and overall methodological quality from each article. Interrater reliability was assessed for all variables. For categorical variables, raters agreed on 81% of judgments (mean Cohen’s k = 0.71, indicating a moderate agreement; Landis and Koch, 1977). For continuous variables, raters were in strong agreement (average intraclass correlation coefficient = 0.89). Discrepancies were resolved through discussion.
2.7. Risk of Bias in Individual Studies
The methodological quality of each article was assessed using 11 items from measures that have been validated in previous trials (Downs and Black, 1998; Jadad et al., 1996; Miller et al., 1995; Miller and Wilbourne, 2002). Reviewers determined the adequacy of methodological characteristics such as randomization, follow-up rate, follow-up length, attrition, and blinding. Meta-regression was used to examine the proportion of methodological quality criteria met as a predictor of study outcomes (sleep quality, alcohol abstinence, and depressive symptoms).
2.8. Summary Measures
Effect sizes (ES) were estimated for changes in sleep problems, days of alcohol abstinence, and symptoms of depression at the first available follow-up. We analyzed the first available follow-up because prior research shows that both behavioral and pharmacological interventions for insomnia produce the strongest effects immediately post-treatment (Edinger et al., 2001; Jacobs et al., 2004). Effect size estimates were calculated as the mean difference between the treatment and comparison conditions, divided by the pre-test standard deviation (Becker, 1988; Morris and DeShon, 2002).1 Consistent with standard procedures (Lipsey and Wilson, 2001), other statistical information (e.g., frequencies, p-values) was used to estimate ES when means and standard deviations were not available. All ES were corrected for sample size bias (Hedges, 1981). Positive ES indicate improvements for the intervention compared to the control participants (i.e., improved sleep problems, more days of alcohol abstinence, and fewer depressive symptoms).
2.9. Planned Methods of Analysis
Weighted mean ES (d+) were calculated using random-effects assumptions (Lipsey and Wilson, 2001). The 95% confidence interval surrounding each d+ indicates the degree of precision of the mean effect size as well as its statistical significance. The homogeneity statistic (Q) was used to indicate the homogeneity of outcomes across studies. The I2 index was also calculated to quantify the inconsistencies between ES (Higgins and Thompson, 2002; Huedo-Medina et al., 2006). Finally, we used a meta-analytic analogue to the ANOVA (following random-effects assumptions) to examine whether the type of intervention (pharmacological versus behavioral) moderated intervention efficacy. Publication bias could not be assessed due to the limited number of studies included in the meta-analysis (i.e., <10 studies; Lau et al., 2006).
3. Results
3.1. Study Selection
The electronic database searches provided a total of 11,001 records; after deleting duplicates, 8,324 records remained. Of these, 8,263 were excluded because the review of the record titles and abstracts indicated the records did not meet eligibility criteria. The full-text of the remaining 61 records were reviewed. Nine studies met eligibility criteria and were included in the final review and meta-analysis (see Figure 1).
3.2. Study Characteristics
Details regarding study characteristics are provided in Table 1. Studies were published (or available) between 1998 and 2016. Most studies (7 out of 9) were conducted in the United States; the two remaining studies were conducted in Belgium (Le Bon et al., 2003) and South Africa (Greeff and Conradie, 1998). Eight were randomized controlled trials (7 individual, 1 group), and one study used a quasi-experimental design (Karam-Hage and Brower, 2003).
Table 1.
Characteristics of the 9 studies included in the meta-analysis.
| Arnedt (2011) | Brower (2008) | Chakravorty (2014) | Chakravorty (2016) | Currie (2004) | Friedmann (2008) | Greeff (1998) | Karam-Hage (2003) | Le Bon (2003) | |
|---|---|---|---|---|---|---|---|---|---|
| Sample characteristics | |||||||||
|
| |||||||||
| N (%) | 17 (59) | 21 (52) | 22 (91) | 22 (95) | 60 (68) | 173 (82) | 22 (100) | 55 (91) | 18 (89) |
| % Female | 35 | 48 | 0 | 0 | 30 | 9 | 0 | 62 | 6 |
| M age in years | 46 | 45 | 53 | 55 | 43 | 41 | 46 | 44 | 44 |
| Race | 77% W | 76% W | 95% B | NR | NR | 86% W | NR | 84% W | NR |
| Sleep inclusion | Diagnosis | Diagnosis | Complaint | Complaint | Diagnosis | Complaint | Diagnosis | Diagnosis | Diagnosis |
|
| |||||||||
| Intervention details | |||||||||
|
| |||||||||
| Intervention | CBT-I | Gabapentin | Quetiapine | CBT-I | CBT-I | Trazodone | PMR | Gabapentin | Trazodone |
| Frequency/dose and duration | 8 sessions | 1500mg | 400 mg | 8 sessions | 5 sessions | 50–150mg | 10 sessions | 300–1800mg | 150–200mg |
| (weekly) | (42 days) | (56 days) | (weekly) | (weekly) | (84 days) | (2 weeks) | (28–42 days) | (28 days) | |
| Sleep medication | X | X | X | X | X | ||||
| Sleep education | X | X | X | X | |||||
| Sleep restriction | X | X | X | ||||||
| Stimulus control | X | X | X | ||||||
| Cognitive therapy | X | X | X | ||||||
| Relaxation training | X | X | |||||||
| Alcohol education | X | ||||||||
|
| |||||||||
| Control condition | RCM | Placebo | Placebo | AO | RCM | Placebo | AO | Trazodone (50–300mg) | Placebo |
|
| |||||||||
| Measures | |||||||||
|
| |||||||||
| Sleep problems | Diary, ISI† | SPQ | ISI, PSQI† | ISI | PSQI | PSQI | Unpublished | SPQ | -- |
| Alcohol abstinence | TLFB | TLFB | TLFB | TLFB | TLFB | TLFB | -- | Unknown | -- |
| Depression | BDI | -- | PHQ-9 | QIDS | BDI | -- | -- | -- | HRSD |
|
| |||||||||
| Follow-ups | Post | Post | Post | Post | Post | 1mo | Post | Post | Post |
| 6wk | 3mo | 3mo | Post (3mo) | ||||||
| 6mo | 6mo | 6mo | |||||||
|
| |||||||||
| Total MQ Score (%) | 8 (50%) | 12 (75%) | 10 (63%) | 9 (56%) | 13 (81%) | 14 (88%) | 7 (44%) | 4 (31%) | 11 (69%) |
Note. Pharmacological intervention studies are highlighted in gray.
average used in analyses.
AO = assessment only. BDI = Beck Depression Inventory. CBT-I = Cognitive Behavioral Therapy for Insomnia. Diary = daily sleep diary. HRSD = Hamilton Rating Scale for Depression. ISI = Insomnia Severity Index. Mo = month. MQ = methodological quality (range 0–16). N (%) = number of participants who consented to participate (% retention). PHQ = Patient Health Questionnaire. PMR = Progressive Muscle Relaxation. QIDS = Quick Inventory of Depressive Symptoms. RCM = relevant content matched for time. SPQ = Sleep Problems Questionnaire. TLFB = Timeline Follow-back. X = included in the intervention.
3.2.1. Participants
Included studies involved 410 participants, 206 of whom were assigned to an active insomnia treatment condition. Primary inclusion criteria were AUD and either clinical diagnosis of insomnia (n = 194) or self-reported complaints of insomnia (n = 216). The majority of trials excluded participants with substance use disorders other than alcohol or nicotine; however, 66% of participants sampled in Karam-Hoge and Brower (2003) met criteria for at least one other substance use disorder. Studies varied in the extent to which they assessed and reported current substance use treatment. Three studies recruited samples exclusively from either inpatient (Greeff and Conradie, 1998; Le Bon et al., 2003) or outpatient (Karam-Hage and Brower, 2003) treatment settings, and all participants were engaged in treatment during the course of the study. Friedmann and colleagues (2008) recruited recently detoxified patients from a short-term inpatient detoxification program, and 25% of their sample had engaged in formal substance use treatment by one-month follow-up. The remaining trials recruited from both clinic and community samples, and the percentage of participants receiving formal treatment was inconsistently reported. Retention was high, with a mean of 81% (SD = 0.17) retained at post-test.
3.2.2. Interventions
All interventions targeted symptoms of insomnia. Four studies utilized a behavioral insomnia intervention [three CBT-I and one Progressive Muscle Relaxation (PMR)], and five utilized pharmacological therapy (two gabapentin, two trazodone, and one quetiapine). Details regarding intervention frequency, duration/dose, and content are summarized in Table 1. The majority of interventions were delivered in person, although one involved both in-person and telephone support (Arnedt et al., 2011). Four interventions involved components of sleep education, two involved relaxation training, and one included alcohol education.
3.2.3. Comparisons
Of the four behavioral intervention trials, two implemented a comparison condition that was matched for both content and time; the other two utilized assessment-only controls. Of the five pharmacological trials, four utilized a time-matched placebo and one (Karam-Hage and Brower, 2003) used trazodone as an active medication comparison.
3.2.4. Outcome Assessment
The outcomes of interest in this study were sleep quality, days of alcohol abstinence, and symptoms of depression. Sleep quality was measured in one study using the daily sleep diary, in one study using an unpublished measure, in two studies using the Sleep Problems Questionnaire (Jenkins et al., 1988), in three studies using the Pittsburgh Sleep Quality Index (Buysse et al., 1989), and in three studies using the Insomnia Severity Index (Morin et al., 2011) (see Table 1). In two studies, authors measured both ‘sleep quality’ and ‘insomnia symptoms.’ Given the overlap in these phenomena, scores were averaged to create an overall ‘sleep quality’ score that could be used in the meta-analysis. Studies that assessed days of abstinence or relapse did so using the Timeline Followback interview (Sobell et al., 1988); a single study did not report how alcohol abstinence was assessed (Karam-Hage and Brower, 2003). Measures of depression included the Beck Depression Inventory (Beck et al., 1996), the Patient Health Questionnaire-9 (Kroenke and Williams, 2001), the Quick Inventory of Depressive Symptomatology (Rush et al., 2003), and the Hamilton Rating Scale for Depression (Hamilton, 1967) (see Table 1).
3.3. Risk of Bias within Studies
The studies satisfied a mean of 62% (SD = 0.18; range = 31–88%) of the methodological quality criteria. Overall, 89% of studies randomized individuals or groups to treatment but only 44% reported blinding facilitators to which participants were in the intervention and control groups. Most studies conducted assessments less than 3 months post-intervention (56%); 67% used methods to minimize assessment reactivity (e.g., using separate intervention and assessment staff); 56% used some form of objective measurement; and 11% obtained collateral verification of self-report measures. Participant retention was moderate, with 55% of studies reporting retention rates of 70% or higher. Only 33% of studies compared drop outs to completed cases. Finally, all studies used appropriate statistical analyses for between-group differences, and 67% accounted for attrition in outcome reporting. The proportion of methodological quality criteria achieved (see Table 1) was not a significant predictor of sleep quality (B = −0.48, p = .64), alcohol abstinence (B = −1.68, p = .18), or depressive symptoms (B = −2.95, p = .21).
3.4. Summary of Effects
3.4.1. Sleep Quality
Data regarding sleep quality were available for eight trials (see Figure 2). In the pooled analysis, there was a significant difference in sleep quality between intervention and control groups (d+ = 0.62; 95% CI = 0.28, 0.97); however, we failed to reject the null hypothesis of homogeneity (Q [7] = 12.82, p = .08; I2 = 45, 95% uncertainty limits = 0, 76). Intervention type significantly moderated sleep quality (Q [1] = 7.41, p < .001), with participants reporting significantly greater improvements in sleep quality in response to behavioral (d+ = 1.20; 95% CI = 0.70, 1.70) as opposed to pharmacological interventions (d+ = 0.43; 95% CI = 0.19, 0.67).
Figure 2.
Forest plot for sleep quality at first follow-up assessment (k = 8).
Note. Pharmacological intervention studies are highlighted in gray.
3.4.2. Alcohol Abstinence
Data regarding abstinence outcomes were available for six trials (see Figure 3), which randomized 370 participants and reported first follow-up data for 327 participants. There were no between-group differences in rates of abstinence (d+ = 0.09; 95% CI = −0.49, 0.68). The null hypothesis of homogeneity was rejected (Q [6] = 28.67, p < .001; I2 = 79, 95% uncertainty limits = 57, 90). Intervention type did not significantly moderate treatment outcomes (behavioral d+ = 0.24, 95% CI = −0.74, 1.23; pharmacological d+ = 0.00, 95% CI = −0.77, 0.78; Q [1] = 0.14, p = .71).
Figure 3.
Forest plot for alcohol abstinence at first follow-up assessment (k = 7).
Note. Pharmacological intervention studies are highlighted in gray.
3.4.3. Depressive Symptoms
Data regarding symptoms of depression were available for five trials (see Figure 4), which randomized 139 participants and reported follow-up data for 99 participants. There was a significant difference between groups (d+ = 0.52; 95% CI = 0.06, 0.98). We failed to reject the null hypothesis of homogeneity (Q[4] = 5.73, p = .22; I2 = 30, 95% uncertainty limits = 0 to 73). Moderator testing did not reveal a statistically significant difference in depressive symptoms between behavioral (d+ = 0.74, 95% CI = 0.31, 1.18) and pharmacological interventions (d+ = 0.08, 95% CI = −0.64, 0.78; QB (1) = 2.44, p = .118).
Figure 4.
Forest plot for depressive symptoms at first follow-up assessment (k = 5).
Note. Pharmacological intervention studies are highlighted in gray.
4. Discussion
This systematic review and meta-analysis evaluated the efficacy of insomnia interventions among individuals with comorbid AUD. We integrated the results of nine trials involving 410 alcohol dependent participants. Both behavioral and pharmacological insomnia interventions improved sleep quality and depressive symptoms among individuals with comorbid AUD, although improvements were stronger for behavioral interventions. Neither behavioral nor pharmacological interventions improved rates of alcohol abstinence within this population. Collectively, there is strong evidence for the efficacy of insomnia interventions in improving sleep quality among individuals with AUD; however, data regarding the secondary benefits of such interventions (e.g., reduced rates of alcohol relapse) were limited.
Both behavioral and pharmacological interventions improved sleep quality among individuals with AUD. However, behavioral interventions demonstrated much larger and more consistent effects. Of the behavioral treatments available, CBT-I was the primary intervention investigated. Consistent with previous studies examining the efficacy of CBT-I among those with psychiatric or medical disorders (Smith et al., 2005), CBT-I was highly effective in improving sleep quality among individuals with comorbid AUD, with all available studies indicating large effects. Notably, PMR also demonstrated strong effects on sleep quality and was included as a part of the intervention in at least one CBT-I trial. Thus, relaxation training may also help reduce sleep complaints among individuals with AUD. This conclusion is consistent with the results of a previous meta-analytic review, in which relaxation, cognitive-behavioral, and strictly behavioral interventions all demonstrated robust effects on sleep quality and symptoms of insomnia among middle-aged and older adults; however, cognitive behavioral techniques were needed to improve sleep efficiency (Irwin et al., 2006).
While results of this meta-analysis suggest that insomnia interventions do not impact rates of alcohol abstinence among individuals with AUD, the methodological weaknesses of the studies included in this review may have limited our ability to detect significant changes in alcohol use. For example, only six of the nine studies in this review reported alcohol use outcomes; thus, we are unable to determine if other interventions had significant effects on rates of abstinence or relapse. Moreover, in the three behavioral intervention studies that measured alcohol-related outcomes (Arnedt et al., 2011; Chakravorty, Perlis, et al., 2016; Currie et al., 2004), most participants either reported abstinence or were required to abstain from alcohol for approximately one month prior to baseline. These relatively extended periods of pre-treatment abstinence may limit the ability to detect changes in alcohol use, due in part to limited rates of relapse over the course of the study.
The question remains, then, why pharmacological interventions that improved sleep quality did not impact abstinence rates. While some of the pharmacological intervention studies may have been underpowered to detect secondary outcomes, Friedmann and colleagues (2008) were sufficiently powered to detect changes in abstinence as a function of treatment and did document improvements in sleep quality as a result of treatment with trazodone. However, in contrast to hypotheses, they found that participants in the trazodone group reported a smaller increase in abstinent days than those in the placebo group. The authors speculate that the pharmacological properties of trazodone may have induced craving in their participants and, upon cessation, may have induced symptoms of alcohol withdrawal, triggering consumption (Friedmann et al., 2008). However, their sample also consisted of recently detoxified patients, only 25% of whom had engaged in formal substance use treatment by one-month follow-up. It is possible that, without the support of formal treatment, quick alleviation of insomnia symptoms led to a minimization of detoxification and withdrawal symptoms that facilitated alcohol relapse.
Compared to controls, insomnia intervention participants also showed significant decreases in symptoms of depression. While there were no statistically significant differences between behavioral or pharmacological interventions in effects on depressive symptoms, summary effect sizes stratified by group indicated that behavioral intervention participants showed a significant reduction in depressive symptoms relative to controls. Notably, the three behavioral intervention trials that reported depressive symptom outcomes were testing the efficacy of CBT-I. Consistent with previous studies (Clarke et al., 2015; Manber et al., 2008), CBT-I reduced symptoms of depression among individuals with comorbid AUD, with effect sizes ranging from small to large. Given the prevalence of depressive symptoms among patients with AUD (SAMHSA, 2016) and the promise of these findings, additional studies examining the impact of CBT-I on psychiatric outcomes among patients with AUD are warranted.
4.1. Limitations and Future Directions
Findings from this systematic review and meta-analysis fill a gap in the literature by quantifying the impact of various insomnia treatments on sleep- and alcohol-related outcomes. That being said, a number of sample and methodological limitations need to be considered. Definitions of ‘insomnia’ varied considerably across studies; some trials included AUD participants who complained of sleep disturbance and others required that participants meet diagnostic criteria for both AUD and insomnia disorder. It is unclear to what extent this impacted outcomes, as participants in all studies reported sleep disturbances above the clinical screening cut-off for insomnia. However, we could be more confident in conclusions regarding the efficacy of insomnia treatment within this population if samples were more consistent across studies.
Future research may also target demographic subgroups that were not fully represented in this review. For example, participants in these studies were not necessarily seeking or engaged in treatment for alcohol use, and they varied in rates of abstinence at baseline. Rates of alcohol relapse may be higher among those in earlier recovery (2 to 4 weeks after detoxification), which is a time of prevalent sleep disturbance (Chakravorty, Chaudhary, et al., 2016). As such, findings may not generalize to those in earlier recovery or those actively seeking treatment. Similarly, three out of four participants were men. While rates of AUD tend to be higher among men (Goldstein et al., 2015), rates of AUD are increasing among women (Han et al., 2017) and the prevalence of insomnia tends to be higher among women (Ford et al., 2015). Thus, women may be an important target for AUD and insomnia interventions in the future.
The studies included in this review were also limited by a number of methodological weaknesses. Eight of the 9 trials had fewer than 30 participants per group at the first follow-up assessment, and authors did not consistently account for attrition and missing data. Moreover, 5 of the 9 studies were limited to post-intervention outcomes. Such sample sizes and follow-up designs are consistent with pilot or developmental work (Rounsaville et al., 2001). Given the promise of these interventions, longitudinal research examining the efficacy of insomnia treatment with larger samples are needed. Finally, only six studies provided outcome data for both sleep quality and alcohol abstinence. Future research would be improved by consistent reporting of both sleep and alcohol use outcomes.
5.0. Conclusions
The co-occurrence of insomnia and AUD is both prevalent and costly. Based on the results of this systematic review and meta-analysis, both behavioral and pharmacological interventions are effective in improving sleep quality among individuals with comorbid AUD, with behavioral interventions demonstrating consistently larger effects. Intervention participants also reported improvements in symptoms of depression following insomnia treatment. Given the small sample sizes and methodological weaknesses of the studies reviewed, additional research is needed to determine the efficacy of insomnia treatment in improving rates of alcohol relapse within this population. Considerations for future research include standardized definitions of insomnia, consistent reporting of both sleep and alcohol use outcomes, inclusion of diverse demographic groups, and fully-powered longitudinal designs.
Supplementary Material
Highlights.
-
▪
The co-occurrence of insomnia and alcohol use disorder (AUD) is prevalent and costly.
-
▪
Insomnia treatment improves sleep quality and depression in those with comorbid AUD.
-
▪
Behavioral interventions are more efficacious in improving sleep quality.
-
▪
Insomnia treatment has not improved rates of alcohol abstinence in studies to date.
Acknowledgments
Role of Funding Source
This research was supported by grants from the National Institute on Alcohol Abuse and Alcoholism (T32-AA007459; Monti, PI) and the National Center for Complementary & Integrative Health (R01-AT008815; Scott-Sheldon, PI). NIH had no role in the study design, collection, analysis, or interpretation of the data, writing the manuscript, or the decision to submit the paper for publication.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
For Currie et al. (2004), we excluded the waitlist control group and used self-help with telephone support as the comparison condition because the waitlist control group did not complete the same follow-ups.
Author Disclosure
Contributors
Author MBM screened and reviewed articles for eligibility. KBC and LAJSS reviewed and provided feedback on potentially relevant articles. MBM and MLD extracted data. LAJSS conducted statistical analyses. All authors contributed to and have approved the final manuscript.
Conflict of Interest
The authors have no conflicts of interest to report.
References
- Arnedt JT, Conroy DA, Armitage R, Brower KJ. Cognitive-behavioral therapy for insomnia in alcohol dependent patients: A randomized controlled pilot trial. Behav. Res. Ther. 2011;49:227–233. doi: 10.1016/j.brat.2011.02.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beck AT, Steer RA, Brown GK. Manual for Beck Depression Inventory-II. San Psychological Corporation; Antonio, TX: 1996. [Google Scholar]
- Becker BJ. Synthesizing standardized mean-change measures. Brit. J. Math. Stat. Psy. 1988;41:257–278. [Google Scholar]
- Bernert RA, Kim JS, Iwata NG, Perlis ML. Sleep disturbances as an evidence-based suicide risk factor. Curr. Psychiatry Rep. 2015;17:554–563. doi: 10.1007/s11920-015-0554-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouchery EE, Harwood HJ, Sacks JJ, Simon CJ, Brewer RD. Economic costs of excessive alcohol consumption the U.S., 2006. Am. J. Prev. Med. 2011;41:516–524. doi: 10.1016/j.amepre.2011.06.045. [DOI] [PubMed] [Google Scholar]
- Breslau N, Roth T, Rosenthal L, Andreski P. Sleep disturbance and psychiatric disorders: A longitudinal epidemiological study of young adults. Biol. Psychiat. 1996;39:411–418. doi: 10.1016/0006-3223(95)00188-3. [DOI] [PubMed] [Google Scholar]
- Brooks AT, Wallen GR. Sleep disturbances in individuals with alcohol-related disorders: A review of Cognitive Behavioral Therapy for Insomnia (CBT-I) and associated non-pharmacological therapies. Subst. Abus. Res. Treat. 2014;8:55–62. doi: 10.4137/SART.S18446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brower KJ. Assessment and treatment of insomnia in adult patients with alcohol use disorders. Alcohol. 2015;49:417–427. doi: 10.1016/j.alcohol.2014.12.003. [DOI] [PubMed] [Google Scholar]
- Brower KJ, Aldrich MS, Robinson EA, Zucker RA, Greden JF. Insomnia, self-medication, and relapse to alcoholism. Am. J. Psychiatry. 2001;158:399–404. doi: 10.1176/appi.ajp.158.3.399. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brower KJ, Myra Kim H, Strobbe S, Karam-Hage MA, Consens F, Zucker RA. A randomized double-blind pilot trial of gabapentin versus placebo to treat alcohol dependence and comorbid insomnia. Alcohol. Clin. Exp. Res. 2008;32:1429–1438. doi: 10.1111/j.1530-0277.2008.00706.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buysse DJ, Reynolds CF, III, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research. Psychiatr. Res. 1989;28:193–213. doi: 10.1016/0165-1781(89)90047-4. [DOI] [PubMed] [Google Scholar]
- Callaghan RC, Gatley JM, Veldhuizen S, Lev-Ran S, Mann R, Asbridge M. Alcohol- or drug-use disorders and motor vehicle accident mortality: A retrospective cohort study. Accident Anal. Prev. 2013;53:149–155. doi: 10.1016/j.aap.2013.01.008. [DOI] [PubMed] [Google Scholar]
- Chakravorty S, Chaudhary NS, Brower KJ. Alcohol dependence and its relationship with insomnia and other sleep disorders. Alcohol. Clin. Exp. Res. 2016;40:2271–2282. doi: 10.1111/acer.13217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chakravorty S, Hanlon AL, Kuna ST, Ross RJ, Kampman KM, Witte LM, Perlis ML, Oslin DW. The effects of quetiapine on sleep in recovering alcohol-dependent subjects: A pilot study. J. Clin. Psychopharm. 2014;34:350–354. doi: 10.1097/JCP.0000000000000130. [DOI] [PubMed] [Google Scholar]
- Chakravorty S, Perlis ML, Arnedt JT, Kranzler HR, Sturgis EB, Findley JC, Oslin DW. The efficacy of individual 8-week CBT-I for insomnia in recovering alcohol dependent veterans. Paper presented at the Sleep; Denver, CO. 2016. [Google Scholar]
- Chaudhary NS, Kampman KM, Kranzler HR, Grandner MA, Debbarma S, Chakravorty S. Insomnia in alcohol dependent subjects is associated with greater psychosocial problem severity. Addict. Behav. 2015;50:165–172. doi: 10.1016/j.addbeh.2015.06.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clarke G, McGlinchey EL, Hein K, Gullion CM, Dickerson JF, Leo MC, Harvey AG. Cognitive-behavioral treatment of insomnia and depression in adolescents: A pilot randomized trial. Behav. Res. Ther. 2015;69:111–118. doi: 10.1016/j.brat.2015.04.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Currie SR, Clark S, Hodgins DC, El-Guebaly N. Randomized controlled trial of brief cognitive-behavioural interventions for insomnia in recovering alcoholics. Addiction. 2004;99:1121–1132. doi: 10.1111/j.1360-0443.2004.00835.x. [DOI] [PubMed] [Google Scholar]
- Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J. Epidemiol. Commun. H. 1998;52:377–384. doi: 10.1136/jech.52.6.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Edinger JD, Wohlgemuth WK, Radtke RA, Marsh GR, Quillian RE. Cognitive behavioral therapy for treatment of chronic primary insomnia: A randomized controlled trial. J. Am. Med. Assoc. 2001;285:1856–1864. doi: 10.1001/jama.285.14.1856. [DOI] [PubMed] [Google Scholar]
- Ford ES, Cunningham TJ, Giles WH, Croft JB. Trends in insomnia and excessive daytime sleepiness among US adults from 2002 to 2012. Sleep Med. 2015;16:372–378. doi: 10.1016/j.sleep.2014.12.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friedmann PD, Herman DS, Freedman S, Lemon SC, Ramsey S, Stein MD. Treatment of sleep disturbance in alcohol recovery: A national survey of addiction medicine physicians. J. Addict. Dis. 2003;22:91–103. doi: 10.1300/J069v22n02_08. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friedmann PD, Rose JS, Swift R, Stout RL, Millman RP, Stein MD. Trazodone for sleep disturbance after alcohol detoxification: A double-blind, placebo-controlled trial. Alcohol. Clin. Exp. Res. 2008;32:1652–1660. doi: 10.1111/j.1530-0277.2008.00742.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goldstein RB, Smith SM, Dawson DA, Grant BF. Sociodemographic and psychiatric diagnostic predictors of 3-year incidence of DSM–IV substance use disorders among men and women in the National Epidemiologic Survey on Alcohol and Related Conditions. Psychol Addict. Behav. 2015;29:924–932. doi: 10.1037/adb0000080. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Greeff AP, Conradie WS. Use of progressive relaxation training for chronic alcoholics with insomnia. Psychol. Rep. 1998;82:407–412. doi: 10.2466/pr0.1998.82.2.407. [DOI] [PubMed] [Google Scholar]
- Hamilton M. Development of a rating scale for primary depressive illness. Br. J. Soc. Clin. Psychol. 1967;6:278–296. doi: 10.1111/j.2044-8260.1967.tb00530.x. [DOI] [PubMed] [Google Scholar]
- Han BH, Moore AA, Sherman S, Keyes KM, Palamar JJ. Demographic trends of binge alcohol use and alcohol use disorders among older adults in the United States, 2005–2014. Drug Alcohol Depend. 2017;170:198–207. doi: 10.1016/j.drugalcdep.2016.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hasler BP, Kirisci L, Clark DB. Restless sleep and variable sleep timing during late childhood accelerate the onset of alcohol and other drug involvement. J. Stud. Alcohol Drugs. 2016;77:649–655. doi: 10.15288/jsad.2016.77.649. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hedges LV. Distribution theory for Glass's estimator of effect size and related estimators. J. Educ. Stat. 1981;6:107–128. doi: 10.2307/1164588. [DOI] [Google Scholar]
- Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat. Med. 2002;21:1539–1558. doi: 10.1002/sim.1186. [DOI] [PubMed] [Google Scholar]
- Huedo-Medina TB, Sanchez-Meca J, Marin-Martinez F, Botella J. Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychol. Methods. 2006;11:193–206. doi: 10.1037/1082-989X.11.2.193. [DOI] [PubMed] [Google Scholar]
- Irwin MR, Cole JC, Nicassio PM. Comparative meta-analysis of behavioral interventions for insomnia and their efficacy in middle-aged adults and in older adults 55+ years of age. Health Psychol. 2006;25:3–14. doi: 10.1037/0278-6133.25.1.3. [DOI] [PubMed] [Google Scholar]
- Jacobs GD, Pace-Schott EF, Stickgold R, Otto MW. Cognitive behavior therapy and pharmacotherapy for insomnia: A randomized controlled trial and direct comparison. Arch. Intern. Med. 2004;164:1888–1896. doi: 10.1001/archinte.164.17.1888. [DOI] [PubMed] [Google Scholar]
- Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ. Assessing the quality of reports of randomized clinical trials: Is blinding really necessary? Control Clin. Trials. 1996;17:1–12. doi: 10.1016/0197-2456(95)00134-4. [DOI] [PubMed] [Google Scholar]
- Jenkins CD, Stanton BA, Niemcryk SJ, Rose RM. A scale for the estimation of sleep problems in clinical research. J. Clin. Epidemiol. 1988;41:313–321. doi: 10.1016/0895-4356(88)90138-2. [DOI] [PubMed] [Google Scholar]
- Karam-Hage M, Brower KJ. Open pilot study of gabapentin versus trazodone to treat insomnia in alcoholic outpatients. Psychiatr. Clin. Neurosci. 2003;57:542–544. doi: 10.1046/j.1440-1819.2003.01161.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kolla BP, Schneekloth T, Biernacka J, Mansukhani M, Geske J, Karpyak V, Hall-Flavin D, Louikianova L, Frye MA. The course of sleep disturbances in early alcohol recovery: An observational cohort study. Am. J. Addiction. 2014;23:21–26. doi: 10.1111/j.1521-0391.2013.12056.x. [DOI] [PubMed] [Google Scholar]
- Kroenke KS, Williams JB. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001;16:606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310. [DOI] [PubMed] [Google Scholar]
- Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. BMJ. 2006;333:597–600. doi: 10.1136/bmj.333.7568.597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Le Bon O, Murphy JR, Staner L, Hoffmann G, Kormoss N, Kentos M, Dupont P, Lion K, Pelc I, Verbanck P. Double-blind, placebo-controlled study of the efficacy of trazodone in alcohol post-withdrawal syndrome: Polysomnographic and clinical evaluations. J. Clin. Psychopharmacol. 2003;23:377–383. doi: 10.1097/01.jcp.0000085411.08426.d3. [DOI] [PubMed] [Google Scholar]
- Li L, Wu C, Gan Y, Qu X, Lu Z. Insomnia and the risk of depression: A meta-analysis of prospective cohort studies. BMC Psychiatry. 2016;16:375. doi: 10.1186/s12888-016-1075-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lipsey MW, Wilson DB. Practical meta-analysis. Sage; Thousand Oaks, CA: 2001. [Google Scholar]
- Malcolm R, Myrick LH, Veatch LM, Boyle E, Randall PK. Self-reported sleep, sleepiness, and repeated alcohol withdrawals: A randomized, double blind, controlled comparison of lorazepam vs gabapentin. J. Clin. Sleep Med. 2007;3:24–32. [PubMed] [Google Scholar]
- Manber R, Edinger JD, Gress JL, San Pedro-Salcedo MG, Kuo TF, Kalista T. Cognitive behavioral therapy for insomnia enhances depression outcome in patients with comorbid major depressive disorder and insomnia. SLEEP. 2008;31:489–495. doi: 10.1093/sleep/31.4.489. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller MB, Janssen T, Jackson KM. Prospective association between sleep and the initiation of substance use in adolescents. J. Adolescent Health. 2017;60:154–160. doi: 10.1016/j.jadohealth.2016.08.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller WR, Brown JM, Simpson TL, Handmaker NS, Bien TH, Luckie LF. What works? A methodological analysis of the alcohol treatment outcome literature. In: RKHWRM, editor. Handbook of alcoholism treatment approaches: Effective alternatives. 2. Allyn and Bacon; Needham Heights, MA: 1995. pp. 12–44. [Google Scholar]
- Miller WR, Wilbourne PL. Mesa grande: A methodological analysis of clinical trials of treatments for alcohol use disorders. Addiction. 2002;97:265–277. doi: 10.1046/j.1360-0443.2002.00019.x. [DOI] [PubMed] [Google Scholar]
- Mitchell MD, Gehrman P, Perlis M, Umscheid CA. Comparative effectiveness of cognitive behavioral therapy for insomnia: A systematic review. BMC Fam. Pract. 2012;13:1–11. doi: 10.1186/1471-2296-13-40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: The PRIMSA statement. PLoS Med. 2009;6:e1000097. doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morin CM, Belleville G, Belanger L, Ivers H. The Insomnia Severity Index: Psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep. 2011;34:601–608. doi: 10.1093/sleep/34.5.601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morris SB, DeShon RP. Combining effect size estimates in meta-analysis with repeated measures and independent-group designs. Psychol. Methods. 2002;7:105–125. doi: 10.1037//1082-989X.7.1.105. [DOI] [PubMed] [Google Scholar]
- Pollack M, Seal B, Joish VN, Cziraky MJ. Insomnia-related comorbidities and economic costs among a commercially insured population in the United States. Curr. Med. Res. Opin. 2009;25:1901–1911. doi: 10.1185/03007990903035505. [DOI] [PubMed] [Google Scholar]
- SAMHSA Center for Behavioral Health Statistics and Quality. 2015 National Survey on Drug Use and Health. from Substance Abuse and Mental Health Services Administration. 2016. [Google Scholar]
- Rounsaville BJ, Carroll KM, Onken LS. A stage model of behavioral therapies research: Getting started and moving on from Stage 1. Clin. Psychol. Sci. Pr. 2001;8:133–142. [Google Scholar]
- Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow BA, Klein DN, Markowitz JC, Ninan PT, Kornstein S, Manber R, Thase ME, Kocsis JH, Keller MB. The 16-item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): A psychometric evaluation in patients with chronic major depression. Biol. Psychiatry. 2003;54:573–583. doi: 10.1037/t04100-000. [DOI] [PubMed] [Google Scholar]
- Schutte-Rodin S, Broch L, Buysse D, Dorsey C, Sateia M. Clinical guideline for the evaluation and management of chronic insomnia in adults. J. Clin. Sleep Med. 2008;4:487–504. [PMC free article] [PubMed] [Google Scholar]
- Siebern AT, Manber R. New developments in cognitive behavioral therapy as the first-line treatment of insomnia. J. Psych. Res. Behav. Manage. 2011;4:21–28. doi: 10.2147/PRBM.S10041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith MT, Huang MI, Manber R. Cognitive behavior therapy for chronic insomnia occurring within the context of medical and psychiatric disorders. Clin. Psychol. Rev. 2005;25:559–592. doi: 10.1016/j.cpr.2005.04.004. [DOI] [PubMed] [Google Scholar]
- Smith N, Hill R, Marshall J, Keaney F, Wanigaratne S. Sleep Related Beliefs and their Association with Alcohol Relapse Following Residential Alcohol Detoxification Treatment. Behav. Cogn. Psychoth. 2014;42:593–604. doi: 10.1017/s1352465813000465. [DOI] [PubMed] [Google Scholar]
- Sobell LC, Sobell MB, Leo GI, Cancilla A. Reliability of a timeline method: Assessing normal drinkers' reports of recent drinking and a comparative evaluation across several populations. Brit. J. Addict. 1988;83:393–402. doi: 10.1111/j.1360-0443.1988.tb00485.x. [DOI] [PubMed] [Google Scholar]
- Watson NF, Badr MS, Belenky G, Bliwise DL, Buxton OM, Buysse D, Dinges DF, Gangwisch J, Grandner MA, Kushida C, Malhotra RK, Martin JL, Patel SR, Quan SF, Tasali E. Recommended amount of sleep for a healthy adult: A joint consensus statement of the American Academy of Sleep Medicine and Sleep Research Society. Sleep. 2015;38:843–844. doi: 10.5665/sleep.4716. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weissman MM, Greenwald S, Nino-Murcia G, Dement WC. The morbidity of insomnia uncomplicated by psychiatric disorders. Gen. Hosp. Psychiatr. 1997;19:245–250. doi: 10.1016/S0163-8343(97)00056-X. [DOI] [PubMed] [Google Scholar]
- Wong MM, Brower KJ, Zucker RA. Childhood sleep problems, early onset of substance use, and behavioral problems in adolescence. Sleep Med. 2009;10:787–796. doi: 10.1016/j.sleep.2008.06.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yoon-kyu S, La Flair LN, Mojtabai R, Lee L, Spivak S, Crum RM. The association of alcohol use disorders with suicidal ideation and suicide attempts in a population-based sample with mood symptoms. Arch. Suicide Res. 2016;20:219–232. doi: 10.1080/13811118.2015.1004489. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.




