Current state of scientific evidence on Internet-based interventions for the treatment of depression, anxiety, eating disorders and substance abuse: an overview of systematic reviews and meta-analyses

Abstract

Background

ICare represents a consortium of European Investigators examining the effects of online mental health care for a variety of common mental health disorders provided in a variety of settings. This article provides an overview of the evidence of effectiveness for Internet-based treatment for four common mental health disorders that are the focus of much of this work: depression, anxiety, substance abuse and eating disorders.

Methods

The overview focused primarily on systematic reviews and meta-analyses identified through PubMed (Ovid) and other databases and published in English. Given the large number of reviews specific to depression, anxiety, substance abuse and/or eating disorders, we did not focus on reviews that examined the effects of Internet-based interventions on mental health disorders in general. Each article was reviewed and summarized by one of the senior authors, and this review was then reviewed by the other senior authors. We did not address issues of prevention, cost-effectiveness, implementation or dissemination, as these are addressed in other reviews in this supplement.

Results

Across Internet-based intervention studies addressing depression, anxiety, substance abuse and eating disorders primarily among adults, almost all reviews and meta-analyses found that these interventions successfully reduce symptoms and are efficacious treatments. Generally, effect sizes for Internet-based interventions treating eating disorders and substance abuse are lower compared with interventions for depression and anxiety.

Conclusions

Given the effectiveness of Internet-based interventions to reduce symptoms of these common mental health disorders, efforts are needed to examine issues of how they can be best disseminated and implemented in a variety of health care and other settings.

Introduction

The psychological treatment of mental health problems is undergoing a radical transformation, driven by the near universal availability of digital technology and daily use of digital technology by most people for a variety of functions and activities.¹ By digital technology, we refer to the use of computers, the Internet, mobile devices, apps and similar digital devices often used in combination. These technologies are provided as stand-alone self-help programs, guided/moderated programs or blended programs with some face-to-face encounters, and/or in various combinations. Digital interventions are seen as advantageous to other psychological modes of delivery because they are easily accessible, private (thus avoiding some issues of stigma), potentially more affordable and can be readily personalized and tailored to individual needs and interests.

Given the importance of digital technology to transform mental health services, the aim of the EU-funded consortium ICare (Integrating Technology into Mental Health Care Delivery in Europe) was to establish an online platform that provides evidence-based interventions for the prevention and treatment of the most prevalent mental health problems and disorders, to implement the interventions into real-world contexts in Europe, to evaluate their effectiveness and cost-effectiveness and to study moderators and mediators of intervention outcomes (www.icare-online.eu). As an introductory article in this supplement, we summarize the current state of knowledge in relation to the clinical trials on Internet-based treatments for four of the common mental health disorders included in ICare: depression, anxiety, substance abuse and eating disorders. More specifically, the aim is to present a brief overview of recent systematic reviews and meta-analyses that have evaluated the effectiveness of Internet-based treatments for these disorders primarily among adults. Based on these studies, we also identify important issues and emerging directions for future research. Consistent with the goals of ICare, we anticipated that findings from the meta-analyses and systematic reviews would support research that continues to examine issues related to the effectiveness of Internet-based interventions as provided to large populations in a variety of settings.

Methods

We began by conducting a search of PubMed (Ovid), PsychInfo and Embase. The searches were limited to English language articles published in the last 6 years. Our search focused on Internet-based interventions that were tested primarily among adults. The search terms included: systematic reviews and meta-analyses of Internet, mobile/smartphone and/or web-based treatment of depression, anxiety, substance abuse and eating disorders. We also conducted searches focusing on specific anxiety disorders: post-traumatic stress disorder (PTSD), social phobia, generalized anxiety disorder (GAD) and obsessive-compulsive disorder (OCD). We did not include articles on tobacco use as this is not a focus of ICare. Articles identified were reviewed from most recent backwards, with a forward search also conducted for the most recent articles. Articles were accepted if they (i) included information relevant to the topics of the current overview (Internet-based intervention for depression, anxiety, substance abuse and/or eating disorders), (ii) were a published meta-analysis, systematic review or rapid review, (iii) focused mostly on randomized trials, (iv) included randomized controlled trials (RCTs) where participants were primarily adults and (v) were in English. Specifics regarding the different types of comparator interventions are included in the individual sections. Given the large number of reviews specific to depression, anxiety, substance abuse and/or eating disorders, we did not focus on reviews that examined the effects of Internet-based interventions on mental health disorders in general. Each article was reviewed and summarized by one of the senior authors (C.B.T., A.K.G. or E.F.C.), and this review was then reviewed by the other senior authors. ICare also includes interventions for adjustment disorders, but we found no meta-analyses or systematic reviews that met our criteria, so this disorder was not included below.

One of the problems of this approach is that many of the reviews and meta-analyses report on the same articles. For this reason, as mentioned above, we focused on the most recent articles. We did not address issues of prevention, cost-effectiveness, implementation or dissemination, as these are addressed in other reviews in this special issue.

Results

Depression

We initially identified 339 different articles (not including abstracts), of which 14 met our search criteria. Of the 14, one study was omitted because it did not include detailed statistical data, another because the review included a number of non-Internet-based interventions, and a third because most of the interventions were quasi-experimental or included several disorders or primarily adolescents, leaving 11 trials.

The most recent review for treating clinical depression included in our search was an update from a previous meta-analysis conducted in 2010.² The review followed PRISMA guidelines. In all, 4423 abstracts were examined from a variety of searches, eventually leading to 53 studies in the meta-analysis. Only RCTs of Internet-based interventions vs. either waitlist control, information control, care as usual or placebo were included (see Supplementary table S1 for more details on comparators). According to the authors, the control group was usually a delayed treatment group in which there was no expectation that the delay before treatment would be beneficial. Hedges’ effect sizes were calculated, and the number needed to treat (NNT) was also determined. Adherence, patient satisfaction and bias risk were also assessed. In total, there were 32 depression studies involving 5642 subjects. The overall g-value at follow-up was 0.67 [95% confidence interval (CI) (0.51–0.81); P = 0.00], almost all using Internet-based cognitive-behavioral therapy (iCBT); NNT was 2.78. When compared with usual care, effect sizes were smaller but still significant. Adherence ranged from 16% to 100%, with an overall adherence (including anxiety studies) of 75% and an overall satisfaction of 85%. Follow-up effect sizes compared with immediately after trial completion, again combined for both depression and anxiety, were g = 0.15 [95% CI (0.06–0.23); P = 0.05] at 3–6 months post-treatment and g = 0.22 [95% CI (0.01–0.43); P = 0.00] at 9–18 months post-treatment. Overall, when compared with face-to-face treatment, the effect size was g = 0.14 [95% CI (−0.04 to 0.32)], a non-significant difference. The authors concluded that iCBT was effective.

Wright et al.³ identified 40 randomized iCBT depression trials that met their inclusion criteria. The control groups were waitlist, attention control or treatment as usual. The study included adolescent participants, if they were 16 years or older, but most included participants who were adults. The random-effects weighted mean effect size for iCBT vs. controls at post-treatment was g = 0.50 [95% CI (0.39–0.61); P < 0.001]. The random-effects weighted mean effect size for studies using the support of a coach was g = 0.67 [95% CI (0.55–0.80); P < 0.001]. In contrast, iCBT studies that did not include support had a random-effects weighted mean effect size at post-treatment of g = 0.24 [95% CI (0.12–0.36); P < 0.001]. Regarding effect sizes depending on the level of support provided, the random-effects weighted mean effect size at post-treatment was lowest for e-mail [n = 9; g = 0.56; 95% CI (0.35–0.94); P < 0.001], intermediate for telephone [n = 9; g = 0.78; 95% CI (0.56–1.01); P < 0.001] and largest when face-to-face person support was provided [n = 3; g = 0.83; 95% CI (0.43–1.24); P < 0.001]. The authors concluded that Internet-based interventions for depression are effective, but that self-guided interventions are considerably less effective.

Josephine et al.⁴ identified 19 controlled studies that reported on 29 different Internet- and mobile-based interventions for depression. The intervention had to be compared with another intervention or to one of the following controls: (i) no psychological treatment, (ii) attention or psychological placebo, (iii) waitlist control or (iv) active, non-Internet-based treatment. At the end of treatment, Internet-based interventions resulted in improved depression severity compared with waitlist conditions [g = −0.90; 95% CI (−1.07 to −0.73)]. (If P-values are not included in this overview, they were not reported by the authors.) Comparisons between different interventions did not demonstrate any superiority or inferiority, and heterogeneity among the studies was high. Depression symptoms were reduced across all interventions from pre- to post-treatment [within group g range = (−2.24 to −0.64)] and from pre-treatment to follow-up [g range = (−3.07 to −0.93)].

Karyotaki et al.⁵ examined the effects of self-guided iCBT for treatment of depressive symptoms using data from 3876 participants from 13 of 16 studies they identified. Control conditions were attention placebo, no treatment, treatment as usual or waiting list. Self-guided iCBT was significantly more effective than controls for reducing depressive symptoms severity [β = −0.21; Hedges g  = 0.27; 95% CI (0.17–0.37); P < 0.001]. In a subsequent study, Karyotaki et al.⁶ examined the efficacy of guided iCBT for depression compared with control groups. They identified 27 relevant RCTs and were able to obtain the data from 24, which then comprised of 4889 participants. Treatment outcomes on response and remission were examined with mixed-effects models with participants nested within studies. The Reliable Change Index was used to calculate response and remission. The intervention group obtained significantly higher response rates [odds ratio (OR) 2.49; 95% CI (2.17–2.85); P < 0.001], and remission rates compared with controls [OR 2.41; 95% CI (2.07–2.79); P < 0.001]. Adults with more severe depressive symptoms at baseline were more likely to remit after receiving treatment [OR 1.19: 95% CI (1.01–1.39); P = 0.04]. The results suggest that guided Internet-based interventions lead to substantial positive effects on treatment response and remission at post-treatment. The authors argue that an important finding was that guided self-help is useful for patients with more severe depression. They also note that, depending on the criteria, between 44% and 61% of the participants did not show response, and between 58% and 62% did not achieve remission.

Wahle et al.⁷ reviewed 45 studies, selected from 6387 initial records that used various types of technology-based interventions to reduce depressive symptoms. Approximately 80% of the studies were based on cognitive-behavioral therapy (CBT). The interventions showed a trend toward reduced depressive symptoms [SMD −0.58; 95% CI (−0.71 to −0.45); P < 0.001], but the findings were limited by the significant heterogeneity among trials. The authors also provided descriptive data on 15 components that were part of the trials. About 43% used homework, and about 25% used email reminders.

Twomey et al.⁸ undertook a meta-analysis of one depression program (Deprexis) that had been studied in eight trials with a combined sample of 2402 participants. The authors selected only RCTs and ‘waiting list (or delayed treatment)’ were used in all studies. Deprexis includes 10 sessions, and the user can select which modules to use. The program demonstrated a medium effect size [g = 0.54; 95% CI (0.39–0.69)]. The authors describe the program as ‘broadly based on CBT’ but also describe it as including acceptance, mindfulness, attachment, interpersonal process, positive psychology, dream-work, nutrition and physical exercise. Because users could select the order of components, and the effects of the components were not examined, it is not clear how much evidence this provides for the effects of iCBT per se.

As part of a broad review of Internet-delivered psychological treatments for mood and anxiety disorders, Arnberg et al.⁹ summarized the results of five iCBT randomized trials that included a waitlist control group that were identified as part of their search. The test for overall effect was Z = 6.75; SMD = 0.83; 95% CI (0.59–1.07); P < 0.001. They also noted that many of these studies were conducted with well-educated and employed populations, which raises concerns about their effects for less resourced populations, the lack of adequately powered non-inferiority trials, the lack of information on implementation, and the paucity of information on long-term effects and information on children. Several articles that cite this publication have addressed some of these issues: for example, Thase et al.¹⁰ found that computer-assisted CBT that blends Internet-delivered skill-building modules with about 5 h of therapeutic contact was non-inferior to a standard course of CBT (up to 20 face-to-face sessions of 50 min each) that provided over eight additional hours of therapist contact. Klein et al.¹¹ did not find differences in depression outcome measures.

Păsărelu et al.¹² conducted a meta-analysis examining only transdiagnostic/tailored iCBT for adult anxiety and/or depression with control groups (i.e. waitlist comparison groups or active waitlists, such as attention modification or online discussion groups). The study included 19 randomized trials, and 2952 participants that met inclusion criteria were included in the analyses. For uncontrolled effects (Hedges' g), transdiagnostic/tailored iCBT had large and medium effects for anxiety and depression outcomes and for quality of life, respectively. For controlled effects, iCBT had medium to large effect sizes for anxiety and depression outcomes [anxiety: g = 0.82; 95% CI (0.58–1.05), P = 0.00; depression: g = 0.79; 95% CI (0.59–1.00), P = 0.00] and medium effect sizes for quality of life [g = 0.56; 95% CI (0.37–0.73), P = 0.00]. Of note, only two studies appeared to include participants with major depressive disorder. The authors concluded that transdiagnostic and tailored iCBT are effective for addressing anxiety and depression. (We did not include in the Supplementary table because of the heterogeneity of the subject selection characteristics.)

Richards and Richardson’s¹³ review included 40 studies and 19 RCTs; these studies were drawn from 45 and 23 published papers, respectively. The nature of the control groups was not explicitly specified, but based on tables in the article, appeared to include waitlist, treatment as usual and active treatment control groups. Across the 19 randomized studies, a moderate post-treatment pooled effect size was found [d = 0.56; 95% CI (−0.71 to −0.41); Z = 7.48; P < 0.001]. Therapist supported studies had a mean post-treatment effect size of d = 1.35 and d = 1.29 at follow-up. For coached or guided studies, the mean post-treatment effect size was d = 0.95 and at follow-up was d = 1.20 (P-values were not reported for any of these effect sizes). Among studies in which no support was provided, the mean post-treatment effect was d = 0.78 and at follow-up was d = 1.13. Across 40 studies, an overall rate of participant dropout was 57%. By intervention type, dropout rates were 74% for no support (self-help), 38% for guided/coached and 28% for direct therapy support. Thus, the authors concluded that supported interventions yielded better outcomes and had greater retention.

Hedman et al.¹⁴ evaluated 20 RCTs, which included over 4776 patients with depression. Control groups were not specified but based on the table, included such conditions as online information about depression, treatment from a general practitioner and face-to-face CBT. They found large treatment effects for iCBT for depression or depressive symptoms [d = 0.94; 95% CI (0.77–1.11)]. They also found that in comparing iCBT to conventional CBT across a number of problems, treatment effects were equivalent for iCBT [d = 1.04; 95% CI (0.73–1.35)] and conventional CBT [d = 1.14; 95% CI (0.72–1.56)] in 12 RCTs.

There were additional articles of relevance to this review that did not meet our formal criteria, but we felt the results of two were worth including. In an effort to compare face-to-face CBT vs. iCBT for ‘psychiatric and somatic conditions’, Carlbring et al.¹⁵ identified 20 studies that included 1418 participants comparing face-to-face CBT with iCBT within the same trial. The pooled effect size at post-treatment was Hedges’ g = 0.05 [95% CI (−0.09 to 0.20)], indicating that the overall effects of iCBT and face-to-face treatment were equivalent. Karyotaki et al.¹⁶ included participant data obtained from 13 RCTs in a trials meta-analysis that examined potential ‘harmful’ effects of iCBT. Control groups included waiting list, treatment as usual, attention placebo or other non-active controls. There was a clinically significant deteriorate of 5.8% in the treatment groups compared with 9.1% in the control groups, a significant difference [OR 0.62; 95% CI (0.46–0.83); P < 0.001] compared with control conditions.

Innovations and emerging directions for depression interventions

In reviewing the literature, it became apparent that a number of Internet-based approaches and strategies to improve delivery and/or engagement are being developed and that some might improve outcomes of iCBT-based programs. Papers describe the use of games, text messaging, ecological momentary assessment and automated systems, including conversational agents. Of these, text messaging and ecological momentary assessment systems have been widely used. We could not find reviews or meta-analyses that related these approaches for treating depression specifically. A noticeable gap in the literature is papers that examine the use of social media, peer support groups and other interventions that might enhance outcomes.

Summary

Systematic reviews and meta-analyses support the efficacy of Internet-based interventions for treating depression and depressive symptoms, at least in adults and in populations selected from higher socioeconomic demographics. Effect sizes are often in the moderate to strong range and are clinically important. Notably, the effectiveness of Internet-based interventions for depression has been demonstrated in a number of countries, with somewhat less evidence from studies in the U.S. High dropout rates and poor adherence are common. Few studies examine long-term effects, but short-term effects appear more substantial than longer ones. Online interventions are heavily dominated by iCBT-derived approaches. With some exceptions, therapist-supported or guided self-help intervention seem more effective than self-help. A few studies have found iCBT to be as effective as face-to-face treatment. More information is needed on the benefits of tailoring and providing single focused interventions, component analysis, systematic integrated approaches to defined populations and the effects on subtypes of depression and suicidality, to name a few topics. Little is known about the use of these techniques in low- and middle-income countries. Finally, more information is needed on the benefits of including social media, texting and other synchronous and asynchronous activities.

Anxiety

We initially identified 339 different articles (not including abstracts). Of these, eight met our search criteria and are included in this review. Anxiety disorders encompass a number of different disorders, yet most of the meta-analyses combined intervention effects across a number of different interventions. We also conducted searches focusing on specific anxiety disorders: PTSD, social phobia, GAD, OCD and simple phobias. (We include studies in the Supplementary table that present data on studies that focus on symptoms and overall effect on disorders, and studies specific to panic disorder/agoraphobia, social phobia, GAD and PTSD.)

Andrews et al.² identified 12 studies addressing panic disorder and agoraphobia, 11 studies addressing social anxiety disorder and 9 studies addressing GAD. All studies compared the Internet-based intervention to a control group including care as usual, waitlist, information control, psychological placebo or pill placebo, among others. In terms of between-group effect sizes, for panic disorder, Hedges’ g was 1.31 [95% CI (0.85–1.76); P < 0.001]. For social phobia, Hedges’ g was 0.92 [95% CI (0.76–1.08); P = 0.05]. For GAD, Hedges’ g was 0.70 [95% CI (0.39–1.01); P < 0.001]. The combined results for depression and anxiety are reported above.

Păsărelu et al.’s¹² meta-analysis, which combined interventions for anxiety and depression, also reviewed above, found medium to large controlled effect sizes for anxiety [g = 0.82; 95% CI (0.58–1.05), P = 0.00].

Olthuis et al.¹⁷ identified 38 RCTs including 3214 participants of therapist-supported iCBT compared with a waiting list, attention control, information or online discussion group; unguided CBT (self-help); or face-to-face CBT. The studies examined social phobia (11 trials), panic disorder with or without agoraphobia (eight trials), GAD (five trials), PTSD (two trials), OCD (two trials) and specific phobia (two trials). Eight remaining studies included a range of anxiety disorder diagnoses. The investigators made three primary comparisons: experimental vs. waiting list control, therapist supported iCBT vs. unguided iCBT and experimental vs. face-to-face CBT. Evidence from nine studies (644 participants) contributed to a pooled risk ratio (RR) of 4.18 [95% CI (2.42–7.22)] for clinically important improvement in anxiety at post-treatment, favoring therapist-supported iCBT over a waiting list, attention, information or online discussion group only. Similarly, the SMD for disorder-specific symptoms at post-treatment evidence from 22 studies [n = 1573; SMD = −1.12; 95% CI (−1.39 to −0.85)] and general anxiety symptoms at post-treatment [14 studies; n = 1004; SMD = −0.79; 95% CI (−1.10 to −0.48)] favored therapist-supported iCBT. At post-treatment, there were no clear differences between unguided CBT and therapist-supported iCBT for disorder-specific anxiety symptoms [four studies; n = 253; SMD = −0.24; 95% CI (−0.69 to 0.21)] or general anxiety symptoms [two studies; n = 138; SMD = 0.28; 95% CI (−2.21 to 2.78)]. Compared with face-to-face CBT, therapist-supported iCBT showed no significant differences in clinically important improvement in anxiety at post-treatment [four studies; n = 365; RR = 1.09; 95% CI (0.89–1.34)]. There were also no clear differences between face-to-face and therapist supported iCBT for disorder-specific anxiety symptoms at post-treatment [six studies; 424 participants; SMD = 0.09, 95% CI (−0.26 to 0.43); low-quality evidence] or general anxiety symptoms at post-treatment [five studies; 317 participants; SMD = 0.17; 95% CI (−0.35 to 0.69)]. They concluded that therapist-supported iCBT appears to be an efficacious treatment for anxiety in adults and that therapist-supported iCBT is more efficacious than waiting list, information only or online discussion groups. They also suggested that therapist-supported iCBT may not be inferior to face-to-face CBT in reducing anxiety.

Arnberg et al.⁹ identified nine trials that examined effects of iCBT on anxiety disorders. Eight trials evaluated the effect of therapist-guided iCBT compared with a waitlist control on social phobia (of note, five of the trials were interventions conducted by two research groups), with the overall effect being d = 0.85 [95% CI (0.66–1.05); P < 0.001]. They identified four trials for GAD, with the overall effect being d = 0.84 [95% CI (0.45–1.23); P < 0.001]. Because of study limitations, small samples, and lack of controls, the authors were unable to draw conclusions about online interventions for panic disorder, specific phobias, post-traumatic stress disorder, OCD or transdiagnostic approaches.

Hedman et al.,¹⁴ also reviewed above in the depression section, looked at 103 RCTs, with over 12 374 participants with anxiety and depression. Large treatment effects were reported for iCBT for panic disorder [n = 407; d = 1.42; 95% CI (0.86–1.99); nine RCTs], social phobia [n = 1448; d = 1.13; 95% CI (0.99–1.28); 16 RCTs], PTSD [n = 148; d = 1.23; 95% CI (0.83–1.63); six RCTs], GAD [n = 145; d = 1.12; 95% CI (0.61–1.62); two RCTs] and transdiagnostic treatments for anxiety disorders [d = 1.07; 95% CI (0.75–1.39); six RCTs]. Individual studies on OCD, severe health anxiety and spider phobia also reported large treatment effects.

A meta-review of 11 systematic reviews and meta-analyses about the efficacy of Internet-based psychological treatments for anxiety disorders noted that there is general agreement on the efficacy of Internet-based psychological treatment as compared with non-treatment groups (with large effect sizes), finding similar efficacy compared with face-to-face therapies and improved when combined with some therapist contact.¹⁸

Specific anxiety disorders

A few meta-analyses focused on specific anxiety disorders. Kampmann et al.¹⁹ conducted a meta-analysis to determine the efficacy of technology-assisted interventions for individuals with social anxiety disorder. They found 37 RCTs, enrolling 2991 participants that were enrolled into iCBT trials (21 studies); the other studies used virtual reality exposure therapy. Patients undergoing iCBT showed significantly less social anxiety disorder symptoms at post-assessment than passive control conditions [g = 0.84; 95% CI (0.72–0.97); P < 0.001]. iCBT had a small advantage compared with active control conditions at post-assessment [g = 0.38; 95% CI (0.13–0.62); P < 0.01]. Sijbrandij et al.²⁰ conducted a meta-analysis of 12 RCTs focused on PTSD. The pooled effect size of the 11 comparisons (10 studies, 1139 participants) that compared iCBT to waitlist support or treatment as usual was moderate [g = 0.71; 95% CI (0.49–0.93); P < 0.001]. Only three studies compared iCBT to other interventions, and the effect size was small [g = 0.28; 95% CI (0.00–0.56); P = 0.05].

Summary

iCBT for GAD, social phobia and PTSD is effective with at least moderate effect sizes. iCBT also seems effective for panic disorder. The results are less clear for OCD.

Substance use disorders

Our search terms for this section included addiction, alcohol or drug abuse or dependence, Internet, systematic reviews, meta-analyses. We did not include interventions for tobacco use cessation, as this is not a primary focus of ICare. We identified 370 articles of potential interest and included four that met our criteria related to alcohol and two on other substances.

Alcohol

Kaner et al.²¹ examined personalized digital interventions for reducing hazardous and harmful alcohol consumption in community-dwelling populations. The authors identified 57 randomized studies that included a total of 34 390 participants. Overall, they found that participants enrolled in a digital intervention drank significantly less alcohol (22.8 g/week) [95% CI (15.4–30.3)] than participants who received no or minimal interventions at end of follow-up. When compared with controls, they found a mean reduction of up to three drinks per week. Of the five studies included in the review that compared digital interventions to in-person interventions, all found that both digital and in-person interventions produced no significant difference post-treatment. The authors concluded that there is ‘moderate’ quality evidence that digital interventions may lower alcohol consumption.

Prosser et al.²² found 23 randomized controlled studies (n = 7614) that examined the effects of digital interventions in reducing drinking in college/university students located in North America (Canada and USA) and Europe (the Netherlands, UK and Sweden). They found a small but significant effect in reduction of drinking [Z = 4.80; SMD = −0.15; 95% CI (−0.21 to −0.09); P < 0.001]. Interventions that included a personalized feedback component (such that participants were provided tailored feedback based on their level of consumption during the week) were significantly more efficacious than those interventions that did not.

Black et al.²³ examined 93 RCTs examining the effectiveness of self-directed digital interventions in terms of reducing alcohol consumption against assessment-only control groups. The primary purpose of the study was to examine behavior change techniques, but they did note that a meta-analysis of the studies found small, but significant effects on alcohol consumption, averaging across time points. The smallest pooled effect size was on heavy episodic drinking frequency [d = 0.07; 95% CI (0.04–0.10)] and the largest pooled effect size was on total consumption [d = 0.15; 95% CI (0.11–0.18)] (P-values were not reported). The authors also found that smaller effects were associated with interventions that provided participants with information on consequences of alcohol consumption.

Finally, Riper et al.²⁴ conducted a meta-analysis on 16 RCTs (with 23 comparisons and 5612 participants) of both guided and unguided interventions for alcohol abuse. Control conditions included assessment-only, waitlist or a psychoeducational brochure. Internet-based interventions were associated with a small but significant overall effect size on reducing alcohol consumption [g = 0.20; 95% CI (0.13–0.27); P < 0.001], with women demonstrating the greatest reductions. While the effect size for guided interventions (g = 0.23) was slightly larger than for unguided interventions (g = 0.20), the authors found no significant difference between the two, possibly as a result of being underpowered and/or participant characteristics.

Other substance abuse

Boumparis et al.²⁵ conducted a systematic literature search to identify RCTs comparing Internet interventions to control conditions in terms of their effectiveness in reducing the use of opioids, cocaine and amphetamines. They identified 17 studies with 2836 participants. Of these, four studies found that Internet interventions significantly decreased opioid use at post-treatment [n = 606; g = 0.36; 95% CI (0.20–0.53); P < 0.001], and nine studies found reductions in illicit substance use at post-treatment [g = 0.35; 95% CI (0.24–0.45); P < 0.001]. Four studies found no significant effects of Internet interventions for stimulant users. Meanwhile, Tait et al.²⁶ identified ten studies involving 4125 participants that examined the effects of Internet or computer interventions on reducing the frequency of cannabis use compared with primarily assessment-only or informational control groups. They found a small, but significant overall effect size of g = 0.16 [95% CI (0.09–0.22); P < 0.001] at post-treatment. They did not find significant differences between guided and unguided interventions, and there was no effect of number of sessions of the intervention on mean effect size.

Summary

Several meta-analyses and systematic reviews suggest that Internet-based interventions can have a small effect size on reducing alcohol consumption, at least in the short term. We could not find evidence that such interventions promote alcohol abstinence, and the data are strongest for college and university populations compared with other populations. Fewer studies have addressed the effects of Internet interventions on other types of substance abuse. There is also encouraging data suggesting that Internet interventions may have a small but significant effect on cannabis use.

Eating disorders

Finally, our search for articles on eating disorders returned 240 papers, and seven met our search criteria and are included in this review.

A recent systematic review was conducted on mobile interventions for eating disorders,²⁷ and 15 studies of any design (e.g. experimental, observational) were reviewed. The interventions were evaluated as the sole means of support, in combination with face-to-face therapy or as relapse prevention. Most interventions used a CBT approach, and the remainders were vodcast. The authors found that mHealth interventions had some improvements in symptomatology at post-treatment, although several studies did not have a control group, making it difficult to ascertain the efficacy of this modality.

Pittock et al.²⁸ reviewed five iCBT studies tested in controlled trials among individuals with bulimic symptoms (i.e. bulimia nervosa or subthreshold bulimia nervosa). One study revealed iCBT to be more efficacious than bibliotherapy and a waitlist in reducing eating disorder behaviors at post-treatment, one study showed iCBT was superior to waitlist controls on self-induced vomiting at post-treatment, and three studies had large effects on binge eating and purging that were maintained at follow up, but no differences compared with controls. iCBT outperformed waitlist treatments in terms of abstinence from binge eating and other behaviors at follow-up. The authors call for more large-scale studies. The authors did not report overall effect sizes.

Melioli et al.²⁹ published a meta-analytic review of the efficacy of Internet interventions for reducing eating disorder symptoms and risk factors among individuals with ED symptoms or full-threshold diagnoses. Twenty studies were included that met the review criteria of comparing Internet-based preventive and treatment interventions to no-treatment or minimally-intensive control conditions (e.g. a brochure) using experimental or quasi-experimental designs. Studies that included active treatments as a comparison were excluded from the review. Across all studies, there was an overall summary effect of the interventions for improving eating disorder pathology. Specifically, summary effects were measured for body dissatisfaction [d = 0.28; 95% CI (0.15–0.41); P < 0.001], drive for thinness [d = 0.47; 95% CI (0.33–0.60); P < 0.001], thin ideal internalization [d = 0.36; 95% CI (0.07–0.65); P < 0.05], shape and weight concerns [shape concern: d = 0.35; 95% CI (0.13–0.57); P < 0.05; weight concern: d = 0.25; 95% CI (0.09–0.40); P < 0.05], dietary restriction [d = 0.36; 95% CI (0.23–0.49), P < 0.001], bulimic symptoms [d = 0.27; 95% CI (0.17–0.37), P < 0.001], purging frequency [d = 0.30; 95% CI (0.02–0.57); P < 0.05] and negative affect [d = 0.32; 95% CI (0.12–0.52), P < 0.05]. Completer analyses revealed similar findings as intent-to-treat analyses, suggesting that their results were not biased by rates of dropout. The authors concluded that Internet-based interventions successfully decrease eating disorder symptomatology.

In 2015, Schlegl et al.³⁰ also published a systematic review of technology-based psychological interventions, and they had the goal of extending past prior reviews by including studies that were not limited to RCTs. They evaluated 40 independent studies that evaluated technology-based psychological interventions for individuals with anorexia nervosa or bulimia nervosa, individuals with subthreshold symptoms, and caregivers. They excluded studies of interventions that had been recently reviewed in published manuscripts (e.g. virtual reality, StudentBodies). The authors concluded that guided computer-based interventions were efficacious for improving symptoms of bulimia nervosa (i.e. binge eating, purging and global eating disorder psychopathology) compared with control conditions among adults, with the need for RCTs among adolescents in this population. However, they noted that poor uptake, dropout and noncompliance may hinder the validity of their findings. The authors found that only one computer-based intervention had been evaluated for anorexia nervosa, with other interventions focused on relapse prevention in this population.

Loucas et al.³¹ evaluated RCTs of e-therapies to prevent and treat eating disorders using the UK's NICE systematic review methodology. E-therapies were defined as interventions delivered by computer, tablet or mobile phone via the Internet, software, CD-ROM or an app; comparator conditions were control conditions or an active intervention. E-therapies could include therapist contact, but studies were excluded if the primary mode of delivery was via a therapist (e.g. in-person, face-to-face treatment). Their literature review yielded 20 relevant RCTs but only four of which evaluated Internet therapies. At the end of the intervention, when compared with a waitlist control condition, CBT-based e-therapy was associated with small improvements in binge eating, vomiting and/or laxative misuse and improved rates of cessation of binge eating, vomiting and/or laxative misuse (24% of participants in the intervention group vs. 13% in the control group.) However, the few treatment studies involved in the analysis limit meaningful meta-analyses of the data and the authors note that confidence in the effect estimates was low.

Fairburn and Murphy³² also reviewed RCTs that evaluated online CBT interventions for eating disorders. They said that of the four trials, comprised of adults with eating disorders characterized by binge eating, engagement was low and cessation rates from binge eating varied from 10% to 37% in intent-to-treat analyses. However, they also said improvements from treatment were maintained at follow-up.

Aardoom et al.³³ identified 21 studies, of which 14 evaluated Internet-based programs. The authors noted that ‘because of the limited number of studies that compared Internet-based treatment to waiting list control conditions, and missing or incomplete data reports…it is hard to reach a reliable conclusion’.

Innovations and emerging directions for eating disorder interventions

We identified several articles that used virtual reality for assessing and treatment, and seemed to include iCBT treatments. Clus et al.³⁴ evaluated 26 studies of which eight were RCTs. They compared interventions using virtual reality techniques (e.g. to address body image or exposure to food stimuli) to another treatment or control. Given the heterogeneity of the studies (e.g. in terms of samples, virtual reality protocols), the authors did not report on the efficacy of the tools or interpret the results of the research. An earlier review, published in 2017, evaluated virtual reality for the assessment and treatment of bulimia nervosa, binge eating disorder and subthreshold variants.³⁵ The authors identified 19 clinical studies (i.e. controlled, uncontrolled or case reports), of which nine were assessment studies and ten were treatment studies, using virtual reality. They concluded that these studies are at an early stage but a promising approach for further study.

Two reviews of smartphone apps in major app stores suggest that apps designed for intervention are available, but few are evidence-based³⁶ and their clinical utility is unclear.³⁷ There also are exciting advances in large-scale implementation efforts to screen individuals with potential eating disorders and to provide iCBT based preventive and clinical services to populations.^38,39 Finally, use of social media requires further exploration, given the potential for benefits and harms from this modality among individuals with eating disorders.

Summary

Across studies, results suggest that Internet-based interventions for eating disorders are effective with small to moderate effect sizes. Several themes emerged for future directions for eating disorder research. First, more work is needed to evaluate Internet-based treatment interventions, particularly in comparison to face-to-face treatments. Second, as is relevant for many mental health disorders, opportunities to increase engagement and reduce rates of dropout are warranted. One recent meta-analysis of RCTs involving CBT for eating disorders found the overall dropout rates was about 24% and that dropout from digital CBT interventions was higher than for other delivery modalities (e.g. individual, group).⁴⁰ Third, it will be helpful to continue to identify factors that moderate intervention response in order to establish more precise delivery models and realize the full potential of Internet-based interventions for improving mental health care delivery.

Discussion

Across Internet-based intervention studies addressing depression, anxiety, substance abuse and eating disorders, almost all reviews and meta-analyses found that these interventions can successfully reduce symptoms and are efficacious treatments. Generally, effect sizes for Internet-based interventions treating eating disorders and substance abuse are lower compared with interventions for depression and anxiety. At least for anxiety and depression, therapist supported/guided interventions appear more effective than unguided approaches and comparable to face-to-face. It is not clear why Internet-based interventions for eating disorders and substance abuse seem less effective than for other disorders, but it may reflect the need to address comorbidities and provide longer therapies. More studies are needed to examine such issues.

Dropout continues to be a major issue in Internet-based interventions across disorders. Interventions that provide additional guidance or support can increase adherence; however, this model may not be as scalable as self-help models without guidance or support. Tailoring interventions to reflect an individual’s symptoms, demographic, interests and technology usage may be a solution to increasing engagement in self-help models and to increase reach of an effective, customized intervention. Additionally, pairing interventions with other apps may be beneficial.

Several of the older reviews and meta-analyses did not include interventions delivered via mobile phone applications, which is an almost ubiquitous technology feature among smartphone users. Future reviews should include more app-based programs as outcome studies become available. Interventions targeting individuals with lower socioeconomic backgrounds and with less access to high-end technology should also be developed and evaluated.

Limitations

There are a few limitations that should be noted. First, we included articles that focused on Internet-based treatment interventions primarily tested among adults; while some reviews and meta-analyses included adolescents and/or preventive interventions, studies focused exclusively on these areas were not included in this review. Second, the research database is strongly dominated by CBT based interventions. Third, as our goal was to summarize the state of the knowledge in this area and provide an overview of the literature, we do not present this as a systematic review or meta-analysis review, nor do we adhere to that format. Future work may benefit from a meta-analysis of the meta-analyses in this area. Finally, as we indicate in our search criteria, we did not include articles that focused on mental health problems in general to maintain scope; however, some articles may have been missed from our overview as a result.

Conclusion

Taken together, Internet-based interventions for depression, anxiety, substance abuse and eating disorders appear efficacious in reducing symptoms. Important areas for future research include generating more evidence for interventions delivered via mobile phone applications, identifying strategies to increase engagement and targeting digital technologies for various defined populations. The results of this overview strongly support the importance of the ICare program to enhance knowledge related to mobile interventions.

Supplementary data

Supplementary data are available at EURPUB online.