Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 May 1.
Published in final edited form as: Harv Rev Psychiatry. 2017 May-Jun;25(3):114–122. doi: 10.1097/HRP.0000000000000139

Internet-based Cognitive Behavioral Therapy for Depression: Current Progress & Future Directions

Christian A Webb 1,*, Isabelle M Rosso 1, Scott L Rauch 1
PMCID: PMC5421393  NIHMSID: NIHMS829164  PMID: 28475503

Abstract

The World Health Organization (WHO) estimates that during a given 12-month period approximately 34 million people suffering from major depressive disorder go untreated in Europe and the Americas alone.1 Barriers to treatment include geographic distance, lack of mental health insurance, prohibitive cost of treatment, long wait-lists, and perceived stigma. Over the past two decades internet-based cognitive behavioral therapy (iCBT) programs have proliferated. A growing body of research supports the efficacy of iCBT for depression and other psychiatric conditions, and these programs may help address barriers that hinder access to effective treatment. The present review describes common iCBT programs along with the evidence base supporting their efficacy in reducing symptoms of depression, reviews research on moderators of treatment response, and provides suggestions for future directions in research and care.

Keywords: Internet, Cognitive Behavioral Therapy, Treatment, Depression, Moderators

Introduction

Since its initial development in the 1960s,2,3 cognitive behavioral therapy (CBT) has flourished and emerged as one of the most commonly practiced and the most extensively researched form of psychotherapy.4 A large body of research supports the efficacy of CBT in alleviating depressive symptoms and lowering the risk of relapse.4,5 Over the past few decades, CBT protocols have been tailored to target a range of psychiatric disorders beyond depression, including anxiety disorders,6,7 bipolar disorder,8 substance use disorders,9,10 personality disorders11 and psychotic disorders.12,13 In recent years, CBT has also been adapted to incorporate newly developed interventions and techniques (e.g., mindfulness- and acceptance-based strategies). Despite this progress, the dominant delivery format of CBT has persisted: face-to-face individual or group therapy. The development of internet-based adaptations of CBT (iCBT), coupled with the exponential growth of internet access throughout the world, has the potential to reshape the landscape of behavioral and mental healthcare. The World Health Organization (WHO) estimates that during a given 12-month period approximately 34 million individuals suffering from major depressive disorder (MDD) go untreated in Europe and the Americas alone.1 Barriers to receiving treatment include costs, long wait-lists, limited access to psychiatric treatment where one lives, and perceived stigma of seeking treatment for a psychiatric disorder. Internet-based interventions have been proposed as one solution to help bridge this treatment gap. In this review, we discuss common iCBT programs for depression, the evidence base supporting these interventions, and the benefits as well as limitations of these programs. We also discuss moderators of treatment response and suggest directions for future research and care.

iCBT Programs for Depression

The majority of internet-based interventions for depression are cognitive behavioral in nature. Although there are differences in format and content, these programs all provide web-based access to materials that teach participants the core cognitive skills (e.g., the ability to identify and modify negative cognitions and depressogenic biases in information processing) and behavioral skills (e.g., behavioral activation, problem solving strategies) encouraged in traditional face-to-face CBT. Early versions of these programs were offline (e.g., delivered via CD-ROM). For example, the cognitive behavioral Beating the Blues (BTB) program was initially offered via CD-ROM, but was subsequently adapted for web-based delivery (available at http://www.beatingtheblues.co.uk).14,15 BTB was developed in the UK and consists of 8 web-based modules. Each module takes approximately 50-minutes to complete, and gradually guides participants through information on the cognitive behavioral model of depression, and teaches a range of common cognitive and behavioral skills. Similar to individual CBT, “homework” is assigned at the end of each module to provide patients the opportunity to practice the skills learned in a given module.

Another early web-based platform is MoodGYM16 (https://moodgym.anu.edu.au), which was developed by researchers in Australia. This program consists of 5 cognitive behavioral modules (lasting approximately 30–45 minutes each), focusing on the relationship between thoughts and emotions, identifying cognitive distortions and negative thoughts, strategies to modify negative thoughts, assertiveness and self-esteem training, behavioral activation, and problem solving. Module content is presented through web pages, interactive features, and supplementary pop-up windows. A personal workbook is also provided, containing assessments (e.g., of depressive/anxiety symptoms, negative cognitions) and 29 CBT-based exercises. Additional early, seminal work on iCBT was conducted in Sweden,17 and also in the Netherlands (e.g., Interapy: http://www.interapy.nl/home).18 Since then, the iCBT literature has expanded rapidly, with numerous additional web-based programs developed and tested.

iCBT programs differ in the extent to which they provide guidance or support. As reviewed in more detail below, unguided or “stand-alone” programs have been associated with relatively poorer outcomes and higher dropout rates than programs incorporating guidance or support. Guidance is provided in a variety of different forms, including informational and supportive automated emails sent to participants,19 brief (e.g., approximately 3–5 minute) weekly phone calls from therapists or research assistants providing encouragement, support and clarification of iCBT lesson content and homework,19 text-based communication between clients and clinicians,18 and, on the more time-intensive end of the support spectrum, providing online CBT via scheduled hour-long sessions.20

As noted above, although there are some differences in format and in the information presented, iCBT programs present similar cognitive behavioral content to participants via websites. Creative variants on these common iCBT formats also have been developed. For example, a CBT-based program named Panoply leverages a peer-to-peer crowdsourcing platform to facilitate the core cognitive skill of identifying and challenging negative thoughts.21 Specifically, through the Panoply platform, users submit brief descriptions of recent stressors and accompanying negative thoughts. These descriptions are then reviewed by other users who receive online training to provide one of three responses: (1) “support” (i.e., providing emotional support and active listening); (2) “debug” (i.e., aiding in identifying and correcting cognitive distortions); (3) “reframe” (i.e., offering alternative, more realistic ways of viewing the stressor). Importantly, all responses are reviewed by other Panoply users prior to being returned to the individual who submitted the original post. Responses deemed inappropriate are discarded. In sum, Panoply is different from other iCBT programs in that the work of identifying and modifying negative cognitions is outsourced to other users. An additional unique aspect of this platform is that users not only receive helpful feedback from others, but also have the opportunity to practice cognitive skills by delivering feedback to fellow Panoply users. A parallel iPhone app (Koko; http://itskoko.com) derived from the web-based Panoply platform has been developed. However, several of the Panoply features are not currently present in this app (e.g., training of other users to provide support, debug and reframe responses).

Researchers have also begun to capitalize on rapid advancements in technology to facilitate the diagnosis and treatment of depression. Examples of these innovations include using “passive” (i.e., no user input required) data collected from built-in smartphone sensors to predict elevated depressive symptoms and to suggest interventions;22,23 differentiating depressive versus manic mood states from speech patterns detected from phone conversations;24 predicting depressive symptoms from Facebook activity;25 delivering CBT interventions via videogame format;26 and using smartphone-based mental health apps to treat depression and anxiety.2729

The Benefits of iCBT

Internet-based treatments offer a range of benefits over traditional face-to-face therapy. First, and as noted above, many individuals suffering from depression do not receive treatment because they cannot access care.1 Internet-based interventions can substantially enhance access in a variety of ways: A) iCBT can be readily accessed from the comfort and convenience of home (or anywhere with an internet connection); B) the scalability of iCBT can drastically increase functional capacity of the care system, thereby overcoming current challenges of inadequate availability of care; and C) the temporal aspects of access can be substantially improved because time elapsed from screening/referral to the iCBT first session can be within the same day, whereas wait-times for initiation of face-to-face therapy are commonly on the order of weeks. Moreover, it is critical to appreciate that while face-to-face sessions need to be scheduled days or weeks in advance due to therapist availability, iCBT sessions can be completed whenever the patient feels best motivated to engage with the therapeutic content as judged by him/her in real time.

Second, some individuals may not seek treatment because they do not have insurance or cannot afford the out-of-pocket fees for treatment. Internet-based interventions are – at least currently – offered for a relatively small fee or free of charge. Data on the cost effectiveness of iCBT for depression is somewhat limited. A recent review indicated that, overall, the literature supports the cost-effectiveness of guided iCBT, and to a lesser extent unguided interventions not involving human support.30 (See also Warmerdam et al.31 and Hollinghurst et al.32). However, the available evidence remains somewhat mixed and more studies are needed to address this important question, including the relative cost-efficiency of internet-based versus face-to-face psychotherapeutic or pharmacologic treatment.

Third, the perceived stigma of seeing a mental health professional for a psychiatric disorder may keep individuals from seeking help. The ability to access internet-delivered treatment from the privacy of one’s home may increase access to care and help bridge the treatment gap.

In addition to these potential benefits, internet-based therapy – at least as currently provided – poses some risks. In particular, current iCBT programs are relatively ill-equipped to handle clinical crises such as active suicidality. In traditional face-to-face outpatient treatment, clinicians can assess for suicide risk in person, and determine whether a higher level of care is needed (e.g., hospitalization). Studies of internet-based interventions often incorporate self-report instruments to assess depressive symptoms, many of which include items assessing suicidal thoughts (e.g., Patient Health Questionnaire-9; PHQ-9).33 If a patient endorses elevated suicidality on a self-report measure, it is recommended that a clinician contact the participant to ascertain the nature and severity of the participant’s suicidality and to determine their risk status (e.g., by administering the Columbia-Suicide Severity Rating Scale;34 http://www.cssrs.columbia.edu/). Following such an evaluation, a clinician can decide whether continued iCBT treatment is appropriate or whether a patient requires a higher level of care. Some iCBT platforms, such as the Sadness Program (https://thiswayup.org.au), include automated emails that are triggered when participants endorse severe depressive symptoms or suicidality on self-report measures administered at the start of each lesson. These emails are sent to assigned clinician(s), who may be psychologists, psychiatrists, other mental health specialists, or general practitioners (GP) depending on the study.19,35 It is the responsibility of the assigned clinician to then contact participants to follow-up with a more detailed suicide assessment by phone.36 Many iCBT studies have excluded participants with higher levels of baseline suicidality, in order to minimize the risk of clinical crises occurring.19,36 Although more research is needed, there is some evidence that iCBT may be therapeutically beneficial even among depressed individuals who endorse suicidal ideation. One study found that 31% of participants who were prescribed the Sadness Program within a primary care setting reported having at least some suicidal ideation during the 2-week time period before starting the program.35 Subgroup analyses focused on patients endorsing suicidal thoughts at the beginning of treatment indicated significant improvement over the course of the program in depressive symptoms (Cohen’s d = 1.08), suicidal ideation (d = 1.10) and overall psychological distress (d = 1.07). Ultimately, it is up to the clinician(s) administering the iCBT intervention to manage risk according to the clinical and risk management guidelines of their institution.

Moreover, face-to-face CBT allows clinicians to develop an individual case conceptualization and tailor treatment to the unique needs of each patient. The majority of existing iCBT programs provide the same “one-size-fits-all” CBT content to every user. These iCBT programs place the task of individualizing the content on participants, who will need to apply them to their unique life circumstances and symptoms (e.g., using the homework assignments). As iCBT programs evolve they will likely become more interactive and better able to adapt to the idiosyncratic needs of each patient (e.g., tailoring content to symptom severity and symptom profiles). For example, the Panoply program provides personalized feedback based on the particular stressors and negative thoughts reported by users. Similarly, and as described below, “tailored” iCBT platforms have been developed that attempt to adapt program content based on the presenting symptoms of each patient.37

How Effective are iCBT Programs for Depression?

As discussed above, there are a number of possible benefits of internet-delivered treatment for depression. However, the proliferation of internet-based adaptations of CBT raises the important question: How effective are these iCBT programs for the treatment of depression? An early meta-analysis of 12 computer-based (10 iCBT and 2 offline, computerized programs) interventions for depression found a moderate post-treatment effect size (d = .56) reflecting greater symptom improvement relative to participants assigned to control groups. Intriguingly, this effect size was moderated by whether these programs were guided (d = .61) versus unguided (d = .25).38 Subsequent reviews identified a similar pattern of findings, with guided programs yielding larger effects than unguided interventions.3942 For example, a meta-analysis of 19 randomized clinical trials of iCBT for depression found a moderate effect size (d = .56) favoring iCBT over control groups in improving depressive symptoms.40 However, unguided interventions yielded smaller effect sizes (d = .38) than guided programs (d = .78 for therapist support; d = .58 for administrative support).

It is important to emphasize that the majority of iCBT studies to date have relied on wait-list control groups, with the next most common control condition being treatment as usual. Patients assigned to a wait-list condition do not receive the intervention during the trial, but they do complete the same symptom assessments as the treatment group. (Wait-list participants are typically given access to the iCBT content following their final assessment). The greater improvement among participants assigned to iCBT over wait-list control groups could be due to the cognitive and/or behavioral skills taught in treatment. However, greater symptom improvement among iCBT participants could also reflect the influence of “common” therapeutic factors, including greater expectations of improvement. In order to control for these factors, future studies will need to test iCBT versus more stringent or credible control conditions, such as a psychosocial placebo control condition that elicits similar expectations of symptom improvement relative to the treatment condition. Of course, one particularly relevant comparison condition for iCBT is traditional, face-to-face CBT. To date, there have only been a few trials with relatively small sample sizes comparing iCBT to face-to-face individual43 or group44,45 CBT. Interestingly, these studies each found similar depressive symptom improvement across groups. Although preliminary, these data suggest that iCBT may be as effective as face-to-face CBT in reducing depressive symptoms.

Given that anxiety is a common comorbidity of depression, it is important to note that transdiagnostic iCBT programs have been developed and found to significantly reduce both depression and anxiety symptoms.46 In addition, “tailored” iCBT programs have been developed to target the idiosyncratic symptoms or problems of each patient. One study of MDD patients with a range of different comorbidities tested a standard “one-size-fits-all” iCBT protocol versus a “tailored” iCBT intervention that adapted the program content based on the presenting symptoms of each patient. For example, in the tailored iCBT condition, a patient reporting substantial worry in addition to depression would receive a CBT-based module targeting worry in addition to cognitive behavioral content addressing depressive symptoms.37 Although both the standard and tailored iCBT groups evidenced significant depressive and anxiety symptom improvement, subgroup analyses indicated that those with higher pre-treatment depression scores (as well as more comorbidity) derived relatively greater therapeutic benefit from the tailored program. Finally, iCBT programs have been adapted for children and adolescents and shown to significantly reduce depressive symptoms in youth.47

In addition to well-controlled randomized clinical trials, it is especially important to assess the “real world” utility of iCBT to enhance access to low-cost, effective treatment. Indeed, several effectiveness studies indicate that iCBT can be effectively delivered in routine clinical care with similar therapeutic benefits as those observed in randomized clinical trials.4850 However, one large and recent effectiveness trial in the UK questioned the therapeutic benefits of iCBT in a primary care setting.51 Specifically, there was no significant difference in symptom improvement between depressed patients randomly assigned to usual GP care, or to either the Beating the Blues or MoodGYM iCBT combined with usual GP care. However, these findings are difficult to interpret for two reasons. First, approximately 19% of participants in the usual GP care arm also reportedly accessed iCBT content, either on their own or on the recommendation of their GP or mental health professional. In addition, the percentage of patients who completed all of the iCBT lessons in the Beating the Blues (18%) and MoodGYM (16%) groups was low. These findings highlight the challenge of maintaining iCBT treatment adherence in real-world settings.

Does iCBT Reduce the Risk of Relapse?

MDD is a highly recurrent disorder. Approximately 80% of those who have experienced a major depressive episode experience a recurrence.52 In addition, the risk of depression recurrence increases by approximately 16% with each successive episode.53 These data underscore the importance of treatments that not only reduce current depressive symptoms but also lower the risk of depression relapse. One of the benefits of traditional, face-to-face CBT is its ability to lower the risk of relapse following treatment termination. In fact, a meta-analysis found that face-to-face CBT was associated with a lower risk of depression relapse than antidepressant medication treatment.5 In order to support the dissemination of iCBT, similar relapse prevention findings would be helpful. In their meta-analytic review, Richards and Richardson found 14 studies that included follow-up data examining whether patients who received a course of iCBT for depression maintained their gains relative to control conditions.40 On average, iCBT patients reported lower levels of depressive symptoms than control participants, but the between-group effect size at follow-up (d =.20) was smaller than at post-treatment (d = .56). One recent study found no significant differences between iCBT and face-to-face CBT in depressive symptoms at a 3-month post-treatment follow-up assessment,43 although there was a nonsignificant trend in the direction of greater symptom improvement in the iCBT group. It is important to note that only about two thirds of participants completed the follow-up assessment in the latter study, limiting the authors’ ability to draw firm conclusions from these data.

Dropout Rates in iCBT

One of the attractive features of internet-based interventions is their scalability and potential to reach large numbers of depressed individuals who are not currently receiving treatment. Several early studies of iCBT platforms were unguided, “stand-alone” interventions. A concern that was raised early on in the development and testing of internet-based interventions for depression was the relatively high attrition rate in these stand-alone programs.54 Indeed, a meta-analysis of 40 iCBT studies found that over half (57%) of patients assigned to treatment drop out.40 In an effort to reduce dropout rates and increase treatment adherence, iCBT programs have incorporated therapist or administrative support. For instance, a study by Christensen and colleagues used brief weekly phone calls or emails from research assistants to check in with participants and clarify questions about program content.54 In their meta-analysis, Richards and Richardson found that dropout rates were significantly higher in stand-alone iCBT programs (74%) relative to either therapist support (28%) or administrative support (38%).40 For comparison, dropout rates in traditional, face-to-face CBT are approximately 17% in randomized clinical trials55 and 25% in non-randomized effectiveness studies.56 Thus, some form of staff support seems important to increase patient engagement and to reduce attrition rates in iCBT interventions. With regard to predictors of dropout, a recent individual patient data (IPD) meta-analysis of 2,705 participants across ten randomized clinical trials of internet-based interventions for depression identified younger age, male gender, lower educational level, and presence of co-morbid anxiety symptoms as being significantly associated with greater likelihood of dropout.57

Clearly, additional work is needed to identify ways to lower attrition rates in existing iCBT programs. However, some have argued that attrition from internet-based interventions, which have the potential to reach vast numbers of individuals who may otherwise not seek treatment, may be less of a concern than attrition from face-to-face treatment.58 By analogy, “massive open online courses” (MOOCs) provide (generally free) educational courses across a wide array of topics to any interested individual with internet access. Although the percentage of individuals who complete a given online course is typically low, a single MOOC may enroll upwards of several hundred thousand students.59 Inspired by the rapid growth of MOOCs, Muñoz and colleagues coined the phrase “massive open online interventions” (MOOIs) to refer to internet-based treatments that could reach a similarly vast number of individuals, and perhaps help offset relatively high dropout rates.58 For example, at the time of this writing, the MoodGYM program has reportedly been used by over 850,000 individuals, even if one study indicates that fewer than 7% of MoodGYM users progress beyond the first two modules (out of a total of 5 modules).60

For Whom is iCBT Most Effective?

A critical goal for the field is to identify those individuals who may derive the most therapeutic benefit from internet-based interventions, as well as those who would be better suited to receive a traditional form of treatment, such as pharmacotherapy and/or face-to-face psychotherapy (or combined treatment). In other words, depressed individuals may vary in their likelihood of responding to iCBT by virtue of their unique psychosocial, demographic, neurobiological, or clinical profile. In recent years there have been studies aimed at identifying predictors of treatment response to face-to-face CBT and pharmacotherapy. For example, one study found that CBT was more effective than selective serotonin reuptake inhibitor (SSRI) pharmacotherapy in reducing depressive symptoms for individuals who were experiencing a relatively large number of life stressors, were unemployed or were married (or cohabitating).61 In terms of neural markers of differential treatment response, glucose hypometabolism in the insula has been linked to better treatment response to CBT than to a SSRI for depression, whereas insula hypermetabolism has been associated with the reverse pattern (i.e., better outcomes for SSRI than CBT).62

Comparatively little research has examined predictors of treatment response to iCBT. Within the few existing studies, the following variables have been found to predict greater depressive symptom improvement in iCBT: relatively higher depression severity,6365 being separated, widowed or divorced,63 having a higher level of education,63 female gender,64,66 as well as lower levels of dysfunctional attitudes and lower perceived mastery (i.e., decreased sense of control over situations).66 More recently, and within the context of a study examining iCBT combined with face-to-face therapist guidance, researchers found that being married (or cohabitating), having higher life satisfaction, and having had more depressive episodes predicted better treatment outcomes; in contrast, higher levels of dysfunctional thinking predicted poorer outcomes.67 In summary, there is substantial variability across studies in the moderator variables examined, as well as in findings. Notably, several studies have found that higher depression severity,6365 as well as more frequent depressive episodes,67 predicts better treatment outcomes to iCBT. Given the lack of clinician contact, and relatively brief nature of the interventions, many iCBT studies purposefully excluded more severely depressed patients who may reasonably require more intensive face-to-face treatment.19,36 Still, the abovementioned findings suggest that, on average, individuals with relatively more severe depression at the beginning of treatment may derive greater therapeutic benefit from iCBT treatment than those with lower depression severity. Nevertheless, these studies were not designed to address whether or not individuals with higher levels of depressive symptoms exhibit relatively greater symptom improvement in an alternative treatment, such as face-to-face CBT. Additional research is required comparing depressive symptom improvement for relatively lower vs. higher severity depressed patients randomly assigned to iCBT vs. face-to-face CBT (or pharmacotherapy).

Prognostic vs. Prescriptive Predictors of Treatment Response

The above findings indicate that there may be certain pre-treatment patient characteristics that can help predict who is more or less likely to improve in iCBT. Although such general “prognostic predictors” are clinically informative, research testing “prescriptive predictors” (i.e., testing for statistical interactions between pre-treatment predictor variables and treatment condition)61 is needed to examine whether certain variables (e.g., clinical, demographic, psychosocial, neurobiological) predict differential response to iCBT relative to other treatment options.1 In other words, whereas prognostic variables predict outcome across treatments, prescriptive variables (also referred to as moderators) predict a different pattern of outcomes for two or more treatments.61 Such research could ultimately inform treatment selection. That is, consistent with the pursuit of personalized medicine in psychiatry, these types of studies can lead to the identification of pre-treatment characteristics that provide clinicians with clinically useful information regarding which intervention has the highest likelihood of improving an individual’s depression. To date, the few iCBT studies that have tested pre-treatment predictor by treatment group interactions have mostly yielded null findings. For example, one study examined predictors of symptom improvement within a clinical trial comparing iCBT versus internet-delivered problem-solving therapy.65 The authors did not find any moderators that differentially predicted outcome between these two treatments. Similarly, Donker and colleagues compared iCBT to internet-delivered interpersonal therapy, and found that no pre-treatment variables interacted with intervention group in differentially predicting outcome.66 In another study, the personality characteristic of altruism moderated treatment outcome such that those with higher levels of altruism evidenced greater symptom improvement in face-to-face group CBT than in iCBT.64 However, the nine other moderator variables they tested were not significant.

Although there are more studies testing prescriptive predictors of treatment response in face-to-face treatment of depression69 and anxiety70, findings in the iCBT literature have similarly been disappointing with few consistent moderators identified. Given the large sample sizes required to provide adequately powered tests of predictors of differential response to two or more treatments,70 most existing studies may be underpowered to detect statistically significant treatment moderators. In addition, the above studies tested the role of individual moderating variables in predicting response to iCBT. More recent statistical methods allow for the combining of multiple moderators rather than relying on single variables, each of which may have small effects when considered individually.68,71,72 For example, among depressed patients randomly assigned to interpersonal therapy versus SSRI pharmacotherapy, one study used principal-components analysis to derive a composite moderator from a set of 32 pre-treatment variables.72 Their final composite moderator was comprised of a weighted combination of eight variables and, notably, was a stronger predictor (effect size = .31) of differential treatment response than any individual pre-treatment variable (largest single moderator effect size = .12).

Multivariate machine learning (ML) methods offer another empirical approach to combining individual predictors in an effort to identify more robust, and ultimately clinically informative, moderators of treatment response.73 ML refers to a family of different statistical methods involving the use of algorithms to identify meaningful patterns within data. For example, one study applied ML analysis to pretreatment resting electroencephalography (EEG) data and found that the resulting ML-derived combination of EEG markers yielded better prediction of SSRI response (81% specificity, 95% sensitivity) than any individual predictor (60% specificity, 86% sensitivity).71 For recent similar findings, see Checkroud et al.73 and Etkin et al.74 To our knowledge, no study has examined whether brain-based variables may predict treatment response in iCBT. Earlier we noted that glucose metabolism in the insula has been found to differentiate treatment response to face-to-face CBT versus SSRIs.62 It remains to be seen whether or not neural variables are more sensitive than clinical/demographic variables in predicting treatment response to iCBT. Given their costs, and in order to be clinically useful, neural variables must provide incremental predictive validity above and beyond other much more inexpensive and easily administered measures (e.g., clinical, demographic, or psychosocial variables).

Future Directions

Future research in iCBT should aim to extend work to date in several respects. First, more rigorous control groups (e.g., active placebo controls, face-to-face CBT) will enable testing for differential efficacy. In this context, relatively large samples will be needed to confer sufficient power to test for clinical group differences, as well as to support predictor and moderator analyses. In addition, with rapid advances in mobile technology there is opportunity for commensurate swift evolution in the manner in which iCBT programs are delivered. Most fundamentally, with the rapid proliferation of smartphone apps, it is likely that these will quickly become the dominant mode of accessing such programs, in comparison with computer- and web-based methods. This will yield several notable advantages, including the convenience and ease with which patients can carry the program with them and complete homework activities in their day-to-day lives. Given that many patients fail to adhere to iCBT treatment,51,60 the extent to which individuals are more likely to access and ideally complete iCBT courses on their smartphones versus on their computers is an important question for future research.

With a progression to iCBT via smartphones, there will also be the potential to integrate ecological momentary assessment (EMA), as well as passive data acquired from built-in smartphone sensors (e.g., GPS, accelerometer, meta-data from calls and text messages) to measure other indices of patient behavior and clinical status, into the therapeutic process. The Mobylize App is one example, seeking to detect depressive mood states based on passive data and to intervene with suggestions of behavioral strategies to boost mood.22

Finally, advances in iCBT will also need to be incorporated into the larger ongoing transformational effort to redesign healthcare. In this context, behavioral and mental health services are being better integrated with primary care, and delivery as well as payment models are evolving to support improved public health via population health management.75,76 Indeed, approaches such as iCBT are emblematic of this movement, representing a scalable approach that can be offered proximate to screening in the primary care office, to improve access, enhance outcomes and reduce cost. It remains to be determined which sub-populations of patients will be best suited for these versus alternative interventions, and which methods and amount of patient contact (e.g., brief weekly phone calls from iCBT staff providing encouragement, support and clarification of iCBT lesson content and homework) will best facilitate treatment adherence and completion. In addition, given that the bulk of iCBT studies have been conducted outside of the United States, research is needed to determine how internet-based treatment should be modified to be best integrated into the American healthcare system. Finally, it will be critical to ensure privacy and the security of patient data given the advancements in technology and the rapid proliferation of internet- and smartphone-delivered interventions.

Conclusion

The field of iCBT has advanced considerably in the past two decades, yielding several popular tools that appear to be efficacious and effective for the treatment of depression. This approach holds promise for improved access, enhanced outcomes, and reduced cost. Still, further research is needed to determine the best approaches to patient selection and for optimizing engagement, as well as the best overall manner for integrating these tools into the larger healthcare delivery system. Likewise, further research is needed to advance our understanding of predictors of treatment response and underlying mechanisms of change in order to further refine and improve existing internet-based treatments. In this context, it is likely that smartphones will soon become the dominant mode of delivery for iCBT applications. It is exciting to consider how this field will rapidly change and advance in the service of helping patients who suffer from depressive symptoms.

Acknowledgments

Source of Funding: Christian A. Webb was partially supported by NIMH K23 MH108752, a NARSAD Young Investigator Award, as well as the Klingenstein Third Generation Foundation. Isabelle M. Rosso was partially supported by NIMH R01 MH096987. Scott L. Rauch was partially supported by USAMRMC W81XWH-12-1-0109.

Footnotes

1

Terminology for these two different classes of predictors differ. Some reserve the term “predictor” for prognostic predictors and use the term “moderator” for prescriptive predictors.68

Conflicts of Interest: The authors report no conflicts of interest. The authors alone are responsible for the content and writing of the article.

References

  • 1.Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004;82(11):858–867. [PMC free article] [PubMed] [Google Scholar]
  • 2.Beck AT. Depression: Causes and Treatment. Philadelphia: University of Pennsylvania Press; 1967. [Google Scholar]
  • 3.Ellis A. Reason and Emotion in Psychotherapy: A New and Comprehensive Method of Treating Human Disturbances. Secaucus, N.J: Citadel Press; 1962. [Google Scholar]
  • 4.DeRubeis RJ, Webb CA, Tang TZ, Beck AT. Cognitive therapy. In: Dobson KS, editor. Handbook of Cognitive-Behavioral Therapy. 3. New York: Guilford; 2010. [Google Scholar]
  • 5.Cuijpers P, Hollon SD, Straten A, van Bockting C, Berking M, Andersson G. Does cognitive behaviour therapy have an enduring effect that is superior to keeping patients on continuation pharmacotherapy? A meta-analysis. BMJ Open. 2013;3(4):e002542. doi: 10.1136/bmjopen-2012-002542. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Barlow DH. Anxiety and Its Disorders: The Nature and Treatment of Anxiety and Panic. Guilford Press; 2004. [Google Scholar]
  • 7.Barlow DH. Clinical Handbook of Psychological Disorders, Fifth Edition: A Step-By-Step Treatment Manual. Guilford Publications; 2014. [Google Scholar]
  • 8.Newman CF, Leahy RL, Beck AT, Reilly-Harrington NA, Gyulai L. Bipolar Disorder: A Cognitive Therapy Approach. xiv. Washington, DC, US: American Psychological Association; 2002. [Google Scholar]
  • 9.Beck AT, Wright FD, Newman CF, Liese BS. Cognitive Therapy of Substance Abuse. Guilford Press; 1993. [PubMed] [Google Scholar]
  • 10.Carroll KM, Onken LS. Behavioral Therapies for Drug Abuse. Am J Psychiatry. 2005;162(8):1452–1460. doi: 10.1176/appi.ajp.162.8.1452. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Beck AT, Davis DD, Freeman A, editors. Cognitive Therapy of Personality Disorders. 3. New York: The Guilford Press; 2014. [Google Scholar]
  • 12.Beck AT, Rector NA, Stolar N, Grant P. Schizophrenia: Cognitive Theory, Research, and Therapy. 1. New York: The Guilford Press; 2011. [Google Scholar]
  • 13.Kingdon DG, Turkington D. Cognitive Therapy of Schizophrenia. 1. New York: The Guilford Press; 2005. [Google Scholar]
  • 14.Proudfoot J, Goldberg D, Mann A, Everitt B, Marks I, Gray JA. Computerized, interactive, multimedia cognitive-behavioural program for anxiety and depression in general practice. Psychol Med. 2003;33(2):217–227. doi: 10.1017/S0033291702007225. [DOI] [PubMed] [Google Scholar]
  • 15.Proudfoot J, Ryden C, Everitt B, et al. Clinical efficacy of computerised cognitive–behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br J Psychiatry. 2004;185(1):46–54. doi: 10.1192/bjp.185.1.46. [DOI] [PubMed] [Google Scholar]
  • 16.Christensen H, Griffiths KM, Korten A. Web-based Cognitive Behavior Therapy: Analysis of Site Usage and Changes in Depression and Anxiety Scores. J Med Internet Res. 2002;4(1):e3. doi: 10.2196/jmir.4.1.e3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Andersson G, Bergström J, Holländare F, Carlbring P, Kaldo V, Ekselius L. Internet-based self-help for depression: randomised controlled trial. Br J Psychiatry. 2005;187(5):456–461. doi: 10.1192/bjp.187.5.456. [DOI] [PubMed] [Google Scholar]
  • 18.Ruwaard J, Schrieken B, Schrijver M, et al. Standardized Web-Based Cognitive Behavioural Therapy of Mild to Moderate Depression: A Randomized Controlled Trial with a Long-Term Follow-Up. Cogn Behav Ther. 2009;38(4):206–221. doi: 10.1080/16506070802408086. [DOI] [PubMed] [Google Scholar]
  • 19.Titov N, Andrews G, Davies M, McIntyre K, Robinson E, Solley K. Internet Treatment for Depression: A Randomized Controlled Trial Comparing Clinician vs. Technician Assistance. [Accessed June 13, 2016];PLoS One. 2010 5(6) doi: 10.1371/journal.pone.0010939. http://search.proquest.com/openview/0b2a90b15a6583e8f702e765e22f0f35/1?pq-origsite=gscholar. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Kessler D, Lewis G, Kaur S, et al. Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial. The Lancet. 2009;374(9690):628–634. doi: 10.1016/S0140-6736(09)61257-5. [DOI] [PubMed] [Google Scholar]
  • 21.Morris RR, Schueller SM, Picard RW. Efficacy of a Web-Based, Crowdsourced Peer-To-Peer Cognitive Reappraisal Platform for Depression: Randomized Controlled Trial. J Med Internet Res. 2015;17(3) doi: 10.2196/jmir.4167. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Burns MN, Begale M, Duffecy J, et al. Harnessing context sensing to develop a mobile intervention for depression. J Med Internet Res. 2011;13(3):e55. doi: 10.2196/jmir.1838. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Saeb S, Zhang M, Karr CJ, et al. Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study. J Med Internet Res. 2015;17(7) doi: 10.2196/jmir.4273. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Karam ZN, Provost EM, Singh S, et al. Ecologically valid long-term mood monitoring of individuals with bipolar disorder using speech. 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); 2014; pp. 4858–4862. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Park S, Lee SW, Kwak J, Cha M, Jeong B. Activities on Facebook Reveal the Depressive State of Users. J Med Internet Res. 2013;15(10) doi: 10.2196/jmir.2718. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Stasiak K, Hatcher S, Frampton C, Merry SN. A Pilot Double Blind Randomized Placebo Controlled Trial of a Prototype Computer-Based Cognitive Behavioural Therapy Program for Adolescents with Symptoms of Depression. Behav Cogn Psychother. 2014;42(04):385–401. doi: 10.1017/S1352465812001087. [DOI] [PubMed] [Google Scholar]
  • 27.Donker T, Petrie K, Proudfoot J, Clarke J, Birch M-R, Christensen H. Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review. J Med Internet Res. 2013;15(11):e247. doi: 10.2196/jmir.2791. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Torous J, Powell AC. Current research and trends in the use of smartphone applications for mood disorders. Internet Interv. 2015;2(2):169–173. doi: 10.1016/j.invent.2015.03.002. [DOI] [Google Scholar]
  • 29.Torous J, Staples P, Onnela J-P. Realizing the Potential of Mobile Mental Health: New Methods for New Data in Psychiatry. Curr Psychiatry Rep. 2015;17(8):61. doi: 10.1007/s11920-015-0602-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Donker T, Blankers M, Hedman E, Ljótsson B, Petrie K, Christensen H. Economic evaluations of Internet interventions for mental health: a systematic review. Psychol Med. 2015;45(16):3357–3376. doi: 10.1017/S0033291715001427. [DOI] [PubMed] [Google Scholar]
  • 31.Warmerdam L, Smit F, van Straten A, Riper H, Cuijpers P. Cost-Utility and Cost-Effectiveness of Internet-Based Treatment for Adults With Depressive Symptoms: Randomized Trial. J Med Internet Res. 2010;12(5):e53. doi: 10.2196/jmir.1436. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hollinghurst S, Peters TJ, Kaur S, Wiles N, Lewis G, Kessler D. Cost-effectiveness of therapist-delivered online cognitive-behavioural therapy for depression: randomised controlled trial. Br J Psychiatry. 2010;197(4):297–304. doi: 10.1192/bjp.bp.109.073080. [DOI] [PubMed] [Google Scholar]
  • 33.Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med. 2001;16(9):606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Posner K, Brown GK, Stanley B, et al. The Columbia–Suicide Severity Rating Scale: Initial Validity and Internal Consistency Findings From Three Multisite Studies With Adolescents and Adults. Am J Psychiatry. 2011;168(12):1266–1277. doi: 10.1176/appi.ajp.2011.10111704. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Williams AD, Andrews G. The Effectiveness of Internet Cognitive Behavioural Therapy (iCBT) for Depression in Primary Care: A Quality Assurance Study. PLOS ONE. 2013;8(2):e57447. doi: 10.1371/journal.pone.0057447. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Rosso IM, Killgore WDS, Olson EA, Webb CA, Fukunaga R, Auerbach RP, Gogel H, Buchholz JL, Rauch SL. Internet-based cognitive behavior therapy for major depressive disorder: a randomized controlled trial. Depression and Anxiety. doi: 10.1002/da.22590. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Johansson R, Sjöberg E, Sjögren M, et al. Tailored vs. Standardized Internet-Based Cognitive Behavior Therapy for Depression and Comorbid Symptoms: A Randomized Controlled Trial. PLOS ONE. 2012;7(5):e36905. doi: 10.1371/journal.pone.0036905. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Andersson G, Cuijpers P. Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis. Cogn Behav Ther. 2009;38(4):196–205. doi: 10.1080/16506070903318960. [DOI] [PubMed] [Google Scholar]
  • 39.Johansson R, Andersson G. Internet-based psychological treatments for depression. Expert Rev Neurother. 2012;12(7):861–869. doi: 10.1586/ern.12.63. quiz 870. [DOI] [PubMed] [Google Scholar]
  • 40.Richards D, Richardson T. Computer-based psychological treatments for depression: A systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–342. doi: 10.1016/j.cpr.2012.02.004. [DOI] [PubMed] [Google Scholar]
  • 41.Andersson G, Wagner B, Cuijpers P. ICBT for Depression. In: Lindefors N, Andersson G, editors. Guided Internet-Based Treatments in Psychiatry. Springer International Publishing; 2016. [Accessed August 11, 2016]. pp. 17–32. http://link.springer.com/chapter/10.1007/978-3-319-06083-5_2. [Google Scholar]
  • 42.Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — A systematic review. Internet Interv. 2014;1(4):205–215. doi: 10.1016/j.invent.2014.08.003. [DOI] [Google Scholar]
  • 43.Wagner B, Horn AB, Maercker A. Internet-based versus face-to-face cognitive-behavioral intervention for depression: A randomized controlled non-inferiority trial. J Affect Disord. 2014;152–154:113–121. doi: 10.1016/j.jad.2013.06.032. [DOI] [PubMed] [Google Scholar]
  • 44.Spek V, Nyklíček I, Smits N, et al. Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial. Psychol Med. 2007;37(12):1797–1806. doi: 10.1017/S0033291707000542. [DOI] [PubMed] [Google Scholar]
  • 45.Andersson G, Hesser H, Veilord A, et al. Randomised controlled non-inferiority trial with 3-year follow-up of internet-delivered versus face-to-face group cognitive behavioural therapy for depression. J Affect Disord. 2013;151(3):986–994. doi: 10.1016/j.jad.2013.08.022. [DOI] [PubMed] [Google Scholar]
  • 46.Titov N, Dear BF, Schwencke G, et al. Transdiagnostic internet treatment for anxiety and depression: A randomised controlled trial. Behav Res Ther. 2011;49(8):441–452. doi: 10.1016/j.brat.2011.03.007. [DOI] [PubMed] [Google Scholar]
  • 47.Pennant ME, Loucas CE, Whittington C, et al. Computerised therapies for anxiety and depression in children and young people: A systematic review and meta-analysis. Behav Res Ther. 2015;67:1–18. doi: 10.1016/j.brat.2015.01.009. [DOI] [PubMed] [Google Scholar]
  • 48.Titov N, Dear BF, Staples LG, et al. MindSpot Clinic: An Accessible, Efficient, and Effective Online Treatment Service for Anxiety and Depression. Psychiatr Serv. 2015;66(10):1043–1050. doi: 10.1176/appi.ps.201400477. [DOI] [PubMed] [Google Scholar]
  • 49.Hedman E, Ljótsson B, Kaldo V, et al. Effectiveness of Internet-based cognitive behaviour therapy for depression in routine psychiatric care. J Affect Disord. 2014;155:49–58. doi: 10.1016/j.jad.2013.10.023. [DOI] [PubMed] [Google Scholar]
  • 50.Andersson G, Hedman E. Effectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings. Verhaltenstherapie. 2013;23(3):140–148. doi: 10.1159/000354779. [DOI] [Google Scholar]
  • 51.Gilbody S, Littlewood E, Hewitt C, et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial. BMJ. 2015;351:h5627. doi: 10.1136/bmj.h5627. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Kessler RC, Berglund P, Demler O, et al. The epidemiology of major depressive disorder: Results from the national comorbidity survey replication (ncs-r) JAMA. 2003;289(23):3095–3105. doi: 10.1001/jama.289.23.3095. [DOI] [PubMed] [Google Scholar]
  • 53.Boland R, Keller M. Course and outcome of depression. In: Gotlib IH, Hammen HL, editors. Handbook of Depression. 2. New York: Guilford Press; 2009. [Google Scholar]
  • 54.Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med. 2006;(12):1737–1746. doi: 10.1017/S0033291706008695. [DOI] [PubMed] [Google Scholar]
  • 55.Cooper AA, Conklin LR. Dropout from individual psychotherapy for major depression: A meta-analysis of randomized clinical trials. Clin Psychol Rev. 2015;40:57–65. doi: 10.1016/j.cpr.2015.05.001. [DOI] [PubMed] [Google Scholar]
  • 56.Hans E, Hiller W. Effectiveness of and dropout from outpatient cognitive behavioral therapy for adult unipolar depression: A meta-analysis of nonrandomized effectiveness studies. J Consult Clin Psychol. 2013;81(1):75–88. doi: 10.1037/a0031080. [DOI] [PubMed] [Google Scholar]
  • 57.Karyotaki E, Kleiboer A, Smit F, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an “individual patient data” meta-analysis. Psychol Med. 2015;45(13):2717–2726. doi: 10.1017/S0033291715000665. [DOI] [PubMed] [Google Scholar]
  • 58.Muñoz RF, Bunge EL, Chen K, et al. Massive Open Online Interventions A Novel Model for Delivering Behavioral-Health Services Worldwide. Clin Psychol Sci. 2016;4(2):194–205. doi: 10.1177/2167702615583840. [DOI] [Google Scholar]
  • 59.Hardesty L. Lessons learned from MITx’s prototype course. MIT News; [Accessed August 12, 2016]. http://news.mit.edu/2012/mitx-edx-first-course-recap-0716. [Google Scholar]
  • 60.Christensen H, Griffiths K, Groves C, Korten A. Free Range users and One Hit Wonders: Community Users of an Internet-Based Cognitive Behaviour Therapy Program. Aust N Z J Psychiatry. 2006;40(1):59–62. doi: 10.1080/j.1440-1614.2006.01743.x. [DOI] [PubMed] [Google Scholar]
  • 61.Fournier JC, DeRubeis RJ, Shelton RC, Hollon SD, Amsterdam JD, Gallop R. Prediction of response to medication and cognitive therapy in the treatment of moderate to severe depression. J Consult Clin Psychol. 2009;77(4):775–787. doi: 10.1037/a0015401. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.McGrath CL, Kelley ME, Holtzheimer PE, et al. Toward a neuroimaging treatment selection biomarker for major depressive disorder. JAMA Psychiatry. 2013;70(8):821–829. doi: 10.1001/jamapsychiatry.2013.143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Button KS, Wiles NJ, Lewis G, Peters TJ, Kessler D. Factors associated with differential response to online cognitive behavioural therapy. Soc Psychiatry Psychiatr Epidemiol. 2012;47(5):827–833. doi: 10.1007/s00127-011-0389-1. [DOI] [PubMed] [Google Scholar]
  • 64.Spek V, Nyklíček I, Cuijpers P, Pop V. Predictors of outcome of group and internet-based cognitive behavior therapy. J Affect Disord. 2008;105(1–3):137–145. doi: 10.1016/j.jad.2007.05.001. [DOI] [PubMed] [Google Scholar]
  • 65.Warmerdam L, Van Straten A, Twisk J, Cuijpers P. Predicting outcome of Internet-based treatment for depressive symptoms. Psychother Res. 2013;23(5):559–567. doi: 10.1080/10503307.2013.807377. [DOI] [PubMed] [Google Scholar]
  • 66.Donker T, Batterham PJ, Warmerdam L, et al. Predictors and moderators of response to internet-delivered Interpersonal Psychotherapy and Cognitive Behavior Therapy for depression. J Affect Disord. 2013;151(1):343–351. doi: 10.1016/j.jad.2013.06.020. [DOI] [PubMed] [Google Scholar]
  • 67.Høifødt RS, Mittner M, Lillevoll K, et al. Predictors of Response to Web-Based Cognitive Behavioral Therapy With High-Intensity Face-to-Face Therapist Guidance for Depression: A Bayesian Analysis. J Med Internet Res. 2015;17(9):e197. doi: 10.2196/jmir.4351. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Kraemer HC. Discovering, comparing, and combining moderators of treatment on outcome after randomized clinical trials: a parametric approach. Stat Med. 2013;32(11):1964–1973. doi: 10.1002/sim.5734. [DOI] [PubMed] [Google Scholar]
  • 69.Simon GE, Perlis RH. Personalized Medicine for Depression: Can We Match Patients With Treatments? Am J Psychiatry. 2010;167(12):1445–1455. doi: 10.1176/appi.ajp.2010.09111680. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Schneider RL, Arch JJ, Wolitzky-Taylor KB. The state of personalized treatment for anxiety disorders: A systematic review of treatment moderators. Clin Psychol Rev. 2015;38:39–54. doi: 10.1016/j.cpr.2015.02.004. [DOI] [PubMed] [Google Scholar]
  • 71.Khodayari-Rostamabad A, Reilly JP, Hasey GM, de Bruin H, MacCrimmon DJ. A machine learning approach using EEG data to predict response to SSRI treatment for major depressive disorder. Clin Neurophysiol. 2013;124(10):1975–1985. doi: 10.1016/j.clinph.2013.04.010. [DOI] [PubMed] [Google Scholar]
  • 72.Wallace ML, Frank E, Kraemer HC. A novel approach for developing and interpreting treatment moderator profiles in randomized clinical trials. JAMA Psychiatry. 2013;70(11):1241–1247. doi: 10.1001/jamapsychiatry.2013.1960. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Chekroud AM, Zotti RJ, Shehzad Z, et al. Cross-trial prediction of treatment outcome in depression: a machine learning approach. Lancet Psychiatry. 2016;3(3):243–250. doi: 10.1016/S2215-0366(15)00471-X. [DOI] [PubMed] [Google Scholar]
  • 74.Etkin A, Patenaude B, Song YJC, et al. A Cognitive–Emotional Biomarker for Predicting Remission with Antidepressant Medications: A Report from the iSPOT-D Trial. Neuropsychopharmacology. 2015;40(6):1332–1342. doi: 10.1038/npp.2014.333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Patel V, Chisholm D, Parikh R, et al. Addressing the burden of mental, neurological, and substance use disorders: key messages from Disease Control Priorities, 3rd edition. The Lancet. 2016;387(10028):1672–1685. doi: 10.1016/S0140-6736(15)00390-6. [DOI] [PubMed] [Google Scholar]
  • 76.Dobbins MI, Thomas SA, Melton SLS, Lee S. Integrated Care and the Evolution of the Multidisciplinary Team. Prim Care Clin Off Pract. 2016;43(2):177–190. doi: 10.1016/j.pop.2016.01.003. [DOI] [PubMed] [Google Scholar]

RESOURCES