Abstract
Cognitive-behavioral therapy (CBT) is one of the most evaluated behavioral interventions for substance use disorders, with considerable empirical evidence supporting its efficacy. However, despite CBT’s strong support from efficacy trials, broad dissemination and implementation have been challenging. Furthermore, there remains limited understanding regarding CBT’s mechanisms of behavior change; the theory-driven assumption that individuals acquire new skills for coping with triggers for substance use has notoriously lacked statistical support. The emergence of computer-delivered interventions has the potential to address dissemination and implementation challenges, as well as offer advantages toward understanding treatment mechanisms. This article will provide a summary of the current evidence supporting one particular computerized CBT program, CBT4CBT. Multiple clinical trials in different treatment settings have indicated CBT4CBT’s efficacy at reducing rates of alcohol and drug use when provided as an add-on to standard addiction treatment, as well as when provided with minimal clinical monitoring (i.e., virtual stand-alone). These effects have also been relatively durable after treatment termination, consistent with findings of traditional CBT. It is important to note that the evaluation of individuals’ cognitive and behavioral coping skills prior and following treatment has indicated the acquisition/improvement of these skills may be a mechanism of behavior change for those who engage with CBT4CBT. Thus, computerized delivery may be a strategy for enhancing individuals’ learning of cognitive and behavioral skills for successfully avoiding substance use. Future work should aim to identify the optimal type of setting, clinician role, and patient characteristics for targeted dissemination and implementation.
Keywords: cognitive-behavioral therapy, substance-use disorders, CBT4CBT, mechanisms of behavior change
Introduction
Cognitive-behavioral therapy (CBT) is one of the most studied behavioral interventions for treating substance use disorders (SUD), and is widely acknowledged as an evidence-based treatment (U.S. Department of Health & Human Services, 2016). Multiple meta-analyses have concluded CBT is an effective treatment for alcohol and drug use, with effect sizes comparable to those of interventions for other psychiatric disorders (Carroll & Onken, 2005; Dutra et al., 2008; Irvin, Bowers, Dunn, & Wong, 1999; Magill & Ray, 2009). It has been shown to be highly compatible with other empirically supported treatments for SUD, such as motivational interviewing and contingency management, and is commonly used as a behavioral therapy platform for pharmacotherapy trials (Carroll & Kiluk, 2017; Carroll, Rounsaville, & Kosten, 2004). However, despite CBT’s strong support from efficacy trials, broad dissemination and implementation in the clinical community has proven challenging. Most private and publicly funded addiction treatment centers fail to provide the level of training, monitoring, and ongoing supervision of clinicians’ implementation of CBT in order to ensure the level of fidelity and skill in treatment delivery that is required in the clinical trials generating the evidence of efficacy (McLellan, Carise, & Kleber, 2003; Olmstead, Abraham, Martino, & Roman, 2012; Rakovshik & McManus, 2010; Sholomskas et al., 2005). This results in a version of CBT delivered in clinical practice that bears little resemblance to the closely monitored versions in clinical trials, ultimately limiting the effectiveness for the broad population of individuals seeking treatment (Carroll & Kiluk, 2017).
In addition, to better translate CBT’s effects from research to practice, there is a need to identify the mechanisms by which individuals reduce or abstain from alcohol/drugs (i.e., mechanisms of behavior change) and the active ingredients of the treatment responsible for that change (Kazdin, 2011; Longabaugh, Magill, Morgenstern, & Huebner, 2013). CBT for SUD is based on social learning theory and the underlying principle that alcohol/drug use is a learned behavior (Abrams & Niaura, 1987; Carroll, 1998; Kadden et al., 1992). Guided by the learning principles of modeling, operant, and classical conditioning, individuals with substance use disorders develop a pattern of alcohol/drug use that produces deficiencies in affective, behavioral, and cognitive coping skills to deal with distressing and negative emotions. As such, one of the primary elements of CBT for SUD is cognitive and behavioral skills training to help individuals exert greater control over learned behavioral patterns, reduce impulsive responding to seek immediate reward in response to alcohol/drug cues via control of craving strategies, improve decision-making and problem-solving skills, and recognize, challenge, and exert control over cognitions associated with alcohol/drug use (Sofuoglu, DeVito, Waters, & Carroll, 2013). However, despite the emphasis on coping skills training in CBT, the evidence supporting improvement in coping skills as a mechanism of CBT for SUD has been mixed (Litt, Kadden, Cooney, & Kabela, 2003; Longabaugh et al., 2005; Longabaugh & Morgenstern, 1999; Magill, Kiluk, McCrady, Tonigan, & Longabaugh, 2015; Roos, Maisto, & Witkiewitz, 2017).
A primary reason for the mixed evidence regarding mechanism may relate to the manner in which traditional CBT is delivered—through a clinician. Variability in fidelity to the intervention, dose and quality of delivery, as well as clinician/therapist factors may directly affect the active treatment ingredients hypothesized to be responsible for contributing to behavior change (Carroll et al., 2000b; Miller & Rollnick, 2014; Perepletchikova, Treat, & Kazdin, 2007). Clinicians delivering standardized treatment in clinical trials regularly show substantial differences in the outcomes of clients they treat; multilevel models applied to clinical trial data have shown that 5–10% of the total variability in outcomes is attributable to between-therapists differences (Crits-Christoph et al., 1991; Elkin, Falconnier, Martinovich, & Mahoney, 2006; Kim, Wampold, & Bolt, 2006). Furthermore, specific effects are deemed inseparable from “relational” effects (e.g., therapeutic alliance) when treatments are delivered in the context of an interpersonal relationship (Miller & Moyers, 2014), thereby making it difficult to identify CBT’s precise mechanisms.
Benefits of Computer-Delivered Interventions
The emergence of computer-delivered interventions offers tremendous promise with respect to making evidence-based treatments more broadly accessible to those who may benefit from them (Carroll & Rounsaville, 2010; Greist, 2008; Marsch, Carroll, & Kiluk, 2014). Computer-delivered interventions have the potential to reach rural populations and other groups whose access to treatment is limited, as well as those who do not seek treatment because of discrimination or stigma (Marks & Cavanagh, 2009; Postel, de Jong, & de Haan, 2005). Furthermore, they also offer significant advantages of standardization and consistent quality, reduction of cost and clinician time, and potential 24/7 availability (Budman, 2000; Cuijpers, van Straten, & Andersson, 2008; Cunningham, 2008; Gibbons et al., 2009; Olmstead, Ostrow, & Carroll, 2010; Wright et al., 2005). In addition, computer-delivered interventions may also facilitate evaluation of mechanisms via delivery of active treatment ingredients in a more focused and concentrated form than is possible with clinician-delivered treatments. One of the key benefits of computerized delivery of interventions is standardization relative to traditional clinician-delivered treatments with respect to variability in treatment fidelity, quality, and delivery of active and common elements (Carroll & Rounsaville, 2010; Marks & Cavanagh, 2009; Marsch & Dallery, 2012). These characteristics make computer-delivered interventions a promising solution to the dissemination and implementation challenges, as well as the challenges in identifying mechanisms, that have limited CBT’s broad use in clinical practice.
Computer-Based Training for Cognitive-Behavioral Therapy
With a desire to implement CBT more consistently, with a high level of quality, and at lower cost, our research group at Yale University developed a computer-based training version of CBT for substance use disorders, called CBT4CBT (Carroll et al., 2008). The CBT4CBT program consists of seven modules (i.e., core skills) targeting substance-use disorders, the content of which is based closely on the CBT manual published by the National Institute on Drug Abuse (Carroll, 1998). In developing CBT4CBT, the aim was to construct a highly engaging version of CBT that could take advantage of the capacity of computer-based learning to convey key CBT skills via a range of media (e.g., video, graphics, audio instruction, interactive exercises). Video-based examples were incorporated to emphasize learning of targeted behavioral, cognitive, and affective strategies, with emphasis on modeling from examples of individuals utilizing skills in a range of realistic situations. CBT4CBT was conceived as a “skills training machine”; one that seeks to teach a core set of generalizable CBT strategies (functional analysis, coping with craving and strong affect, problem solving, decision making, challenging thoughts, and assertive drug refusal). Interactive exercises are included to reinforce patients’ understanding of targeted skills, as well as practice assignments (i.e., homework) to encourage implementation and practice of skills, and thus enhance durability of treatment effects.
Efficacy as an Adjunct to Standard Treatment
Two independent 8-week trials of CBT4CBT for substance-use disorders have evaluated the efficacy of the program as an adjunct to standard outpatient treatment (Carroll et al., 2008; Carroll et al., 2014). In each trial, participants assigned to CBT4CBT were provided with access to the computerized program at the clinic site, typically engaging with the program on the same day they presented for their standard outpatient treatment. The initial trial included 77 individuals entering outpatient addiction treatment randomized to either standard treatment as usual (TAU, weekly individual and/or group counseling) or standard TAU with access to CBT4CBT for 8 weeks. Nearly 80% of participants were users of both alcohol and drugs in this trial. In terms of outcome, those assigned to the CBT4CBT condition submitted a significantly lower proportion of urines that were positive for any drugs compared to TAU (34% vs. 53%, respectively), and a longer duration of continuous abstinence compared to TAU (22 vs. 15 days), with both differences representing a moderate effect size (Carroll et al., 2008).
The second trial replicated and extended these findings in a sample of 101 cocaine-dependent methadone-maintained individuals, a more homogeneous but highly challenging clinical population (Carroll et al., 2014). In this trial, TAU consisted of daily methadone maintenance and weekly group sessions. Again, those assigned to CBT4CBT were also provided access to the computerized program on a dedicated computer in a private room within the clinic. Results indicated those assigned to CBT4CBT plus TAU submitted more drug-free urine specimens, and were more likely to attain 3 or more weeks of continuous abstinence from cocaine, than TAU alone (Carroll et al., 2014). Random effect regression analyses of drug use across time indicated a significant enduring benefit of CBT4CBT in both trials, such that those assigned to CBT4CBT plus TAU tended to decrease their substance use over the 6-month follow-up period compared to TAU alone (Carroll et al., 2009; Carroll et al., 2014). Thus, one of the distinguishing features of traditional CBT, its relative durability of effects (i.e., "sleeper effect"; Carroll et al., 2000a, b; Carroll et al., 1994; Rawson et al., 2002), appears to be retained in its translation to computer-assisted format.
Adapted for Other Populations
In addition to a version for general substance use disorders, our team at Yale University has also developed a version adapted specifically to target alcohol use (Kiluk et al., 2016). The CBT4CBT for alcohol-use disorders (AUD) program retained the structure, features, and basic core CBT skills of the original version, but with additional alcohol-specific content and skill-based examples drawn from the CBT manual published by the National Institute on Alcohol Abuse and Alcoholism (Kadden et al., 1992). Results from an initial pilot study conducted at an outpatient addiction treatment facility indicated those assigned to CBT4CBT for AUD plus TAU had a greater increase in their rate of alcohol abstinence, and greater decrease in heavy drinking days during the 8-week treatment period than those assigned to TAU only (Kiluk et al., 2016). We also found those assigned to CBT4CBT plus TAU attended more treatment sessions and were more likely to complete the treatment protocol compared to TAU.
A culturally adapted version of CBT4CBT for Spanish-speaking populations with SUD has also been developed, which integrated Latino/a cultural values into to content of the program. This is a population that experiences significant health disparities, with elevated rates of substance use and related problems, yet limited access to behavioral health treatments (Alegria, Alvarez, & Falgas-Bague, 2017; Guerrero, Marsh, Khachikian, Amaro, & Vega, 2013). Results from a randomized trial with 92 primary Spanish-speaking adults with current substance-use disorder conducted at outpatient facilities providing substance-use and mental-health services to Spanish-speaking clients, indicated those assigned to CBT4CBT-Spanish plus TAU demonstrated a greater reduction in the frequency of substance use during the 8-week trial compared to TAU only, with effects maintained through a 6-month follow-up (Paris et al., 2018).
Efficacy as a Virtual Stand-Alone Treatment
Two independent randomized trials that evaluated CBT4CBT as a potential “stand-alone” treatment for SUD have been conducted. In each of these trials, participants assigned to the stand-alone CBT4CBT condition were provided with access to the CBT4CBT program at the clinic site and asked to complete one module per week as their principal form of treatment, in conjunction with brief (10-minute) weekly clinical monitoring provided in-person by a doctoral-level clinician. The clinical monitoring sessions were intended as a means of evaluating clients’ functional status and safety, address clients’ questions or concerns, and support their engagement with the CBT4CBT program. This treatment condition was first incorporated in the trial described above evaluating CBT4CBT for AUD, which included a TAU condition, as well as a CBT4CBT plus TAU condition (Kiluk et al., 2016). Results from that 8-week trial indicated rates of alcohol abstinence decreased across all treatment conditions, with no significant difference in alcohol abstinence between those assigned to CBT4CBT plus monitoring (i.e., “stand-alone”) compared to TAU only. In addition, those assigned to CBT4CBT plus monitoring had greater rates of treatment retention and incurred fewer costs associated with AUD treatment compared to TAU only (Kiluk et al., 2016).
The most recently completed trial that included CBT4CBT as a stand-alone treatment was conducted with 137 substance-dependent individuals seeking treatment at an outpatient addiction treatment facility (Kiluk et al., 2018). Treatment conditions in this 12-week trial included standard TAU, CBT4CBT plus monitoring, as well as a therapist-delivered CBT condition. This was one of the first trials to include both a computerized and therapist-delivered version of CBT in a clinical sample. Results indicated those assigned either CBT4CBT plus monitoring or therapist-delivered CBT demonstrated a greater reduction in the frequency of substance use than those assigned to TAU only during the 12-week treatment period. Although the study was not powered as a direct test of computer-delivered versus therapist-delivered CBT, those assigned to CBT4CBT consistently achieved the best outcomes in terms of treatment retention, engagement, and substance use (Kiluk et al., 2018).
Mechanisms of Computerized CBT
Acquisition of Coping Skills
All completed trials of CBT4CBT have included repeated assessment of putative mechanisms, with an emphasis on the acquisition of coping skills, consistent with CBT theory. The primary assessment for measuring coping skills in these trials has been an audio-taped role-play adapted from the Situational Competency Test (Chaney, O'Leary, & Marlatt, 1978), called the Drug Risk Response Test (DRRT; Carroll, Nich, Frankforter, & Bisighini, 1999; Kiluk, Nich, Babuscio, & Carroll, 2010). In this task, individuals are presented with a series of hypothetical situations that are deemed high risk for drug and/or alcohol use. They are instructed to image themselves in each situation and verbally state how they would respond as if the situation were occurring at that moment. The responses are recorded and later scored by independent evaluators using a Likert-based scoring system to rate the individuals’ response along a number of variables, including the quality of the coping skill (rated from 1 to 7: “poor response, would definitely use drugs or alcohol” to “excellent response, no chance of using drugs or alcohol”). Results from the initial trial of CBT4CBT (Carroll et al., 2008) indicated those assigned to CBT4CBT plus TAU showed a greater increase in the quality of their coping skills during the course of treatment, with continued increase during the 6-month follow-up period, compared to TAU only (Kiluk et al., 2010). It is important to note that improvement in the quality of skills was a statistical mediator of posttreatment drug use, which was the first successful demonstration that the acquisition of coping skills was a mediator of substance-use outcomes of CBT (Kiluk et al., 2010; Longabaugh, 2010). Although this mediation finding was not fully replicated in the second CBT4CBT trial that included methadone-maintained cocaine-dependent individuals (Carroll et al., 2014), those in the trial with lower quality skills at baseline did show greater improvement when assigned to CBT4CBT (Kiluk et al., 2017). In the CBT4CBT for AUD trial (Kiluk et al., 2016), individuals in all three treatment conditions (TAU, CBT4CBT plus TAU, CBT4CBT plus monitoring) improved the quality of their coping skills during the course of the 8-week treatment, without differential change according to treatment assignment. However, the quality of coping skills rated at the end of treatment were correlated with alcohol abstinence for those assigned to one of the CBT4CBT conditions (CBT4CBT plus TAU: r = .51, p < .05; CBT4CBT plus monitoring: r = .44, p = .05), but not for those assigned to TAU (r = .07, p = ns; unpublished data). This suggests that the quality of skills acquired from CBT4CBT may be an important contributor toward alcohol abstinence.
Knowledge of CBT Concepts
Teaching of concepts and skills plays a prominent role in CBT interventions for SUD. Therapists introduce and review new concepts and strategies for successfully avoiding substance use, which includes how to understand behavioral patterns (i.e., functional analysis), recognize triggers and cope with cravings, challenge automatic/negative thoughts, refuse offers of drugs/alcohol, and develop strategies for decision making and problem solving. Although questionnaires have been used to assess CBT knowledge gained by therapists following workshop or other training methods (Scott, Klech, Lewis, & Simons, 2016; Sholomskas et al., 2005; Weingardt, Cucciare, Bellotti, & Lai, 2009), there has been little evaluation of knowledge gained by patients during a course of CBT treatment. This is surprising, given the expectation that patients are learning new skills in CBT. To examine the potential contribution of learning CBT concepts toward behavior change, two of the most recent CBT4CBT trials have included a 40-item true/false test to assess basic knowledge of cognitive and behavioral concepts (e.g., “everyone’s triggers are the same,” “you cannot change the way your brain thinks about things”) at baseline and end-of-treatment. In the CBT4CBT for AUD trial (Kiluk et al., 2016), those assigned to one of the CBT4CBT conditions showed a greater increase in scores on the true/false test compared to TAU [F(2,36.15) = 3.83, p < .05] (unpublished data). Percent correct scores for those assigned to CBT4CBT plus TAU improved from 71% correct at baseline to 83% correct at end of treatment; scores for those assigned to CBT4CBT plus monitoring improved from 78% to 83% correct; scores for those assigned to TAU were relatively unchanged from 77% correct to 76% correct.
From the CBT4CBT trial that included both a therapist and computer-delivered CBT, participants as a whole increased their scores from baseline to end-of-treatment [F(1,49) = 8.04, p < .01), with the largest gain for those assigned to CBT4CBT plus monitoring (from 74% to 81% correct; Kiluk et al., 2018). It is interesting that scores for those assigned to therapist-delivered CBT remained relatively unchanged over time, from 64% to 66% correct. Although the sample size for those assigned to therapist-CBT who completed both the baseline and end-of-treatment true/false quiz was comparatively small (n = 11), these results suggest the potential benefits of teaching cognitive and behavioral concepts through a computer-delivered program. An additional evaluation of this true/false quiz, particularly with respect to association with outcomes is ongoing.
Therapeutic Alliance
The quality of the therapeutic relationship (i.e., “therapeutic/working alliance”) is considered an important factor contributing to patient engagement and outcomes in traditional psychotherapies, such as CBT (Horvath, Del Re, Flückiger, & Symonds, 2011; Lambert & Barley, 2001; Martin, Garske, & Davis, 2000). However, relatively little is known about whether the concept of an alliance is relevant when an intervention is delivered through a computer rather than through a therapist, and whether it influences outcome in a manner similar to a patient–therapist alliance. To examine whether patients might form an alliance with the CBT4CBT program and explore its impact on treatment engagement and outcomes, an adapted version of a widely used instrument for measuring the patient–therapist alliance, the Working Alliance Inventory (WAI; Horvath & Greenberg, 1989), was developed to measure the patient–program alliance and included in a CBT4CBT trial with methadone-maintained cocaine-dependent individuals (Carroll et al., 2014). This adapted version, the Working Alliance Inventory for Technology-Based Interventions (WAI-Tech; Kiluk, Serafini, Frankforter, Nich, & Carroll, 2014), instructed participants in the trial to rate their level of alliance with the CBT4CBT program only, not the computer itself or the research team, along the same three dimensions as the WAI—task, bond, and goal. For example, items on the WAI-Tech read, “My interactions with the CBT4CBT program are important to me”; “I agree with the CBT4CBT program about the things I will need to do to help improve my situation”; and “It seems as if the CBT4CBT program and I understand each other.” Response options are on a 7-point Likert-type scale from 1 (“never”) to 7 (“always”). The same items on the standard WAI read, “My interactions with my therapist are important to me”; “I agree with my therapist about the things I will need to do to help improve my situation”; and “It seems as if my therapist and I understand each other.” Because CBT4CBT in this trial was provided as an add-on to TAU, all participants also rated the level of alliance with their substance-abuse counselor (i.e., therapist) at the treatment facility using the standard WAI.
Overall, participants rated a relatively strong alliance with the CBT4CBT program (mean WAI-Tech score for Total scale = 5.5 out of 7 possible), with scores remaining stable over time and not significantly different than scores on the WAI measuring alliance with their therapist (Kiluk et al., 2014). It is interesting that results of correlations between scores on the WAI-Tech and treatment outcomes, such as the percentage of days cocaine abstinent, and percentage of cocaine-negative urine samples, revealed few significant correlations, whereas scores on the WAI for those not assigned to CBT4CBT were significantly correlated with treatment outcomes. Thus, although the level of the patient–program alliance was similar in strength to the patient–therapist alliance, the patient–program alliance did not have the same impact on outcomes as the patient–therapist alliance. This suggests that computer-based delivery of CBT seemingly removes the contribution of the therapeutic alliance, which may enhance the ability to detect the active treatment ingredients of CBT that contribute to behavior change. More work in this area is needed, because these results appeared in a trial wherein CBT4CBT was provided as an add-on to TAU. Evaluation of the WAI-Tech in more recent trials that included a stand-alone CBT4CBT condition is ongoing.
Summary and Discussion
Results from multiple well-controlled RCTs indicate CBT4CBT is efficacious at reducing rates of substance use when provided as an add-on to standard outpatient addiction treatment (Carroll et al., 2008; Carroll et al., 2014; Kiluk et al., 2016; Paris et al., 2018), as well as when provided as a virtual “stand-alone” with minimal clinical monitoring (Kiluk et al., 2016; Kiluk et al., 2018). Furthermore, evaluation of its mechanisms has revealed that individuals appear to increase the quality of their coping skills acquired during treatment, and this in part contributes to their abstinence from drugs and alcohol. There is also some indication that individuals gain greater knowledge of cognitive and behavioral concepts from CBT4CBT than from standard addiction treatment, or even therapist-delivered CBT, which may play a role in its efficacy. Lastly, it appears individuals do form a therapeutic relationship with the CBT4CBT program that is comparable to the relationship formed with a therapist, however this relationship may not have the same function in treatment as in traditional psychotherapy, which could have benefits toward identifying unique mechanisms of behavior change from CBT.
Overall, these results, and those from other computer-based CBT interventions for substance-use disorders (e.g., Budney et al., 2015; Campbell et al., 2014; Kay-Lambkin, Baker, Lewin, & Carr, 2009), hold great promise for addressing the dissemination and implementation challenges of delivering CBT in clinical practice. From a public health perspective, these programs can broaden access to an evidence-based treatment for the population of individuals with substance-use problems who do not receive care due to limited availability, costs, stigma, concerns about confidentiality, or other reasons (Carroll & Kiluk, 2017). From a scientific perspective, these interventions offer the opportunity to better identify and isolate the essential treatment components that contribute to behavior change, thereby advancing the development of highly concentrated interventions that might one day be tailored according to patient profiles. However, there are several questions regarding the target population and implementation options, as well as barriers such as clinician attitudes and the rapidly changing technological landscape, that may complicate the realization of these benefits in the future.
Despite the promise of CBT4CBT, there is still limited understanding regarding how exactly it works and for whom it might work best. Just as with other evidence-based interventions for substance-use disorders (and other psychiatric conditions), not all patients respond to CBT4CBT, such as by demonstrating reductions in frequency/quantity of substance use or achieving sustained abstinence. Prior work to identify patient-level characteristics associated with greater or lesser benefits of CBT4CBT has included characteristics of cognitive functioning, such as general intelligence (Kiluk, Nich, & Carroll, 2011a) and risk-taking (Carroll et al., 2011), emotional characteristics, such as alexithymia (Morie, Nich, Hunkele, Potenza, & Carroll, 2015), as well as genetic characteristics (Carroll et al., 2015). The identification of robust predictors of treatment response (or nonresponse) that might inform guidelines for applications of CBT4CBT is ongoing. Current efforts seek to address how the components of the intervention might change, or be impacted by, various patient characteristics, including the core features of addiction, such as executive functioning, negative emotionality, and incentive salience, outlined by the Addictions Neuroclinical Assessment (Kwako, Momenan, Litten, Koob, & Goldman, 2016). Answers to these questions may be crucial for developing a more effective and precise behavioral intervention and will likely have implications for broad dissemination/implementation strategies as well. For instance, such information could inform decisions regarding whether CBT4CBT (or which components) would be an appropriate treatment option for an individual with a given profile of demographic and clinical characteristics, as well as the setting and types of adjunctive treatment/interventions necessary to achieve and maintain positive outcomes.
There are also several barriers that may influence the potential impact of computerized or technology-based interventions, such as CBT4CBT. One is the limited uptake of self-guided interventions provided through the web or mobile applications, in which low participation and high rates of attrition are common (Christensen, Griffiths, & Farrer, 2009; Kelders, Kok, Ossebaard, & Van Gemert-Pijnen, 2012; Kiluk et al., 2011b; Yeager & Benight, 2018). Merely making an evidence-based computerized intervention widely available for free on the internet does not necessarily translate to successful outcomes for individuals in need. Some contact with a clinician, or delivery within a clinical setting, has been shown to enhance patient engagement and outcomes with computerized CBT (e.g., Andersson, Carlbring, Berger, Almlov, & Cuijpers, 2009; Kenwright, Marks, Graham, Franses, & Mataix-Cols, 2005; Richards & Richardson, 2012). Second, attitudes toward computerized interventions play a role in successful implementation; prior studies have indicated reluctance among both patients and clinicians to engage with or refer to a computerized intervention (Brooks, Ryder, Carise, & Kirby, 2010; Buti et al., 2013; Carper, McHugh, & Barlow, 2013; Perle et al., 2013). Within the conduct of our clinical trials of CBT4CBT, clinicians have expressed fears regarding “being replaced” by a computer. Such attitudes, although misguided, could serve as a barrier toward the implementation of an evidence based computerized intervention.
Finally, the speed with which technology advances far surpasses the pace of empirical evaluation of an intervention, potentially limiting the utility of the technology-based product once efficacy has been demonstrated. To illustrate this point, the original CBT4CBT program developed and evaluated in our two initial randomized trials (Carroll et al., 2008; Carroll et al., 2014) was provided on a DVD/CD-ROM platform, a virtually obsolete technology in today’s world. The amount of time required for careful development of an intervention, evaluation of efficacy, and systematic examination of mechanisms and moderators within well-controlled randomized trials exceeds the typical shelf-life of the technology-based delivery method. Although the field should not seek to ease the scientific burden by relaxing methodological standards for evaluating these interventions, the development of such interventions would benefit from strong collaborations with experts in technology to consider the latest technological advances in product development.
In sum, there is great promise for technology-based interventions, such as CBT4CBT, to expand access to cognitive-behavioral therapy and reduce the gap between research and clinical practice in the treatment of substance-use disorders. At the same time, such optimism should be balanced with a sense of caution by ensuring the same scientific rigor and responsibility as when evaluating and disseminating a pharmacological or behavioral therapy, with continued pursuit toward understanding how and for whom this works best.
Acknowledgements
This work was supported by the following grants: R01AA024122 from the National Institute on Alcohol Abuse and Alcoholism, and P50DA09241 from the National Institute on Drug Abuse.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- Abrams DB, Niaura RS. Social learning theory. In: Blane HT, Leonard KE, editors. Psychological theories of drinking and alcoholism. New York, NY: Guilford Press; 1987. pp. 131–178. [Google Scholar]
- Alegria M, Alvarez K, Falgas-Bague I. Clinical care across cultures: What helps, what hinders, what to do. JAMA Psychiatry. 2017;74(9):865–866. doi: 10.1001/jamapsychiatry.2017.1994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andersson G, Carlbring P, Berger T, Almlov J, Cuijpers P. What makes internet therapy work? Cognitive Behaviour Therapy. 2009;38(Suppl 1):55–60. doi: 10.1080/16506070902916400. [DOI] [PubMed] [Google Scholar]
- Brooks AC, Ryder D, Carise D, Kirby KC. Feasibility and effectiveness of computer-based therapy in community treatment. Journal of Substance Abuse Treatment. 2010;39(3):227–235. doi: 10.1016/j.jsat.2010.06.003. [DOI] [PubMed] [Google Scholar]
- Budman SH. Behavioral health care dot-com and beyond: Computer-mediated communications in mental health and substance abuse treatment. American Psychologist. 2000;55:1290–1300. [PubMed] [Google Scholar]
- Budney AJ, Stanger C, Tilford JM, Scherer EB, Brown PC, Li Z, et al. Computer-assisted behavioral therapy and contingency management for cannabis use disorder. Psychology of Addictive Behaviors. 2015;29(3):501–511. doi: 10.1037/adb0000078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Buti AL, Eakins D, Fussell H, Kunkel LE, Kudura A, McCarty D. Clinician attitudes, social norms and intentions to use a computer-assisted intervention. Journal of Substance Abuse Treatment. 2013;44(4):433–437. doi: 10.1016/j.jsat.2012.08.220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Campbell AN, Nunes EV, Matthews AG, Stitzer M, Miele GM, Polsky D, et al. Internet-delivered treatment for substance abuse: a multisite randomized controlled trial. American Journal of Psychiatry. 2014;171(6):683–690. doi: 10.1176/appi.ajp.2014.13081055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carper MM, McHugh RK, Barlow DH. The dissemination of computer-based psychological treatment: A preliminary analysis of patient and clinician perceptions. Administration & Policy in Mental Health. 2013;40(2):87–95. doi: 10.1007/s10488-011-0377-5. [DOI] [PubMed] [Google Scholar]
- Carroll KM. A cognitive-behavioral approach: Treating cocaine addiction. Rockville, Maryland: National Institute on Drug Abuse; 1998. [Google Scholar]
- Carroll KM, Ball SA, Martino S, Nich C, Babuscio T, Gordon MA, et al. Computer-assisted cognitive-behavioral therapy for addiction: A randomized clinical trial of "CBT4CBT.". American Journal of Psychiatry. 2008;165(7):881–888. doi: 10.1176/appi.ajp.2008.07111835. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Ball SA, Martino S, Nich C, Babuscio TA, Rounsaville BJ. Enduring effects of a computer-assisted training program for cognitive behavioral therapy: A 6-month follow-up of CBT4CBT. Drug & Alcohol Dependence. 2009;100(1):178–181. doi: 10.1016/j.drugalcdep.2008.09.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Herman A, DeVito EE, Frankforter TL, Potenza MN, Sofuoglu M. Catehol-o-methyltransferase gene Val158met polymorphism as a potential predictor of response to computer-assisted delivery of cognitive-behavioral therapy among cocaine-dependent individuals: Preliminary findings from a randomized controlled trial. American Journal on Addictions. 2015;24(5):443–451. doi: 10.1111/ajad.12238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Kiluk BD. Cognitive behavioral interventions for alcohol and drug use disorders: Through the stage model and back again. Psychology of Addictive Behaviors. 2017;31(8):847–861. doi: 10.1037/adb0000311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Kiluk BD, Nich C, Babuscio TA, Brewer JA, Potenza MN, et al. Cognitive function and treatment response in a randomized clinical trial of computer-based training in cognitive-behavioral therapy. Substance Use & Misuse. 2011;46(1):23–34. doi: 10.3109/10826084.2011.521069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Kiluk BD, Nich C, Gordon MA, Portnoy G, Marino D, Ball SA. Computer-assisted delivery of cognitive-behavioral therapy: Efficacy and durability of CBT4CBT among cocaine-dependent individuals maintained on methadone. American Journal of Psychiatry. 2014;171:436–444. doi: 10.1176/appi.ajp.2013.13070987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Nich C, Ball SA, McCance-Katz EF, Frankforter TF, Rounsaville BJ. One year follow-up of disulfiram and psychotherapy for cocaine-alcohol abusers: Sustained effects of treatment. Addiction. 2000;95:1335–1349. doi: 10.1046/j.1360-0443.2000.95913355.x. [DOI] [PubMed] [Google Scholar]
- Carroll KM, Nich C, Frankforter TL, Bisighini RM. Do patients change in the way we intend? Treatment-specific skill acquisition in cocaine-dependent patients using the Cocaine Risk Response Test. Psychological Assessment. 1999;11:77–85. [Google Scholar]
- Carroll KM, Nich C, Sifry RL, Nuro KF, Frankforter TL, Ball SA, et al. A general system for evaluating therapist adherence and competence in psychotherapy research in the addictions. Drug & Alcohol Dependence. 2000;57(3):225–238. doi: 10.1016/s0376-8716(99)00049-6. [DOI] [PubMed] [Google Scholar]
- Carroll KM, Onken LS. Behavioral therapies for drug abuse. American Journal of Psychiatry. 2005;162:1452–1460. doi: 10.1176/appi.ajp.162.8.1452. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Rounsaville BJ. Computer-assisted therapy in psychiatry: Be brave—it’s a new world. Current Psychiatry Reports. 2010;12(5):426–432. doi: 10.1007/s11920-010-0146-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Rounsaville BJ, Kosten TR. Choosing a behavioral therapy platform for pharmacotherapy of substance users. Drug & Alcohol Dependence. 2004;75:123–134. doi: 10.1016/j.drugalcdep.2004.02.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carroll KM, Rounsaville BJ, Nich C, Gordon LT, Wirtz PW, Gawin F. One-year follow-up of psychotherapy and pharmacotherapy for cocaine dependence. Delayed emergence of psychotherapy effects. Archives of General Psychiatry. 1994;51(12):989–997. doi: 10.1001/archpsyc.1994.03950120061010. [DOI] [PubMed] [Google Scholar]
- Chaney EF, O'Leary MR, Marlatt GA. Skill training with problem drinkers. Journal of Consulting & Clinical Psychology. 1978;46:1092–1104. doi: 10.1037//0022-006x.46.5.1092. [DOI] [PubMed] [Google Scholar]
- Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. Journal of Medical Internet Research. 2009;11(2):e13. doi: 10.2196/jmir.1194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crits-Christoph P, Baranackie K, Kurcias J, Beck AT, Carroll KM, Perry K, et al. Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research. 1991;1:81–91. [Google Scholar]
- Cuijpers P, van Straten A, Andersson G. Internet-administered cognitive behavior therapy for health problems: A systematic review. Journal of Behavioral Medicine. 2008;31:169–177. doi: 10.1007/s10865-007-9144-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cunningham JA. Access and interest: Two important issues in considering the feasibility of web-assisted tobacco interventions. Journal of Medical Internet Research. 2008;10(5):e37. doi: 10.2196/jmir.1000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dutra L, Stathopoulou G, Basden SL, Leyro TM, Powers MB, Otto MW. A meta-analytic review of psychosocial interventions for substance use disorders. American Journal of Psychiatry. 2008;165(2):179–187. doi: 10.1176/appi.ajp.2007.06111851. [DOI] [PubMed] [Google Scholar]
- Elkin I, Falconnier L, Martinovich Z, Mahoney C. Therapist effects in the National Institute of Mental Health Treatment of Depression Collaborative Research Program. Psychotherapy Research. 2006;16(2):144–160. [Google Scholar]
- Gibbons, M. C., Wilson, R. F., Samal, L., Lehmann, C. U., Dickersin, K., Lehmann H.P. . . . Bass, E.B. (2009). Impact of consumer health informatics applications. Evidence Report/Technology Assessment No. 188. AHRQ Publication No. 09(10)-E019. Rockville, MD: Agency for Healthcare Research and Quality. [PMC free article] [PubMed]
- Greist JH. A promising debut for computerized therapies. American Journal of Psychiatry. 2008;165(7):793–795. doi: 10.1176/appi.ajp.2008.08040528. [DOI] [PubMed] [Google Scholar]
- Guerrero EG, Marsh JC, Khachikian T, Amaro H, Vega WA. Disparities in Latino substance use, service use, and treatment: Implications for culturally and evidence-based interventions under health care reform. Drug & Alcohol Dependence. 2013;133(3):805–813. doi: 10.1016/j.drugalcdep.2013.07.027. [DOI] [PubMed] [Google Scholar]
- Horvath AO, Del Re AC, Flückiger C, Symonds D. Alliance in individual psychotherapy. Psychotherapy. 2011;48(1):9–16. doi: 10.1037/a0022186. [DOI] [PubMed] [Google Scholar]
- Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology. 1989;36(2):223–233. [Google Scholar]
- Irvin JE, Bowers CA, Dunn ME, Wong MC. Efficacy of relapse prevention: A meta-analytic review. Journal of Consulting & Clinical Psychology. 1999;67:563–570. doi: 10.1037//0022-006x.67.4.563. [DOI] [PubMed] [Google Scholar]
- Kadden R, Carroll KM, Donovan D, Cooney JL, Monti P, Abrams D, et al. Cognitive-behavioral coping skills therapy manual: A clinical research guide for therapists treating individuals with alcohol abuse and dependence. Rockville, MD: National Institute on Alcohol Abuse & Alcoholism; 1992. [Google Scholar]
- Kay-Lambkin FJ, Baker AL, Lewin TJ, Carr VJ. Computer based psychological treatment for comorbid depression and problematic alcohol and/or cannabis use: A randomized controlled trial of clinical efficacy. Addiction. 2009;104:378–388. doi: 10.1111/j.1360-0443.2008.02444.x. [DOI] [PubMed] [Google Scholar]
- Kazdin AE. Evidence-based treatment research: Advances, limitations, and next steps. American Psychologist. 2011;66(8):685–698. doi: 10.1037/a0024975. [DOI] [PubMed] [Google Scholar]
- Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JE. Persuasive system design does matter: A systematic review of adherence to web-based interventions. Journal of Medical Internet Research. 2012;14(6):e152. doi: 10.2196/jmir.2104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kenwright M, Marks I, Graham C, Franses A, Mataix-Cols D. Brief scheduled phone support from a clinician to enhance computer-aided sell-help for obsessive-compulsive disorder: Randomized controlled trial. Journal of Clinical Psychology. 2005;61(12):1499–1508. doi: 10.1002/jclp.20204. [DOI] [PubMed] [Google Scholar]
- Kiluk BD, DeVito EE, Buck MB, Hunkele K, Nich C, Carroll KM. Effect of computerized cognitive behavioral therapy on acquisition of coping skills among cocaine-dependent individuals enrolled in methadone maintenance. Journal of Substance Abuse Treatment. 2017;82:87–92. doi: 10.1016/j.jsat.2017.09.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiluk BD, Devore KA, Buck MB, Nich C, Frankforter TL, LaPaglia DM, et al. Randomized trial of computerized cognitive behavioral therapy for alcohol use disorders: Efficacy as a virtual stand-alone and treatment add-on compared with standard outpatient treatment. Alcoholism: Clinical & Experimental Research. 2016;40(9):1991–2000. doi: 10.1111/acer.13162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiluk BD, Nich C, Babuscio T, Carroll KM. Quantity vs. quality: Acquisition of coping skills following computerized cognitive behavioral therapy for substance use disorders. Addiction. 2010;105:2120–2127. doi: 10.1111/j.1360-0443.2010.03076.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiluk BD, Nich C, Buck MB, Devore KA, Frankforter TL, LaPaglia DM, et al. Randomized clinical trial of computerized and clinician-delivered cbt in comparison with standard outpatient treatment for substance use disorders: Primary within-treatment and follow-up outcomes. American Journal of Psychiatry. 2018;175(9):853–863. doi: 10.1176/appi.ajp.2018.17090978. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiluk BD, Nich C, Carroll KM. Relationship of cognitive function and the acquisition of coping skills in computer assisted treatment for substance use disorders. Drug & Alcohol Dependence. 2011;114:169–176. doi: 10.1016/j.drugalcdep.2010.09.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiluk BD, Serafini K, Frankforter T, Nich C, Carroll KM. Only connect: The working alliance in computer-based cognitive behavioral therapy. Behaviour Research & Therapy. 2014;63:139–146. doi: 10.1016/j.brat.2014.10.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiluk BD, Sugarman D, Nich C, Gibbons CJ, Martino S, Rounsaville BJ, Carroll KM. A methodological analysis of randomized clinical trials of computer-assisted therapies for psychiatric disorders: Towards improved standards for an emerging field. American Journal of Psychiatry. 2011;168:790–799. doi: 10.1176/appi.ajp.2011.10101443. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim D-M, Wampold BE, Bolt DM. Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research. 2006;16(2):161–172. [Google Scholar]
- Kwako LE, Momenan R, Litten RZ, Koob GF, Goldman D. Addictions neuroclinical assessment: A neuroscience-based framework for addictive disorders. Biological Psychiatry. 2016;80(3):179–189. doi: 10.1016/j.biopsych.2015.10.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lambert MJ, Barley DE. Research summary on the therapeutic relationship and psychotherapy outcome. Psychotherapy: Theory, Research, Practice, Training. 2001;38(4):357–361. [Google Scholar]
- Litt MD, Kadden RM, Cooney NL, Kabela E. Coping skills and treatment outcomes in cognitive behavioral and interactional group therapy for alcoholism. Journal of Consulting & Clinical Psychology. 2003;71:118–128. doi: 10.1037//0022-006x.71.1.118. [DOI] [PubMed] [Google Scholar]
- Longabaugh R. Commentary on Kiluk et al. (2010): The emperor has some new clothes—Coping is a mediator of cognitive-behavioral therapy's effectiveness. Addiction. 2010;105(12):2128–2129. doi: 10.1111/j.1360-0443.2010.03131.x. [DOI] [PubMed] [Google Scholar]
- Longabaugh R, Donovan DM, Karno MP, McCrady BS, Morgenstern J, Tonigan JS. Active ingredients: How and why evidence-based alcohol behavioral treatment interventions work. Alcoholism: Clinical & Experimental Research. 2005;29:235–247. doi: 10.1097/01.alc.0000153541.78005.1f. [DOI] [PubMed] [Google Scholar]
- Longabaugh R, Magill M, Morgenstern J, Huebner R. Mechanisms of behavior change in treatment for alcohol and other drug use disorders. In: McCrady BS, Epstein EE, editors. Addictions: A comprehensive guidebook. 2. New York, NY: Oxford University Press; 2013. pp. 572–596. [Google Scholar]
- Longabaugh R, Morgenstern J. Cognitive-behavioral coping-skills therapy for alcohol dependence: Current status and future directions. Alcohol Research & Health. 1999;23(2):78–85. [PMC free article] [PubMed] [Google Scholar]
- Magill M, Kiluk BD, McCrady BS, Tonigan JS, Longabaugh R. Active ingredients of treatment and client mechanisms of change in behavioral treatments for alcohol use disorders: Progress 10 years later. Alcoholism: Clinical & Experimental Research. 2015;39(10):1852–1862. doi: 10.1111/acer.12848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Magill M, Ray LA. Cognitive-behavioral treatment with adult alcohol and illicit drug users: A meta-analysis of randomized controlled trials. Journal of Studies on Alcohol & Drugs. 2009;70(4):516–527. doi: 10.15288/jsad.2009.70.516. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marks I, Cavanagh K. Computer-aided psychological treatments: Evolving issues. Annual Review of Clinical Psychology. 2009;5:121–141. doi: 10.1146/annurev.clinpsy.032408.153538. [DOI] [PubMed] [Google Scholar]
- Marsch LA, Carroll KM, Kiluk BD. Technology based interventions for the treatment and recovery management of substance use disorders: A JSAT special issue. Journal of Substance Abuse Treatment. 2014;46(1):1–4. doi: 10.1016/j.jsat.2013.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marsch LA, Dallery J. Advances in the psychosocial treatment of addiction: The role of technology in the delivery of evidence-based psychosocial treatment. Psychiatric Clinics of North America. 2012;35(2):481–493. doi: 10.1016/j.psc.2012.03.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin DJ, Garske JP, Davis MK. Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review. Journal of Consulting & Clinical Psychology. 2000;68:438–450. [PubMed] [Google Scholar]
- McLellan AT, Carise D, Kleber HD. Can the national addiction treatment infrastructure support the public's demand for quality care? Journal of Substance Abuse Treatment. 2003;25:117–121. [PubMed] [Google Scholar]
- Miller, W. R., & Moyers, T. B. (2014). The forest and the trees: Relational and specific factors in addiction treatment. Addiction, 110(3), 401-413. 10.1111/add.12693. [DOI] [PubMed]
- Miller WR, Rollnick S. The effectiveness and ineffectiveness of complex behavioral interventions: Impact of treatment fidelity. Contemporary Clinical Trials. 2014;37(2):234–241. doi: 10.1016/j.cct.2014.01.005. [DOI] [PubMed] [Google Scholar]
- Morie KP, Nich C, Hunkele K, Potenza MN, Carroll KM. Alexithymia level and response to computer-based training in cognitive behavioral therapy among cocaine-dependent methadone maintained individuals. Drug & Alcohol Dependence. 2015;152:157–163. doi: 10.1016/j.drugalcdep.2015.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olmstead TA, Abraham AJ, Martino S, Roman PM. Counselor training in several evidence-based psychosocial addiction treatments in private US substance abuse treatment centers. Drug & Alcohol Dependence. 2012;120(1–3):149–154. doi: 10.1016/j.drugalcdep.2011.07.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olmstead TA, Ostrow CD, Carroll KM. Cost-effectiveness of computer-assisted training in cognitive-behavioral therapy as an adjunct to standard care for addiction. Drug & Alcohol Dependence. 2010;110(3):200–207. doi: 10.1016/j.drugalcdep.2010.02.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Paris M, Silva M, Anez-Nava L, Jaramillo Y, Kiluk BD, Gordon MA, et al. Culturally adapted, web-based cognitive behavioral therapy for spanish-speaking individuals with substance use disorders: A randomized clinical trial. American Journal of Public Health. 2018;108(11):1535–1542. doi: 10.2105/AJPH.2018.304571. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perepletchikova F, Treat TA, Kazdin AE. Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting & Clinical Psychology. 2007;75(6):829–841. doi: 10.1037/0022-006X.75.6.829. [DOI] [PubMed] [Google Scholar]
- Perle JG, Langsam LC, Randel A, Lutchman S, Levine AB, Odland AP, et al. Attitudes toward psychological telehealth: Current and future clinical psychologists' opinions of internet-based interventions. Journal of Clinical Psychology. 2013;69(1):100–113. doi: 10.1002/jclp.21912. [DOI] [PubMed] [Google Scholar]
- Postel MG, de Jong CA, de Haan HA. Does e-therapy for problem drinking reach hidden populations? American Journal of Psychiatry. 2005;162(12):2393. doi: 10.1176/appi.ajp.162.12.2393. [DOI] [PubMed] [Google Scholar]
- Rakovshik SG, McManus F. Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review. 2010;30(5):496–516. doi: 10.1016/j.cpr.2010.03.004. [DOI] [PubMed] [Google Scholar]
- Rawson RA, Huber A, McCann M, Shoptaw S, Farabee D, Reiber C, Ling W. A comparison of contingency management and cognitive-behavioral approaches during methadone maintenance treatment for cocaine dependence. Archives of General Psychiatry. 2002;59(9):817–824. doi: 10.1001/archpsyc.59.9.817. [DOI] [PubMed] [Google Scholar]
- Richards D, Richardson T. Computer-based psychological treatments for depression: A systematic review and meta-analysis. Clinical Psychology Review. 2012;32(4):329–342. doi: 10.1016/j.cpr.2012.02.004. [DOI] [PubMed] [Google Scholar]
- Roos CR, Maisto SA, Witkiewitz K. Coping mediates the effects of cognitive-behavioral therapy for alcohol use disorder among out-patient clients in Project MATCH when dependence severity is high. Addiction. 2017;112(9):1547–1557. doi: 10.1111/add.13841. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Scott K, Klech D, Lewis CC, Simons AD. What did they learn? Effects of a brief cognitive behavioral therapy workshop on community therapists’ knowledge. Community Mental Health Journal. 2016;52(8):998–1003. doi: 10.1007/s10597-015-9876-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sholomskas DE, Syracuse-Siewert G, Rounsaville BJ, Ball SA, Nuro KF, Carroll KM. We don't train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting & Clinical Psychology. 2005;73(1):106–115. doi: 10.1037/0022-006X.73.1.106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sofuoglu M, DeVito EE, Waters AJ, Carroll KM. Cognitive enhancement as a treatment for drug addictions. Neuropharmacology. 2013;64:452–463. doi: 10.1016/j.neuropharm.2012.06.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- U.S. Department of Health & Human Services. (2016). Facing addiction in America: The surgeon general's report on alcohol, drugs, and health. Washington, DC: Health and Human Services. [PubMed]
- Weingardt KR, Cucciare MA, Bellotti C, Lai WP. A randomized trial comparing two models of web-based training in cognitive-behavioral therapy for substance abuse counselors. Journal of Substance Abuse Treatment. 2009;37(3):219–227. doi: 10.1016/j.jsat.2009.01.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wright JH, Wright AS, Albano AM, Basco MR, Goldsmith LJ, Raffield T, Otto MW. Computer-assisted cognitive therapy for depression: maintaining efficacy while reducing therapist time. American Journal of Psychiatry. 2005;162(6):1158–1164. doi: 10.1176/appi.ajp.162.6.1158. [DOI] [PubMed] [Google Scholar]
- Yeager, C. M., & Benight, C. C. (2018). If we build it, will they come? Issues of engagement with digital health interventions for trauma recovery. mHealth, 4: 37. [DOI] [PMC free article] [PubMed]
