Abstract
Background
Depression is twice as common in people with diabetes, and this comorbidity worsens the course of both pathologies. In clinical practice guidelines, screening and treatment of depression in patients with diabetes are highly recommended. However, depression is still both underrecognized and undertreated. To find ways to enhance their reach, psychological treatments have taken advantage of benefits of internet and technological devices as delivery formats, providing interventions that require considerably less (or even no) interaction time with therapists. Web-based treatments hold promise for effective interventions at low cost with positive results.
Objective
The objectives of this review were to describe Web-based interventions for depression in individuals with diabetes and to discuss these studies’ procedures and findings in light of evidence from a wider range of interventions for depression and diabetes.
Methods
A comprehensive literature search was conducted in PsycINFO and MEDLINE electronic databases. Studies were included when they met the following selection criteria: the study was available in a peer-reviewed journal mainly publishing studies written in either English or Spanish; the studied sample comprised individuals with diabetes; the intervention targeted depression symptomatology; the intervention was accessible via the internet; and the intervention was accessible via the internet with little or no clinician support.
Results
Overall, 5 research studies were identified in the review. All studies were randomized controlled trials, and most used a wait list as a control; 4 studies reported treatment dropout, rates of which varied from 13% to 42%. Studies supported the notion that the Web-based format is a suitable psychology service delivery option for diabetic individuals with depression (effect size range for completers 0.7-0.89). Interventions varied in their characteristics but most were clinical-assisted, had a cognitive behavioral therapy approach, used diabetes-specific topics, had a weekly modular display, used homework assignments, and had some adherence management strategy. These characteristics are consistent with the intervention features associated with positive results in the literature.
Conclusions
The analyzed studies’ findings and procedures are discussed in light of evidence drawn from a wider range of reviews on Web-based interventions for depression and diabetes. Consistent with previous research on depression treatment, Web-based interventions for depression among individuals with diabetes have shown positive results. Future research should contribute new evidence as to why these interventions are effective, for whom, and which particular aspects can increase patients’ adherence.
Keywords: Web-based intervention, internet, depression, diabetes, cognitive behavioral therapy
Introduction
Substantial evidence shows that depression among individuals with diabetes is associated with poorer diabetes outcomes [1] and higher levels of diabetes distress (emotional burdens, stresses, and worries associated with diabetes) [2]. When depressed, patients with diabetes show higher frequency of hypoglycemia and higher levels of glycosylated hemoglobin, their risk of developing diabetes-related complications increases [3-5]. They also show poorer adherence to self-care regimens, particularly to medications, diet, and exercise [6-7]. Congruently, diabetes comorbid depression is associated with reduced work productivity [8], reduced quality of life [9], increased medical symptom burden [10], increased functional disability [11], more health care service utilization and costs [12-13], and higher risk of mortality [14-15]. Considering that depression is twice as prevalent among people with diabetes [16], there is no doubt that interventions for depression in individuals with diabetes are crucial for both medical and economic reasons.
Fortunately, there are depression treatments for patients with diabetes [17]. Psychotherapeutic interventions, often combined with a diabetes self-management intervention, have significant effects on depressive symptoms and glycemic control [18-19]. Routine assessment, screening, and treatment of depression in patients with diabetes are recommended in clinical practice guidelines [20]. However, despite these recommendations, depression is both underrecognized and undertreated; in routine care for diabetes, depression remains untreated in 50% of patients [1]. Recently, faced with the need to enhance reach [21], some treatments have resorted to the internet and technological devices as delivery formats. Particularly interesting are interventions requiring considerably less interaction time with the therapist than face-to-face psychotherapy (guided self-help approach) or even no interaction at all (unguided self-help approach). These treatments hold promise for low-cost interventions with positive results [22-23]. They may be particularly beneficial to overcome logistical and financial obstacles burdening both health care providers and patients [24-25]. Other advantages of such interventions are flexible usage not constrained by time and place; a high level of anonymity and privacy; standardized contents, and easy translatability and cultural adaptability [26]. In the general population, effective Web-based interventions and other computerized psychological treatments for depression have been designed and tested in research and slowly but gradually in clinical settings [27]. Moreover, internet-supported therapy for depression with a guided self-help approach has proved to generate the same benefits as face-to-face therapy [28].
In this review, we identified Web-based interventions for depression in individuals with diabetes, addressed those interventions’ efficacy, addressed differences and similarities in interventions’ characteristics and study designs, and discussed studies’ procedures and findings in light of evidence from a wider range of interventions for depression and diabetes. Because psychological intervention studies are very often clinically and methodologically diverse [29], we hope that in the future, our review will be helpful for all researchers and clinicians who are willing to design Web-based interventions for depression in individuals with diabetes.
Methods
Inclusion and Exclusion Criteria
Eligible studies had to be published in English or Spanish in a peer-reviewed journal between 1990 (coinciding with introduction of the World Wide Web in 1991) and 2017.
Participants
Studies had to target adult participants (18 years or older) with a primary diagnosis of diabetes and comorbid depression. Depression was defined according to diagnostic criteria (Diagnostic and Statistical Manual of Psychiatric Disorders) or depressive symptomatology (on a validated self-report or clinician measure).
Web-Based Interventions
The examined Web-based interventions required the following components: program content (ie, psychoeducation and skills training guided by psychological theory); multimedia; provision of Web-based activities; and a guided or unguided self-help approach. Eligible interventions had to target depression symptomatology with the specific intent of producing emotional, behavioral, and cognitive change.
Study Design
Intervention studies with a repeated measures design, including randomized controlled trials (RCTs) and quasi experimental studies, were eligible.
Search Strategy
A literature search was conducted in the PsycINFO and MEDLINE electronic databases with the following keywords: diabetes, depression, Web-based, computer-based, internet- based, online, and psychological intervention.
Data Extraction
The following data were extracted from each study: study characteristics (eg, type of study, sample size, measures); participants’ compliance (eg, dropout percentage); intervention efficacy (eg, between-group effect size in depression and diabetes-related measures); intervention characteristics (eg, delivery mode, psychotherapeutic approach, and research design); sample characteristics (eg, sample size and medical diagnosis); and treatment characteristics (eg, delivery format, therapeutic approach, therapist and peers support, and adherence management). Intervention characteristics sometimes were extracted from the study protocol paper.
Because of the small number of studies and their heterogeneity, data extracted were not statistically combined and reanalyzed. Effect sizes are presented as they were extracted from individual papers’ results sections when the between-groups difference was significant; effect size measures were either Cohen d or Hedges g.
Results
Characteristics of Included Studies
Overall, 5 studies were identified [21,30-33] and all were RCTs. A summary of reviewed articles is provided in Table 1. All studies included standardized measures to assess symptoms of depression and diabetes distress. For depression, studies used the Center for Epidemiological Studies-Depression (CES-D) measure [21,30-32] or the Patient Health Questionnaire-9 (PHQ-9) [33]. Depression inclusion criteria were established in 3 studies [21,32,33]. In Bond et al [30] and Cohn et al’s [31] studies, CES-D was employed but with no established cut-off scores; their treatment groups had a mean baseline CES-D score of 12 (SD 10.4) and 16.9 (SD 11.6), respectively; 3 studies added a telephone-administered interview to confirm whether participants met a major depression episode’s diagnostic criteria [21,32,33]. Newby et al [33] excluded participants with a severe profile (PHQ-9>23).
Table 1.
Lead author (year) | Approach (DMa
specific) |
Depression criteria |
DM type (Age target) |
Participants, n |
Control | Intervention length |
Postassessment |
Bond (2010) [30] | CBTb (yes) | N/Ac | Not reported by authors (older adults) | 62 | Wait list | 6 mo (nonmodular) | 6 mo after baseline |
van Bastelaar (2011) [21] | CBT (yes) | CES-Dd>16 | I and II (adults) | 255 | Wait list | 8 modules (1 per wk) | 1 mo follow-up |
Cohn (2014) [31] | Positive psychology (no) | N/A | II (adults) | 53 | Wait list with emotion reporting | 5 modules (1 per wk) | 1 wk after the final module |
Nobis (2015) [32] | CBT (yes) | CES-D≥23 | I and II (adults) | 260 | Access to unguided Web-based psychoeducation | 6-8 modules (1 per wk) + booster session | 8 wk after randomization |
Newby (2017) [33] | CBT (no) | Patient Health Questionnaire-9>5 | I and II (adults) | 90 | Treatment as usual | 6 modules (10 wk, 5 d minimum between) | 1 wk after module 6 (or wk 10) 3 mo follow-up for intervention group only |
aDM: diabetes mellitus.
bCBT: cognitive behavioral therapy.
cNot applicable.
dCES-D: Center for Epidemiological Studies-Depression.
Diabetes distress was assessed with the Problem Areas in Diabetes Questionnaire (PAID) [21,30,32,33] or the Diabetes Distress Scale (DDS) [31]. All studies added at least one of the following diabetes-related measures: glycosylated hemoglobin [21,33], diabetes self-management [31,32], diabetes empowerment [30], diabetes acceptance [32], and diabetes social support [30].
In addition, 2 studies also assessed the following secondary psychological outcomes [31,33]: anxiety, psychological distress, positive and negative affect, and well-being. Only Nobis et al [32] and Newby et al [33] included process evaluation by expectancy of benefit and intervention satisfaction. All measures were administered online.
Participants’ Compliance
The percentage of enrolled participants who dropped out (treatment dropout) varied among identified studies: 41.6% (52/125) [21]; 34% (14/41) [33]; 24.0% (31/129) [32]; and 13% (4/29) [31]. Bond et al [30] did not report a treatment dropout rate.
Intervention Efficacy
Overall, 4 studies found significant reduction in depression scores in the intervention condition compared with control (effect size range 0.29-0.89 for intended-to-treat analyses and 0.70-1.00 for per protocol analyses). See Table 2 for results obtained from the study. Newby et al [33] found that the within-group effects for the intervention group (g=1.90) persisted at the 3-month follow-up. Cohn et al’s [31] study showed a reduction in depression scores in the intervention condition compared with the control, although it was not significant (P=.05), and found no impact in any other measures.
Table 2.
Lead author (year) and outcome measure | Analysis | Effect size | |
Bond (2010) [30] | |||
Center for Epidemiological Studies-Depression | Not reported | da=0.7 | |
Problem Areas in Diabetes Questionnaire | Not reported | d=0.6 | |
Diabetes Social Support Scale | Not reported | d=1.0 | |
Diabetes Empowerment Scale | Not reported | d=0.7 | |
van Bastelaar (2011) [21] | |||
Center for Epidemiological Studies-Depression | Intended-to-treat | d=0.29 | |
Center for Epidemiological Studies-Depression | Per protocol | d=0.70 | |
Problem Areas in Diabetes Questionnaire | Per protocol | d=0.58 | |
Glycosylated hemoglobin | Intended-to-treat | —b | |
Cohn (2014) [31] | |||
Center for Epidemiological Studies-Depression | Per protocol | — | |
Perceived Stress Scale | Per protocol | — | |
Differential Emotions Scale | Per protocol | — | |
Confidence in Diabetes Self-Care Scale | Per protocol | — | |
Diabetes Distress Scale | Per protocol | — | |
Nobis (2015) [32] | |||
Center for Epidemiological Studies-Depression | Intended-to-treat | d=0.89 | |
Center for Epidemiological Studies-Depression | Per protocol | d=1.00 | |
Hospital Anxiety and Depression Scale-Depression | Intended-to-treat | d=0.82 | |
Problem Areas in Diabetes Questionnaire | Intended-to-treat | d=0.58 | |
Acceptance and Action Diabetes Questionnaire | Intended-to-treat | d=0.22 | |
Diabetes Self-Management Questionnaire | Intended-to-treat | d=0.07 | |
Newby (2017) [33] | |||
Patient Health Questionnaire-9 | Intended-to-treat | gc=0.78 | |
Problem Areas in Diabetes Questionnaire | Intended-to-treat | g=0.80 | |
Kessler Psychological Distress Scale | Intended-to-treat | g=1.06 | |
Generalized Anxiety Disorder 7-item | Intended-to-treat | g=0.72 | |
Glycosylated hemoglobin | Intended-to-treat | — | |
Short form 12-item scale of mental well-being | Intended-to-treat | g=−0.66 | |
Short form 12-item scale of physical well-being | Intended-to-treat | — | |
Patient Health Questionnaire physical symptoms module for somatic symptom severity | Intended-to-treat | — |
aCohen d.
bNo significance.
cHedges g.
Significant reduction in diabetes distress was shown in 4 studies (effect size range 0.58-0.80). Newby et al [33] reported that within-group effects for the intervention group (g=1.18) persisted at the 3-month follow-up. Positive effects were also found in diabetes social support [30] and diabetes acceptance [32]. Newby et al [33] found moderate positive differences for generalized anxiety and mental well-being that persisted at the 3-month follow-up but failed to find differences in physical well-being and somatic symptom severity. No significant differences were found for glycosylated hemoglobin [21,33] or diabetes self-management [32].
Intervention Characteristics
Therapeutic Approach and Delivery Mode
Interventions had a cognitive behavioral therapy (CBT) [21,30,32,33] or a positive psychology [31] psychotherapeutic approach; 3 focused on relevant diabetes-specific topics [21,30,32], whereas the others used generic depression interventions. Interventions aimed to promote different skills. The amount of skills grew proportional to the number of modules presented. The most used topics were psychoeducation, cognitive restructuring, behavioral activation, coping with worries and anxiety, communication and assertiveness, problem solving, and stress management (including breathing and relaxation techniques); 2 interventions addressed relapse prevention [21,34].
Overall, 4 interventions were distributed in modules. The amount of modules ranged from 5 to 8, and they were delivered with a minimum lapse of 5-7 days between sessions. To strengthen participants’ acquired skills, one study had an optional reinforcing module (“Booster session”) 4 weeks after finishing the intervention [32]. The nonmodular intervention comprised free access to a website with different resources for 6 months with weekly Web-based discussion groups [30].
All interventions provided lesson reinforcement activities and progress tracking; 4 used homework assignments to encourage patients to apply the learned skills in daily practice [21,31,32,34] and 2 added mood, thought, behavior, and diabetes self-management reporting [30,31].
Support
From Clinician
The identified interventions had important differences concerning therapist support, ranging from none [31] to highly individualized email or phone contact [32]. Bond et al [30] added a weekly discussion group delivered by a Web-based communication forum using MSN Messenger. See Table 3 for therapist support by intervention. Only one study reported clinician time spent per participant; Newby et al [33] reported that the clinician spent, on average, 27 minutes per participant for email and telephone contact over the course of the intervention.
Table 3.
Lead author (year) | Participant activities | Clinician-assisted, professional |
Clinician-patient communication | Adherence management | |
Synchronous | Asynchronous | ||||
Bond (2010) [30] | Weekly discussion group & DMa self-management diary | Yes (nurse or psychologist or social worker) | Instant messaging, Web-based educational discussion group | Email and bulletin board |
|
van Bastelaar (2011) [21] | Homework | Yes (psychologist) | N/Ab | Semistandardized feedback on homework assignments (CNEc) |
|
Cohn (2014) [31] | Homework & mood or DM self-management diary | No | N/A | N/A |
|
Nobis (2015) [32] | Homework & mood diary | Yes (psychologist) | N/A | Email: personalized feedback on homework assignments |
|
Newby (2017) [33] | Homework | Yes (psychologist or psychiatrist) | Phone call: patient request or deterioration | Feedback on homework assignments (CNE) |
|
aDM: diabetes mellitus.
bNot applicable.
cCNE: channel not specified.
dSMS: short message service.
From Peers
Only Bond et al’s [30] intervention included contact with peers. This contact was both synchronous and asynchronous by instant short message service (SMS) text messaging and email. Interactions were participant-generated and not moderated by any study personnel.
Adherence Management
Two interventions incorporated automated emails or mobile SMS text messaging (integrating mobile phone support) with reminders, motivational statements, and congratulations for finishing a module [32,33]. Three addressed no logging into the website or no homework received by email (mainly standardized) or phone call [21,32,34]. Cohn et al’s [31] intervention used payment as a motivation strategy; they paid US $1 for each daily report completed, US $20 for completing final questionnaires and the phone interview, and US $20 if participants completed the study within 75 days with reports on at least 75% of all days. See Table 3 for adherence management by intervention.
Discussion
Main Results and Comparisons with Previous Work
This review aimed to identify Web-based interventions for depression in individuals with diabetes and to discuss these studies’ procedures and findings in light of evidence drawn from a wider range of interventions for depression and diabetes. Overall, 5 studies met the inclusion criteria.
Studies’ Characteristics
All studies were RCTs, a rigorous method proven to provide critical evidence for psychological interventions’ efficacy [35]. However, most studies used a wait list as control, and literature shows than this control is more likely than many other control conditions to produce strong effect size [36]. Only one study provided an active control intended to match the intervention’s nonspecific factors [32]. Future research should include active controls matched as closely as possible with the intervention under research but excluding its “active ingredient(s)” [37]. Because no-treatment controls are less costly, they can be potentially useful for novel interventions’ first evaluations. When no-treatment controls are implemented, Mohr et al [36] suggest monitoring health and well-being of participants; assessing and monitoring potential threats to internal validity such as expectancies, help-seeking behavior, and other services received; and continuing assessment for patients dropping out of treatment.
Because people with depression are in need of treatment, a long follow-up period can be inappropriate when a wait list is used as a control group. However, for intervention efficacy and cost-effectiveness, assessing whether effects are long lasting is necessary. One option is to conduct within-group analyses, as performed by Newby et al [33].
All studies included standardized measures to assess depression symptoms and diabetes distress. However, there were differences in the inclusion criteria. If depression diagnosis is an inclusion criterion, it may be advisable to use cut-off scores for CES-D and PHQ-9 of ≥23 and ≥13 points, respectively; these have proven to provide an optimal balance between sensitivity and specificity in people with type 2 diabetes [38]. Nonetheless, a diagnostic interview, at least a telephone-administered diagnostic interview, is strongly recommended. This was included in 3 studies [21,32,33]. This option may indeed increase study costs, but it can also improve the precise diagnosis of depression (if diagnosis is an inclusion criterion). An even better scenario consists of a face-to-face diagnostic interview, precluding problems of not seeing the patient. A meta-analysis showed that in both controlled and uncontrolled studies, depression rates are approximately two to 3 times higher in studies that used self-report measures versus face-to-face diagnostic interviews [16]. Using Web-based questionnaires to assess depression symptomatology usually works well, but psychiatric diagnoses cannot be reliably made using self-reports solely. If face-to-face interviews cannot be conducted, a compromise solution could lie in telephone interviews to confirm the diagnosis [39].
For diabetes distress assessment, Schmitt et al’s [40] recent study supported both PAID and DDS as good self-report measures of diabetes distress. They concluded that PAID was significantly more strongly associated with dysfunctional coping styles, quality of life, and depressive symptoms, whether DDS showed significantly stronger associations with diabetes self-care and metabolic outcomes; therefore, its selection should be based on study objectives. A cut-off criterion’s inclusion concerning these measures should be considered, particularly for interventions with diabetes-specific content.
Because of the impact of depression-diabetes comorbidity on diabetes self-management and glycemic control [3,4,5], inclusion of these variables is desirable. Van Bastelaar et al [21] and Newby et al [33] did not find an effect on glycosylated hemoglobin, but in their studies, participants’ diabetes was relatively well controlled, despite comorbid depression and high levels of diabetes distress. Face-to-face treatments for depression have shown mixed results for glycosylated hemoglobin outcomes [41] so that more evidence is needed to clarify this relationship, including its moderators and mediators. Adding recurrent glycemia monitoring can probably foster a broader understanding of the intervention effect and its relation with CBT-targets (cognition, emotion, and behavior). Newer Web platforms include emotion, thoughts and behavior registers, and sometimes graphics [42]. Glycemia data graphics could be easily integrated. This would also function as a resource itself, providing patients feedback about the relationship between depression symptomatology and glycemic control.
Assessment of other psychological outcomes (eg, anxiety) and process evaluation (eg, satisfaction with the intervention) can provide a more comprehensive assessment of the intervention’s effects, identify individuals most likely to benefit, and identify adherence-related dimensions. More recent studies have tended to include these variables [31-33]. Additionally, recruitment strategies should be taken into account (eg, online) because they can lead to selection bias. The use of questionnaires to assess reasons for participating, expectancies, credibility, and patient satisfaction with the intervention are strongly suggested [32].
Participants’ Compliance and Treatment Efficacy
As noted in this review, Web-based interventions often suffer from nonadherence. A systematic review of 83 Web-based interventions on lifestyle, chronic disease, and mental health (with and without therapist support) found that, on average, approximately 50% of participants adhere fully to an intervention [43]. A meta-analysis that compared adherence to Web-based and face-to-face CBT for depression (although not in a single trial) found significant differences in the percentage of treatment completers with 65% and 84%, respectively [44]. Nonetheless, authors of the meta-analysis found that in the Web-based CBT, participants completed, on average, 80% of their treatments; this does not differ significantly from the rates observed in face-to-face CBT groups. They suggest that future studies should include more detailed information on adherence, preferably both the number of completers and average number of sessions completed, and should search for factors that can explain adherence and participants’ reasons for dropping out.
Interventions’ impact on depressive symptoms are consistent with previous research on Web-based depression treatments in the general population with meta-analyses showing an effect size of d=0.4 [27] and d=0.56 [45] that increases to d=0.61 and d=1.35, respectively, when supported by a therapist. This lends support to the notion that Web-based interventions have potential as a psychology service delivery option for individuals with diabetes and depression.
Interventions’ Characteristics
Overall, 4 interventions had a CBT only approach. Face-to-face CBT is the most extensively researched psychotherapeutic treatment for depression [46] and has shown to be effective in depression symptomatology [47] and glycemic control [48] in individuals with diabetes. CBT is also the most commonly used approach in Web-based depression interventions [45,49,50]. Furthermore, Web-based guided self-help CBT is the only approach that has been directly compared with face-to-face CBT with reported effects being similar [28]. However, all interventions are multicomponent with a number of hypothesized mechanisms (eg, behavioral activation and cognitive restructuring); therefore, determining which aspects contribute the most in psychological outcome measures is not possible. The combination of approaches may not be suggested because it makes drawing clear conclusions regarding effective ingredients even more difficult. Future studies must elucidate which skills should be promoted for stronger effect in depression and what mechanisms of change are.
The need of diabetes-specific content should be studied. An aspect that can contribute to understanding of the nondiabetic specific versus diabetic-specific debate is probably related to the presence or absence of diabetes distress. Both syndromes are closely related, but also independent, and they can co-occur or not [51]. Snoek et al [51] advanced the following 3 possible combinations of depression and diabetes among diabetic patients: with distress, but no depression; with depression, but no distress; and no depression or distress. They propose that the first 2 are more are likely to benefit from diabetes-specific depression treatment modalities. However, Newby et al’s [33] nondiabetes-specific intervention showed large effects on depression and diabetes distress, whereas it showed no significant effects on glycemic control. In the past, both face-to-face health care and digital interventions have tended to focus on either depression or diabetes alone, despite their co-occurrence and similar behavioral treatment strategies that may call for a more holistic approach [52]. A review of Web-based interventions for comorbid depression and chronic illness showed that participants valued psychoeducation with illness-specific examples [53]. Perhaps an intervention for depression and diabetes, instead of in individuals with diabetes, may contribute to address health in a more holistic way.
Weekly modules tend to mimic face-to-face therapy sessions’ frequency. Approaches like CBT normally prioritize short-term care; therefore, the average number of sessions for depression face-to-face treatment is approximately 13 [54] with brief forms containing less than 8 sessions. The ideal number of modules remains unclear, mainly because when interventions with different numbers of modules are compared, they differ in other unmeasured key variables such as the modules’ content; thus, whether the impact on depression symptomatology is because of the number of modules alone remains uncertain [54]. On the other hand, evaluating the effect of the patient choosing which modules to complete and proving recommendations to participants on which modules are more suitable for them from the assessment upon registration would be interesting [42].
All interventions provided lesson reinforcement activities or progress tracking. Homework is important for helping patients to apply skills learned during sessions to various and multiple situations that arise in everyday life [55]. In face-to-face CBT for depression, the assignment of homework and homework compliance show significantly better outcomes than therapy consisting only of work during the session [54]. On the other hand, inclusion of regularly self-administered questionnaires or reports may have benefits by allowing both patients and therapists to monitor progress and deterioration of depression.
Support
Consistent with meta-analyses, a Web-based intervention’s effect on depression is greater when the intervention includes therapist assistance or guidance with patients’ compliance being higher [27,45]. Communication between patient and therapist in the identified studies was mainly asynchronous (personalized or semipersonalized), providing feedback on homework and other issues. Synchronous communication in the selected studies was used for adherence management after nonresponse to asynchronous strategies or for urgent cases like deterioration. Interestingly, a meta-analysis on Web-based depression interventions showed that studies providing asynchronous support yielded greater effects than studies providing synchronous support [45] perhaps because of the benefits associated with asynchronous communication such as disinhibition and more time to reflect and compose one’s responses [56]. A study that compared 2 groups allocated to a Web-based CBT for depression with therapist guidance either by telephone calls or email correspondence showed significant and large symptom reductions in both groups with no significant differences between them [57]. There was no between-group difference in client-rated therapeutic alliance or treatment engagement. However, more research is needed to determine how the content, length, and frequency of therapists’ feedback can affect outcomes in guided self-help treatments [58].
Newby et al’s [33] intervention established a clinician’s email or phone call when participants requested contact or had a depression or distress score indicating deterioration of their condition. A review of Web-based programs for depression currently available in English showed that 62% (20/32) had a crisis link defined as email addresses, phone numbers, or hotlines connected to distress centers providing counseling services to at-risk users [49]. Because of the depression’s oscillating course, risk of deterioration or moments of crisis always exist; therefore, detecting them in time and determining courses of action are important.
Only one intervention incorporated peer support [30]. This reflects the small number of Web-based interventions that offer such support. A Web-based intervention for diabetic support showed that online peer support was a successful approach [42], but in interventions for depression, evidence is limited and inconsistent [59]. Future studies should bring new data to this subject.
Adherence Management
Considering that adherence is problematic in Web-based interventions [60,61] for many depressed people [45,62] and for many people with diabetes [63] and that it is associated with treatment effectiveness [64,65], the need exists to develop and evaluate ways to increase intervention adherence. This review and the literature have shown that frequent automated reminders via email or SMS text messaging can positively influence adherence [43]. However, through studies that compare strategies, it remains necessary to determine which adherence management techniques are more effective.
Limitations
Caution is needed when drawing conclusions from efficacy results exposed by this review. In most studies, participants were well educated overall with relatively well controlled diabetes. In 2 studies [30,31], the number of participants was relatively small (25 and 31 in treatment groups), which also affects the generalizability of results. Different measures and cut-off criteria for depressive symptomatology and multicomponent interventions make comparing studies’ results difficult. Finally, as mentioned above, the recruiting strategy could have led to selection bias in some cases.
This review has some limitations. We found only 5 studies that met our criteria; therefore, caution is needed when trying to generalize results. These findings may be affected by publication bias with a tendency for academic journals to publish significant findings. Because we restricted our literature search to articles written in English or Spanish, we might have missed studies eligible for inclusion but published in other languages.
Conclusions
In summary, we are optimistic about Web-based interventions for depression in people with diabetes. Our review and the literature support the idea that with the inclusion of specific features (such as some therapist support), these interventions are effective. They may enhance the therapy’s reach and decrease both patient and health services costs by not only engaging in a less expensive, more accessible treatment but also preventing diabetes complications and depression deterioration. Upcoming research should continue contributing evidence on why these interventions are effective, for whom, and which aspects can increase patient adherence. We hope that, in the future, our review will be helpful for all researchers and clinicians willing to design and use Web-based interventions for depression in individuals with diabetes.
Abbreviations
- CBT
cognitive behavioral therapy
- CES-D
Center for Epidemiological Studies-Depression
- DDS
Diabetes Distress Scale
- PAID
Problem Areas in Diabetes Questionnaire
- PHQ-9
Patient Health Questionnaire-9
- RCT
randomized controlled trial
- SMS
short message service
Footnotes
Conflicts of Interest: None declared.
References
- 1.Egede LE, Ellis C. Diabetes and depression: global perspectives. Diabetes Res Clin Pract. 2010 Mar;87(3):302–12. doi: 10.1016/j.diabres.2010.01.024. [DOI] [PubMed] [Google Scholar]
- 2.Fisher L, Glasgow RE, Mullan JT, Skaff MM, Polonsky WH. Development of a brief diabetes distress screening instrument. Ann Fam Med. 2008;6(3):246–52. doi: 10.1370/afm.842. http://www.annfammed.org/cgi/pmidlookup?view=long&pmid=18474888. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Lustman PJ, Anderson RJ, Freedland KE, de Groot M, Carney RM, Clouse RE. Depression and poor glycemic control: a meta-analytic review of the literature. Diabetes Care. 2000 Jul;23(7):934–42. doi: 10.2337/diacare.23.7.934. http://care.diabetesjournals.org/cgi/pmidlookup?view=long&pmid=10895843. [DOI] [PubMed] [Google Scholar]
- 4.de Groot M, Anderson R, Freedland KE, Clouse RE, Lustman PJ. Association of depression and diabetes complications: a meta-analysis. Psychosom Med. 2001;63(4):619–30. doi: 10.1097/00006842-200107000-00015. [DOI] [PubMed] [Google Scholar]
- 5.Adili F, Larijani B, Haghighatpanah M. Diabetic patients: Psychological aspects. Ann N Y Acad Sci. 2006 Nov;1084:329–49. doi: 10.1196/annals.1372.016. [DOI] [PubMed] [Google Scholar]
- 6.Lin EHB, Katon W, Von KM, Rutter C, Simon GE, Oliver M, Ciechanowski P, Ludman EJ, Bush T, Young B. Relationship of depression and diabetes self-care, medication adherence, and preventive care. Diabetes Care. 2004 Sep;27(9):2154–60. doi: 10.2337/diacare.27.9.2154. [DOI] [PubMed] [Google Scholar]
- 7.Gonzalez JS, Safren SA, Delahanty LM, Cagliero E, Wexler DJ, Meigs JB, Grant RW. Symptoms of depression prospectively predict poorer self-care in patients with Type 2 diabetes. Diabet Med. 2008 Sep;25(9):1102–7. doi: 10.1111/j.1464-5491.2008.02535.x. http://europepmc.org/abstract/MED/19183315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Egede LE. Effects of depression on work loss and disability bed days in individuals with diabetes. Diabetes Care. 2004 Jul;27(7):1751–3. doi: 10.2337/diacare.27.7.1751. [DOI] [PubMed] [Google Scholar]
- 9.Eren I, Erdi O, Sahin M. The effect of depression on quality of life of patients with type II diabetes mellitus. Depress Anxiety. 2008;25(2):98–106. doi: 10.1002/da.20288. [DOI] [PubMed] [Google Scholar]
- 10.Katon W, Lin EHB, Kroenke K. The association of depression and anxiety with medical symptom burden in patients with chronic medical illness. Gen Hosp Psychiatry. 2007;29(2):147–55. doi: 10.1016/j.genhosppsych.2006.11.005. [DOI] [PubMed] [Google Scholar]
- 11.Egede LE. Diabetes, major depression, and functional disability among U.S. adults. Diabetes Care. 2004 Feb;27(2):421–8. doi: 10.2337/diacare.27.2.421. [DOI] [PubMed] [Google Scholar]
- 12.Le TK, Able SL, Lage MJ. Resource use among patients with diabetes, diabetic neuropathy, or diabetes with depression. Cost Eff Resour Alloc. 2006 Oct 23;4:18. doi: 10.1186/1478-7547-4-18. https://resource-allocation.biomedcentral.com/articles/10.1186/1478-7547-4-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Finkelstein EA, Bray JW, Chen H, Larson MJ, Miller K, Tompkins C, Keme A, Manderscheid R. Prevalence and costs of major depression among elderly claimants with diabetes. Diabetes Care. 2003 Feb;26(2):415–20. doi: 10.2337/diacare.26.2.415. [DOI] [PubMed] [Google Scholar]
- 14.Egede LE, Nietert PJ, Zheng D. Depression and all-cause and coronary heart disease mortality among adults with and without diabetes. Diabetes Care. 2005 Jun;28(6):1339–45. doi: 10.2337/diacare.28.6.1339. [DOI] [PubMed] [Google Scholar]
- 15.Katon W, Fan M, Unützer J, Taylor J, Pincus H, Schoenbaum M. Depression and diabetes: a potentially lethal combination. J Gen Intern Med. 2008 Oct;23(10):1571–5. doi: 10.1007/s11606-008-0731-9. http://europepmc.org/abstract/MED/18649108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Anderson RJ, Freedland KE, Clouse RE, Lustman PJ. The prevalence of comorbid depression in adults with diabetes: a meta-analysis. Diabetes Care. 2001 Jun;24(6):1069–78. doi: 10.2337/diacare.24.6.1069. [DOI] [PubMed] [Google Scholar]
- 17.Petrak F, Herpertz S. Treatment of depression in diabetes: an update. Curr Opin Psychiatry. 2009 Mar;22(2):211–7. doi: 10.1097/YCO.0b013e3283207b45. [DOI] [PubMed] [Google Scholar]
- 18.van der Feltz-Cornelis CM, Nuyen J, Stoop C, Chan J, Jacobson AM, Katon W, Snoek F, Sartorius N. Effect of interventions for major depressive disorder and significant depressive symptoms in patients with diabetes mellitus: a systematic review and meta-analysis. Gen Hosp Psychiatry. 2010;32(4):380–95. doi: 10.1016/j.genhosppsych.2010.03.011. [DOI] [PubMed] [Google Scholar]
- 19.Safren SA, Gonzalez JS, Wexler DJ, Psaros C, Delahanty LM, Blashill AJ, Margolina AI, Cagliero E. A randomized controlled trial of cognitive behavioral therapy for adherence and depression (CBT-AD) in patients with uncontrolled type 2 diabetes. Diabetes Care. 2014;37(3):625–33. doi: 10.2337/dc13-0816. http://europepmc.org/abstract/MED/24170758. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.NCC-CC . Type 2 Diabetes: National Clinical Guideline for Management in Primary and Secondary Care (update) London: Royal College of Physicians of London; 2008. [PubMed] [Google Scholar]
- 21.van Bastelaar KM, Pouwer F, Cuijpers P, Riper H, Snoek FJ. Web-based depression treatment for type 1 and type 2 diabetic patients: a randomized, controlled trial. Diabetes Care. 2011 Feb;34(2):320–5. doi: 10.2337/dc10-1248. http://europepmc.org/abstract/MED/21216855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007 Mar;37(3):319–28. doi: 10.1017/S0033291706008944. [DOI] [PubMed] [Google Scholar]
- 23.Tate DF, Finkelstein EA, Khavjou O, Gustafson A. Cost effectiveness of internet interventions: review and recommendations. Ann Behav Med. 2009 Aug;38(1):40–5. doi: 10.1007/s12160-009-9131-6. http://europepmc.org/abstract/MED/19834778. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res. 2006;8(2):e10. doi: 10.2196/jmir.8.2.e10. http://www.jmir.org/2006/2/e10/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Strecher V. Internet methods for delivering behavioral and health-related interventions (eHealth) Annu Rev Clin Psychol. 2007;3:53–76. doi: 10.1146/annurev.clinpsy.3.022806.091428. [DOI] [PubMed] [Google Scholar]
- 26.Schröder J, Berger T, Westermann S, Klein JP, Moritz S. Internet interventions for depression: new developments. Dialogues Clin Neurosci. 2016 Dec;18(2):203–12. doi: 10.31887/DCNS.2016.18.2/jschroeder. http://www.dialogues-cns.org/publication/internet-interventions-for-depression-new-developments. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196–205. doi: 10.1080/16506070903318960. [DOI] [PubMed] [Google Scholar]
- 28.Andersson G, Topooco N, Havik O, Nordgreen T. Internet-supported versus face-to-face cognitive behavior therapy for depression. Expert Rev Neurother. 2016;16(1):55–60. doi: 10.1586/14737175.2015.1125783. [DOI] [PubMed] [Google Scholar]
- 29.Rodgers M, Asaria M, Walker S, McMillan D, Lucock M, Harden M, Palmer S, Eastwood A. The clinical effectiveness and cost-effectiveness of low-intensity psychological interventions for the secondary prevention of relapse after depression: a systematic review. Health Technol Assess. 2012 May;16(28):1–130. doi: 10.3310/hta16280. doi: 10.3310/hta16280. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Bond GE, Burr RL, Wolf FM, Feldt K. The effects of a web-based intervention on psychosocial well-being among adults aged 60 and older with diabetes: a randomized trial. Diabetes Educ. 2010;36(3):446–56. doi: 10.1177/0145721710366758. [DOI] [PubMed] [Google Scholar]
- 31.Cohn MA, Pietrucha ME, Saslow LR, Hult JR, Moskowitz JT. An online positive affect skills intervention reduces depression in adults with type 2 diabetes. J Posit Psychol. 2014 Jan 1;9(6):523–534. doi: 10.1080/17439760.2014.920410. http://europepmc.org/abstract/MED/25214877. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Nobis S, Lehr D, Ebert DD, Baumeister H, Snoek F, Riper H, Berking M. Efficacy of a web-based intervention with mobile phone support in treating depressive symptoms in adults with type 1 and type 2 diabetes: a randomized controlled trial. Diabetes Care. 2015 May;38(5):776–83. doi: 10.2337/dc14-1728. [DOI] [PubMed] [Google Scholar]
- 33.Newby J, Robins L, Wilhelm Kay, Smith Jessica, Fletcher Therese, Gillis Inika, Ma Trevor, Finch Adam, Campbell Lesley, Andrews Gavin. Web-Based Cognitive Behavior Therapy for Depression in People With Diabetes Mellitus: A Randomized Controlled Trial. J Med Internet Res. 2017 May 15;19(5):e157. doi: 10.2196/jmir.7274. http://www.jmir.org/2017/5/e157/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Robins L, Newby J, Wilhelm K, Smith J, Fletcher T, Ma T, Finch A, Campbell L, Andrews G. Internet-delivered cognitive behaviour therapy for depression in people with diabetes: study protocol for a randomised controlled trial. BMJ Open Diabetes Res Care. 2015;3(1):e000144. doi: 10.1136/bmjdrc-2015-000144. http://europepmc.org/abstract/MED/26688735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Cuijpers P, Van Straten A, Warmerdam L, Smits N. Characteristics of effective psychological treatments of depression: a metaregression analysis. Psychother Res. 2008 Mar;18(2):225–36. doi: 10.1080/10503300701442027. [DOI] [PubMed] [Google Scholar]
- 36.Mohr DC, Spring B, Freedland KE, Beckner V, Arean P, Hollon SD, Ockene J, Kaplan R. The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom. 2009;78(5):275–84. doi: 10.1159/000228248. [DOI] [PubMed] [Google Scholar]
- 37.Chiesa A. Improving psychotherapy research: The example of mindfulness based interventions. World J Methodol. 2011 Sep 26;1(1):4–11. doi: 10.5662/wjm.v1.i1.4. http://www.wjgnet.com/2222-0682/full/v1/i1/4.htm. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Khamseh ME, Baradaran HR, Javanbakht A, Mirghorbani M, Yadollahi Z, Malek M. Comparison of the CES-D and PHQ-9 depression scales in people with type 2 diabetes in Tehran, Iran. BMC Psychiatry. 2011 Apr 16;11:61. doi: 10.1186/1471-244X-11-61. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/1471-244X-11-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry. 2014 Feb;13(1):4–11. doi: 10.1002/wps.20083. doi: 10.1002/wps.20083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Schmitt A, Reimer A, Kulzer B, Haak T, Ehrmann D, Hermanns N. How to assess diabetes distress: comparison of the Problem Areas in Diabetes Scale (PAID) and the Diabetes Distress Scale (DDS) Diabet Med. 2016 Jun;33(6):835–43. doi: 10.1111/dme.12887. [DOI] [PubMed] [Google Scholar]
- 41.Penckofer S, Doyle T, Byrn M, Lustman PJ. State of the science: depression and type 2 diabetes. West J Nurs Res. 2014 Oct;36(9):1158–82. doi: 10.1177/0193945914524491. http://europepmc.org/abstract/MED/24577866. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Ramadas A, Quek KF, Chan CKY, Oldenburg B. Web-based interventions for the management of type 2 diabetes mellitus: a systematic review of recent evidence. Int J Med Inform. 2011 Jun;80(6):389–405. doi: 10.1016/j.ijmedinf.2011.02.002. [DOI] [PubMed] [Google Scholar]
- 43.Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JEWC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. 2012;14(6):e152. doi: 10.2196/jmir.2104. http://www.jmir.org/2012/6/e152/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, Riper H. Adherence to Internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One. 2014;9(7):e100674. doi: 10.1371/journal.pone.0100674. http://dx.plos.org/10.1371/journal.pone.0100674. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012 Jun;32(4):329–42. doi: 10.1016/j.cpr.2012.02.004. [DOI] [PubMed] [Google Scholar]
- 46.Hofmann SG, Asnaani A, Vonk IJJ, Sawyer AT, Fang A. The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses. Cognit Ther Res. 2012 Oct 1;36(5):427–440. doi: 10.1007/s10608-012-9476-1. http://europepmc.org/abstract/MED/23459093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Li C, Xu D, Hu M, Tan Y, Zhang P, Li G, Chen L. A systematic review and meta-analysis of randomized controlled trials of cognitive behavior therapy for patients with diabetes and depression. J Psychosom Res. 2017 Apr;95:44–54. doi: 10.1016/j.jpsychores.2017.02.006. [DOI] [PubMed] [Google Scholar]
- 48.Uchendu C, Blake H. Effectiveness of cognitive-behavioural therapy on glycaemic control and psychological outcomes in adults with diabetes mellitus: a systematic review and meta-analysis of randomized controlled trials. Diabet Med. 2017 Mar;34(3):328–339. doi: 10.1111/dme.13195. [DOI] [PubMed] [Google Scholar]
- 49.Renton T, Tang H, Ennis N, Cusimano MD, Bhalerao S, Schweizer TA, Topolovec-Vranic J. Web-based intervention programs for depression: a scoping review and evaluation. J Med Internet Res. 2014;16(9):e209. doi: 10.2196/jmir.3147. http://www.jmir.org/2014/9/e209/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Andersson G. Using the Internet to provide cognitive behaviour therapy. Behav Res Ther. 2009 Mar;47(3):175–80. doi: 10.1016/j.brat.2009.01.010. [DOI] [PubMed] [Google Scholar]
- 51.Snoek FJ, Bremmer MA, Hermanns N. Constructs of depression and distress in diabetes: time for an appraisal. Lancet Diabetes Endocrinol. 2015 Jun;3(6):450–460. doi: 10.1016/S2213-8587(15)00135-7. [DOI] [PubMed] [Google Scholar]
- 52.Aguilera A, Lyles CR. The Case for Jointly Targeting Diabetes and Depression Among Vulnerable Patients Using Digital Technology. JMIR Diabetes. 2017 Jan 17;2(1):e1. doi: 10.2196/diabetes.6916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Charova E, Dorstyn D, Tully P, Mittag O. Web-based interventions for comorbid depression and chronic illness: a systematic review. J Telemed Telecare. 2015 Jun;21(4):189–201. doi: 10.1177/1357633X15571997. [DOI] [PubMed] [Google Scholar]
- 54.Sudak D. The Cognitive Behavioral Therapy for Clinicians. Philadelphia: Lippincott Williams and Wilkins; 2006. Cognitive behavioral therapy for clinicians. [Google Scholar]
- 55.Beck . Cognitive Therapy of Depression. New York: Guilford Publications, Inc; 1987. [Google Scholar]
- 56.Kazantzis N, Deane F, Ronan K. Homework assignments in Cognitive and Behavioral Therapy: A meta-analysis. Clin Psychol Sci Pract. 2000;7(2):189–207. doi: 10.1093/clipsy.7.2.189. [DOI] [Google Scholar]
- 57.Lindner P, Olsson EL, Johnsson A, Dahlin M, Andersson G, Carlbring P. The impact of telephone versus e-mail therapist guidance on treatment outcomes, therapeutic alliance and treatment engagement in Internet-delivered CBT for depression: A randomised pilot trial. Internet Interventions. 2014 Oct;1(4):182–187. doi: 10.1016/j.invent.2014.09.001. [DOI] [Google Scholar]
- 58.Berger T, Hämmerli K, Gubser N, Andersson G, Caspar F. Internet-based treatment of depression: a randomized controlled trial comparing guided with unguided self-help. Cogn Behav Ther. 2011 Dec;40(4):251–66. doi: 10.1080/16506073.2011.616531. [DOI] [PubMed] [Google Scholar]
- 59.Melling B, Houguet-Pincham T. Online peer support for individuals with depression: a summary of current research and future considerations. Psychiatr Rehabil J. 2011;34(3):252–4. doi: 10.2975/34.3.2011.252.254. [DOI] [PubMed] [Google Scholar]
- 60.Wangberg SC, Bergmo TS, Johnsen JK. Adherence in Internet-based interventions. Patient Prefer Adherence. 2008;2:57–65. http://www.dovepress.com/articles.php?article_id=2062. [PMC free article] [PubMed] [Google Scholar]
- 61.Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol. 2010 Nov;49(Pt 4):455–71. doi: 10.1348/014466509X472138. [DOI] [PubMed] [Google Scholar]
- 62.DiMatteo MR, Lepper HS, Croghan TW. Depression is a risk factor for noncompliance with medical treatment: meta-analysis of the effects of anxiety and depression on patient adherence. Arch Intern Med. 2000 Jul 24;160(14):2101–7. doi: 10.1001/archinte.160.14.2101. [DOI] [PubMed] [Google Scholar]
- 63.Delamater AM. Improving Patient Adherence. Clinical Diabetes. 2006 Apr 01;24(2):71–77. doi: 10.2337/diaclin.24.2.71. [DOI] [Google Scholar]
- 64.Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res. 2011;13(3):e52. doi: 10.2196/jmir.1772. http://www.jmir.org/2011/3/e52/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Hilvert-Bruce Z, Rossouw PJ, Wong N, Sunderland M, Andrews G. Adherence as a determinant of effectiveness of internet cognitive behavioural therapy for anxiety and depressive disorders. Behav Res Ther. 2012 Aug;50(7-8):463–8. doi: 10.1016/j.brat.2012.04.001. [DOI] [PubMed] [Google Scholar]