Skip to main content
Internet Interventions logoLink to Internet Interventions
. 2021 Jan 7;23:100363. doi: 10.1016/j.invent.2021.100363

Blended transdiagnostic group CBT for emotional disorders: A feasibility trial protocol

Amanda Díaz-García a,, Alberto González-Robles a, Azucena García-Palacios b,c, Isabel Fernández-Felipe b, Cintia Tur b, Diana Castilla c,d, Cristina Botella b,c
PMCID: PMC7820549  PMID: 33520670

Abstract

Introduction

Emotional disorders (anxiety and depressive disorders) are a relevant public health concern associated with high prevalence, high costs, and important disability. Therefore, research priorities include designing and testing cost-effective interventions to reach everyone in need. Internet-delivered interventions for emotional disorders are effective and can help to disseminate and implement evidence-based treatments. However, although these treatments are generally effective, not all patients benefit from this treatment format equally. Blended treatments are a new form of intervention that combines the strengths of face-to-face and Internet approaches. Nevertheless, research on blended interventions has focused primarily on individual therapy, and less attention has been paid to the potential of using this format in group psychotherapy. This study aims to analyze the feasibility of blended transdiagnostic group CBT for emotional disorders. The current article describes the study protocol for this trial.

Method and analysis

A one-armed pilot trial will be conducted. Participants will be 30 adults suffering from DSM-5 anxiety and/or depressive disorders. The treatment consists of a blended transdiagnostic group intervention delivered during a period of 24 weeks. Groups of 6 to 10 patients will attend a total of eight 2-hour, face-to-face sessions, alternated with the use of an online platform where they will find the contents of the treatment protocol. The intervention has four core components: present-focused awareness, cognitive flexibility, identification and modification of behavioral and cognitive patterns of emotional avoidance, and interoceptive and situational exposure. These components are delivered in 16 modules. Assessments will be performed at baseline, during the treatment, at post-treatment, and at 3-month follow-up. Clinical and treatment acceptability outcomes will be included. Quantitative and qualitative data (participants’ views about blended group psychotherapy) will be analyzed.

Ethics and dissemination

The trial has received ethical approval from the Ethics Committee of Universitat Jaume I (September 2019) and will be conducted in accordance with the study protocol, the Declaration of Helsinki, and good clinical practice. The results of this study will be disseminated by presentation at conferences and will be submitted for publication in a peer-reviewed journal.

Trial registration

ClinicalTrials.gov Identifier: NCT04008576. Registered 05 July 2019, https://clinicaltrials.gov/ct2/show/NCT04008576

Keywords: Blended psychotherapy, Blended CB, Group psychotherapy, Transdiagnostic, Emotional disorders, Anxiety, Depression

Highlights

  • This feasibility study presents a user-centered blended group intervention for the treatment of emotional disorders.

  • This study will open up new forms of patient-to-patient or patient-to-therapist communication.

  • This study may help to consider the utility of feasibility studies in practice for the treatment of emotional disorders.

1. Introduction

Emotional disorders (anxiety and depressive disorders) (Bullis et al., 2019) are the most prevalent mental disorders (Ferrari et al., 2013; Kessler et al., 2005), and impact the lives of millions of people worldwide (Kohn et al., 2004; Steel et al., 2014). Moreover, emotional disorders are associated with high costs (Andlin-Sobocki and Wittchen, 2005; Cuijpers et al., 2012), disability (Baxter et al., 2014), chronicity (Richards, 2011), and high comorbidity rates with other emotional disorders (Kroenke et al., 2007).

A large body of research shows the efficacy of cognitive-behavioral treatments (CBT) for emotional disorders (Nathan and Gorman, 2015). However, although there is little doubt about the efficacy and effectiveness of CBT for emotional disorders, the dissemination and effective implementation of these protocols is still a major challenge for research and clinical practice (McHugh and Barlow, 2010). In other words, despite research efforts to provide empirically supported treatments during the past three decades, there is still an important treatment gap in mental healthcare, leading to a large proportion of patients who do not receive treatment in mental healthcare services, especially those with anxiety and mood disorders (Kohn et al., 2004; Lilienfeld et al., 2013; Wang et al., 2007).

In the past two decades, different approaches have emerged to improve the dissemination and implementation of evidence-based treatments. In this regard, one important line of research is the transdiagnostic approach to the treatment of emotional disorders. The efficacy of transdiagnostic treatments has been shown in a growing number of meta-analytic studies (García-Escalera et al., 2016; Newby et al., 2015, Newby et al., 2016; Reinholt and Krogh, 2014). The main defining characteristic of transdiagnostic treatments is that they “apply the same underlying treatment principles across mental disorders, without tailoring the protocol to specific diagnoses” (McManus et al., 2010, p. 4). Broadly, transdiagnostic treatments are based on the premise that the commonalities of psychological disorders outweigh their differences, and that the observed differences (symptoms) are specific manifestations of broader, underlying common psychopathological processes. This approach has been called the “mechanistically transdiagnostic approach”, and it has fueled the development of transdiagnostic treatments based on “shared mechanisms” (Sauer-Zavala et al., 2017). For these reasons, the use of transdiagnostic treatments has important implications for clinical practice. For example, comorbid presentations can be targeted more appropriately (Mansell et al., 2008), and training costs are lower because clinicians only have to be trained in one protocol instead of different protocols for each specific diagnosis (McEvoy et al., 2009).The goal of these treatments has typically been to train the individual in emotion regulation strategies to address the dimension of neuroticism or negative affect (Barlow et al., 2004; Norton, 2012; Titov et al., 2010, Titov et al., 2011). However, the interest in directly targeting positive affect in the context of emotional disorders has increased in more recent research (Carl et al., 2018; Taylor et al., 2017). For instance, Carl et al. (2018) proposed a module for the regulation of positive affectivity to be applied transdiagnostically across anxiety and depressive disorders. According to the authors, the module can be implemented flexibly, either integrated into a modular treatment program (e.g., the Unified Protocol) or as an adjunct treatment for patients who show deficits in positive affect at post-treatment.

Another approach that could enhance the dissemination and implementation of evidence-based CBT and considerably reduce the costs is the use of the Internet to deliver treatments. A number of systematic reviews have shown that Internet-delivered treatments for depression and anxiety disorders are more effective than different control groups, such as waitlist and treatment as usual groups (Andrews et al., 2018; Richards and Richardson, 2012; Spek et al., 2007), and that they work as effectively as face-to-face psychotherapy (Carlbring et al., 2018). In the context of Internet-delivered treatments, one possibility consists of the so-called “blended treatments”, that is, the combination of face-to-face and Internet-delivered therapy (Kleiboer et al., 2016; Kooistra et al., 2014). Some of the advantages of these interventions include enhancing the learning process (e.g., retention of learned information or improvement of learned tasks), extending the reach of information by using the Internet, and optimizing development costs and time and cost-effectiveness (i.e., to offer learning strategies that reach large numbers of individuals quickly) (Cucciare et al., 2008). Moreover, by participating in a blended treatment, patients can work on their own mental health between sessions, increasing their ability to adapt and self-manage, which are core aspects in defining health (Huber et al., 2011). There is growing support in the literature for the claim that blended therapy may save clinician time, lead to lower dropout rates, help maintain the effects of inpatient therapy, and increase the effects of psychotherapy, compared to stand-alone face-to-face therapy (Erbe et al., 2017). Thus, another advantage of blended treatments is their lower cost in comparison with traditional face-to-face psychotherapy, suggesting that this treatment delivery format can help to save therapist time. For instance, the usual treatments include between 12 and 14 sessions, whereas blended treatments are shortened to 6–8 sessions, representing a 33–57% savings in terms of costs and time (Schuster et al., 2018). Furthermore, blended treatments might be a good alternative for those patients who are less likely to benefit from guided or unguided Internet-delivered treatments (with no face-to-face contact). Another way to reduce the costs of psychotherapy is through the use of the group format. The literature has shown that, for the treatment of anxiety and depressive disorders, different methods of implementation (individual vs. group CBT) have led to similar drop-out rates or satisfaction with the treatment (Bastien et al., 2004; Jónsson et al., 2011). Numerous advantages have been attributed to group therapy, such as support (the group become a valuable source of support), confidentiality (one of the ground rules for group therapy), or diversity (it makes it possible to discover a whole range of strategies to face problems) (APA, 2013; Sepúlveda et al., 2010). In addition, as the National Institute for Health and Care Excellence recommends, group CBT should be considered for people with mild to moderate depression who decline low-intensity psychosocial interventions such as Internet-based treatments (NIH, 2009). Furthermore, the literature suggests that the two treatment formats (individual vs. group) are comparable in terms of rates of treatment acceptance, dropout, remission, or improvement (Barkowski et al., 2016). Therefore, group therapy is an appropriate strategy to reduce the burden of these disorders in a more cost-effective manner.

A treatment strategy that may boost the cost-effectiveness relationship is the combination of the blended and group formats. In spite of the advantages of group CBT, in the specific field of transdiagnostic treatments, research has mainly focused on individual transdiagnostic treatments (González-Robles et al., 2018a, González-Robles et al., 2018b), with some exceptions (Norton, 2012; Reinholt et al., 2017). In Spain, Osma et al. (2019) are conducting arandomized controlled trial (RCT) that tests transdiagnostic group psychotherapy in specialized mental health care. However, to our knowledge, no studies have been published that combine blended (i.e., face-to-face plus Internet-delivered psychotherapy) and group delivery formats to provide transdiagnostic treatments for emotional disorders. The existing studies on blended group psychotherapy are quite scarce, and they focus only on the treatment of major depressive disorder (Schuster et al., 2018). Combining these two treatment approaches to deliver a transdiagnostic treatment might be a highly cost-effective treatment strategy for these disorders, which could ultimately contribute to the dissemination and implementation of evidence-based transdiagnostic CBT.

1.1. Current study

The objective of this study is to analyze the feasibility of blended transdiagnostic group CBT for emotional disorders. To this end, a transdiagnostic Internet-delivered treatment protocol will be delivered in combination with group psychotherapy sessions. The treatment protocol is a mechanistically transdiagnostic treatment that adds a specific component for the regulation of positive affectivity. Thus, the treatment contains strategies for the regulation of both negative affectivity and positive affectivity. The manualized version of this treatment protocol has already been pilot-tested in an individual face-to-face format (González-Robles et al., 2019), and results of a randomized controlled trial of the Internet-delivered version have already been published (González-Robles et al., 2020). Specifically, we aim to study the adequacy of the different methods of recruitment and data collection (e.g., how broad or restrictive eligibility criteria are, how willing patients are to participate, time needed to collect data), to explore reasons for non-participation and for dropping out from the treatment, to analyze and select optimal outcome measures, and to explore patients' acceptability of the intervention (both quantitatively and qualitatively). Furthermore, a secondary aim of the study is to preliminary estimate the impact of the intervention at post-treatment and 3-month follow up.

These objectives will help to optimize the design of a future RCT and they are consistent with the recommendations found in the literature about feasibility studies (Eldridge et al., 2013, Eldridge et al., 2016). The current article describes the study protocol of this trial.

2. Method and analysis

2.1. Design

The current study uses a single-group, open-trial design with three measurement points: baseline (pre-treatment), immediately after the intervention (post-treatment), and at 3-month follow-up. A mixed-method design will be used (including quantitative and qualitative methodology) (Creswell and Clark, 2017), in line with guidelines for Good Reporting of a Mixed Method Study (O'cathain et al., 2008) and for complex interventions (Craig et al., 2008).This design is appropriate to evaluate an intervention before it is introduced in a clinical setting (Bowen et al., 2009). Quantitative data will be collected through the online platform using validated questionnaires. Qualitative data will be collected using the focus group method using in-depth questions. Quantitative data will be employed to explore changes in outcomes, while qualitative data will provide data on the participants' opinions about the treatment, the face-to-face sessions, and the online platform.

2.2. Participants, recruitment and procedure

Participants will be adults attending the Service of Psychological Assistance at Universitat Jaume I to seek psychological help. The main aim of this service is to provide evidence-based treatment protocols using Information and communication Technologies tools. After an initial screening session, an additional session will be arranged with those candidates interested in participating to confirm that they meet the eligibility diagnostic criteria, using the MINI International Neuropsychiatric Interview (MINI) (Ferrando et al., 1997; Sheehan et al., 1998). This session will be used to collect sociodemographic and other clinical data (e.g., medication). Moreover, patients will be asked about medication types and dose before starting the intervention, and these data will be monitored and recorded during the treatment and follow-up periods. Once the characteristics of the study have been explained to participants, they will be asked to sign an informed, written consent form. All the assessment instruments will be delivered through a web platform (https://www.psicologiaytecnologia.labpsitec.es), and assessments will take place at pre- and post-treatment and at 3-month follow-up. One week before the intervention starts (i.e., first group session), patients will be asked to complete pre-treatment assessment instruments. Post-treatment questionnaires will be completed 3 weeks after the last group session.

Groups will be led by two trained therapists (AD-G and AG-R), each of whom will have the support of a co-therapist (IF-F and CT). Both therapists and co-therapists are qualified clinicians with experience in the treatment of emotional disorders and have been trained in the use of the transdiagnostic treatment protocol as well as the study protocol. Moreover, the leading therapists (AD-G and AG-R) developed doctoral dissertations focused on the application of transdiagnostic CBT (Díaz-García et al., 2017; González-Robles et al., 2020). All the therapists have experience with group psychotherapy, and they will be supervised by expert clinicians with extensive experience in the application of evidence-based CBT and this transdiagnostic protocol for emotional disorders. All the therapists involved in participant assessments have already been trained in the use of the diagnostic interview (i.e., MINI). The study flowchart is shown in Fig. 1.

Fig. 1.

Fig. 1

Flowchart of participants.

The study has been registered in Clinicaltrials.gov (https://clinicaltrials.gov/) as NCT04008576 (https://clinicaltrials.gov/ct2/show/NCT04008576) and received ethical approval from the Ethics Committee of Universitat Jaume I (Castellon, Spain).

Because the study is designed to assess the feasibility of conducting an RCT, a formal power calculation is not considered appropriate. A minimum of 30 participants is considered enough to cover the aims of this feasibility study and to provide data about a number of parameters (i.e., adherence, attrition, satisfaction with the online treatment and with the face-to-face group sessions, deterioration rate, platform usage, and so on) that will help to optimize the future RCT design.

2.3. Eligibility criteria

The selection of participants will be based on the following eligibility criteria: a) age 18 years old or older; b) fluency in Spanish; c) daily access to the Internet at home and an email address; d) meeting DSM-5 diagnostic criteria (DSM-5 American Psychological Association, 2013) for at least one of the following emotional disorders (Bullis et al., 2019): major depressive disorder, dysthymic disorder, other specified/unspecified depressive disorder, panic disorder, agoraphobia, social anxiety disorder, generalized anxiety disorder, other specified/unspecified anxiety disorder, and obsessive-compulsive disorder; e) absence of schizophrenia, bipolar disorder and/or alcohol and/or substance dependence disorder; f) absence of high suicide risk; g) not receiving any additional psychological treatment during the study period; and h) no changes and/or increases in pharmacological treatment during the treatment and follow-up periods (decreases in medication will be accepted).

2.4. Treatment

The treatment consists of a blended transdiagnostic group intervention delivered during a period of 24 weeks. Groups of 6 to 10 patients will attend a total of eight 2-hour, face-to-face sessions, alternated with the use of an online platform where they will find the contents of the treatment protocol. The treatment is a 16-module transdiagnostic CBT Internet-delivered protocol adapted from the Unified Protocol (Barlow et al., 2011a, Barlow et al., 2011b) and treatment strategies derived from Dialectical Behavioral Therapy (Linehan, 1993). The treatment was initially developed and structured in a patient and therapist handbook (Botella et al. Transdiagnostic Treatment for Emotion Disorders: Manualized Treatment Protocol, unpublished) and, later, adapted to a multimedia web platform designed by our research group (https://www.psicologiaytecnologia.labpsitec.es). The intervention has four core components that aim to: a) increase present-focused awareness, b) promote cognitive flexibility, c) identify and modify behavioral and cognitive patterns of emotional avoidance, and d) promote interoceptive and situational graded exposure. Additionally, it also contains a treatment component aimed at regulating positive affect (modules 12 to 15). These components are preceded by three modules containing psychoeducation about emotions and emotion regulation, and a module to facilitate patients' readiness to change (motivation for change) (modules 1 to 3), and they are followed by a relapse prevention module (module 16). More details about the online treatment platform and the contents of the modules have been published elsewhere (Díaz-García et al., 2017; González-Robles et al., 2019).

Each group will meet once every three weeks. During the three weeks between group sessions, participants will be asked to access the online platform to review the treatment contents and do the homework tasks. Attendance of participants to the face-to-face sessions as well as program usage will be monitored throughout the whole study period. Overall, group sessions will be divided in two parts: the first part will focus on discussing the contents of the modules already targeted, whereas the second part will be devoted to presenting the contents of the modules to be addressed in the following three weeks. In order to make the sessions more dynamic and appealing to patients, a practical and participative approach will be followed. The structure of the face-to-face group sessions and the contents of the online modules are described in greater detail in Table 1.

Table 1.

Structure of face-to-face sessions and multimedia elements.

Sessions Group session Modules Multimedia elements
S1 Part 1 (45′):
  • Therapists' introduction

  • Discussion of the advantages and rules of group therapy

  • Patients' introduction

Part 2 (75′):
  • Presentation of M1 to M3

M1. Emotional disorders and emotion regulation
M2. Motivation for change
M3. Understanding the role of emotions
Videos 1–5. Objectives of the module; the transdiagnostic approach; emotion regulation; contents of the program; the importance of homework tasks
Videos 6–12. Examples of patients with different emotional disorders
Multiple-choice check questions
PDF1 questions for reflection
PDF2 summary of M1

Videos 1–6. Objectives of the module; ambivalence about change; identifying objectives and goals; pros and cons of changing (example); identifying objectives and goals (example); the importance of homework tasks
Multiple-choice check questions
PDF1 questions for reflection
PDF2 decisional balance worksheet
PDF3 treatment goal setting worksheet
PDF4 summary of M2

Videos 1–4. Objectives of the module; what are emotions?; the adaptive role of emotions; the three-component model of emotions;
Multiple-choice check questions
PDF1 the function of emotions
PDF2 three component model of emotions worksheet
PDF3 summary of M2
S2 Part 1 (30′):
  • Presentation of the agenda

  • Doubts and questions about M1 to M3

  • Emphasis on self-monitoring, practice and homework

Part 2 (90′):
  • Presentation of M4 and M5

M4. The acceptance of emotional experiences
M5. Practicing acceptance
Videos 1–5. Objectives of the module; primary and secondary emotional response; present-focused emotional awareness; observe the breath; the five senses exercise
Multiple-choice check questions
PDF1 “what” techniques
PDF2 “how” techniques
PDF3 summary of M4

Videos 1–4. Objectives of the module; present-focused awareness of physical sensations; present-focused awareness of thoughts; present-focused awareness of emotions
Multiple-choice check questions
PDF1 present-focused awareness of physical sensations worksheet
PDF2 present-focused awareness of thoughts worksheet
PDF3 present-focused awareness of emotions worksheet
PDF4 present-focused awareness of the daily life worksheet
PDF5 web links with videos to practice present-focused awareness of emotions
PDF6 summary of M5
S3 Part 1 (30′):
  • Presentation of the agenda

  • Doubts and questions about M4 and M5

  • Emphasis on self-monitoring, practice and homework

Part 2 (90′):
  • Presentation of M6 and M7

M6. Learning to be flexible
M7. Practicing cognitive flexibility
Videos 1–8. Objectives of the module; cognitive appraisal; how interpretations influence emotions; how the same situation can be interpreted in different ways; how emotions influence interpretations; negative thoughts (catastrophizing); downward arrow technique; identification and reappraisal of automatic thoughts (example)
Multiple-choice check questions
PDF1 downward arrow technique worksheet
PDF2 identification and reappraisal of automatic thoughts worksheet
PDF3 summary of M6

Videos 1–5. Objectives of the module; cognitive reappraisal; techniques for cognitive reappraisal; strategies for the reappraisal of automatic thoughts (example); evaluating obsessive, intrusive, nonsensical thoughts
Multiple-choice check questions
PDF1 strategies for the reappraisal of automatic thoughts worksheet
PDF2 identification and reappraisal of automatic thoughts worksheet
PDF3 downward arrow technique worksheet
PDF4 identification and reappraisal of automatic thoughts worksheet
PDF5 summary of M7
S4 Part 1 (30′):
  • Presentation of the agenda

  • Doubts and questions about M6 and M7

  • Emphasis on self-monitoring, practice and homework

Part 2 (90′):
  • Presentation of M8 and M9

M8. Emotional avoidance
M9. Emotion-driven behaviors
Videos 1–3. Objectives of the module; types of maladaptive emotional regulation strategies; consequences of maladaptive emotional regulation strategies
Multiple-choice check questions
PDF1 maladaptive emotional regulation strategies worksheet
PDF2 consequences of emotional avoidance worksheet
PDF3 emotional avoidance strategies worksheet
PDF3 summary of M8

Videos 1–3. Objectives of the module; emotion-driven behaviors; the opposite action
Multiple-choice check questions
PDF1 emotion-driven behaviors worksheet
PDF2 the opposite action
PDF3 Summary of M9
S5 Part 1 (30′):
  • Presentation of the agenda

  • Doubts and questions about M8 and M9

  • Emphasis on self-monitoring, practice and homework

Part 2 (90′):
  • Presentation of M10 and M11

M10. Accepting and facing physical sensations
M11. Facing emotions in the contexts where they occur
Videos 1–3. Objectives of the module; the role of physical sensations in emotion; the avoidance of physical sensations
Multiple-choice check questions
PDF1 exercises to generate physical sensations
PDF2 symptoms associated with the different exercises
PDF3 symptom induction test worksheet
PDF4 interoceptive exposure self-monitoring worksheet
PDF5 summary of M10

Videos 1–4. Objectives of the module; what is graded exposure?; Situational exposure; exposure in the imagination
Multiple-choice check questions
PDF1 emotional exposure hierarchy worksheet
PDF2 exposure self-monitoring worksheet
PDF3 summary of M11
S6 Part 1 (30′):
  • Presentation of the agenda

  • Doubts and questions about M10 and M11

  • Emphasis on self-monitoring, practice and homework

Part 2 (90′):
  • Presentation of M12 and M13

M12. Learning to move on
M13. Learning to enjoy
Videos 1–6. Objectives of the module; the relationship between inactivity and emotional distress; how being active can improve emotional well-being; the importance of short- and long-term significant life goals; the role of social support in emotional well-being; difficulties with and recommendations for behavioral activation
Multiple-choice check questions
PDF1 recommendations for setting short- and long-term significant life goals
PDF2 activity planning and social support form
PDF3 diary of daily activities form
PDF4 summary of M12

Videos 1–5. Objectives of the module; the role of positive emotions in life; the induction of positive emotions; the importance of smiling; exercise: smile to others
Multiple-choice check questions
PDF1 summary of M13

In order to promote the use of the online platform between the group sessions, all the participants will be sent two automatized emails (e.g., “We encourage you to review the modules and carry out all the tasks described in the program as many times as necessary. Remember, the more you practice, the more you will benefit from the treatment”) and two mobile phone text messages (e.g. “Hi there! Don't give up on your module tasks! Dedicate some time and effort to them. Remember, practice makes perfect!”) once a week during the treatment period. In general, the purpose of these messages is to encourage the practice of the treatment strategies, increase the time the participants spend using the platform, and provide positive reinforcement.

2.5. Outcome measures

2.5.1. Clinical outcomes

2.5.1.1. Diagnostic interview

Mini International Neuropsychiatric Interview Version 7.0.2 (MINI). It is a widely used structured diagnostic psychiatric interview to determine DSM-5 and ICD-10 diagnoses. This interview is a brief and accurate structured interview that can be administered by clinicians after a brief training session and in a short period of time. It can also be administered by nonclinical interviewers after more intensive training. The MINI has excellent test-retest and inter-rater reliability (k = 0.88–1.00) and adequate concurrent validity with the Composite International Diagnostic Interview (Lecrubier et al., 1997). This interview has been translated and validated in Spanish (Ferrando et al., 1997).

2.5.1.2. Primary outcomes measures

Overall Anxiety Severity and Impairment Scale (OASIS) (Campbell-Sills et al., 2009). The OASIS is a 5-item questionnaire that assesses the severity and functional impairment caused by anxiety symptoms during the previous week. Items are rated on a scale ranging from 0 to 4, added together to obtain a score that ranges between 0 and 20. Previous studies have shown good internal consistency (α = 0.80), test-retest reliability, and convergent and discriminant validity. The Spanish version has shown good internal consistency (α = 0.86) and construct validity in patients with emotional disorders (González-Robles et al., 2018a, González-Robles et al., 2018b).

Overall Depression Severity and Impairment Scale (ODSIS) (Bentley et al., 2014). The ODSIS is a brief scale made up of 5 items for the assessment of the severity and impairment associated with depressive symptoms during the previous week. The responses are coded on a 5-point scale (0 to 4), and scores can range between 0 and 20 points. The instrument has demonstrated excellent internal consistency in different samples (α = 0.91 to 0.94) and good convergent and discriminant validity. The Spanish validation has also shown excellent internal consistency (α = 0.93) and convergent and discriminant validity (Mira et al., 2019).

2.5.1.3. Secondary outcomes measures

Positive and Negative Affect Schedule (PANAS) (Watson et al., 1988). The PANAS is a 20-item scale that assesses the dimensions of positive affectivity and negative affectivity. The scale contains 10 descriptors for each dimension (e.g., “enthusiastic”, “inspired”, or “proud” in the positive affectivity scale; “scared”, “irritable”, or “guilty” in the negative affect scale). For each item, responses are rated on a 5-point scale (1–5), and the scores on each scale (10 items on each) can range from 10 to 50. The scale has shown excellent convergent and discriminant validity. The Spanish version has demonstrated good psychometric properties (Díaz-Garcia et al., 2020; Sandín et al., 1999).

NEO-five factor Inventory (NEO-FFI) (Robins et al., 2001). The NEO-FFI is a shorter version of the NEO-PI-R composed of 60 items that evaluate the personality dimensions of the five-factor personality model (Costa and McCrae, 1992). Because this study is focused on a mechanistically transdiagnostic treatment that emphasizes the dimensions of neuroticism and extraversion (McManus et al., 2010), only the scores in these dimensions will be used. The NEO-FFI has shown good test-retest reliability. The Spanish version of the questionnaire also showed good psychometric properties (Aluja et al., 2005).

Quality of Life Index (QLI) (Mezzich et al., 1986). The QLI is a scale containing 10 items that assesses quality of life in the following ten areas: psychological well-being, physical well-being, emotional and social support, interpersonal functioning, self-care and independent functioning, community and service support, occupational functioning, self-realization, spiritual satisfaction, and an overall assessment of quality of life. The QLI has shown high test-retest reliability (r = 0.87). The Spanish version of the QLI has shown good internal consistency (α = 0.87) and test-retest reliability in a clinical sample (Mezzich et al., 2000).

Work and Social Adjustment Scale (WSAS) (Mundt et al., 2002). The WSAS is a 5-item scale that evaluates the degree of interference associated with the patients' symptoms in the following five domains: work, home management, private leisure, social leisure, and family relationships. Items are coded on a scale from 0 (not at all) to 8 (very severely), and higher scores are indicative of greater interference in the different areas. The scale has shown good to excellent internal consistency (α = 0.70 to 0.94), test-retest reliability, and sensitivity to change. The Spanish version has demonstrated excellent internal consistency and good concurrent validity (Echezarraga et al., 2018).

2.5.2. Treatment acceptability

2.5.2.1. Expectations and opinion of treatment

Expectations and opinion of treatment scales (Borkovec and Nau, 1972). Each scale contains 5 items rated from 0 (“nothing at all”) to 10 (“completely”). The expectation scale is applied after the treatment rationale has been explained. It aims to assess subjective patient expectations about this treatment. The opinion scale is administered after the patient has completed the treatment, and its objective is to evaluate the patient's satisfaction with this treatment. The items cover how logical the treatment is (“How logical do you think this treatment is?”), the degree of satisfaction with the treatment (“How satisfied are you with the treatment?”), whether the patient would recommend it to a person with similar problems (“To what extent do you feel confident recommending this treatment to a friend who has the same problems?”), how useful the treatment would be in treating other psychological problems (“To what extent do you think this treatment could be useful in treating other psychological problems?”), and how useful the treatment is for the patient (“To what extent do you think this treatment will be/was helpful to you?”).Our team has used this scale in a number of research studies (Botella et al., 2009, Botella et al., 2016; Campos et al., 2018; Mira et al., 2017).

2.5.2.2. Satisfaction with the group sessions

In order to evaluate the participant's satisfaction with each of the different face-to-face group sessions, an ad hoc questionnaire was developed with seven questions rated on a Likert scale. The questions, rated from 0 (not at all) to 10 (extremely), include the following: 1) How helpful do you think the contents of this session can be for your problems?; 2) How useful do you think the contents of this session can be for your psychological problems at other times in your life?; 3) How logical do the contents of this session seem to you?; 4) How difficult/boring do the contents of this session seem to you?; 5) How interesting/enjoyable do the contents of this session seem to you?; 6) How clear/understandable were the contents of this session to you?; and 7) What overall score would you give the session?

2.5.2.3. Usability of the program

The System Usability Scale (SUS) (Bangor et al., 2008; Brooke, 1996) is applied in order to assess the usability of a service or product and the acceptance of technology by the people who use it. The SUS is a simple, ten-item scale that indicates the degree of agreement or disagreement with the statements on a 5-point scale (1 = strongly disagree; 5 = strongly agree). The final score is obtained by adding the scores on each item and multiplying the result by 2.5. Scores range from 0 to 100, where higher scores indicate better usability.

2.5.3. Other outcome measures

2.5.3.1. Assessment of barriers and facilitators

A focus group method will be used in order to obtain a wider range of answers and greater detail about the participants' opinions of the treatment, the face-to-face sessions, and the online platform. This methodology involves the use of in-depth questions about a given topic in a dynamic group with the aim of providing abundant information about the perspectives, perceptions, opinions, feelings, and thoughts individuals have about a certain issue, in this case, a blended group transdiagnostic treatment (Krueger and Casey, 2000). For this purpose, with the participants' consent, we will record the focus group interviews on audiotapes, and we will conduct qualitative data analyses. Specifically, we will use the Consensual Qualitative Research (CQR) methodology to gather information within certain thematic areas and subsequent domains (Hill et al., 2005). CQR was developed by psychotherapy researchers, and there is a data analysis protocol with a clear explanation about how to analyze the raw data (McLeod, 2013).

2.5.3.2. Online platform usage measures

Participants' engagement and use of the online treatment platform will be assessed using several measures collected by the online system. These data will include information such as the total number of modules completed, the number of days spent in each module, the number of times each module was accessed (i.e., every time the user logs on to the platform), and the number of times each module was reviewed.

The study variables and assessment times are summarized in Table 2.

Table 2.

Study variables and assessment times.

Measure Area of assessment Time of assessment
Diagnostic interview
MINI Psychiatric diagnosis BL



Primary outcomes
OASIS Severity of anxiety BL, post-M, post-T and FU
ODSIS Severity of depression BL, post-M, post-T and FU



Secondary outcomes
PANAS Positive and negative affect BL, post-M, post-T, FU,
NEO-FFI Neuroticism and extraversion BL, post-T and FU
QLI Quality of life BL, post-T and FU
WSAS Work and social adjustment BL, post-T and FU
Expectations scale Expectations of treatment BL
Opinion scale Opinion of treatment Post-T
Satisfaction scale Satisfaction with group sessions Post-F2F group sessions
SUS Usability of the program Post-T
Platform usage indicators Number of modules completed, number of logins, number of times each module has been accessed/reviewed Throughout the study period

Note. MINI: MINI Neuropsychiatric Interview; BL: Baseline; OASIS: Overall Anxiety Severity and Impairment Scale; Post-M: Post-module; Post-T: Post-treatment; FU: Follow-up; ODSIS: Overall Depression Severity and Impairment Scale; PANAS: Positive and Negative Affect Schedule; NEO-FFI: NEO Five Factor Inventory; QLI: Quality of Life Inventory; WSAS: Work and Social Adjustment Scale; F2F: Face-to-face; SUS: System Usability Scale.

3. Ethics and dissemination

The trial has received ethical approval from the Ethics Committee of Universitat Jaume I (September 2019) and will be conducted in accordance with the study protocol, the Declaration of Helsinki, and good clinical practice. All participants will be volunteers, and they will sign a written, informed consent before their participation in the study. The security and confidentiality of the data will be guaranteed, i.e., all transferred data will be secured via AES-256 encryption (Advanced Encryption Standard). The web platform will be accessed through a unique username-password combination that will be available on a 24/7 basis. Only participants will have access to their password. In order to protect patients' privacy, sensitive information, i.e., personal data, will be replaced by codes and stored separately from clinical data (e.g. clinical outcomes). Only researchers directly involved in the current study will have access to these data. The results of this study will be disseminated by presentation at conferences and will be submitted for publication in a peer-reviewed journal.

4. Data analysis plan

Because the goal of this study is to analyze the feasibility of a blended transdiagnostic group intervention for ED, the analysis will be performed through descriptive statistics rather than formal hypothesis testing. To preliminary estimate the impact of the intervention, means, standard deviations, effect sizes and their corresponding confidence intervals will be calculated for both principal and secondary measures. The software SPSS version 26.0 will be used to conduct these analyses. Finally, qualitative data analyses will be conducted following the COnsolidated criteria for REporting Qualitative research (COREQ) (Tong et al., 2007).

5. Discussion

This study investigates the feasibility of a novel, blended (face-to-face and Internet-delivered therapy), group intervention for the regulation of emotional disorders. First, we aim to study the adequacy of the recruitment and data collection processes (e.g. whether inclusion and exclusion criteria should be adjusted; patients' willingness to participate in the trial). Second, another goal is to explore the reasons of patients that refuse to participate (e.g., the patient prefers an individual format). Relatedly, compliance with both the treatment and assessment protocols, retention and attrition rates, as well as reasons for drop out will be studied. Therefore, the psychometric data obtained in this trial will be helpful to define the assessment protocol in anticipation of a future RCT. Finally, both quantitative (i.e., expectations and opinion of treatment, usability of the treatment platform) and qualitative data (i.e., interviews about participants' opinions) will be collected and analyzed. In our own experience as clinical researchers, qualitative analysis procedures can provide critical data to improve the design and development of clinical trials (Fernández-Álvarez et al., 2017). On the other hand, this study seeks to preliminary estimate the impact of the intervention in a number of clinical measures at post-treatment and 3-month follow up. Taken together, these objectives will help to optimize the design of a future RCT. The present study seeks to contribute to solving some of the challenges in the mental health field, specifically to transform the healthcare system and policy responses in order to disseminate and implement evidence-based treatments (EBTs) around the world (Collins et al., 2011) and provide psychological support to all those in need (Kazdin, 2015). In line with this, the intervention described in this study combines the advantages of transdiagnostic treatments for emotional disorders (better management of comorbid presentations, higher cost-effectiveness, and dissemination) (Mansell et al., 2009; McEvoy et al., 2009; Sauer-Zavala et al., 2017) and Internet-delivered treatments (accessibility, versatility, and anonymity) (Andrews et al., 2010; Richards and Richardson, 2012; Spek et al., 2007).

Although Internet-delivered treatments are generally effective for depression and anxiety disorders, not all patients benefit from this treatment delivery format equally (e.g., patients who need more personal contact or those less likely to benefit from Internet-delivered treatments) (Fernández-Álvarez et al., 2017). Consequently, face-to-face therapy remains an important aspect of mental healthcare. Blended interventions have been developed to cover the research priority of delivering cost-effective interventions. It is not surprising, therefore, that combining these two approaches (i.e., face-to-face and Internet-delivered treatments) into one integrated treatment may be a way to take advantage of the best aspects of these two treatment modalities (Kooistra et al., 2014; Van der Vaart et al., 2014; Wentzel et al., 2016). Nevertheless, research on blended interventions has focused primarily on individual therapy, and less attention has been paid to the potential of using this format in group psychotherapy and, more specifically, in group transdiagnostic treatments, which have already shown their efficacy in several RCTs (Norton, 2012; Reinholt et al., 2017). Adding the group format intervention to a transdiagnostic treatment for emotional disorders and delivering it in a blended therapy format could contribute to some of the research priorities, such as the implementation of EBTs and the dissemination and sustainability of mental health promotion (Forsman et al., 2015; Wykes et al., 2015).

Despite the existence of effective evidence-based treatments, their transfer to routine practice is often quite scarce (Cunningham et al., 2010; Grimshaw et al., 2012). Specifically, the implementation of blended therapy combining face-to-face and Internet-delivered interventions is still limited. The use of blended therapy may depend on its clinical effectiveness, but also on its acceptance by patients undergoing the treatment. In this regard, knowledge about barriers and facilitators in the implementation of a blended therapy from the patients' perspective seems to be essential. A qualitative approach (focus group) will be followed to explore this aspect.

In summary, this feasibility study presents a user-centered blended group intervention for the treatment of emotional disorders. To the best of our knowledge, this is the first study to investigate the feasibility of a blended group transdiagnostic treatment in patients with emotional disorders.

We are aware that this study has limitations. On the one hand, the trial has no control group, and so no conclusions can be drawn about the clinical efficacy of the intervention. The selection of an adequate control group (e.g., advantages and disadvantages of different types of control group) will be carefully considered when planning the future RCT. However, the aim of this study is to gain insight into the implementation value of a transdiagnostic group blended treatment, rather than its clinical effectiveness. On the other hand, because face-to-face sessions take place once every 3 weeks, some patients' use of the online platform might be lower than expected. To mitigate this, we developed a support protocol that includes automatized emails and text messages (e.g., with reminders about the importance of doing the homework tasks, practicing the different strategies, and so on).

The results of this study will provide data on the acceptability and feasibility of a transdiagnostic blended treatment for patients with emotional disorders. Furthermore, it will facilitate knowledge acquisition and open up new forms of patient-to-patient or patient-to-therapist communication. This will provide valuable data about the way patients use the program modules, the frequency and duration with which they enter them, the opinion about each of them, and the adherence to the program. This study may help to consider the utility of feasibility studies in practice, with the aim of better understanding the way an intervention works and facilitating ongoing adaptation of the treatment and assessment design in preparation for a randomized controlled trial of a blended transdiagnostic group treatment for emotional disorders.

Ethics approval and consent to participate

The study follows the guidelines of the Declaration Helsinki and existing guidelines in Spain and the European Union for the protection of patients in clinical trials. All participants interested in participating signed an informed consent form. The study has been approved by the Ethics Committee of Universitat Jaume I (Castellón, Spain).

Consent for publication

“Not applicable” in this section.

Availability of data and material

It is not possible to share the data because the study is in progress. We are now at the stage of data recruitment.

Funding

Funding for the study was provided by grant: CIBER de Fisiopatología de la Obesidad y Nutrición-ISCIII CB06/03/0052. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

CRediT authorship contribution statement

AD-G drafted the manuscript. AD-G, in collaboration with AG-R, AG-P, and CB designed the study. IF-F, CT, and DC participated in each of its phases. AG-P and CB participated in the review and revision of the manuscript. All the authors have approved the final manuscript to be published.

Authors' information

AD-G holds a PhD in Clinical Psychology at Universitat Jaume I in the Department of Basic and Clinical Psychology, and Psychobiology, granted by Ministry of Economy and Competitiveness. AD-G is also PhD Assistant Professor at the Department of Psychology and Sociology (Universidad de Zaragoza) and member of LabPsiTec (Laboratory of Psychology and Technology) (www.labpsitec.com) at Universitat Jaume I. AG-R is PhD Assistant Professor at the Department of Psychology and Sociology (Universidad de Zaragoza) and IF-F and CT are PhD student in Clinical Psychology at LabPsiTec. DC holds a PhD in Clinical Psychology and she is PhD Assistant Professor at Universidad de Valencia, Spain, in the Department of Personality, Evaluation and Psychological Treatments, and she is member of LabPsiTec. AG-P is Full Professor of Clinical Psychology in the Department of Basic and Clinical Psychology, and Psychobiology. AG-P is also director of LabPsiTec. CB is professor emeritus at Universitat Jaume I in the Department of Basic and Clinical Psychology, and Psychobiology.

Declaration of competing interest

The authors declare that they have no competing interests.

Acknowledgements

This study was funded by the Institute of Health Carlos III (ISCiii) CIBERobn is an initiative of ISCIII (ISCIII CB06 03/0052), and Horizon 2020 ECoWeB project (754657-2. H2020-SC1-2016-2017).

Contributor Information

Amanda Díaz-García, Email: amandadiaz@unizar.es.

Alberto González-Robles, Email: gonzaleza@unizar.es.

Azucena García-Palacios, Email: azucena@uji.es.

Isabel Fernández-Felipe, Email: fernandi@uji.es.

Cintia Tur, Email: ctur@uji.es.

Diana Castilla, Email: diana.castilla@uv.es.

Cristina Botella, Email: botella@uji.es.

References

  1. Aluja A., García O., Rossier J. Comparison of the NEO-FFI, the NEOFFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. PersIndividDif. 2005;38(3):591–604. [Google Scholar]
  2. American Psychological Association. Psychotherapy: Understanding Group Therapy. 2013. Available from: http://www.apa.org/helpcenter/group-therapy.
  3. Andlin-Sobocki P., Wittchen H.U. Cost of anxiety disorders in Europe. Eur. J. Neurol. 2005;12(s1):39–44. doi: 10.1111/j.1468-1331.2005.01196.x. [DOI] [PubMed] [Google Scholar]
  4. Andrews G, Cuijpers P, Craske MG, et al. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One2010;5(10):e13196. doi: 10.1371/journal.pone.0013196. [DOI] [PMC free article] [PubMed]
  5. Andrews G, Basu A, Cuijpers P, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord2018;55:70–78. [DOI] [PubMed]
  6. Bangor A., Kortum P.T., Miller J.T. An empirical evaluation of the system usability scale. Intl. Hum-Comput Interact. 2008;24(6):574–594. [Google Scholar]
  7. Barkowski S., Schwartze D., Strauss B., Burlingame G.M., Barth J., Rosendahl J. Efficacy of group psychotherapy for social anxiety disorder: a meta-analysis of randomized-controlled trials. J Anxiety Disord. 2016;39:44–64. doi: 10.1016/j.janxdis.2016.02.005. [DOI] [PubMed] [Google Scholar]
  8. Barlow DH, Allen LB, Choate ML. Toward a unified treatment for emotional disorders. BehavTher2004;35:205–30. [DOI] [PubMed]
  9. Barlow D.H., Ellard K.K., Fairholme C.P. Oxford University Press; New York: 2011. The Unified Protocol for Transdiagnostic Treatment of Emotional Disorders: Client Workbook. [Google Scholar]
  10. Barlow D.H., Farchione T.J., Fairholme C.P. Oxford University Press; New York, NY, US: 2011. Treatments That Work. Unified Protocol for Transdiagnostic Treatment of Emotional Disorders: Therapist Guide. [Google Scholar]
  11. Bastien C.H., Morin C.M., Ouellet M.C. Cognitive-behavioral therapy for insomnia: comparison of individual therapy, group therapy, and telephone consultations. J Consult Clin Psych. 2004;72(4):653–659. doi: 10.1037/0022-006X.72.4.653. [DOI] [PubMed] [Google Scholar]
  12. Baxter A.J., Vos T., Scott K.M. The global burden of anxiety disorders in 2010. Psychol. Med. 2014;44(11):2363–2374. doi: 10.1017/S0033291713003243. [DOI] [PubMed] [Google Scholar]
  13. Bentley K.H., Gallagher M.W., Carl J.R. Development and validation of the overall depression severity and impairment scale. Psychol. Assess. 2014;26(3):815–830. doi: 10.1037/a0036216. [DOI] [PubMed] [Google Scholar]
  14. Borkovec T.D., Nau S.D. Credibility of analogue therapy rationales. J BehavTherExpPsychiatry. 1972;3(4):257–260. doi: 10.1016/0005-7916(72)90045-6. [DOI] [Google Scholar]
  15. Botella C., Gallego M.J., Garcia-Palacios A. The acceptability of an internet-based self-help treatment for fear of public speaking. Br J GuidCounc. 2009;37(3):297–311. doi: 10.1080/03069880902957023. [DOI] [Google Scholar]
  16. Botella C., Pérez-Ara M.A., Breton-Lopez J. In vivo versus augmented reality exposure in the treatment of small animal phobia: a randomized controlled trial. PLoS One. 2016;11(2) doi: 10.1371/journal.pone.0148237. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Bowen D.J., Kreuter M., Spring B. How we design feasibility studies. Am. J. Prev. Med. 2009;36(5):452–457. doi: 10.1016/j.amepre.2009.02.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Brooke J. SUS: a “quick and dirty'usability. Usability Evaluation in Industry, 189; 1996.
  19. Bullis J.R., Boettcher H., Sauer-Zavala S. What is an emotional disorder? A transdiagnostic mechanistic definition with implications for assessment, treatment, and prevention. Clin Psychol-Sci Pr. 2019;26(2) [Google Scholar]
  20. Campbell-Sills L., Norman S.B., Craske M.G. Validation of a brief measure of anxiety-related severity and impairment: the Overall Anxiety Severity and Impairment Scale (OASIS) J Affect Disorders. 2009;112(1–3):92–101. doi: 10.1016/j.jad.2008.03.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Campos D, Mira A, Bretón-López J, et al. The acceptability of an internet-based exposure treatment for flying phobia with and without therapist guidance: patients' expectations, satisfaction, treatment preferences, and usability. Neuropsych Dis Treat2018;14:879. [DOI] [PMC free article] [PubMed]
  22. Carl J.R., Gallagher M.W., Barlow D.H. Development and preliminary evaluation of a positive emotion regulation augmentation module for anxiety and depression. BehavTher. 2018;49(6):939–950. doi: 10.1016/j.beth.2017.11.008. [DOI] [PubMed] [Google Scholar]
  23. Carlbring P., Andersson G., Cuijpers P. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. CognBehav Therapy. 2018;47(1):1–18. doi: 10.1080/16506073.2017.1401115. [DOI] [PubMed] [Google Scholar]
  24. Collins P.Y., Patel V., Joestl S.S. Grand challenges in global mental health. Nature. 2011;475(7354):27–30. doi: 10.1038/475027a. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Costa P.T., McCrae R.R. Normal personality assessment in clinical practice: the NEO personality inventory. Psychol. Assess. 1992;4(1):5–13. [Google Scholar]
  26. Craig P., Dieppe P., Macintyre S. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337 doi: 10.1136/bmj.a1655. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Creswell J.W., Clark V.L.P. Designing and Conducting Mixed Methods Research. Sage publications. 2017 [Google Scholar]
  28. Cucciare M.A., Weingardt K.R., Villafranca S. Using blended learning to implement evidence-based psychotherapies. Clin Psychol-Sci Pr. 2008;15(4):299–307. doi: 10.1111/j.1468-2850.2008.00141.x. [DOI] [Google Scholar]
  29. Cuijpers P., Beekman A.T.F., Reynolds C.F. Preventing depression. JAMA. 2012;307(10):1033–1344. doi: 10.1001/jama.2012.271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Cunningham J.T., Khadjesari Z., Bewick B.M., Riper H. Internet-based interventions for problem drinkers: from efficacy trials to implementation. Drug Alcohol Rev. 2010;29(6):617–622. doi: 10.1111/j.1465-3362.2010.00201.x. [DOI] [PubMed] [Google Scholar]
  31. Díaz-García A, González-Robles A, Fernández-Álvarez J, et al. Efficacy of a transdiagnostic internet-based treatment for emotional disorders with a specific component to address positive affect: study protocol for a randomized controlled trial. BMC Psychiatry2017;17:145. [DOI] [PMC free article] [PubMed]
  32. Díaz-Garcia A., González-Robles A., Mor S. Positive and negative affect schedule (PANAS): psychometric properties of the online Spanish version in a clinical simple with emotional disorders. BMC Psychiatry. 2020;20(1):56. doi: 10.1186/s12888-020-2472-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. DSM-5 American Psychological Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington: American Psychiatric Association; 2013.
  34. Echezarraga A., Calvete E., Las Hayas C. Validation of the Spanish version of the work and social adjustment scale in a sample of individuals with bipolar disorder. J PsychosocNurs Men. 2018;57(5):44–51. doi: 10.3928/02793695-20181128-02. [DOI] [PubMed] [Google Scholar]
  35. Eldridge S., Bond C., Campbell Definition and reporting of pilot and feasibility studies. Trials. 2013;14(1):1. [Google Scholar]
  36. Eldridge S.M., Chan C.L., Campbell M.J. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ. 2016;355:i5239. doi: 10.1136/bmj.i5239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Erbe D, Psych D, Eichert HC, et al. Blending face-to-face and internet-based interventions for the treatment of mental disorders in adults: systematic review. J Med Internet Res2017;19(9):1–14. 10.2196/jmir.6588. [DOI] [PMC free article] [PubMed]
  38. Fernández-Álvarez J, Díaz-García A, González-Robles A, et al. Dropping out of a transdiagnostic online intervention: a qualitative analysis of client's experiences. Internet Interv2017;10:29–38. [DOI] [PMC free article] [PubMed]
  39. Ferrando L, Bobes J, Gibert J, et al. Mini international neuropsychiatric interview. In: Bobes J, Bousoño M, González MP, editors. Manejo De Los Trastornos Mentales Y Del Comportamiento En Atención Primaria. Oviedo: Gofer; 1997. p. 9.
  40. Ferrari A.J., Charlson F.J., Norman R.E. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med. 2013;10(11) doi: 10.1371/journal.pmed.1001547. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Forsman A.K., Wahlbeck K., Aarø L.E., Alonso J., Barry M.M., Brunn M., Valimaki M. Research priorities for public mental health in Europe: recommendations of the ROAMER project. Eur. J. Pub. Health. 2015;25(2):249–254. doi: 10.1093/eurpub/cku232. [DOI] [PubMed] [Google Scholar]
  42. García-Escalera J., Chorot P., Valiente R.M., Reales J.M., Sandín B. Efficacy of transdiagnostic cognitive-behavioral therapy for anxiety and depression in adults, children and adolescents: A meta-analysis. Revista de Psicopatología y Psicología Clínica. 2016;21(3):147–175. [Google Scholar]
  43. González-Robles A., Díaz-García A., Miguel C. Comorbidity and diagnosis distribution in transdiagnostic treatments for emotional disorders: a systematic review of randomized controlled trials. PloSOne. 2018;13(11) doi: 10.1371/journal.pone.0207396. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. González-Robles A., Mira A., Miguel C. A brief online transdiagnostic measure: psychometric properties of the Overall Anxiety Severity and Impairment Scale (OASIS) among Spanish patients with emotional disorders. PLoSOne. 2018;13(11) doi: 10.1371/journal.pone.0206516. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. González-Robles A., García-Palacios A., Baños R.M. Upregulating positive affectivity in the transdiagnostic treatment of emotional disorders: a randomized pilot study. Behavmodif. 2019;43(1):26–55. doi: 10.1177/0145445517735631. [DOI] [PubMed] [Google Scholar]
  46. González-Robles A., Díaz-García A., García-Palacios A., Roca P., Ramos-Quiroga J.A., Botella C. Effectiveness of a Transdiagnostic Guided Internet-Delivered Protocol for Emotional Disorders Versus Treatment as Usual in Specialized Care: Randomized Controlled Trial. J. Med. Internet Res. 2020;22(7):e18220. doi: 10.2196/18220. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(1). 10.1186/1748-5908-7-50. [DOI] [PMC free article] [PubMed]
  48. Hill C.E., Knox S., Thompson B.J. Consensual qualitative research: an update. J. Couns. Psychol. 2005;52(2):196. [Google Scholar]
  49. Huber M., André Knottnerus J., Green L. How should we define health? Br. Med. J. 2011;343(7817):1–3. doi: 10.1136/bmj.d4163. [DOI] [PubMed] [Google Scholar]
  50. Jónsson H, Hougaard E, Bennedsen BE. Randomized comparative study of group versus individual cognitive behavioural therapy for obsessive compulsive disorder. ActaPsychiatScand 2011;123(5):387–397. [DOI] [PubMed]
  51. Kazdin AE. Treatment as usual and routine care in research and clinical practice. Clin Psychol Rev2015;42:168–178. [DOI] [PubMed]
  52. Kessler R.C., Berglund P., Demler O. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch. Gen. Psychiatry. 2005;62(6):593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
  53. Kleiboer A, Smit J, Bosmans J, et al. European Comparative Effectiveness research on blended Depression treatment versus treatment-as-usual (E-COMPARED): study protocol for a randomized controlled, non-inferiority trial in eight European countries. Trials2016;17(1):387. [DOI] [PMC free article] [PubMed]
  54. Kohn R., Saxena S., Levav I. The treatment gap in mental health care. Bull. World Health Organ. 2004;82(11):858–866. [PMC free article] [PubMed] [Google Scholar]
  55. Kooistra L.C., Wiersma J.E., Ruwaard J. Blended vs. face-to-face cognitive behavioural treatment for major depression in specialized mental health care: study protocol of a randomized controlled cost-effectiveness trial. BMC Psychiatry. 2014;14(1):1–11. doi: 10.1186/s12888-014-0290-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Kroenke K, Spitzer RL, Williams JBW, et al. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med 2007;6;146(5):317–25. [DOI] [PubMed]
  57. Krueger R.A., Casey M.A. Sage; CA: 2000. Focus Groups: A Practical Guide for Applied Research. [Google Scholar]
  58. Lecrubier Y., Sheehan D., Weiller E. The MINI International Neuropsychiatric interview (MINI). A short diagnostic structured interview: reliability and validity according to the CIDI. Eur Psychiatry. 1997;12(5):224–231. [Google Scholar]
  59. Lilienfeld SO, Ritschel LA, Lynn SJ, et al. The research-practice gap: bridging the schism between eating disorder researchers and practitioners. Vol. 46, Int JEatDisord 2013. p. 386–94. [DOI] [PubMed]
  60. Linehan M. Guilford Press; New York: 1993. Cognitive-behavioral Treatment of Borderline Personality Disorder. [Google Scholar]
  61. Mansell W., Harvey A., Watkins E.R. Cognitive behavioral processes across psychological disorders: a review of the utility and validity of the transdiagnostic approach. Int J CognTher. 2008;1(3):181–191. [Google Scholar]
  62. Mansell W, Harvey A, Watkins E, et al. Conceptual foundations of the transdiagnostic approach to CBT.J CognPsychother 2009;23(1):6–19.
  63. Mcevoy PM, Nathan P, Norton PJ. Efficacy of Transdiagnostic treatments: a review of published outcome studies and future research directions. J CognPsychother2009;23(1):20–33.
  64. McHugh R.K., Barlow D.H. The dissemination and implementation of evidence-based psychological treatments: a review of current efforts. Am Psychol. 2010;65(2):73–84. doi: 10.1037/a0018121. [DOI] [PubMed] [Google Scholar]
  65. McLeod J. Qualitative research: methods and contributions In Lambert MJ, editor.(Ed.), Bergin and Garfield's Handbook of Psychotherapy and Behavior Change, 6th edn (pp. 49–84). Hoboken. 2013.
  66. McManus F., Shafran R., Cooper Z. What does a transdiagnostic approach have to offer the treatment of anxiety disorders? Br J Clin Psychol. 2010;49(4):491–505. doi: 10.1348/014466509X476567. [DOI] [PubMed] [Google Scholar]
  67. Mezzich JE, Cohen NL, et al. A Quality of Life Index: Brief Description and Validation. Paper Presented at: International Congress of the International Federation for Psychiatric Epidemiology; 1986; Santiago de Compostela, Spain.
  68. Mezzich J.E., Ruipérez M.A., Pérez C. The Spanish version of the quality of life index: presentation and validation. J NervMentDis. 2000;188(5):301–305. doi: 10.1097/00005053-200005000-00008. [DOI] [PubMed] [Google Scholar]
  69. Mira A, Bretón-López J, García-Palacios A, et al. An internet-based program for depressive symptoms using human and automated support: a randomized controlled trial. NeuropsychiatrDisTreat2017;13:987–1006. [DOI] [PMC free article] [PubMed]
  70. Mira A., González-Robles A., Molinari G. Capturing the severity and impairment associated with depression: the Overall Depression Severity and Impairment Scale (ODSIS) validation in a Spanish clinical sample. Front Psychiatry. 2019;10 doi: 10.3389/fpsyt.2019.00180. [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Mundt JC, Marks IM, Shear MK, et al. The Work and Social Adjustment Scale: a simple measure of impairment in functioning. Br J Psychiatry2002;180:461–4. [DOI] [PubMed]
  72. Nathan P.E., Gorman J.M. Oxford University Press; New York: 2015. A Guide to Treatments That Work. [Google Scholar]
  73. Depression in adults: recognition and management [Internet]. National Institute for Health and Care Excellence; 2009. Clinical Guideline 90; 2018. Avaiable from: http:// guidance. nice. org. uk/ cg123. [PubMed]
  74. Newby JM, McKinnon A, Kuyken W, et al. Systematic review and meta-analysis of transdiagnostic psychological treatments for anxiety and depressive disorders in adulthood. Clin Psychol Rev2015;40:91–110. [DOI] [PubMed]
  75. Newby JM, Twomey C, Yuan Li SS, et al. Transdiagnosticcomputerised cognitive behavioural therapy for depression and anxiety: a systematic review and meta-analysis. J Affect Disord2016;199:30–41. [DOI] [PubMed]
  76. Norton P.J. Transdiagnostic group CBT for anxiety disorder: efficacy, acceptability, and beyond. Rev Psicopatol y PsicolClin. 2012;17(3):205–217. [Google Scholar]
  77. O’cathain A., Murphy E., Nicholl J. The quality of mixed methods studies in health services research. J HealthServ Res Pol. 2008;13(2):92–98. doi: 10.1258/jhsrp.2007.007074. [DOI] [PubMed] [Google Scholar]
  78. Osma J, Suso-Ribera C, García-Palacios A, et al. Efficacy of the unified protocol for the treatment of emotional disorders in the Spanish public mental health system using a group format: study protocol for a multicenter, randomized, non-inferiority controlled trial. Health Qual. Life Outcomes 2019;16(1). [DOI] [PMC free article] [PubMed]
  79. Reinholt N., Krogh J. Efficacy of transdiagnostic cognitive behaviour therapy for anxiety disorders: a systematic review and meta-analysis of published outcome studies. CognBehavTher. 2014;43(3):171–184. doi: 10.1080/16506073.2014.897367. [DOI] [PubMed] [Google Scholar]
  80. Reinholt N., Aharoni R., Winding C. Transdiagnostic group CBT for anxiety disorders: the unified protocol in mental health services. CognBehavTher. 2017 Jan 2;46(1):29–43. doi: 10.1080/16506073.2016.1227360. [DOI] [PubMed] [Google Scholar]
  81. Richards D. Prevalence and clinical course of depression: a review. Vol. 31, Clin Psychol Rev 2011. p. 1117–25. [DOI] [PubMed]
  82. Richards D., Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin. Psychol. Rev. 2012;32(4):329–342. doi: 10.1016/j.cpr.2012.02.004. [DOI] [PubMed] [Google Scholar]
  83. Robins R.W., Fraley R.C., Roberts B.W. A longitudinal study of personality changein young adulthood. J. Pers. 2001;69(4):617–640. doi: 10.1111/1467-6494.694157. [DOI] [PubMed] [Google Scholar]
  84. Sandín B., Chorot P., Lostao L. Escalas PANAS de afecto positivo y negativo: validacion factorial y convergencia transcultural. Psicothema. 1999;11(1):37–51. [Google Scholar]
  85. Sauer-Zavala S, Gutner CA, Farchione TJ, et al. Current definitions of “transdiagnostic” in treatment development: a search for consensus. Vol. 48, Behavior Therapy. Elsevier Inc.; 2017. p. 128–38. [DOI] [PubMed]
  86. Schuster R, Fichtenbauer I, Sparr VM, et al. Feasibility of a blended group treatment (bGT) for major depression: uncontrolled interventional study in a university setting. BMJ Open2018 Mar 1;8(3). [DOI] [PMC free article] [PubMed]
  87. Sepúlveda MJ, Lu C, Sill S, et al. An observational study of an employer intervention for children's healthy weight behaviors. Pediatrics 2010;126(5). [DOI] [PubMed]
  88. Sheehan D.V., Lecrubier Y., Sheehan K.H. The Mini-International Neuropsychiatric interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(20):22–33. [PubMed] [Google Scholar]
  89. Spek V, Cuijpers P, NykIíček I, et al. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Vol. 37, Psychological Medicine. 2007. p. 319–28. [DOI] [PubMed]
  90. Steel Z, Marnane C, Iranpour C, et al. The global prevalence of common mental disorders: a systematic review and meta-analysis 1980-2013. Int J Epidemiol2014;43(2):476–93. [DOI] [PMC free article] [PubMed]
  91. Taylor C.T., Lyubomirsky S., Stein M.B. Upregulating the positive affect system in anxiety and depression: outcomes of a positive activity intervention. Depress Anxiety. 2017;34(3):267–280. doi: 10.1002/da.22593. [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. Titov N., Andrews G., Johnston L. Transdiagnostic internet treatment for anxiety disorders: a randomized controlled trial. Behav. Res. Ther. 2010 Sep;48(9):890–899. doi: 10.1016/j.brat.2010.05.014. [DOI] [PubMed] [Google Scholar]
  93. Titov N, Dear BF, Schwencke G, et al. Transdiagnostic internet treatment for anxiety and depression: a randomised controlled trial. Behav Res Ther2011;49(8):441–52. [DOI] [PubMed]
  94. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Heal Care2007;19(6):349–57. [DOI] [PubMed]
  95. Van der Vaart R., Witting M., Riper H. Blending online therapy into regular face-to-face therapy for depression: content, ratio and preconditions according to patients and therapists using a Delphi study. BMC Psychiatry. 2014;14:355. doi: 10.1186/s12888-014-0355-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer MC, et al. Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. 2007;8;370(9590):841–50. [DOI] [PMC free article] [PubMed]
  97. Watson D., Clark L.A., Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 1988;54(6):1063–1070. doi: 10.1037//0022-3514.54.6.1063. [DOI] [PubMed] [Google Scholar]
  98. Wentzel J, van der Vaart R, Bohlmeijer ET, et al. Mixing online and face-to-face therapy: how to benefit from blended care in mental health care. JMIR Ment Heal 2016;3(1). [DOI] [PMC free article] [PubMed]
  99. Wykes T, Haro JM, Belli SR, Obradors-Tarragó C, Arango C, Ayuso-Mateos JL, et al. Mental health research priorities for Europe. Vol. 2, The Lancet Psychiatry. Elsevier Ltd; 2015. p. 1036–42. [DOI] [PubMed]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

It is not possible to share the data because the study is in progress. We are now at the stage of data recruitment.


Articles from Internet Interventions are provided here courtesy of Elsevier

RESOURCES