Abstract
Introduction
Emotional disorders (EDs) have become the most prevalent psychological disorders in the general population, which has boosted the economic burden associated with their management. Approximately half of the individuals do not receive adequate treatment. Consequently, finding solutions to deliver cost-effective treatments for EDs has become a key goal of today’s clinical psychology. Blended treatments, a combination of face-to-face and online interventions, have emerged as a potential solution to the previous. The Unified Protocol for the Transdiagnostic Treatment of EDs (UP) might serve this purpose, as it can be applied to a variety of disorders simultaneously and its manualised format makes it suitable for blended interventions.
Methods and analysis
The study is a multicentre, randomised, superiority, clinical trial. Participants will be 310 individuals with a diagnosis of an ED. They will be randomised to a treatment as usual (individual cognitive behavioural therapy) or a UP condition in a blended format (face-to-face individual UP +online, app-based UP). Primary outcomes will be ED diagnostic criteria and depression and anxiety symptoms. Cost efficiency of the intervention, app usability, as well as opinion and confidence in the treatment will also be evaluated. Assessment points will include baseline and 3 months, 6 months and 12 months after UP treatment.
Ethics and dissemination
The study has received approvals by the Ethics Research Committee of Navarra, Castellón, Euskadi, Castilla y León, Extremadura, Lleida and Aragón. The study is currently under an approval process by the Ethics Research Committees of all the remaining collaborating centres. Outcomes will be disseminated through publication in peer-reviewed journals and presentations at international conference meetings.
Trial registration number
Keywords: anxiety disorders, depression & mood disorders, public health, mental health
Strengths and limitations of this study.
This study is the first randomised controlled trial to test the efficacy, implementation and cost effectiveness of a transdiagnostic intervention in a blended format for the treatment of emotional disorders (EDs) in public settings in Spain.
The blended Unified Protocol for the Transdiagnostic Treatment of EDs (UP) may allow clinicians to use the same treatment for the most prevalent psychological disorders, that is, EDs.
The blended UP can enable clinicians to use technology to motivate, monitor, give support and provide treatment to patients without losing the benefits of individual face-to-face treatments.
A UP-based treatment programme in a blended format might help reduce dropouts and waiting lists because it allows clients to take advantage of the time between sessions, which might help them progress and engage with their treatments and, therefore, improve earlier and be discharged sooner.
One limitation could be that some people may be resistant to participate in the blended condition because they perceive it as more impersonal and less effective.
Introduction
Emotional disorders (EDs; ie, anxiety disorders, unipolar mood disorders and related disorders)1 are the most prevalent mental disorders in the general population.2 In Spain, anxiety disorders and mood disorders affect approximately two million (4.1%) and two and half million (5.2%) individuals, respectively.3 These disorders have a direct cost of €22 000 million (€500 per capita and year) and the total expense of these disorders entails 2.2% of the gross domestic product in Spain.4 Due to the excessive demand for treatment, mental health services of our National Health System (NHS) are overwhelmed with large waiting lists, which results in a great difficulty to dedicate the recommended time to attend patients who require psychological treatment.4 5 Therefore, there is an urgent need to find cost-effective solutions for the treatment of EDs in our NHS.
The Unified Protocol (UP)6 7 is a structured, manualised transdiagnostic intervention for the treatment of EDs based on cognitive behavioural therapy (CBT). The UP aims to treat emotion regulation deficits, which are argued to be the underlying common factor in all EDs.8 By focusing on these common mechanisms, the UP offers numerous advantages. For example, it allows the simultaneous treatment of people with different EDs and comorbid presentations with a single protocol9 and reduces the costs associated with training mental health professionals.10 To date, three systematic reviews, which include two meta-analyses, have been conducted to summarise the efficacy of the UP. Overall, these studies reveal that the UP significantly improves anxious and depressive symptoms with moderate to large effect sizes. Additionally, the improvements appear to be maintained over time (up to 3 months and 6 months of follow-up).11–13 In Spain, a previous clinical trial conducted in the NHS showed that the UP in a group format, compared with treatment as usual (TAU), achieved significantly larger improvements in anxious and depressive symptoms, as well as in quality of life at 6-month follow-up.14
The preferred intervention format by patients with EDs attending the Spanish NHS is individual, face-to-face treatment (85.4%), followed by group (14.2%) and online interventions (0.4%).15 These results justify that blended treatments, which use online treatments but maintain some form of individual, face-to-face intervention, could be a potential solution to the availability problems of treatments for EDs in our Spanish NHS. The advantage of blended treatments is that they are dynamic and flexible and they allow using technology to motivate, monitor, give support and treat patients. Importantly, this is done without losing face-to-face treatment sessions.16 17 Research has shown that blended interventions are more effective than face-to-face treatments in the reduction of depression and anxiety symptoms.18 For example, one study found that a blended smartphone treatment, which consisted of four face-to-face sessions and a smartphone app to be used between the sessions, can be as effective as a full behavioural activation treatment in the reduction of major depression. Moreover, comparable scores were also obtained between the two conditions for treatment credibility and working alliance, and therapist time was reduced by an average of 47% in the blended condition.19 Finally, a recent meta-analysis has also revealed optimistic results regarding the power of blended interventions, given that they allow saving time to the clinicians, in addition to decreasing dropouts and enhancing the maintenance of the benefits obtained with treatment over time.20
The present study will compare the efficacy and cost efficiency of the UP in a blended format against traditional, individual, unstructured CBT in a sample of patients with EDs. All the participants will seek treatment at the Spanish NHS. To ensure the generalisability of the results, our outcomes will be evaluated in several public mental health centres in Spain.
Methods and analysis
Study protocol
The current study is a superiority, multicentre, randomised controlled trial (RCT) with two active conditions: the UP in a blended format (individual UP face to face and UP-APP for smartphone) and non-structured CBT in an individual format (TAU). The study is planned to start in January 2022 and end in December 2024.
The expected superiority comes from the fact that the participants in the blended condition will receive additional treatment compared with the TAU condition, which should enhance the benefits of the TAU. In the present investigation, all consecutive patients with EDs attending any of the collaborating centres (see the Sample and recruitment section) will be asked to participate. It is important to note that this is a feasibility study in which the context and usual procedures of ED management will be kept as naturalistic as possible for implementation purposes. This means that there are some study characteristics that should be bared in mind. For example, some variables will not be predetermined and will only be known at the end of the investigation. This includes, for example, the frequency of the psychological appointments in both conditions (which will vary depending on the patient’s evolution and clinician appraisals) or the time spent in the UP-APP by participants in the blended condition (ie, amount of progress in the treatment modules and exercises). These variables, which might influence on outcomes, will of course be considered in the statistical analysis when the information is available (at the end of the study).
The study was registered on clinicaltrials.gov. The flow chart of the study design is shown in figure 1. A schedule of the enrolment, interventions and assessments is reported following the Standard Protocol Items: Recommendations for Interventional Trials guidelines (table 1).
Figure 1.

Study flow chart. TAU, treatment as usual; UP, the Unified Protocol for the Transdiagnostic Treatment of Emotional Disorders.
Table 1.
Study schedule of enrolment, interventions and assessments
| Study period | |||||||
| Enrolment | Preallocation | Allocation | Intervention | Postallocation | |||
| Time point | - t1 |
t0
Baselin e |
t1 | t2 | t3 3 months after the intervention |
t4 6 months after the intervention |
t5 12 months after the intervention |
| Enrolment | |||||||
| Eligibility screen | X | ||||||
| MINI | X | X | X | X | |||
| Informed consent | X | ||||||
| Allocation | X | ||||||
| ODSIS | X | X | X | X | X | ||
| OASIS | X | X | X | X | X | ||
| Interventions | |||||||
| TAU |
![]() |
||||||
| UP in a blended format |
|
||||||
| OTHER ASSESSMENTS: | |||||||
| Demographics | X | ||||||
| MEDI | X | X | X | X | |||
| EuroQol-5D | X | X | X | X | |||
| FFMQ | X | X | X | X | |||
| BEAQ | X | X | X | X | |||
| DERS | X | X | X | X | |||
| ERQ | X | X | X | X | |||
| SUS | X | X | X | ||||
| CEQ | X | X | X | ||||
| CSRI | X | X | X | ||||
| TOS | X | X | X | ||||
| WAI-S | X | ||||||
| QALYs | X | X | X | X | |||
BEAQ, Brief Experiential Avoidance Questionnaire; CEQ, Credibility/Expectancy Questionnaire; CSRI, Client Service Receipt Inventory; DERS, Difficulties in Emotion Regulation Scale; ERQ, Emotion Regulation Questionnaire; FFMQ, Five Factor Mindfulness Questionnaire; MEDI, Multidimensional Emotional Disorder Inventory; MINI, Mini International Neuropsychiatric Interview; OASIS, Overall Anxiety Severity and Impairment Scale; ODSIS, Overall Depression Severity and Impairment Scale; QALYs, quality-adjusted life years; SUS, System Usability Scale; TAU, treatment as usual; TOS, Treatment Opinion Scale; UP, Unified Protocol for Transdiagnostic Treatment of Emotional Disorders; WAI-S, Working Alliance Inventory-Short.
Sample size
To calculate the required sample size, we used the G*Power software.21 We obtained a sample size of 129 participants per condition with a 95% power, an α of 0.01 and a conservative effect size of 0.30. Considering a dropout rate of 15% and 5% of candidates who will not meet inclusion criteria, we will recruit at least 155 participants per condition (N=310). The expected effect size and dropout rates come from studies showing that blended interventions lead to lower dropout rates20 and better outcomes in patients with anxiety and adjustment disorder18 when compared with face-to-face interventions.
Procedure
UP-APP design (patient and public involvement)
Prior to the design of the UP-APP, our team will conduct two different focus groups, one with patients who already received the UP for their EDs diagnosis and other with therapists trained in the UP intervention. Information about structure, content, format, design, exercises, language, duration, evaluation, feedback, security, adherence, usability and customisation will be collected in the focus groups. Besides, their opinion about the use of apps and technological devices in clinical psychology and advantages and disadvantages of face-to-face therapy and app-based therapy will be also collected. Some researchers of the study and the engineer’s team will participate in these focus groups as observers. The focus groups will be recorded on video to be transcribed by two researchers of the study. The qualitative analysis of the data collected will be used to design the UP-APP for smartphone. This analysis will consist of generating a system of codes, grouping the information provided by the participants in the focus groups that referred to the same ideas or highlighting the main ideas.
Sample and recruitment
Participants are individuals over 18 years old, seeking psychological assistance in the Spanish Public Health System. Patients are referred to the study by licensed psychologists, psychiatrists and clinical psychology residents working at the collaborating centres. Mental health professionals (therapists and psychiatrists from the units to which patients are referred to and who want to collaborate in the study) will be responsible for assessing the current Diagnostic and Statistical Manual (DSM) diagnoses (see the Measures section) and the remaining eligibility criteria (see the Eligibility criteria section). Individuals with comorbid diagnosis of several EDs are also enrolled in the study.
Recruitment is expected to start in January 2022. The study will be conducted in 15 different mental health centres of the Spanish NHS, namely, USM Sagasta (Zaragoza), H. Comarcal de Vinaròs (Castellón), Centro San Francisco Javier (Navarra), USM La Milagrosa (Pamplona), Hospital Universitario Reina Sofía de Córdoba, CSM Eguia-Donostia, H. U. de Alicante, CSM del Segrià en Lleida, USM La Fuente de San Luís (Valencia), USM Montoro de Córdoba, H. U. Río Hortega (Valladolid), CSM Mérida, CSM Zafra, USM Fraga, and USM Tarazona.
Eligibility criteria
Inclusion and exclusion criteria are listed in table 2.
Table 2.
Eligibility criteria
| Inclusion criteria | |
| 1 | Principal diagnosis of an emotional disorder* |
| 2 | The patient is over 18 years of age |
| 3 | The patient is fluent in the language in which the therapy is performed (Spanish in the present study) |
| 4 | The patient has a smartphone (regardless of the condition, to ensure that the TAU condition does not include more patients that do not have access to a smartphone) |
| 5 | Patients taking pharmacological treatment for their ED will be asked to maintain the same dosages and medications for at least 3 months prior to enrolling in the study and during the whole treatment† |
| 6 | The patient signs the informed consent form (online supplemental file) |
| Exclusion criteria | |
| 1 | The patient presents a severe condition that would require them to be prioritised for treatment. This includes a severe mental disorder (bipolar disorder, personality disorder, schizophrenia or organic mental disorder), suicide risk at the time of assessment or substance use in the last 3 months |
| 2 | The patient has previously received 8 or more sessions of psychological treatment with clear and identifiable CBT principles within the past 5 years |
*The following disorders will be included based on diagnostic and statistical manual 5th ed. (DSM-5)2 diagnostic criteria: major depression disorder, dysthymic disorder, panic disorder, agoraphobia, obsessive-compulsive disorder, generalised anxiety disorder, posttraumatic stress disorder, social anxiety disorder, hypochondria and adjustment disorders.
†If medication stability is not possible, the participant’s data will be treated separately in the analyses.
CBT, cognitive behavioral therapy; TAU, treatment as usual.
bmjopen-2021-054286supp001.pdf (111.7KB, pdf)
Patients with unspecified anxiety disorders and unspecified depressive disorders will also be included as they are frequent in public settings.
Randomisation
All consecutive patients with a diagnosis of an ED attending any of the collaborating centres will be asked to participate in the present study. Once the inclusion criteria are met, every patient will be randomly assigned to one of the two experimental conditions: TAU or UP in a blended format. Patients who refuse to participate in the study will receive the TAU outside the RCT. The number of people refusing to participate and the reasons for that decision will be recorded and reported due its interest for future studies. Randomisation will be performed by a researcher unrelated to the study using a computer-generated sequence (Randomizer). Randomisation will be stratified according to the severity of the primary measures of depression and anxiety, using the cut-off reported in Spanish clinical samples of ED, which has been 10 (0–20) in both scales.22 This cut-off differentiates patients with moderate–severe symptoms from those with moderate–low symptoms.
Stratification will be made to ensure a comparable proportion of severely depressed and anxious individuals in each group. For each subgroup (ie, severe or less severe depression and/or anxiety), participants will be randomly assigned to the UP in a blended format or to the TAU.
Therapists and interventions
Participants in both conditions will receive the individual therapy in a face-to-face format. Individuals with an ED also frequently receive pharmacological treatment (ie, antidepressants and/or anxiolytics) as treatment of choice in the Spanish NHS. The frequency of the appointment sessions with their clinicians will depend on the characteristics of their centres (eg, existing waiting lists and availability of the clinicians). In addition to these individual face-to-face appointments, participants randomised to the blended condition will be able to use the UP-APP at any time and at whatever pace during the whole duration of the study. Clinicians will recommend participants in the blended condition to work on modules 1, 2, 5, 6 and 8 during at least 1 week, and modules 3, 4 and 7 during at least 2 weeks (see the Unified Protocol in a blended format section for a detail on the titles of the UP modules).
The relatively naturalistic nature of this study prevents us from defining, prior to the intervention, the exact number of sessions and the time spent in each psychological intervention (TAU vs UP blended). This also applies to the time spent by the participants in the UP-blended condition with the UP-APP. All these variables will be recorded by the UP-APP and the clinicians attending the participants for their inclusion in the statistical analyses.
Previous to start the RCT, we will conduct an open pilot study to analyse the preliminary data of the clinical utility and feasibility of the UP-APP in a small sample of patients with EDs diagnosis. Specifically, after the clinical assessment, from those who met the inclusion and exclusion criteria, we will invite 10 patients (in order of date of receipt) to participate voluntarily in this pilot study. Participants will sign the informed consent and data protection. Then, they will be randomised to one baseline condition: 1 week, 2 weeks and 3 weeks in order of date of receipt (baseline measures will be Overall Depression Severity and Impairment Scale (ODSIS) and Overall Anxiety Severity and Impairment Scale (OASIS)22). Then patients will receive a face-to-face psychological treatment in a blended format and will receive the instructions to download the UP-APP in their smartphone. They will be asked to complete a special set of questions to assess the comprehension, appearance, utility, interest, if they would recommend it to other people, usability, intention to use in the future and satisfaction of the content of each module of the UP-APP (ad hoc).
For ethical reasons, if a patient feels uncomfortable with the blended format at any time during the study, they will receive the TAU outside the RCT.
Therapists participating in the study will include licensed psychologists with 8–20 years of experience in delivering CBT.
Unified Protocol in a blended format
For face-to-face interventions, the clinicians in this condition will follow the second edition of the UP therapist manual translated by Osma and Crespo into Spanish.23 24
As described in detail previously,25 therapists in the UP group received a training workshop on UP prior to the start of the intervention. This consisted of two or three group workshop sessions in which the therapists were instructed on the delivery of the different UP treatment modules. The duration of the course was between 10 hours and 20 hours, depending on the availability of the therapists at the centre. In addition to the workshop, all therapists received individual training during 12 therapy sessions through online supervision or participating as a co-therapist with an expert. In both cases, the training was led by the lead author (JO), who has been certified as a UP trainer by the Unified Protocol Institute.
Between sessions, all participants in this condition will have access to the UP-APP. The APP includes the content of the patient’s manual, but using more dynamic and attractive digital material (videos and audios). The UP includes eight modules: (1) setting goals and maintaining motivation; (2) understanding your emotions; (3) mindful emotion awareness; (4) cognitive flexibility; (5) countering emotional behaviours; (6) facing physical sensations; (7) emotion exposures and (8) moving UP from here.
In the UP-APP, after completing each module, an assessment of the knowledge acquired will be carried out using true/false questions. The APP will collect the correct/incorrect responses and will provide feedback to the participants. Thus, participants will receive positive reinforcement as they progress through the modules and get correct answers to keep them engaged and motivated in the use of the APP. In addition, participants will have to complete different exercises throughout the modules, such as records or activities to identify emotion-driven behaviours. They will also be provided with examples of real patients with whom they can identify and which will help them to complete their records. Finally, a weekly assessment will be made to evaluate the evolution of the depression and the anxiety symptoms (ODSIS and OASIS).22 The scores over time will be shown to the participants with a graphic display. This weekly evaluation with the APP will also include the participants’ degree of motivation to continue working on the intervention.
Treatment as usual
This treatment condition will include individual, non-structured CBT using the following techniques: psychoeducation, cognitive restructuring, relaxation techniques, mindfulness techniques, exposure techniques, activity scheduling, problem solving and training in communication techniques. This is the treatment of choice by the psychologists at the collaborating Public Mental Health Centres.
Measures
The evaluation protocol is administered by the therapists in a paper and pencil format at the participant’s health centre or, when possible, through the internet using the Qualtrics platform. The assessments will occur in four different time points: baseline, 3 months after starting the intervention (t3), 6 months after starting the intervention (t4) and 12 months after starting the intervention (t5). Assessment instruments include demographic characteristics (age, sex, education, marital status and work status), a diagnostic interview and well-established questionnaires for both primary and secondary outcomes.
At the end of the study, the clinicians in the TAU condition will complete a self-report sheet describing the characteristics of their interventions using treatment modules as cues (psychoeducation module, identification of negative thoughts, breathing training, etc), the average duration of sessions, the number of sessions delivered, the end-of-treatment date and the information on the number of appointments with the psychiatrist and pharmacological treatment prescribed during the study.
Information on the number of appointments with the psychiatrist and the pharmacological treatment prescribed during the study is also collected for patients in the blended condition following the same procedure described for the TAU condition. All the participants using the UP-APP will be informed about the data that are going to be registered while using it. Primary and secondary outcomes are listed in table 3.
Table 3.
Clinical outcomes
| Instrument | Construct | Reliability (α) | Response range |
| Primary outcomes | |||
| ODSIS22 33 | Severity of depressive symptoms | 0.94 | 5-point Likert scale ranging from 0 (I did not feel depressed) to 4 (constant depression) |
| OASIS22 34 | Severity of anxiety symptoms | 0.87 | 5-point Likert scale ranging from 0 (I did not feel anxious) to 4 (constant anxiety) |
| MINI35 36 | Principal diagnosis of ED | NA | Structured diagnostic interview |
| Secondary outcomes | |||
| Patient outcomes | |||
| MEDI37 | Transdiagnostic dimensions of EDs | NA | 9-point Likert response scale ranging from 0 (not characteristic of me/does not apply to me) to 8 (extremely characteristic of me/applies to me very much) |
| EuroQol-5D38 39 | Quality of life | NA | 5 items ranging from 1 (I do not have problems) to 3 (unable to perform these activities). Thermometer from 0 (worst imaginable health status) to 100 (best imaginable health status) |
| FFMQ40 41 | Mindfulness dimensions | 0.80–0.91 | Likert scale ranging from 1 (never or very rarely true) to 5 (very often or always true) |
| BEAQ42 43 | Experiential avoidance | 0.82 | 6-point Likert scale ranging from 1 (strongly disagree) to 6 (strongly agree) |
| DERS44 45 | Emotion regulation | .73 to.93 | 5-point Likert scale ranging from 1 (never or very rarely) to 5 (very often or always) |
| ERQ46 47 | Cognitive reappraisal and expressive suppression | 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree) | |
| Implementation outcomes | |||
| SUS48 49 | Usability | 0.81 | 5-point Likert scale ranging from 1 (strong disagreement) to 5 (strong agreement) |
| CEQ50 51 | Confidence in the treatment (credibility and client expectancy) | 0.85 | 9-point scale rated from 1 (not at all confident) to 9 (very confident). |
| CSRI52 53 | Emergency service (total visits), general medical inpatient hospital admissions (total days) and outpatient healthcare services (total visits) | NA | NA |
| QALYs54 55 | NA | NA | |
| Patient satisfaction outcomes | |||
| WAI-S56 57 | Working alliance | 0.91 | 7-point Likert scale ranging from 1 (never) to 7 (always) |
| TOS (ad hoc) | Quality of the intervention and its components, discomfort experienced during treatment and the experience of participating in a blended format | NA | 4-point Likert scale ranging from 0 (poor or nothing) to 3 (excellent or very much) and 11-point response scale in some items ranging from 0 (nothing) to 10 (very much) |
| App Outcomes | |||
| App | Time of use of the App, videos viewed and exercises completed | NA | NA |
BEAQ, Brief Experiential Avoidance Questionnaire; CEQ, Credibility/Expectancy Questionnaire; CSRI, Client Service Receipt Inventory; DERS, Difficulties in Emotion Regulation Scale; ED, emotional disorder; ERQ, Emotion Regulation Questionnaire; FFMQ, Five Facet Mindfulness Questionnaire; MEDI, Multidimensional Emotional Disorder Inventory; MINI, Mini-International Neuropsychiatric Interview; NA, Not Applicable; OASIS, Overall Anxiety Severity and Impairment Scale; ODSIS, Overall Depression Severity and Impairment Scale; QALYs, quality-adjusted life years; SUS, System Usability Scale; TOS, Treatment Opinion Scale.
Analyses
For the efficacy analyses, both completers and non-completers (intention-to-treat) analyses will be conducted separately. Then, a baseline comparison of both conditions in all study outcomes will be conducted to ensure that the randomisation was successful. Next, mixed, multilevel, linear models will be conducted using the restricted maximum likelihood method to estimate the parameters. All the evaluations from all time points will be used in the models. The models will include covariates if baseline differences are detected. Specifically, the linear mixed model analysis will include the main effects of time (each variable collected at each evaluation time to analyse the evolution over time). The treatment condition and the number of sessions will also be included as interaction effects with time (in order to see differences in the evolution of the variables as a function of the treatment condition and/or as a function of the number of sessions). Finally, the centre where the participants have received the treatment will be included as random effects in the model. These analyses will be computed both for the primary and the secondary outcomes. The effect sizes will be computed and interpreted following the Cohen’s proposal. Additionally, we will also calculate the Reliable Change Index and the Reliable Recovery Index (RRI) to evaluate the effectiveness of both interventions, as proposed by Jacobson and Truax.26
Missing data will be handled using mixed models, which can be conducted with missing data.27 For the remaining implementation outcomes (usability, acceptability and satisfaction), we will compute descriptive analyses. Cost effectiveness will be calculated by exploring the relationship between the cost of each intervention (cost of TAU or UP in a blended format, number of sessions, medication and use of health resources carried out by the participants (evaluated through the Client Service Receipt Inventory)) and its consequences in the form of quality-adjusted life years (QALYs) (standardised health units that allow the quantification of individuals’ preferences regarding the quality of life that has been produced by a health intervention,28 the information obtained through the EuroQol allows the calculation of QALYs). Other measures of intervention penetration will be used, such as the number of consumers who were eligible or willing to use the app (end users). All analyses will be conducted with SPSS V.24.029 and Mplus V.8.0.30 The study will follow the Consolidated Standards of Reporting Trials recommendations.31
Ethics
This study will be carried out in accordance with the study protocol, the Declaration of Helsinki and good clinical practice. This superiority, multicentre, RCT is currently under an approval process by the ethical and research committees of all the collaborating centres. It has already been approved by Ethics Research Committee of Navarra, Castellón, Euskadi, Castilla y León, Extremadura, Lleida and Aragón.
Data handling will be carried out according to the premises established by Spanish laws.32 The security and confidentiality of the participants’ data are guaranteed by using alphanumeric codes (SUP001) instead of names. In addition, the demographic data will be hold separately from the rest of the data and will only be available to the researchers responsible for the data. The right to privacy will be a priority. The data obtained with the UP-APP will also comply with the mentioned guidelines. We will follow the necessary technical measures to ensure data safety and confidentiality, such as information encryption, access control and protection, security copies, updating of the operating system, security patches, centralised management of passwords, roles, users and privileges, patches management and vulnerabilities detection. Outcomes will be disseminated through publication in peer-reviewed journals and presentations at international conference meetings. In addition, we will give visibility to the results through www.researchgate.net, https://clinicaltrials.gov/ and the website of our research group.
Supplementary Material
Acknowledgments
We would like to thank in advance all the collaborating centres, healthcare professionals, volunteers and participants that will make this study possible.
Footnotes
Contributors: JO: conceptualisation, funding acquisition, project administration, supervision and writing the original draft. LM-G: conceptualisation, investigation, visualisation and writing the original draft. ÓP-B: conceptualisation, investigation, methodology and writing (review and editing). MVN-H: conceptualisation and writing (review and editing). AG-P: methodology, software and writing (review and editing). CS-R: conceptualisation, methodology and writing (review and editing).
Funding: Funding for the study was provided by the PI20/00697 project integrated in Plan Estatal de I+D+I 2017–2020 and co-funded by the 'ISCIII-Subdirección General de Evaluación y Fomento de la investigación del Fondo Europeo de Desarrollo Regional (FEDER), Otra manera de hacer Europa'. Co-funding for this study was also provided by Gobierno de Aragón and FEDER 2014–2020 'Construyendo Europa desde Aragón' (research team: S31_20D). These funding sources had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data or decision to submit results.
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Data availability statement
Data sharing not applicable as no datasets generated and/or analysed for this study. Data will be shared under reasonable request.
Ethics statements
Patient consent for publication
Not applicable.
References
- 1.Bullis JR, Boettcher H, Sauer‐Zavala S, et al. What is an emotional disorder? a transdiagnostic mechanistic definition with implications for assessment, treatment, and prevention. Clin Psychol Sci Pract 2019;26:e12278. 10.1111/cpsp.12278 [DOI] [Google Scholar]
- 2.American Psychiatric Association . Diagnostic and statistical manual of mental disorders. 5th edn. Arlington, VA, 2013. [Google Scholar]
- 3.World Health Organization . Depression and other common mental disorders: global health estimates, 2017: 1–24. [Google Scholar]
- 4.Ruiz-Rodríguez P, Cano-Vindel A, Muñoz Navarro R, et al. Impacto económico Y carga de los trastornos mentales comunes en España: Una revisión sistemática Y crítica. Ansiedad y Estrés 2017;23:118–23. 10.1016/j.anyes.2017.10.003 [DOI] [Google Scholar]
- 5.Cano-Vindel A, Muñoz-Navarro R, Wood CM, Wood JT M, et al. Transdiagnostic cognitive behavioral therapy versus treatment as usual in adult patients with emotional disorders in the primary care setting (PsicAP study): protocol for a randomized controlled trial. JMIR Res Protoc 2016;5:e246. 10.2196/resprot.6351 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Barlow DH, Ellard KK, Fairholme CP. The unified protocol for transdiagnostic treatment of emotional disorders: client workbook. New York: Oxford University Press, 2011. [Google Scholar]
- 7.Barlow DH, Farchione TJ, Fairholme CP. The unified protocol for transdiagnostic treatment of emotional disorders: therapist guide. New York: Oxford University Press, 2011. [Google Scholar]
- 8.Brown TA, Barlow DH. A proposal for a dimensional classification system based on the shared features of the DSM-IV anxiety and mood disorders: implications for assessment and treatment. Psychol Assess 2009;21:256–71. 10.1037/a0016608 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Brown TA, Campbell LA, Lehman CL, et al. Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. J Abnorm Psychol 2001;110:585–99. 10.1037/0021-843X.110.4.585 [DOI] [PubMed] [Google Scholar]
- 10.McHugh RK, Murray HW, Barlow DH. Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: the promise of transdiagnostic interventions. Behav Res Ther 2009;47:946–53. 10.1016/j.brat.2009.07.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Carlucci L, Saggino A, Balsamo M. On the efficacy of the unified protocol for transdiagnostic treatment of emotional disorders: a systematic review and meta-analysis. Clin Psychol Rev 2021;87:101999. 10.1016/j.cpr.2021.101999 [DOI] [PubMed] [Google Scholar]
- 12.Cassiello-Robbins C, Southward MW, Tirpak JW, et al. A systematic review of unified protocol applications with adult populations: facilitating widespread dissemination via adaptability. Clin Psychol Rev 2020;78:101852. 10.1016/j.cpr.2020.101852 [DOI] [PubMed] [Google Scholar]
- 13.Sakiris N, Berle D. A systematic review and meta-analysis of the unified protocol as a transdiagnostic emotion regulation based intervention. Clin Psychol Rev 2019;72:101751. 10.1016/j.cpr.2019.101751 [DOI] [PubMed] [Google Scholar]
- 14.Osma J, Suso-Ribera C, Peris-Baquero O. Eficacia del Protocolo Unificado en formato grupal para el tratamiento transdiagnóstico de los trastornos emocionales en unidades de salud mental públicas españolas. In: Osma J, ed. Aplicaciones del Protocolo Unificado para El Tratamiento Transdiagnóstico La Disregulación Emocional. Madrid: Alianza Editorial, 2019: 203–18. [Google Scholar]
- 15.Osma J, Suso-Ribera C, Peris-Baquero Óscar, et al. What format of treatment do patients with emotional disorders prefer and why? implications for public mental health settings and policies. PLoS One 2019;14:e0218117. 10.1371/journal.pone.0218117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.van Gemert-Pijnen JEWC, Nijland N, van Limburg M, et al. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res 2011;13:e111. 10.2196/jmir.1672 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Wentzel J, van der Vaart R, Bohlmeijer ET, et al. Mixing online and face-to-face therapy: how to benefit from blended care in mental health care. JMIR Ment Health 2016;3:e9. 10.2196/mental.4534 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Leterme AC, Behal H, Demarty AL, et al. A blended cognitive behavioral intervention for patients with adjustment disorder with anxiety: a randomized controlled trial. Internet Interv 2020;21:100329. 10.1016/j.invent.2020.100329 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ly KH, Topooco N, Cederlund H, et al. Smartphone-supported versus full behavioural activation for depression: a randomised controlled trial. PLoS One 2015;10:e0126559. 10.1371/journal.pone.0126559 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Erbe D, Eichert H-C, Riper H, et al. Blending face-to-face and Internet-based interventions for the treatment of mental disorders in adults: systematic review. J Med Internet Res 2017;19:e306. 10.2196/jmir.6588 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Faul F, Erdfelder E, Lang A-G, et al. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007;39:175–91. 10.3758/BF03193146 [DOI] [PubMed] [Google Scholar]
- 22.Osma J, Quilez-Orden A, Suso-Ribera C, et al. Psychometric properties and validation of the Spanish versions of the overall anxiety and depression severity and impairment scales. J Affect Disord 2019;252:9–18. 10.1016/j.jad.2019.03.063 [DOI] [PubMed] [Google Scholar]
- 23.Barlow DH, Sauer-Zavala S, Farchione TJ. Protocolo unificado para el tratamiento transdiagnóstico de los trastornos emocionales. In: Manual del terapeuta (Jorge Osma Y Elena Crespo, TraD. 2nd edn. Madrid: Alianza Editorial, 20192019. [Google Scholar]
- 24.Barlow DH, Sauer-Zavala S, Farchione TJ. Protocolo Unificado para el Tratamiento Transdiagnóstico de los Trastornos Emocionales. In: Manual del paciente (Jorge Osma Y Elena Crespo, TraD. 2nd edn. Madrid: Alianza Editorial, 20192019. [Google Scholar]
- 25.Osma J, Suso-Ribera C, García-Palacios A, et al. Efficacy of the unified protocol for the treatment of emotional disorders in the Spanish public mental health system using a group format: study protocol for a multicenter, randomized, non-inferiority controlled trial. Health Qual Life Outcomes 2018;16:46. 10.1186/s12955-018-0866-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. In: Methodological issues & strategies in clinical research. Washington D.C: American Psychological Association, 1992: 631–48. [Google Scholar]
- 27.Krueger C, Tian L. A comparison of the general linear mixed model and repeated measures ANOVA using a dataset with multiple missing data points. Biol Res Nurs 2004;6:151–7. 10.1177/1099800404267682 [DOI] [PubMed] [Google Scholar]
- 28.Alvis N, Valenzuela MT. Los QALYs Y DALYs como indicadores sintéticos de salud. Rev. méd. Chile 2010;138:83–7. 10.4067/S0034-98872010001000005 [DOI] [Google Scholar]
- 29.IBM Corp . Ibm SPSS statistics for windows, version 24.0. New York: IBM Corp, 2016. [Google Scholar]
- 30.Muthén LK, Muthén BO. Mplus User’s Guide. 8 edn. Los Ángeles: CA: Muthén & Muthén, 2017. [Google Scholar]
- 31.Piaggio G, Elbourne DR, Pocock SJ, et al. Reporting of Noninferiority and equivalence randomized trials. JAMA 2012;308:2594. 10.1001/jama.2012.87802 [DOI] [PubMed] [Google Scholar]
- 32.Ministerio de Justicia . Boletin Oficial del Estado, n°17 [BOE-A-2008-979], 2008. Available: https://www.boe.es/buscar/act.php?id=BOE-A-2008-979
- 33.Bentley KH, Gallagher MW, Carl JR, et al. Development and validation of the overall depression severity and impairment scale. Psychol Assess 2014;26:815–30. 10.1037/a0036216 [DOI] [PubMed] [Google Scholar]
- 34.Norman SB, Cissell SH, Means-Christensen AJ, et al. Development and validation of an overall anxiety severity and impairment scale (OASIS). Depress Anxiety 2006;23:245–9. 10.1002/da.20182 [DOI] [PubMed] [Google Scholar]
- 35.Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International neuropsychiatric interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22–33. [PubMed] [Google Scholar]
- 36.Ferrando L, Bobes J, Gibert J. Detección Orientación Diagnóstica. In: Mini Entrevista Neuropsiquiátrica Internacional (mini international neuropsychiatric interview, mini, 2000. [Google Scholar]
- 37.Rosellini AJ, Brown TA. The multidimensional emotional disorder inventory (MEDI): assessing transdiagnostic dimensions to validate a profile approach to emotional disorder classification. Psychol Assess 2019;31:59–72. 10.1037/pas0000649 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Brooks R, Group E. EuroQol: the current state of play. Health Policy 1996;37:53–72. 10.1016/0168-8510(96)00822-6 [DOI] [PubMed] [Google Scholar]
- 39.Herdman M, Badia X, Berra S. El EuroQol-5D: Una alternativa sencilla para La medición de la calidad de vida relacionada Con La salud en atención primaria. Atención Primaria 2001;28:425–9. 10.1016/S0212-6567(01)70406-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Baer RA, Smith GT, Hopkins J, et al. Using self-report assessment methods to explore facets of mindfulness. Assessment 2006;13:27–45. 10.1177/1073191105283504 [DOI] [PubMed] [Google Scholar]
- 41.Cebolla A, García-Palacios A, Soler J, et al. Psychometric properties of the Spanish validation of the five facets of mindfulness questionnaire (FFMQ). Eur. J. Psychiat. 2012;26:118–26. 10.4321/S0213-61632012000200005 [DOI] [Google Scholar]
- 42.Gámez W, Chmielewski M, Kotov R, et al. The brief experiential avoidance questionnaire: development and initial validation. Psychol Assess 2014;26:35–45. 10.1037/a0034473 [DOI] [PubMed] [Google Scholar]
- 43.Vázquez-Morejón R, León Rubio JM, Martín Rodríguez A, Rubio JML, Rodríguez AM, et al. Validation of a Spanish version of the Brief Experiential Avoidance Questionnaire (BEAQ) in clinical population. Psicothema 2019;31:335–40. 10.7334/psicothema2019.60 [DOI] [PubMed] [Google Scholar]
- 44.Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Assess 2004;26:41–54. 10.1023/B:JOBA.0000007455.08539.94 [DOI] [Google Scholar]
- 45.Hervás G, Jódar R. Adaptación al castellano de la Escala de Dificultades en la Regulación Emocional [The Spanish version of the Difficulties in Emotion Regulation Scale]. Clin. salud 2008;19:139–56 https://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S1130-52742008000200001 [Google Scholar]
- 46.Gross JJ, John OP. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. J Pers Soc Psychol 2003;85:348–62. 10.1037/0022-3514.85.2.348 [DOI] [PubMed] [Google Scholar]
- 47.Cabello R, Salguero JM, Fernández-Berrocal P, et al. A Spanish adaptation of the emotion regulation questionnaire. European Journal of Psychological Assessment 2013;29:234–40. 10.1027/1015-5759/a000150 [DOI] [Google Scholar]
- 48.Brooke J. SUS—A quick and dirty usability scale usability. Eval. Ind 1996;189:4–7 https://hell.meiert.org/core/pdf/sus.pdf [Google Scholar]
- 49.Sevilla-Gonzalez MDR, Moreno Loaeza L, Lazaro-Carrera LS, et al. Spanish version of the system usability scale for the assessment of electronic tools: development and validation. JMIR Hum Factors 2020;7:e21161 https://doi.org/ 10.2196/21161 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry 2000;31:73–86. 10.1016/S0005-7916(00)00012-4 [DOI] [PubMed] [Google Scholar]
- 51.Baños Rivera RM, Botella G, Botella Arbona C. Un programa de tratamiento para Los Trastornos adaptativos. un estudio de caso Apunt. Psicol 2008;26:303–16. [Google Scholar]
- 52.Beecham J, Knapp M. Client service receipt inventory (CSRI), 2018. Available: https://www.ncbi.nlm.nih.gov/books/NBK481452/
- 53.Vázquez-Barquero JL, Gaite L, Cuesta MJ. Spanish version of the CSRI: a mental health cost evaluation interview. Arch. Neurobiol 1997;60:171–84. [Google Scholar]
- 54.Nord E. Cost-value analysis in health care: making sense out of QALYs. Cambridge University Press, 1999. [Google Scholar]
- 55.Prieto L, Sacristán JA. Problems and solutions in calculating quality-adjusted life years (QALYs). Health Qual. Life Outcomes 2003;1. 10.1186/1477-7525-1-80 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Tracey TJ, Kokotovic AM. Factor structure of the working alliance inventory. Psychol Assess 1989;1:207–10. 10.1037/1040-3590.1.3.207 [DOI] [Google Scholar]
- 57.Corbella S, Botella L, Gómez AM. Características psicométricas de la versión española del working alliance Inventory-Short (WAI-S). An. Psicol. Psychol 2011;27:298–301. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2021-054286supp001.pdf (111.7KB, pdf)
Data Availability Statement
Data sharing not applicable as no datasets generated and/or analysed for this study. Data will be shared under reasonable request.

