Abstract
Background
Symptoms of depression and anxiety are common among Spanish university students. Minimally guided online interventions have shown promise in reducing symptomatology and preventing increased mental distress. Here we describe the protocol of a controlled study which aims to evaluate the effectiveness of a guided preventive mental health intervention for depression and anxiety in Spanish university students.
Methods
Ongoing two-arm multicenter randomized controlled trial (RCT) targeting undergraduate students from 6 public universities with symptoms of depression and/or anxiety. Students are evaluated (between February and November 2024) through a web-based survey assessing mental health problems, use of mental health services, self-perceived health, childhood and adolescent adversities, recent stressful events, social networks, university experiences, as well as sociodemographic variables. A total of 428 students, fulfilling the inclusion criteria, are randomly assigned to: intervention group (minimally guided mhealth prevention intervention) or control group (treatment as usual plus self-monitoring including periodic evaluations on mood and stress). The intervention is based on cognitive behavioral therapy principles, such as relaxation and cognitive restructuring, and includes weekly asynchronous feedback from a psychologist based on content and participation, along with self-monitoring. Participants are assessed at baseline, and 3, 6 and 12 months after randomization. The primary outcome consists of the reduction of depressive and/or anxiety symptoms post-intervention, assessed with the Patient Health Questionnaire-9, the Generalized Anxiety Disorder-7 and the Patient Health Questionnaire-Anxiety and Depression Scale. Secondary outcomes of the RCT will be symptoms of other mental health conditions, psychological wellbeing, academic stress, acceptability and adherence. Primary analyses will be conducted on an intention-to-treat basis.
Discussion
The results of the PROMES-U RCT will provide valuable information on the effectiveness of a minimally guided preventive mental health intervention to reduce symptoms of depression and anxiety among university students that could be delivered in the campus context. Results will also provide information on the potential impact of the intervention on other relevant factors involved in mental health among university students and on the acceptability and adherence of this intervention. Trial registration number: NCT06078007.
Supplementary Information
The online version contains supplementary material available at 10.1186/s12889-025-24752-3.
Keywords: Mhealth, Prevention intervention, Depression, Anxiety, University students, Effectiveness, RCT, Cognitive behavioral therapy, University
Introduction
Mental health has become a primary global concern due to the high prevalence of mental disorders in the general population, with one in eight people suffering from a condition such as depression (4.4%) or anxiety (3.6%) in 2019 [1]. The majority of mental disorders tend to first appear between mid-adolescence and early adulthood [2]. This stage of life often coincides with tertiary education, a period when students must learn to manage psychosocial distress and academic pressure in a new environment [3]. Prevalence of mental disorders in university students have been found to be high, ranging between 20% and 60% [4–7]. The World Mental Health-International College Student (WMH-ICS) Initiative reported that the most common mental disorders among first year college students were major depressive disorder (18.5%), generalized anxiety disorder (16.7%), and alcohol use disorder (6.3%) [8].
Bruffaerts et al. (2019) found that only 36.3% of first-year students with possible mental disorders sought mental health treatment in the past year [9]. Similarly, another study found that 34% of university students with mood disorder received any form of specialized treatment (mental health professional attention or psychopharmacological treatment) [10]. Some of the main reasons why students do not seek professional help are attitudinal barriers, such as preferring to cope on their own, talking with friends or family, or the associated stigma. Structural barriers, although rated as less important, include cost, displacement and scheduling issues [11]. Internet-based programs for screening and treatment can bring down some of these barriers by providing anonymity and reducing time to treatment [12]. These barriers highlight the need for alternative forms of intervention.
Internet-based intervention programs have been shown to be an effective alternative to face-to-face treatments for many mental health problems in the general population [13, 14]. Regarding university population, findings suggest small to moderate effects on depression and anxiety [15]. Evidence shows that guided interventions achieve higher adherence [16]. Emerging “mobile health” (mHealth), i.e. the delivery of health services through mobile technology [17, 18], is of interest because of its availability, immediate support, anonymity and acceptability in young people [19, 20]. Despite this, insufficient research has been done on the effectiveness of mHealth apps using randomized controlled designs [18, 21, 22].
The Promoting Mental Health among University Students (PROMES-U) project is part of the WMH-ICS. The project takes place in 6 public universities in Spain and combines two sub-studies. The first is a prospective observational cohort study to estimate the frequency of mental disorders and assess possible proximal and distal associated factors [23]. PROMES-U also aims to evaluate the effectiveness of a preventive mental health intervention among university students, which the current protocol confers, following the Recommendations for Interventional Trials (SPIRIT) [24] and the Consolidated Standards of Reporting Trials in EHealth (CONSORT-EHEALTH) [25].
The objective of this study is to test the effectiveness of a minimally guided mHealth prevention intervention based on cognitive behavioral therapy (guided mHealth CBT) aimed at reducing symptoms of depression and anxiety among university students in Spain. Secondary objectives of this study are: (a) to evaluate the effect of the mHealth intervention on other outcomes: symptoms of other mental health conditions, psychological wellbeing, academic stress; (b) to analyze moderators and mediators of the minimally guided mHealth prevention intervention; and, (c) to evaluate adherence and acceptability of the intervention.
Methods
This study is a multicenter pragmatic Randomized Controlled Trial (RCT) of a minimally guided mHealth intervention based on cognitive behavioral therapy (guided mHealth CBT), that consists of a two-arm superiority RCT with an allocation ratio of 1:1 for comparing the guided mHealth prevention intervention to treatment as usual plus self-monitoring.
Study setting and recruitment
This study is conducted in 6 Spanish public universities across 5 autonomous regions: Andalusia, Aragon, Balearic Islands, Catalonia, and the Valencian Community. The Hospital del Mar Research Institute coordinates the study management.
All undergraduate students from the participating universities, as well as university students that participated to the PROMES-U observational study who provided personal email for further contacts, are invited to participate between February and November 2024 through various recruitment strategies, such as email invitations from academic authorities, classroom visits, university activities, advertisements (posters, websites, social media), and recommendations from student counselling services. In four of the six universities, invitation emails are sent by academic authorities. A link is provided to students to access a Qualtrics® platform to visualize the information sheet and informed consent form. Adult undergraduate students who have provided informed consent are requested to complete the baseline survey, for the assessment of eligibility criteria and pre-intervention information.
Eligibility criteria
Eligible participants are all undergraduate students at the 6 participating universities and students followed in the PROMES-U observational study, who are 18 years old or older, have literacy in Spanish, access to a smartphone (Android or Apple), and a positive screen for mild or moderate depression and/or anxiety (i.e., depression (5 ≤ PHQ-9 ≤ 14) and/or anxiety (5 ≤ GAD-7 ≤ 14) [26, 27] assessed through the baseline survey. We will exclude participants: with moderately severe or severe depression and/or anxiety (i.e., PHQ-9 ≥ 15 and/or GAD-7 ≥ 15), high suicide risk, a history of severe mental disorder (e.g., bipolar disorder, psychosis) and those who are receiving mental health treatment (i.e., psychiatric medication, psychotherapy or other mental health interventions). Students at high risk of suicide, defined with items assessing suicide attempts in the past 12 months and the likelihood to act on their suicidal ideation in the next 30 days, will receive a clinical alert recommending them to visit a healthcare professional and a list of available mental health resources and services. The PROMES-U RCT study flow chart is shown in Fig. 1.
Fig. 1.
Flow chart of the PROMES-U RCT study
Allocation
After completing the web-based baseline survey, a concealed automatic randomization will be performed for those who fulfill eligibility criteria, using randomization procedure implemented in the Qualtrics® platform, with an allocation ratio of 1:1, to intervention (guided mHealth CBT) or control (treatment as usual plus self-monitoring) groups. The randomization is stratified using information from the baseline survey: gender and severity of symptoms of depression and anxiety according to the cut-off points on the instruments: mild or moderate depression or anxiety (PHQ-9 or GAD-7 between 5 and 9 and PHQ-9 or GAD-7 between 10 and 14, respectively) [26, 28].
One researcher will be designated as the RCT coordinator of the study. The RCT coordinator will invite participants to download the app used in this study through the Apple or Android stores and will coordinate the intervention period. Students will be informed of the assignment to the intervention or control group via a message on the last screen of the Qualtrics® platform. Participants, coaches and the researcher are not blinded to study conditions.
Guided mHealth CBT intervention group: My Mood Coach app
Among the existing online CBT interventions for the treatment of depression and anxiety [29–32], we are using the MyMoodCoach, a smartphone app powered by the company Monsenso®. The MyMoodCoach app is an evidence-based online resource that adopts CBT principles such as behavioral activation, problem solving and challenging negative thoughts. MyMoodCoach was developed in a self-help version and targeted to the university population by researchers of the Ecoweb Project [33, 34]. The Ecoweb project was composed by two trials and three arms, aiming to enhance mental wellbeing and reducing mental distress. The MyMoodCoach app is available in Spanish and has been adapted for the PROMES-U study, including the design of the guided version of the intervention using a clinical portal for coaches. The main objectives of the intervention guidance are to increase adherence and detect adverse effects of the intervention. The app is structured with a library, tools and challenges sections, and includes periodic evaluations on mood, stress and achievement of the weekly goals and visualization of results, a system of alerts and notifications, and a chat for contact with the coach. The content of the app is shown in Table 1.
Table 1.
Content of the My Mood Coach smartphone app [33] powered by Monsenso®
| Section | Content |
|---|---|
| Library | Thoughts and actions change behaviors |
| Building up positive activities | |
| Changing avoidance to coping | |
| Building positive thoughts | |
| Cognitive biases | |
| Scheduling better plans | |
| Challenges | Beliefs and rules |
| My personal MyMoodCoach | |
| Identifying avoidance | |
| Identify goals and activities to be achieved | |
| Identifying and challenging anxious thoughts | |
| Identifying and challenging sad thoughts | |
| Identifying and challenging angry thoughts | |
| Enjoyable activities from the past | |
| Key steps of problem-solving | |
| Tools | First aid problem-solving |
| Relaxation exercise | |
| Challenging anxious thoughts | |
| Challenging sad thoughts | |
| Challenging angry thoughts | |
| Instant Mood Boost |
The intervention period will last 8 weeks. During this time, students in the intervention arm will receive minimal guidance from a coach via the app’s chat feature and will have the option to contact their assigned coach directly. This guidance consists of giving asynchronous written feedback once a week regarding the modules, tools and challenges that the participants have completed and recommending content for the following week. Students will be encouraged to complete one module, one tool and one challenge per week during the 8-week intervention, which is the period that the coach will be in contact with them. In addition, coaches will encourage participants to continue with the intervention plan.
Coaches will be psychology graduates and students of the Master’s degree in General Health Psychology. They will receive training on how to provide feedback and about the clinical portal of the Monsenso® platform. A total of six psychologists will be trained and supervised by the RCT coordinator. After the eight weeks of the guided intervention, participants will retain access to the app, without coach support, until the end of 2024 (when the license expires), allowing for optional continued self-help use.
Control group: treatment as usual plus self-monitoring
Participants in the control arm will receive treatment as usual (TAU), meaning that they could be able to seek and use mental health services and resources available at the university and in the community in Spain. In addition, they will be offered access to a basic version of the app (also developed by Monsenso®), in which they will be able to monitor their mood with periodic questions about mood and stress and visualization of the results. This app contains psychoeducational information on depression, anxiety and suicidal thoughts, and a list of available mental health resources. Access to the app will be open until the end of 2024.
Data collection methods
Participant timeline
Data collection started in February 2024 (academic year 2023-24) and is carried out inviting all undergraduate students from the participating 6 universities to complete the baseline survey. Those students fulfilling eligibility criteria are randomized automatically in the intervention or control group. Participants in the intervention group and control group will receive follow-up assessment 3 months, 6 months and 12 months after randomization. The assessments will be carried out through online surveys programmed in Qualtrics® and RedCAP®.
The schedule of enrollment, assessments and interventions can be found in Fig. 2.
Fig. 2.
SPIRIT Schedule of enrolment, intervention, and assessments in the PROMES-U RCT study
Participation and retention strategies
Students will receive up to 5 reminder emails to answer and complete each of the online surveys and receive a 10€ Amazon voucher for each follow-up they complete. To increase participation in the intervention, coaches will send weekly messages to participants in the intervention group encouraging them to continue with the intervention. In addition, the RCT coordinator will send weekly reminder emails to participants who have not started the intervention to encourage them to download the app.
Measures
The baseline and follow-up assessments will be self-reported scales based on the WMH-ICS Questionnaire.
The baseline survey will include seventeen sections covering the main variables to be considered in the study. They can be regrouped in eight areas: sociodemographic, general physical health, depression and anxiety, other mental health disorders, treatment, relationships and stressful events.
Sociodemographic are set out in Sect. 1: Your background. These will include age, gender, student status, work status, living arrangement and distance of permanent residence from school.
General health can be found in Sect. 2: Your health. Perception of physical health, weight and height, physical health related interference and frequency of physical activity are measured. This section also includes: traumatic brain injury, general mental health, lifetime mental disorders, sleep disorders and role impairment.
Depression and Anxiety will be evaluated in Sect. 5: depression and Sect. 6: worry and anxiety through the PHQ-9, GAD-7 and PHQ-ADS. The PHQ-9 [27, 35] is a widely used questionnaire for screening the severity of depressive symptoms in the prior 2 weeks. It is composed of 9 items with a Likert scale from 0 to 3. The total score ranges from 0 to 27 and its interpretation is according to the following cutoff points: 5 (mild), 10 (moderate), 15 (moderately severe) and, 20 (severe). Internal consistency of 0.9 and sensitivity and specificity of 80–90% have been found [28, 36, 37]. The GAD-7 [26, 38] is the instrument used to assess anxiety symptoms. The GAD-7 is composed of 7 items with a Likert scale from 0 to 3. The total score is from 0 to 20 and is interpreted according to the following cut-off points: 5 (mild), 10 (moderate) and 15 (severe). This measure showed an internal consistency of 0.9 and sensitivity and specificity of 80% [26, 39]. The PHQ-ADS is a composite measure for screening depression and anxiety symptoms [40]. It includes the sum of the PHQ-9 and GAD-7 items, ranging from 0 to 48 and indicating severity of symptoms of 10 (mild), 20 (moderate) and 30 (severe). The PHQ-ADS showed an internal consistency of 0.8–0.9.
Other mental health disorders includes Sect. 3: ADHD evaluated with 6-month Adult ADHD Self-Report Scale (ASRS-V1.1) [41]; Sect. 4: substance Use with PhenX ToolKit [42]; Sect. 7: Panic Attacks measured with an adapted version of the Composite International Diagnostic Interview Screening Scales (CIDI-SC) [43, 44]; Sect. 8: Social Anxiety considering the 5th Edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) criteria [45]; Sect. 9: High Mood with an adapted version of the Composite International Diagnostic Interview Screening Scales (CIDI-SC) [43, 44]; Sect. 11: Other behavioral problems with items adapted from the Patient Health Questionnaire (PRIME-MD) will be used to assess eating disorders [27] and Sect. 12: Self-harm that will evaluate Suicidal thoughts and behaviors with adapted items from the Self-Injurious Thoughts and Behaviors Interview (SITBI) and the Columbia Suicidal Severity Rating Scale (C-SSRS) instruments [46, 47].
Treatment will be evaluated with Sect. 13: treatment. It will be assessed the current treatment and the barriers to seeking treatment with the Post-Katrina Survey and the Healthy Minds Survey [48, 49], treatment history evaluated with the CIDI [50].
Relationships cover Sect. 14: Personal relationships and Sect. 15: social networks. Sexual orientation, sexual attraction and sexual behavior will be evaluated through the American College Health Association – National College Health Assessment (ACHA-NCHA III) [51] and the Williams Institute Best Practices for Asking Questions about Sexual Orientation on Surveys [52].
Stressful events, Sect. 10: Stressful experiences, Sect. 16: Childhood experiences and Sect. 17: University experiences. They will measure symptoms with the 6-question Short-Form PCL-5 Scale [53], age onset with the CIDI-SC [43], severity with the MIDUS Self-Report Scale of Perceived Stress [54], resilience with the 5-Item Resilience Scale [55], bullying based on various bullying measures developed by Dr. Kessler [56], trauma experiences based on questions from the Army STARRS [57], childhood stressful experiences with the Adverse Childhood Experiences (ACE) Study Survey [58], childhood trauma with the Childhood Trauma Questionnaire – Short Form (CTQ-SF) [59], academic stress with the Perception of Academic Stress Scale [60] and psychological wellbeing with the Flourishing Scale [61].
To allow assessment of inclusion/exclusion criteria and subsequent randomization, participants must complete the baseline survey through Sect. 13 (Treatment).
Sociodemographic characteristics, high mood, personal relationships, social networks and childhood experiences will be evaluated at baseline. Follow-up surveys at 3, 6 and 12 months will evaluate: general physical and mental health, substance use, depression, worry and anxiety, panic attacks, social anxiety, behavioral problems, self-harm, treatment and university experiences. And at 3-month follow-up, the survey will also evaluate acceptability.
Outcomes
The primary outcome will be the reduction of depressive and anxiety symptoms separately and overall at post-intervention (3 months, and again, at 6 and 12 months), considering the minimal clinically relevant change in the scores of the PHQ-9, GAD-7 and PHQ-ADS measures. A reduction of 5 points or more in PHQ-9 will be considered a meaningful change, as found in the study by Löwe et al. (2004) for longitudinal assessment results and corresponding to two standard errors of measurement [62]. For GAD-7, 4 points were estimated as the minimal clinically important difference in longitudinal assessments and corresponding to two standard error of measurement [63]. And for PHQ-ADS, a reduction of 3 points or more will be considered [64]. The primary outcome will also be considered as a binary outcome defining improvement as a reduction of at least 50% of the scores on the baseline survey [29, 65].
Secondary outcomes will be the change in symptoms of other mental health conditions, psychological wellbeing, and academic stress. Symptoms of other mental health disorders will be assessed with adapted versions of the following instruments: panic attacks (adapted version of the Composite International Diagnostic Interview Screening Scales; CIDI-SC) [43, 44]; social anxiety symptoms (5th Edition of the Diagnostic and Statistical Manual of Mental Disorders criteria; DSM-5) [45]; post-traumatic stress disorder symptoms (adapted PTSD Checklist from the DSM-5; PCL-5) [53]; eating disorders (items from the Patient Health Questionnaire (PRIME-MD) [27]; suicidal thoughts and behaviors (adapted items from the Self-Injurious Thoughts and Behaviors Interview; SITBI and the Columbia Suicidal Severity Rating Scale; C-SSRS) [46, 47]; assessing statistically significant differences between baseline and follow-up assessments. Substance use frequency (i.e., alcohol and drugs consumption) will be evaluated with measures from the PhenX ToolKit [42]. Psychological wellbeing will be measured with 4 items from the Flourishing Scale [61] and academic stress will be assessed through 4 items from the Perception of Academic Stress Scale (PAS) [60].
Secondary outcomes will also include adherence and acceptability of treatment. Adherence will be evaluated considering “technical” data and acceptability of the intervention. “Technical” data are data automatically collected in the Monsenso® app and they include: information about the number of logins, the time spent in the app, the number of challenges and tools visualized, the number of questionnaires sent and answered and the responses in the questionnaires. Acceptability will be evaluated with items adapted from the Client Satisfaction Questionnaire (CSQ) [66–69], where a high score indicates higher satisfaction.
Primary and secondary outcomes will be assessed at four time points: baseline, 3-, 6- and 12-months through Qualtrics® and RedCAP®. During the baseline survey, the inclusion and exclusion criteria and the primary and secondary outcomes will be assessed.
Sample size and power calculation
The sample size calculation is based on the t-test of two independent means. Based on an existing meta-analysis, we anticipate a conservative effect size of 0.35 [70]. With a statistical power of 0.8 and two-sided alpha level of 0.05, a sample size of 129 participants per group is needed to detect an effect size of 0.35 (total n = 258). Considering a drop-out rate of 40%, the minimum required sample for the RCT is n = 428 participants (n = 214 participants per group).
Statistical methods
Descriptive analyses of sociodemographic variables and primary outcomes of the PROMES-U RCT study (i.e., symptoms of depression and anxiety) will be performed. Continuous variables will be summarized using the mean and categorical variables by absolute and relative frequencies.
Differences in outcomes of the study will be analyzed on an Intention-To-Treat (ITT) basis including all randomized participants [24, 71, 72]. Analyses of primary outcomes will be performed at post-intervention (i.e., at 3 months) as well as considering 6 and 12 months of follow-up.
Primary analyses will be conducted with generalized linear models (GLM) with different link functions and error structure according to the nature of the outcomes. In the case of continuous outcomes, the PHQ-9, GAD-7 and PHQ-ADS scores at post-intervention will be the dependent variable, the treatment variable as the independent variable in the model and adjusting for baseline outcome scores [73–75]. The magnitude of the effect for continuous outcomes will be calculated with Cohen’s d and 95% confidence intervals (95%CI), allowing interpreting the effect as no effect (< 0.2), small effect (0.2–0.5), medium effect (0.5–0.8) and large effect (> 0.8) [76]. For binary outcomes, effects will be reported as adjusted relative risk (aRR) with 95%CI.
For analyses involving longitudinal data (i.e., follow-up assessments at 3, 6 and 12 months), generalized linear mixed models (GLMM) will be used, considering individuals as a random effect and treatment and time being fixed effects, and adjusting for baseline outcome scores. Different link functions and error structure will be considered depending on the nature of the outcomes.
As a pre-planned secondary analysis, the treatment effect on compliers will be estimated. Complier Average Causal Effect (CACE) analyses [77] will be conducted using the instrumental variable method and including specific models for continuous and categorical outcomes. Compliance to the minimally guided mhealth CBT will be defined as completing at least 5 Challenges and 3 Tools and accessing the app for at least four weeks once a week, which corresponds to almost half of the content and duration of the intervention.
Additionally, adjusted analyses will be performed including the covariates assessed in the baseline survey in the model. For secondary outcomes at post-intervention, bivariate and multiple GLM with different link functions and error structure depending on the outcomes will be conducted. Interaction effects and mediation effects, using structural equation modeling, will be evaluated including variables assessed at baseline and follow-ups [78, 79].
Item-level missing data and dropout will be summarized, providing patterns of missingness, and considered in the interpretation of the results [80]. To deal with missing data at the item level, Multiple Imputation with Chained Equations (MICE) or Full Information Maximum Likelihood (FIML) will be applied [81, 82]. Alternatively, the assumption that these data are missing not at random will be tested in a sensitivity analysis, applying a reference-based imputation approach [83]. To correct for follow-up losses, inverse probability weighting will be calculated based on covariates evaluated in previous assessments [84, 85]. All statistical analysis will be carried out in RStudio [86].
Ethics, data management and dissemination
The project complies with national and international regulations, including the Declaration of Helsinki and the Code of Ethics, and ethical approval was provided by the Parc de Salut Mar-Clinical Research Ethics Committee (2020/9198/I) and the corresponding Ethics Committees of all participating universities. If there are major modifications to the protocol, they will be agreed with the research team and communicated to the Ethics Committee, as well as participants and university authorities.
Participants will be able to access the baseline assessment only after they have provided explicit online informed consent. Students with possible high suicide risk will receive a clinical alert with indications to consult a healthcare professional and a list of available mental health resources and services.
Reported adverse events and other unintended effects of the trial intervention will be collected with self-reported data at each follow-up. Information can also be obtained if participants in the intervention group report information to their coach. In addition, questions about mental health symptoms and suicidal thoughts and behaviors will be collected at each follow-up assessment (3-, 6- and 12-months). A Data Monitoring Committee will be established to review the adverse events and will decide whether the trial should be discontinued.
Information from the online surveys will be collected using the Qualtrics® and RedCAP® platform. The only personal information that will be requested to participants is a personal email address to invite them to download the app and answer follow-up online surveys. Data will be pseudo-anonymized by assigning an identification number to each student. Information on participation to the intervention will be collected on the Monsenso® platform and this data will be linked to the survey responses with the identification number. The anonymized data set will be used to perform all data analyses. Data analyst will be blinded to study conditions.
The dissemination of results will be adapted to the different target audiences of the PROMES-U RCT. Dissemination strategies will include the publication of peer-reviewed scientific articles and participation in conferences. Information sessions and reports will also be elaborated to provide information to university authorities. For the general population and specifically university students, results will be presented through reports, sessions, social media or news.
Discussion
A large number of university students with emotional problems do not receive a diagnosis or treatment [5, 6, 9]. Reasons to not seek professional care include stigma, cost, lack of access or misinformation about mental health care. There is an urgent need in the management of depressive and anxiety symptoms in university students to reduce their impact in academic or social functioning or to prevent later mental disorders.
Based on results of a previous study (UNIVERSAL project [87]), we evaluate a mHealth intervention that can be easily delivered to a targeted population, such as university students. Attitudes towards using e-health interventions for mental disorders are generally positive, useful and well accepted. In terms of cost, scalability, and anonymity, app-interventions have important advantages in university students. They offer the possibility to reach a group of persons who could experience barriers to participate in a face-to-face assessment or treatment as young population.
In this study we will analyze the effectiveness of a minimally guided CBT intervention for treating depressive and anxious symptoms among students of six different Spanish universities delivered by a minimally guided mobile app. This multicenter pragmatic RCT will evaluate the effectiveness of MyMoodCoach app [33] in students with depressive or anxiety symptoms vs. treatment as usual with self-monitoring. We will evaluate potential moderators and mediators of the guided intervention, as well as adherence and acceptability.
This trial has several anticipated limitations. First, the control group will receive access to a basic version of the Monsenso® app, which includes mood and stress monitoring, psychoeducational information, and mental health resources. This minimal intervention may reduce the contrast with the guided intervention and potentially underestimate effect sizes. Second, app uptake and intensity of use are expected to be modest, which could limit intervention exposure. Third, follow-up response rates, particularly at 6 and 12 months, may be reduced, which could affect power and introduce bias. Finally, although the guided intervention is standardized at 8 weeks, the length of subsequent unguided access to the MyMoodCoach app until the end of 2024 varies depending on the date of randomization, potentially leading to heterogeneity in long-term outcomes.
To mitigate these limitations, we will conduct analyses estimating treatment effects among compliers, apply Complier Average Causal Effect (CACE) methods, use inverse probability weighting to account for attrition, and perform sensitivity analyses to explore the impact of the variable duration of unguided app access.
This study will provide relevant information for policy makers and will have implications for public health and research on the integration of digital interventions on university campuses.
Supplementary Information
Acknowledgements
The PROMES-U study group is formed by: Jordi Alonso, Franco Amigo, Laura Ballester, Paula Carrasco, Raquel Falcó, Patricia Garcia-Pazo, Margalida Gili, Cristina Giménez-García, Inés Forteza-Rey, Francisco H Machancoses, Juan Carlos Marzo Campos, Berta Moreno-Küstner, Philippe Mortier, Jose A Piqueras, Ana Portillo-Van Diest, Marisa Rebagliato, Miquel Roca, Tiscar Rodriguez, Estefanía Ruiz-Palomino, José Martín Salguero, Victoria Soto-Sanz and Gemma Vilagut.
Abbreviations
- DSM-5
5th Edition of the Diagnostic and Statistical Manual of Mental Disorders
- ASRS-V1.1
Adult ADHD Self-Report Scale
- ACHA-NCHA III
American College Health Association – National College Health Assessment
- ADHD
Attention-Deficit/Hyperactivity Disorder
- CSQ
Client Satisfaction Questionnaire
- CONSORT-EHEALTH
Consolidated Standards of Reporting Trials in Ehealth
- CBT
Cognitive Behavioral Therapy
- C-SSRS
Columbia Suicidal Severity Rating Scale
- CACE
Complier Average Causal Effect
- CIDI-SC
Composite International Diagnostic Interview Screening Scales
- FIML
Full Information Maximum Likelihood
- GAD-7
Generalized Anxiety Disorder 7-item
- GLMM
Generalized Linear Mixed Models
- ITT
Intention-To-Treat
- mHealth
Mobile Health
- MICE
Multiple Imputation with Chained Equations
- PRIME-MD
Patient Health Questionnaire
- PHQ-9
Patient Health Questionnaire-9
- PHQ-ADS
Patient Health Questionnaire Anxiety and Depression Scale
- PAS
Perception of Academic Stress Scale
- PROMES-U
Promoting Mental Health among University students project
- PCL-5
PTSD Checklist from the DSM-5
- RCT
Randomized Controlled Trial
- SITBI
Self-Injurious Thoughts and Behaviors Interview
- SPIRIT
Standard Protocol Items: Recommendations for Interventional Trials
- WHO
World Health Organization
- WMH-ICS
World Mental Health-International College Student initiative
Authors’ contributions
Co-first authors: LB, MG, and MR contributed equally to this work. JA, PM, GV, LB, MG, MR were responsible of study conceptualization and design. LB, IF-R, MG, MR wrote the first draft of the article. VS-S, GV, FAA, BM, PM, JAP, AP-VD, MR, TR, and JA provided critical revisions. All authors read and approved the submitted manuscript.
Funding
This work is supported by Instituto de Salud Carlos III (ISCIII) and cofunded by the European Union, grant number PI20/00006; by the Departament de Recerca i Universitats of the Generalitat de Catalunya (AGAUR 2021 SGR 00624); and CIBER -Consorcio Centro de Investigación Biomédica en Red- (CB06/02/0046), Instituto de Salud Carlos III, Ministerio de Ciencia e Innovación and Unión Europea.Subdirecció General d'Addiccions, VIH, ITS i Hepatitis Víriques, Secretaria de Salut Pública, Departament de Salut, Generalitat de Catalunya.
Data availability
No datasets were generated or analysed during the current study.
Declarations
Ethics approval and consent to participate
Ethical approval was provided by the Parc de Salut Mar-Clinical Research Ethics Committee (Reference: 2020/9198/I) and the Ethics Committees at each participating university. Written informed consent will be obtained from all subjects.
Consent for publication
Not applicable.
Competing interests
MR received research funding from the European Union, Spanish Ministry of Economy, Commerce and Business and Janssen, Lundbeck and Rovi. MG received research funding from the European Union, and Spanish Ministry of Economy, Commerce and Business.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Laura Ballester, Margalida Gili and Miquel Roca contributed equally.
Contributor Information
Laura Ballester, Email: lballester@researchmar.net.
Jordi Alonso, Email: jalonso@researchmar.net.
References
- 1.World Health Organization. Depression and other common mental disorders: global health estimates. Geneva; 2017.
- 2.Solmi M, Radua J, Olivola M, Croce E, Soardo L, Salazar de Pablo G, et al. Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies. Mol Psychiatry. 2022;27:281–95. 10.1038/s41380-021-01161-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Stallman HM. Psychological distress in university students: A comparison with general population data. Aust Psychol. 2010;45:249–57. 10.1080/00050067.2010.482109. [Google Scholar]
- 4.Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, et al. Mental disorders among college students in the world health organization world mental health surveys. Psychol Med. 2016;46:2955–70. 10.1017/S0033291716001665. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Ballester L, Alayo I, Vilagut G, Almenara J, Cebrià AI, Echeburúa E, et al. Mental disorders in Spanish university students: prevalence, age-of-onset, severe role impairment and mental health treatment. J Affect Disord. 2020;273:604–13. 10.1016/j.jad.2020.04.050. [DOI] [PubMed] [Google Scholar]
- 6.Verger P, Guagliardo V, Gilbert F, Rouillon F, Kovess-Masfety V. Psychiatric disorders in students in six French universities: 12-month prevalence, comorbidity, impairment and help-seeking. Soc Psychiatry Psychiatr Epidemiol. 2010;45:189–99. 10.1007/s00127-009-0055-z. [DOI] [PubMed] [Google Scholar]
- 7.Lipson SK, Zhou S, Abelson S, Heinze J, Jirsa M, Morigney J, et al. Trends in college student mental health and help-seeking by race/ethnicity: findings from the National healthy Minds study, 2013–2021. J Affect Disord. 2022;306:138–47. 10.1016/j.jad.2022.03.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Auerbach RP, Mortier P, Bruffaerts R, Alonso J, Benjet C, Cuijpers P, WHO World Mental Health Surveys International College Student Project, et al. Prevalence and distribution of mental disorders. J Abnorm Psychol. 2018;127:623–38. 10.1037/abn0000362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bruffaerts R, Mortier P, Auerbach RP, Alonso J, De la Hermosillo AE, Cuijpers P, et al. Lifetime and 12-month treatment for mental disorders and suicidal thoughts and behaviors among first year college students. Int J Methods Psychiatr Res. 2019;28:e1764. 10.1002/mpr.1764. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Blanco C, Okuda M, Wright C, Hasin DS, Grant BF, Liu S-M, et al. Mental health of college students and their Non–College-Attending peers. Arch Gen Psychiatry. 2008;65:1429. 10.1001/archpsyc.65.12.1429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ebert DD, Mortier P, Kaehlke F, Bruffaerts R, Baumeister H, Auerbach RP, et al. Barriers of mental health treatment utilization among first-year college students: first cross‐national results from the WHO world mental health international college student initiative. Int J Methods Psychiatr Res. 2019;28:e1782. 10.1002/mpr.1782. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Pedrelli P, Nyer M, Yeung A, Zulauf C, Wilens T. College students: mental health problems and treatment considerations. Acad Psychiatry. 2015;39:503–11. 10.1007/s40596-014-0205-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Andrews G, Basu A, Cuijpers P, Craske MG, McEvoy P, English CL, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord. 2018;55:70–8. 10.1016/j.janxdis.2018.01.001. [DOI] [PubMed] [Google Scholar]
- 14.Etzelmueller A, Vis C, Karyotaki E, Baumeister H, Titov N, Berking M, et al. Effects of Internet-Based cognitive behavioral therapy in routine care for adults in treatment for depression and anxiety: systematic review and Meta-Analysis. J Med Internet Res. 2020;22:e18100. 10.2196/18100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Harrer M, Adam SH, Baumeister H, Cuijpers P, Karyotaki E, Auerbach RP, et al. Internet interventions for mental health in university students: A systematic review and meta-analysis. Int J Methods Psychiatr Res. 2019;28:e1759. 10.1002/mpr.1759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Musiat P, Johnson C, Atkinson M, Wilksch S, Wade T. Impact of guidance on intervention adherence in computerised interventions for mental health problems: a meta-analysis. Psychol Med. 2022;52:229–40. 10.1017/S0033291721004621. [DOI] [PubMed] [Google Scholar]
- 17.Lecomte T, Potvin S, Corbière M, Guay S, Samson C, Cloutier B, et al. Mobile apps for mental health issues: Meta-Review of Meta-Analyses. JMIR Mhealth Uhealth. 2020;8:e17458. 10.2196/17458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Miralles I, Granell C, Díaz-Sanahuja L, Van Woensel W, Bretón-López J, Mira A, et al. Smartphone apps for the treatment of mental disorders: systematic review. JMIR Mhealth Uhealth. 2020;8:e14897. 10.2196/14897. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Grist R, Porter J, Stallard P. Mental health mobile apps for preadolescents and adolescents: A systematic review. J Med Internet Res. 2017;19:e176. 10.2196/jmir.7332. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Olff M. Mobile mental health: a challenging research agenda. Eur J Psychotraumatol. 2015;6:27882. 10.3402/ejpt.v6.27882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Vereschagin M, Wang AY, Richardson CG, Xie H, Munthali RJ, Hudec KL, et al. Effectiveness of the Minder mobile mental health and substance use intervention for university students: randomized controlled trial. J Med Internet Res. 2024;26:e54287. 10.2196/54287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.McCloud T, Jones R, Lewis G, Bell V, Tsakanikos E. Effectiveness of a mobile app intervention for anxiety and depression symptoms in university students: randomized controlled trial. JMIR Mhealth Uhealth. 2020;8:e15418. 10.2196/15418. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Portillo-Van Diest A, Ballester Coma L, Mortier P, Vilagut G, Amigo F, Puértolas Gracia B, et al. Experience sampling methods for the personalised prediction of mental health problems in Spanish university students: protocol for a survey-based observational study within the PROMES-U project. BMJ Open. 2023;13:e072641. 10.1136/bmjopen-2023-072641. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7. 10.7326/0003-4819-158-3-201302050-00583/ASSET/IMAGES/10TT2.JPG. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Eysenbach G. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011;13:e126. 10.2196/jmir.1923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder. Arch Intern Med. 2006;166:1092. 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 27.Spitzer RL, Kroenke K, Williams JBW, the Patient Health Questionnaire Primary Care Study Group. Validation and utility of a Self-report version of PRIME-MD: the PHQ primary care study. JAMA. 1999;282:1737–44. 10.1001/JAMA.282.18.1737. [DOI] [PubMed] [Google Scholar]
- 28.Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med. 2001;16:606–13. 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Benjet C, Kessler RC, Kazdin AE, Cuijpers P, Albor Y, Carrasco Tapias N, et al. Study protocol for pragmatic trials of Internet-delivered guided and unguided cognitive behavior therapy for treating depression and anxiety in university students of two Latin American countries: the Yo Puedo sentirme Bien study. Trials. 2022;23:450. 10.1186/s13063-022-06255-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Musiat P, Potterton R, Gordon G, Spencer L, Zeiler M, Waldherr K, et al. Web-based indicated prevention of common mental disorders in university students in four European countries – Study protocol for a randomised controlled trial. Internet Interv 2018; Dec. 2017;0–1. 10.1016/j.invent.2018.02.004. [DOI] [PMC free article] [PubMed]
- 31.Karyotaki E, Klein AM, Riper H, Wit L, De, Krijnen L, Bol E, et al. Examining the effectiveness of a web-based intervention for symptoms of depression and anxiety in college students: study protocol of a randomised controlled trial. BMJ Open. 2019;9:1–11. 10.1136/bmjopen-2018-028739. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Montero-Marín J, Araya R, Pérez-Yus MC, Mayoral F, Gili M, Botella C, et al. An Internet-Based intervention for depression in primary care in spain: A randomized controlled trial. J Med Internet Res. 2016;18:e231. 10.2196/jmir.5695. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Newbold A, Warren FC, Taylor RS, Hulme C, Burnett S, Aas B, et al. Promotion of mental health in young adults via mobile phone app: study protocol of the ecoweb (emotional competence for well-being in young adults) cohort multiple randomised trials. BMC Psychiatry. 2020;20:458. 10.1186/s12888-020-02857-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.ECoWeB Project. http://www.ecowebproject.eu/. Accessed 20 Aug 2025.
- 35.Diez-Quevedo C, Rangil T, Sanchez-Planell L, Kroenke K, Spitzer RL. Validation and utility of the patient health questionnaire in diagnosing mental disorders in 1003 general hospital Spanish inpatients. Psychosom Med. 2001;63:679–86. 10.1097/00006842-200107000-00021. [DOI] [PubMed] [Google Scholar]
- 36.Adewuya AO, Ola BA, Afolabi OO. Validity of the patient health questionnaire (PHQ-9) as a screening tool for depression amongst Nigerian university students. J Affect Disord. 2006;96:89–93. 10.1016/j.jad.2006.05.021. [DOI] [PubMed] [Google Scholar]
- 37.Moriarty AS, Gilbody S, McMillan D, Manea L. Screening and case finding for major depressive disorder using the patient health questionnaire (PHQ-9): a meta-analysis. Gen Hosp Psychiatry. 2015;37:567–76. 10.1016/j.genhosppsych.2015.06.012. [DOI] [PubMed] [Google Scholar]
- 38.Garcia-Campayo J, Zamorano E, Ruiz MA, Pardo A, Perez-Paramo M, Lopez-Gomez V, et al. Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health Qual Life Outcomes. 2010;8:8. 10.1186/1477-7525-8-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry. 2016;39:24–31. 10.1016/j.genhosppsych.2015.11.005. [DOI] [PubMed] [Google Scholar]
- 40.Kroenke K, Wu J, Yu Z, Bair MJ, Kean J, Stump T, et al. Patient health questionnaire anxiety and depression scale: initial validation in three clinical trials. Psychosom Med. 2016;78:716–27. 10.1097/PSY.0000000000000322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Kessler RC, Adler LA, Gruber MJ, Sarawate CA, Spencer T, Van Brunt DL. Validity of the world health organization adult ADHD Self-Report scale (ASRS) screener in a representative sample of health plan members. Int J Methods Psychiatr Res. 2007;16:52–65. 10.1002/mpr.208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Hamilton CM, Strader LC, Pratt JG, Maiese D, Hendershot T, Kwok RK, et al. The phenx toolkit: get the most from your measures. Am J Epidemiol. 2011;174:253–60. 10.1093/aje/kwr193. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Kessler RC, Calabrese JR, Farley PA, Gruber MJ, Jewell MA, Katon W, et al. Composite international diagnostic interview screening scales for DSM-IV anxiety and mood disorders. Psychol Med. 2013;43:1625–37. 10.1017/S0033291712002334. [DOI] [PubMed] [Google Scholar]
- 44.Kessler RC, Santiago PN, Colpe LJ, Dempsey CL, First MB, Heeringa SG, et al. Clinical reappraisal of the composite international diagnostic interview screening scales (CIDI-SC) in the army study to assess risk and resilience in servicemembers (Army STARRS). Int J Methods Psychiatr Res. 2013;22:303–21. 10.1002/mpr.1398. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. American Psychiatric Association; 2013. 10.1176/appi.books.9780890425596.
- 46.Nock MK, Holmberg EB, Photos VI, Michel BD. Self-Injurious thoughts and behaviors interview: development, reliability, and validity in an adolescent sample. Psychol Assess. 2007;19:309–17. 10.1037/1040-3590.19.3.309. [DOI] [PubMed] [Google Scholar]
- 47.Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia–Suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168:1266–77. 10.1176/appi.ajp.2011.10111704. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Wang PS, Gruber MJ, Powers RE, Schoenbaum M, Speier AH, Wells KB, et al. Mental health service use among hurricane katrina survivors in the eight months after the disaster. Psychiatric Serv. 2007;58:1403–11. 10.1176/ps.2007.58.11.1403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Healthy Minds N. 2016–2017 Healthy Minds Survey. https://healthymindsnetwork.org/research/data-for-researchers/. Accessed 20 Aug 2025.
- 50.Kessler RC, Üstün TB, The World Mental Health (WMH) Survey Initiative version of the World Health Organization (WHO). Composite international diagnostic interview (CIDI). Int J Methods Psychiatr Res. 2004;13:93–121. 10.1002/mpr.168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.American College Health Association. 2019 American College Health Association – National College Health Assessment (ACHA-NCHA III). https://www.acha.org/wp-content/uploads/ACHANCHA_III_Spring_2023_Codebook_2_8_2023.pdf. Accessed 20 Aug 2025.
- 52.Sexual Minority Assessment Research Team S. Best practices for asking questions about sexual orientation on surveys. The Williams Institute, UCLA School of Law; 2009.
- 53.Zuromski KL, Ustun B, Hwang I, Keane TM, Marx BP, Stein MB, et al. Developing an optimal short-form of the PTSD checklist for DSM‐5 (PCL‐5). Depress Anxiety. 2019;36:790–800. 10.1002/da.22942. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Kessler RC, Mickelson KD, Walters EE, Zhao S, Hamilton L. Age and depression in the MIDUS survey. In: Brim OG, Ryff CDRCK, editors. How healthy are we? A National study of well-being at midlife. University of Chicago Press; 2004: 227–51.
- 55.Campbell-Sills L, Kessler RC, Ursano RJ, Sun X, Taylor CT, Heeringa SG, et al. Predictive validity and correlates of self‐assessed resilience among U.S. Army soldiers. Depress Anxiety. 2018;35:122–31. 10.1002/da.22694. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Hamburger ME, Basile KC, Vivolo AM. Measuring Bullying Victimization, Perpetration, and Bystander Experiences: A Compendium of Assessment Tools. 2011. https://stacks.cdc.gov/view/cdc/5994. Accessed 8 Feb 2024.
- 57.Ursano RJ, Colpe LJ, Heeringa SG, Kessler RC, Schoenbaum M, Stein MB. The army study to assess risk and resilience in servicemembers (Army STARRS). Psychiatry: Interpers Biol Processes. 2014;77:107–19. 10.1521/psyc.2014.77.2.107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Dube SR, Anda RF, Felitti VJ, Chapman DP, Williamson DF, Giles WH. Childhood abuse, household dysfunction, and the risk of attempted suicide throughout the life span. JAMA. 2001;286:3089. 10.1001/jama.286.24.3089. [DOI] [PubMed] [Google Scholar]
- 59.Bernstein DP, Stein JA, Newcomb MD, Walker E, Pogge D, Ahluvalia T, et al. Development and validation of a brief screening version of the childhood trauma questionnaire. Child Abuse Negl. 2003;27:169–90. 10.1016/S0145-2134(02)00541-0. [DOI] [PubMed] [Google Scholar]
- 60.Bedewy D, Gabriel A. Examining perceptions of academic stress and its sources among university students: the perception of academic stress scale. Health Psychol Open. 2015;2:205510291559671. 10.1177/2055102915596714. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Diener E, Wirtz D, Tov W, Kim-Prieto C, Choi D, Oishi S, et al. New Well-being measures: short scales to assess flourishing and positive and negative feelings. Soc Indic Res. 2010;97:143–56. 10.1007/s11205-009-9493-y. [Google Scholar]
- 62.Löwe B, Unützer J, Callahan CM, Perkins AJ, Kroenke K. Monitoring depression treatment outcomes with the patient health Questionnaire-9. Med Care. 2004;42:1194–201. 10.1097/00005650-200412000-00006. [DOI] [PubMed] [Google Scholar]
- 63.Toussaint A, Hüsing P, Gumz A, Wingenfeld K, Härter M, Schramm E, et al. Sensitivity to change and minimal clinically important difference of the 7-item generalized anxiety disorder questionnaire (GAD-7). J Affect Disord. 2020;265:395–401. 10.1016/j.jad.2020.01.032. [DOI] [PubMed] [Google Scholar]
- 64.Kroenke K, Baye F, Lourens SG. Comparative validity and responsiveness of PHQ-ADS and other composite anxiety-depression measures. J Affect Disord. 2019;246:437–43. 10.1016/j.jad.2018.12.098. [DOI] [PubMed] [Google Scholar]
- 65.Katzelnick DJ, Duffy FF, Chung H, Regier DA, Rae DS, Trivedi MH. Depression outcomes in psychiatric clinical practice: using a Self-Rated measure of depression severity. Psychiatric Serv. 2011;62:929–35. 10.1176/ps.62.8.pss6208_0929. [DOI] [PubMed] [Google Scholar]
- 66.Apolinário-Hagen J, Hennemann S, Fritsche L, Drüge M, Breil B. Determinant factors of public acceptance of stress management apps: survey study. JMIR Ment Health. 2019;6:e15373. 10.2196/15373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Chen AT, Wu S, Tomasino KN, Lattie EG, Mohr DC. A multi-faceted approach to characterizing user behavior and experience in a digital mental health intervention. J Biomed Inf. 2019;94:103187. 10.1016/j.jbi.2019.103187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Cheung K, Ling W, Karr CJ, Weingardt K, Schueller SM, Mohr DC. Evaluation of a recommender app for apps for the treatment of depression and anxiety: an analysis of longitudinal user engagement. J Am Med Inform Assoc. 2018;25:955–62. 10.1093/jamia/ocy023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Kelly PJ, Kyngdon F, Ingram I, Deane FP, Baker AL, Osborne BA. The client satisfaction Questionnaire-8: psychometric properties in a cross‐sectional survey of people attending residential substance abuse treatment. Drug Alcohol Rev. 2018;37:79–86. 10.1111/dar.12522. [DOI] [PubMed] [Google Scholar]
- 70.Cuijpers P, Koole SL, van Dijke A, Roca M, Li J, Reynolds CF. Psychotherapy for subclinical depression: meta-analysis. Br J Psychiatry. 2014;205:268–74. 10.1192/bjp.bp.113.138784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Gupta S. Intention-to-treat concept: A review. Perspect Clin Res. 2011;2:109. 10.4103/2229-3485.83221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Tripepi G, Chesnaye NC, Dekker FW, Zoccali C, Jager KJ. Intention to treat and per protocol analysis in clinical trials. Nephrology. 2020;25:513–7. 10.1111/nep.13709. [DOI] [PubMed] [Google Scholar]
- 73.Twisk J, Bosman L, Hoekstra T, Rijnhart J, Welten M, Heymans M. Different ways to estimate treatment effects in randomised controlled trials. Contemp Clin Trials Commun. 2018;10:80–5. 10.1016/j.conctc.2018.03.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Holmberg MJ, Andersen LW. Adjustment for baseline characteristics in randomized clinical trials. JAMA. 2022;328:2155. 10.1001/jama.2022.21506. [DOI] [PubMed] [Google Scholar]
- 75.Ashbeck EL, Bell ML. Single time point comparisons in longitudinal randomized controlled trials: power and bias in the presence of missing data. BMC Med Res Methodol. 2016;16:43. 10.1186/s12874-016-0144-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Cohen J. Statistical power analysis for the behavioral sciences. New Jersey: Lawrence Elrbaum Associates; 1988. [Google Scholar]
- 77.Hesser H. Estimating causal effects of internet interventions in the context of nonadherence. Internet Interv. 2020;21:100346. 10.1016/j.invent.2020.100346. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Angerer F, Mennel V, Grund S, Mayer A, Büscher R, Sander LB, et al. Mechanisms of change in digital interventions for depression: A systematic review and meta-analysis of six mediator domains. J Affect Disord. 2025;368:615–32. 10.1016/j.jad.2024.09.055. [DOI] [PubMed] [Google Scholar]
- 79.Conejo-Cerón S, Bellón JÁ, Motrico E, Campos-Paíno H, Martín-Gómez C, Ebert DD, et al. Moderators of psychological and psychoeducational interventions for the prevention of depression: A systematic review. Clin Psychol Rev. 2020;79:101859. 10.1016/j.cpr.2020.101859. [DOI] [PubMed] [Google Scholar]
- 80.White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trails. 2012;9:396–407. 10.1177/1740774512450098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Collins LM, Schafer JL, Kam CM. A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychol Methods. 2001;6:330–51. [PubMed] [Google Scholar]
- 82.van Buuren S. Flexible Imputation of Missing Data, Second Edition. Chapman and Hall/CRC; 2018. 10.1201/9780429492259.
- 83.Bartlett JW. Reference-Based multiple Imputation—What is the right variance and how to estimate it. Stat Biopharm Res. 2023;15:178–86. 10.1080/19466315.2021.1983455. [Google Scholar]
- 84.Seaman SR, White IR. Review of inverse probability weighting for dealing with missing data. Stat Methods Med Res. 2013;22:278–95. 10.1177/0962280210395740. [DOI] [PubMed] [Google Scholar]
- 85.Seaman SR, White IR, Copas AJ, Li L. Combining multiple imputation and Inverse-Probability weighting. Biometrics. 2012;68:129–37. 10.1111/j.1541-0420.2011.01666.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.RStudio Inc. RStudio software 12.0 353. 2022.
- 87.Blasco MJ, Castellví P, Almenara J, Lagares C, Roca M, Sesé A, et al. Predictive models for suicidal thoughts and behaviors among Spanish university students: rationale and methods of the UNIVERSAL (University & mental health) project. BMC Psychiatry. 2016;16:122. 10.1186/s12888-016-0820-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
No datasets were generated or analysed during the current study.


