Abstract
Background
Tackling poor mental health in university students has been identified as a priority in higher education. However, there are few evidence-based prevention initiatives designed for students. Repetitive Negative Thought (RNT, e.g. worry, rumination) is elevated in university students and is a well-established vulnerability factor for anxiety and depression. Furthermore, there are now evidence-based cognitive-behavioural interventions to tackle RNT. A mobile self-help cognitive-behavioural app targeting RNT, adapted for students may therefore be an effective, scalable, and acceptable way to improve prevention in students.
Methods
An online single blind, two-arm parallel-group Randomised Controlled Trial (RCT) to examine the incidence of major depression and symptoms of anxiety and depression across 12 months in university students aged over 16 who screen into the study with self-reported high levels of worry and/or rumination and no current diagnosis of major depression. Eligible participants will be randomised to the active intervention arm (usual practice plus using a self-guided mobile app targeting RNT) or to the control arm (usual practice). In total, 648 participants aged over 16, with no current major depression, bipolar disorder or psychosis will be recruited from UK universities. Assessments will take place at baseline (pre-randomisation), 3 months and 12 months post- randomisation. Primary endpoint and outcome is incidence of major depression as determined by self-reported diagnostic criteria at 12-month follow-up. Depressive symptoms, anxiety, well-being, health-related quality of life, functioning and academic outcomes are secondary outcomes. Compliance, adverse events, and potentially mediating variables will be carefully monitored.
Discussion
The trial aims to provide a better understanding of the causal role of tackling RNT (worry, rumination) using a self-help mobile app with respect to preventing depression in university students. This knowledge will be used to develop and disseminate innovative evidence-based, feasible, and effective mobile-health public health strategies for preventing common mental health problems.
Trial registration
https://www.isrctn.com/ISRCTN86795807 Date of registration: 27 October 2022
Keywords: Depression, Well-being, University students, Mobile-health prevention, Randomised controlled trial, Worry, Rumination
Background
University provides an opportunity for young people to develop independence, positive self-identity, good coping skills and social-emotional resources to stand them in good stead through their lives, as they face challenges like leaving home, meeting academic standards, making new friends, and managing finances. However, university is also a high-risk period for stress and poor mental health, which can result in increased drop-out, poorer academic outcomes, diminished employment opportunities and long-term disadvantage [1–3]. Mental health concerns are increasing amongst university students, with anxiety, depression, self-harm, and alcohol/substance abuse most common [4–8].
One of the major challenges for enhancing student mental health is the absence of proven effective prevention and wellbeing promotion initiatives [9, 10]. To tackle this key challenge, the current Nurture-U (NURTURE University) Prevention trial investigates the use of self-guided cognitive-behavioural strategies delivered by mobile app to prevent depression in university students. More specifically, this self-help intervention targets elevated repetitive negative thought (RNT) in the form of worry and rumination. RNT is a good intervention target to help students because it is a vulnerability factor that is robustly found to predict later depression, anxiety, alcohol misuse and eating disorders [11–14] and can be successfully reduced by cognitive-behavioural approaches [15–19], making it a tractable target for prevention. Furthermore, recent research has indicated that RNT is elevated in university students [5] and that it may be increasing over time in students [20], and that it specifically predicts poor mental health in students [13, 18, 19, 21]. Furthermore, RNT (e.g., worry) is a problem that students can easily self-identify and are motivated to seek help for, and that does not carry the potential stigma of more directly targeting anxiety and depression – targeting RNT may thus have the benefits recently proposed for indirect preventative interventions [22].
A version of cognitive-behavioural therapy (CBT) adapted to target RNT has been proven to be effective in reducing and preventing depression and anxiety in face-to-face therapy [15–17]. Moreover, a randomised controlled trial of a preventative intervention designed to target excessive levels of RNT in young people with elevated levels of worry and rumination found that both a group based and internet version of a rumination-focused Cognitive Behavioural Therapy programme (RF-CBT) significantly reduced RNT (d = 0.53 to 0.89) and halved the rates of caseness for self-reported major depression and generalized anxiety disorder over the next 12 months relative to a wait-list control [18]. A further trial involving 235 UK undergraduates with high-RNT found that a therapist-guided internet-based version of this RNT-targeting therapy reduced the risk of depression by 34% relative to controls over the next 15 months and that participants showed a significant improvement in RNT and depressive symptoms in the short to medium term [19]. A feasibility arm within this trial suggested that an unguided self-help version of this approach may prevent anxiety and depression in students [19] but this needs robust evaluation in a large-scale suitably powered proof-of-concept trial to test its potential as a highly scalable approach [23].
Moreover, prior prevention work in students has focused on the use of internet-delivered interventions. However, it may be that the use of a mobile app has further advantages. First, the use of mobile phones is near ubiquitous in university students – in the UK within young people aged 16-24, in 2022, 98% had a smart phone [24]. Mobile apps can thus provide a highly scalable intervention, allowing very good coverage and reach and that is widely accessible and acceptable, and convenient that can be used anytime and anywhere, all of which are critical for an effective preventive intervention [25]. Second, an unguided self-help app would be non-consumable and can be used by a nearly unlimited number of people simultaneously unlike guided interventions, which are limited by the capacity of the coaches or therapists [26]. Third, mobile apps can help to integrate behavioural changes into daily life: the app is always on hand via the smartphone, making it well-suited for changing mental habits such as worry and rumination [27].
Despite a huge increase in the number of mobile-based mental health apps over the last ten years [28] only a small number have been developed with scientific rigour. Further, many do not utilise established treatment principles nor have they been rigorously tested in robust well-powered Randomised Controlled Trials (RCTs) [28–32]. While emerging evidence suggests that mobile-based applications can deliver efficacious treatment interventions for anxiety and depression [33, 34], there have not been many trials examining their use for prevention of poor mental health in young people and in university students particularly [28, 32]. Many studies have been under-powered, with less than 100 participants per trial arm.
The app in this study will adapt an existing proven intervention that targets a shift away from maladaptive worry and rumination, as well-established risk factors for poor mental health [11–14] to more adaptive problem-solving. This self-help intervention builds on proven cognitive-behavioural therapy principles and includes identifying warning signs for worry, repeated practice to train out of unhelpful habits and build helpful habits, and the training of useful alternative strategies such as being more specific, relaxation, problem-solving and self-compassion [15–19, 35]. The comparator condition will be usual practice, reflecting the standard experience of students not receiving the app, providing a pragmatic real-world control.
Objective
The primary objective of this trial is to examine the efficacy of unguided digital RNT-targeting self-help relative to usual practice to prevent incidence of major depression over a 12-month period in university students with elevated risk as indexed by high levels of RNT. Secondary objectives are to examine the efficacy of this self-help app on secondary outcomes concerning mental well-being and mental health and associated costs, the maintenance of these effects at 12-month follow-up and to examine potential mediators and moderators of the beneficial effects (if any) of this intervention.
It is hypothesised that for university students with elevated worry and rumination, a self-guided mobile app that targets RNT added to usual practice will outperform usual practice in reducing incidence of depression across 12 months and reducing symptoms of worry, rumination, depression, and anxiety at 3 and 12 months.
Methods
The study will be conducted and reported according to Consolidated Standards of Reporting Trials (CONSORT) [36, 37] and extensions for non-pharmacologic treatment interventions and multi-arm parallel-group randomised trials and CONSORT-EHEALTH for improving and standardising evaluation reports of Web-based and mobile health interventions [38].
Study design
The trial design is a superiority parallel 2-arm individual-level single-blind Randomized Controlled Trial (RCT). All participants will be randomized into either receiving the self-help unguided self-help app incorporating CBT strategies targeting RNT in addition to usual practice or to receiving usual practice alone.
Potential participants for the trial provide initial consent to complete screening measures to determine if they are eligible to participate in the trial, i.e., showing elevated levels of RNT. Any potential participants who are found not to be eligible are automatically signposted to other sources of support. Once trial eligibility has been determined and consent to participate in the trial has been obtained, participants are individually selected at random (in a 1:1 ratio) to be offered the unguided self-help app or to continue with usual practice only.
Recruitment and study settings
We seek to recruit 648 participants from within United Kingdom universities (focused on the partner universities in the grant: Exeter, Newcastle, Oxford, Cardiff, Southampton, and King’s College London, but also open to other UK universities). The recruitment strategy will include on-campus presentations, posters, stands, and presentations in lectures, online and website advertising; email to mailing lists; newsletters and other circulars and noticeboards within willing universities in the UK. A social media campaign will be designed and prepared to be carried out on different social networks (e.g., Facebook, Instagram, TikTok), including advertisements in social media.
Eligibility criteria
Eligible participants will be: (1) over 16 years of age; (2) studying at a UK university; (3) able to provide informed consent; (4) having regular access to a smart phone (android or iOS), tablet, PC or laptop, necessary to use intervention; (5) available for the full duration of the trial (12 months); (6) able to complete consent and online questionnaires based on a basic literacy in English; (7) scoring above previously established cut-offs on standardized self-report measures of worry (Penn State Worry Questionnaire- Short-form, PSWQ-S) [39] and rumination (Ruminative Response Scale-Brooding, RRS-B) [40] , defined as scoring in the worst performing quarter on at least one of these measures, and scoring in the worst performing third on the second measure (in practice, this means scores of >11 for worst tercile, > 12 for worst quartile on the RRS-brooding scale and >24 for top tercile and >26 for top quartile on the Penn State Worry Questionnaire short-form). These thresholds are based on prior studies finding that individuals scoring in the worst quarter on measures of RNT have elevated risk for subsequent anxiety and depression [18, 19, 41].
Since this is a prevention trial, potential participants will be excluded at baseline if currently meeting diagnostic criteria for major depression (according to psychiatric DSM-V criteria), determined in structured self-report electronic screening using the LIDAS instrument [42]. Participants will also be excluded at baseline if presenting with highly elevated symptoms of depression indicating they require more specialist treatment. This is defined as having a score of 20 or higher on the Patient Health Questionnaire (PHQ-9) [43]. Other exclusion criteria include: active suicidality; any self-reported history of severe mental health problems such as bipolar disorder and psychosis and drug/alcohol dependence; and currently receiving psychological therapy, counselling or psychiatric medication including antidepressants.
Screening and consent procedure
Potential participants who are interested in the study will be directed to our study website, (www.nurtureuniversity.co.uk) which provides further information. Interested participants can proceed directly to the Electronic Data Capture (EDC) system and undertake a brief pre-screener to check age and that the participant is a university student. If appropriate, the website visitor can watch a video version of the screening Participant Information Sheet (PIS) and/or read an electronic version of the PIS and an initial consent screen to provide contact details (email; mobile phone number), and to provide informed consent (screening consent form) to complete the screening questionnaires. After completing pre-screening, potential participants will be automatically emailed a copy of the screening PIS, privacy policy and completed screening consent form. Once this initial consent is provided, the participant will complete the screening assessment consisting of the LIDAS, PSWQ-S, RRS-B and PHQ-9 and if meeting eligibility criteria will be assigned to the trial (the screening process will in parallel be assessing participants for eligibility for a trial of internet cognitive behavioural therapy for students with elevated anxiety and depression).
Those meeting eligibility criteria following the screening assessment will then be asked to consent to take part in the trial after viewing a video version of the trial PIS and/or reading an electronic version of the trial PIS and completing an electronic trial consent form (trial consent form). Participants who provide consent are automatically emailed a copy of the trial PIS, privacy policy and completed trial consent form.
Individuals who are not suitable at pre-screen or screening (e.g., outside of age range, below threshold on RNT) will automatically be directed to a webpage explaining why they are not suitable for the trial. Those reporting mental health difficulties will be automatically guided to webpages providing information, guidance including to consult with their general practitioner (or equivalent), and weblinks and telephone numbers for help and support, including contact details for the trial team.
Baseline and follow-up assessments
The baseline assessment will take place after electronic informed consent to participate in the trial is provided and consists of web-based self-report measures to assess current and lifetime history of depression, current wellbeing, symptoms of anxiety and depression, social and work functioning, use of services and treatment received, academic grades, resilience, and stressful events, and levels of RNT (see outcome measures and Tables 1 and 2). The Lifetime Depression Assessment Self-report questionnaire (LIDAS) [42] will be used to assess lifetime major depression (MDD) diagnosis according to DSM criteria and is largely based on the widely used Composite International Diagnostic Interview (CIDI). It has been proven to be effective for determining history of depression through self-report in an online digital format, matching the needs for the current study [42]. It consists of a conditional sequence of pre-programmed questions assessing all the diagnostic criteria for depression, with logic cut-outs so that subsequent questions are determined by prior questions, keeping the assessment brief.
Table 1.
Table 2.
Follow-up (months) | ||||
---|---|---|---|---|
Web Assessment | Baseline | 3 | 12 | |
Pre-screening | date of birth, self-reported mental health | ✓ | ||
Informed Consent | ✓ | |||
Socio-demographics | Age, sex, employment status, ethnicity, historic mental health problems | ✓ | ||
LIDAS | Incidence of current and past major depressive episode (primary outcome) | ✓ | ✓ | ✓ |
Rumination | RRS-Brooding questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Worry | PSWQ questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Wellbeing | WEMWBS questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Depression | PHQ-9 questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Anxiety | GAD-7 questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Resilience | BRS questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Perceived Stress | PSS-4 questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Stressful Events | ASQ questionnaire; secondary outcome | ✓ | ✓ | ✓ |
Use of mental health services and resources | ✓ | ✓ | ||
Academic Outcomes | ✓ | ✓ | ✓ |
Once consented participants have completed the baseline assessment, they will be randomised automatically by an independent computer system. Randomised participants will be informed of their randomisation allocation and signed up to use the relevant variant of the app via clinically trained members of the research team. The participant’s University email address is used for app set-up.
All participants will be followed up electronically at 3 months and 12 months post-randomisation. At each follow-up point, participants will be automatically sent emails and texts with links to enter their data into the EDC. Each assessment point will involve an automated weekly follow- up by email and then text and telephone follow-ups to participants who haven’t yet completed the EDC assessment at 3 months and 12 months. Tables 1 and 2 give an overview of all measurements. Figure 1 gives an overview of trial flow. Project researchers will be blind to treatment allocation but will be available to participants to answer queries about the trial or the assessments. Participants will receive honorariums for the completion of each of the brief mediator assessments occurring each week for 8 weeks post-randomisation, 3-month and 12-month follow-up assessments.
Randomisation, intervention delivery and masking
Participants will be randomised (in a 1:1 ratio) to the two intervention arms. Randomisation will be conducted automatically by means of a custom-built secure web service created and managed by the Exeter Clinical Trials Unit (ExeCTU), which interfaces with the trial database, and which will be independent of the trial researchers. To promote balance across key participant characteristics across intervention arms, randomisation will be stratified according to recruitment site (each of the six funded partner universities plus an “other” university category for students recruited elsewhere), and history of depression (no history vs past history of depression – given that this is a strong predictor of future depression and was used previously) [19]. Stratification will be used (on these two variables) and blocking will be used with minimum block size of 4 and maximum block size of 6, occurring at random to maintain concealment.
All the online recruitment and randomisation will be automated and independent of trial researchers. The Exeter CTU EDC system will contact an unblinded team member (administrator/therapist) indicating when an individual [by study ID] has been randomized to the active intervention. This team member will then access the relevant details in the EXCTU database and manually set up the participant in the mobile app intervention using administrator rights via the treatment platform dashboard. An email will also go to the participant indicating the condition to which they are randomised and informing them what to expect. The relevant unblinded team member will also monitor if the participant has accessed the intervention and check if any difficulties and encourage to sign-up.
All assessments will be routinely collected online using the EDC following automated reminders, without the involvement of researchers. Site researchers will be blind to treatment allocation. Site researchers will prompt all participants to complete follow ups by phone and text if they do not respond to the automated email reminders. Any unblinding in contact with a site researcher would be logged as a protocol deviation and only a researcher that remained blind will be able to prompt future follow-up from that participant.
Interventions
Usual practice control
This control is what usual practice the participants may receive during the course of the 12-month follow-up. Usual practice, as received by the university student outside of the trial, may include no provision of intervention, local provision of intervention, support from their GP/family doctor, local health services or youth services, or provision of intervention within their university (e.g., well-being service; support and welfare staff). The nature of usual practice will be monitored and assessed by questionnaires at each follow-up assessment, determining what treatment and services participants have received since the last assessment.
Unguided RNT-focused self-help mobile app (experimental intervention group)
The self-help app includes self-monitoring, psychoeducation, and active self-help exercises based on RNT-specific strategies from an evidence-based rumination-focused CBT intervention [35]. Core elements of the intervention are designed to break the ruminative habit and enable users to shift towards a more helpful processing style. This involves coaching participants to spot warning signs for rumination and worry, and then to plan alternative strategies. These include being more active, slowing things down, breaking tasks down, opposite action, relaxation, concrete thinking, becoming absorbed, self-compassion, and assertiveness. Participants are prompted to practice alternative strategies in response to their warning signs. The user interface includes text, pictures, audio-recordings, vignettes, animations, audio-exercises, quizzes, and questionnaires with tailored automated feedback. The app is entirely automated (i.e., self-guided) and designed for use on both iOS and Android phones. The app is accessed for free via each participant’s smartphone app store and is set up in the Minddistrict delivery platform. The app is structured in a logical order with participants needing to complete each module/lesson before proceeding to the next lesson. Each lesson can be completed within 5-30 mins and followed a structure of psychoeducation, student stories, experiential exercises, strategies to practice, making plans, and a quiz to test knowledge (see Table 3 for further detail).
Table 3.
Module Name | Description of contents |
---|---|
Building Confidence and Reducing Worry (introductory module) App is programmed so that all users receive this first – they can then choose in which order they want to complete the subsequent modules – all subsequent modules introduce new strategies to add to the changing habit framework introduced in first module. Participants work through the module in order with various points where they choose which and how many examples or strategies they read, enabling further personalisation. |
Chapter 1: Introduction to therapy, student stories (introducing 4 diverse students and their backgrounds and difficulties – Rory, Li Wei, Amira, Alex), psychoeducation on common problems linked to RNT (perfectionism, procrastination, imposter syndrome, academic stress, fear of missing out, bullying and harrassment, loneliness, adjusting to university), introduction to action plan, with example, activation of My Goal and Action Plan features (which user can access whenever they want in app to créate plans and which enables user to set a goal and make a plan to reach the goal); psychodeducation on worry and rumination as a habit including animated video; student stories of experiences of overthinking; quiz to check understanding Chapter 2: Spotting Triggers – psychoeducation on importance of spotting triggers to worry and rumination, including animation; my warning signs quiz that reviews range of different warning signs (situations, physical reactions, places and times, actions, thoughts) for RNT and gives contingent feedback on what actions and modules may be helpful; quiz to check understanding; Mood Tracker tool activated that enables users to record at any time new triggers for RNT and stress Chapter 3: Removing and interrupting triggers – psychoeducation on value of removing triggers to RNT to change habit, including animation; choice of tools to manage triggers to review including detailed steps, tips, and student examples for (a) sleep hygiene (including regular routine, stimulus control),(b) changing routine and environment (e.g., taking a break), (c) slowing things down; (d) breaking tasks down into smaller steps; (e) being more active (including SMART plans); (f) worry postponement and worry periods; quiz to check understanding; activation of Worry Diary that participant can access to and add a new entry whenever they want which helps them to note a worry and then to return to later at a scheduled worry time. Chapter 4: Learning new helpful habits – psychoeducation on how to learn new habits including animated video; introduction of IF-THEN plans (implementation intentions to plan an alternative to RNT when notice warning signs for RNT, e.g., If I notice I am getting tense, then I will listen to a relaxation exercise) as useful way to plan new responses to counter RNT, with student example; introduction of different alternative helpful responses to RNT; introduces Opposite action as a useful alternative with animated video; opposite action tool is interactive tool that suggests alternative actions, facial expressions and body language to try in response to anger, anxiety, shame, sadness, boredom or tiredness; IF-THEN diary is activated, in which participant can add a new IF-THEN plan and reminder whenever they want; quiz to check understanding |
Helpful Thinking to Build Confidence and Reduce Worry | Psychoeducation on how different processing styles (abstract Why? vs concrete-specific How?) influence effects of RNT, including animated video; behavioural experiment including audio-recorded exercises to compare different effects of abstract versus concrete thinking; steps and tips to think more concretely and be more specific; activation of Concrete Thinking tool (audio-exercise to practise being more specific); explanation of how changing thinking is a potential alternative to RNT in the IF-THEN plan and making a new IF-THEN plan; activation of Be Specific diary that participant can open and complete a new entry whenever they want, with prompts to aid them in thinking in a more specific way; quiz to check understanding |
Relax and Refocus to Build Confidence and Reduce Worry | Psychoeducation on relaxation and how it might be useful for RNT; choice of 3 different relaxation exercises to practice, each with audio-recording (Slow Breathing; Body Scan, Progressive Muscle relaxation); practice of exercise with review of effect; explanation of how relaxation is a potential alternative to RNT in the IF-THEN plan and making a new IF-THEN plan |
Being Absorbed to Build Confidence and Reduce Worry | psychoeducation on how being absorbed in an activity and connecting with experience act counter to RNT; behavioural experiment using audio-recorded exercises to compare experience of times when absorbed versus time not absorbed; explanation of how absorption is a potential alternative to RNT in the IF-THEN plan and making a new IF-THEN plan; access to absorption audio-recorded exercise as tool; making plans to increase absorbing activities, using My Activity Plan feature; student example; quiz to check understanding |
Being Kind to Yourself to Build Confidence and Reduce Worry | psychoeducation on how being self-compassion and kindness act counter to RNT including animated video; behavioural experiment using audio-recorded exercises to compare experience of times when being kind versus time not being kind; explanation of how self-compassion is a potential alternative to RNT in the IF-THEN plan and making a new IF-THEN plan; access to self-compassion listening exercise; choice of tips on how to talk to oneself in a kinder way; making plans to increase self-compassionate activities, using My Activity Plan feature; student example; activation of Be Kind diary that participant can open and complete a new entry whenever they want, with prompts to aid them in thinking about a situation in a more supportive and tolerant way; quiz to check understanding |
Developing Assertiveness to Build Confidence and Reduce Worry | Psychoeducation on what assertiveness is and how it can be helpful response to reduce RNT; choice of student stories as examples; choice of communication styles to read about; exercise about how to be more assertive providing tips, with student examples; choice of different tips about being assertive to read; quiz to check understanding |
Building Confidence and Reducing Worry into the Future (this module is designed to be the last module, helping participants with ongoing practice and relapse prevention plans) | Review of what participant has learnt through the modules so far (warning signs, useful tools); encouraged to check-in regularly; activation of Check In diary that participant can open and complete a new entry whenever they want, with prompts to aid them in thinking about whether they are facing any warning signs and to review what helpful actions they can take; choice of student stories for all four students highlighting their journey and progress and what they found helpful; goal setting with choice to identify risks and make goals and future plans to stay well over 3-month, 6-month, and/or 12-month periods; questionnaire on experience of therapy; congratulations on completing course. |
The content will focus on providing psychoeducation, tips, advice, strategies, and reflective exercises and learning tests relevant to reducing worry and rumination and building confidence. It has been adapted to be usable in a mobile app format and has been tailored through two iterations (one on paper with illustrative examples for a student focus group, one with n=6 students working through the app and providing feedback) to reflect student concerns, including specific sections on student issues and a series of diverse student vignettes illustrating different concerns and strategies through the app. The vignettes are designed to follow different student stories to illustrate different aspects of the intervention and different experiences of worry and rumination. The adaptation includes organising all information into “bite-sized” information that can be displayed on a mobile phone screen without the need to scroll down, typically with one key message per “page”, and with users then swiping forwards to the next “page” to make it user-friendly.
There is a “favourite” feature so that any exercise or video or information could be stored and accessed whenever the user wanted from their dashboard. The app also includes interactive features that the user can access whenever they want and as many times as they want, including features to complete diaries, set goals, and make plans.
Intervention adherence
The use of the app will be assessed and recorded including number of times the app is used, for how long, and progress through the different modules. A minimum intervention dose for the app will be defined a priori, with “compliance” defined as completion of a pre-specified minimum level of usage of the unguided self-help intervention (at least 2 modules of 7 modules in treatment package). All participants in the usual practice control will be defined as receiving the minimum intervention dose.
Outcomes
Outcomes will be assessed at baseline (pre-randomisation) and 3 months and 12 months post-randomisation.
Primary outcome
The primary outcome measure will be the incidence of major depression over 12 months (primary endpoint), indexed by the LIDAS [42] assessing diagnosis retrospectively across the follow-up period.
Secondary outcomes
Secondary outcomes include: the Patient Health Questionnaire-9 (PHQ-9), a well-validated measure of depression [43] and the Warwick -Edinburgh Mental Wellbeing Scale (WEMWBS) [44], a widely used and well-validated measure of wellbeing. The Generalized Anxiety Disorder-7 (GAD-7) questionnaire will be used to assess anxiety symptoms [45]. The Work and Social Adjustment Scale (WSAS) [46] will be used to measure functioning with respect to work/education, home management, social leisure, private leisure, and close relationships each rated from 0 not at all impaired to 8 severely impaired. A bespoke questionnaire will assess the use of university-based and non-university-based healthcare (including National Health Service) services, resources, and support. Another bespoke questionnaire will ask participants to report on the actual academic marks and their academic targets for the previous year and whether they were satisfied with their academic progress. The Brief Resilience Scale is a brief and reliable means to assess the ability to bounce back from stress [47]. The Perceived Stress Scale-4 is a four-item measure of individuals perceived levels of stress and ability to cope [48]. The Adverse Events Questionnaire is a brief measure designed to assess stressful events in young people, which is proven to predict subsequent depression [49]. It consists of 3 questions asking about relevant adverse experiences (bad experiences concerning academic study; bad experiences concerning relationships; other bad experiences) rated from 0 “No”, 1 “yes, happened once”, 2 “yes happened twice”, 3 “yes, happened more than twice”. A fourth item asks about minor problems or hassles ranging from 0 “minor problems” to 4 “large number of minor problems and hassles”.
Participants will be asked to complete brief measures each week for eight weeks after randomisation to provide potential mediators of change: a two-item measure of depression (PHQ-2) [50]; a two-item measure of anxiety (GAD-2) [51]; a single item measure of stress over the last week (scored 0 none to 4 very severe); six items from the Cognitive and Behavioural Response to Stress Scale [52] assessing the frequency and usefulness of use of cognitive reinterpretation, behavioural activation, and relaxation or meditation strategies; 3-item adaptations of the automaticity component of the Self-Report Habit Index [53] focused on assessing the extent to which worry and problem-solving respectively are each a habit (e.g., “something that I do automatically" “I do without thinking”) over the past seven days; 2-items from the Self-Compassion Scale-short-form [54]; 2 items from the RRS-Brooding 5-item questionnaire [40]; a one-item measure assessing self-efficacy (“In the last seven days I feel better prepared to handle situations I could not handle before” rated using a seven‐point Likert scale ranging from −3 (“absolutely not true), 0 (“neither nor”) to +3 (“absolutely true”) and a one-item measuring problem clarification (“In the last seven days, I understand myself and my problems better” rated using a seven‐point Likert scale ranging from −3 (“absolutely not true), 0 (“neither nor”) to +3 (“absolutely true”).
The following descriptive variables will be assessed only at baseline: age, gender, sexuality, year of study, course of study, family’s occupational status, country of birth.
Sample size
The sample size was calculated using the primary outcome based on a minimum clinically important difference (MCID) at primary endpoint allowing for power at 0.80 and a two sided alpha at 0.05. The primary outcome is incidence of major depression across the 12 months follow-up. Assuming that the MCID is an absolute risk reduction in incidence of major depressive episodes of 10% based on previously published consensus [55] and that incidence of major depressive episodes will be 25% in the usual practice arm, paralleling previous studies in this high-risk sample [18, 19], and assuming 20% follow-up attrition, then conservatively we require n=324 per arm, giving a total sample required of 648.
Statistical analysis plan
The primary analyses will be intention-to-treat (ITT) analyses [56] (i.e. all participants will be included in the analyses according to their randomised allocation) and based on complete case outcome data. The primary inferential analyses will compare across trial arms for the primary and continuous secondary outcomes at 12-months follow up using multilevel mixed-effect models, which enable us to examine nested hierarchies in the data (individual, intervention, university), across time (examining pre-to-post change), to capture dependencies in the data, to investigate individual trajectories (random intercepts, random slopes), and which have less restrictive assumptions re missing data.
Secondary analysis will be undertaken using both Complier Average Causal Effect models and multiple imputation:
Complier Average Causal Effect (CACE) analysis [57, 58] to provide an estimate of a treatment effect accounting for pre-specified per protocol adherence and compliance with the treatment, whilst retaining the benefits of randomisation.
Multiple imputation following the examination of the pattern of missing outcomes to impute primary and secondary continuous outcomes. Imputation models will be informed by treatment arm, baseline scores, other covariates to be included in the model, and other baseline characteristics found to predict outcome or propensity for missingness (logistic regression models will be used to investigate the associations between baseline characteristics and missingness).
Secondary analyses will be undertaken including:
Models will be estimated for the primary and secondary outcomes at 3- and 12-month follow-up and will include the covariates adjusted for in the linear regression models.
Cox regression models will be undertaken to investigate between group differences in the time until a major depressive episode.
Mediation analyses will be undertaken to gain insight into mechanisms that could explain the potential effect of the interventions on primary outcomes. We will use modern causal inference methods using structural equation modelling or parametric regression models to assess mediation effects [59]. In addition, we will investigate potential moderation of the interventions by site and history of depression.
The results of all models will be compared to primary analysis complete case ITT results.
Analyses will be undertaken by a statistician blinded to group allocation and using Stata v.17.
Organization, quality assurance and data management
Research data will be automatically collected in a pseudonymised manner through an electronic data capture system licenced/programmed by Exeter Clinical Trials Unit (CTU). In the first instance all participants will be directed to the electronic data capture system to provide their data. Participants who respond to follow-ups by telephone will have their primary outcome data entered into the system by a site researcher and this variation in data collection method will be recorded in the EDC. All data will be kept securely and confidentially and only accessed by specified researchers at the University of Exeter. The central data-management team will use de-identified backups for the monitoring of the overall progress and data quality. Ultimately, a comprehensive de-identified dataset will be produced that includes all outcome data.
Trial status
The Trial was registered in ISRCTN, number of identification 86795807. Date of registration: 27 October 2022. Recruitment commenced in July 2023 and is ongoing.
Discussion
In recent years, there has been evidence for increasing prevalence of poor mental health amongst university students, with high rates of anxiety and depression (1-5). These mental health problems have significant negative impact on students, including resulting in greater rates of university drop-out, lower grades and subsequent impact on future careers. Furthermore, many of the students who experience mental health difficulties do not receive treatment (6-8). Finding better ways to prevent the onset of common mental health problems such as depression is one necessary step to improve mental health in higher education. However, to date, there is limited evidence on effective approaches to preventing depression within university students (7-10).
Effective approaches to improve prevention need to be widely accessible and highly scalable so that they can be reach large numbers of young people. One potential approach to delivering a scalable intervention is through mobile apps (m-health) as the majority of young people regularly use mobile devices. The current study is an important contribution to this field by aiming to deliver a well-powered trial of a self-guided mobile app for university students.
Because this intervention is based on a smartphone app and is entirely self-help, without requiring support or therapist time, it has potential to be scaled up to be widely available as a public health intervention. If proven to be efficacious, this work may thus contribute to large-scale effective preventions for young people, i.e., massive open online interventions (MOOI) [23].
Acknowledgements
Not applicable.
Abbreviations
- AE
Adverse Event
- CACE
Complier average causal effect
- DMEC
Data Monitoring Ethics Committee
- DSM-IV
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition
- EDC
Electronic Data Capture System
- ExeCTU
University of Exeter Clinical Trials Unit
- GAD-7
Generalized Anxiety Disorder-7
- ITT
Intention-to-treat
- MDD
Major depressive disorder
- MI
Multiple imputations
- NIHR
National Institute for Health Research
- NRES
NHS National Research Ethics Service
- PHQ-9
Patient Health Questionnaire
- PIS
Participant Information Sheet
- RCT
randomised controlled trial
- SAE
Serious Adverse Event
- TSC
Trial Steering Committee
Authors’ contributions
EW obtained funding for the Nurture-U project and designed the trial. HC, GT contributed to the design of the Nurture-U trial. DP coordinates the trial. GT prepared the statistical analysis plan. EW, HC, MN designed and prepared the content of the self-help intervention. TC and Exeter CTU (ExeCTU) set up the logistics for the trial’s data collection. All authors contributed to the writing of the manuscript and approved the final version.
Funding
Funding for this paper was provided by the UKRI Adolescent Mental Health and Developing Minds Scheme project (MR/W002442/1) to the project titled: Developing and Evaluating a Stepped Change Whole-University approach for Student Wellbeing and Mental Health (Nurture-U). The study protocol titled “Developing and Evaluating a Stepped Change Whole-University approach for Student Wellbeing and Mental Health: trial of unguided internet rumination CBT to prevent depression and anxiety in students (Reducing Worry)” was peer-reviewed by the funding body. The study sponsor and funder have no influence on the conduct, delivery or reporting of the research. For the purpose of open access, the author has applied a ‘Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising from this submission.
Availability of data and materials
Anonymised datasets arising from this trial will be made available after the primary outcomes are published to researchers and other groups via request to a data committee within the trial consortium. The results will additionally be updated on https://www.isrctn.com/ISRCTN86795807. We plan to communicate trial results through peer-reviewed open access publications and direct reports to TSC, sponsor, and participants.
Data availability
No datasets were generated or analysed during the current study.
Declarations
Ethics approval and consent to participate
Ethical and professional guidelines will be followed at all times, in line with Good Clinical Practice guidelines. Institutional review board approval has been obtained from the FHLS Psychology Ethics Committee at the University of Exeter on 29 September 2022 (Ref: Ethics Application ID: 523085). All participants will provide electronic informed consent. Data will be collected in a pseudonymised manner and stored securely.
The study is currently using trial protocol version 2.0 dated 04 December 2023. The trial sponsor is the University of Exeter, Exeter, UK. Protocol modifications are recorded and communicated to trial partners, sponsor, review boards and Trial Steering Committee (TSC).
A Trial Steering Committee (TSC) with independent experts in ethics, psychiatry, statistics and a representative from a patient’s association will provide independent oversight of the trial and expert advice, meeting every 6 months, and ensure that it is being conducted in accordance with the principles of Good Clinical Practice and the relevant regulations. There will also be an independent Data Monitoring Committee (DMC) to review adverse events and monitor data with access to group allocation with respect to recruitment, retention, and safety, and report to the TSC. The DMEC will be responsible for monitoring serious adverse effects, protocol violations and any risks emerging from the trial. It has the capacity to conduct an unblinded analysis if concerned about serious adverse effects. Interim analyses will only be conducted at request of the DMC if there is a concern about harmful effects of intervention; based on these analyses, the DMC will make recommendations to the TSC who will decide if the trial or a particular intervention should be discontinued on the basis of participant well-being and safety.
Adverse events and other unintended effects of trial interventions or trial conduct will be self-reported on the EDC through open questions asking about any problems arising from participation, standardized questions about self-harm and symptoms at each follow up, healthcare use (including hospitalisation and emergency care) asked at the 3 and 12 month assessments, plus spontaneously reported feedback from participants. All SAEs recorded in the EDC must be reported to the ExeCTU Trial Manager within 24 working hours/1 working day of becoming aware of the event. Only serious adverse events (SAE) that are related to the trial and unexpected will be reported to the sponsor who will decide if onward reporting to the research ethics committee is required. All SAEs and Adverse Events (AEs) are collated in a report for each TSC/ DMC meeting.
The trial has a risk and safety protocol, which includes action for ancillary care for participants with mental health disorders, including signposting to help, aiding with onward referrals, and contact with a clinician in the team. The sponsor has trial insurance that has provision for compensation for those who suffer harm from trial participation, in the unlikely event it is required.
All participants will provide electronic informed consent prior to baseline assessment. All participants can discontinue allocated interventions at their own choice and request.
Consent for publication
Not applicable.
Competing interests
Prof Watkins developed the rumination-focused cognitive-behavioural therapy adapted for the digital app intervention and receives royalties from Guilford Press for sales of the associated therapy manual. The other authors declare no competing interests.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Bruffaerts R, Mortier P, Kiekens G, Auerbach RP, Cuijpers P, Demyttenaere K, Green JG, Nock MK, Kessler RC. Mental health problems in college freshmen: Prevalence and academic functioning. J Affect Disord. 2018 Jan 1;225:97-103. 10.1016/j.jad.2017.07.044. Epub 2017 Jul 25. PMID: 28802728; PMCID: PMC5846318. [DOI] [PMC free article] [PubMed]
- 2.Alonso J, Vilagut G, Mortier P, Auerbach RP, Bruffaerts R, Cuijpers P, Demyttenaere K, Ebert DD, Ennis E, Gutiérrez-García RA, Green JG, Hasking P, Lee S, Bantjes J, Nock MK, Pinder-Amaker S, Sampson NA, Zaslavsky AM, Kessler RC; WHO WMH-ICS Collaborators. The role impairment associated with mental disorder risk profiles in the WHO World Mental Health International College Student Initiative. Int J Methods Psychiatr Res. 2019 Jun;28(2):e1750. 10.1002/mpr.1750. Epub 2018 Nov 6. PMID: 30402985; PMCID: PMC6877266. [DOI] [PMC free article] [PubMed]
- 3.Duffy A, Keown-Stoneman C, Goodday S, et al. Predictors of mental health and academic outcomes in first-year university students: Identifying prevention and early-intervention targets. BJPsych Open. 2020;6(3): e46. 10.1192/bjo.2020.24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Auerbach RP, Alonso J, Axinn WG, Cuijpers P, Ebert DD, Green JG, Hwang I, Kessler RC, Liu H, Mortier P, Nock MK, Pinder-Amaker S, Sampson NA, Aguilar-Gaxiola S, Al-Hamzawi A, Andrade LH, Benjet C, Caldas-de-Almeida JM, Demyttenaere K, Florescu S, de Girolamo G, Gureje O, Haro JM, Karam EG, Kiejna A, Kovess-Masfety V, Lee S, McGrath JJ, O'Neill S, Pennell BE, Scott K, Ten Have M, Torres Y, Zaslavsky AM, Zarkov Z, Bruffaerts R. Mental disorders among college students in the World Health Organization World Mental Health Surveys. Psychol Med. 2016 Oct;46(14):2955-2970. 10.1017/S0033291716001665. Epub 2016 Aug 3. Erratum in: Psychol Med. 2017 Nov;47(15):2737. PMID: 27484622; PMCID: PMC5129654. [DOI] [PMC free article] [PubMed]
- 5.Pereira SR et al. University Student Mental Health Survey 2018: The Insight Network.
- 6.Auerbach RP, Mortier P, Bruffaerts R, Alonso J, Benjet C, Cuijpers P, Demyttenaere K, Ebert DD, Green JG, Hasking P, Murray E, Nock MK, Pinder-Amaker S, Sampson NA, Stein DJ, Vilagut G, Zaslavsky AM, Kessler RC; WHO WMH-ICS Collaborators. WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders. J Abnorm Psychol. 2018 Oct;127(7):623-638. 10.1037/abn0000362. Epub 2018 Sep 13. PMID: 30211576; PMCID: PMC6193834. [DOI] [PMC free article] [PubMed]
- 7.McIntyre JC, Worsley J, Corcoran R, Harrison Woods P, Bentall RP. Academic and non-academic predictors of student psychological distress: the role of social identity and loneliness. J Ment Health. 2018;27(3):230–9. 10.1080/09638237.2018.1437608. (Epub 2018 Feb 13 PMID: 29436883). [DOI] [PubMed] [Google Scholar]
- 8.Thorley C. Not by degrees, Improving Student Mental Health in the UK’s universities. 2017. Institute for Public Policy Research.
- 9.Andrews G, Issakidis C, Sanderson K, Corry J, Lapsley H. Utilising survey data to inform public policy: comparison of the cost-effectiveness of treatment of ten mental disorders. Br J Psychiatry. 2004;184:526–33. 10.1192/bjp.184.6.526. (PMID: 15172947). [DOI] [PubMed] [Google Scholar]
- 10.Ormel J, Kessler RC, Schoevers R. Depression: more treatment but no drop in prevalence: how effective is treatment? And can we do better? Curr Opin Psychiatry. 2019;32(4):348–54. 10.1097/YCO.0000000000000505.PMID:30855297. [DOI] [PubMed] [Google Scholar]
- 11.Ehring T, Watkins ER. Repetitive negative thinking as a transdiagnostic process. Vol. 1, International Journal of Cognitive Therapy. 2008.
- 12.Nolen-Hoeksema S, Wisco BE, Lyubomirsky S. Rethinking Rumination. Perspect Psychol Sci. 2008;3(5):400–24. [DOI] [PubMed] [Google Scholar]
- 13.Watkins ER, Roberts H. Reflecting on rumination: Consequences, causes, mechanisms and treatment of rumination. Behav Res Ther. 2020;127:1–28. [DOI] [PubMed] [Google Scholar]
- 14.Watkins ER. Constructive and Unconstructive Repetitive Thought. Psychol Bull. 2008;134(2):163–206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Watkins ER, Mullan E, Wingrove J, Rimes K, Steiner H, Bathurst N, et al. Rumination-focused cognitive-behavioural therapy for residual depression: Phase II randomised controlled trial. Br J Psychiatry. 2011;199(4):317–22. [DOI] [PubMed] [Google Scholar]
- 16.Watkins ER, Taylor RS, Byng R, Baeyens C, Read R, Pearson K, et al. Guided self-help concreteness training as an intervention for major depression in primary care: A Phase II randomized controlled trial. Psychol Med. 2012;42(7):1359–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Hvenegaard M, Moeller SB, Poulsen S, Gondan M, Grafton B, Austin SF, et al. Group rumination-focused cognitive-behavioural therapy (CBT) v. group CBT for depression: Phase II trial. Psychol Med. 2020;50(1):11–9. [DOI] [PubMed]
- 18.Topper M, Emmelkamp PMG, Watkins E, Ehring T. Prevention of anxiety disorders and depression by targeting excessive worry and rumination in adolescents and young adults: A randomized controlled trial. Behav Res Ther. 2017;1(90):123–36. [DOI] [PubMed] [Google Scholar]
- 19.Cook L, Mostazir M, Watkins E. Reducing stress and preventing depression (RESPOND): Randomized controlled trial of web-based rumination-focused cognitive behavioral therapy for high-ruminating university students. J Med Internet Res. 2019 May 1;21(5). [DOI] [PMC free article] [PubMed]
- 20.Davey GCL, Meeten F, Field AP. What’s Worrying Our Students? Increasing Worry Levels over Two Decades and a New Measure of Student Worry Frequency and Domains. Cognit Ther Res. 2022;46(2):406–19. 10.1007/s10608-021-10270-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Nolen-Hoeksema S, Stice E, Wade E, Bohon C. Reciprocal relations between rumination and bulimic, substance abuse, and depressive symptoms in female adolescents. Journal of Abnormal Psychology. 2007;116(1):198–207. 10.1037/0021-843X.116.1.198. [DOI] [PubMed] [Google Scholar]
- 22.Cuijpers P. Indirect Prevention and Treatment of Depression: An Emerging Paradigm? Clin Psychol Eur. 2021;3(4): e6847. 10.32872/cpe.6847.PMID:36398290;PMCID:PMC9667226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Muñoz RF, Bunge EL, Chen K, Schueller SM, Bravin JI, Shaughnessy EA, et al. Massive open online interventions: A novel model for delivering behavioral- health services worldwide. Clin Psychol Sci. 2016;4(2):194–205. [Google Scholar]
- 24.Statista https://www.statista.com/help/#faq52a7443e29f8d0f009000014.
- 25.Schueller SM, Muñoz RF, Mohr DC. Realizing the Potential of Behavioral Intervention Technologies. Curr Dir Psychol Sci. 2013;22(6):478–83. [Google Scholar]
- 26.Kazdin AE. Technology-Based Interventions and Reducing the Burdens of Mental Illness: Perspectives and Comments on the Special Series. Cogn Behav Pract. 2015;22(3):359–66. [Google Scholar]
- 27.Watkins ER, Nolen-Hoeksema S. A habit-goal framework of depressive rumination. J Abnorm Psychol. 2014;123(1):24–34. 10.1037/a0035540. [DOI] [PubMed] [Google Scholar]
- 28.Torous J, Roberts LW. Needed innovation in digital health and smartphone applications for mental health transparency and trust. JAMA Psychiatry. 2017;74(5):437–8. [DOI] [PubMed] [Google Scholar]
- 29.Bakker D, Kazantzis N, Rickwood D, Rickard N. Mental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments. JMIR Ment Heal. 2016;3(1): e7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Donker T, Petrie K, Proudfoot J, Clarke J, Birch M-R, Christensen H. Smartphones for Smarter Delivery of Mental Health Programs: A Systematic Review. J Med Internet Res. 2013;15(11): e247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Sucala M, Cuijpers P, Muench F, Cardoș R, Soflau R, Dobrean A, et al. Anxiety: There is an app for that. A systematic review of anxiety apps. Depress Anxiety. 2017;34(6):518–25. [DOI] [PubMed]
- 32.Torous J, Andersson G, Bertagnoli A, Christensen H, Cuijpers P, Firth J, et al. Towards a consensus around standards for smartphone apps and digital mental health. Vol. 18, World Psychiatry. 2019. p. 97–8. [DOI] [PMC free article] [PubMed]
- 33.Firth J, Torous J, Carney R, Newby J, Cosco TD, Christensen H, et al. Digital Technologies in the Treatment of Anxiety: Recent Innovations and Future Directions. Curr Psychiatry Rep. 2018;20(6):44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. Vol. 16, World Psychiatry. 2017. p. 287–98. [DOI] [PMC free article] [PubMed]
- 35.Watkins ER. Rumination-Focused Cognitive-Behavioral Therapy for Depression. New York: Guildford Publications; 2016. [Google Scholar]
- 36.Schulz KF, Altman DG, Moher D, Grp C. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. 2010;152(11):726-W293. [DOI] [PubMed] [Google Scholar]
- 37.Grant S, Mayo-Wilson E, Montgomery P, Macdonald G, Michie S, Hopewell S, et al. CONSORT-SPI 2018 explanation and elaboration: guidance for reporting social and psychological intervention trials. Trials. 2018;19:406. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Eysenbach G. CONSORT-EHEALTH Group CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions. J Med Internet Res. 2011;13(4): e126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Hopko DR, Stanley MA, Reas DL, Wetherell JL, Beck JG, Novy DM, et al. Assessing worry in older adults: confirmatory factor analysis of the Penn State worry questionnaire and psychometric properties of an abbreviated model. Psychol Assess. 2003;15(2):173–83. [DOI] [PubMed] [Google Scholar]
- 40.Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: a psychometric analysis. Cogn Ther Res. 2003;27(3):247–59. [Google Scholar]
- 41.Hankin BL, Young JF, Gallop R, Garber J. Cognitive and interpersonal vulnerabilities to adolescent depression: classification of risk profiles for a personalized prevention approach. J Abnorm Child Psychol. 2018;46(7):1521–33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Bot M, Middeldorp CM, de Geus EJC, Lau HM, Sinke M, van Nieuwenhuizen B, et al. Validity of LIDAS (LIfetime depression assessment self-report): a self- report online assessment of lifetime major depressive disorder. Psychol Med. 2017;47(2):279–89. [DOI] [PubMed] [Google Scholar]
- 43.Kroenke K, Spitzer RL, Williams JBW. The PHQ-9 - validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Stewart-Brown S, Platt S, Tennant A, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a valid and reliable tool for measuring mental well-being in diverse populations and projects. J Epidemiol Community Health. 2011;65:A38–9. [Google Scholar]
- 45.Spitzer RL, Kroenke K, Williams JBW, Lowe B. A brief measure for assessing generalized anxiety disorder - the GAD-7. Arch Intern Med. 2006;166(10):1092–7. [DOI] [PubMed] [Google Scholar]
- 46.Mundt JC, Marks IM, Shear MK, Greist JH. The work and social adjustment scale: a simple measure of impairment in functioning. Br J Psychiatry. 2002;180:461–4. [DOI] [PubMed] [Google Scholar]
- 47.Smith BW, Dalen J, Wiggins K, Tooley E, Christopher P, Bernard J. The brief resilience scale: assessing the ability to bounce back. Int J Behav Med. 2008;15(3):194–200. 10.1080/10705500802222972. [DOI] [PubMed] [Google Scholar]
- 48.Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. Journal of Health and Social Behavior. 1983;24:385–96. [PubMed] [Google Scholar]
- 49.Carver CS. Generalization, adverse events, and development of depressive symptoms. J Pers. 1998;66(4):607–19. [DOI] [PubMed] [Google Scholar]
- 50.Kroenke K, Spitzer RL, Williams JB. The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41(11):1284–92. 10.1097/01.MLR.0000093487.78664.3C. (PMID: 14583691). [DOI] [PubMed] [Google Scholar]
- 51.Kroenke K, Spitzer RL, Williams JB, Monahan PO, Löwe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med. 2007;146:317–25. [DOI] [PubMed] [Google Scholar]
- 52.Miner AS, Schueller SM, Lattie EG, Mohr DC. Creation and validation of the Cognitive and Behavioral Response to Stress Scale in a depression trial. Psychiatry Res. 2015 Dec 30;230(3):819-25. 10.1016/j.psychres.2015.10.033. Epub 2015 Oct 30. PMID: 26553147; PMCID: PMC4681670. [DOI] [PMC free article] [PubMed]
- 53.Gardner B, Abraham C, Lally P, et al. Towards parsimony in habit measurement: Testing the convergent and predictive validity of an automaticity subscale of the Self-Report Habit Index. Int J Behav Nutr Phys Act. 2012;9:102. 10.1186/1479-5868-9-102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Raes F, Pommier E, Neff KD, Van Gucht D. Construction and factorial validation of a short form of the Self-Compassion Scale. Clinical Psychology & Psychotherapy. 2011;18:250–5. [DOI] [PubMed] [Google Scholar]
- 55.Buntrock C, Ebert DD, Lehr D, Smit F, Riper H, Berking M, Cuijpers P. Effect of a Web-Based Guided Self-help Intervention for Prevention of Major Depression in Adults With Subthreshold Depression: A Randomized Clinical Trial. JAMA. 2016;315(17):1854–63. 10.1001/jama.2016.4326. (PMID: 27139058). [DOI] [PubMed] [Google Scholar]
- 56.White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trials. 2012;9(4):396–407. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Angrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Stat Assoc. 1996;91(434):444–55. [Google Scholar]
- 58.Dunn G, Maracy M, Tomenson B. Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005;14(4):369–95. [DOI] [PubMed] [Google Scholar]
- 59.Emsley R, Dunn G, White IR. Mediation and moderation of treatment effects in randomised controlled trials of complex interventions. Stat Methods Med Res. 2010;19(3):237–70. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Anonymised datasets arising from this trial will be made available after the primary outcomes are published to researchers and other groups via request to a data committee within the trial consortium. The results will additionally be updated on https://www.isrctn.com/ISRCTN86795807. We plan to communicate trial results through peer-reviewed open access publications and direct reports to TSC, sponsor, and participants.
No datasets were generated or analysed during the current study.