Abstract
Introduction
Major depressive disorder (MDD) causes significant disease burden and functional impairment during adolescence and young adulthood. While most young people recover from their first episode, around two-thirds will experience one or more relapses, which can become more severe and treatment-resistant with each episode. To address relapse in MDD, we developed a moderated online social therapy platform (titled Rebound) that integrates: (i) peer-to-peer social networking; (ii) tailored third-wave therapeutic content targeting mindfulness, self-compassion and rumination; and (iii) three types of human support (clinicians, peer workers, career consultants), informed by self-determination theory. The aim of this trial is to determine whether, in addition to treatment as usual (TAU), Rebound, an 18-month complex digital intervention, is superior to 18 months of enhanced TAU in preventing relapse and managing depressive symptoms.
Methods and analysis
This study is a rater-masked randomised controlled trial. The treatment conditions include Rebound plus TAU or enhanced TAU alone. We aim to recruit 255 young people with at least one episode of MDD, aged 14–27 years. The study includes monthly assessment points over 18 months. The study includes a 48-month recruitment period and an 18-month treatment phase. The primary outcome is depressive relapse at 18 months, as measured by the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), Research Version (SCID-5-RV). Secondary outcomes include the severity of depressive symptoms, time to relapse, time to remission, remission status, severity of anxiety symptoms, study and employment outcomes and cost-effectiveness. We will also examine four therapeutic mechanisms (mindfulness, self-compassion skills, social support and reduced rumination) to understand the ‘how and why’ of the intervention effects.
Ethics and dissemination
Melbourne Health Human Research Ethics Committee (HREC/42967/MH-2018) provided ethics approval for this study. Findings will be made available through scientific journals and forums and to the public via social media and the Orygen website.
Trial registration number
ANZCTR, ACTRN12619001412123.
Keywords: Randomized Controlled Trial, Psychosocial Intervention, Depression & mood disorders
STRENGTHS AND LIMITATIONS OF THIS STUDY.
Rebound is the first intervention to harness scalable digital technology to deliver a mindfulness-based intervention to prevent depressive relapse and manage depressive symptoms in youth diagnosed with major depressive disorder (MDD).
Rebound was developed by a multidisciplinary team in partnership with young people and clinicians, which may enhance the acceptability of the intervention.
The purpose of Rebound is to scale across and embed within youth mental health services.
The Rebound study is the longest known study (18 months) of a digital intervention addressing relapse in youth diagnosed with MDD.
Due to the nature of psychosocial interventions, participants and clinicians were not masked to treatment allocation.
Introduction
Adolescence and young adulthood are a time of forming social connections, exploring identity and engaging in work and study.1 Alongside already significant physical and emotional development, the onset and recurrence of major depressive disorder (MDD) can significantly affect a young person’s social functioning, physical health and quality of life.2 MDD is a common and often recurrent mental health condition, affecting approximately 12% of young people aged between 15 and 24 years.3 4 Globally, depression is the leading cause of disability5 and has increased in prevalence since the COVID-19 pandemic.6 Around 80% of children and young people accessing mental health services have a diagnosis of MDD.7 Depressive symptoms, alongside anxiety, represent the most common presenting problem of those accessing Australian, entry-level youth mental health services like headspace.8 While most young people recover from their first episode of MDD, around two-thirds will experience a relapse.9 The course of MDD shows a worsening pattern, with each episode occurring sooner, increasing in severity and becoming more resistant to effective treatments.10 Therefore, treatments must be timely, efficient and effective for those experiencing their first episode or who are at risk of subsequent episodes of depression. Unfortunately, even in high-income countries like Australia, the mental health system offers the opposite: delayed access to care due to limited availability of services and long waitlists and while in care, insufficient or mismatched treatments as indicated by many young people not reaching clinically significant improvement by the end of care.8 11
Digital mental health interventions may help to address systemic challenges by providing timely, accessible, evidence-based treatments.12 Digital interventions can be offered to young people while waiting for face-to-face care, during care, and on discharge and can extend the in-person ‘therapy hour’ by building on skills and concepts introduced in therapy.13 This means that digital interventions can treat current and emerging mental health disorders and support relapse prevention after remission. Moreover, digital mental health interventions are feasible and acceptable for use with young people experiencing depression.14 Digital health interventions have been shown to reduce the rate of hospital admissions and emergency service use and be both cost-saving and cost-effective for young people with serious mental ill-health over 18 months compared with treatment as usual (TAU).15 16
Despite the benefits of digital mental health interventions, engagement with and completion of online therapy content tend to be low.17 Real-time or ‘synchronous’ human support from a trained mental health professional improves engagement rates as mental health professionals can provide supportive accountability and motivational support.18 19 Furthermore, to provide an effective intervention, human support needs to lead to ‘effective’ engagement, which includes behaviour change.20 Behaviour change may also be supported by trained mental health professionals through the application of behaviour change techniques. Self-determination theory (SDT) is a theory of motivation that posits individuals are motivated in the most sustainable and healthy ways when they experience optimal levels of autonomy, competence and relatedness.21 SDT has been operationalised into evidence-based behaviour change techniques that can be applied to the provision of human support online.22
Rebound is a complex digital mental health intervention23 as it targets youth depression and prevents depressive relapse through the integration of several interacting components: (1) youth-friendly, evidence-based therapeutic content targeting mechanisms of mindfulness, self-compassion and rumination; (2) three types of human support (clinicians, peer workers and career consultants) applying evidence-based SDT-informed behaviour change techniques; and (3) a supportive online community of peers and peer workers sharing lived and living experience of mental ill-health, who aim to increase social support and decrease loneliness. Rebound has been iteratively developed with young people and a multidisciplinary team of clinicians, creative writers and developers over the past decade, using the Moderated Online Social Therapy (MOST) model.24,26 In a single-arm pilot trial (n=42), Rebound has been found to be safe, acceptable, and feasible and significantly improved depressive symptoms at a 12-week follow-up.14
The primary aims of the current study are:
To evaluate, via a randomised controlled trial (RCT), the effectiveness of the Rebound platform in preventing relapse of MDD in young people with MDD (aged 14–27 years).
To evaluate the cost-effectiveness of the Rebound platform via a concurrent within-trial economic evaluation.
To examine four therapeutic mechanisms (mindfulness skills, self-compassion, social support and reduced rumination).
The primary hypothesis is that relative to enhanced TAU, TAU plus Rebound will reduce the accumulated relapse rate over 18 months among young people with MDD. The secondary hypotheses are that relative to enhanced TAU, TAU plus Rebound will generate improvements in depressive symptoms, reduce time to relapse and time to remission, reduce remission rates, improve anxiety symptoms, and improve study and employment outcomes over 18 months; be more cost-effective; and help to prevent relapse in MDD by increasing mindfulness skills, self-compassion, social support and reducing rumination.
Method
Study design
The study design is a prospective, parallel group, rater-masked RCT. Approximately 255 participants with MDD will be allocated to either enhanced TAU or TAU in tandem with a complex moderated online social media intervention (TAU+Rebound).
The trial includes a 48-month recruitment period and an 18-month treatment phase, with the study being completed within 5.5 years. The design comprises monthly assessment points across 18 months. The protocol development addressed all aspects of Good Clinical Practice,27 CONSORT EHEALTH criteria28 and SPIRIT guidelines.29
Setting
Participant recruitment commenced in October 2019 at services in the North-Western Melbourne (Victoria, Australia) catchment, specifically the Youth Mood Clinic (YMC), a programme of Orygen Specialist Program (OSP) and headspace centres led by Orygen (in the Melbourne suburbs of Sunshine and Glenroy).30 31 Orygen is the world’s leading research and knowledge translation organisation focusing on mental ill-health in young people.
Orygen Digital, the digital mental health division of Orygen and Centre for Youth Mental Health at University of Melbourne, designs, delivers and evaluates evidenced-based digital services for youth mental health. In April 2020, Orygen Digital commenced implementation of the MOST platform across all Victorian youth mental health services as part of the Victorian State Government’s response to the COVID-19 pandemic and the recommendations of the Royal Commission into Victorian Mental Health system.11 Due to the overlap between study and implementation sites, participant recruitment from Victorian sites ceased in October 2020. Instead, satellite recruitment sites were established at headspace services in the Illawarra region, New South Wales (NSW), operated by Grand Pacific Health (Wollongong, Bega, Nowra, Goulburn) and two services within the South Eastern Sydney Local Health District (Bondi Junction Community Mental Health Centre and headspace Bondi Junction).
Patient and public involvement
The Rebound intervention has been co-designed with young people, following strict participatory design principles32 with continual feedback from young people across the development, pilot and intervention period. Consistent with best practice in developing novel interventions,33 we have obtained feedback from participants in the Rebound pilot14 about the need for more visually engaging therapy content. As a result, we have incorporated graphic narratives and comics to enhance engagement with therapy content in Rebound. Participants in the intervention group will be invited to regular focus groups with the emphasis being on feedback and questions about the intervention. More broadly, the protocol and participant information and consent forms have been reviewed by the Orygen Youth Research Council, and the investigator group carefully considered the burden of the trial schedule of assessments on participants.
Participants
Inclusion criteria for participants are: (a) age 14 to 27 years inclusive; (b) able to read and converse in English; (c) able to provide informed consent; (d) able and willing to nominate an emergency contact person, such as a close family member; (e) diagnosis of MDD (current, partial or full remission) corresponding to the current episode of care as measured by the SCID-5-RV;34 and (f) ≥ 1 episode of MDD if in partial remission at time of screening assessment or ≥2 episodes of MDD (including the current episode) if current MDD or MDD in full remission at time of screening assessment.
Exclusion criteria are: (a) inability to converse in or read English; (b) acute risk of self-harm requiring urgent intervention (ie, suicidal ideation with a current plan and intent to enact this plan) at time of screening assessment; (c) a diagnosed permanent developmental delay or intellectual disability; (d) current or past episode of mania or hypomania; and (e) previous exposure to a MOST platform.
Enrolment and randomisation
Participants are recruited from primary and specialist youth mental health services. In Victoria, study research assistants (RAs) attend weekly clinical review meetings at YMC and headspace services to identify eligible clients. In NSW, a study clinical liaison has been appointed at satellite sites to actively facilitate recruitment at the site. The study liaison attends clinical review meetings, engages with treating clinicians and screens clinical files to identify potentially eligible clients. The study liaison introduces the trial to the client and obtains consent to share contact details with Orygen. Young people can also self-refer via the study recruitment page on the Orygen website.
The RA contacts potential participants, provides a detailed explanation about the trial and offers to answer questions. All participants are required to provide informed, signed consent. Parental or legal guardian consent is required for participants under 18 years of age. Once consent is obtained, the participant is enrolled in the trial and a screening assessment to assess eligibility is conducted by the RA. Once eligibility is established, the baseline assessment is completed. After completing the baseline assessment, the participant is randomised by the RA via a secure online Research Project Management System (RPMS). The RPMS sends an automated email to the study coordinator and principal investigator, notifying them of the outcome of randomisation. The study coordinator informs the participant of the allocation. Participants are reimbursed for their time for each assessment completed.
The randomisation schedule is generated by a statistician independent of the study, programmed in the RPMS and not accessible by the study team. Participants are randomly assigned to the treatment condition via the RPMS using randomly permutated blocks with a 1:1 allocation ratio. Participants are stratified by current MDD status (current, partial or full remission), number of previous MDD episodes (≤ 2 or ≥ 3), age (<18 years and ≥18 years), sex at birth and by treatment centre.
Enhanced treatment as usual (TAU)
TAU consists of a range of treatment options delivered by the treating service prior to discharge30 31 and/or generic medical or mental health services typically available to young people in the absence of enrolment in the study. These can include follow-up by a general practitioner, private psychiatrist, primary care youth mental health services or adult mental health services, which deliver multidisciplinary psychiatric care (including medical follow-up, case management and acute psychiatric care as appropriate). Online psychoeducation is also offered to those allocated to enhanced TAU to match the additional support offered to the intervention group. Psychoeducation is beneficial as an adjunctive treatment for depression and is readily translated into web-format.35 The study team developed a web application called ‘Empower Your Mood’ (EYM) that includes psychoeducation modules on depression symptoms, causes and course, behaviour and mood, information on diet, exercise, sleep, social support and getting support. In contrast to the Rebound platform, EYM is a static website and does not include clinician support or an online community. All modules are available for 18 months to match the Rebound intervention’s timeframe.
Intervention
Rebound is a complex, multicomponent intervention23 based on the MOST model.1415 24,26 The design of Rebound considers SDT principles to best support intrinsic motivation36 (see table 1). Each component of Rebound will be introduced in turn.
Table 1. Self-determination theory (SDT)-informed platform features.
SDT principle | Brief definition | Moderated Online Social Therapy platform feature |
Autonomy | Freely chosen actions, including genuine interest, value and appreciation for the activity | Personalised approach and flexibility in support and content options |
Competence | A sense of growth through progressive mastery over a task | Bite-sized therapeutic content, demonstrating progress in content completion, toolkit of saved items |
Relatedness | Meaningful and supportive bi-directional social connections | Online community and talking points |
Therapeutic content
To scaffold the building of competence, the therapeutic content on Rebound is presented in ‘bite-size’ chunks—thematically related ‘activities’ that are organised into ‘tracks’—that are clustered within ‘journeys’. There are five activity types: comics, reflective actions, actions, talking points and pages. Comics are illustrated multipaneled narratives that bring therapeutic concepts to life via recurring characters and story (see figure 1 for an excerpt), reflective actions provide a clear prompt for reflection, actions suggest a practical step (eg, behavioural experiment), talking points prompt young people and peer workers to post their thoughts and reactions to the content, and pages summarise each track and provide psychoeducation. Users have the option to save activities to a ‘toolkit’, so they have an accessible, personalised and labelled bank of strategies when needed.
Rebound includes five ‘journeys’, each with a different focus: managing depression (‘Improve Your Mood’), managing anxiety (‘Find Your Calm’), overcoming social anxiety (‘Find Your Confidence’), managing insomnia (‘Feeling Tired’) and enhancing social functioning (‘Social Hacks’). There is also one journey based on work and study-related issues. Users can access one journey at a time and on-demand ‘Explore’ activities alongside their journey.
Participants randomised to the TAU+Rebound condition are initially offered the Improve Your Mood journey, which adopts a trans-therapeutical approach to depressive relapse prevention using Mindfulness-Based Cognitive Therapy, Acceptance and Commitment Therapy and Cognitive Behavioural Therapy principles. The Improve Your Mood journey contains over 50 activities, which are available over the 18 months of the trial. The Improve Your Mood journey targets rumination and worry, behavioural inactivation and avoidance by introducing the following strategies: mindfulness, behavioural activation, values, defusion, cognitive restructuring, acceptance, self-compassion and gratitude.
Peer-to-peer online social networking (‘the community’)
The online ‘community’ allows young people and peer workers to develop a profile listing their interests (‘members’ page) and to post text, images and links (‘feed’ page). On the community feed, peer workers post regularly about their lived and living experience of mental health (see figure 2) and contribute ice breaker–type posts about their interests. When contributing a post to the feed, users also have the option to apply the ‘vent’ function to the post, which allows users to include certain offensive words (most commonly swear words) that would otherwise be blocked by the MOST system. Vent posts are by default collapsed in the feed so that their viewing is optional, and other users who wish to see such posts are required to click expand to view them. Users may ‘react’ (eg, ‘I get you’, ‘thinking of you’) or comment in response to a post. The community is designed to facilitate social support and enhance relatedness.
The community also includes Talk it Out (TiO), a structured problem-solving function that steps a young person through developing a question (eg, How can I manage stress?), provides an opportunity for the young person to crowdsource solutions and checks in with their progress. TiO was informed by the Social Problem-Solving Framework.37
Human support
There are three types of human support (or ‘moderation’) offered via Rebound: clinicians, peer workers and career consultants. These moderators work together to provide care for each user of Rebound using SDT-informed engagement strategies (see table 2). Rebound moderators meet fortnightly as a whole team and weekly in discipline-specific groups to review engagement on the platform and revise SDT-related strategies to support motivation. Moderators can also communicate with one another via chat messaging and activity logs on Rebound.
Table 2. Self-determination theory (SDT)-informed engagement strategies22.
SDT concept | Strategies22 | Relevance to moderation on Rebound |
Autonomy | Use non-judgemental language that suggests, rather than demands.Note sources of internal and external pressure.Encourage the user to develop their own understanding of their mental health.Provide a clear rationale for suggestions.Explore the user’s values and aspirations.Provide choices (including the choice not to change).Encourage experimentation with new skills, with debriefing. | Clinical formulation development.Encouraging reflection in 1:1 interactions.Moderation team being mindful to not place pressure on user in interactions.Explore sources of internal/external pressure in 1:1 interactions, particularly with peer work/clinicians.Create culture within moderation team of speaking to one another non-judgementally and then spread culture to platform.Apply strategies to goal setting on platform.Link journey/platform engagement to values.Develop shared rationale for journey/platform engagement.Provide choices about goal setting, journey tailoring, mode and frequency of contact.Support engagement in reflective actions.Encourage light, fun and experimental actions. |
Competence | Discuss barriers and how to overcome them.Clarify goals.Support the user to set realistic goals.Validate progress being made.Support the user to develop a plan to meet their goals.Encourage the user to self-monitor progress.Explore dealing with unhelpful internal and external pressure. | Ensure user knows that you are figuring out the barriers together—reduces power imbalance.Complete part of journey with user to identify and troubleshoot barriers in real time.Clinicians help user to identify what they expect of themselves and encourage consideration of what they have capacity for.Peer workers share experiences of process of change.Clinicians and career consultants help user to set personalised and realistic goals on a realistic timeline.Clarify differences between long-term and short-term goals.Clarify differences between goal-setting on MOST vs other types of support (eg, face-to-face).Career consultants provide feedback on resumes and cover letters.Clinicians provide encouragement and validation when progress made (eg, completion of activities).Clinicians provide feedback on reflective actions and skill development (eg, mindfulness); user identifies strengths through questionnaire, and moderators can identify and point out strengths in action.Setting realistic amounts of activity on platform per day (eg, 2 min, one activity) in order to meet longer term goals (eg, complete journey).Using non-controlling language, acknowledging the present ‘capacity’ of the user.Reminding them of when they have overcome pressure in the past.Encouraging them to explore what is internal/external pressure.Ask questions to prompt reflection on why they are doing what they're doing—align with core values.Provide a rationale for why we are asking user to engage.Acknowledge pressure that can be experienced.Provide information about work rights.Encourage boundaries. |
Relatedness | Respect the user’s perspective.Encourage the user to ask questions.Demonstrate unconditional positive regard.Demonstrate genuine interest in the user.Listen empathetically.Check the user’s available supports and link them in to support where needed. | Provide validation and empathy in all interactions.Validate before jumping to problem-solving.Encourage user to ask questions of moderators and in the community, particularly using TalkitOut.Encourage self-reflection on progress.Build trust so that user feel comfortable asking questions.Regularly ask if user have any questions.Unconditional positive regard in all interactions.Genuine interest in all interactions.Offer choices for types of support.Check in on supports later in user’s time on platform.Assess supports during welcome call/initial interactions with user.Career consultants refer user to external supports and resources as needed. |
Clinicians. Each young person on Rebound is allocated a qualified mental health clinician (eg, clinical psychologist, social worker) with experience working with young people. During the initial ‘welcome call’, clinicians welcome young people to the platform, provide a platform orientation, support goal setting and develop a formulation. After this, clinicians contact the young person weekly for 12 months (via phone/SMS/chat) to support engagement with therapy content, suggest and tailor therapy content, and act as a liaison between the young person and other forms of human support. In their final 6 months, clinicians reduce contact to monthly.
To maintain usability, relevance and uptake of content, clinical moderators tailor journey content to each user’s immediate needs. Tailoring is also based on the user’s remission status. For example, for participants who are actively depressed, activities related to behavioural activation/motivation, sleep hygiene and avoidance may be prioritised, while those in full remission may focus on mindfulness, values/strengths, wellness planning and developing their toolkit. Cognitive strategies (ie, restructuring, defusion) and self-compassion are addressed regardless of remission status. Users may also choose to switch to a different journey in consultation with their allocated clinician.
Importantly, the clinician monitors the clinical status of young people in their caseload and conducts twice-daily safety checks of the platform. The clinical team meet weekly for peer supervision. Clinicians complete fidelity checklists bi-monthly and discuss their self-identified strengths and weaknesses during supervision to strengthen fidelity to the moderation model and processes.
Peer workers. Peer workers are trained young people with lived and living experience of mental ill-health. Peer workers are integral to the provision of social support via Rebound—a proposed mechanism of action in the study (eg,38 Peer workers moderate the online ‘community’ and chat with young people on the platform. Peer workers also lead monthly online ‘hangouts’ to reinforce connections. The peer work model is also designed to normalise experiences, counteract stigma, and promote platform engagement.
Career consultants. Career consultants provide specialised support for work and study issues via phone and chat including support with job applications, interviews and career assessments.
Safety protocol
The safety protocol is comprised of three levels of security including: (1) system and privacy protection; (2) online safety and (3) clinical safety.
The Rebound platform is hosted on an Amazon Web Services web server. Amazon Web Services and Orygen Digital meet standards of responsible business practice. Identity management and networking are handled by Orygen Digital’s Engineering Department according to Orygen (National) Standards, which meet Australian research requirements. In addition, MOST has a wide range of measures to secure the application and database against unauthorised access. These measures conform to industry best practice as defined by the Open Web Application Security Project (www.OWASP.org). Privacy and online safety are managed in accordance with the Australian Communications and Media Authority.
At onboarding, the Rebound clinician carries out an initial orientation with Rebound participants, including details of the terms of use. Participants are required to accept and comply with the guidelines for safe use of Rebound. When needed, participants are offered guidance on appropriate usage of the system. All users are asked to nominate an emergency contact person, such as a close family member. Rebound includes a ‘report function’ that enables young people to report a concern about any material posted by a user. The moderator assesses the report and responds accordingly, which may include removing material and, in some cases, deactivating or restricting the poster person’s account. Participants are also able to hide their profile and activity should they become concerned about their privacy.
Clinical risk is managed through both manual and automated procedures. First, clinical moderators monitor the system two times per day on weekdays and one time per day on weekends for evidence of clinical risk or deterioration. Any detected increased risk activates the Rebound risk and safety protocol, which includes one or more of the following: a risk assessment with the young person, informing the research team, alerting the emergency contact nominated by the participant and liaising with suitable emergency services where necessary. In addition, the system incorporates visible emergency guidelines and contact information. Finally, Rebound includes an automated keyword detection function, which activates each time a participant posts a contribution indicative of clinical risk or that contains potentially offensive words. The function blocks posts with notifications sent to the young person and the moderator, who can ‘unblock’ the post should they determine it unproblematic.
In the event of a clinically significant deterioration of symptoms, increased risk of suicide or a hospital admission, a clinical moderator performs an assessment to determine the risks and benefits of a temporary withdrawal from Rebound. Based on this assessment, and in consultation with the young person, the clinical moderation team determines whether their account is temporarily suspended, or their level of access is restricted. Following suspensions or restrictions to a user’s account, the clinician will contact the young person at monthly intervals to ascertain whether the account is to be reactivated.
Outcome measures
Multiple methods will be employed to assess study outcomes (see table 3). These include independent observer ratings, self-report and usage data from the Rebound system.
Table 3. Schedule of outcomes and measures.
Screening/baseline | 3 months | 6 months | 9 months | 12 months | 15 months | 18 months | ||
Primary outcome and measure | ||||||||
Relapse of MDD (SCID-5-RV: depression module) | x | x | x | x | x | x | x | |
Secondary outcomes and measures | ||||||||
Depressive symptoms (QIDS-SR) | Monthly | |||||||
Time to relapse (SCID-5-RV: depression module) | x | x | x | x | x | x | x | |
Time to remission (SCID-5-RV: depression module) | x | x | x | x | x | x | x | |
Rate of remission (SCID-5-RV: depression module) | x | x | x | x | x | x | x | |
Time in remission (SCID-5-RV: depression module) | x | x | x | x | x | x | x | |
Anxiety (GAD-7) | x | x | x | x | ||||
Vocational status (RUQ) | x | x | x | x | ||||
Cost-effectiveness (RUQ) | x | x | x | x | ||||
Therapeutic mechanisms and measures | ||||||||
Mindfulness skills (FMI) | x | x | x | x | ||||
Self-compassion (SCS-SF) | x | x | x | x | ||||
Social support (SPS) | x | x | x | x | ||||
Rumination (RRS-SF) | x | x | x | x | ||||
Exploratory outcomes and measures | ||||||||
Stress (PSS) | x | x | x | x | ||||
Social anxiety (LSAS) | x | x | x | x | ||||
Loneliness (UCLA Loneliness Scale) | x | x | x | x | ||||
Self-efficacy (Self-Efficacy Scale) | x | x | x | x | ||||
Self-esteem (Rosenberg SES) | x | x | x | x | ||||
Social and general functioning (SOFAS) | x | x | x | x | ||||
Suicidal ideation and attempts in past 6 months (CSSRS) | x | x | x | x | ||||
Deliberate self-harm (Risk Taking and Self-Harm Inventory†) | x | x | x | x | ||||
Psychological well-being (BPNSS) | x | x | x | x | ||||
Quality of life (AQoL-8D) | x | x | x | x | ||||
Behavioural activation (BADS-SF) | x | x | x | x | ||||
Sleep quality (PSQI) | x | x | x | x | ||||
Strengths use (SUS) | x | x | x | x | ||||
Medication adherence (RUQ)* | x | x | x | x | ||||
Substance use (ASSIST)* | x | x | x | x | ||||
Digital phenotype (AWARE-Light) | Continuous | |||||||
Affective and cognitive reactivity and social support (SEMA3 application) | Daily | |||||||
Intervention group-only outcomes and measures | ||||||||
Intervention acceptability (qualitative evaluation via semistructured interview) | x | |||||||
Therapeutic alliance (WAI-C, WAI-T) | x | x | x | x | ||||
Intervention use (ie, frequency, duration, pattern) | Continuous |
Potential covariates.
Risk Taking and Self-Harm Inventory for Adolescents.
AQoL-8DAssessment of Quality of Life - 8 DimensionsASSISTAlcohol, Smoking and Substance Involvement Screening Test BADS-SFBehavioural Activation for Depression Scale-short formBPNSSBasic Psychological Needs Satisfaction ScaleCSSRSColumbia-Suicide Severity Rating ScaleFMIFreiburg Mindfulness InventoryGAD-7Generalized Anxiety Disorder 7-item scaleLSASLiebowitz Social Anxiety ScaleMDDmajor depressive disorderPSQIPittsburgh Sleep Quality IndexPSSPerceived Stress ScaleQIDS-SRQuick Inventory of Depressive Symptomatology-Self-ReportRRS-SFRuminative Responses Scale - short formRUQResource Use QuestionnaireSCID-5-RVStructured Clinical Interview for DSM-5 Disorders, Research VersionSCS-SFSelf-Compassion Scale Short FormSEMA3Smartphone Ecological Momentary AssessmentSESSelf-Esteem ScaleSOFASSocial and Occupational Functioning Assessment ScaleSPSSocial Provisions ScaleSUSStrengths Use ScaleUCLAUCLA Loneliness Scale (Version 3)WAI-CWorking Alliance Inventory client versionWAI-TWorking Alliance Inventory therapist version
Primary outcome and measure
The primary outcome is relapse rate (accumulated over 18 months) of MDD. Relapse will be defined as a return, for at least 2 weeks, of symptoms sufficient to meet DSM-5 criteria for MDD (as determined by the SCID-5-RV)34 at any time in the 18 months post randomisation. This definition of relapse is the one most commonly used in clinical studies.39 Measurement of relapse will be carried out every 3 months (ie, at 3, 6, 9, 12, 15 and 18 months). Telephone administration of the SCID is a valid method for measuring MDD.40 Data from the Quick Inventory of Depressive Symptomatology Self-Report41 may also be used to supplement the SCID assessment. A number of strategies will be embedded to promote participant retention, including a generous assessment window, flexible availability of RAs, minimal data collection at most timepoints and honing RA interview skills to minimise time commitment at larger assessment points.
Secondary outcomes and measures
Secondary outcomes and measures include:
Depressive symptoms will be measured by the QIDS self-report instrument41 monthly for 18 months.
Time to relapse will be derived from the SCID-5-RV (Module A: Mood Episodes) at 3, 6, 9 12, 15 and 18 months.
Time to remission will be derived from the SCID-5-RV (Module A – Mood Episodes) at 3, 6, 9, 12, 15 and 18 months.
Rate of remission will be derived from the SCID-5-RV (Module A – Mood Episodes) at 3, 6, 9, 12, 15 and 18 months.
Time in remission will be derived from the SCID-5-RV (Module A: Mood Episodes) at 3, 6, 9, 12, 15 and 18 months.
Anxiety will be measured by the Generalized Anxiety Disorder 7-item scale42 at baseline, 6, 12 and 18 months.
Vocational status will be self-reported by participants at baseline, 6, 12 and 18 months (including the participant’s report of employment and educational activities in between assessments).
Cost-effectiveness will be assessed using a self-reported Resource Use Questionnaire (RUQ) to determine the broader resource use of participants (eg, community mental health services, hospitalisations, work and educational impacts) and the Assessment of Quality of Life - 8 Dimensions (AQoL-8D) questionnaire, which measures health-related quality of life and can be used to calculate quality-adjusted life years (QALYs).43
Measures of therapeutic mechanisms
Therapeutic mechanisms include: mindfulness skills, measured by the Freiburg Mindfulness Inventory;44 self-compassion, measured by the Self-Compassion Scale Short Form;45 rumination, measured by the Ruminative Responses Scale-Short Form;46 and social support, measured using the Social Provisions Scale.47 Measures are administered at baseline, 6, 12 and 18 months.
Other measured outcomes
Additional exploratory outcomes, potential covariates and intervention-only outcomes are outlined in table 3.
Data analysis and management
Sample size
Sample size was determined by power analysis using G*Power 3. The primary outcome is difference in accumulated relapse rate over 18 months. A previous relapse prevention study in youth MDD reported a relapse rate at an 18-month follow-up of 62% for TAU and 36% in the relapse prevention group (OR=2.9).48 Since Rebound will be compared against an enhanced TAU, we assume a smaller effect (OR=2.5), for which a total sample of 192 people is required to achieve 85% power (alpha=0.05). A total of 255 participants will be recruited, allowing for a 25% attrition rate. This compares favourably with the attrition rates in the Rebound pilot (7%) and is comparable at an 18-month follow-up to the Horyzons RCT (25%).14 15
Data management
The RPMS is used to manage all outcome data. The RPMS includes an electronic Case Report Form (eCRF). The RAs record participant-level data on an eCRF. These data are subsequently entered into the eCRF section of the RPMS. Self-report data are entered directly by the participant. The RPMS is accessed using a secure website and is stored on a secure server. It is designed to maintain the privacy and confidentiality of participant information and to ensure the integrity of the data. Access to RPMS is restricted to study personnel, and the level of access is dependent on the person’s role.
Analysis of outcomes
Primary analyses will be undertaken on an intention-to-treat basis. Group differences in accumulated relapse rate at 18 months (primary outcome) will be tested using Fisher’s exact test. The Cox proportional hazards regression model (survival analysis) will be used to model time to relapse and rate of remission in each group, which will also be used to derive the hazard function reflecting the instantaneous probability of relapse/remission at any time over the 18-month follow-up.49 Finally, group differences (Rebound plus TAU vs enhanced TAU) in change over time in the continuous secondary outcomes across the 18-month follow-up will be examined using random-effects models. Random-effects models allow for estimation of between-person differences (ie, group effects) in within-person slopes (ie, change trajectories in secondary outcomes) and are the preferred methods for analysing clinical trial data.50
Mechanism of action analyses will be conducted using a multilevel structural equation modelling framework to assess mediation.51 Specifically, person-specific slopes representing change over time in the proposed mechanism-of-action variables will be examined as mediators of the effect of treatment group (Rebound vs control) on risk of relapse.
Additional analyses will use multiple imputation to assess the robustness of the findings to the choice of method for handling missing data. Additional comparisons between treatment groups based on completers-only analyses will be conducted. Analyses will be undertaken in accordance with The International Council for Harmnonisation (ICH) 9 guidelines including a full analysis as well as per protocol set. The per protocol sample will be defined based on receiving a prespecified minimal exposure to the online intervention (ie, more than 16 logins over the 18-month intervention period).
The economic evaluation will comprise a cost-consequences analysis comparing the incremental costs of the Rebound platform (vs treatment as usual) to a wide range of incremental study outcomes (eg, QALYs, relapse rate). Inclusion of the AQoL-8D questionnaire facilitates the derivation of QALYs and enables a cost-utility analysis to be undertaken. A study-specific RUQ was adapted for this study from another RUQ frequently used in Australian mental health-related economic evaluations.52 The RUQ encompasses: community-based health service use; hospitalisations; accommodation services; medication and diagnostic tests; impacts on education and employment; and other relevant services. Best practice within-trial economic evaluation methods will be adopted53; and the comparative cost-effectiveness of the Rebound platform (vs treatment as usual) will be summarised using the incremental cost-effectiveness ratio metric (eg, cost per QALY). If the Rebound platform is found to be effective, then the lifetime and population cost-effectiveness of the intervention will be evaluated using modelling techniques.
Monitoring
Adverse events will be recorded throughout the trial and serious adverse events will be reported to the sponsor (Orygen). The study was assessed as low risk by the sponsor, and a trial management group will be established in place of a data monitoring committee. The sponsor monitoring plan includes an initial monitoring visit early in the recruitment phase which will determine the ongoing monitoring schedule. Discontinuation of the study will be considered where:
A participant attempts suicide, and it is highly likely that the attempt was caused by the Rebound intervention.
There are repeated instances of participants notifying moderators about triggering or distressing content posted by other users.
Decisions about study discontinuation will be determined by the trial management group in consultation with the sponsor.
Discussion
Accessible, timely and evidence-based treatments are imperative to meet the demands of the present youth mental health crisis.4 54 Rebound is a complex digital intervention;23 unique in its length (18 months); engagement principles (using SDT-informed strategies and a multidisciplinary approach); and presentation of youth-friendly, third-wave mindfulness-based content. It is the first accessible, scalable treatment to prevent relapse in youth MDD, addressing a major gap in public youth mental health services. The study includes: an active control group, an extended follow-up, cost-effectiveness analysis and evaluation of theory-driven mechanisms of action. This is likely to advance models of relapse in youth depression and inform future intervention development.
Furthermore, the findings of this study serve to advance our knowledge of digital adaptations of mindfulness-based approaches and how to best engage young people online and prevent depressive relapse. If the trial is successful, there is a clear translation pathway for findings to the rollout of MOST.13 Recruitment of trial participants was finalised in September 2023. Follow-up assessments will conclude in March 2025.
Dissemination
Findings will be made available through scientific journals and forums and to the public via social media and the Orygen website. De-identified individual participant data will be available after publication for 3 years via the Health Data Australia catalogue (https://www.researchdata.edu.au/health). Requests must include a methodologically sound proposal. Specific conditions of use may apply and will be specified in a data sharing agreement (or similar) that the requester must agree to before access is granted (online supplemental file 1). Study protocol, informed consent material and statistical analysis plan will also be available.
supplementary material
Acknowledgements
The authors wish to thank the Orygen Youth Advisory Council for their input into the development of Rebound. The authors thank the moderation team (Hailey, Winn, McKenzie, Harmony, Benji, James, Emily, Annette, Connor, Evan and Ingrid) and research assistants (Jordan, Rory, Sasha, Lauren, Sheryl and Pemma) for their valuable contributions to the study.
Footnotes
Funding: The Rebound trial was supported by a grant from the National Health and Medical Research Council (NHMRC ID# 2018/GNT1144563) from the Australian Government. MA-J was supported by an Investigator Grant (APP1177235) from the National Health and Medical Research Council and a Dame Kate Campbell Fellowship from The University of Melbourne.
Prepublication history and additional supplemental material for this paper are available online. To view these files, please visit the journal online (https://doi.org/10.1136/bmjopen-2024-088695).
Provenance and peer review: Not commissioned; internally peer reviewed.
Patient consent for publication: Not applicable.
Patient and public involvement: Patients and/or the public were involved in the design, conduct, reporting or dissemination plans of this research. Refer to the Methods section for further details.
Contributor Information
Shaminka N Mangelsdorf, Email: shaminka.mangelsdorf@orygen.org.au.
Daniela Cagliarini, Email: daniela.cagliarini@orygen.org.au.
Yong Yi Lee, Email: yongyi.lee@monash.edu.
Cathrine Mihalopoulos, Email: cathy.mihalopoulos@monash.edu.
Virginia Liu, Email: virginia.liu@orygen.org.au.
Lee Valentine, Email: lee.valentine@orygen.org.au.
Sarah Bendall, Email: Sarah.bendall@orygen.org.au.
Peter Koval, Email: p.koval@unimelb.edu.au.
Simon D'Alfonso, Email: dalfonso@unimelb.edu.au.
Christopher Davey, Email: chris.davey@unimelb.edu.au.
Penni Russon, Email: penni.russon@unimelb.edu.au.
Jess Phillips, Email: jess.phillips@monash.edu.
Cesar Gonzalez-Blanch, Email: cesar.gonzalezblanch@scsalud.es.
Brendan Pawsey, Email: bpawsey@mercy.org.au.
Richard M Ryan, Email: Richard.Ryan@acu.edu.au.
Alexandra Parker, Email: alex.parker@vu.edu.au.
Sarah Hetrick, Email: s.hetrick@auckland.ac.nz.
Simon Rice, Email: simon.rice@orygen.org.au.
Reeva Lederman, Email: reeva.lederman@unimelb.edu.au.
Helen Herrman, Email: helen.herrman@orygen.org.au.
Greg Murray, Email: gwm@swin.edu.au.
John Gleeson, Email: John.Gleeson@acu.edu.au.
Mario Alvarez-Jimenez, Email: mario.alvarez@orygen.org.au.
References
- 1.Larson RW, Verma S. How children and adolescents spend time across the world: work, play, and developmental opportunities. Psychol Bull. 1999;125:701–36.:701. doi: 10.1037/0033-2909.125.6.701. [DOI] [PubMed] [Google Scholar]
- 2.Naicker K, Galambos NL, Zeng Y, et al. Social, demographic, and health outcomes in the 10 years following adolescent depression. J Adolesc Health. 2013;52:533–8. doi: 10.1016/j.jadohealth.2012.12.016. [DOI] [PubMed] [Google Scholar]
- 3.Australian Bureau of Statistics National Health Survey: First results 2017-18 n.d.
- 4.Herrman H, Patel V, Kieling C, et al. Time for united action on depression: a Lancet–World Psychiatric Association Commission. The Lancet. 2022;399:957–1022. doi: 10.1016/S0140-6736(21)02141-3. [DOI] [PubMed] [Google Scholar]
- 5.Organization WH . Depression and Other Common Mental Disorders: Global Health Estimates. Geneva, Switzerland: 2017. [Google Scholar]
- 6.Racine N, McArthur BA, Cooke JE, et al. Global Prevalence of Depressive and Anxiety Symptoms in Children and Adolescents During COVID-19: A Meta-analysis. JAMA Pediatr. 2021;175:1142–50. doi: 10.1001/jamapediatrics.2021.2482. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Johnson SE, Lawrence D, Hafekost J, et al. Service use by Australian children for emotional and behavioural problems: Findings from the second Australian Child and Adolescent Survey of Mental Health and Wellbeing. Aust N Z J Psychiatry. 2016;50:887–98. doi: 10.1177/0004867415622562. [DOI] [PubMed] [Google Scholar]
- 8.Rickwood D, McEachran J, Saw A, et al. Sixteen years of innovation in youth mental healthcare: Outcomes for young people attending Australia’s headspace centre services. PLoS One. 2023;18:e0282040. doi: 10.1371/journal.pone.0282040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Kiviruusu O, Strandholm T, Karlsson L, et al. Outcome of depressive mood disorder among adolescent outpatients in an eight-year follow-up. J Affect Disord. 2020;266:520–7. doi: 10.1016/j.jad.2020.01.174. [DOI] [PubMed] [Google Scholar]
- 10.Kendler KS, Thornton LM, Gardner CO. Stressful Life Events and Previous Episodes in the Etiology of Major Depression in Women: An Evaluation of the “Kindling” Hypothesis. AJP. 2000;157:1243–51. doi: 10.1176/appi.ajp.157.8.1243. [DOI] [PubMed] [Google Scholar]
- 11.Victoria So. Summary and recommendations; 2021. Royal commission into victoria’s mental health system. [Google Scholar]
- 12.Bond RR, Mulvenna MD, Potts C, et al. Digital transformation of mental health services. Npj Ment Health Res. 2023;2:13. doi: 10.1038/s44184-023-00033-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cross SP, Nicholas J, Bell IH, et al. Integrating digital interventions with clinical practice in youth mental health services. Australas Psychiatry. 2023;31:302–5. doi: 10.1177/10398562231169365. [DOI] [PubMed] [Google Scholar]
- 14.Rice S, Gleeson J, Davey C, et al. Moderated online social therapy for depression relapse prevention in young people: pilot study of a “next generation” online intervention. Early Interv Psychiatry. 2018;12:613–25. doi: 10.1111/eip.12354. [DOI] [PubMed] [Google Scholar]
- 15.Alvarez-Jimenez M, Koval P, Schmaal L, et al. The Horyzons project: a randomized controlled trial of a novel online social therapy to maintain treatment effects from specialist first-episode psychosis services. World Psychiatry. 2021;20:233–43. doi: 10.1002/wps.20858. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Engel L, Alvarez-Jimenez M, Cagliarini D, et al. The Cost-Effectiveness of a Novel Online Social Therapy to Maintain Treatment Effects From First-Episode Psychosis Services: Results From the Horyzons Randomized Controlled Trial. Schizophr Bull. 2024;50:427–36. doi: 10.1093/schbul/sbad071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Garrido S, Millington C, Cheers D, et al. What Works and What Doesn’t Work? A Systematic Review of Digital Mental Health Interventions for Depression and Anxiety in Young People. Front Psychiatry. 2019;10:759. doi: 10.3389/fpsyt.2019.00759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Mohr DC, Cuijpers P, Lehman K. Supportive Accountability: A Model for Providing Human Support to Enhance Adherence to eHealth Interventions. J Med Internet Res. 2011;13:e30. doi: 10.2196/jmir.1602. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Werntz A, Amado S, Jasman M, et al. Providing Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-review. J Med Internet Res. 2023;25:e42864. doi: 10.2196/42864. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Yardley L, Spring BJ, Riper H, et al. Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions. Am J Prev Med. 2016;51:833–42. doi: 10.1016/j.amepre.2016.06.015. [DOI] [PubMed] [Google Scholar]
- 21.Ryan RM, Duineveld JJ, Di Domenico SI, et al. We know this much is (meta-analytically) true: A meta-review of meta-analytic findings evaluating self-determination theory. Psychol Bull. 2022;148:813–42. doi: 10.1037/bul0000385. [DOI] [Google Scholar]
- 22.Teixeira PJ, Marques MM, Silva MN, et al. A classification of motivation and behavior change techniques used in self-determination theory-based interventions in health contexts. Motiv Sci. 2020;6:438–55. doi: 10.1037/mot0000172. [DOI] [Google Scholar]
- 23.Skivington K, Matthews L, Simpson SA, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:2061.:n2061. doi: 10.1136/bmj.n2061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Alvarez-Jimenez M, Rice S, D’Alfonso S, et al. A Novel Multimodal Digital Service (Moderated Online Social Therapy+) for Help-Seeking Young People Experiencing Mental Ill-Health: Pilot Evaluation Within a National Youth E-Mental Health Service. J Med Internet Res. 2020;22:e17155. doi: 10.2196/17155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Cross S, Nicholas J, Mangelsdorf S, et al. Developing a Theory of Change for a Digital Youth Mental Health Service (Moderated Online Social Therapy): Mixed Methods Knowledge Synthesis Study. JMIR Form Res. 2023;7:e49846. doi: 10.2196/49846. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Lederman R, Wadley G, Gleeson J, et al. Moderated online social therapy: Designing and evaluating technology for mental health. ACM Trans Comput Hum Interact. 2014;21:1–26. [Google Scholar]
- 27.Administration TG . ICH Guideline for Good Clinical Practice. Canberra: Commonwealth Department of Health and Aged Care; 2018. [Google Scholar]
- 28.Eysenbach G, Group C-E. CONSORT-EHEALTH: Improving and Standardizing Evaluation Reports of Web-based and Mobile Health Interventions. J Med Internet Res. 2011;13:e126. doi: 10.2196/jmir.1923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Chan A-W, Tetzlaff JM, Altman DG, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7. doi: 10.7326/0003-4819-158-3-201302050-00583. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Rice SM, Halperin S, Cahill S, et al. The Youth Mood Clinic: an innovative service for the treatment of severe and complex depression. Australas Psychiatry. 2017;25:112–6. doi: 10.1177/1039856216689002. [DOI] [PubMed] [Google Scholar]
- 31.Rickwood D, Paraskakis M, Quin D, et al. Australia’s innovation in youth mental health care: The headspace centre model. Early Interv Psychiatry. 2019;13:159–66. doi: 10.1111/eip.12740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Hagen P, Collin P, Metcalf A, et al. Participatory Design of Evidence-Based Online Youth Mental Health Promotion, Intervention and Treatment. Abbotsford, Victoria, Australia: Western Sydney University; 2012. [Google Scholar]
- 33.Arain M, Campbell MJ, Cooper CL, et al. What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010;10:1–7.:67. doi: 10.1186/1471-2288-10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.First M, Williams J, Karg R, et al. Structured Clinical Interview for DSM-5—Research Version (SCID-5 for DSM-5, Research Version; SCID-5-RV) bArlington, VA: American Psychiatric Association; 2015. [Google Scholar]
- 35.Tursi MF de S, Baes C von W, Camacho FR de B, et al. Effectiveness of psychoeducation for depression: A systematic review. Aust N Z J Psychiatry. 2013;47:1019–31. doi: 10.1177/0004867413491154. [DOI] [PubMed] [Google Scholar]
- 36.Ryan RM, Deci EL. Self-determination theory: basic psychological needs in motivation, development, and wellness. 2017. https://www.google.com/books/edition/Self_Determination_Theory/th5rDwAAQBAJ?hl=en&gbpv=1&dq=inauthor:%22Richard+M.+Ryan%22 Available.
- 37.D’Zurilla TJ, Nezu AM. Development and preliminary evaluation of the Social Problem-Solving Inventory. Psychological Assessment: A Journal of Consulting and Clinical Psychology. 1990;2:156–63. doi: 10.1037/1040-3590.2.2.156. [DOI] [Google Scholar]
- 38.Slemp GR, Field JG, Ryan RM, et al. Interpersonal supports for basic psychological needs and their relations with motivation, well-being, and performance: A meta-analysis. J Pers Soc Psychol. 2024 doi: 10.1037/pspi0000459. [DOI] [PubMed] [Google Scholar]
- 39.Rush AJ, Kraemer HC, Sackeim HA, et al. Report by the ACNP Task Force on response and remission in major depressive disorder. Neuropsychopharmacology. 2006;31:1841–53. doi: 10.1038/sj.npp.1301131. [DOI] [PubMed] [Google Scholar]
- 40.Lee S, Tsang A, Mak A, et al. Concordance between telephone survey classification and face-to-face interview diagnosis of one-year major depressive episode in Hong Kong. J Affect Disord. 2010;126:155–60. doi: 10.1016/j.jad.2010.03.024. [DOI] [PubMed] [Google Scholar]
- 41.Rush AJ, Trivedi MH, Ibrahim HM, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry. 2003;54:573–83. doi: 10.1016/s0006-3223(02)01866-8. [DOI] [PubMed] [Google Scholar]
- 42.Spitzer RL, Kroenke K, Williams JBW, et al. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166:1092–7. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
- 43.Richardson J, Elsworth G, Iezzi A, et al. Increasing the sensitivity of the AQoL inventory for the evaluation of interventions affecting mental health. Adv Pers Relat. 2011 [Google Scholar]
- 44.Walach H, Buchheld N, Buttenmüller V, et al. Measuring mindfulness—the Freiburg Mindfulness Inventory (FMI) Pers Individ Dif. 2006;40:1543–55. doi: 10.1016/j.paid.2005.11.025. [DOI] [Google Scholar]
- 45.Raes F, Pommier E, Neff KD, et al. Construction and factorial validation of a short form of the Self‐Compassion Scale. Clin Psychol Psychoth. 2011;18:250–5. doi: 10.1002/cpp.702. [DOI] [PubMed] [Google Scholar]
- 46.Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: A psychometric analysis. Cognit Ther Res. 2003;27:247–59. doi: 10.1023/A:1023910315561. [DOI] [Google Scholar]
- 47.Cutrona CE, Russell DW. The provisions of social relationships and adaptation to stress. Adv in pers rel. 1987;1:37–67. [Google Scholar]
- 48.Emslie GJ, Kennard BD, Mayes TL, et al. Continued Effectiveness of Relapse Prevention Cognitive-Behavioral Therapy Following Fluoxetine Treatment in Youth With Major Depressive Disorder. J Am Acad Child Adolesc Psychiatry. 2015;54:991–8. doi: 10.1016/j.jaac.2015.09.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Hutton JL, Monaghan PF. Choice of parametric accelerated life and proportional hazards models for survival data: asymptotic results. Lifetime Data Anal. 2002;8:375–93. doi: 10.1023/a:1020570922072. [DOI] [PubMed] [Google Scholar]
- 50.Brown H, Prescott R. Applied Mixed Models in Medicine. John Wiley & Sons; 2014. [Google Scholar]
- 51.Preacher KJ, Zyphur MJ, Zhang Z. A general multilevel SEM framework for assessing multilevel mediation. Psychol Methods. 2010;15:209–33. doi: 10.1037/a0020141. [DOI] [PubMed] [Google Scholar]
- 52.Dolar V, Chatterton ML, Le LK-D, et al. Health Service Utilisation of People Living with Psychosis: Validity of Self-report Compared with Administrative Data in a Randomised Controlled Trial. Appl Health Econ Health Policy. 2024;22:255–64. doi: 10.1007/s40258-023-00849-x. [DOI] [PubMed] [Google Scholar]
- 53.Ramsey SD, Willke RJ, Glick H, et al. Cost-effectiveness analysis alongside clinical trials II-An ISPOR Good Research Practices Task Force report. V Health. 2015;18:161–72. doi: 10.1016/j.jval.2015.02.001. [DOI] [PubMed] [Google Scholar]
- 54.McGorry PD, Coghill D, Berk M. Mental health of young Australians: dealing with a public health crisis. Med J Aust. 2023;219:246–9. doi: 10.5694/mja2.52047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Russell DW. UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure. J Pers Assess. 1996;66:20–40. doi: 10.1207/s15327752jpa6601_2. [DOI] [PubMed] [Google Scholar]
- 56.Sherer M, Adams CH. Construct Validation of the Self-Efficacy Scale. Psychol Rep. 1983;53:899–902. doi: 10.2466/pr0.1983.53.3.899. [DOI] [Google Scholar]
- 57.Rosenberg M. Rosenberg self-esteem scale. J Relig Health. 1965 [Google Scholar]
- 58.Goldman HH, Skodol AE, Lave TR. Revising axis V for DSM-IV: a review of measures of social functioning. Am J Psychiatry. 1992;149:1148–56. doi: 10.1176/ajp.149.9.1148. [DOI] [PubMed] [Google Scholar]
- 59.Posner K, Brown GK, Stanley B, et al. The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168:1266–77. doi: 10.1176/appi.ajp.2011.10111704. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Vrouva I, Fonagy P, Fearon PRM, et al. The risk-taking and self-harm inventory for adolescents: development and psychometric evaluation. Psychol Assess. 2010;22:852–65. doi: 10.1037/a0020583. [DOI] [PubMed] [Google Scholar]
- 61.Gagné M. The role of autonomy support and autonomy orientation in prosocial behavior engagement. Motiv Emot. 2003;27:199–223. doi: 10.1023/A:1025007614869. [DOI] [Google Scholar]
- 62.Manos RC, Kanter JW, Luo W. The behavioral activation for depression scale-short form: development and validation. Behav Ther. 2011;42:726–39. doi: 10.1016/j.beth.2011.04.004. [DOI] [PubMed] [Google Scholar]
- 63.Buysse DJ, Reynolds CF, III, Monk TH, et al. The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research. Psychiatry Res. 1989;28:193–213. doi: 10.1016/0165-1781(89)90047-4. [DOI] [PubMed] [Google Scholar]
- 64.Wood AM, Linley PA, Maltby J, et al. Using personal and psychological strengths leads to increases in well-being over time: A longitudinal study and the development of the strengths use questionnaire. Pers Individ Dif. 2011;50:15–9. doi: 10.1016/j.paid.2010.08.004. [DOI] [Google Scholar]
- 65.Humeniuk R, Ali R, Babor TF, et al. Validation of the Alcohol, Smoking And Substance Involvement Screening Test (ASSIST) Addiction. 2008;103:1039–47. doi: 10.1111/j.1360-0443.2007.02114.x. [DOI] [PubMed] [Google Scholar]
- 66.van Berkel N, D’Alfonso S, Kurnia Susanto R, et al. AWARE-Light: a smartphone tool for experience sampling and digital phenotyping. Pers Ubiquit Comput . 2023;27:435–45. doi: 10.1007/s00779-022-01697-7. [DOI] [Google Scholar]
- 67.O’Brien ST, Dozo N, Hinton JDX, et al. SEMA3: a free smartphone platform for daily life surveys. PsyArXiv. 2023 doi: 10.31234/osf.io/cnar8. Preprint. [DOI] [PMC free article] [PubMed]
- 68.Horvath AO, Greenberg LS. Development and validation of the Working Alliance Inventory. J Couns Psychol. 1989;36:223–33.:223. doi: 10.1037/0022-0167.36.2.223. [DOI] [Google Scholar]
- 69.Fresco DM, Coles ME, Heimberg RG, et al. The Liebowitz Social Anxiety Scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychol Med. 2001;31:1025–35. doi: 10.1017/s0033291701004056. [DOI] [PubMed] [Google Scholar]
- 70.Cohen S. In: The social psychology of health: Sage Publications, Inc. Spacapan S, Oskamp S, editors. 1988. Perceived stress in a probability sample of the united states; pp. 31–67. [Google Scholar]