Skip to main content
PMC home page
JMIR Research Protocols logoLink to JMIR Research Protocols
. 2020 Oct 27;9(10):e23655. doi: 10.2196/23655

A Mobile Health Intervention (LifeBuoy App) to Help Young People Manage Suicidal Thoughts: Protocol for a Mixed-Methods Randomized Controlled Trial

Jin Han 1,✉, Lauren McGillivray 1, Quincy JJ Wong 2, Aliza Werner-Seidler 1, Iana Wong 1, Alison Calear 3, Helen Christensen 1, Michelle Torok 1
Editor: Gunther Eysenbach
Reviewed by: Runsen Chen, Theresa Fleming
PMCID: PMC7655466  PMID: 33107832

Abstract

Background

Self-help smartphone apps offer a new opportunity to address youth suicide prevention by improving access to support and by providing potentially high fidelity and cost-effective treatment. However, there have been very few smartphone apps providing evidence-based support for suicide prevention in this population. To address this gap, we developed the LifeBuoy app, a self-help smartphone app informed by dialectical behavior therapy (DBT), to help young people manage suicidal thoughts in their daily life.

Objective

This study describes the protocol for a randomized controlled trial to evaluate the efficacy of the LifeBuoy app for reducing suicidal thoughts and behaviors, depression, anxiety, and psychological distress, and improving general mental well-being in young adults aged 18 to 25 years.

Methods

This is a randomized controlled trial recruiting 378 young adults aged between 18 and 25 years and comparing the LifeBuoy app with a matched attention control (a placebo app with the same display but no DBT components). The primary outcome is suicidal thoughts measured by the Suicidal Ideation Attributes Scale (SIDAS). The secondary outcomes are suicidal behavior, depression, anxiety, psychological distress, and general mental well-being. The changes in the levels of insomnia, rumination, suicide cognitions, distress tolerance, loneliness, and help seeking before and after using the app are evaluated in this study. The study also addresses risk factors and responses to the intervention. A series of items assessing COVID-19 experiences is included in the trial to capture the potential impact of the pandemic on this study. Assessments will occur on the following three occasions: baseline, postintervention, and follow-up at 3 months postintervention. A qualitative interview about user experience with the LifeBuoy app will take place within 4 weeks of the final assessment. Using linear mixed models, the primary analysis will compare the changes in suicidal thoughts in the intervention condition relative to the control condition. To minimize risks, participants will receive a call from the team clinical psychologist by clicking a help button in the app or responding to an automated email sent by the system when they are assessed with elevated suicide risks at the baseline, postintervention, and 3-month follow-up surveys.

Results

The trial recruitment started in May 2020. Data collection is currently ongoing.

Conclusions

This is the first trial examining the efficacy of a DBT-informed smartphone app delivered to community-living young adults reporting suicidal thoughts. This trial will extend knowledge about the efficacy and acceptability of app-based support for suicidal thoughts in young people.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12619001671156; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378366.

International Registered Report Identifier (IRRID)

PRR1-10.2196/23655

Keywords: suicide prevention, mental health, eHealth, mHealth, mobile health, digital health, smartphone app, dialectical behavior therapy

Introduction

Suicidal thoughts and behaviors are a global public health concern for adolescents and young adults owing to their life-threatening nature and high prevalence [1]. Globally, it is estimated that over 200,000 people aged between 10 and 29 years died by suicide in 2016 [2]. Suicide remains the second leading cause of death for this age group despite numerous prevention initiatives over the last decade [3]. Rates have increased across multiple countries and regions in recent years [4-6], and the increased rates are likely to be a lasting concern owing to the coronavirus pandemic and economic recession [7]. One possible approach to prevent youth suicide is to provide accessible and engaging interventions that can effectively reduce suicidal thoughts and behaviors in this age group.

Dialectical behavior therapy (DBT) is one therapeutic approach that has been shown to reduce suicide-related outcomes, including nonsuicidal self-injurious behavior and suicide attempts [8,9]. DBT combines principles from behaviorism, Zen, and dialectics [10] that aim to help clients improve their emotional and cognitive regulation to overcome problems, including intense mood change [11,12], impulsivity [13,14], and loneliness [15]. DBT was initially developed for persons diagnosed with borderline personality disorder [16], and there is increasing evidence to suggest that DBT is also effective in reducing suicidal thoughts, nonsuicidal self-injurious behavior, and suicide attempts in both adults [17] and adolescents [18,19].

Traditional face-to-face psychotherapies, including DBT, usually carry high economic costs and personal barriers that may prevent youth from accessing them [20]. Literature suggests that only 28% of adolescents and young adults with current, past year, or lifetime suicidal thoughts, plans, and/or attempts have accessed mental health services [21]. Potential barriers to mental health services include lack of time, preference for self-reliance, stigma, and service unavailability [21,22]. Digitally delivered interventions offer a new opportunity to improve access to support and to provide high fidelity and cost-effective treatment [23] at scale. Self-help smartphone apps that are designed to be used without professional guidance can help address these gaps by allowing people to seek help anonymously at a relatively low cost and at a time that suits them [24]. There is emerging evidence that adults readily access and benefit from suicide prevention interventions delivered via smartphone-based apps [25]. However, there have been very few empirical studies examining the efficacy of mental health apps for young people, and there are even fewer studies for apps that specifically target suicidal thoughts in this population. To our best knowledge, no studies have investigated the possibility of using a DBT-informed app to reduce suicidal thoughts in young adults.

To address this gap, we developed the LifeBuoy app, a self-help smartphone app designed to help young adults manage suicidal thoughts and negative feelings in daily life. It includes seven structured therapeutic sessions derived from DBT and incorporates the principles of positive psychology. The primary objective of the trial is to investigate the efficacy of the LifeBuoy app compared with a matched attention control condition in reducing suicidal thoughts in young adults at postintervention and a 3-month follow-up compared with baseline. The second objective is to assess the impact of the app on secondary outcomes, including suicidal behaviors, depression, anxiety, psychological distress, and general mental well-being. We are also interested in examining the changes in tertiary outcomes, including insomnia, rumination, suicide cognitions, distress tolerance, loneliness, and help-seeking intentions and behaviors at postintervention and a 3-month follow-up compared with baseline, and assessing the potential impacts of demographics, perseverance, negative events, such as COVID-19, and expectation of treatment success on participants. The final objective of this trial is to investigate adherence, satisfaction, and acceptability of the LifeBuoy app via survey questions, app usage data, and qualitative interviews.

Methods

Trial Design

This study is a randomized controlled superiority trial with a matched attention control condition. Individuals are randomly allocated to either the intervention or attention control condition with a 2:2 allocation using a block design (four participants per block), stratified by gender and age group using an automated web-based platform tailored for this trial. Participants within each block (N=4) are randomly assigned to either of the two groups based on the six sequences, given a block size of four [26]. The trial has the following three measurement occasions: baseline, postintervention, and follow-up at 3 months postintervention. A qualitative interview about user experience with the LifeBuoy app will take place within 4 weeks of the final assessment (Figure 1).

Figure 1.

Figure 1

Open in a new tab

Study flow.

Blinding

In the trial, participants are not notified about whether they are assigned to an intervention or control group. Participants may still discern their condition assignment owing to the nature of the intervention content. All the investigators will be blinded to intervention assignment throughout the study period.

Participants

Young adults aged between 18 and 25 years are eligible to participate in the trial if they (1) have experienced suicidal thoughts in the past 12 months, (2) have not made a suicide attempt in the past month, (3) do not have a diagnosis of psychosis or bipolar disorder, (4) currently live in Australia, and (5) are fluent in English. The inclusion criteria will be determined by an online self-report screening survey. They are not prohibited from receiving other treatments or interventions during the trial.

Sample Size

Based on a systematic review and meta-analysis on online and mobile apps for suicidal thoughts and self-harm [27], an effect size of 0.30 (Cohen d) is expected between the intervention condition and the control condition at posttest for the primary outcome suicidal thoughts. Based on an attrition rate of 30% [28,29] and a 0.50 correlation between pre- and posttest scores of the primary outcome, a sample size of 189 for each condition (total N=378) will be required to detect the expected effect size with a power of 0.80 and alpha of .05. For the qualitative interviews, we will recruit a 10% subsample of individuals who participate in the intervention condition to assess their experience with the app (N=20), which is likely to reach data saturation according to prior studies [30,31].

Recruitment

From May 2020, a community-based sample of participants is being recruited into the trial through targeted Facebook advertising hosted on the Black Dog Institute’s social media pages. The recruitment is still ongoing. A subgroup of the participants in the intervention group will be recruited for the qualitative interview via an expression of interest form provided before the final assessment.

Intervention

The LifeBuoy app includes seven structured therapeutic sessions derived from DBT and incorporates the principles of positive psychology. It includes sessions on value identification, goal setting, psychoeducation, emotion regulation, and distress tolerance. These sessions are self-paced and delivered sequentially in the app. Each module takes approximately 3 to 7 minutes to complete. A mood tracker is included in the app to allow participants to rate their feelings multiple times per day. The app also contains a toolbox, which includes two distraction activities (popping bubbles and funny quiz) and additional tips for reducing distress (self-soothing tips and the Temperature, Intense exercise, Paced breathing, Paired muscle relaxation [TIPP] technique). Finally, there is a “help” button embedded in the app with direct links to Australian crisis lines. The LifeBuoy app was developed using a person-centered approach, involving young people with lived experience of suicidal thoughts, to understand and accommodate the perspectives of young people who will use the intervention. The design process of the app will be reported in a separate paper, which is currently in preparation.

Matched Attention Control

Similar to the intervention app, the control app contains seven brief nontherapeutic education-based sessions. The topics are peripherally related to mental health and well-being, including confidence, performance stress, the importance of having goals, and the value of being present. Each session takes 2 to 3 minutes to read through. The control does not contain a mood tracker or toolbox but includes the “help” button for safety management. Participants in the control group will be granted access to the intervention app after they complete the 3-month follow-up assessment.

Assessments

There are three data collection points as follows: baseline (day 0), postintervention (day 42), and 3-month postintervention follow-up (day 132) (Table 1). Data collection will be fully automated and online, with participants accessing the study website to register for the trial, download the app, and complete assessments.

Table 1.

Summary of the primary, secondary, and tertiary outcome measures, risk factors, other measures, and data collection time points.

Outcomes measures Scale Baseline Postintervention Three-month follow-up
Primary outcome




Suicidal thoughts Suicidal Ideation Attributes Scale (SIDAS) Yes Yes Yes
Secondary outcomes




Suicide behaviors Suicide attempt and self-harm Yes Yes Yes

Depression Patient Health Questionnaire-9 (PHQ-9) Yes Yes Yes

Anxiety Generalized Anxiety Disorder-7 (GAD-7) Yes Yes Yes

Psychological distress Distress Questionnaire-5 (DQ-5) Yes Yes Yes

General mental well-being Short Warwick-Edinburgh Mental Wellbeing Scale (SWEMWBS) Yes Yes Yes
Tertiary outcomes




Insomnia Insomnia Severity Index (ISI) Yes Yes Yes

Rumination Repetitive Thinking Questionnaire (RTQ) Yes Yes Yes

Suicide cognitions Suicide Cognitions Scale (SCS) Yes Yes Yes

Distress intolerance Distress Tolerance Scale (DTS) Yes Yes Yes

Loneliness Three-Item Loneliness Scale (TILS) Yes Yes Yes

Help-seeking intentions General Help-Seeking Questionnaire (GHSQ) Yes Yes Yes

Help-seeking behaviors Client Service Receipt Inventory (CSRI) Yes No Yes
Risk factors and other measures




Demographics Questions Yes No No

Perseverance Short Grit Scale (SGS) Yes No No

COVID-19–related worry Questions Yes No No

Negative events Negative Life Events Scale for Students (NLESS) Yes No No

Expectations of treatment success Questions Yes No No

Satisfaction with the app Questions No Yes No
Open in a new tab

Outcomes

Primary Outcome Measure

Suicidal Ideation Attributes Scale

The primary outcome measure is the severity of suicidal thoughts assessed by the Suicidal Ideation Attributes Scale (SIDAS [32]). It consists of five questions pertaining to frequency of suicidal thoughts in the past month, controllability of suicidal thoughts, closeness to suicide attempt, level of distress associated with the thoughts, and impact on daily functioning. Each item is assessed on a 11-point scale (0-10). Item two (controllability) is reverse scored. Total scale scores on the SIDAS range from 0 to 50, with higher scores indicating more severe suicidal thoughts.

Secondary Outcome Measures

Suicide Behaviors

Participants’ previous suicide attempts and self-injury are assessed by eight questions developed for a previous suicide prevention trial [29]. Participants are invited to indicate whether they have attempted suicide in their lifetime and in the past 30 days on a three-point Likert scale, with responses of “No, never (0),” “Yes, once (1),” and “Yes, more than once (2).” They are also asked to report the number of suicide attempts over their lifetime and the number of months that they have been thinking about suicide. Apart from that, participants are asked to indicate whether they have experienced intentional self-injury in their lifetime on the aforementioned three-point Likert scale. If yes, they are asked to provide the number of times of their intentional self-injury and rate the severity of the worst injury in the past month on a three-point Likert scale, with responses of “No care was needed (1),” “Some care was needed (2),” and “Required medical care (3).”

Patient Health Questionnaire-9

The Patient Health Questionnaire-9 (PHQ-9 [33]) is a nine-item self-report questionnaire measuring the severity of depression. The scale assesses the frequency of occurrence of depression symptoms in the previous 2 weeks, with items rated on a four-point scale ranging from “Not at all (0)” to “Nearly every day (3).” Total scores on the PHQ-9 depression scale can range from 0 to 27, with higher scores reflecting more severe depression.

Generalized Anxiety Disorder-7

The Generalized Anxiety Disorder-7 (GAD-7 [34]) is a seven-item self-report measure designed to assess the severity of generalized anxiety symptoms over the previous 2-week period. Items are rated on a four-point scale, ranging from “Not at all sure (0)” to “Nearly every day (3).” Total scores on the GAD-7 can range from 0 to 21. Higher scores indicate higher levels of GAD symptoms.

Distress Questionnaire-5

The Distress Questionnaire-5 (DQ-5 [35]) is a five-item brief screening tool for identifying general psychological distress. Participants are asked to endorse the frequency of each item in the past 30 days on a five-point scale ranging from “Never (1)” to “Always (5).” Total scores range from 5 to 25, with higher scores indicating greater psychological distress.

Short Warwick-Edinburgh Mental Well-Being Scale

The Short Warwick-Edinburgh Mental Well-Being Scale (SWEMWBS [36,37]) is a shortened seven-item version of the 14-item Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) [37], which was developed to assess mental well-being in the general population. It assesses mental well-being by asking about participants’ feelings and experiences over the previous 2 weeks. Responses range from “None of the time (1)” to “All of the time (5),” and raw item scores are summed and converted to a metric total score using the SWEMWBS conversion table [38]. Total scores can range from 7 to 35, with higher scores indicating higher levels of mental well-being.

Tertiary Outcome Measures

Insomnia Severity Index

The Insomnia Severity Index (ISI [39]) is a psychometrically sound, seven-item, self-report measure assessing the perceived severity of insomnia symptoms, the degree of satisfaction with sleep, interference with daytime functioning, noticeability of impairment, and concern caused by the sleep problems in the previous 2 weeks. Responses are reported on a five-point scale yielding total scores of 0 to 28. Higher scores indicate greater insomnia severity.

Repetitive Thinking Questionnaire

The Repetitive Thinking Questionnaire-10 (RTQ-10 [40]) is a transdiagnostic measure of engagement in repetitive negative thinking following distressing situations. The RTQ was developed to capture the underlying construct of recurrent negative thinking underlying mental health disorders such as depression and anxiety. Participants are requested to respond to the RTQ-10 on a five-point Likert scale, with responses ranging from “Not true at all (1)” to “Very true (5).” Total scores fall between 10 and 50, with higher scores indicating greater rumination.

Shortened Version of the Suicide Cognition Scale

The shortened version of the Suicide Cognition Scale (SCS [41]) is a self-report instrument consisting of nine items that are designed to measure suicide-specific cognition. The items contain statements consistent with the suicidal schemas of unbearability (eg, “I can’t cope with my problems any longer”), unlovability (eg, “I am completely unworthy of love”), and unsolvability (eg, “Nothing can help me solve my problems”). Items in the SCS are rated on a five-point Likert scale, with responses ranging from “Strongly disagree (1)” to “Strongly agree (5).” The instrument is scored by summing ratings across items, resulting in scores ranging from 9 to 45.

Distress Tolerance Scale

The Distress Tolerance Scale (DTS [42]) is a 15-item self-report measure designed to assess respondents’ perceived capacity to experience and endure negative emotional states. The DTS encompasses four subscales, including tolerance, appraisal, absorption, and regulation. Items are rated on a five-point Likert scale, with responses ranging from “Strongly disagree (1)” to “Strongly agree (5).” Higher mean scores indicate a greater tendency to withstand emotional distress.

Three-Item Loneliness Scale

The Three-Item Loneliness Scale (TILS [43]) is a brief self-report measure of loneliness. The three items that compose this scale were selected from the R-UCLA Loneliness Scale [44] and include the following: “How often do you feel that you lack companionship?” (relational connectedness); “How often do you feel left out?” (collective connectedness); and “How often do you feel isolated from others?” (general isolation). Response categories for the TILS are as follows: “Hardly ever (1),” “Some of the time (2),” and “Often (3).” Total scores are calculated by summing item scores, with higher scores indicating greater loneliness.

General Help-Seeking Questionnaire

The General Help-Seeking Questionnaire (GHSQ [45]) is used in the current trial to assess participants’ intentions to seek help for suicidal thoughts from a variety of sources. Respondents are invited to rate on a six-point scale, ranging from “Not applicable (0)” and “Extremely unlikely (1)” to “Extremely likely (5),” the likelihood of seeking help from three professional sources (school or university counsellor, mental health professional, and doctor/general practitioner), four informal sources (boyfriend/girlfriend, friends, parents, and other relative/family members), three telephone/online sources (phone helpline, internet website, and mobile app), or no one. An optional item “I would seek help from another source not listed above” is also provided. Higher scores represent stronger intentions to seek help.

Modified Client Service Receipt Inventory

The adapted version of the Client Service Receipt Inventory (CSRI [46]) is designed to collect information about use of health care and social care services over a retrospective period of the past 6 months. Respondents are asked to indicate whether they have used any services in the past 6 months owing to mental health problems, including suicidal thoughts, on a binary scale (“Yes”/“No”). Services include hospital services, mental health helplines, crisis support team, police/ambulance, contact with a range of mental health professionals (eg, social worker and counsellor), self-help groups, and other medically qualified doctors.

Risk Factors and Other Measures

Demographic Information and Baseline Variables

At the baseline assessment, participants are asked to provide their age, gender identity, gender assigned at birth, sexual orientation, contact information (email and mobile number), state and area they live in (ie, metropolitan or rural/remote), language spoken at home, who they live with at home, current relationship status, highest level of education completed, employment status, and whether they have ever experienced or been diagnosed with mental illness. Information related to their service use is also collected, such as whether they have ever seen a mental health professional for a mental health problem and used health or well-being apps.

Short Grit Scale

The Short Grit Scale (SGS [47]) is an eight-item measure assessing perseverance and passion for pursuing long-term goals. Half of the items are worded positively (eg, “I am diligent”), while the other half are worded negatively (eg, “New ideas and projects sometimes distract me from previous ones”) and are thus reverse scored. Items are rated on a five-point scale, with responses ranging from “Not like me at all (1)” to “Very much like me (5)” and the total scale score ranging from 8 to 40.

COVID-19–Related Worry

Ten items are used to assess the extent to which the coronavirus (COVID-19) pandemic influences participants’ perception of their symptoms (anxiety, depression, and suicidal ideation) and coping strategies. Items 1 to 3 relate to perceptions of symptoms and are rated on a five-point scale, with responses ranging from “Not at all (1)” to “All of the time (5)” (eg, “Do you think the COVID-19 pandemic has increased your anxiety levels more than usual?”). Items 4 to 6 relate to anticipated, experienced, and current worry and have been modified from a previous study of pandemic-related worry [48], with item 7 asking participants to indicate what aspects of COVID-19 are worrying them from a list of responses (eg, “not knowing when the pandemic will end”). Items 8 to 9 relate to the frequency and effectiveness of coping strategies used from a list of 14 equally balanced healthy (eg, “using social support” and “relaxation techniques”) and unhealthy (eg, “overeating/comfort food” and “avoidance/procrastination”) strategies. Participants are asked to rate their use of the strategies on a four-point scale (do not use, use less, use the same, and use more) and rate on a five-point scale whether they think each strategy used has been less effective during the pandemic, with responses ranging from “Not at all (1)” to “All of the time (5).” Item 10 asks participants to indicate if they have noticed any symptom improvement during or following the pandemic (none; yes, anxiety; yes, depression; yes, suicidal thoughts; and yes, other).

Modified Negative Life Events Scale for Students

The Negative Life Events Scale for Students (NLESS [49]) is designed to assess the experience of stressful life events among students. Respondents are asked to indicate whether they have experienced 25 negative life events (eg, death of a family member and being arrested) in the past year, and if yes, how stressful that event has been for them. In the adapted version of this measure, items are rated on a five-point scale, with responses ranging from “Not stressful (1)” to “Extremely stressful (5).” Higher mean scores indicate higher negative impact on life.

Expectation of Treatment Success

Four items were created to measure participants’ confidence and readiness in using an app to reduce suicidal thoughts, as well as the perceived importance of reducing suicidal thoughts and participating in research to reduce suicide risk. Items on this scale include “I am confident that people could reduce their suicidal thoughts using an app” and “I think that participating in a study that aims to reduce suicidal thoughts is an important thing to do.” These items are rated on a five-point scale, with responses ranging from “Strongly disagree (1)” to “Strongly agree (5).” Other items include “Please rate the importance of reducing your suicidal thoughts over the next 6 months,” with responses ranging from “Not important (0)” to “Very important (5),” and “Please rate your readiness to reduce your suicidal thoughts by using an app,” with responses ranging from “Not ready (1)” to “Completely ready (5).” Owing to the nature of these questions, this measure is administered only once during baseline assessment. Total scores indicate higher expectation of treatment success.

Satisfaction With the LifeBuoy App

Eighteen items were adapted from a previous study to assess participants’ satisfaction with the LifeBuoy app [50]. This measure consists of three parts. The first part contains seven statements related to the usability, readability, and helpfulness of the app, and the respondent’s intention to continue to use and recommend the app. Participants are asked to indicate whether they agree or disagree with each item. The second part of this measure comprises 10 questions pertaining to potential difficulties in using the app (eg, forgetting to use it and feeling worse after using it). Participants are asked to indicate whether they agree or disagree with each item. In the last part of this measure, they are asked to rate the overall helpfulness of the app on a five-point scale, with responses ranging from “Extremely unhelpful (1)” to “Extremely helpful (5).” Higher scores on each item indicate higher satisfaction with the app.

Treatment Adherence

Adherence to both the LifeBuoy app and control app is measured by the number of modules accessed and completed by participants, and the time spent on each module. The data are automatically collected via the app.

Statistical Analysis

Mixed model repeated measures analyses with maximum likelihood estimation and an appropriate covariance structure will be used to evaluate the efficacy of the LifeBuoy app relative to the control condition. Within-person variation will be modelled by using an unstructured covariance matrix, and degrees of freedom will be estimated using Satterthwaite correction [51]. The primary outcome is the change in severity of suicidal thoughts across time (baseline to postintervention and postintervention to the 3-month follow-up). The mixed model approach incorporates all available data, including participants with missing follow-up data points, under the missing-at-random assumption, in accordance with the intention-to-treat principle. The same analytic approach will be used to examine temporal changes in secondary and tertiary outcomes, including depression, anxiety, psychological distress, general mental well-being, insomnia, rumination, suicide cognition, distress tolerance, loneliness, help-seeking intentions, and behaviors. The difference between the two groups on potential risk factors, including demographics, perseverance, COVID-19–related worry, negative events, and expectation of treatment success will be assessed by descriptive statistics.

In the interview, participants will be asked about their general feelings about the app and the design, their favorite and unfavorite features, the scenarios where they find the app useful, and other feedback about the app. The interview data will be analyzed using Braun & Clarke thematic analysis [52]. An inductive approach will be used to identify group themes. Two researchers will independently refine the themes and determine the final coding framework. Discrepancies will be resolved by a third researcher to ensure reliability of the process.

Risk Management

In both the intervention and control versions of the LifeBuoy app, there is a help button that contains a list of 24-hour crisis support contacts that are publicly accessible nationwide. This button also contains a clinical psychologist contact button that allows participants to request a call from the team clinical psychologist.

Calls by the team clinical psychologist to participants will focus on ensuring the participants are safe and supported by their family and/or community if this is possible, and identifying how they can access the services they need. If participants express distress in relation to using the app or answering the assessment questionnaires, they will be reminded of their right to withdraw from the trial without penalty or explanation. In the event that a participant does not respond to the initial contact attempt, an email stating that contact was attempted and requesting for their availability will be sent. The psychologist will attempt to call the participants up to two times in the requested time. If the participant is still unavailable, another email stating that contact was attempted and containing referral sources will be sent.

At each survey timepoint (baseline, postintervention, and 3-month follow-up) and in the middle of the trial (3 weeks after commencing use of the LifeBuoy app), risk of suicide will be assessed using a standardized scale (SIDAS). If the SIDAS score is above 20 [32], indicating an elevated level of suicidal thoughts, an automated alert system will be triggered, in which a notification will be sent to the research inbox to notify the team clinical psychologist. An automated email will also be sent to the participants asking if they would like to receive a phone call from the team clinical psychologist as above. This email will also include a list of 24-hour crisis support contacts.

There are two levels of risk management in this project. The first is the trial steering committee, which consists of the research team, and the second is an independent Data Monitoring Safety Board (DSMB). The DSMB has three members who are experts in clinical trial conduct, statistics, and youth mental health. The trial manager will record the number of notifications at each assessment in a report for the DSMB and will notify the DSMB after each assessment period about how many alerts have been triggered and whether follow-ups have been carried out. Any serious adverse event will be reported to the DSMB. The DSMB will provide recommendations to the research team to continue the trial, temporarily pause the trial, or discontinue the trial owing to heightened risk or adverse events.

Privacy, Confidentiality, and Data Management

The sensitive data that are collected in this study include participants’ responses to the surveys, usage data collected by the LifeBuoy app, and the audio records of the interviews.

The survey and usage data are collected by the Black Dog Institute eHealth research platform, a bespoke trial management system. Each participant will be assigned a unique identification code automatically at the time of registration on the Black Dog Institute research platform. When online survey data are exported for analysis, the research team will remove the identifiable information from the initial data set (ie, first name, mobile phone number, and email address will be removed). A deidentified extract of the data will be downloaded for analysis on a shared drive, which is password protected and approved by the university for storing highly sensitive data. The file used for analysis will only include the unique ID code and raw research data. Only named study personnel will have access to any identifiable information. For participant withdrawal, only named study personnel will access the register to identify the personal details of participants using their ID code.

Transcription of the interviews will be undertaken by a professional transcription service, and only deidentified audio will be provided to the agency. The agency will need to sign a confidentiality agreement before being provided with the recordings. Participants will be informed that deidentified audio will be provided to an agency for transcription service only. Upon completion of this project, all deidentified data will be stored in an archive on the server hard drive for a period of a minimum of 7 years, in accordance with University of New South Wales guidelines and the Australian Code for the Responsible Conduct of Research.

Results

The current trial has ethical approval from the University of New South Wales Human Research Ethics Committee (HC190764). It has been registered in The Australian New Zealand Clinical Trials Registry (ACTRN12619001671156) and with the Therapeutic Goods Administration through the Clinical Trial Notification (CTN) scheme (CT-2020-CTN-00256-1-v1). Recruitment started on May 11, 2020. Data collection of the trial is expected to be complete by December 2020.

Discussion

Preventing suicide in young people is a pressing global imperative [1]. The current mental health system addresses less than half of the need of support [21], leaving most young people to manage their symptoms alone. Self-help smartphone apps offer an opportunity to improve access to support for this population.

To our knowledge, the LifeBuoy study is the first trial to examine the efficacy of a DBT-informed smartphone app in reducing suicidal thoughts and related mental health symptoms in young adults. The app is innovative by integrating structured therapeutic sessions derived from DBT with distraction activities and mood assessments. If the LifeBuoy app is found to be effective, it may prove to be useful as a way to support young adults who do not usually seek help from mental health services or as an adjunct for those who do seek help. Because we have asked about current health service use, we will be able to determine for whom it is effective. We will also determine whether the app is useful for those in underdeveloped areas, where professional health sources are usually scarce. Through our qualitative interviews, we will find information on who our participants think it could be used.

There are few limitations we would like to acknowledge in the current trial design. First, the participants may not be blinded in terms of intervention allocation owing to the nature of the content of the app. All the researchers involved in this study will be blinded to the allocation at the time of analysis, thus maintaining the integrity of study results reporting. Second, the trial sample is being recruited from targeted Facebook advertising rather than by mail or phone. Samples recruited by Facebook have been found to present similar representativeness to convention methods in achieving age and gender distribution and are usually less costly [53]. Finally, the sample is being recruited during the COVID-19 period, which is likely to elevate participants’ levels of psychological distress and mental health symptoms [54]. We intend to examine this by measuring the relevant symptoms and the impact of COVID-19 in the surveys.

Acknowledgments

We acknowledge Mr Jamie Astley, Mr Cesar Anonuevo, and Mr Jacinto Santamaria at the Black Dog Institute for building the apps and setting up the trial site, and Ms Laura Kampel, Dr Mark Deady, Dr Kit Huckvale, Ms Victoria Carr, and Assoc Professor Vijaya Manicavasagar at the Black Dog Institute for insights on app design. This project received funds from Roth Family Foundation Philanthropic grant, Australian Rotary Health Mental Health grant, and Perpetual IMPACT funding. JH is supported by Commonwealth Suicide Prevention Research Fund Post-Doctoral Fellowship. AWS is supported by an NSW Health Early Career Fellowship. ALC is supported by NHMRC Fellowships 1122544 and 1173146. MT is supported by NHMRC Early Career Fellowship 1138710. HC is supported by NHMRC Senior Principal Research Fellowship 1155614.

Abbreviations

CSRI

Client Service Receipt Inventory

DBT

dialectical behavior therapy

DQ-5

Distress Questionnaire-5

DSMB

Data Monitoring Safety Board

DTS

Distress Tolerance Scale

GAD-7

Generalized Anxiety Disorder-7

GHSQ

General Help-Seeking Questionnaire

ISI

Insomnia Severity Index

NLESS

Negative Life Events Scale for Students

PHQ-9

Patient Health Questionnaire-9

RTQ-10

Repetitive Thinking Questionnaire-10

SCS

Suicide Cognitions Scale

SGS

Short Grit Scale

SIDAS

Suicidal Ideation Attributes Scale

SWEMWBS

Short Warwick-Edinburgh Mental Well-Being Scale

TILS

Three-Item Loneliness Scale

WEMWBS

Warwick-Edinburgh Mental Well-Being Scale

Footnotes

Conflicts of Interest: None declared.

References

  • 1.Preventing Suicide: A Global Imperative. Geneva, Switzerland: World Health Organization; 2014. [Google Scholar]
  • 2.Mental health: Suicide data. World Health Organization. [2020-09-25]. https://www.who.int/mental_health/prevention/suicide/suicideprevent/en/
  • 3.Arensman E, Scott V, De Leo D, Pirkis J. Suicide and Suicide Prevention From a Global Perspective. Crisis. 2020 Mar 01;41(Suppl 1):S3–S7. doi: 10.1027/0227-5910/a000664. [DOI] [PubMed] [Google Scholar]
  • 4.Leckning BA, Li SQ, Cunningham T, Guthridge S, Robinson G, Nagel T, Silburn S. Trends in hospital admissions involving suicidal behaviour in the Northern Territory, 2001-2013. Australas Psychiatry. 2016 Jun;24(3):300–4. doi: 10.1177/1039856216629838. [DOI] [PubMed] [Google Scholar]
  • 5.Han B, Compton WM, Blanco C, Colpe L, Huang L, McKeon R. National Trends in the Prevalence of Suicidal Ideation and Behavior Among Young Adults and Receipt of Mental Health Care Among Suicidal Young Adults. J Am Acad Child Adolesc Psychiatry. 2018 Jan;57(1):20–27.e2. doi: 10.1016/j.jaac.2017.10.013. [DOI] [PubMed] [Google Scholar]
  • 6.Griffin E, McMahon E, McNicholas F, Corcoran P, Perry IJ, Arensman E. Increasing rates of self-harm among children, adolescents and young adults: a 10-year national registry study 2007-2016. Soc Psychiatry Psychiatr Epidemiol. 2018 Jul;53(7):663–671. doi: 10.1007/s00127-018-1522-1. [DOI] [PubMed] [Google Scholar]
  • 7.Gunnell D, Appleby L, Arensman E, Hawton K, John A, Kapur N, Khan M, O'Connor RC, Pirkis J, Appleby L, Arensman E, Caine ED, Chan LF, Chang S, Chen Y, Christensen H, Dandona R, Eddleston M, Erlangsen A, Gunnell D, Harkavy-Friedman J, Hawton K, John A, Kapur N, Khan M, Kirtley OJ, Knipe D, Konradsen F, Liu S, McManus S, Mehlum L, Miller M, Moran P, Morrissey J, Moutier C, Niederkrotenthaler T, Nordentoft M, O'Connor RC, O'Neill S, Page A, Phillips MR, Pirkis J, Platt S, Pompili M, Qin P, Rezaeian M, Silverman M, Sinyor M, Stack S, Townsend E, Turecki G, Vijayakumar L, Yip PS. Suicide risk and prevention during the COVID-19 pandemic. The Lancet Psychiatry. 2020 Jun;7(6):468–471. doi: 10.1016/s2215-0366(20)30171-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.DeCou CR, Comtois KA, Landes SJ. Dialectical Behavior Therapy Is Effective for the Treatment of Suicidal Behavior: A Meta-Analysis. Behav Ther. 2019 Jan;50(1):60–72. doi: 10.1016/j.beth.2018.03.009. [DOI] [PubMed] [Google Scholar]
  • 9.Ougrin D, Tranah T, Stahl D, Moran P, Asarnow JR. Therapeutic interventions for suicide attempts and self-harm in adolescents: systematic review and meta-analysis. J Am Acad Child Adolesc Psychiatry. 2015 Feb;54(2):97–107.e2. doi: 10.1016/j.jaac.2014.10.009. [DOI] [PubMed] [Google Scholar]
  • 10.Swales M, Heard H. Dialectical Behaviour Therapy: Distinctive Features. New York, USA: Taylor & Francis; 2016. [Google Scholar]
  • 11.Palmier-Claus JE, Taylor PJ, Varese F, Pratt D. Does unstable mood increase risk of suicide? Theory, research and practice. J Affect Disord. 2012 Dec 20;143(1-3):5–15. doi: 10.1016/j.jad.2012.05.030. [DOI] [PubMed] [Google Scholar]
  • 12.Bowen R, Balbuena L, Peters EM, Leuschen-Mewis C, Baetz M. The Relationship between Mood Instability and Suicidal Thoughts. Arch Suicide Res. 2015;19(2):161–71. doi: 10.1080/13811118.2015.1004474. [DOI] [PubMed] [Google Scholar]
  • 13.Klonsky ED, May A. Rethinking impulsivity in suicide. Suicide Life Threat Behav. 2010 Dec;40(6):612–9. doi: 10.1521/suli.2010.40.6.612. [DOI] [PubMed] [Google Scholar]
  • 14.Liu RT, Trout ZM, Hernandez EM, Cheek SM, Gerlus N. A behavioral and cognitive neuroscience perspective on impulsivity, suicide, and non-suicidal self-injury: Meta-analysis and recommendations for future research. Neurosci Biobehav Rev. 2017 Dec;83:440–450. doi: 10.1016/j.neubiorev.2017.09.019. http://europepmc.org/abstract/MED/28928071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Stravynski A, Boyer R. Loneliness in relation to suicide ideation and parasuicide: a population-wide study. Suicide Life Threat Behav. 2001;31(1):32–40. doi: 10.1521/suli.31.1.32.21312. [DOI] [PubMed] [Google Scholar]
  • 16.Linehan MM, Armstrong HE, Suarez A, Allmon D, Heard HL. Cognitive-behavioral treatment of chronically parasuicidal borderline patients. Arch Gen Psychiatry. 1991 Dec;48(12):1060–4. doi: 10.1001/archpsyc.1991.01810360024003. [DOI] [PubMed] [Google Scholar]
  • 17.Linehan MM, Korslund KE, Harned MS, Gallop RJ, Lungu A, Neacsiu AD, McDavid J, Comtois KA, Murray-Gregory AM. Dialectical behavior therapy for high suicide risk in individuals with borderline personality disorder: a randomized clinical trial and component analysis. JAMA Psychiatry. 2015 May;72(5):475–82. doi: 10.1001/jamapsychiatry.2014.3039. [DOI] [PubMed] [Google Scholar]
  • 18.McCauley E, Berk MS, Asarnow JR, Adrian M, Cohen J, Korslund K, Avina C, Hughes J, Harned M, Gallop R, Linehan MM. Efficacy of Dialectical Behavior Therapy for Adolescents at High Risk for Suicide: A Randomized Clinical Trial. JAMA Psychiatry. 2018 Aug 01;75(8):777–785. doi: 10.1001/jamapsychiatry.2018.1109. http://europepmc.org/abstract/MED/29926087. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Mehlum L, Tørmoen AJ, Ramberg M, Haga E, Diep LM, Laberg S, Larsson BS, Stanley BH, Miller AL, Sund AM, Grøholt B. Dialectical behavior therapy for adolescents with repeated suicidal and self-harming behavior: a randomized trial. J Am Acad Child Adolesc Psychiatry. 2014 Oct;53(10):1082–91. doi: 10.1016/j.jaac.2014.07.003. [DOI] [PubMed] [Google Scholar]
  • 20.Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, Bromet E, Bruffaerts R, de Girolamo G, de Graaf R, Florescu S, Gureje O, Hinkov HR, Hu C, Huang Y, Hwang I, Jin R, Karam EG, Kovess-Masfety V, Levinson D, Matschinger H, O'Neill S, Posada-Villa J, Sagar R, Sampson NA, Sasu C, Stein DJ, Takeshima T, Viana MC, Xavier M, Kessler RC. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med. 2014 Apr;44(6):1303–17. doi: 10.1017/S0033291713001943. http://europepmc.org/abstract/MED/23931656. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Hom MA, Stanley IH, Joiner TE. Evaluating factors and interventions that influence help-seeking and mental health service utilization among suicidal individuals: A review of the literature. Clin Psychol Rev. 2015 Aug;40:28–39. doi: 10.1016/j.cpr.2015.05.006. [DOI] [PubMed] [Google Scholar]
  • 22.Han J, Batterham PJ, Calear AL, Randall R. Factors Influencing Professional Help-Seeking for Suicidality. Crisis. 2018 May;39(3):175–196. doi: 10.1027/0227-5910/a000485. [DOI] [PubMed] [Google Scholar]
  • 23.WHO Guideline: recommendations on digital interventions for health system strengthening. Geneva, Switzerland: World Health Organization; 2019. [PubMed] [Google Scholar]
  • 24.Torous J, Larsen ME, Depp C, Cosco TD, Barnett I, Nock MK, Firth J. Smartphones, Sensors, and Machine Learning to Advance Real-Time Prediction and Interventions for Suicide Prevention: a Review of Current Progress and Next Steps. Curr Psychiatry Rep. 2018 Jun 28;20(7):51. doi: 10.1007/s11920-018-0914-y. [DOI] [PubMed] [Google Scholar]
  • 25.Torok M, Han J, Baker S, Werner-Seidler A, Wong I, Larsen ME, Christensen H. Suicide prevention using self-guided digital interventions: a systematic review and meta-analysis of randomised controlled trials. The Lancet Digital Health. 2020 Jan;2(1):e25–e36. doi: 10.1016/S2589-7500(19)30199-2. [DOI] [PubMed] [Google Scholar]
  • 26.Efron B. Forcing a Sequential Experiment to be Balanced. Biometrika. 1971 Dec;58(3):403–17. doi: 10.2307/2334377. [DOI] [Google Scholar]
  • 27.Witt K, Spittal MJ, Carter G, Pirkis J, Hetrick S, Currier D, Robinson J, Milner A. Effectiveness of online and mobile telephone applications ('apps') for the self-management of suicidal ideation and self-harm: a systematic review and meta-analysis. BMC Psychiatry. 2017 Aug 15;17(1):297. doi: 10.1186/s12888-017-1458-0. https://bmcpsychiatry.biomedcentral.com/articles/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Han J, Batterham PJ, Calear AL, Wu Y, Xue J, van Spijker BA. Development and pilot evaluation of an online psychoeducational program for suicide prevention among university students: A randomised controlled trial. Internet Interv. 2018 Jun;12:111–120. doi: 10.1016/j.invent.2017.11.002. https://linkinghub.elsevier.com/retrieve/pii/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.van Spijker BA, Werner-Seidler A, Batterham PJ, Mackinnon A, Calear AL, Gosling JA, Reynolds J, Kerkhof AJ, Solomon D, Shand F, Christensen H. Effectiveness of a Web-Based Self-Help Program for Suicidal Thinking in an Australian Community Sample: Randomized Controlled Trial. J Med Internet Res. 2018 Feb 14;20(2):e15. doi: 10.2196/jmir.8595. https://www.jmir.org/2018/2/e15/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Werner-Seidler A, O'Dea B, Shand F, Johnston L, Frayne A, Fogarty AS, Christensen H. A Smartphone App for Adolescents With Sleep Disturbance: Development of the Sleep Ninja. JMIR Ment Health. 2017 Jul 28;4(3):e28. doi: 10.2196/mental.7614. https://mental.jmir.org/2017/3/e28/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Deady M, Johnston D, Milne D, Glozier N, Peters D, Calvo R, Harvey S. Preliminary Effectiveness of a Smartphone App to Reduce Depressive Symptoms in the Workplace: Feasibility and Acceptability Study. JMIR Mhealth Uhealth. 2018 Dec 04;6(12):e11661. doi: 10.2196/11661. https://mhealth.jmir.org/2018/12/e11661/ [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.van Spijker BA, Batterham PJ, Calear AL, Farrer L, Christensen H, Reynolds J, Kerkhof AJ. The suicidal ideation attributes scale (SIDAS): Community-based validation study of a new scale for the measurement of suicidal ideation. Suicide Life Threat Behav. 2014 Aug;44(4):408–19. doi: 10.1111/sltb.12084. [DOI] [PubMed] [Google Scholar]
  • 33.Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001 Sep;16(9):606–13. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006 May 22;166(10):1092–7. doi: 10.1001/archinte.166.10.1092. [DOI] [PubMed] [Google Scholar]
  • 35.Batterham PJ, Sunderland M, Carragher N, Calear AL, Mackinnon AJ, Slade T. The Distress Questionnaire-5: Population screener for psychological distress was more accurate than the K6/K10. J Clin Epidemiol. 2016 Mar;71:35–42. doi: 10.1016/j.jclinepi.2015.10.005. [DOI] [PubMed] [Google Scholar]
  • 36.Ng Fat L, Scholes S, Boniface S, Mindell J, Stewart-Brown S. Evaluating and establishing national norms for mental wellbeing using the short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS): findings from the Health Survey for England. Qual Life Res. 2017 May;26(5):1129–1144. doi: 10.1007/s11136-016-1454-8. http://europepmc.org/abstract/MED/27853963. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, Parkinson J, Secker J, Stewart-Brown S. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007 Nov 27;5:63. doi: 10.1186/1477-7525-5-63. https://hqlo.biomedcentral.com/articles/10.1186/1477-7525-5-63. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Stewart-Brown S, Tennant A, Tennant R, Platt S, Parkinson J, Weich S. Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a Rasch analysis using data from the Scottish Health Education Population Survey. Health Qual Life Outcomes. 2009 Feb 19;7:15. doi: 10.1186/1477-7525-7-15. https://hqlo.biomedcentral.com/articles/10.1186/1477-7525-7-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Morin CM, Belleville G, Bélanger L, Ivers H. The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep. 2011 May 01;34(5):601–8. doi: 10.1093/sleep/34.5.601. http://europepmc.org/abstract/MED/21532953. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.McEvoy PM, Mahoney AE, Moulds ML. Are worry, rumination, and post-event processing one and the same? Development of the repetitive thinking questionnaire. J Anxiety Disord. 2010 Jun;24(5):509–19. doi: 10.1016/j.janxdis.2010.03.008. [DOI] [PubMed] [Google Scholar]
  • 41.Bryan CJ, Kanzler KE, Grieser E, Martinez A, Allison S, McGeary D. A Shortened Version of the Suicide Cognitions Scale for Identifying Chronic Pain Patients at Risk for Suicide. Pain Pract. 2017 Mar;17(3):371–381. doi: 10.1111/papr.12464. [DOI] [PubMed] [Google Scholar]
  • 42.Simons JS, Gaher RM. The Distress Tolerance Scale: Development and Validation of a Self-Report Measure. Motiv Emot. 2005 Jun;29(2):83–102. doi: 10.1007/s11031-005-7955-3. [DOI] [Google Scholar]
  • 43.Hughes ME, Waite LJ, Hawkley LC, Cacioppo JT. A Short Scale for Measuring Loneliness in Large Surveys: Results From Two Population-Based Studies. Res Aging. 2004;26(6):655–672. doi: 10.1177/0164027504268574. http://europepmc.org/abstract/MED/18504506. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Russell D, Peplau LA, Cutrona CE. The revised UCLA Loneliness Scale: Concurrent and discriminant validity evidence. Journal of Personality and Social Psychology. 1980;39(3):472–480. doi: 10.1037//0022-3514.39.3.472. [DOI] [PubMed] [Google Scholar]
  • 45.Wilson C, Deane F, Ciarrochi J, Rickwood D. Measuring help seeking intentions: Properties of the General Help seeking Questionnaire. Can J Couns. 2005;39(1):15–28. http://ro.uow.edu.au/hbspapers/1527. [Google Scholar]
  • 46.Beecham J, Knapp M. Measuring Mental Health Needs (Second Edition) London, UK: Cambridge University Press; 2001. Costing psychiatric interventions; pp. 200–24. [Google Scholar]
  • 47.Duckworth AL, Peterson C, Matthews MD, Kelly DR. Grit: perseverance and passion for long-term goals. J Pers Soc Psychol. 2007 Jun;92(6):1087–101. doi: 10.1037/0022-3514.92.6.1087. [DOI] [PubMed] [Google Scholar]
  • 48.Liao Q, Cowling BJ, Lam WW, Ng DM, Fielding R. Anxiety, worry and cognitive risk estimate in relation to protective behaviors during the 2009 influenza A/H1N1 pandemic in Hong Kong: ten cross-sectional surveys. BMC Infect Dis. 2014 Mar 27;14:169. doi: 10.1186/1471-2334-14-169. https://bmcinfectdis.biomedcentral.com/articles/10.1186/1471-2334-14-169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Buri J, Cromett C, Post M, Landis A, Alliegro M. Negative Life Events Scale for Students (NLESS). 123rd annual convention of the American Psychological Association; August 2015; Toronto. 2015. [Google Scholar]
  • 50.O'Dea B, Han J, Batterham PJ, Achilles MR, Calear AL, Werner-Seidler A, Parker B, Shand F, Christensen H. A randomised controlled trial of a relationship-focussed mobile phone application for improving adolescents' mental health. J Child Psychol Psychiatry. 2020 Aug;61(8):899–913. doi: 10.1111/jcpp.13294. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Verbeke G, Molenberghs G. Linear Mixed Models for Longitudinal Data. New York, USA: Springer; 2013. [Google Scholar]
  • 52.Clarke V, Braun V, Hayfield N. Qualitative psychology: A practical guide to research methods. London: Sage; 2015. Thematic analysis; pp. 222–48. [Google Scholar]
  • 53.Thornton L, Batterham PJ, Fassnacht DB, Kay-Lambkin F, Calear AL, Hunt S. Recruiting for health, medical or psychosocial research using Facebook: Systematic review. Internet Interv. 2016 May;4:72–81. doi: 10.1016/j.invent.2016.02.001. https://linkinghub.elsevier.com/retrieve/pii/S2214-7829(15)30016-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Newby JM, O'Moore K, Tang S, Christensen H, Faasse K. Acute mental health responses during the COVID-19 pandemic in Australia. PLoS One. 2020;15(7):e0236562. doi: 10.1371/journal.pone.0236562. https://dx.plos.org/10.1371/journal.pone.0236562. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from JMIR Research Protocols are provided here courtesy of JMIR Publications Inc.

RESOURCES