Abstract
Loneliness is a significant problem for young people and is associated with a range of physical and mental health difficulties. Meta-analyses have identified that interventions aimed at young people who report loneliness as their primary problem are lacking within the literature. In adults, the most effective interventions for loneliness are those which target the underlying maladaptive social cognitions. Therefore, we have developed a modular Cognitive Behavioural Therapy (CBT) intervention for children and young people. The aim of this study is to conduct a multiple baseline single-case experimental design (SCED) to assess the efficacy, feasibility and acceptability of this intervention. In total 6–8 11–18-year-olds and their families will be recruited. The design consists of AB+ post-intervention, where A is the baseline phase, B is the intervention phase and then a post-intervention phase. Participants will complete a baseline assessment, before being randomised to one of four different baseline lengths (12 days, 19 days, 26 days or 33 days). Participants will then complete an average of 12 sessions of CBT, with the aim being to reduce their feelings of loneliness. Participants will then complete a 12-day post-intervention phase. Participant loneliness will be repeatedly assessed throughout the three phases of the intervention using the Three-item Loneliness Scale, which will be the primary outcome. Secondary outcomes will be reliable and clinically meaningful change on the UCLA Loneliness Scale, Revised Child Anxiety and Depression Scale (RCADS) and Strengths and Difficulties Questionnaire (SDQ). Feasibility and participant satisfaction will also be assessed and reported.
Trial registration: ClinicalTrails.gov trial registration number: NCT05149963 (Date registered: 07.12.2021). https://www.clinicaltrials.gov/ct2/show/NCT05149963?term=cbt&cond=loneliness&draw=2&rank=1.
Introduction
Loneliness is defined as the discrepancy between actual and desired social interaction [1]. Temporary loneliness is a normal phenomenon and regarded as part of everyday life [1, 2]. Research suggests that spending time alone is a normative adolescent experience and part of the developmental task of becoming independent, with some young people reporting time alone to be important for the development of self-identity [3]. This is differentiated from chronic loneliness, where an individual experiences a lack of satisfying relationships over time [4].
Chronic loneliness is a transdiagnostic problem and associated with a range of physical and mental health difficulties [5, 6]. Loneliness also increases the likelihood of mortality by 26% even when controlling for multiple covariates [7]. Loneliness in children and young people is associated with higher levels of peer victimisation [8, 9], lower self-worth and a range of mental and physical health problems [10–14]. The population of young people who are at an elevated risk of loneliness is highly heterogenous. It includes those with chronic health problems [15], mental health difficulties [10, 11] and those on the autism spectrum [16]. It is also hypothesised that interventions aimed at reducing loneliness may be an important active ingredient in the prevention and treatment of anxiety and depression in young people [17].
Distinct developmental trajectories of youth loneliness have been identified. It has been found that 18% of young people present with moderate levels of loneliness which increase over time and 22% present with consistently high levels of loneliness throughout childhood [14]. These findings are of significant concern, as it suggests that for many young people loneliness does not spontaneously remiss without intervention. Loneliness in young people is a significant challenge cross-culturally [18], including within the United Kingdom where 10% of children are reported to often experience loneliness, with 14% of those aged 10–12 and 8.6% of those aged 13–15 reporting that they “often” feel lonely [19].
Psychological interventions can be effective in reducing loneliness across the lifespan [20]. A recent meta-analysis of interventions for loneliness in young people highlighted a range of approaches that may reduce loneliness as a secondary outcome in at-risk groups [21]. These included intrapersonal strategies (e.g., psychological therapy), interpersonal strategies (e.g., social skills interventions), social strategies (e.g., social support) and self-help strategies (e.g., therapeutic apps). However, interventions specifically aimed at young people who report loneliness as their primary difficulty (rather than those at-risk of loneliness) are lacking within the literature. The authors also highlighted that current interventions do not differentiate between transient and chronic loneliness; with the latter requiring interventions targeting the underlying anxieties and negative cognitive biases that maintain chronic loneliness. A further limitation of the current evidence base is the lack of controlled experimental designs, which limits the conclusions that can be drawn regarding the efficacy of reported interventions.
A meta-analytic review of adult loneliness interventions by Masi et al. [22] identified that the most efficacious interventions were those which targeted the underlying maladaptive social cognitions. This may also be the case for youth populations and indicates that interventions aimed specifically at reducing loneliness in children and young people should be based within a Cognitive Behavioural Therapy (CBT) framework. However, this finding was not replicated in a recent systematic review and meta-analysis by Hickin et al. [20], which found CBT to be the third most effective treatment approach behind a reminiscence intervention for older adults and social identity interventions. This suggests that interventions for loneliness should take a modular approach, incorporating different evidence-based treatment components which can be selected based upon treatment need. A modular approach may be particularly appropriate for the adolescent population, due to the high levels of heterogeneity in the presentations of young people presenting with chronic loneliness [10, 11, 15, 16].
Käll et al. [23] have developed a modular cognitive behavioural analysis of chronic loneliness based upon a common elements approach. They identified the common practice elements within existing interventions shown to reduce loneliness and identified the ‘target’ mechanisms for a modular loneliness intervention. The modular model has varying treatment implications and its modular nature means it can be applied flexibly to different populations. A modular approach may be particularly appropriate for this client group, as the population is highly heterogenous and it is not yet known what interventions work for whom [17]. Interventions informed by this modular formulation have since been shown to be efficacious in two online randomised controlled trials (RCT) for reducing loneliness in adulthood [24, 25]. This suggests that this formulation model provides a good underlying theoretical basis for the development of Cognitive Behavioural Therapy (CBT) for loneliness in children and young people.
Associations between parental and child mental health problems have been identified, with parental mental health problems predictive of poorer CBT outcomes in young people [26, 27]. Therefore, in this present study parental health will also examined, to assess whether there is preliminary evidence for it having a role in treatment response.
The modular CBT intervention developed for this study will be evaluated through a multiple baseline single-case experimental design (SCED) [28–30]. A criticism of previous loneliness interventions for children and young people has been the lack of controlled experimental designs [21]. SCED’s provide a controlled experimental approach from which causal inferences can be drawn and give the detail and richness commonly associated with case studies [28]. As this is the first study to test this intervention, an iterative approach will be taken to development based upon Plan-Do-Study-Act (PDSA) cycles [31]. PDSA cycles are an individualised quality improvement method which aims to maximise the feasibility and acceptability of interventions by providing a framework for development, testing and implementation of change [32]. This approach has also been used effectively in previous intervention development studies for children and young people [33].
Aims and objectives
The primary objective will be to evaluate the efficacy of CBT for loneliness in children and young people ages 11–18. The primary outcome will be differences in scores on the Three-Item Loneliness Scale [34] between baseline and intervention and baseline and post-intervention. It is hypothesised that there will be a significant decrease in self-reported loneliness across both time-points. The secondary outcomes will be self-reported loneliness scores on the UCLA Loneliness Scale (UCLA-LS-3) [35] and self and parent-reported scores on the Strengths and Difficulties Questionnaires (SDQ) [36] and Revised Child Anxiety and Depression Scale (RCADS) [37]. It is hypothesised that there will be a reliable and clinically meaningful change [38] in total loneliness scores on the UCLA-LS-3, in the impact scores on the SDQ and in total anxiety and depression scores on the RCADS.
The secondary objective is to evaluate the feasibly and acceptability of the intervention process. This will be defined in terms of a) meeting the recruitment target, b) participant retention and c) participant feedback of the intervention using the Experience of Service Questionnaire [39].
Methods
Study design
The efficacy of CBT for loneliness in children and young people will be evaluated through a randomised multiple-baseline single-case experimental design (SCED) [28–30]. The design consists of AB+ post-intervention, where A is the baseline phase, B is the intervention phase and then a post-intervention phase. In the SCED approach participants are repeatedly assessed on at least one independent variable, in this case self-reported loneliness on the Three-item Loneliness Scale [34], across each phase of the intervention. This repeated measurement and within subject replication is then used to test the effects of the intervention for individual participants [28, 30]. Multiple-baseline SCEDs are a controlled experimental approach, with multiple-baselines protecting against threats to internal validity [40].
The construction of this SCED trial and the reporting of the results will be in accordance with the Single-Case Reporting Guidelines in Behavioural Intervention (SCRIBE) [30].
The study has received ethical approval from Royal Holloway, University of London on 22.03.2021 (ethical approval number: 2489). The study was registered with ClinicalTrials.gov on 07.12.2021 (registration number: NCT05149963).
Procedure
The trial procedure is shown in the schedule of enrolment, interventions and assessments (Fig 1).
Fig 1. Showing the trials schedule of enrolment, interventions and assessments.
Participants will be recruited via advertisements emailed to schools, shared via social media and word of mouth. Participants and their parents/carers will be sent an electronic information sheet and given the opportunity to ask any questions before completing an online consent form. Participants will provide informed ascent as they are under 18, with parents/carers providing informed consent. Participants and their parents/carers will then complete a baseline eligibility assessment. They will complete a range of online questionnaires via Qualtrics [41], a secure online platform. They will then attend a remote research assessment appointment to determine whether the family meet the eligibility criteria. The researcher completing the baseline and post-intervention assessments will not be involved in the clinical intervention and will be blinded to baseline allocation. After all baseline assessments for the participant group are completed, they will be discussed within supervision to confirm that the participants meet eligibility criteria. Eligible participants will then be randomised using a random number generator to one of four different baseline lengths (12 days, 19 days, 26 days or 33 days [42]. The decision to have a minimum of 12 observations per phase meets the requirements for guidelines and standards [43] and will allow for sufficient power for Tau-U analysis [44, 45].
Each of the families will then be contacted to inform them of their allocation. Randomisation and contacting of the families will be completed by a third researcher, who is not involved in either the clinical intervention or research assessments. Families will receive a £25 voucher for completing the baseline eligibility assessment. A letter will also be sent to their General Practitioner (GP) informing them of the family’s participation in the research study. The setting for the entire study will be remote via Zoom [46], with participants recruited from across the United Kingdom (UK).
All participants in the group will begin their baseline phase concurrently. During the baseline phase participants will be asked to complete the Three-Item Loneliness Scale [34] each day via Qualtrics [41]. SMS message reminders will also be sent to the young people and their parent/carers each day.
The baseline phase will be immediately followed by the intervention. Each family will receive (on average) 12 sessions of CBT for loneliness in children and young people. Where possible the first 4 sessions will take place bi-weekly, the second 4 sessions weekly and the final 4 sessions fortnightly.
For all participants the first two sessions will be focussed on assessment and then formulation. The final session for all participants will focus on relapse prevention. During the assessment session the participant will be asked to define 3 goal-based outcomes (GBOs) [47] for how they hope the intervention will reduce their loneliness, which will then guide the treatment process. During the intervention phase the participants will complete routine outcome measures (ROMs) for each session. This will include the Three-Item Loneliness Scale [34], visual analogue scales (VAS) of mood, anxiety and loneliness and ratings of their goal-based outcomes [48]. The ROMs will be completed via Qualtrics [41] before each session. If participants have not completed the ROMs before their appointment, then they will be completed with the clinician at the start of the session.
Participants will begin the post-intervention phase immediately after the final session of their intervention. During the post-intervention phase participants will be asked to complete the primary outcome measure, Three-Item Loneliness Scale [34], each day for 12 days. They will then complete their post-intervention assessment with the second researcher. Before the assessment they will be asked to re-complete the baseline questionnaires in addition to the parent and child-report versions of the Experience of Service Questionnaire [39] and a questionnaire asking whether COVID-19 or any other events have affected them during the intervention period. The family will be given a £25 voucher for completing the post-intervention assessment. A letter will be sent to their General Practitioner (GP) informing them of their participation in the research study has finished.
Procedural fidelity
The intervention will be conducted by the first author (TC). He will receive weekly supervision from RS, AK and SB throughout the research and intervention process to ensure fidelity to the agreed protocol. Procedural fidelity during the intervention phase will also be monitored through the completion of adherence to the manual checklists after each intervention appointment.
Participants
We will aim to recruit 6–8 participants to the study. All participants will be recruited from within the United Kingdom. Participants must meet the following inclusion/exclusion criteria:
Inclusion criteria
Aged 11–18
Score more than 42 on the UCLA-LS-3 [35], which is more than one standard deviation above the mean in a large community adolescent sample [49].
Have a parent/carer who is willing to take part in the study.
Report loneliness as their primary difficulty (i.e., they are able to identify relevant goal-based outcomes and their current difficulties are not attributable to a significant mental health problem).
Exclusion criteria
Currently receiving psychological therapy.
Started taking antidepressant in the last 8 weeks.
Eligibility assessment indicates a severe mental health problem not considered suitable for the trial intervention due to the clinical need for immediate intervention, e.g., active suicidality or psychosis.
Refusal for therapy sessions to be video recorded.
Having an intellectual disability at a level whereby they cannot access the intervention.
Do not have access to a laptop or smartphone which they can use for video calls.
Intervention
To the best of our knowledge this is the first study to examine the efficacy of cognitive behavioural therapy for loneliness in children and young people. The intervention has been developed for this research study using a modular approach based upon Käll et al.’s [23] modular cognitive behavioural formulation. It incorporates translated elements of Käll et al., [25] online intervention, and is informed by the Modular approach to therapy for children with anxiety, depression, trauma, or conduct problems (MATCH-ADTC) [50], Groups4Health [51], PEERS social skills training [52], CBT for Social Anxiety Disorder for adolescence [53] and the literature implicating social camouflaging in mental health difficulties for those on the autism spectrum [54].
The intervention is being developed iteratively based upon feedback and clinical experience using PDSA cycles [31]. The current manual is comprised of 10 treatment modules (Table 1). All participants will complete Module 1 (Assessment), Module 2 (Formulation and Psychoeducation) and Module 10 (Relapse prevention). Other intervention modules will be chosen in collaboration with the participants based upon their personalised formulation and treatment goals. The number of sessions delivered for each module will be determined by treatment priorities, individual progress and the number of sessions remaining. The intervention will be delivered by the first author (TC) who is a trainee clinical psychologist. He will receive weekly supervision from the other authors (RS, AK, SB) who are all qualified clinical psychologists. If there is deterioration in wellbeing or risk issues are identified local statutory or healthcare services will be contacted as appropriate. Participants are able to withdraw from the trial at any time.
Table 1. Showing the treatment modules which comprise CBT for chronic loneliness in children and young people.
Module | Description |
---|---|
1. Assessment | The aim of this module is to complete a structured CBT assessment of the participants loneliness. The CBT assessment will cover each of the modules within Käll et al., [23] formulation. The assessment will also include questions regarding the participants development/early experiences, current living situation, education, physical health, lifestyle (diet, sleep, exercise, hobbies/interests, social media use) and a risk assessment, before identifying three goals for treatment. |
2. Formulation and psychoeducation | The aim of this module is to collaboratively complete a modular formulation of the factors maintaining the participants chronic loneliness [23]. The participant will also be given psychoeducation on loneliness, the intervention process and will collaboratively develop a treatment plan based on their formulation and goal-based outcomes. |
3. Challenging negative interpersonal appraisals and counterproductive behaviours | The aim of the module is to change the negative thought patterns and counter-productive behaviours which are maintaining chronic loneliness. Participants will be given psychoeducation on the CBT model and the relationship between thoughts, behaviours, physical feelings, and emotions. Participants will be supported to identify the negative interpersonal appraisals and counterproductive behaviours which are maintaining their loneliness. The participant will then be supported to develop within-session behavioural experiments to challenge the counterproductive processes that are maintain their loneliness, which will then be reinforced through agreed homework tasks. |
4. Challenging negative thoughts and cognitive biases | The aim of the module is to challenge the negative cognitions and cognitive biases that are maintaining chronic loneliness. Participants will be given psychoeducation on automatic thought processes, negative thinking traps and their role in chronic loneliness. The participant will be supported to develop strategies to challenge thinking errors. The module is based upon the Cognitive Coping modules of MATCH-ADTC [50]. |
5. Challenging self-focussed attention, hypervigilance and camouflaging | The aim of the module is to challenge self-focussed attention, hypervigilance and/or camouflaging when they are maintaining chronic loneliness. The module is comprised of three submodules: 5A, Reducing Self-Focussed Attention, 5B Reducing Hypervigilance and 5C Reducing Camouflaging Behaviours. Each submodule provides psychoeducation on the role of that difficulty in maintaining chronic loneliness. The participant will then be supported to develop within-session behavioural experiments to challenge the counterproductive processes, which will then be reinforced through agreed homework tasks. Module 5A is based upon CBT for Social Anxiety in Adolescence [53], with module 5B being a hypervigilance-focussed adaptation of this. Module 5C is a novel module informed by the literature regarding the role of camouflaging in mental health difficulties in those on the autism spectrum [54]. |
6. Values-based social skills training | The aim of this module is to identify the participants social communication strengths and areas for development. The participant will then be supported to develop their social skills in line with their values and treatment goals aiming to reduce their loneliness. The module is informed by the UCLA PEERS program [52] and the social skills module of the internet-based CBT for loneliness in adults [24]. The module is comprised of four submodules: 6A Conversation skills, 6B Managing Teasing and Bullying, 6C Managing disagreements and 6D Dating and Flirting. An emphasis on remote communication is embedded across all submodules. |
7. Problems solving | The aim of the module is to teach formal problem-solving to overcome practical barriers to reducing loneliness. The module is based upon the Problem-Solving module within MATCH-ADTC [50]. Participants will be provided with psychoeducation on the problem-solving STEPS before having the opportunity to practice the skills within the session. The participant will then be supported to use the problem-solving skills to overcome the practical barriers that are maintaining their loneliness. |
8. Finding Friends | The aim of the module is to map the young person’s current social world and identify opportunities for the development of positive social relationships. Participants will be supported to map their current relationships and rate them in terms of positivity, similarity, support and time spent together. Participants will then link their current social groups based on compatibility. Participants will then be supported to identify strategies to improve their connection with current groups, as well as develop connections with new social groups. The module is informed by the Groups4Health intervention [51]. |
9. Managing Emotions | The aim of the module is to develop strategies to manage emotional responses where they are maintaining chronic loneliness. The module is comprised of two submodules; 9A: Activity selection (for low mood) and 9B Learning to relax (for anxiety management). Both submodules are based on MATCH-ADTC [50]. |
10. Relapse Prevention | The aim of the module is to develop a relapse prevention plan with the young person and their parent/carer. This will focus on what the family has learnt during the sessions, strategies to maintain their progress and overcome future difficulties and the difference between a lapse and relapse. Participants will be supported to complete a written plan in addition to a relapse prevention video. |
Outcome measures
Loneliness
The three item loneliness scale [34]. This will be used to assess the child/young persons’ self-reported loneliness throughout each of the three phases of the study. The scale is a brief 3-item measure derived from the UCLA-LS-3 [35]. The measure contains three items rated on a 5-point Likert scale (0 = never, 1 = rarely, 2 = sometimes, 3 = often, 4 = very often). Answers are summed to a total score of 0–12, with higher scores indicating a higher level of loneliness. The Office for National Statistics (ONS) have validated a 3-reponse version of this measure with young people ages 10–15 [19]. In qualitative testing of the measure, they identified that the words “companionship” and “isolation” were difficult for some young people to understand. These changes in wording were also used in this study as the age range was similar to that used in the ONS validation. The items used were “How often do you feel that you have no one to talk to?”, “How often do you feel left out?” and “How often do you feel alone?”.
UCLA Loneliness Scale (UCLA-LS-3) [35]. The measure will be used to assess the child/young person’s subjective experience of loneliness. The instrument consists of 20 items measured on a 4-point scale where the respondents are asked to indicate how frequently the statement is descriptive of them with the options of never, rarely, sometimes, and often. The UCLA-LS-3 has been used extensively in loneliness research, including in intervention studies [25, 55] and has been validated in a large adolescent sample [49]. The psychometric properties include a very high internal consistency (Cronbach’s α’s ranging from .89 to .94) and a good test-retest-reliability (.73 over a 1-year period) [35].
Psychological wellbeing
The Strengths and Difficulties Questionnaires (SDQ) [36]. The self-report and parent-report versions will be used to assess the child’s psychological wellbeing. It is a brief behavioural screening questionnaire for children and young people ages 2 -17. The 25 items are divided between 5 scales (emotional, conduct problems, hyperactivity/inattention, peer relationship problems, prosocial behaviour), with the first four summed to provide a total difficulties score. The SDQ has an ‘impact scale’, which assesses the impact that symptoms have on everyday life in a range of domains (home, school, leisure). The SDQ has good internal consistency (mean Cronbach α .73), cross-informant correlation (mean 0.34), and retest stability after 4 to 6 months [36].
The Revised Child Anxiety and Depression Scale (RCADS). The parent and self-report versions will be used to assess the child’s anxiety and depression. It is a 47-item questionnaire for 8–18-year-olds. Its subscales include separation anxiety disorder, social phobia, generalized anxiety disorder, panic disorder, obsessive compulsive disorder, and low mood (major depressive disorder). In addition to the subscales, a total anxiety scale and total anxiety and depression scale can be calculated. It has good reliability on subscales and total scale, with internal consistency of adequate-excellent across the different subscales [56]. It also had good test-retest reliability and good convergent and concurrent validity [56, 57].
Sample characterisation
Demographic questionnaire. Parents/carers will be asked to complete a demographic questionnaire. This will ask about the child’s age, gender, ethnic background, existing child psychiatric diagnoses, parent/carer’s age, family composition, parent/carer’s education level, parent/carer employment status and household income band.
The Generalised Anxiety Disorder Assessment (GAD-7) [58]
The measure will be used to assess the parents/carers self-reported anxiety. The GAD-7 is a 7-item measure with scores ranging from 0–21. Scores of 5, 10, and 15 represent cut-points for mild, moderate, and severe anxiety, respectively. The measure has been shown to have excellent internal consistency and good test-retest reliability and convergent validity [58].
The Patient Health Questionnaire (PHQ-9) [59]
The measure will be used to assess the parent/carers self-reported depression. It is a 9-item measure of depressive symptoms with scores ranging from 0–27. Each item asks the individual to rate the severity of their symptoms over the past two weeks. Scores of 5, 10, and 15 and 20 represent cut-points for mild, moderate, moderately severe and severe depression respectively. The PHQ-9 has demonstrated good convergent and discriminant validity and high internal consistency [59–61].
UCLA-LS-3 [35]. This measure will also be used to characterise the level of self-reported parent/carer loneliness.
Process measures
Goal based outcomes [47]. During their first intervention session young people will be asked to identify 3 intervention goals relating to their loneliness. They will be asked to rate on a 1–10 scale where they are in terms of achieving this goal; with 1 being “the furthest I could ever be from achieving this goal” and 10 “I have achieved this goal”. They will then rate each goal as part of the routine outcome measures for each session. Goal-based outcomes have been shown to improve treatment retention, clinical outcomes and client progress [62, 63].
Visual analogue scales (VAS) [48]. For each session young people will be asked to rate their current mood, anxiety and loneliness on a 1–10 scale, where 10 is the worst. Visual analogue scales have been shown to have good validity and reliability [64].
Feasibility and experience measures
During the post-intervention assessment, the participants will be asked to complete the child and parent-report versions of the Experience of Services Questionnaire (ESQ) [39] regarding their experience of the intervention. Feasibility will be assessed based upon recruitment (meeting targets), retention, completion of measures and proportion of sessions attended by the participants. All participating families will also be asked how COVID-19 or other events have impacted the child’s loneliness during the intervention period. Finally, any adverse events that occur during the trial period will be recorded, reported and discussed within supervision.
Data analysis
Primary outcome measure
The primary outcome measure of the SCED (self-reported scores on the Three Item Loneliness Scale [34]) will be analysed using visual inspection and statistical analysis.
For visual analysis, in accordance with SCED procedure, each participants data will be graphically represented on a line graph for the outcome variable [65, 66]. The baseline phase will be examined to determine a stable control. Data within and between each phase will then be compared for a) change in trend or symptom severity across phases, b) the degree of the slope on the graph which indicates the strength of the trend and c) change in the variability of the data to indicate stability in symptom change. Data will be mapped and inspected using both within-phase (evaluation of data patterns across participants in a single phase) and between-phase (comparison across adjacent phases for each participant) analyses [65, 66].
For statistical analysis Tau-U [45] will be used, which is a test specifically designed for single case research and has been used in previous SCEDs of psychological interventions [67, 68]. It is not dependent on distribution assumptions and calculations are based upon consideration of all data points. A further strength of the approach is that it can control for unwanted trends or variability in baseline scores to identify whether any change is the result of the introduction of the intervention [45]; making it a robust approach for SCED analysis. Tau-U will be used to analyse the overlap between the baseline and intervention phase and the baseline and post-intervention phase. The statistical analysis can be understood as the percentage of data that ‘improves’ across the phases of the study whilst considering any pre-existing baseline trends [68]. Tau-U will also be used to calculate an effect size and weighted average across all cases for the primary outcome variable.
Secondary outcome measures
It will be assessed how many of the participants display a reliable and clinically significant change [38] in total loneliness scores on the UCLA-LS-3 [35] and parent and self-reported impact scores on the SDQ [36]. It will also be examined how many participants display reliable change [38] in parent and self-reported Total Anxiety and Depression Scores on the RCADS [37], as well as how many participants report ‘clinically significant’ and ‘borderline clinical’ scores at baseline and post-intervention.
For the UCLA-LS-3 criterion B will be used to determine clinically significant change [38]. For criterion B, the participant must move within 2 standard deviations of the mean of a non-clinical comparison population. Criterion A and C will not be used due to lack of normative data available for a ‘clinically lonely’ population. The test-retest reliability used for the calculation will be 0.73 [35]. Normative data for the comparison population will be taken from a large-scale adolescent community sample, mean = 32.82, SD = 9.43 [49]. Reliable change will be calculated using Jacobson and Truax [38], whereby the baseline mean is subtracted from the post-intervention mean then divided by the standard error of measurement, giving the Reliable Change Index (RCI). The RCI indicates what would be categorised as clinically reliable improvement or deterioration.
For the RCADS well-defined norms are available [37], with raw scores being converted to age and gender-specific T-scores. A T-score of 65 means the young person is scoring in the top 7% for un-referred young people and is classified as “borderline clinical”. A T-score of 70 means that the young person is in the top 2% of unreferred young people and is described as the “clinical” threshold. The number of participants scoring within the clinical, borderline clinical and non-clinical ranges at baseline and post-intervention will be reported. As this current study has a small sample, the Reliable Change Index (RCI) used will be from a large normative sample [37].
For the SDQ parent and self-reported impact scores criterion C will be used to calculate clinically significant change. For criterion C, the participant’s score must move to the comparison side of the point halfway between the clinical and comparison group mean. Criterion C will be calculated as both clinical and comparisons norms are available. A test-retest reliability of .71 will be used [69]. For parent-report M = 0.4, SD = 1.1 will be used for comparison norms [36] and M = 6.2, SD = 2.7 for clinical norms [70]. For child report M = 0.2, SD = 2.8 will be used for comparison norms [36] and M = 5, SD = 3.3 [70] for clinical norms. For the SDQ impact scores, the Reliable Change Index (RCI) values will be based on those reported by Goodman [36] from a large normative sample.
The VAS and GBO’s will also be visually presented and the means and standard deviations of scores at baseline and post-intervention will be reported.
Feasibility and satisfaction measures
The proportion of our minimum recruitment target of 6 participants that we achieve will be reported. Successful completion of 6 participants will indicate that the recruitment protocol is feasible. The proportion of participants retained, defined as completing both the baseline and intervention assessments will be reported; with an 80% retention rate indicating that the research protocol is feasible, based on previous studies [71]. We will also report the proportion of appointments attended across all participants. The key themes identified in the Experience of Services Questionnaire [39] and the questionnaire assessing the impact of COVID-19 or other events on the child’s loneliness will also be reported. Acceptability will be indicated by 80% positive responses on the Experience of Services Questionnaire [39].
Data management, confidentiality and access
All data in the trial is anonymised. Participants will complete their questionnaires via Qualtrics [41], which is a password protected online platform. Consent forms will be stored on a separate encrypted database to participant data and linked by a unique participant ID number. Anonymised data will made available within the OSF data repository.
Patient public involvement (PPI)
A young person advisor and several parent/carer advisors provided advice on the study advertisements, information sheets, assessment protocol and intervention materials. A member of the University College London Loneliness and Social Isolation in Mental Health Research Network provided feedback on the intervention protocol. As the intervention protocol is being developed iteratively using PDSA cycles [31] it will also be adapted based upon within-session feedback from the participants.
Discussion
To the best of our knowledge this will be the first study to test a CBT-based intervention for loneliness in young people ages 11–18. The intervention is modular and based upon Käll et al., [23] cognitive behavioural analysis of chronic loneliness. The intervention incorporates translated elements of Käll et al., [55] online intervention, and is informed by MATCH-ADTC [50], Groups4Health [51], PEERS social skills training [52] and CBT for Social Anxiety Disorder for adolescence [53]. The intervention will be evaluated through a SCED [28–30] of 6–8 participants. The primary objective of this study will be to test the efficacy of the intervention in terms of whether there are differences in scores on the Three-Item Loneliness Scale [34] between the different phases. The secondary objectives will be to examine whether there is reliable and clinically meaningful change [38] in self-reported loneliness scores on the UCLA-LS-3 [35], self and parent-reported impact scores on the SDQ [36] and self and parent-reported total scores on the RCADS [37]. The third objective will be to evaluate the feasibly and acceptability of the intervention. This will be defined in terms of a) meeting the recruitment target, b) participant retention and c) participant feedback of the intervention using the Experience of Service Questionnaire [39]. The results of the trial will be published in a peer reviewed journal and presented at relevant conferences.
Limitations
The population of young people who are at an elevated risk of loneliness is highly heterogenous, [10, 11, 15, 16], and there is significant variability in the psychological problems across the 11–18 age range used in this study. The relatively small sample size means that it is not possible within this design to test the efficacy of the intervention broadly across these different subgroups. However, we suggest that the modular approach allows for the intervention to be applied flexibly, and so is feasible for use with the heterogenous population of young people presenting with chronic loneliness. If it is found that there is preliminary evidence that the modular intervention is effective, future research should examine the specific mechanisms maintaining loneliness for different subgroups of young people. This could allow for the development of bespoke adaptations of the intervention which may result in increased treatment engagement and efficacy.
The sample size used within this study is also relatively small and caution should be taken when interpreting the results. If preliminary evidence of effectiveness is found, an open trial followed by an RCT should be conducted to further examine the efficacy of the intervention, with RCT’s described as the ‘gold standard’ for effectiveness research [72].
Protocol version 1 (November 2021). Any changes to the protocol will be communicated to the journal and updated on ClinicalTrails.gov.
Supporting information
(DOC)
(PDF)
Acknowledgments
All research at Great Ormond Street Hospital NHS Foundation Trust and UCL Great Ormond Street Institute of Child Health is made possible by the NIHR Great Ormond Street Hospital Biomedical Research Centre. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.
We would like to thank Ellie Pearce, Georgia Jerwood and the University College London Loneliness and Social Isolation in Mental Health Research Network for supporting with service-user involvement. We would also like to thank James Martin and the parents who gave feedback on the research and intervention materials.
Data Availability
No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.
Funding Statement
The author(s) received no specific funding for this work.
References
- 1.Perlman D, Peplau LA, Goldston S. Loneliness research: A survey of empirical findings. 5th ed. National Institute of Mental Health (U.S.); 1984. [Google Scholar]
- 2.McWhirter BT. Loneliness: A review of current literature, with implications for counseling and research. J Couns Dev. 1990;68(4):417–22. [Google Scholar]
- 3.Rotenberg KJ, Hymel S. Loneliness in childhood and adolescence. Cambridge University Press; 1999. [Google Scholar]
- 4.Cacioppo JT, Hawkley LC. Perceived social isolation and cognition. Trends Cogn Sci. 2009;13(10):447–54. doi: 10.1016/j.tics.2009.06.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Shiovitz-Ezra S, Ayalon L. Situational versus chronic loneliness as risk factors for all-cause mortality. Int Psychogeriatr. 2010;22(3):455–62. doi: 10.1017/S1041610209991426 [DOI] [PubMed] [Google Scholar]
- 6.Mushtaq R, Shoib S, Shah T, Mushtaq S. Relationship between loneliness, psychiatric disorders and physical health? A review on the psychological aspects of loneliness. J Clin Diagn Res JCDR. 2014;8(9):WE01. doi: 10.7860/JCDR/2014/10077.4828 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Holt-Lunstad J, Smith TB, Baker M, Harris T, Stephenson D. Loneliness and social isolation as risk factors for mortality: a meta-analytic review. Perspect Psychol Sci. 2015;10(2):227–37. doi: 10.1177/1745691614568352 [DOI] [PubMed] [Google Scholar]
- 8.Boivin M, Hymel S, Bukowski WM. The roles of social withdrawal, peer rejection, and victimization by peers in predicting loneliness and depressed mood in childhood. Dev Psychopathol. 1995;7(4):765–85. [Google Scholar]
- 9.Ladd GW, Kochenderfer BJ, Coleman CC. Classroom peer acceptance, friendship, and victimization: Distinct relational systems that contribute uniquely to children’s school adjustment? Child Dev. 1997;1181–97. doi: 10.1111/j.1467-8624.1997.tb01993.x [DOI] [PubMed] [Google Scholar]
- 10.Loades ME, Chatburn E, Higson-Sweeney N, Reynolds S, Shafran R, Brigden A, et al. Rapid systematic review: the impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1218–39. doi: 10.1016/j.jaac.2020.05.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Schinka KC, VanDulmen MH, Bossarte R, Swahn M. Association between loneliness and suicidality during middle childhood and adolescence: longitudinal effects and the role of demographic characteristics. J Psychol. 2012;146(1–2):105–18. doi: 10.1080/00223980.2011.584084 [DOI] [PubMed] [Google Scholar]
- 12.Vanhalst J, Klimstra TA, Luyckx K, Scholte RH, Engels RC, Goossens L. The interplay of loneliness and depressive symptoms across adolescence: Exploring the role of personality traits. J Youth Adolesc. 2012;41(6):776–87. doi: 10.1007/s10964-011-9726-7 [DOI] [PubMed] [Google Scholar]
- 13.Qualter P, Brown SL, Munn P, Rotenberg KJ. Childhood loneliness as a predictor of adolescent depressive symptoms: an 8-year longitudinal study. Eur Child Adolesc Psychiatry. 2010;19(6):493–501. doi: 10.1007/s00787-009-0059-y [DOI] [PubMed] [Google Scholar]
- 14.Qualter P, Brown SL, Rotenberg KJ, Vanhalst J, Harris RA, Goossens L, et al. Trajectories of loneliness during childhood and adolescence: Predictors and health outcomes. J Adolesc. 2013;36(6):1283–93. doi: 10.1016/j.adolescence.2013.01.005 [DOI] [PubMed] [Google Scholar]
- 15.Maes M, Van den Noortgate W, Fustolo-Gunnink SF, Rassart J, Luyckx K, Goossens L. Loneliness in children and adolescents with chronic physical conditions: a meta-analysis. J Pediatr Psychol. 2017;42(6):622–35. doi: 10.1093/jpepsy/jsx046 [DOI] [PubMed] [Google Scholar]
- 16.Bauminger N, Shulman C, Agam G. Peer interaction and loneliness in high-functioning children with autism. J Autism Dev Disord. 2003;33(5):489–507. doi: 10.1023/a:1025827427901 [DOI] [PubMed] [Google Scholar]
- 17.Pearce E, Myles-Hooton P, Johnson S, Hards E, Olsen S, Clisu D, et al. Loneliness as an active ingredient in preventing or alleviating youth anxiety and depression: a critical interpretative synthesis incorporating principles from rapid realist reviews. Transl Psychiatry. 2021;11(1):1–36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Peltzer K, Pengpid S. Loneliness: Its correlates and associations with health risk behaviours among university students in 25 countries. J Psychol Afr. 2017;27(3):247–55. [Google Scholar]
- 19.Measuring loneliness: guidance for use of the national indicators on surveys—Office for National Statistics [Internet]. [cited 2021 Dec 10]. Available from: https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/methodologies/measuringlonelinessguidanceforuseofthenationalindicatorsonsurveys#recommended-measures-for-children
- 20.Hickin N, Käll A, Shafran R, Sutcliffe S, Manzotti G, Langan D. The effectiveness of psychological interventions for loneliness: A systematic review and meta-analysis. Clin Psychol Rev. 2021;102066. doi: 10.1016/j.cpr.2021.102066 [DOI] [PubMed] [Google Scholar]
- 21.Eccles AM, Qualter P. Alleviating loneliness in young people–a meta‐analysis of interventions. Child Adolesc Ment Health. 2021;26(1):17–33. [DOI] [PubMed] [Google Scholar]
- 22.Masi CM, Chen HY, Hawkley LC, Cacioppo JT. A meta-analysis of interventions to reduce loneliness. Personal Soc Psychol Rev. 2011;15(3):219–66. doi: 10.1177/1088868310377394 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Käll A, Shafran R, Lindegaard T, Bennett S, Cooper Z, Coughtrey A, et al. A common elements approach to the development of a modular cognitive behavioral theory for chronic loneliness. J Consult Clin Psychol. 2020;88(3):269. doi: 10.1037/ccp0000454 [DOI] [PubMed] [Google Scholar]
- 24.Käll A, Jägholm S, Hesser H, Andersson F, Mathaldi A, Norkvist BT, et al. Internet-based cognitive behavior therapy for loneliness: a pilot randomized controlled trial. Behav Ther. 2020;51(1):54–68. doi: 10.1016/j.beth.2019.05.001 [DOI] [PubMed] [Google Scholar]
- 25.Käll A, Bäck M, Welin C, Åman H, Bjerkander R, Wänman M, et al. Therapist-Guided Internet-Based Treatments for Loneliness: A Randomized Controlled Three-Arm Trial Comparing Cognitive Behavioral Therapy and Interpersonal Psychotherapy. Psychother Psychosom. 2021;90(5):351–8. doi: 10.1159/000516989 [DOI] [PubMed] [Google Scholar]
- 26.Kunas SL, Lautenbacher LM, Lueken U, Hilbert K. Psychological predictors of cognitive-behavioral therapy outcomes for anxiety and depressive disorders in children and adolescents: A systematic review and meta-analysis. J Affect Disord. 2021;278:614–26. doi: 10.1016/j.jad.2020.09.092 [DOI] [PubMed] [Google Scholar]
- 27.De Haan AM, Boon AE, de Jong JT, Hoeve M, Vermeiren RR. A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clin Psychol Rev. 2013;33(5):698–711. doi: 10.1016/j.cpr.2013.04.005 [DOI] [PubMed] [Google Scholar]
- 28.Kazdin AE. Evidence-based treatment research: Advances, limitations, and next steps. Am Psychol. 2011;66(8):685. doi: 10.1037/a0024975 [DOI] [PubMed] [Google Scholar]
- 29.Kazdin AE. Single-case experimental designs. Evaluating interventions in research and clinical practice. Behav Res Ther. 2019;117:3–17. doi: 10.1016/j.brat.2018.11.015 [DOI] [PubMed] [Google Scholar]
- 30.Tate RL, Perdices M, Rosenkoetter U, Shadish W, Vohra S, Barlow DH, et al. The single-case reporting guideline in behavioural interventions (SCRIBE) 2016 statement. Phys Ther. 2016;96(7):e1–10. doi: 10.2522/ptj.2016.96.7.e1 [DOI] [PubMed] [Google Scholar]
- 31.Berwick DM. Developing and testing changes in delivery of care. Ann Intern Med. 1998;128(8):651–6. doi: 10.7326/0003-4819-128-8-199804150-00009 [DOI] [PubMed] [Google Scholar]
- 32.Taylor MJ, McNicholas C, Nicolay C, Darzi A, Bell D, Reed JE. Systematic review of the application of the plan–do–study–act method to improve quality in healthcare. BMJ Qual Saf. 2014;23(4):290–8. doi: 10.1136/bmjqs-2013-001862 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Shafran R, Bennett S, Coughtrey A, Welch A, Walji F, Cross JH, et al. Optimising evidence-based psychological treatment for the mental health needs of children with epilepsy: principles and methods. Clin Child Fam Psychol Rev. 2020;1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Klein E, Zenger M, Tibubos A, Ernst M, Reiner I, Schmalbach B, et al. Loneliness and its relation to mental health in the general population: Validation and norm values of a brief measure. J Affect Disord Rep. 2021;4:100120. [Google Scholar]
- 35.Russell DW. UCLA Loneliness Scale (Version 3): Reliability, validity, and factor structure. J Pers Assess. 1996;66(1):20–40. doi: 10.1207/s15327752jpa6601_2 [DOI] [PubMed] [Google Scholar]
- 36.Goodman R. Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry. 2001;40(11):1337–45. doi: 10.1097/00004583-200111000-00015 [DOI] [PubMed] [Google Scholar]
- 37.Chorpita BF, Yim L, Moffitt C, Umemoto LA, Francis SE. Assessment of symptoms of DSM-IV anxiety and depression in children: A revised child anxiety and depression scale. Behav Res Ther. 2000;38(8):835–55. doi: 10.1016/s0005-7967(99)00130-8 [DOI] [PubMed] [Google Scholar]
- 38.Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. Journal of consulting and clinical psychology. 1992;59(1):12–9. [DOI] [PubMed] [Google Scholar]
- 39.Brown A, Ford T, Deighton J, Wolpert M. Satisfaction in child and adolescent mental health services: Translating users’ feedback into measurement. Adm Policy Ment Health Ment Health Serv Res. 2014;41(4):434–46. doi: 10.1007/s10488-012-0433-9 [DOI] [PubMed] [Google Scholar]
- 40.Slocum TA, Pinkelman SE, Joslyn PR, Nichols B. Threats to Internal Validity in Multiple-Baseline Design Variations. Perspect Behav Sci. 2022;1–20. doi: 10.1007/s40614-022-00326-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Qualtrics XM // The Leading Experience Management Software [Internet]. [cited 2021 Dec 10]. Available from: https://www.qualtrics.com/uk/?rid=ip&prevsite=en&newsite=uk&geo=GB&geomatch=uk
- 42.RANDOM.ORG—Sequence Generator [Internet]. [cited 2021 Dec 10]. Available from: https://www.random.org/sequences/
- 43.Smith JD. Single-case experimental designs: a systematic review of published research and current standards. Psychol Methods. 2012;17(4):510. doi: 10.1037/a0029312 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Shadish WR, Hedges LV, Pustejovsky JE, Boyajian JG, Sullivan KJ, Andrade A, et al. A d-statistic for single-case designs that is equivalent to the usual between-groups d-statistic. Neuropsychol Rehabil. 2014;24(3–4):528–53. doi: 10.1080/09602011.2013.819021 [DOI] [PubMed] [Google Scholar]
- 45.Parker RI, Vannest KJ, Davis JL, Sauber SB. Combining nonoverlap and trend for single-case research: Tau-U. Behav Ther. 2011;42(2):284–99. doi: 10.1016/j.beth.2010.08.006 [DOI] [PubMed] [Google Scholar]
- 46.Video Conferencing, Cloud Phone, Webinars, Chat, Virtual Events | Zoom [Internet]. [cited 2021 Dec 10]. Available from: https://zoom.us/
- 47.Law D, Jacob J. Goals and goal based outcomes (GBOs). London: CAMHS Press; 2013. [Google Scholar]
- 48.Wewers ME, Lowe NK. A critical review of visual analogue scales in the measurement of clinical phenomena. Res Nurs Health. 1990;13(4):227–36. doi: 10.1002/nur.4770130405 [DOI] [PubMed] [Google Scholar]
- 49.Shevlin M, Murphy S, Murphy J. The latent structure of loneliness: testing competing factor models of the UCLA loneliness scale in a large adolescent sample. Assessment. 2015;22(2):208–15. doi: 10.1177/1073191114542596 [DOI] [PubMed] [Google Scholar]
- 50.Chorpita BF, Weisz JR. Modular approach to therapy for children with anxiety, depression, trauma, or conduct problems (MATCH-ADTC). Satellite Beach, FL: PracticeWise; 2009. [Google Scholar]
- 51.Haslam C, Cruwys T, Haslam SA, Dingle G, Chang MXL. Groups 4 Health: Evidence that a social-identity intervention that builds and strengthens social group membership improves mental health. J Affect Disord. 2016;194:188–95. doi: 10.1016/j.jad.2016.01.010 [DOI] [PubMed] [Google Scholar]
- 52.Laugeson EA, Frankel F, Gantman A, Dillon AR, Mogil C. Evidence-based social skills training for adolescents with autism spectrum disorders: The UCLA PEERS program. J Autism Dev Disord. 2012;42(6):1025–36. doi: 10.1007/s10803-011-1339-1 [DOI] [PubMed] [Google Scholar]
- 53.Leigh E, Clark DM. Understanding social anxiety disorder in adolescents and improving treatment outcomes: Applying the cognitive model of Clark and Wells (1995). Clin Child Fam Psychol Rev. 2018;21(3):388–414. doi: 10.1007/s10567-018-0258-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Cook J, Hull L, Crane L, Mandy W. Camouflaging in autism: A systematic review. Clin Psychol Rev. 2021;102080. doi: 10.1016/j.cpr.2021.102080 [DOI] [PubMed] [Google Scholar]
- 55.Käll A, Backlund U, Shafran R, Andersson G. Lonesome no more? A two-year follow-up of internet-administered cognitive behavioral therapy for loneliness. Internet Interv. 2020;19:100301. doi: 10.1016/j.invent.2019.100301 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Chorpita BF, Moffitt CE, Gray J. Psychometric properties of the Revised Child Anxiety and Depression Scale in a clinical sample. Behav Res Ther. 2005;43(3):309–22. doi: 10.1016/j.brat.2004.02.004 [DOI] [PubMed] [Google Scholar]
- 57.Donnelly A, Fitzgerald A, Shevlin M, Dooley B. Investigating the psychometric properties of the revised child anxiety and depression scale (RCADS) in a non-clinical sample of Irish adolescents. J Ment Health. 2018;28(4). [DOI] [PubMed] [Google Scholar]
- 58.Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7. doi: 10.1001/archinte.166.10.1092 [DOI] [PubMed] [Google Scholar]
- 59.Kroenke K, Spitzer RL, Williams JB. The PHQ‐9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13. doi: 10.1046/j.1525-1497.2001.016009606.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Beard C, Hsu K, Rifkin L, Busch A, Björgvinsson T. Validation of the PHQ-9 in a psychiatric sample. J Affect Disord. 2016;193:267–73. doi: 10.1016/j.jad.2015.12.075 [DOI] [PubMed] [Google Scholar]
- 61.Cameron IM, Crawford JR, Lawton K, Reid IC. Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care. Br J Gen Pract. 2008;58(546):32–6. doi: 10.3399/bjgp08X263794 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Tryon GS, Birch SE, Verkuilen J. Meta-analyses of the relation of goal consensus and collaboration to psychotherapy outcome. Psychotherapy. 2018;55(4):372. doi: 10.1037/pst0000170 [DOI] [PubMed] [Google Scholar]
- 63.Delgadillo J, de Jong K, Lucock M, Lutz W, Rubel J, Gilbody S, et al. Feedback-informed treatment versus usual psychological treatment for depression and anxiety: a multisite, open-label, cluster randomised controlled trial. Lancet Psychiatry. 2018;5(7):564–72. doi: 10.1016/S2215-0366(18)30162-7 [DOI] [PubMed] [Google Scholar]
- 64.McCormack HM, David J de L, Sheather S. Clinical applications of visual analogue scales: a critical review. Psychol Med. 1988;18(4):1007–19. doi: 10.1017/s0033291700009934 [DOI] [PubMed] [Google Scholar]
- 65.Krasny-Pacini A, Evans J. Single-case experimental designs to assess intervention effectiveness in rehabilitation: A practical guide. Ann Phys Rehabil Med. 2018;61(3):164–79. doi: 10.1016/j.rehab.2017.12.002 [DOI] [PubMed] [Google Scholar]
- 66.Lane JD, Gast DL. Visual analysis in single case experimental design studies: Brief review and guidelines. Neuropsychol Rehabil. 2014;24(3–4):445–63. doi: 10.1080/09602011.2013.815636 [DOI] [PubMed] [Google Scholar]
- 67.Veale D, Page N, Woodward E, Salkovskis P. Imagery Rescripting for Obsessive Compulsive Disorder: A single case experimental design in 12 cases. J Behav Ther Exp Psychiatry. 2015;49:230–6. doi: 10.1016/j.jbtep.2015.03.003 [DOI] [PubMed] [Google Scholar]
- 68.Willson R, Veale D, Freeston M. Imagery rescripting for body dysmorphic disorder: a multiple-baseline single-case experimental design. Behav Ther. 2016;47(2):248–61. doi: 10.1016/j.beth.2015.08.006 [DOI] [PubMed] [Google Scholar]
- 69.Yao S, Zhang C, Zhu X, Jing X, McWhinnie CM, Abela JR. Measuring adolescent psychopathology: psychometric properties of the self-report strengths and difficulties questionnaire in a sample of Chinese adolescents. J Adolesc Health. 2009;45(1):55–62. doi: 10.1016/j.jadohealth.2008.11.006 [DOI] [PubMed] [Google Scholar]
- 70.Gibbons N, Harrison E, Stallard P. Assessing recovery in treatment as usual provided by community child and adolescent mental health services. BJPsych Open. 2021;7(3). doi: 10.1192/bjo.2021.44 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Walters SJ, dos Anjos Henriques-Cadby IB, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276. doi: 10.1136/bmjopen-2016-015276 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Hariton E, Locascio JJ. Randomised controlled trials—the gold standard for effectiveness research. BJOG Int J Obstet Gynaecol. 2018;125(13):1716. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
(DOC)
(PDF)
Data Availability Statement
No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.