Skip to main content
Trials logoLink to Trials
. 2019 Jan 15;20:53. doi: 10.1186/s13063-018-3156-8

Efficacy and cost-effectiveness of two online interventions for children and adolescents at risk for depression (E.motion trial): study protocol for a randomized controlled trial within the ProHEAD consortium

Sabrina Baldofski 1, Elisabeth Kohls 1, Stephanie Bauer 2, Katja Becker 3,4, Sally Bilic 2, Heike Eschenbeck 5, Michael Kaess 6,7, Markus Moessner 2, Hans Joachim Salize 8, Silke Diestelkamp 9, Elke Voß 8, Christine Rummel-Kluge 1,; the ProHEAD consortium
PMCID: PMC6334409  PMID: 30646944

Abstract

Background

Depression is a serious mental health problem and is common in children and adolescents. Online interventions are promising in overcoming the widespread undertreatment of depression and in improving the help-seeking behavior in children and adolescents.

Methods

The multicentre, randomized controlled E.motion trial is part of the German ProHEAD consortium (Promoting Help-seeking using E-technology for ADolescents). The objective of the trial is to investigate the efficacy and cost-effectiveness of two online interventions to reduce depressive symptomatology in high-risk children and adolescents with subsyndromal symptoms of depression in comparison to an active control group. Participants will be randomized to one of three conditions: (1) Intervention 1, a clinician-guided self-management program (iFightDepression®); (2) Intervention 2, a clinician-guided group chat intervention; and (3) Control intervention, a psycho-educational website on depressive symptoms. Interventions last six weeks. In total, N = 363 children and adolescents aged ≥ 12 years with Patient Health Questionnaire-9 modified for Adolescents (PHQ-A) scores in the range of 5–9 will be recruited at five study sites across Germany. Online questionnaires will be administered before onset of the intervention, at the end of the intervention, and at the six-month follow-up. Further, children and adolescents will participate in the baseline screening and the one- and two-year school-based follow-up assessments integrated in the ProHEAD consortium. The primary endpoint is depression symptomatology at the end of intervention as measured by the PHQ-A score. Secondary outcomes include depression symptomatology at all follow-ups, help-seeking attitudes, and actual face-to-face help-seeking, adherence to and satisfaction with the interventions, depression stigma, and utilization and cost of interventions.

Discussion

This study represents the first randomized controlled trial (RCT) investigating efficacy and cost-effectiveness of two online interventions in children and adolescents aged ≥ 12 years at risk for depression. It aims to provide a better understanding of the help-seeking behavior of children and adolescents, potential benefits of E-mental health interventions for this age group, and new insights into so far understudied aspects of E-mental health programs, such as potential negative effects of online interventions. This knowledge will be used to tailor and improve future help offers and programs for children and adolescents and ways of treatment allocation.

Trial registration

German Register for Clinical Trials (DRKS), DRKS00014668. Registered on 4 May 2018.

International trial registration took place through the “international clinical trials registry platform” with the secondary ID S-086/2018.

Electronic supplementary material

The online version of this article (10.1186/s13063-018-3156-8) contains supplementary material, which is available to authorized users.

Keywords: Depression, Depressive symptoms, Children, Adolescents, Adolescence, Prevention, Internet-based, Psychological intervention, Self-management, ProHEAD

Background

Depressive disorders are severe mental illnesses with overall prevalence rates, measured from point prevalence up to 12-month prevalence, in the range of 2.6–19.4% among children and adolescents (C&A) [17]. Rates rise in adolescence compared to childhood [8] and show a stronger female preponderance in adolescents [2, 6]. Depression in C&A has a marked negative impact regarding poor academic performance and social dysfunction and predicts adverse mental health outcomes such as recurrence of depressive symptoms, substance abuse, self-harm, suicidal ideation, and attempted and completed suicide [911]. Due to the high burden of depression for both personal and societal areas, early intervention and prevention of its onset are of utmost importance [12, 13]. Targeting subthreshold depression in particular is of enormous potential as subthreshold depression in adolescents is a substantial risk factor for the onset of major depression [14]. However, currently the vast majority of C&A with subthreshold depressive symptoms does not seek professional help and does not receive professional support. Barriers to help-seeking include poor mental health literacy, shame and stigmatization related to depression [15], but also symptoms of depression itself, such as feelings of worthlessness or guilt. Internet-based interventions present a promising approach to overcome these barriers, especially as various studies have shown that a high percentage of C&A use the Internet for health-related purposes (e. g. seeking health-related information and support communities; [16]). Internet-based interventions provide low-threshold access to evidence-based information, self-help tools, peer support, and professional counseling and could thus help in reaching target populations who might otherwise not seek treatment.

The development of online-delivered interventions and the use of smartphone systems and apps for monitoring and treatment of depression has increased enormously during recent years [17]. Therapist-delivered online cognitive behavioral therapy (CBT) for depression has been shown to be both effective and cost-effective [18]. In addition, various guided and unguided Internet-based interventions for adults with depression have been developed and their efficacy has been shown [12]. Specifically, self-management and self-help reduce the burden of sub-threshold and full-syndrome forms of depression in adults [19]. Comparisons of Internet-based interventions for depression with face-to-face treatment did not indicate differences in efficacy between the different treatment formats [20].

Despite the clear benefits of Internet-based interventions for depression in adults, there is a lack of studies specifically focusing on C&A [21, 22]. Several pilot trials have been published recently, providing preliminary results for the effectiveness of Internet-based interventions for the treatment of depression in C&A. These include, among others, an Internet-based intervention for at-risk of suicide school students, which has resulted in reduced suicidal ideation, hopelessness, and depressive symptoms [23], a randomized controlled trial (RCT) on a spirituality informed e-mental health tool as an intervention for major depressive disorder in adolescents and young adults [24], and a RCT on a school-based CBT program, which resulted in significant decreases in depression symptomatology and suicidality [25]. Another self-directed Internet-based intervention for depression was delivered as part of the high school curriculum and resulted in a reduction of depressive symptoms in adolescent girls [26].

While most programs include online information, exercises, and questionnaires accessible to the participants, chat treatments for C&A at risk for depression have not been studied well so far. Two randomized trials in adolescents and young people with depressive symptoms investigating the effectiveness of an Internet-based, solution-focused, brief chat treatment and an Internet-based chat treatment based on principles of CBT, respectively, showed positive effects of the respective treatment regarding a reduction of depressive symptoms in comparison to a wait-list control condition [22, 27].

In summary, there is preliminary evidence for the effectiveness of Internet-based interventions in C&A at risk for depression. However, most of the identified trials had either limited results, only short-term follow-up periods (often due to waitlist control conditions), or were self-guided. Studies with longer-term follow-up and guidance are currently lacking [22]. To address the gaps identified in the literature, the E.motion trial will be conducted to investigate the efficacy and cost-effectiveness of two different online interventions to reduce depressive symptomatology in high-risk C&A aged ≥ 12 years with subsyndromal symptoms of depression.

Methods/Design

Design

The E.motion trial is a multicentre, three-arm RCT comparing two online interventions with an active control group. Participants will be randomized to one of three conditions, each with a duration of six weeks: (1) Intervention 1, a clinician-guided self-management program (iFightDepression®); (2) Intervention 2, a clinician-guided group chat intervention; and (3) Control intervention, a psycho-educational website on depressive symptoms.

Recruitment and study procedures

This trial is part of the ProHEAD consortium (Promoting Help-seeking using E-technology for ADolescents) aiming to assess new access pathways for prevalent mental health problems in C&A. Within the ProHEAD consortium, C&A with mental health problems and/or high risk for mental health problems will be allocated to one of five RCTs [2831]. A large-scale school-based sample of N = 15,000 C&A aged ≥ 12 years attending school grades 6–13 will be recruited within the ProHEAD consortium in five urban areas geographically distributed across Germany (Hamburg, Heidelberg, Leipzig, Marburg, Schwäbisch Gmünd). The ProHEAD consortium includes online assessments of mental health problems and health-risk behaviors (i.e. general mental health problems, eating disorder symptoms, alcohol use, and depressive symptoms) at baseline and at two annual follow-ups. All assessments within the ProHEAD consortium will be administered through on-site visits in the school classes and C&A will complete the questionnaires in the respective school’s local computer rooms (for further details on study procedures within the ProHEAD consortium, see study protocol by Kaess et al., published in this special issue).

Written informed consent will be obtained from all participating C&A and their legal guardians before administering baseline screening assessments. Participants will be informed that after completing the baseline screening, they will receive an invitation to participate in one out of five fully remote Internet-based intervention trials (group 1, general mental health problems; group 2, eating disorder symptoms; group 3, at-risk alcohol use; group 4, depressive symptoms, E.motion trial; group 5, no mental health problems, prevention trial). Within each of these RCTs, different intervention and prevention programs, respectively, will be compared and the allocation to a specific RCT will be based on meeting pre-defined cut-off scores in the baseline screening.

Participants for the E.motion trial will be recruited from the ProHEAD consortium. Following the baseline screening within the ProHEAD consortium, an estimated number of N = 1500 C&A reporting subthreshold depressive symptoms and meeting eligibility criteria for the E.motion trial will be invited to participate in the trial. In the case of participation, these C&A will be randomized to one of the three treatment arms, as illustrated in Fig. 1. Participants not meeting eligibility criteria will be included in one of the other four RCTs within the ProHEAD consortium (see information on eligibility criteria below). A schedule of enrolment, interventions, and assessments is included in Fig. 2 and a Standard Protocol Items: Recommendations for Intervention Trials (SPIRIT) Checklist is provided in Additional file 1.

Fig. 1.

Fig. 1

Trial flow diagram. Assessments within the E.motion trial will be conducted at baseline, at the end of intervention (six weeks after onset of intervention), and at six-month follow-up. Further, participants will complete the school-based baseline screening and one- and two-year school-based follow-up assessments integrated in the ProHEAD consortium. * For further details on other RCTs within the ProHEAD consortium, see other study protocols published in this special issue. PHQ-A Patient Health Questionnaire-9 modified for Adolescents

Fig. 2.

Fig. 2

Schedule of enrolment, interventions, and assessments. * Assessments within the E.motion trial will be conducted at the end of intervention (six weeks after onset of intervention) and at six-month follow-up. Further, participants will complete the one- and two-year school-based follow-up assessments integrated in the ProHEAD consortium. PHQ-A Patient Health Questionnaire-9 modified for Adolescents, IASMHS Inventory of Attitudes Toward Seeking Mental Health Services, GHSQ General Help-Seeking Questionnaire, AHSQ Actual Help-Seeking Questionnaire, DSS Depression Stigma Scale, MRV Mannheimer Modul zum Ressourcenverbrauch, KIDSCREEN-10 Health-related quality of life measure for children and adolescents, ZUF-8 German version of the Client Satisfaction Questionnaire, INEP Inventory for the Assessment of Negative Effects of Psychotherapy

Eligibility criteria

All eligibility criteria will be assessed through the baseline screening of the ProHEAD consortium. C&A aged ≥ 12 years and reporting current subthreshold depressive symptoms will be included in the trial. Subthreshold depressive symptoms will be operationalized with the Patient Health Questionnaire-9 modified for Adolescents (PHQ-A) [32, 33], with scores in the range of 5–9. Inclusion criteria further comprise sufficient German language skills and Internet access. There are no restrictions for participants for engaging in additional (depression-related) interventions or treatments.

Participants reporting either other mental health problems (general mental health problems, eating disorder symptoms, or alcohol misuse) or no clinically relevant levels of psychopathology will be allocated based on their specific symptom profiles to one of the other four RCTs within the ProHEAD consortium. Other current mental health problems will be operationalized as scores above the clinical cut-off in one or more of the following questionnaires: Strengths and Difficulties Questionnaire (SDQ) [34]; Short Evaluation of Eating Disorders (SEED) [35]; Weight Concerns Scale (WCS) [36]; Car, Relax, Alone, Forget, Friends, Trouble (CRAFFT-d) [37]; and Alcohol Use Disorders Identification Test (AUDIT) [38]. Participants meeting inclusion criteria for more than one RCT will be randomly allocated to one of the RCTs for which they are eligible.

Assessments

All interventions will have a duration of six weeks for the individual participant. Assessments specific to the E.motion trial will be conducted before the onset of the intervention period, at the end of the intervention (six weeks after start of intervention), and at the six-month follow-up. Further, C&A will participate in the baseline screening and the regular one- and two-year school-based follow-up assessments integrated in the ProHEAD consortium, to track long-term outcome of the interventions (see Fig. 2). All assessments will consist of self-administered questionnaires and will be carried out online using secure links sent via automated e-mails.

Randomization

Following the school-based baseline screening within the ProHEAD consortium, participants eligible for the E.motion trial will receive an e-mail including information about the trial and access details for the baseline assessment within the E.motion trial. After completing this assessment, participants will be randomized with equal probability (in a 1:1:1 ratio) to one of the three intervention groups. The assignment to the three conditions will be randomized, stratified for gender and school type. Randomization will be conducted externally and follow a permutated block design. Following randomization, participants will be contacted again via e-mail to be informed about their allocation to the respective intervention group and receive access details for the specific online programs. Blinding is not possible as the study assistants will be involved in delivering the interventions. However, the risk of a potential bias is considered minimal as the study outcome variables are exclusively based on self-report. For all treatment arms, the intervention will be discontinued at any time for participants who withdraw consent to participate in the trial.

Interventions

Intervention 1: iFightDepression® (iFD®) tool

The first intervention group will complete the iFightDepression® (iFD®) tool, which is an online, clinician-guided, self-management program that aims to help individuals with mild to moderate depression to self-manage their symptoms (tool accessible at https://tool.ifightdepression.com) [39]. The tool consists of six core modules related to behavioral activation, sleep and mood monitoring, and cognitive restructuring (“Thinking, feeling and doing,” “Planning and doing things that you enjoy,” “Getting things done,” “Recognizing negative thoughts,” “Changing negative thoughts,” and “Sleep and depression”) and three optional modules related to psychosocial issues and healthy lifestyle habits (“Healthy lifestyle,” “Relationships,” and “Social anxiety”). Each module comprises written information, worksheets (online or printable), exercises, and a voluntary mood rating using the PHQ-A with a graphical output display. In addition, emergency contact material is provided. Participants will be asked to use the tool for six weeks on a regular basis and complete one workshop per week. The self-management program has a total duration of six weeks and participants will be guided by a trained clinical psychologist giving administrative and motivational support and exploring how well participants were able to integrate the exercises into their daily routine.

Two versions of the iFD® tool (one for adults and one for young people) were developed within the EU-funded project PREDI-NU [39]. Previous research confirmed the feasibility of the tool [39, 40]. Oehler C, Görges F, Böttger D, Hug J, Koburger N, Kohls E, et al: Efficacy of an internet-based self-management intervention for adult primary care patients with mild and moderate depression or dysthymia – a study protocol, submitted. Within the E.motion trial, the tailored version of the tool for young people, incorporating less formal language and additional age-appropriate modules on relationships and social anxiety, will be used. iFD® was developed based on existing evidence, best practice recommendations, and user and expert consensus. The tool is free to use and is intended to help individuals self-manage their symptoms of depression and to promote recovery. It is based on principles of CBT, which has been proven to be effective in treating depression [41, 42]. Associated worksheets and exercises encourage users of the tool to practice and consolidate new skills and to promote self-monitoring. The tool is currently available in 11 languages.

Intervention 2: Group chat

The second intervention group will receive a clinician-guided, online, group chat intervention based on a cognitive-behavioral approach. The intervention will address the following core elements: (1) information about depressive symptoms; (2) diagnosis of depression and etiological factors; (3) treatment options: psychotherapy; (4) treatment options: medication; (5) social support and dealing with stigmatization in the context of depression; and (6) emergency strategies and help seeking. The intervention will consist of six 90-min group chat sessions, which will be held once per week. Sessions will be scheduled at fixed times and a secured chat room will be specifically arranged for the sessions. The group size will be 6–10 participants, depending on recruitment and attrition rates. Groups will be “open,” i.e. participants can join at any time during the intervention period. Participants will communicate via written messages, allowing a synchronous communication in real time. Participation in the chat will be under self-chosen pseudonyms to ensure confidentiality.

The chats will be moderated by a trained clinical psychologist and the intervention will be manualized to maximize treatment adherence. The psychologists delivering the intervention are experienced in individual and group treatment of persons with depression and depressive symptoms, being aware of the medical consequences of depressive symptoms, potential suicidal ideation, and self-harm. These aspects will be assessed regularly during chat sessions. Each chat session will be focused on one of the six core elements as mentioned above, whereas the specific chat agenda will be set at the beginning of each session and will be based on the current questions and needs of each participant. Sessions will be used to provide information on different aspects of depression and to discuss and answer questions within the group. A specific focus will be given to positive communication among participants and to the peer-to-peer exchange, which has been shown to be of additional help in patients with depression and other mental disorders [4347]. Kohls E, Hug J, Stahl M, Driessen P, Roemer C, Wollschlaeger E, et al: Peer counselling in depression care: a pilot study in an inpatient setting, submitted. Chat protocols will be stored for supervision purposes.

Control intervention

Trial participants in the control intervention group will have access to structured online psycho-educational modules on depression (e.g. symptoms, diagnosis, treatment, medication, psychotherapy, other forms of treatment like self-help) for a duration of six weeks. There will be no therapeutic guidance or support. The participants in the control condition will be offered to inform themselves about the different aspects of depression by reading the different psycho-educational modules on their own schedule, e.g. one module per week.

Intervention fidelity

The guiding therapists for the iFD® tool will be clinical psychologists who have qualified through completing a guidance webinar and a short test before gaining access to the tool. For the group chat, clinical psychologists will conduct the chats and will have completed a training according to the group chat intervention manual before the start of the intervention. For both interventions 1 and 2, regular supervision will be conducted by a senior psychiatrist (CRK) specializing in depression, who has been part of the project team developing the iFD® tool and has developed the manual for the clinician-guided group chat intervention.

Outcomes and measures

Primary outcome

The primary outcome of the trial is depression symptomatology at the end of intervention as measured by the PHQ-A score. The depression module of the PHQ-A [32, 33] comprises nine items assessing depressive symptoms based on the diagnostic criteria for depression according to the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) [48]. Respondents rate the frequency of the symptoms over the previous two weeks on a four-point Likert scale (0 = “not at all” to 3 = “nearly every day”). A sum score will be computed with higher scores indicating higher levels of depressive symptomatology. The PHQ-9 for adults has shown good reliability, validity, and sensitivity to change [49, 50].

Secondary outcomes

Secondary outcomes will be assessed at baseline, at the end of intervention, and at six months, one year, and two years after the start of the intervention by using the following measures: the PHQ-A [32, 33] will be used to assess depression symptomatology. Help-seeking attitudes will be assessed by the Inventory of Attitudes Toward Seeking Mental Health Services (IASMHS) [51] and actual face-to-face help-seeking will be measured with the General Help-Seeking Questionnaire (GHSQ) [52] and the Actual Help-Seeking Questionnaire (AHSQ) [53]. Adherence to the interventions (iFightDepression® and group chat) will be measured with participation rates and satisfaction with the interventions as well as possible negative effects will be assessed by the German version of the Client Satisfaction Questionnaire (ZUF-8) [54] and the Inventory for the Assessment of Negative Effects of Psychotherapy (INEP) [55], respectively. The Depression Stigma Scale (DSS) [56] will be used to assess the stigma associated with depression.

Finally, cost-effectiveness and cost-utility analyses will be conducted. Data on the cost of interventions will be compared to study outcomes to determine the incremental cost-effectiveness ratio (ICER) of interventions. The ICER is defined as the differential cost of a new treatment and treatment as usual, divided by the outcome differential of the two. Cost-utility analyses will provide information on cost per quality-adjusted life years (QALYs). QALYs are measures combining the additional life years gained by a certain healthcare intervention or program with the quality of life a subject attributes to this lifespan into one single parameter. Thus, QALYs are subjective and universally applicable outcome parameters for comparing health benefits across sectors, disorders, samples, or populations. It can be assessed in both patients and healthy individuals. Health-related quality of life will be assessed using the KIDSCREEN-10 [57, 58]. In addition, the health service utilization of the participants will be assessed by the “Mannheimer Modul Ressourcenverbrauch” (MRV) [59] and transformed into cost estimates. For this purpose, a catalog of so-called “unit costs” will be compiled for all types of treatments, services, or other healthcare measures that were used.

Sample size calculation

We assume a small to medium effect (superiority of the two intervention groups over the control condition) on depressive symptomatology at postline after treatment as reported in meta-analyses on interventions for the prevention of depression in C&A [60]. Non-inferiority of the two active intervention groups is assumed. Repeated measures mixed models will be conducted (time*group interaction, alpha = 5%). Assuming a small to medium effect of f = 0.13, a lost-to-follow-up rate of 20%, and correlations of 0.2 among repeated measures, n = 363 individuals (n = 121 per group) need to be recruited for a test of the global hypothesis with 90% power. In case the ANOVA shows significant differences, post-hoc pairwise group comparisons can be conducted at a power of about 80% (Bonferroni correction) with the planned sample size.

Participants will be recruited within the ProHEAD consortium from the school-based sample of N = 15,000 screened C&A. Based on prevalence rates of approximately 5–12% of subthreshold depression in adolescents [14], 10% or n = 1500 of the screened C&A are expected to be eligible for inclusion in the trial. Thus, in order to meet the required sample size of n = 363, about 25% of eligible C&A would have to be willing to participate in the trial.

Criteria for the allocation of participants to the five individual ProHEAD trials are based on latest scientific evidence. However, this is the first time that the overall algorithm is applied on a consortium-wide basis simultaneously screening for various mental health problems. Therefore, an intermediate data analysis will be conducted following completion of 10% of the screening assessments (N = 1500) in order to determine the actual allocation ratio to the five ProHEAD trials and to adjust the screening algorithm if necessary.

Statistical analysis plan

All analyses will be conducted in accordance with intention-to-treat (ITT) principles, i.e. all randomized individuals will be included in the analysis [61]. In addition to the primary ITT analysis, per-protocol analysis will be conducted.

For the primary outcome, repeated measures mixed models (time*group interaction) will be conducted to test for differences in efficacy between the intervention groups. In case of statistically significant results, group differences will be investigated using post-hoc pairwise comparisons (Bonferroni correction). Secondary analyses using repeated measures mixed models will be performed on variables related to help-seeking behavior and depression stigma. In addition, repeated measures mixed models will be conducted to examine long-term group differences in PHQ-A scores at the six-month, one-year, and two-year follow-up timepoints, respectively. All analyses will include testing for interaction effects with study site (time*group*study site interaction).

Additionally, cost-effectiveness analyses and cost-utility analyses will be conducted. Cost-effectiveness analyses include the calculation of the ICER. The ICER indicates the additional cost for each additional (primary) outcome that has to be paid under routine care conditions. During these analyses, standard health economy techniques will be applied, such as bootstrapping techniques for estimating ICER variability, the calculation of cost-effectiveness acceptability curves (CEAC), and calculation of willingness-to-pay (WTP) criteria [62, 63]. In addition, a cost-utility study will be conducted that requires the transformation of longitudinal quality of life data (assessed with the KIDSCREEN-10) into preference measures, for the calculation of QALYs lost or gained during follow-up in order to calculate costs per QALY of the intervention.

Analyses will be performed using IBM SPSS Statistics and p values < 0.05 will be considered statistically significant.

Organization, quality assurance, and data management

Research data will be collected in a pseudonymized manner by means of online questionnaires. Data quality will be ensured by conducting automatic validity and range checks at data entry. The confidentiality of participants is secured by providing unique study identifiers unrelated to the real name. All study-related data will be stored on secure servers at the principal investigator’s institution with frequent back-up procedures in place. Data will be stored for 10 years at the primary research institution. Data handling and access will follow German and European Union legal regulations concerning data protection and data security. The Coordination Center for Clinical Trials (KKS) Heidelberg will monitor study-related procedures at the five recruiting centers. Specifically, the recruitment of schools within the target regions and the recruitment of students within these schools will be monitored in order to ensure adherence to the study manual and documentation guidelines as well as equivalent procedures at all sites. In addition, an independent Data and Safety Monitoring Board (DSMB) as defined in ICH-GCP will assess the progress of the trial, data safety, and the clinical efficacy endpoints.

Safety reporting

There is no obvious risk for participating C&A. The study does not involve any restriction to standard care. All participants will receive information on where to seek help for mental health problems within the ProHEAD consortium. In case of C&A reporting suicidal plans or suicide attempts, special emergency procedures will be put in place allowing immediate contact of the participant in order to assess risks and refer to appropriate care. Potential serious adverse events (SAE) will be reported to the local ethics committee, the DSMB, and the KKS.

Dissemination

Trial results will be published in peer-reviewed international journals and will be presented at national and international conferences. Substantial protocol modifications will be communicated to the ethics committee, trial registry, DSMB, and all relevant parties.

Discussion

This study represents the first RCT investigating efficacy and cost-effectiveness of two online interventions for C&A at risk for depression. To our knowledge, this is the first study, aiming at large scale, sustainable implementation of Internet-based indicated prevention of depression within an integrated infrastructure that aims at health promotion, prevention of clinical symptoms, and facilitating help-seeking. Research on the cost-effectiveness of such interventions is sparse as well and the results of the study will provide a strong basis for decision-making for stakeholders and policy makers in the field. Also, the trial will provide new insights into so far understudied aspects of E-mental health programs, such as potential negative effects of online interventions and user characteristics. Further, this RCT will overcome current shortcomings of available studies, with a particular focus on professional guidance by mental health professionals for participants and longer follow-up periods and provide an internationally consented, guided self-management tool which has been broadly used in adults with milder forms of depression in 11 different languages/countries already.

This RCT will advance the state of the art by bringing an established, guided, online-delivered self-management approach, which is well implemented into routine care, to the large population of unrecognized C&A with subthreshold depression being at risk of developing a depressive disorder.

In summary, the trial will: (1) significantly add to the existing evidence on Internet-based indicated prevention of depression in C&A at risk for the development of depression; (2) be the first study to investigate effects of Internet-based indicated prevention on help-seeking in C&A with subthreshold depressive symptoms; and (3) provide cost-effectiveness data on Internet-based indicated depression prevention.

Trial status

The trial was registered at the German Register for Clinical Trials (DRKS) under the title “ProHEAD – Promoting Help-seeking using E-technology for Adolescents. Sub-project 4: Efficacy and cost-effectiveness of two online interventions for children and adolescents at risk for depression (E.motion trial)”, identification code: DRKS00014668. International trial-registration took place through the “international clinical trials registry platform” with the secondary ID S-086/2018.

The recruitment period for the trial will start in October 2018 and is predicted to continue until March 2020.

Additional files

Additional file 1: (123KB, doc)

Standard Protocol Items: Recommendations for Intervention Trials (SPIRIT) Checklist. (DOC 123 kb)

Acknowledgements

This trial is funded by the German Federal Ministry of Education and Research (BMBF) Grant 01GL1744E. Michael Kaess is the coordinator and Stephanie Bauer the co-coordinator of the ProHEAD consortium. The consortium comprises six study sites in Germany. Site leaders are: Michael Kaess (University Hospital Heidelberg); Stephanie Bauer (University Hospital Heidelberg); Rainer Thomasius (University Medical Center Hamburg-Eppendorf); Christine Rummel-Kluge (University Leipzig); Heike Eschenbeck (University of Education Schwäbisch Gmünd); Hans-Joachim Salize (Medical Faculty Mannheim/Heidelberg University); and Katja Becker (Philipps-University of Marburg). Further members of the consortium are: Katja Bertsch, Sally Bilic, Romuald Brunner, Johannes Feldhege, Christina Gallinat, Sabine C. Herpertz, Julian Koenig, Sophia Lustig, Markus Moessner, Fikret Özer, Peter Parzer, Franz Resch, Sabrina Ritter, and Jens Spinner (all University Hospital Heidelberg); Silke Diestelkamp and Kristina Wille (both University Medical Center Hamburg-Eppendorf); Sabrina Baldofski, Elisabeth Kohls, and Lina-Jolien Peter (all University Leipzig); Vera Gillé, Hanna Hofmann, and Laya Lehner (all University of Education Schwäbisch Gmünd); Elke Voß (Medical Faculty Mannheim/Heidelberg University); and Jens Pfeiffer and Alisa Samel (both Philipps-University of Marburg).

Funding

This trial is funded by the German Federal Ministry of Education and Research (BMBF) Grant 01GL1744E. We acknowledge support from the German Research Foundation (DFG) and Leipzig University within the program of Open Access Publishing.

Availability of data and materials

Not applicable.

Abbreviations

AHSQ

Actual Help-Seeking Questionnaire

AUDIT

Alcohol Use Disorders Identification Test

C&A

Children and adolescents

CBT

Cognitive-behavioral therapy

CEAC

Cost-effectiveness acceptability curves

CRAFFT-d

Car, Relax, Alone, Forget, Friends, Trouble

DRKS

German Register for Clinical Trials

DSMB

Data and Safety Monitoring Board

DSM-IV

Diagnostic and Statistical Manual of Mental Disorders, fourth edition

DSS

Depression Stigma Scale

GHSQ

General Help-Seeking Questionnaire

IASMHS

Inventory of Attitudes Toward Seeking Mental Health Services

ICER

Incremental cost-effectiveness ratio

iFD

iFightDepression

IIT

Investigator-initiated trial

INEP

Inventory for the assessment of negative effects of psychotherapy

ITT

Intention-to-treat

KIDSCREEN-10

Health-related quality of life measure for children and adolescents

KKS

Coordination Center for Clinical Trials

MRV

Mannheimer Modul zum Ressourcenverbrauch

PHQ-A

Patient Health Questionnaire-9 modified for Adolescents

QALY

Cost per quality-adjusted life year

RCT

Randomized controlled tial

SAE

Serious adverse event

SDQ

Strengths and Difficulties Questionnaire

SEED

Short Evaluation of Eating Disorders

WCS

Weight Concerns Scale

WTP

Willingness-to-pay

ZUF-8

German version of the Client Satisfaction Questionnaire

Authors’ contributions

CRK is the principal investigator of the trial, was part of the project team developing the iFD® tool, and developed the manual for the clinician-guided group chat intervention. MK is the coordinator of the ProHEAD consortium, StB is the co-coordinator of the ProHEAD consortium. MK, KB, HE, CRK, and SD are the site leaders or coordinators of the five recruiting centers; SBi and MM are responsible for technological support; HJS and EV are responsible for health economic analysis. SB and EK are the scientific staff for the trial and are critically involved in the realization of the trial. SB, EK, and CRK wrote the first draft of this study protocol. All authors revised the manuscript for important intellectual content and approved the final version of the manuscript.

Ethics approval and consent to participate

The ProHEAD consortium including the E.motion trial was reviewed and approved by the ethics committee of the Medical Faculty, University of Leipzig, on 30 May 2018, reference number 181/18-lk, and by all responsible ethics committees of the participating study sites (University of Heidelberg, reference number S-086/2018).

The trial will follow the Declaration of Helsinki (DoH), 1996, and the Guidelines for Good Clinical Practice (ICH-GCP) in the latest revision. Written informed consent will be obtained from all participating C&A and their legal guardians to participate in the study. Copies of the consent forms will be kept in the trial site files. Internet-based platforms to assess data and to deliver the interventions will follow latest regulations concerning data security. All collected information will be confidential and held in accordance with ICH-GCP. Participants will be free to withdraw consent from the study at any time without giving a reason.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Sabrina Baldofski, Email: sabrina.baldofski@medizin.uni-leipzig.de.

Elisabeth Kohls, Email: elisabeth.kohls@medizin.uni-leipzig.de.

Stephanie Bauer, Email: bauer@psyres.de.

Katja Becker, Email: katja.becker@med.uni-marburg.de.

Sally Bilic, Email: bilic@psyres.de.

Heike Eschenbeck, Email: heike.eschenbeck@ph-gmuend.de.

Michael Kaess, Email: michael.kaess@med.uni-heidelberg.de.

Markus Moessner, Email: moessner@psyres.de.

Hans Joachim Salize, Email: hans-joachim.salize@zi-mannheim.de.

Silke Diestelkamp, Email: s.diestelkamp@uke.de.

Elke Voß, Email: elke.voss@zi-mannheim.de.

Christine Rummel-Kluge, Phone: +49 341 97-24464, Email: christine.rummel-kluge@medizin.uni-leipzig.de.

the ProHEAD consortium:

Michael Kaess, Stephanie Bauer, Rainer Thomasius, Christine Rummel-Kluge, Heike Eschenbeck, Hans-Joachim Salize, Katja Becker, Katja Bertsch, Sally Bilic, Romuald Brunner, Johannes Feldhege, Christina Gallinat, Sabine C. Herpertz, Julian Koenig, Sophia Lustig, Markus Moessner, Fikret Özer, Peter Parzer, Franz Resch, Sabrina Ritter, Jens Spinner, Silke Diestelkamp, Kristina Wille, Sabrina Baldofski, Elisabeth Kohls, Lina-Jolien Peter, Vera Gillé, Hanna Hofmann, Laya Lehner, Elke Voß, Jens Pfeiffer, and Alisa Samel

References

  • 1.Balazs J, Miklósi M, Keresztény Á, Apter A, Bobes J, Brunner R, et al. P-259 - Prevalence of adolescent depression in Europe. Eur Psychiatry. 2012;27:1. [Google Scholar]
  • 2.National Institute of Mental Health (NIMH) Information Resource Center . Major depression. Bethesda: NIMH; 2017. [Google Scholar]
  • 3.Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA. Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry. 2015;56:345–365. doi: 10.1111/jcpp.12381. [DOI] [PubMed] [Google Scholar]
  • 4.Young JF, Miller MR, Khan N. Screening and managing depression in adolescents. Adolesc Health Med Ther. 2010;1:87–95. doi: 10.2147/AHMT.S7539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Wiens K, Williams JV, Lavorato DH, Duffy A, Pringsheim TM, Sajobi TT, et al. Is the prevalence of major depression increasing in the Canadian adolescent population? Assessing trends from 2000 to 2014. J Affect Disord. 2017;210:22–26. doi: 10.1016/j.jad.2016.11.018. [DOI] [PubMed] [Google Scholar]
  • 6.Avenevoli S, Swendsen J, He J, Burstein M, Merikangas KR. Major depression in the national comorbidity survey-adolescent supplement: prevalence, correlates, and treatment. J Am Acad Child Adolesc Psychiatry. 2015;54:37–44.e2. doi: 10.1016/j.jaac.2014.10.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Hoffmann F, Petermann F, Glaeske G, Bachmann CJ. Prevalence and comorbidities of adolescent depression in Germany. An analysis of health insurance data. Z Kinder Jugendpsychiatr Psychother. 2012;40:399–404. doi: 10.1024/1422-4917/a000199. [DOI] [PubMed] [Google Scholar]
  • 8.Costello JE, Erkanli A, Angold A. Is there an epidemic of child or adolescent depression? J Child Psychol Psychiatry. 2006;47:1263–1271. doi: 10.1111/j.1469-7610.2006.01682.x. [DOI] [PubMed] [Google Scholar]
  • 9.Birmaher B, Ryan ND, Williamson DE, Brent DA, Kaufman J, Dahl RE, et al. Childhood and adolescent depression: a review of the past 10 years. Part I. J Am Acad Child Adolesc Psychiatry. 1996;35:1427–1439. doi: 10.1097/00004583-199611000-00011. [DOI] [PubMed] [Google Scholar]
  • 10.Hauenstein EJ. Depression in adolescence. J Obstet Gynecol Neonatal Nurs. 2003;32:239–248. doi: 10.1177/0884217503252133. [DOI] [PubMed] [Google Scholar]
  • 11.Fergusson DM, Boden JM, Horwood LJ. Recurrence of major depression in adolescence and early adulthood, and later mental health, educational and economic outcomes. Br J Psychiatry. 2007;191:335–342. doi: 10.1192/bjp.bp.107.036079. [DOI] [PubMed] [Google Scholar]
  • 12.Merry SN, Hetrick SE, Cox GR, Brudevold-Iversen T, Bir JJ, McDowell H. Cochrane review: psychological and educational interventions for preventing depression in children and adolescents. Evid Based Child Health. 2012;7:1409–1685. doi: 10.1002/ebch.1867. [DOI] [PubMed] [Google Scholar]
  • 13.Mendelson T, Tandon SD. Prevention of depression in childhood and adolescence. Prev Ment Health Disord. 2016;25:201–218. doi: 10.1016/j.chc.2015.11.005. [DOI] [PubMed] [Google Scholar]
  • 14.Bertha EA, Balazs J. Subthreshold depression in adolescence: a systematic review. Eur Child Adolesc Psychiatry. 2013;22:589–603. doi: 10.1007/s00787-013-0411-0. [DOI] [PubMed] [Google Scholar]
  • 15.Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113. doi: 10.1186/1471-244X-10-113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Park E, Kwon M. Health-related internet use by children and adolescents: systematic review. J Med Internet Res. 2018;20:e120. doi: 10.2196/jmir.7731. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Dogan E, Sander C, Wagner X, Hegerl U, Kohls E. Smartphone-based monitoring of objective and subjective data in affective disorders: where are we and where are we going? Systematic review. J Med Internet Res. 2017;19:e262. doi: 10.2196/jmir.7006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Hollinghurst S, Peters TJ, Kaur S, Wiles N, Lewis G, Kessler D. Cost-effectiveness of therapist-delivered online cognitive-behavioural therapy for depression: randomised controlled trial. Br J Psychiatry. 2010;197:297–304. doi: 10.1192/bjp.bp.109.073080. [DOI] [PubMed] [Google Scholar]
  • 19.Morgan AJ, Jorm AF, Mackinnon AJ. Usage and reported helpfulness of self-help strategies by adults with sub-threshold depression. J Affect Disord. 2012;136:393–397. doi: 10.1016/j.jad.2011.11.015. [DOI] [PubMed] [Google Scholar]
  • 20.Cuijpers P, Kleiboer A, Karyotaki E, Riper H. Internet and mobile interventions for depression: opportunities and challenges. Depress Anxiety. 2017;34:596–602. doi: 10.1002/da.22641. [DOI] [PubMed] [Google Scholar]
  • 21.Stasiak K, Fleming T, Lucassen MFG, Shepherd MJ, Whittaker R, Merry SN. Computer-based and online therapy for depression and anxiety in children and adolescents. J Child Adolesc Psychopharmacol. 2016;26:235–245. doi: 10.1089/cap.2015.0029. [DOI] [PubMed] [Google Scholar]
  • 22.van der Zanden R, Kramer J, Gerrits R, Cuijpers P, Eysenbach G. Effectiveness of an online group course for depression in adolescents and young adults: a randomized trial. J Med Internet Res. 2012;14:e86. doi: 10.2196/jmir.2033. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Robinson J, Hetrick S, Cox G, Bendall S, Yung A, Pirkis J. The safety and acceptability of delivering an online intervention to secondary students at risk of suicide: findings from a pilot study. Early Interv Psychiatry. 2015;9:498–506. doi: 10.1111/eip.12136. [DOI] [PubMed] [Google Scholar]
  • 24.Rickhi B, Kania-Richmond A, Moritz S, Cohen J, Paccagnan P, Dennis C, et al. Evaluation of a spirituality informed e-mental health tool as an intervention for major depressive disorder in adolescents and young adults – a randomized controlled pilot trial. BMC Complem Altern. 2015;15:450. doi: 10.1186/s12906-015-0968-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Silverstone PH, Bercov M, Suen VYM, Allen A, Cribben I, Goodrick J, et al. Initial findings from a novel school-based program, EMPATHY, which may help reduce depression and suicidality in youth. PLoS One. 2015;10:e0125527. doi: 10.1371/journal.pone.0125527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.O’Kearney R, Kang K, Christensen H, Griffiths K. A controlled trial of a school-based internet program for reducing depressive symptoms in adolescent girls. Depress Anxiety. 2009;26:65–72. doi: 10.1002/da.20507. [DOI] [PubMed] [Google Scholar]
  • 27.Kramer J, Conijn B, Oijevaar P, Riper H. Effectiveness of a web-based solution-focused brief chat treatment for depressed adolescents and young adults: randomized controlled trial. J Med Internet Res. 2014;16:e141. doi: 10.2196/jmir.3261. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Eschenbeck H, Lehner L, Hofmann H, Bauer S, Becker K, Diestelkamp S, et al. School-based mental health promotion in children and adolescents with StresSOS using online or face-to-face interventions: study protocol for a randomized controlled trial within the ProHEAD Consortium. Trials. [DOI] [PMC free article] [PubMed]
  • 29.Diestelkamp S, Wartberg L, Kaess M, Bauer S, Rummel-Kluge C, Becker K, et al. Effectiveness of a web-based screening and brief intervention with weekly text-message-initiated individualised prompts for reducing risky alcohol use among teenagers: study protocol of a randomised controlled trial within the ProHEAD Consortium. Trials. [DOI] [PMC free article] [PubMed]
  • 30.Bauer S, Bilic S, Reetz C, Oezer F, Becker K, Eschenbeck H, et al. Efficacy and cost-effectiveness of internet-based selective eating disorder prevention: study protocol for a randomized controlled trial within the ProHEAD Consortium. Trials. [DOI] [PMC free article] [PubMed]
  • 31.Kaess M, Ritter S, Lustig S, Bauer S, Becker K, Eschenbeck H, et al. Promoting help-seeking using e-technology for adolescents with mental health problems: study protocol for a randomized controlled trial within the ProHEAD Consortium. Trials. [DOI] [PMC free article] [PubMed]
  • 32.Johnson JG, Harris ES, Spitzer RL, Williams JBW. The patient health questionnaire for adolescents: validation of an instrument for the assessment of mental disorders among adolescent primary care patients. J Adolesc Health. 2002;30:196–204. doi: 10.1016/S1054-139X(01)00333-0. [DOI] [PubMed] [Google Scholar]
  • 33.Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA. 1999;282:1737–1744. doi: 10.1001/jama.282.18.1737. [DOI] [PubMed] [Google Scholar]
  • 34.Goodman R, Meltzer H, Bailey V. The Strengths and Difficulties Questionnaire: a pilot study on the validity of the self-report version. Eur Child Adolesc Psychiatry. 1998;7:125–130. doi: 10.1007/s007870050057. [DOI] [PubMed] [Google Scholar]
  • 35.Bauer S, Winn S, Schmidt U, Kordy H. Construction, scoring and validation of the Short Evaluation of Eating Disorders (SEED) Eur Eat Disord Rev. 2005;13:191–200. doi: 10.1002/erv.637. [DOI] [Google Scholar]
  • 36.Killen JD, Taylor CB, Hayward C, Haydel KF, Wilson DM, Hammer L, et al. Weight concerns influence the development of eating disorders: a 4-year prospective study. J Consult Clin Psychol. 1996;64:936–940. doi: 10.1037/0022-006X.64.5.936. [DOI] [PubMed] [Google Scholar]
  • 37.Tossmann P, Kasten L, Lang P, Struber E. Determination of the concurrent validity of the CRAFFT-d: a screening instrument for problematic alcohol consumption. Z Kinder Jugendpsychiatr Psychother. 2009;37:451–459. doi: 10.1024/1422-4917.37.5.451. [DOI] [PubMed] [Google Scholar]
  • 38.Babor TF, Higgins-Biddle JC, Saunders JB, Monteiro MG. The Alcohol Use Disorders Identification Test: guidelines for use in primary care. 2. Geneva: World Health Organization; 2001. [Google Scholar]
  • 39.Arensman E, Koburger N, Larkin C, Karwig G, Coffey C, Maxwell M, et al. Depression awareness and self-management through the internet: protocol for an internationally standardized approach. JMIR Res Protoc. 2015;4:e99. doi: 10.2196/resprot.4358. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Justicia A, Elices M, Cebria AI, Palao DJ, Gorosabel J, Puigdemont D, et al. Rationale and methods of the iFightDepression study: a double-blind, randomized controlled trial evaluating the efficacy of an internet-based self-management tool for moderate to mild depression. BMC Psychiatry. 2017;17:143. doi: 10.1186/s12888-017-1306-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Cuijpers P, Berking M, Andersson G, Quigley L, Kleiboer A, Dobson KS. A meta-analysis of cognitive-behavioural therapy for adult depression, alone and in comparison with other treatments. Can J Psychiatr. 2013;58:376–385. doi: 10.1177/070674371305800702. [DOI] [PubMed] [Google Scholar]
  • 42.Spirito A, Esposito-Smythers C, Wolff J, Uhl K. Cognitive-behavioral therapy for adolescent depression and suicidality. Child Adolesc Psychiatr Clin N Am. 2011;20:191–204. doi: 10.1016/j.chc.2011.01.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Rummel CB, Hansen W, Helbig A, Pitschel-Walz G, Kissling W. Peer-to-peer psychoeducation in schizophrenia: a new approach. J Clin Psychiatry. 2005;66:1580–1585. doi: 10.4088/JCP.v66n1214. [DOI] [PubMed] [Google Scholar]
  • 44.Rummel-Kluge C, Stiegler-Kotzor M, Schwarz C, Hansen W, Kissling W. Peer-counseling in schizophrenia: patients consult patients. Patient Educ Couns. 2008;70:357–362. doi: 10.1016/j.pec.2007.11.001. [DOI] [PubMed] [Google Scholar]
  • 45.Dennis C. The effect of peer support on postpartum depression: a pilot randomized controlled trial. Can J Psychiatr. 2003;48:115–124. doi: 10.1177/070674370304800209. [DOI] [PubMed] [Google Scholar]
  • 46.Ho APY. A peer counselling program for the elderly with depression living in the community. Aging Ment Health. 2007;11:69–74. doi: 10.1080/13607860600735861. [DOI] [PubMed] [Google Scholar]
  • 47.Garcia YE, Metha A, Perfect MC, McWhirter JJ. A senior peer counseling program: evaluation of training and benefits to counselors. Educ Gerontol. 1997;23:329–344. doi: 10.1080/0360127970230403. [DOI] [Google Scholar]
  • 48.American Psychiatric Association (APA) Diagnostic and Statistical Manual of Mental Disorders (DSM-IV) 4. Washington, DC: APA; 1994. [Google Scholar]
  • 49.Löwe B, Kroenke K, Herzog W, Gräfe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9) J Affect Disord. 2004;81:61–66. doi: 10.1016/S0165-0327(03)00198-8. [DOI] [PubMed] [Google Scholar]
  • 50.Löwe B, Spitzer RL, Gräfe K, Kroenke K, Quenter A, Zipfel S, et al. Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians’ diagnoses. J Affect Disord. 2004;78:131–140. doi: 10.1016/S0165-0327(02)00237-9. [DOI] [PubMed] [Google Scholar]
  • 51.Mackenzie CS, Knox VJ, Gekoski WL, Macaulay HL. An adaptation and extension of the attitudes toward seeking professional psychological help scale. J Appl Soc Psychol. 2004;34:2410–2435. doi: 10.1111/j.1559-1816.2004.tb01984.x. [DOI] [Google Scholar]
  • 52.Wilson CJ, Deane FP, Ciarrochi J, Rickwood D. Measuring help-seeking intentions: properties of the General Help-Seeking Questionnaire. Can J Couns. 2005;39:15–28. [Google Scholar]
  • 53.Rickwood DJ, Braithwaite VA. Social-psychological factors affecting help-seeking for emotional problems. Soc Sci Med. 1994;39:563–572. doi: 10.1016/0277-9536(94)90099-X. [DOI] [PubMed] [Google Scholar]
  • 54.Schmidt J, Lamprecht F, Wittmann WW. Zufriedenheit mit der stationären Versorgung. Entwicklung eines Fragebogens und erste Validitätsuntersuchungen. [Satisfaction with inpatient care: development of a questionnaire and first validity assessments]. Psychother Psych Med. 1989:248–55. [PubMed]
  • 55.Ladwig I, Rief W, Nestoriuc Y. Welche Risiken und Nebenwirkungen hat Psychotherapie? - Entwicklung des Inventars zur Erfassung Negativer Effekte von Psychotherapie (INEP). [What are the Risks and Side Effects to Psychotherapy? - Development of an Inventory for the Assessment of Negative Effects of Psychotherapy (INEP)] Verhaltenstherapie. 2014;24:252–263. doi: 10.1159/000367928. [DOI] [Google Scholar]
  • 56.Griffiths KM, Christensen H, Jorm AF, Evans K, Groves C. Effect of web-based depression literacy and cognitive-behavioural therapy interventions on stigmatising attitudes to depression: randomised controlled trial. Br J Psychiatry. 2004;185:342–349. doi: 10.1192/bjp.185.4.342. [DOI] [PubMed] [Google Scholar]
  • 57.Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Duer W, et al. KIDSCREEN-52 quality-of-life measure for children and adolescents. Expert Rev Pharm Out. 2005;5:353–364. doi: 10.1586/14737167.5.3.353. [DOI] [PubMed] [Google Scholar]
  • 58.Ravens-Sieberer U, Erhart M, Rajmil L, Herdman M, Auquier P, Bruil J, et al. Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents’ well-being and health-related quality of life. Qual Life Res. 2010;19:1487–1500. doi: 10.1007/s11136-010-9706-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Voß E, Salize HJ. Health care utilization and cost-effectiveness analyses in prevention studies in the mental health care field. Ment Health Prev. 2016;4:19–23. doi: 10.1016/j.mhp.2016.01.004. [DOI] [Google Scholar]
  • 60.Merry S, McDowell H, Hetrick S, Bir J, Muller N. Psychological and/or educational interventions for the prevention of depression in children and adolescents. Cochrane Database Syst Rev. 2004, Issue 2. Art. No.: CD003380. [DOI] [PubMed]
  • 61.White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trials. 2012;9:396–407. doi: 10.1177/1740774512450098. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Salize HJ, Kilian R. Gesundheitsökonomie in der Psychiatrie – Konzepte, Methoden, Analysen. Stuttgart: Kohlhammer; 2010.
  • 63.Salize HJ, Merkel S, Reinhard I, Twardella D, Mann K, Brenner H. Cost-effective primary care-based strategies to improve smoking cessation: more value for money. Arch Intern Med. 2009;169:230–235. doi: 10.1001/archinternmed.2008.556. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1: (123KB, doc)

Standard Protocol Items: Recommendations for Intervention Trials (SPIRIT) Checklist. (DOC 123 kb)

Data Availability Statement

Not applicable.


Articles from Trials are provided here courtesy of BMC

RESOURCES