Skip to main content
BMC Psychiatry logoLink to BMC Psychiatry
. 2017 Jun 13;17:218. doi: 10.1186/s12888-017-1376-1

Blended care vs. usual care in the treatment of depressive symptoms and disorders in general practice [BLENDING]: study protocol of a non-inferiority randomized trial

Btissame Massoudi 1,, Marco H Blanker 1, Evelien van Valen 2, Hans Wouters 1, Claudi L H Bockting 2,3, Huibert Burger 1
PMCID: PMC5470276  PMID: 28610561

Abstract

Background

The majority of patients with depressive disorders are treated by general practitioners (GPs) and are prescribed antidepressant medication. Patients prefer psychological treatments but they are under-used, mainly due to time constraints and limited accessibility. A promising approach to deliver psychological treatment is blended care, i.e. guided online treatment. However, the cost-effectiveness of blended care formatted as an online psychological treatment supported by the patients’ own GP or general practice mental health worker (MHW) in routine primary care is unknown. We aim to demonstrate non-inferiority of blended care compared with usual care in patients with depressive symptoms or a depressive disorder in general practice. Additionally, we will explore the real-time course over the day of emotions and affect, and events within individuals during treatment.

Methods

This is a pragmatic non-inferiority trial including 300 patients with depressive symptoms, recruited by collaborating GPs and MHWs. After inclusion, participants are randomized to either blended care or usual care in routine general practice. Blended care consists of the ‘Act and Feel’ treatment: an eight-week web-based program based on behavioral activation with integrated monitoring of depressive symptomatology and automatized feedback. GPs or their MHWs coach the participants through regular face-to-face or telephonic consultations with at least three sessions. Depressive symptomatology, health status, functional impairment, treatment satisfaction, daily activities and resource use are assessed during a follow-up period of 12 months. During treatment, real-time fluctuations in emotions and affect, and daily events will be rated using ecological momentary assessment. The primary outcome is the reduction of depressive symptoms from baseline to three months follow-up. We will conduct intention-to-treat analyses and supplementary per-protocol analyses.

Discussion

This trial will show whether blended care might be an appropriate treatment strategy for patients with depressive symptoms and depressive disorder in general practice.

Trial registration

Netherlands Trial Register: NTR4757; 25 August 2014. http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=4757. (Archived by WebCite® at http://www.webcitation.org/6mnXNMGef)

Electronic supplementary material

The online version of this article (doi:10.1186/s12888-017-1376-1) contains supplementary material, which is available to authorized users.

Keywords: eHealth, Blended care, Internet-based treatment, Depression, Depressive symptoms, Depressive disorders, General practice, Primary care, Effectiveness, Cost-effectiveness

Background

Depressive disorders are common. Up to 15% of people in high-income countries experience a major depressive episode at least once in their lifetime [1, 2] Depressive disorders cause high personal and economic burden of disease through their effects on many aspects of life such as participation and functioning [35]

The majority of patients (65% to 80%) with mild and moderate depression are treated by general practitioners (GPs) [611]. GPs in many countries including the Netherlands are recommended to use a (collaborative) stepped care management approach in the treatment of depression with antidepressants appearing only in the second step [12, 13]. Nevertheless, in routine general practice an estimated 70% of cases are primarily treated with antidepressants worldwide [9, 1416]. This is worrisome as there is increasing evidence that antidepressants, while bringing about side effects, are ineffective in patients with mild to moderate depressive disorders which are particularly common in general practice [1719]. This contrasts with psychological treatments that have convincingly shown effectiveness in these patients [20]. Moreover, most patients prefer psychological treatment [21].

Clear barriers for the implementation of psychological treatment in general practice exist. First, most GPs have too little time and experience to offer psychological treatment themselves [22, 23]. Second, referral for psychological treatment is hampered by limited accessibility due to practical barriers, such as high costs of treatment, limited availability of trained professionals and transportation issues [22, 24, 25]. Next, patients may experience emotional barriers such as feared stigmatization [26].

Referral by GPs to web-based programs for the treatment of depression circumvents these problems effectively by providing direct availability of psychological treatment at home. Several systematic reviews demonstrated the effectiveness of online psychological treatment in the treatment of depression [2729]. Interventions without therapist guidance, however, showed small mean effect size and low adherence. In contrast, web-based interventions guided by a therapist (blended care) displayed relatively large mean effect size and better adherence [2729], even comparable to face-to-face psychological treatment [30, 31]. Better adherence to treatment is important also for psychological interventions, as it is associated with greater response to treatment [32]. Therefore, guidance seems essential in the online treatment of depression. Importantly, it can be delegated to less trained or less experienced professionals (i.e. task-sharing) [33].

In previous trials on blended care in general practice, experienced professionals such as clinical psychologists or psychiatrist guided the patients [3442]. In none of these studies were participants guided by their own GP or mental health worker (MHW). This may impair the generalizability of the results of these studies to Dutch general practice or similar settings. MWHs support primary care in delivering good quality mental health care by providing brief and simplified psychological treatment, blended care or self-help [43, 44]

In previous studies mainly online psychological interventions based on cognitive behavioral therapy (CBT) have been studied [38, 42, 4547]. In a recent study behavioral activation has been shown as effective and more cost-effective compared to CBT [48] and it has been experienced as less complicated and more accessible to patients and therapists [49]. MHWs can learn this technique relatively quickly and its effectiveness is comparable to behavioral activation delivered by more specialist staff with more training [49]. Therefore in this trial we evaluate a blended behavioral activation treatment (guided ‘Act and Feel’ treatment).

Blended care has been expected to reduce costs, because part of the psychological treatment is provided online. However, a limited number of studies assessed the cost-effectiveness of blended care in general practice [50, 51].

To our knowledge, this is the first study investigating the effectiveness and cost-effectiveness of a blended behavioral activation treatment for depressive symptoms and disorders as performed in routine general practice.

Methods

Study design and aims

This study is a pragmatic, two-arm non-inferiority randomized controlled trial with an economic evaluation in general practice. The primary aim is to study the short-term (i.e. three months) effectiveness of a blended behavioral activation treatment compared to care as usual (CAU) for patients with depressive symptoms or disorders in general practice. Secondary aims include the short- and long-term (i.e. 12 months) cost-effectiveness and effects of blended care on daily activities, treatment satisfaction, medication use and other related resource use. In addition, we will explore the effects of the blended behavioral activation treatment and CAU on the course of real-time experiences of emotion, affect and events over the day.

Participants

Adults (18 years or over) with a GP diagnosis of depressive symptoms or a depressive disorder for whom the GP considers a next step in the treatment of depression will be included [12]. Patients who fulfill the following criteria will be excluded: a) severe depression requiring prompt referral to specialized mental health service according to the GP (e.g. acute suicidality); b) current/past severe mental illness: schizophrenia, psychotic episode, bipolar disorder, depression with psychotic features; c) current anxiety disorder as primary diagnosis; d) current substance abuse (alcohol, drugs); e) current psychological treatment for depression; such as (online) cognitive behavioral therapy; f) no access to internet; g) insufficient computer skills; h) insufficient proficiency of Dutch language.

Study setting and recruitment

This trial will be conducted in approximately 45 general practices in the Netherlands, located both in cities and in villages. This is a closed trial, i.e. GPs and MHWs recruit participants among their registered patients only. Informed consent will be obtained from each patient. Baseline assessments include the Structured Clinical Interview for DSM-IV disorders I (SCID-I). Modules A (mood episode), D (mood disorders) and F (anxiety disorders) allowing for diagnosing depressive disorders and anxiety disorders. The before-mentioned exclusion criteria are verified using the screening questions of the SCID-I; if screened positive than the total concerning section is administered. A trained interviewer telephonically conducts the SCID. Agreement between telephonic and face-to-face assessment is excellent (90% agreement) [52].

Randomization

Sequence generation and allocation

After baseline assessment participants are 1:1 randomly assigned to one of the treatment groups, stratified by sex, diagnosis (depressive symptoms or depressive disorder) and general practice (availability of a MHW). The randomization sequence is computer-generated with randomly varying block sizes and is concealed by an independent research department. After randomization, the researchers inform the general practice about the treatment allocation. The GP/MHW shares this information with the participant during the follow-up consultation. This trial is single-blinded, i.e. the treatment allocation is concealed from the outcome assessor and participants are asked not to reveal the treatment allocation (Fig. 1).

Fig. 1.

Fig. 1

Outline of inclusion, baseline assessment, and randomization and follow-up assessmentsGP: general practitioner. SCID-I: Structured Clinical Interview for DSM disorders. HRSD-17: Hamilton Rating Scale for Depression, 17 items. EMA: ecological momentary assessments. QIDS-16: quick inventory of depressive symptomatology, 16 items. WHODAS-II: WHO Disability Schedule 2.0. EQ-5D: EuroQol five dimensions questionnaire. TIC-P: Trimbos and iMTA questionnaire on Costs associated with Psychiatric illness

Guided ‘act and feel’ treatment

The guided ‘Act and Feel’ treatment is an online self-management program blended with direct contacts (face-to-face or telephonic) with a MHW [53, 54]. The content of Act and Feel is based on the face-to-face behavioral activation by Lewinsohn [55] and focuses on depressive symptoms. Behavioral activation is based on the behavioral theory stating that depressive behavior is a consequence of low rates of response-contingent positive reinforcement [55]. Therefore, behavioral activation concentrates on activating individuals by increasing activities that are potentially reinforcing for the individual. ‘Act and Feel’ consists of eight modules with integrated monitoring of depressive symptomatology (including suicidality) and automatized feedback in a secure online environment. First, it provides psycho-education about depression and the rationale behind behavioral activation. Second, participants are given insight in their daily mood and behavior/activities using daily activity mood monitoring. Preplanned potential pleasurable activities are mood-independent increased to increase the sense of satisfaction and enhance mood in the long term. There is additionally attention for the role of avoidant behavior in depression and how to turn this to proactive behavior. Finally, it concludes with the development of a personal relapse prevention strategy.

Every module has a fixed structure, starting with a visual analogue scale (VAS) mood assessment (on a Likert scale from 1 to 10); the rationale of that module and specific exercises and it concludes with a summary and evaluation of that module. The ‘Act and Feel’ treatment provides automatically produced graphs of self-ratings mood score and depressive symptomatology.

Guidance

The MHW supports the participants with consultations of a targeted 30 min at two, four and six weeks. The purposes of these consultations are to motivate and support the participants during the activation process and to enhance adherence. In addition, participants receive e-mail reminders when inactive on the online environment for two weeks. The MHWs who guide Act and Feel follow a one-day training session on guidance of Act and Feel and behavioral activation and on-demand supervision of cases by the psychologist research assistant. Before implementation of this treatment, the usability of the ‘Act and Feel’ treatment was evaluated in a pilot study with twenty healthy volunteers. By means of this feedback the treatment was adjusted and after adjustment retested in a second pilot.

Care as usual

The control group receives CAU for depression, left at the discretion of the GP. Patients with depressive disorders in routine usual general practice care are offered mostly pharmacological treatment and receive alongside some psychological treatment, such as non-directive counseling [56, 57]. We will not interfere with CAU but document it carefully. Nevertheless, GPs (or delegated to the MHW) are asked to plan consultations (telephonic or face-to-face) with the participant at two, four and six weeks as recommended by the guideline of the Dutch College of GPs thus mirroring the intervention arm [12]. In addition, patients are monitored for depressive symptomatology and acute suicidality.

Concomitant treatments

Given the trial’s pragmatic nature, the aim is to quantify the real life difference in the course of depressive symptoms between blended behavioral activation and usual care. Consequently, all participants in both arms are allowed to continue or to start any medical or non-medical concomitant treatment, except for psychological treatment, which we ask not to offer in the intervention group during the first three months. For both groups, the use of all forms of formal health care during the trial is carefully documented.

Participant timeline and assessments

Both clinical and economical outcomes are measured (Table 1). Interviewer-rated assessments are performed telephonically (i.e. SCID-I and HRSD-17) and the online self-report assessments through an online environment (ResearchOnline®). Follow-up assessments are at 3, 6 and 12 months.

Table 1.

Overview of the follow-up assessments of the participants

Measures Description Baseline Week 1–10 3 months 6 months 12 months
HRSD-17 Depressive symptom rating X X X
EMA Daily real time ratings of emotion, affect and events X
SCID-I Diagnosis of current depressive disorder X
QIDS-16 Depressive symptoms rating X
WHODAS-II Functional impairment and activity limitation X X X
EQ-5D Health status X X X
Daily activity section of Leidsche Rijn Health Questionnaire Regular daily activities X X X
Treatment satisfaction X X
TIC-P Direct and indirect costs X X X
Demographics Socio-demographic characteristics X
Resource use Medication use, number of referrals and GP consultations X

HRSD-17: Hamilton Rating Scale for Depression, 17 items

EMA: ecological momentary assessments

SCID-I: Structured Clinical Interview for DSM disorders

QIDS-16: quick inventory of depressive symptomatology, 16 items

WHODAS-II: WHO Disability Schedule 2.0

EQ-5D: EuroQol five dimensions questionnaire

TIC-P: Trimbos and iMTA questionnaire on Costs associated with Psychiatric illness

GP: general practitioner

Random real-time assessments will be done in the first ten weeks of participation. In addition to the assessments, all patients are monitored for severe depression and acute suicidality by filling in the self-report questionnaire QIDS weekly during ten weeks.

Outcomes

Primary outcome

The primary outcome is the reduction of depressive symptoms from baseline to three months follow-up, as measured with the Hamilton Depression Scale 17-items (HRSD-17) [5860]. This is a clinician-rated scale consisting of 17 items. This scale has been widely used in clinical trials and serves as gold standard for assessment of depression. It has been found valid and reliable measurement outcome with a higher inter-rater reliability and test-retest reliability [59, 61].

Secondary outcomes

Depression related outcomes

The reduction of depressive symptoms on the HRSD-17 is assessed from baseline to 12 months of follow-up. Additionally, response defined as a 50% reduction on the HRSD-17 is evaluated at 3 and 12 months. Furthermore, depressive symptoms are assessed weekly using the self-reported measurement Quick Inventory of Depressive symptoms self-reported 16 items (QIDS-SR 16). The QIDS-SR 16 are used to monitor depressive symptoms and to signal acute suicidality and severe depression during the first ten weeks of treatment. When exceeding the threshold of severe depression (i.e. HRSD-17 score 16 or higher) or acute suicidality (i.e. score of 2 or 3 on the suicidality item of the QIDS-R), all patients receives an automatic message to contact their GP and MHW and the researcher informs the GP.

Treatment satisfaction

Treatment satisfaction is assessed using a self-developed questionnaire, consisting of five items. Each question is scored on a Likert-type scale from 1 to 4. The questionnaire addresses overall service satisfaction; i.e. satisfaction with treatment, recommendation of treatment, satisfaction about effectiveness of treatment and willingness to repeat treatment if needed. This questionnaire is shown in Additional file 1.

Health status

General health status is assessed with the EuroQol (EQ-5D), which is a validated self-administered questionnaire that contains a descriptive section and a valuation section. The descriptive section consists of five dimensions: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. Each of these five dimensions has three levels of severity: no problems, some/moderate problems and extreme problems. Values of the five dimensions are linearly transformed into one single score, ranging from 0 to 1 (lower scores represent more problems). The valuation section of the EQ-5D contains a visual analogue scale; this vertical visual scale ranges between ‘best imaginable health state = perfect health’ (score of 100) and ‘worst imaginable health state = death’ (score of 0). The EQ-5D valuation section has been shown to be efficient and easy to use [62].

Functional impairment and activity limitations

Functional impairment and activity limitations are assessed using the 12-item self-report World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0). The WHODAS 2.0 is based on the conceptual framework of the International Classification of Functioning, Disability and Health (ICF). It provides a global measure of disability and 7 domain-specific scores. It assesses health and disability on six dimensions, namely cognition, mobility, self-care, getting along, life activities and participation. WHODAS 2.0 has been validated in 1119 patients across 7 European centers with 13 chronic conditions and it has been shown to have good metric properties [63]

Daily activities

Daily activities are assessed using part of the Health Questionnaire of the Utrecht Health project [64] This part of the questionnaire assesses daily activity level during a regular week in the past months, i.e. the kind and duration of these activities. The blended care treatment focuses on activating participants, by increasing their potential pleasurable activities. By assessing daily activities we study a potential prognostic mediating factor in the recovery of depression.

Ecological momentary assessment (EMA)

We will capture real-time momentary ratings of cognitions as well as affect and emotions with so-called Ecological Momentary Assessment (EMA). Compared to conventional questionnaires, potential advantages of prospective precise measurement with EMA are less recall bias and increased detection of vulnerable patients with adverse disease trajectories [65].

Specifically, using a smart phone application called ‘DE Free’ (Bockting, used software TEMPEST, Batalas & Markopoulos) (Fig. 2), auditory cue signals will be sent to participants’ cellphones. Thereupon, participants will be asked to rate their momentary states. These include an appraisal of positive affect (i.e. being cheerful, content, and energetic) and negative affect (i.e. feeling gloomy, nervous, insecure, lonely, irritated, helpless, and guilty), and activity levels (i.e. being active, pleasantness of activity, and energy involved in performing activity). Momentary states are rated on visual analogue scales, which are either numerical and ranging from 0 to 100 or ordinal and ranging from e.g. “not at all” to “very much”. Furthermore, participants will be asked to indicate the specific activities they were undertaking and the specific situation they were in while rating these momentary states (e.g. being at home and doing household chores). Participants will be asked to rate their momentary states in the following time schedule: every other day, 5 times per day, over the course of a 10-week period. Auditory signals will be sent at random moments during the following time intervals: equally spread between 8.30 a.m. and 7.30 p.m.

Fig. 2.

Fig. 2

Screenshot from the ‘DE-free’ application

Resource use

Costs related to the intervention

To calculate costs related to the internet treatment, we include costs of running the website platform and costs of the guidance by the GP or MHW.

Direct and indirect costs

We will measure health care costs in general (direct costs) as well as productivity losses (indirect costs) with the revised version of the Trimbos and iMTA Questionnaires on Costs Associated with Psychiatric Illness (TiC-P) [66, 67]. Direct costs are measured by investigating, which contact with health professionals has occurred and which type of medication has been prescribed. Indirect costs are measured by work absenteeism and reduced productivity. The TiC-P questions cover the previous six months; it is administrated at 6 and 12 months follow-up.

Sample size

The sample size is based on demonstrating non-inferiority of blended care compared to usual care for the primary outcome, i.e. the reduction on HRSD-17 from baseline to three months follow-up. An acceptable non-inferiority margin has been defined as the maximum clinically irrelevant difference between treatments [68]. The non-inferiority margin is set to be the half of minimal clinical important difference of 3 points on the HRSD-17 scale as advised by the FDA [60, 69, 70]; i.e. a non-inferiority margin of 1.5 points at the HRSD-17 (0.31 SD). The sample size was calculated with one-sided t-test with a power of 80% (α = 0.025) to detect a non-inferiority margin of 1.5. We compensated for an expected loss to follow-up of 20%. We adjusted for covariance, as advised to reduce required sample sizes and costs [71, 72]. In this correction we assumed a correlation coefficient (ρ) of 0.5, as recommended when the correlation coefficient is unknown [71, 73]. The number of participants needed is then corrected with design factor (1 − ρ 2), where ρ is the correlation coefficient. This resulted in a calculated design factor of 0.75. The final number calculated necessary to complete the trial is 151 participants per condition (a total of N = 302).

Statistical methods

First, we will compare demographic characteristics of the trial population, to assure whether the randomization procedure has been successful.

The principle analysis will follow an intention-to-treat (ITT) strategy including all patients analyzed according to their randomized group. Supplementary analyses will be done on a ‘per protocol’ basis, meaning that they will be restricted to those participants that completed a minimum of three sessions in the intervention group.

The primary outcome, i.e. reduction in symptoms of depression from baseline to the 3 months follow-up, will be analyzed using a linear regression approach to analysis of covariance (ANCOVA) with the follow-up value of the outcome as the dependent variable and treatment and baseline value of the outcome as the independent variables. Secondary outcomes that were measured more than twice will be analyzed using linear mixed models for fixed (e.g. treatment) and random effects (e.g. patient). These models are superior for the analysis of longitudinally correlated data and can optimally deal with missing values [71]. In these analyses, a treatment*time variable indicating the magnitude of the effect of the intervention on the change of the outcome variable will be included as an independent variable. If important baseline differences exist in prognostic important variables, despite randomization, we will adjust the analyses by including variables as covariates in additional analyses. Potential baseline differences will be reexamined before the per protocol analyses. Dichotomous outcome variables measured more than twice will be analyzed using generalized linear mixed models (mixed-effects logistic regression).

All effect parameters will be supplied with a 95% confidence interval. Statistical significance level will be set at 0.025, one-sided, as appropriate with the chosen non-inferiority design.

EMA data of real time momentary ratings will be examined in a bivariate vector-autoregressive Bayesian dynamic analysis and related analytic approaches to model the time structure of the data [Krone in preparation 2016; Krone submitted]. Feasibility and tolerability of EMA assessment by participants will be examined by assessing how many participants will be able to complete at least 70% of the EMA ratings. Based on the literature we will exclude participants with 30% or more missing on the EMA ratings (Krone in preparation, [74, 75]).

Additional analysis

Economic outcomes

The cost-effectiveness and cost-utility of blended care will be studied from a societal perspective, using a time horizon of 12 months. To determine the cost-effectiveness of both treatments, we will estimate costs in both treatment groups. To calculate the total direct medical costs we will estimate the resource use. The resource use will be valued according to the Dutch guidelines for cost studies [67]. Costs of blended care will be estimated by true resources used. Medication use will be valued based on costs a provided by The National Health Care Institute (Zorginstituut Nederland, ZIN). Total costs for both interventions will be summed-up over the 12-month study period. An incremental cost effectiveness ratio (ICER) will be calculated using the primary measure of effect: HDRS-17. In addition, a secondary analysis will be performed using the number of patients with a response as defined under secondary outcomes. In order to be able to compare the effects of blended care to other health care interventions, also a cost-utility analysis will be done; using EQ-5D defined utilities. Bootstrapping will be performed to depict the 95% confidence intervals surrounding the cost effectiveness, and cost utility ratios. Cost-effectiveness planes will be plotted in order to represent the cost-effectiveness graphically.

Discussion

There is a need to investigate accessible ways to offer psychological treatment in general practice as both GPs and patients prefer psychological treatment [2123]. However, barriers to psychological treatment in general practice such as time constraints and lack of experience of the GP (28–30), result in GPs prescribing pharmacological treatment even as a first step [76]. This contrasts sharply with the guidelines recommending non-pharmacological treatment as the first step [12, 13] and is unwanted in view of the side effects, poor adherence, and long-term use after remission associated with antidepressant use [7779]. Blended care interventions may provide GPs a feasible instrument to offer structured psychological treatment.

The current paper presents the design of a pragmatic non-inferiority trial to study the effectiveness and cost-effectiveness of a blended behavioral activation treatment for depressive symptoms and disorders in general practice.

While previous studies mainly used online psychological interventions based on cognitive behavioral therapy (CBT) [28, 32, 80], behavioral activation has been shown as effective and more cost-effective compared to CBT(50). In addition, it has been experienced as less complicated and more accessible to patients and therapists [81]. MHWs can learn the technique required quickly and its effectiveness is comparable to behavioral activation delivered by more specialist staff with more training [49]. It is expected that blended behavioral activation will provide an accessible and easier way to provide psychological treatment in general practice.

To our knowledge, this is the first trial of blended care based on behavioral activation in general practice provided by patients’ own GP or MHWs including assessments of real-time experiences during treatment by the EMA. An important strength of this trial is that it is conducted in routine general practice. Patients are recruited and coached by their own GPs and MHWs during treatment, hereby mirroring routine general practice and increasing the study’s generalizability. Another strength is that the EMA has the advantage of reducing memory distortions compared to conventional questionnaires. It gives insight into actual experiences during treatment [82]. In future, knowledge of patients’ real-time experiences may enable the development of more personalized blended care for depression [65]. This randomized controlled trial will show whether a blended behavioral activation treatment is a non-inferior treatment strategy for patients with depressive symptoms and depressive disorder in general practice.

Acknowledgements

The authors would like to thank the GPs and MHWs for their contribution to the recruitment of participants and Welmoed Dekker, Rosanne Dokkum, Agnes Diemers and Lianne Dijkstra for their contribution in the training and supervision of the GPs and MHWs.

Funding

This trial was funded by the Netherlands Organization for Health Research and Development ZonMw (83911000). In addition we received a private donation from Mr. J.J. van der Werff. This paper has partly been written by CLHB as part of a fellowship at the Netherlands Institute for Advances Study in the Humanities and Social Science Study (NIAS).

Availability of data and materials

Not applicable, still ongoing.

Authors’ contributions

HB, MHB, and CLB designed the trial. CLB and EvV designed the Act and Feel treatment. BM tested the Act and Feel platform, performed the pilot of the platform with volunteers and partly recruited practices and participants. HW manages the conduction of the trial. All authors read and approved the final manuscript.

Competing interests

Co-authors EVV and CLHB have written the content of the behavioral activation treatment ‘Act and Feel’.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The protocol of this trial has been approved by the Medical Ethics Committee of the University Medical Center Groningen, University of Groningen, the Netherlands (registration number 2014/346). All participants were provided study information through a study brochure and a telephonically explanation of the study before written informed consent was obtained.

Study status

Ongoing, collecting participants and data.

Related articles

Not applicable.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Abbreviations

CAU

Care as usual

CBT

Cognitive behavioral therapy

EMA

Ecological Momentary Assessments

EQ-5D

EuroQol five dimensions questionnaire

FDA

Federal Drug Administration

GP

General practitioner

HRSD-17

Hamilton Rating Scale for Depression, 17 items

ICER

Incremental Cost-Effectiveness Ratio

ICF

International Classification of Functioning, Disability and health

ITT

Intention To Treat

MHW

Mental health worker

QIDS-16

Quick inventory of depressive symptomatology, 16 items

SCID

Structured Clinical Interview for DSM disorders

TIC-P

Trimbos and iMTA questionnaire on Costs associated with Psychiatric illness

VAS

Visual analogue scale

WHODAS-II

WHO Disability Schedule 2.0; EQ-5D

Additional file

Additional file 1: (1.2MB, docx)

Questionnaire overall service satisfaction; i.e. satisfaction with treatment, recommendation of treatment, satisfaction about effectiveness of treatment and willingness to repeat treatment if needed. (DOCX 1224 kb)

Footnotes

Electronic supplementary material

The online version of this article (doi:10.1186/s12888-017-1376-1) contains supplementary material, which is available to authorized users.

Contributor Information

Btissame Massoudi, Phone: +31503616760, Email: b.massoudi@umcg.nl.

Marco H. Blanker, Email: marcoblanker@gmail.com

Evelien van Valen, Email: e.vanvalen@uu.nl.

Hans Wouters, Email: j.wouters@umcg.nl.

Claudi L. H. Bockting, Email: c.l.h.bockting@uu.nl

Huibert Burger, Email: h.burger@umcg.nl.

References

  • 1.Kruijshaar ME, Barendregt J, Vos T, de Graaf R, Spijker J, Andrews G. Lifetime prevalence estimates of major depression: an indirect estimation method and a quantification of recall bias. Eur J Epidemiol. 2005;20(1):103–111. doi: 10.1007/s10654-004-1009-0. [DOI] [PubMed] [Google Scholar]
  • 2.Kessler RC, Bromet EJ. The epidemiology of depression across cultures. Annu Rev Public Health. 2013;34:119–138. doi: 10.1146/annurev-publhealth-031912-114409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Wells KB, Stewart A, Hays RD, Burnam MA, Rogers W, Daniels M, et al. The functioning and well-being of depressed patients. Results from the medical outcomes study. JAMA. 1989;262(7):914–919. doi: 10.1001/jama.1989.03430070062031. [DOI] [PubMed] [Google Scholar]
  • 4.Von Korff M, Ormel J, Katon W, Lin EH. Disability and depression among high utilizers of health care. A longitudinal analysis. Arch Gen Psychiatry. 1992;49(2):91–100. doi: 10.1001/archpsyc.1992.01820020011002. [DOI] [PubMed] [Google Scholar]
  • 5.Ustun TB, Ayuso-Mateos JL, Chatterji S, Mathers C, Murray CJ. Global burden of depressive disorders in the year 2000. Br J Psychiatry. 2004;184:386–392. doi: 10.1192/bjp.184.5.386. [DOI] [PubMed] [Google Scholar]
  • 6.Alonso J, Angermeyer MC, Bernert S, Bruffaerts R, Brugha TS, Bryson H, et al. Use of mental health services in Europe: results from the European study of the epidemiology of mental disorders (ESEMeD) project. Acta Psychiatr Scand Suppl. 2004;(420):47–54. [DOI] [PubMed]
  • 7.Bijl RV, Ravelli A. Psychiatric morbidity, service use, and need for care in the general population: results of The Netherlands mental health survey and incidence study. Am J Public Health. 2000;90(4):602–607. doi: 10.2105/AJPH.90.4.602. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Verhaak PF, Prins MA, Spreeuwenberg P, Draisma S, van Balkom TJ, Bensing JM, et al. Receiving treatment for common mental disorders. Gen Hosp Psychiatry. 2009;31(1):46–55. doi: 10.1016/j.genhosppsych.2008.09.011. [DOI] [PubMed] [Google Scholar]
  • 9.Verhaak PF, van Dijk CE, Nuijen J, Verheij RA, Schellevis FG. Mental health care as delivered by Dutch general practitioners between 2004 and 2008. Scand J Prim Health Care. 2012;30(3):156–162. doi: 10.3109/02813432.2012.688707. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Wang PS, Berglund P, Kessler RC. Recent care of common mental disorders in the United States : prevalence and conformance with evidence-based recommendations. J Gen Intern Med. 2000;15(5):284–292. doi: 10.1046/j.1525-1497.2000.9908044.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Kovess-Masfety V, Alonso J, Brugha TS, Angermeyer MC, Haro JM, Sevilla-Dedieu C, et al. Differences in lifetime use of services for mental health problems in six European countries. Psychiatr Serv. 2007;58(2):213–220. doi: 10.1176/ps.2007.58.2.213. [DOI] [PubMed] [Google Scholar]
  • 12.Weel-Baumgarten V, van Gelderen MG, Grundmeijer HGLM, et al. NHG-Standaard Depressie (tweede herziening) Huisarts Wet. 2012;55(6):252–259. [Google Scholar]
  • 13.National Collaborating Centre for Mental Health (UK) Depression: the treatment and Management of Depression in adults (updated edition) 2010. [PubMed] [Google Scholar]
  • 14.Olfson M, Blanco C, Marcus SC. Treatment of adult depression in the United States. JAMA Intern Med. 2016;176(10):1482–1491. doi: 10.1001/jamainternmed.2016.5057. [DOI] [PubMed] [Google Scholar]
  • 15.Bushnell J, McLeod D, Dowell A, Salmond C, Ramage S, Collings S, et al. The treatment of common mental health problems in general practice. Fam Pract. 2006;23(1):53–59. doi: 10.1093/fampra/cmi097. [DOI] [PubMed] [Google Scholar]
  • 16.Sleath BL, Rubin RH, Huston SA. Antidepressant prescribing to Hispanic and non-Hispanic white patients in primary care. Ann Pharmacother. 2001;35(4):419–423. doi: 10.1345/aph.10245. [DOI] [PubMed] [Google Scholar]
  • 17.Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008;358(3):252–260. doi: 10.1056/NEJMsa065779. [DOI] [PubMed] [Google Scholar]
  • 18.Katon W, Schulberg H. Epidemiology of depression in primary care. Gen Hosp Psychiatry. 1992;14(4):237–247. doi: 10.1016/0163-8343(92)90094-Q. [DOI] [PubMed] [Google Scholar]
  • 19.Fournier JC, DeRubeis RJ, Hollon SD, Dimidjian S, Amsterdam JD, Shelton RC, et al. Antidepressant drug effects and depression severity: a patient-level meta-analysis. JAMA. 2010;303(1):47–53. doi: 10.1001/jama.2009.1943. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Bortolotti B, Menchetti M, Bellini F, Montaguti MB, Berardi D. Psychological interventions for major depression in primary care: a meta-analytic review of randomized controlled trials. Gen Hosp Psychiatry. 2008;30(4):293–302. doi: 10.1016/j.genhosppsych.2008.04.001. [DOI] [PubMed] [Google Scholar]
  • 21.van Schaik DJ, Klijn AF, van Hout HP, van Marwijk HW, Beekman AT, de Haan M, et al. Patients' preferences in the treatment of depressive disorder in primary care. Gen Hosp Psychiatry. 2004;26(3):184–189. doi: 10.1016/j.genhosppsych.2003.12.001. [DOI] [PubMed] [Google Scholar]
  • 22.Saltini A, David A, Trentini A, Marchi J, Pioli R. Clinical practice in mental health and educational needs in general practice. Recenti Prog Med. 2002;93(7–8):410–415. [PubMed] [Google Scholar]
  • 23.Hermens ML, Muntingh A, Franx G, van Splunteren PT, Nuyen JS, et al. BMC Fam Pract. 2014;15(5):2296-15-5. doi: 10.1186/1471-2296-15-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Mohr DC, Hart SL, Howard I, Julian L, Vella L, Catledge C, et al. Barriers to psychotherapy among depressed and nondepressed primary care patients. Ann Behav Med. 2006;32(3):254–258. doi: 10.1207/s15324796abm3203_12. [DOI] [PubMed] [Google Scholar]
  • 25.Alvidrez J, Azocar F. Distressed women's clinic patients: preferences for mental health treatments and perceived obstacles. Gen Hosp Psychiatry. 1999;21(5):340–347. doi: 10.1016/S0163-8343(99)00038-9. [DOI] [PubMed] [Google Scholar]
  • 26.Barney LJ, Griffiths KM, Christensen H, Jorm AF. Exploring the nature of stigmatising beliefs about depression and help-seeking: implications for reducing stigma. BMC Public Health. 2009;9(61):2458-9-61. doi: 10.1186/1471-2458-9-61. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;6;32(4):329–342. doi: 10.1016/j.cpr.2012.02.004. [DOI] [PubMed] [Google Scholar]
  • 28.Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One. 2010;5(10):e13196. doi: 10.1371/journal.pone.0013196. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Spek V, Cuijpers P, Nyklicek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. 2007;37(3):319–328. doi: 10.1017/S0033291706008944. [DOI] [PubMed] [Google Scholar]
  • 30.van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, et al. Adherence to internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One. 2014;9(7):e100674. doi: 10.1371/journal.pone.0100674. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014;13(3):288–295. doi: 10.1002/wps.20151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. 2017;22 [DOI] [PubMed]
  • 33.Titov N, Andrews G, Davies M, McIntyre K, Robinson E, Solley K. Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLoS One. 2010;5(6):e10939. doi: 10.1371/journal.pone.0010939. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Moreno FA, Chong J, Dumbauld J, Humke M, Byreddy S. Use of standard webcam and internet equipment for telepsychiatry treatment of depression among underserved Hispanics. Psychiatr Serv. 2012;63(12):1213–1217. doi: 10.1176/appi.ps.201100274. [DOI] [PubMed] [Google Scholar]
  • 35.Hilty DM, Marks S, Wegelin J, Callahan EJ, Nesbitt TS. A randomized, controlled trial of disease management modules, including telepsychiatric care, for depression in rural primary care. Psychiatry (Edgmont) 2007;4(2):58–65. [PMC free article] [PubMed] [Google Scholar]
  • 36.Burton C, Szentagotai Tatar A, McKinstry B, Matheson C, Matu S, Moldovan R, et al. Pilot randomised controlled trial of Help4Mood, an embodied virtual agent-based system to support treatment of depression. J Telemed Telecare. 2016;22(6):348–355. doi: 10.1177/1357633X15609793. [DOI] [PubMed] [Google Scholar]
  • 37.Hoifodt RS, Lillevoll KR, Griffiths KM, Wilsgaard T, Eisemann M, Waterloo K, et al. The clinical effectiveness of web-based cognitive behavioral therapy with face-to-face therapist support for depressed primary care patients: randomized controlled trial. J Med Internet Res. 2013;15(8):e153. doi: 10.2196/jmir.2714. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Kivi M, Eriksson MC, Hange D, Petersson EL, Vernmark K, Johansson B, et al. Internet-based therapy for mild to moderate depression in Swedish primary care: short term results from the PRIM-NET randomized controlled trial. Cogn Behav Ther. 2014;43(4):289–298. doi: 10.1080/16506073.2014.921834. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Levesque DA, Van Marter DF, Schneider RJ, Bauer MR, Goldberg DN, Prochaska JO, et al. Randomized trial of a computer-tailored intervention for patients with depression. Am J Health Promot. 2011;26(2):77–89. doi: 10.4278/ajhp.090123-QUAN-27. [DOI] [PubMed] [Google Scholar]
  • 40.Simon GE, Ralston JD, Savarino J, Pabiniak C, Wentzel C, Operskalski BH. Randomized trial of depression follow-up care by online messaging. J Gen Intern Med. 2011;26(7):698–704. doi: 10.1007/s11606-011-1679-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Salisbury C, O'Cathain A, Edwards L, Thomas C, Gaunt D, Hollinghurst S, et al. Effectiveness of an integrated telehealth service for patients with depression: a pragmatic randomised controlled trial of a complex intervention. Lancet Psychiatry. 2016;3(6):515–525. doi: 10.1016/S2215-0366(16)00083-3. [DOI] [PubMed] [Google Scholar]
  • 42.Montero-Marin J, Araya R, Perez-Yus MC, Mayoral F, Gili M, Botella C, et al. An internet-based intervention for depression in primary Care in Spain: a randomized controlled trial. J Med Internet Res. 2016;18(8):e231. doi: 10.2196/jmir.5695. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.England E, Lester H. Implementing the role of the primary care mental health worker: a qualitative study. Br J Gen Pract. 2007;57(536):204–211. [PMC free article] [PubMed] [Google Scholar]
  • 44.Bower P. Primary care mental health workers: models of working and evidence of effectiveness. Br J Gen Pract. 2002;52(484):926–933. [PMC free article] [PubMed] [Google Scholar]
  • 45.Gilbody S, Littlewood E, Hewitt C, Brierley G, Tharmanathan P, Araya R, et al. Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial. BMJ. 2015;351:h5627. doi: 10.1136/bmj.h5627. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Hallgren M, Kraepelien M, Ojehagen A, Lindefors N, Zeebari Z, Kaldo V, et al. Physical exercise and internet-based cognitive-behavioural therapy in the treatment of depression: randomised controlled trial. Br J Psychiatry. 2015;207(3):227–234. doi: 10.1192/bjp.bp.114.160101. [DOI] [PubMed] [Google Scholar]
  • 47.Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, et al. Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet. 2009;374(9690):628–634. doi: 10.1016/S0140-6736(09)61257-5. [DOI] [PubMed] [Google Scholar]
  • 48.Richards DA, Ekers D, McMillan D, Taylor RS, Byford S, Warren FC, et al. Cost and outcome of Behavioural activation versus cognitive Behavioural therapy for depression (COBRA): a randomised, controlled, non-inferiority trial. Lancet. 2016;388(10047):871–880. doi: 10.1016/S0140-6736(16)31140-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Ekers D, Richards D, McMillan D, Bland JM, Gilbody S. Behavioural activation delivered by the non-specialist: phase II randomised controlled trial. Br J Psychiatry. 2011;198(1):66–72. doi: 10.1192/bjp.bp.110.079111. [DOI] [PubMed] [Google Scholar]
  • 50.Littlewood E, Duarte A, Hewitt C, Knowles S, Palmer S, Walker S, et al. A randomised controlled trial of computerised cognitive behaviour therapy for the treatment of depression in primary care: the randomised evaluation of the effectiveness and acceptability of computerised therapy (REEACT) trial. Health Technol Assess. 2015;viii(101):xxi-171. doi: 10.3310/hta191010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Hollinghurst S, Peters TJ, Kaur S, Wiles N, Lewis G, Kessler D. Cost-effectiveness of therapist-delivered online cognitive-behavioural therapy for depression: randomised controlled trial. Br J Psychiatry. 2010;197(4):297–304. doi: 10.1192/bjp.bp.109.073080. [DOI] [PubMed] [Google Scholar]
  • 52.Simon GE, Revicki D, VonKorff M. Telephone assessment of depression severity. J Psychiatr Res. 1993;0;27(3):247–252. doi: 10.1016/0022-3956(93)90035-Z. [DOI] [PubMed] [Google Scholar]
  • 53.Bockting CLH, van Valen E. Act and feel online: internet-based behavioral activation in Dutch. Treat Mod. 2015;
  • 54.Arjadi R, Nauta MH, Scholte WF, Hollon SD, Chowdhary N, Suryani AO, et al. Guided act and feel Indonesia (GAF-ID) - internet-based behavioral activation intervention for depression in Indonesia: study protocol for a randomized controlled trial. Trials. 2016;17(1):455,016-1577-9. doi: 10.1186/s13063-016-1577-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Lewinsohn PM. A behavioral approach to depression. In: Coyne JC, editor. Essential papers on depression. New York: New York University Press; 1985. pp. 150–180. [Google Scholar]
  • 56.van Rijswijk E, Borghuis M, van de Lisdonk E, Zitman F, van Weel C. Treatment of mental health problems in general practice: a survey of psychotropics prescribed and other treatments provided. Int J Clin Pharmacol Ther. 2007;45(1):23–29. doi: 10.5414/CPP45023. [DOI] [PubMed] [Google Scholar]
  • 57.Rijswijk van E. Mental health problems in general practice. UMC St Radboud: Nijmegen; 2005. [Google Scholar]
  • 58.Morriss R, Leese M, Chatwin J, Baldwin D, THREAD Study Group Inter-rater reliability of the Hamilton depression rating scale as a diagnostic and outcome measure of depression in primary care. J Affect Disord. 2008;111(2–3):204–213. doi: 10.1016/j.jad.2008.02.013. [DOI] [PubMed] [Google Scholar]
  • 59.Zimmerman M, Martinez JH, Young D, Chelminski I, Dalrymple K. Severity classification on the Hamilton depression rating scale. J Affect Disord. 2013;150(2):384–388. doi: 10.1016/j.jad.2013.04.028. [DOI] [PubMed] [Google Scholar]
  • 60.Walker R. Understanding the Hamilton depression scores. 2012. [Google Scholar]
  • 61.Helmreich I, Wagner S, Mergl R, Allgaier AK, Hautzinger M, Henkel V, et al. Sensitivity to changes during antidepressant treatment: a comparison of unidimensional subscales of the inventory of depressive Symptomatology (IDS-C) and the Hamilton depression rating scale (HAMD) in patients with mild major, minor or subsyndromal depression. Eur Arch Psychiatry Clin Neurosci. 2012;262(4):291–304. doi: 10.1007/s00406-011-0263-x. [DOI] [PubMed] [Google Scholar]
  • 62.Brazier J, Connell J, Papaioannou D, Mukuria C, Mulhern B, Peasgood T, et al. A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technol Assess. 2014;18(34):1–188. doi: 10.3310/hta18340. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Garin O, Ayuso-Mateos JL, Almansa J, Nieto M, Chatterji S, Vilagut G, et al. Validation of the "World Health Organization disability assessment schedule, WHODAS-2" in patients with chronic diseases. Health Qual Life Outcomes. 2010;8(51):7525-8-51. doi: 10.1186/1477-7525-8-51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Grobbee DE, Hoes AW, Verheij TJ, Schrijvers AJ, van Ameijden EJ, Numans ME. The Utrecht health project: optimization of routine healthcare data for research. Eur J Epidemiol. 2005;20(3):285–287. doi: 10.1007/s10654-004-5689-2. [DOI] [PubMed] [Google Scholar]
  • 65.Wichers M, Peeters F, Geschwind N, Jacobs N, Simons CJ, Derom C, et al. Unveiling patterns of affective responses in daily life may improve outcome prediction in depression: a momentary assessment study. J Affect Disord. 2010;124(1–2):191–195. doi: 10.1016/j.jad.2009.11.010. [DOI] [PubMed] [Google Scholar]
  • 66.Bouwmans C, De Jong K, Timman R, Zijlstra-Vlasveld M, Van der Feltz-Cornelis C, Tan Swan S, et al. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P) BMC Health Serv Res. 2013;13(217):6963-13-217. doi: 10.1186/1472-6963-13-217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Handleiding Trimbos/iMTA questionnaire for Costs associated with Psychiatric illness (TiC-P), Rotterdam. 2013. Available from: www.imta.nl.
  • 68.Hida E, Tango T. On the three-arm non-inferiority trial including a placebo with a prespecified margin. Stat Med. 2011;30(3):224–231. doi: 10.1002/sim.4099. [DOI] [PubMed] [Google Scholar]
  • 69.Mynors-Wallis LM, Gath DH, Day A, Baker F. Randomised controlled trial of problem solving treatment, antidepressant medication, and combined treatment for major depression in primary care. BMJ. 2000;320(7226):26–30. doi: 10.1136/bmj.320.7226.26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Guidance for Industry Non-Inferiority Clinical Trials. 2010. Available at: https://www.fda.gov.
  • 71.Vickers AJ, Altman DG. Statistics notes: Analysing controlled trials with baseline and follow up measurements. BMJ. 2001;323(7321):1123–1124. doi: 10.1136/bmj.323.7321.1123. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Borm GF, Fransen J, Lemmens WA. A simple sample size formula for analysis of covariance in randomized clinical trials. J Clin Epidemiol. 2007;60(12):1234–1238. doi: 10.1016/j.jclinepi.2007.02.006. [DOI] [PubMed] [Google Scholar]
  • 73.Follmann D, Elliott P, Suh I, Cutler J. Variance imputation for overviews of clinical trials with continuous response. J Clin Epidemiol. 1992;45(7):769–773. doi: 10.1016/0895-4356(92)90054-Q. [DOI] [PubMed] [Google Scholar]
  • 74.West M, Harrison J. Bayesian forecasting and dynamic models. second. Springer-Verlag New York: New York, NY, USA; 1999. [Google Scholar]
  • 75.Delespaul PAEG. Assessing schizophrenia in daily life : the experience sampling method. Maastricht: UPM, Universitary Press Maastricht, Maastricht; 1995. [Google Scholar]
  • 76.van Marwijk HW, Bijl D, Ader HJ, de Haan M. Antidepressant prescription for depression in general practice in The Netherlands. Pharm World Sci. 2001;23(2):46–49. doi: 10.1023/A:1011294305606. [DOI] [PubMed] [Google Scholar]
  • 77.van Geffen EC, Gardarsdottir H, van Hulten R, van Dijk L, Egberts AC, Heerdink ER. Initiation of antidepressant therapy: do patients follow the GP's prescription? Br J Gen Pract. 2009;59(559):81–87. doi: 10.3399/bjgp09X395067. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.van Geffen EC, van Hulten R, Bouvy ML, Egberts AC, Heerdink ER. Characteristics and reasons associated with nonacceptance of selective serotonin-reuptake inhibitor treatment. Ann Pharmacother. 2008;42(2):218–225. doi: 10.1345/aph.1K516. [DOI] [PubMed] [Google Scholar]
  • 79.Moore M, Yuen HM, Dunn N, Mullee MA, Maskell J, Kendrick T. Explaining the rise in antidepressant prescribing: a descriptive study using the general practice research database. BMJ. 2009;339:b3999. doi: 10.1136/bmj.b3999. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329–342. doi: 10.1016/j.cpr.2012.02.004. [DOI] [PubMed] [Google Scholar]
  • 81.Ekers DM, Dawson MS, Bailey E. Dissemination of behavioural activation for depression to mental health nurses: training evaluation and benchmarked clinical outcomes. J Psychiatr Ment Health Nurs. 2013;20(2):186–192. doi: 10.1111/j.1365-2850.2012.01906.x. [DOI] [PubMed] [Google Scholar]
  • 82.Bos FM, Schoevers RA, aan het Rot M. Experience sampling and ecological momentary assessment studies in psychopharmacology: a systematic review. Eur Neuropsychopharmacol. 2015;25(11):1853–1864. doi: 10.1016/j.euroneuro.2015.08.008. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable, still ongoing.


Articles from BMC Psychiatry are provided here courtesy of BMC

RESOURCES