Skip to main content
BMC Psychiatry logoLink to BMC Psychiatry
. 2016 Jul 7;16:216. doi: 10.1186/s12888-016-0927-1

Effectiveness and cost-effectiveness of a self-management training for patients with chronic and treatment resistant anxiety or depressive disorders: design of a multicenter randomized controlled trial

Maringa H H Zoun 1,2,, Bauke Koekkoek 2,3, Henny Sinnema 4, Anna D T Muntingh 5, Anton J L M van Balkom 5, Aart H Schene 6, Filip Smit 4,7,8, Jan Spijker 1,2,4
PMCID: PMC4936240  PMID: 27388878

Abstract

Background

Many patients with anxiety or depressive disorders achieve no remission of their symptoms after evidence-based treatment algorithms. They develop a chronic course of the disorder. Current care for these patients usually consists of long-term supportive contacts with a community psychiatric nurse and pharmacological management by a psychiatrist. Data on the effectiveness of these treatments is lacking. A psychosocial rehabilitation approach, where self-management is an increasingly important part, could be more suitable. It focuses on the restoration of functioning and enhancement of patients’ autonomy and responsibility. Treatment with this focus, followed by referral to primary care, may be more (cost-)effective.

Methods

A multicenter randomized controlled trial is designed for twelve participating specialized outpatient mental health services in the Netherlands. Patients with chronic and treatment resistant anxiety or depressive disorders, currently receiving supportive care in specialized outpatient mental health care, are asked to participate. After inclusion, patients receive the baseline questionnaire and are randomized to the intervention group or the usual care control group. The intervention focuses on rehabilitation and self-management and is provided by a trained community psychiatric nurse, followed by referral to primary care. Measurements take place at 6, 12, and 18 months after baseline. This study evaluates both the effectiveness (on quality of life, symptom severity, and empowerment), and cost-effectiveness of the intervention compared to usual care. In addition, a questionnaire is designed to get insight in which self-management strategies patients use to manage their disorder, and in the experiences of patients with the change of care setting.

Discussion

In this study we evaluate the effectiveness and cost-effectiveness of a self-management intervention for patients with chronic and treatment resistant anxiety or depressive disorders in specialized outpatient mental health care. The results of this study may provide a first ‘proof-of-concept’ in this under-researched but important field, and might be relevant for a large group of patients in the context of a transition of the Dutch health care system.

Trial registration

Netherlands Trial Register: NTR3335, registered 7 March 2012.

Keywords: Anxiety, Depression, Chronic, Treatment resistant, Self-management, Randomized controlled trial, Specialized outpatient mental health care, Primary care

Background

Anxiety and depressive disorders are among the most common mental disorders both worldwide and in the Netherlands. International data (the Netherlands and other developed countries) of the lifetime prevalence of these disorders are similar to each other. According to results from NEMESIS-2 (Netherlands Mental Health Survey and Incidence Study-2), the lifetime prevalence of anxiety disorders is 19.6 %, and 18.7 % for major depressive disorder [1, 2]. Also in specialized outpatient mental health care, anxiety and depressive disorders are common: 22.2 % of outpatients have an anxiety disorder and 37.2 % a depressive disorder [2].

A substantial part of patients in specialized outpatient mental health care achieve no remission of their symptoms after treatment that is provided in accordance with the (inter-)national multidisciplinary guidelines [35]. Their disorder seems treatment-resistant [6] and they suffer from a chronic course, with an estimated 41.9 % chronicity for anxiety disorders and 24.5 % for depressive disorders [7]. While anxiety disorders may be considered as chronic disorders in itself [8], a depressive disorder is defined as chronic when a depressive episode lasts more than two years [9]. The comorbidity between anxiety and depressive disorders is high (33–54 %) [1012] and increases with a longer duration of symptoms. Comorbidity, in turn, increases the risk of treatment resistance and chronicity [13, 14]. Chronic and treatment resistant anxiety or depressive disorders are associated with more intense suffering, increased risk of suicide, and poorer social functioning [15, 16].

Care as usual (CAU) for patients with chronic and treatment resistant anxiety or depressive disorders usually consists of long-term supportive contacts with a key clinician, which is regularly a community psychiatric nurse, and pharmacological management by a psychiatrist. This CAU often has no clear purpose, and lacks treatment evaluation. Data on the effectiveness is lacking [17]. Nevertheless, termination of treatment is not considered to be an option due to the persistent symptoms, the level of suffering, and the absence of other treatment options. A psychosocial rehabilitation approach, focused on specific goals, could be more suitable [18, 19]. However, there is no research on feasibility and effectiveness of rehabilitation approaches for anxiety and depressive disorders in specialized outpatient mental health care.

In the development of such an approach for patients with chronic and treatment resistant anxiety or depressive disorders, self-management is an increasingly important element. Self-management for long-term health problems focuses on the restoration of functioning and enhancement of patients’ autonomy and responsibility. Self-management strategies are for instance: symptom management, enacting problem-solving strategies, and implementing learning plans [20]. We do not yet know much about the self-management strategies used by patients with chronic and treatment resistant anxiety or depressive disorders.

For patients with chronic and treatment resistant anxiety or depressive disorders in specialized outpatient mental health care the intervention, ZemCAD (English SemCAD; Self-management for Chronic Anxiety and Depression) was developed, in order to offer them a different perspective. This is also consistent with the transition of the Dutch health care system where the aim is to refer chronic patients to less intensive levels of care when possible. The focus in this study is on the transition from specialized outpatient mental health care to primary care. ZemCAD, the experimental treatment, offers treatment focused on rehabilitation and self-management, provided by a trained professional (a community psychiatric nurse, and in some cases a psychologist), followed by referral to primary care. Liaison consultation with specialized mental health care is an option if required. We compare the intervention to CAU.

The objectives of this study are:

  1. To assess the cost-effectiveness of ZemCAD compared to CAU

  2. To evaluate the effectiveness of ZemCAD compared to CAU with regard to quality of life, symptom severity, and empowerment

  3. To get insight in the self-management strategies that patients use to manage their anxiety or depressive disorder;

  4. To review the experiences of patients with a change of care setting.

Our hypothesis is that ZemCAD is more cost-effective than CAU. We expect that ZemCAD has outcomes just as good and not inferior to CAU with regard to quality of life, symptom reduction, and empowerment.

Methods/Design

Design

In a multicenter randomized controlled trial, with randomization at the level of patients in two parallel groups, the protocolized ZemCAD intervention versus care as usual is studied across twelve participating specialized outpatient mental health care services in the Netherlands. Assessments are at baseline, 6, 12 and 18 months and assessors are blind to randomization status.

Setting/Participants

The twelve participating specialized outpatient mental health care services offer outpatient treatment interventions for anxiety and depressive disorders, in accordance with the (inter)national multidisciplinary guidelines. For patients with chronic and treatment resistant anxiety or depressive disorders, prolonged treatment (supportive contacts with a community psychiatric nurse) is offered. The transition from specialized outpatient mental health care tot primary care is not considered to be an option due to the persistent symptoms.

Inclusion criteria for the study are:

  • ▪ patients with anxiety or depressive disorders according to DSM-IV;

  • ▪ >18 years;

  • ▪ > two years in specialized mental health care;

  • ▪ received at least one psychological treatment and at least three medication steps according to the national multidisciplinary guidelines on anxiety and depressive disorders [21];

  • ▪ regarded by their clinicians as treatment resistant, meaning that prolonged treatment in a specialized outpatient mental health service according to the professional is unlikely to improve clinical outcomes (e.g. achieve remission);

  • ▪ currently having supportive contacts with a community psychiatric nurse.

Exclusion criteria are:

  • ▪ life-threatening medical condition;

  • ▪ dementia;

  • ▪ psychotic disorder;

  • ▪ bipolar disorder;

  • ▪ alcohol or drugs dependence;

  • ▪ not fluent in Dutch language;

  • ▪ cognitive problems/indications for low IQ < 80.

Recruitment and randomization

Patients that are eligible for participating in the ZemCAD study according to the inclusion and exclusion criteria are asked to participate by their community psychiatric nurse. This nurse informs the patient about the study and provides an information letter to take home. If the patient is interested and consents to participate, the signed informed consent is sent to the coordinating research centre. To check the inclusion and exclusion criteria formally, the current DSM-IV disorders present in the patient were diagnosed with the Mini-International Neuropsychiatric Interview (MINI interview) in the mental health service that provides the treatment of the patient. The MINI is a well-validated semi-structured diagnostic interview used to establish psychiatric disorders according to the DSM-IV [22]. After inclusion, patients receive the baseline questionnaire. Patients and community psychiatric nurses are blind to the patient’s condition until they have completed the baseline questionnaire. Then the patient is allocated to ZemCAD or CAU, using a randomization schedule designed by an independent statistician. To evenly distribute ZemCAD/CAU across community psychiatric nurses, block randomization (block size of four) of patients is used. Questionnaires are completed over the internet. If a patient has no access to the internet, the questionnaires are completed on paper. Patients are informed that participation in the study is voluntary and that they can withdraw from the study at any time. An overview of the study design and patient flow is provided in Fig. 1.

Fig. 1.

Fig. 1

Study design and patient flow

Intervention

ZemCAD is based on an existing treatment protocol for patients with chronic depression, developed at the Amsterdam Academic Medical Center [23], adapted for patients with chronic and treatment resistant anxiety or depressive disorders [24]. During thirteen sessions over twenty-six weeks patients and their families are educated about the nature of their chronic disorder, about suicidality and crises, and they learn how to cope with these conditions and events. The trained professional and the patient make an action plan to re-establish social contacts and improve their daily living activities.

ZemCAD consists of three parts. The first part is an introduction phase of three weeks with weekly sessions. The goals for the professionals are to get acquainted with the patient and family, and explain the treatment. Patients make an individual treatment plan, identify symptoms and daily activities, keep a log of symptoms, and learn how they can accept lifestyle changes due to having a chronic disease. The second part is a coaching and treatment phase of fourteen weeks with sessions every second week. Patients start again engaging in social activities, they are stimulated to maintain a daily structure, and learn to use general problem solving skills to cope with their chronic disease. The third part is the final phase of nine weeks with sessions every three weeks. Topics are to make an action plan on how to deal with crisis situations and to further practice with earlier mentioned skills. Finally, patients are referred to primary care. Every primary care practice is asked to select a mental health professional who works in close collaboration with the general practitioner and actively monitors functioning of the patient. After referral to primary care, the general practitioner is responsible for the prescription of medication. Both mental health professional in primary care and general practitioner have easy access to specialized outpatient mental health services for liaison consultation if required.

Patients receiving ZemCAD are allocated to a new and trained professional. This clearly marks the transition from CAU to ZemCAD for both patient and professional. The training of the participating professionals in ZemCAD consists of a two-day course. A prerequisite is that the professionals study the intervention in advance. The two-day course is provided by an expert and trainer in cognitive behavioural therapy and motivational skills for anxiety and depressive disorders. The training combines self-study, lectures, assignments, and group discussions. During the study, three additional booster sessions were given. In addition, in each mental health service monthly booster sessions for the professionals were scheduled.

Usual care

Patients who are allocated to CAU continue to receive specialized outpatient mental health care, which usually consists of long-term supportive contacts with a community psychiatric nurse, and pharmacological management by a psychiatrist. In most cases patients continue care with their own community psychiatric nurse. Only if the patient allocated to CAU receives treatment from a community psychiatric nurse who is trained to provide the intervention, the patient needs to switch to a different (untrained) community psychiatric nurse. CAU may also involve termination of treatment in specialized outpatient mental health care and referral to primary care. In the ZemCAD intervention, however, this referral is planned and anticipated within the intervention, while in CAU the referral and termination of the treatment only occurs when indicated.

Treatment integrity

Patients who are allocated to CAU in most cases continue care with their current community psychiatric nurse. Since there is no clear treatment guideline for CAU, treatment integrity is not assessed in the control group. We do, however, monitor the number of contacts patients have with health care professionals. In the intervention group, treatment integrity is assessed for each participating patient using a checklist that the trained professional completes at the end of each treatment session. In this checklist the trained professional can indicate on which points the treatment differs from the ZemCAD protocol.

Measurements

At baseline demographics are measured. Measurements take place 6, 12, and 18 months after baseline. Quality of life is measured with the World Health Organization Quality of Life instrument, Brief version (WHOQOL-BREF) [25, 26]. The WHOQOL-BREF measures the overall quality of life in four different areas: physical health, psychological health, social relationships and environment. Anxiety symptoms are measured with the Beck Anxiety Inventory (BAI) [27], a validated self-rated questionnaire to assess the severity of anxiety symptoms. Depression severity is measured with the Patient Health Questionnaire (PHQ-9) [28, 29], a validated self-rated questionnaire to assess the severity of depression symptoms. Empowerment is assessed using the Dutch Empowerment Scale (Nederlandse Empowerment Vragenlijst) [30]. Contacts with health care professionals, medical costs, and productivity costs are measured with the Trimbos and Institute of Medical Technology Assessment questionnaire for costs associated with psychiatric illness (TiC-P) [31]. Using this self-completion questionnaire, direct and indirect costs of health care utilization of patients can be assessed. In addition, the EuroQoL (EQ-5D) [32] is used to compute Quality Adjusted Life Years (QALYs) gained, to be used in the cost-utility analysis.

To get insight in self-management strategies used by patients with chronic and treatment resistant anxiety or depressive disorders, and experiences of patients with a change of care setting, a questionnaire is designed. We do this by organizing focus groups, and use concept mapping [33] for processing the data. The questionnaire is administered during the ZemCAD trial, to all participants, in both conditions. An overview of measurements is provided in Table 1.

Table 1.

Overview of measurements

Baseline 6 months 12 months 18 months
Demographics x
Clinical depression/anxiety (MINI) x
Quality of life (WHOQOL-BREF) x x x x
Anxiety (BAI) x x x x
Depression (PHQ-9) x x x x
Empowerment (Dutch Empowerment Scale) x x x x
Health care costs (TiC-P) x x x x
Health care costs (EQ-5D) x x x x
Questionnaire about self-management strategies and experiences with a change of care setting x

Data handling

Each participant receives a code. This code is a unique number that is not based on personal information. The list linking participant code and personal information is kept in a separate file stored in a database with access limited to designated researchers and data managers. All our study-related information is stored in secure folders with limited access. Paper-based data collection forms only contain participant codes to maintain participant confidentiality and are stored in a locked cabinet in an area with limited access. Electronic data files are stored on a file system with access restricted to designated researchers and data managers. All results will be described in groups of participants and data will not be traced to a single person. Data will be stored for 5 years after the end of inclusion. The study has low to negligibly risks therefore no data monitoring committee is assigned. Only the designated researchers, or persons assigned by them, will have access to the final data set. Authors of the final manuscript have made substantial contributions to the design, conduction, interpretation and reporting of the trial. We will not use professional writers. Participants, funders and involved professionals will receive a summary of the study results. Final results will be presented via publications and presentations.

Sample size

The feasibility of our trial is evaluated in a pilot study, which was carried out within one of the participating mental health services. Based on the number of included patients in this pilot and the number of services participating, we expect to be able to include 130–180 patients in our trial. This is enough to detect a standardized mean difference of d ≥ 0.50 in a 2-tailed test at α = 0.05 and with a power of (1-β) = 0.80. However, we do not expect such large differences between the conditions on any of the outcomes. With regard to the hypotheses about the clinical effects we assume non-inferiority rather than superiority and with n = 130 the non-inferiority margin would be as large as d = 0.45 (one sided), which is uninformative. That said, our main hypothesis requires health-economic decision-making. In that context it is more customary to take a probabilistic medical decision-making approach and do not rely on statistical techniques to test hypotheses.

Statistical analysis

Descriptive statistics are used for presenting the demographics of the sample. All outcome analyses are conducted in agreement with the intention-to-treat (ITT) principle, as required by the CONSORT statement [34]. To that end, we use linear mixed-effects models. If differences in baseline data are present, we adjust for relevant baseline characteristics, by including baseline variables as covariates in the model. To see how effects develop over time we also model interactions of the treatment with time in the linear mixed-effects models. All analyses are conducted in SPSS 22 and Stata 13.1 or later versions.

Economic evaluation

The health economic evaluation is conducted in agreement with the CHEERS statement [35]. Healthcare utilization is measured and costs are calculated using standard unit prices (for the reference year 2014) published in the Dutch costing guideline [36]. In addition, data on (increased or decreased) productivity due to changes in the number of hours worked per week and accounting for absenteeism and presenteeism are valued using the mean per-capita gross income. The difference between ZemCAD and CAU in terms of health gains are expressed in QALYs, based on the EQ-5D. Non-parametric bootstrapping is used to estimate the uncertainty surrounding costs and effects. On that basis, probabilistic statements can be made about the likelihood that, relative to usual care, the new intervention (1) costs more and is associated with QALY gains, (2) costs more and is associated with QALY losses, (3) costs less and is associated with QALY losses, or (4) costs less and is associated with QALY gains. Obviously scenario 2 is the least attractive and in that case maintaining the old (current) health care system is the best option as seen from a (narrow) health-economics perspective, but always contingent on further medical-ethical considerations. In case of scenario 4 the new health care system is the best option as viewed from a health-economics perspective. However, we often end up in scenario 1: we pay more and get more QALYs. This could be an acceptable scenario, but raises the question how much we are willing to pay for the additional QALY gains. In such a scenario we therefore also consider a range of willingness-to-pay (WTP) ceilings while using the so-called acceptability curve, where the probability of cost-effectiveness is plotted against various WTP ceilings. The incremental cost-effectiveness ratios (ICER) acceptability curve helps in the decision whether ZemCAD should or should not be considered as cost-effective from a probabilistic medical decision-making perspective. The health-economic evaluation is completed with sensitivity analyses focusing on uncertainties in major cost-drivers, and is intended to show how robust the results of the cost-effectiveness analysis are under uncertainty. It is worth re-emphasising that in addition to health-economic considerations other considerations, such as medical-ethical considerations and patients’ preferences, ought to play a role in medical decision-making.

Discussion

This article describes a protocol for a multicenter randomized controlled trial on the effectiveness and cost-effectiveness of a self-management intervention for patients with chronic and treatment resistant anxiety or depressive disorders in specialized outpatient mental health care. In this study we evaluate the cost-effectiveness of ZemCAD compared to CAU. We also explore the effects of the ZemCAD intervention compared to CAU on quality of life, depressive and anxiety symptom severity, and empowerment. Furthermore we like to shed light on the self-management strategies that patients use to cope with their chronic and treatment resistant anxiety or depressive disorder, and experiences of patients with a change of care setting. Given the fact that there are hardly any evidence-based interventions for patients with these disorders, and the need to make cost-effective use of scarce resources, the results of this study may provide a first ‘proof-of-concept’ in this under-researched but important field. Moreover the results of this study might be relevant for a large group of patients in the context of a transition of the Dutch health care system. In this study we focus on the transition from specialized outpatient mental health care to primary care.

Abbreviations

BAI, Beck Anxiety Inventory; CAU, care as usual; EQ-5D, EuroQoL; ICER, incremental cost-effectiveness ratio; ITT, intention-to-treat; MINI interview, Mini-International Neuropsychiatric Interview; NEMESIS-2, Netherlands Mental Health Survey and Incidence Study-2; PHQ-9, Patient Health Questionnaire; QALYs, Quality Adjusted Life Years; TiC-P, Trimbos/iMTA questionnaire for Costs associated with Psychiatric illness; WHOQOL-BREF, World Health Organization Quality of Life instrument Brief version; WTP, willingness-to-pay; ZemCAD (English SemCAD), Self-management for Chronic Anxiety and Depression

Acknowledgements

We would like to thank the Trimbos Institute for being the coordinating research centre in this study, and we thank the employees that were involved in parts of the study. We gratefully acknowledge the participating secondary mental health services: AMC Department of Psychiatry, GGZ inGeest, GGZ Breburg, Altrecht, Vincent van Gogh, GGZ Centraal, GGZ Friesland, PsyQ Maastricht, GGZ Drenthe, Yulius, and GGZ Noord-Holland-Noord. In particular we would like to thank Pro Persona for developing the treatment protocol which is examined in this study. Last but not least, we thank all the professionals and patients participating in this study.

Funding

The study is funded by the Healthcare Insurers Innovation Foundation (Dutch: Innovatiefonds Zorgverzekeraars). The funder is not involved in the design of the study and collection, analyses, and interpretation of data and in writing the manuscript.

Availability of data and materials

Not applicable.

Authors’ contributions

MZ made contributions to part of the design and drafted the manuscript. BK helped to draft the manuscript. HS participated in the conception and design of the study, and is co-leader of the study. AM, AvB, and AS participated in the conception and design of the study. FS supported planning of the (economic) analyses. JS participated in the conception and design of the study, obtained funding, helped drafting the manuscript, developed the treatment protocol, and leads the study. BK, AvB, AS, FS and JS supervise the study. All authors commented and contributed to successive drafts, and read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This study is approved by the Institutional Review Board of the University Medical Center Utrecht (NL33674.097.10, registration number 10.218) for all participating sites, and is conducted according to the principles of the Declaration of Helsinki (version 2008) and in accordance with the Dutch Medical Research Involving Human Subjects Act (WMO) and other relevant guidelines, regulations and acts.

Contributor Information

Maringa H. H. Zoun, Email: m.zoun@propersona.nl

Bauke Koekkoek, Email: bauke.koekkoek@han.nl.

Henny Sinnema, Email: hsinnema@trimbos.nl.

Anna D. T. Muntingh, Email: a.muntingh@ggzingeest.nl

Anton J. L. M. van Balkom, Email: t.balkom@ggzingeest.nl

Aart H. Schene, Email: aart.schene@radboudumc.nl

Filip Smit, Email: fsmit@trimbos.nl.

Jan Spijker, Email: j.spijker@propersona.nl.

References

  • 1.Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry. 2005;62:593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
  • 2.de Graaf R, ten Have M, van Gool C, van Dorsselaer S. Prevalence of mental disorders and trends from 1996 to 2009. Results from the Netherlands Mental Health Survey and Incidence Study-2. Soc Psychiatry Psychiatr Epidemiol. 2012;47(2):203–13. doi: 10.1007/s00127-010-0334-8. [DOI] [PubMed] [Google Scholar]
  • 3.CBO & Trimbos-instituut . Multidisciplinaire richtlijn depressie. Utrecht: Trimbos-insituut; 2005. [Google Scholar]
  • 4.Landelijke Stuurgroep Multidisciplinaire Richtlijnontwikkeling in de GGZ . Multidisciplinaire richtlijn angststoornissen. Utrecht: Trimbos-instituut; 2003. [Google Scholar]
  • 5.van Dijk MK, Oosterbaan DB, Verbraak MJ, Hoogendoorn AW, Penninx BW, van Balkom AJ. Effectiveness of the implementation of guidelines for anxiety disorders in specialized mental health care. Acta Psychiatr Scand. 2015;132(1):69–80. doi: 10.1111/acps.12338. [DOI] [PubMed] [Google Scholar]
  • 6.Rush AJ, Laux G, Giles DE, Jarrett RB, Weissenburger J, Feldman-Koffler F, Stone L. Clinical characteristics of outpatients with chronic major depression. J Affect Disord. 1995;34:25–32. doi: 10.1016/0165-0327(94)00101-E. [DOI] [PubMed] [Google Scholar]
  • 7.Penninx BWJH, Nolen WA, Lamers F, Zitman FG, Smit JH, Spinhoven P, Cuijpers P, de Jong PJ, van Marwijk HWJ, van der Meer K, Verhaak P, Laurant MGH, de Graaf R, Hoogendijk WJ, van der Wee N, Ormel J, van Dyck R, Beekman ATF. Two-year course of depressive and anxiety disorders: results from the Netherlands Study of Depression and Anxiety (NESDA) J Affect Disord. 2011;13(1–2):76–85. doi: 10.1016/j.jad.2011.03.027. [DOI] [PubMed] [Google Scholar]
  • 8.Bruce SE, Yonkers KA, Otto MW, Eisen JL, Weisberg RB, Pagano M, Shea MT, Keller MB. Influence of psychiatric comorbidity on recovery and recurrence in generalized anxiety disorder, social phobia, and panic disorder: a 12-year prospective study. Am J Psychiatry. 2005;162:1179–87. doi: 10.1176/appi.ajp.162.6.1179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.American Psychiatric Association . Diagnostic and statistical manual of mental disorders, fourth edition (DSM-IV) Washington, DC: American Psychiatric Publishing; 2001. [Google Scholar]
  • 10.de Graaf R, Bijl RV, Smit F, Vollebergh WA, Spijker J. Risk factors for 12-month comorbidity of mood, anxiety, and substance use disorders: findings from the Netherlands Mental Health Survey and Incidence Study. Am J Psychiatry. 2002;159:620–9. doi: 10.1176/appi.ajp.159.4.620. [DOI] [PubMed] [Google Scholar]
  • 11.Klein Hofmeijer-Sevink MK, Batelaan NM, van Megen HJ, Penninx BW, Cath DC, van den Hout MA, van Balkom AJ. Clinical relevance of comorbidity in anxiety disorders: a report from the Netherlands Study of Depression and Anxiety (NESDA) J Affect Disord. 2012;137(1–3):106–12. doi: 10.1016/j.jad.2011.12.008. [DOI] [PubMed] [Google Scholar]
  • 12.Klein Hofmeijer-Sevink M, van Oppen P, van Megen HJ, Batelaan NM, Cath DC, van der Wee NJ, van den Hout MA, van Balkom AJ. Clinical relevance of comorbidity in obsessive compulsive disorder: The Netherlands OCD Association study. J Affect Disord. 2013;150(3):847–54. doi: 10.1016/j.jad.2013.03.014. [DOI] [PubMed] [Google Scholar]
  • 13.Merikangas KR, Zhang H, Avenevoli S, Acharyya S, Neuenschwander M, Angst J. Longitudinal trajectories of depression and anxiety in a prospective community study: the Zurich Cohort Study. Arch Gen Psychiatry. 2003;60:993–1000. doi: 10.1001/archpsyc.60.9.993. [DOI] [PubMed] [Google Scholar]
  • 14.Visser HA, van Oppen P, van Megen HJ, Eikelenboom M, van Balkom AJ. Obsessive-compulsive disorder; chronic versus non-chronic symptoms. J Affect Disord. 2014;152–154:169–74. doi: 10.1016/j.jad.2013.09.004. [DOI] [PubMed] [Google Scholar]
  • 15.Polder JJ, Takken J, Meerding WJ, Kommer GJ, Stokx LJ. Kosten van ziekten in Nederland. Bilthoven: Rijksinstituut voor Volksgezondheid en Milieu; 2010. [Google Scholar]
  • 16.Ustun TB, Ayuso-Mateos JL, Chatterji S, Mathers C, Murray CJ. Global burden of depressive disorders in the year 2000. Br J Psychiatry. 2004;184:386–92. doi: 10.1192/bjp.184.5.386. [DOI] [PubMed] [Google Scholar]
  • 17.Koekkoek B, Quintus A, Tiemens B, van Boeijen C, Spijker J. Langdurige begeleiding door sociaal-psychiatrisch verpleegkundigen bij angst en depressie. Is afwijken van de richtlijn onzin of noodzaak? Maandblad Geestelijke volksgezondheid. 2008;63:496–504. [Google Scholar]
  • 18.Koekkoek B, van Meijel B, Schene A, Hutschemaekers G. Clinical problems in the long-term care of patients with chronic depression. J Adv Nurs. 2008;62:689–97. doi: 10.1111/j.1365-2648.2008.04645.x. [DOI] [PubMed] [Google Scholar]
  • 19.Michon HW, ten Have M, Kroon H, van Weeghel J, de Graaf R, Schene AH. Mental disorders and personality traits as determinants of impaired work functioning. Psychol Med. 2008;38:1627–37. doi: 10.1017/S0033291707002449. [DOI] [PubMed] [Google Scholar]
  • 20.Keitner GI, Ryan CE, Solomon DA. Realistic expectations and a disease management model for depressed patients with persistent symptoms. J Clin Psychiatry. 2006;67:1412–21. doi: 10.4088/JCP.v67n0912. [DOI] [PubMed] [Google Scholar]
  • 21.Ruhé HG, van Rooijen G, Spijker J, Peeters FPML, Schene AH. Staging methods for treatment resistant depression. A systematic review. J Affect Disord. 2012;137:35–45. doi: 10.1016/j.jad.2011.02.020. [DOI] [PubMed] [Google Scholar]
  • 22.van Vliet IM, Leroy H, van Megen HJM. De MINI-Internationaal neuropsychiatrisch interview: een kort gestructureerd diagnostisch interview voor DSM-IV en ICD-10 psychiatrische stoornissen. Leiden: LUMC; 2000. [PubMed] [Google Scholar]
  • 23.Delfgaauw PG. Rehabilitatie bij depressie. Amsterdam: Academisch Medisch Centrum; 2005. [Google Scholar]
  • 24.Exterkate CC, Spijker J. Rehabilitatie bij angst en depressie. Een cursus voor cliënten met chronische en therapieresistente angst en depressie. Arnhem: Pro Persona; 2010. [Google Scholar]
  • 25.Skevington SM, Lotfy M, O’Connell KA. The World Health Organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Qual Life Res. 2004;13:299–310. doi: 10.1023/B:QURE.0000018486.91360.00. [DOI] [PubMed] [Google Scholar]
  • 26.The WHOQOL Group Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychol Med. 1998;28:551–8. doi: 10.1017/S0033291798006667. [DOI] [PubMed] [Google Scholar]
  • 27.Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol. 1988;56:893–7. doi: 10.1037/0022-006X.56.6.893. [DOI] [PubMed] [Google Scholar]
  • 28.Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Spitzer R, Kroenke K, Williams J. Validation and utility of a self-report Version of PRIME-MD: the PHQ Primary Care Study. JAMA. 1999;282:1737–44. doi: 10.1001/jama.282.18.1737. [DOI] [PubMed] [Google Scholar]
  • 30.Boevink W, Kroon H, Giesen F. De Nederlandse Empowerment Vragenlijst. Utrecht: Trimbos instituut; 2009. [Google Scholar]
  • 31.Hakkaart-van Roijen L, van Straten A, Donker M, Tiemens B. Handleiding Trimbos/iMTA questionnaire for Costs associated with Psychiatric illness (TiC-P) Rotterdam: Erasmus University; 2002. [Google Scholar]
  • 32.Euroqol group . EQ-5D user guide. Rotterdam: Sanders instituut; 1995. [Google Scholar]
  • 33.Kane M, Trochim MK. Concept mapping for planning and evaluation. London: Sage publications; 2007. [Google Scholar]
  • 34.Schulz KF, Altman DG, Moher D, the CONSORT Group CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010;11:32. doi: 10.1186/1745-6215-11-32. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs AH, Mauskopf J, Loder E, the CHEERS Task Force Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. BMC Med. 2013;11:80. doi: 10.1186/1741-7015-11-80. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Hakkaart-van Roijen L, Van der Linden N, Bouwmans C, Kanters T, Tan SS. Kostenhandleiding: Methodologie van kostenonderzoek en referentieprijzen voor economische evaluaties in de gezondheidszorg (geactualiseerde versie 2015). In opdracht van Zorginstituut Nederland; 2015.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.


Articles from BMC Psychiatry are provided here courtesy of BMC

RESOURCES