Abstract
Introduction
Major depressive disorder (MDD) affects 163 million people globally every year. Individuals who experience subsyndromal depressive symptoms during remission (ie, partial remission of MDD) are especially at risk for a return to a depressive episode within an average of 4 months. Simultaneously, partial remission of MDD is associated with work and (psycho)social impairment and a lower quality of life. Brief psychological interventions such as preventive cognitive therapy (PCT) can reduce depressive symptoms or relapse for patients in partial remission, although achieving full remission with treatment is still a clinical challenge. Treatment might be more effective if cognitive functioning of patients is targeted as well since cognitive problems are the most persisting symptom in partial remission and predict poor treatment response and worse functioning. Studies show that cognitive functioning of patients with (remitted) MDD can be improved by online neurocognitive remediation therapy (oNCRT). Augmenting oNCRT to PCT might improve treatment effects for these patients by strengthening their cognitive functioning alongside a psychological intervention.
Methods and analysis
This study will examine the effectiveness of augmenting oNCRT to PCT in a pragmatic national multicentre superiority randomised controlled trial. We will include 115 adults partially remitted from MDD with subsyndromal depressive symptoms defined as a Hamilton Depression Rating Scale score between 8 and 15. Participants will be randomly allocated to PCT with oNCRT, or PCT only. Primary outcome measure is the effect on depressive symptomatology over 1 year. Secondary outcomes include time to relapse, cognitive functioning, quality of life and healthcare costs. This first dual approach study of augmenting oNCRT to PCT might facilitate full remission in partially remitted individuals as well as prevent relapse over time.
Ethics and dissemination
Ethical approval was obtained by Academic Medical Center, Amsterdam. Outcomes will be made publicly available.
Trial registration number
NL9582.
Keywords: adult psychiatry, depression & mood disorders, psychiatry
Strengths and limitations of this study.
Strengths are the national, pragmatic, multicentre, superiority randomised controlled trial design, with measurements focusing on various levels of patient functioning, where the outcome assessors are blinded to treatment allocation of the participants.
In our multimodal approach, we provide the patients who are partially remitted from a major depressive episode with preventive cognitive therapy with online neurocognitive remediation therapy, or only preventive cognitive therapy.
A limitation is that the study is single blinded and focuses on a specific group of patients.
Introduction
Major depressive disorder (MDD) affects 163 million people globally every year.1 Approximately 28%–47% of patients treated with pharmacotherapy and 18%–45% of patients treated with psychotherapy and/or pharmacotherapy achieve no more than partial remission of MDD.2–11 Approximately 16%–24% of these patients spend a substantial amount of time in partial remission, ranging from 5 to 10 years following the index depressive episode.12 13 Partial remission has been defined as a period of improvement during which a patient no longer meets criteria for MDD yet continues to experience symptoms.14–18 In line with this consensus statement, we define partial remission as the presence of subsyndromal depressive symptoms during the remission phase of MDD with a Hamilton Depression Rating Scale (HAM-D) score in the range of 8–15.
Partial remission is associated with a high risk of relapse (76% experience a relapse within 15 months) as well as a fast return of the full episode, as the depressive episode returns on average within 3.7 months in the year following partial remission.10 Aside from the symptoms and risks, partial remission is associated with impairment in work as well as (psycho)social impairment,4 19 20 and lower quality of life.4 21 The most persisting symptoms reported by patients in partial remission are cognitive problems.22 23 Cognitive problems are present in 46% of patients in partial remission and 44% of the time22 24 and might therefore be a target for novel treatments. Taken together, partial remission of MDD has a considerable impact on a person’s life, which underscores the need for innovative strategies that tackle partial remission in MDD.
To treat partial remission, current guidelines recommend continuing, switch or add antidepressants, to switch to (another) psychotherapy, or to combine antidepressants with psychotherapy.25 26 Previous randomised controlled trials (RCTs), including a variety of definitions of partial remission, demonstrated that cognitive–behavioural therapy (CBT),27 mindfulness-based cognitive therapy (n=460)28 and potentially rumination-focused CBT (n=60; n=42)29 30 can further reduce depressive symptoms for patients in partial remission from MDD. CBT for this patient group improved psychological functioning as well as social functioning.31 Alongside the effect on depressive symptoms, these treatments decreased relapse risk27 29 32 and internet-based CBT increased time to relapse (n=84).33 Furthermore, preventive cognitive therapy (PCT) has been shown to reduce depressive symptomatology34–38 and relapse risk for up to 5.5–10 years in studies that included patients with partially and fully remitted MDD (HAM-D score below 10 or 14).34–36 39–42
Interestingly, most psychological treatments do not focus on improving cognitive functioning, whereas cognitive problems are the most persistent symptoms in partial remission.22 24 Deficits in cognitive functioning are present during the acute phase of MDD and often remain during remission,43–46 and predict poor treatment response and worse functioning.47–49 These deficits in emotion-independent information processing are also referred to as ‘cold cognition’ deficits.50 Rather than focusing on deficits in cold cognition, psychological treatments for partial remission address so-called ‘hot cognitions’, defined as emotion-dependent thinking (eg, self-schemata).50 51 Targeting cold cognition (ie, improving cognitive functioning) alongside hot cognition in a combined treatment might facilitate full remission in individuals with partial remission.
Available evidence-based treatments for cold cognition include neurocognitive remediation therapy (NCRT), which involves exercises to train cognitive functions. Recent meta-analyses demonstrated that NCRT enhances attention, processing speed, executive functioning, working memory and verbal memory in (remitted) depressed patients.52–56 For patients in partial remission specifically, NCRT improved attention.57 NCRT also decreased depressive symptomatology in patients with (remitted) MDD,52 54–56 although the robustness of the effect on depressive symptomatology is questionable as the beneficial effect disappeared when only high-quality studies were included.52 Despite these inconsistent effects on depressive symptomatology, beneficial effects of NCRT on cognitive functioning (ie, cold cognition) throughout several stages of MDD have been demonstrated.
Previous studies show that NCRT may enhance the effect of psychotherapy that targets hot cognitions.58 Targeting cold cognition with NCRT augmented to targeting hot cognitions using PCT might promote full remission for patients in partial remission. Therefore, in a nationwide pragmatic multicentre superiority RCT, we will compare PCT with online NCRT (oNCRT) to PCT alone (1:1 allocation) to assess if augmenting oNCRT to PCT further reduces depressive symptoms in partially remitted depressed patients over 1 year. We hypothesise that over a period of 1 year, augmentation of oNCRT to PCT further reduces depressive symptoms, reduces the risk of relapse and time to relapse, strengthens cognitive functioning, increases overall quality of life and decreases healthcare costs.
Methods and analysis
The HERSTEL (Dutch for ‘recovery’) study is funded by the Dutch Brain Foundation (Hersenstichting). The study has been approved by the Medical Research Ethics Committee of the Academic Medical Center, Amsterdam.
Study design
This study is a national pragmatic multicentre superiority RCT with a 1:1 parallel group design. In total, 115 partially remitted depressed adults will be randomised to adding oNCRT to PCT (PCT+ group) or PCT alone (PCT− group). Both groups will be assessed monthly up to 1 year after baseline assessment. Total duration of participation in the study is 12 months. Allocation of participants is concealed for study assessors to ascertain independent assessments. An overview of the study design is provided in figure 1.
Figure 1.

Study flow chart. ECT, Electroconvulsive Therapy; HAM-D, Hamilton Depression Rating Scale; IDS-SR, Inventory of Depression Symptomatology Self-Report; oNCRT, online neurocognitive remediation therapy; PCT, preventive cognitive therapy; SCID-5-S, Structured Clinical Interview for DSM-5 Disorders.
Participants
Recruitment
Participants will be recruited in participating mental healthcare centres and hospitals across the Netherlands, and through advertisements, (social) media and websites. A full list of participating centres is available on request.
Inclusion and exclusion criteria
Eligible patients must fulfil the following criteria at randomisation: (1) are currently in remission from MDD according to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5)59 for at least 8 weeks and no longer than 2 years, as assessed with the Structured Clinical Interview for DSM-5 Disorders (SCID-5-S);60 (2) have HAM-D61 scores of ≥8 and ≤15; (3) are aged 18 years or older; and (4) speak Dutch or English. Exclusion criteria are current (hypo)mania or a history of bipolar illness, any psychotic disorder, substance misuse, primary anxiety disorder diagnosis, electroconvulsive therapy in the previous 12 months, neurological disorder, or a disabling sensory and/or motor deficit. Patients must provide written informed consent before the study procedures occur.
Informed consent and assessment of eligibility
Patients who either declare interest in the study or are referred by a healthcare provider will first be informed about the study by one of the researchers. Patients who are interested in the study will receive an information letter and an informed consent form. After informed consent is obtained, patients will be screened for inclusion and exclusion criteria using the SCID-5-S, HAM-D and additional questions regarding age, language, current and previous treatments of DSM-5 disorders and neurological disorders. The screening results will be discussed with an experienced mental health professional to decide if a participant is eligible. Eligible participants will continue with a baseline assessment, consisting of various questionnaires and neuropsychological tests. See table 1 and ‘outcomes’ for an overview of all assessments. On completion of the baseline assessment, participants will be randomised.
Table 1.
Overview of schedule of enrolment, interventions and assessments
| Time point | Description | Entry | Baseline | Study period | |||||||||||
| Postallocation | Last assessment | ||||||||||||||
| T-1 | T0 | T1 | T2 | T3 | T4 | T5 | T6 | T7 | T8 | T9 | T10 | T11 | T12 | ||
| Enrolment | |||||||||||||||
| Eligibility screen | X | ||||||||||||||
| Informed consent | Before T-1 assessments | X | |||||||||||||
| Allocation | Randomisation after baseline assessments | X | |||||||||||||
| Interventions | |||||||||||||||
| PCT+oNCRT |
|
||||||||||||||
| PCT alone |
|
||||||||||||||
| Assessments | |||||||||||||||
| Clinical interviews | X | ||||||||||||||
| SCID-5-S | DSM-5 disorders | X | X | ||||||||||||
| HAM-D | Depressive symptoms | X | X | X | |||||||||||
| Patient characteristics and psychiatric history | X | X | |||||||||||||
| Self-reports | |||||||||||||||
| IDS-SR | X | X | X | X | X | X | X | X | X | X | X | X | X | ||
| EPCL | X | X | X | X | X | ||||||||||
| DAS | X | X | X | X | X | ||||||||||
| CTQ | X | ||||||||||||||
| TiC-P | X | X | X | X | X | ||||||||||
| EQ-5D-5L | X | X | X | X | X | ||||||||||
| WHODAS 2.0 | X | X | X | X | X | ||||||||||
| PANAS | X | X | X | X | X | ||||||||||
| Neuropsychological tests | |||||||||||||||
| TOMM | X | X | |||||||||||||
| Wordlist Learning | X | X | |||||||||||||
| Place the Beads | X | X | |||||||||||||
| Connect the Dots I and II | X | X | |||||||||||||
| Digit Sequences I and II | X | X | |||||||||||||
| Stroop Color-Word Interference Test | X | X | |||||||||||||
| Computer skills | X | X | |||||||||||||
| Adherence | |||||||||||||||
| PCT | X | X | X | ||||||||||||
| oNCRT | X | X | X | ||||||||||||
All assessments will be conducted online. T0=baseline, T1=1 month, T2=directly post-treatment (8 weeks), T3–T11=3–11 months, T12=1 year follow-up.
CTQ, Childhood Trauma Questionnaire; DAS, Dysfunctional Attitude Scale; DSM-5, Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition; EPCL, Everyday Problem Checklist; EQ-5D-5L, 5-Level version of EuroQol-5 Dimension (EuroQol Group 5 dimensions questionnaire for health-related quality of life); HAM-D, Hamilton Depression Rating Scale; IDS-SR, Inventory of Depression Symptomatology Self-Report; oNCRT, online neurocognitive remediation therapy; PANAS, Positive and Negative Affect Scale; PCT, preventive cognitive therapy; SCID-5-S, Structured Clinical Interview for DSM-5 Disorders; TiC-P, questionnaire on healthcare utilisation and productivity losses in patients with a psychiatric disorder; TOMM, Test of Memory Malingering; WHODAS, WHO Disability Assessment Schedule.
Randomisation
In total, 115 participants will be randomised with a 1:1 allocation ratio to PCT with oNCRT (PCT+) or PCT alone (PCT). To that end, an independent researcher will use a computer-generated block randomisation scheme with randomly varying block size (eg, 2, 3 or 4), stratified for number of previous depressive episodes (1 vs ≥2). After randomisation, the participants will be informed by one of the coordinating researchers on their treatment allocation. Allocation of participants is concealed for the outcome assessors. Participants are requested not to share treatment allocation with the outcome assessor. If the blinding is violated, this will be registered.
Interventions
Preventive cognitive therapy
All participants will receive PCT, which consists of eight weekly individual PCT sessions. PCT is an adapted form of cognitive therapy that was developed to prevent relapse in patients with remitted MDD and with recurrent MDD.62 During PCT, patients identify and evaluate presumed vulnerability factors of MDD recurrence (ie, dysfunctional beliefs).63 Furthermore, patient’s autobiographical memory and retrieval of positive experiences is trained in PCT. In addition, patients create a tailored relapse prevention plan. A recent RCT (n=195) showed that PCT is effective in patients with partial remission.36 PCT was also evaluated in several RCTs which demonstrated that PCT reduces the risk of relapse over 12 months up to 10 years.34–36 38–40 42 64–66
PCT will be delivered via a videoconferencing programme by trained and licensed healthcare and clinical psychologists at one of the participating centres. Treatment delivered via videoconferencing yields similar results as face-to-face treatment,67 and a previous study demonstrated that using a videoconferencing programme for PCT is feasible.37 Therapists who deliver PCT will follow a 1-day training in PCT and subsequent monthly group supervision. To assess adherence to the PCT protocol, therapists will be asked to complete a checklist after every PCT session, and the number of sessions attended by the participants will be noted.
Neurocognitive remediation therapy
Participants assigned to the PCT+ group will receive oNCRT alongside PCT during the same 8-week period as the PCT. oNCRT is provided by CogniFit and targets cognitive abilities that are often diminished in patients with MDD (ie, (working) memory, executive functioning (task shifting) and attention (divided attention, inhibition and updating)).68 Engaging game-like cognitive exercises are played to strengthen these cognitive abilities. The difficulty level of the exercises adjusts to the participant’s performance level. Participants will play three sessions of these exercises per week, with a duration of 45 min per session, over a period of 8 weeks. oNCRT is delivered as an online programme that can be accessed at home at the participant’s own computer. We will register the number of sessions completed to assess adherence.
Concomitant care
Psychiatric medication or any other medication is allowed during the entire study if necessary, which is in line with the pragmatic nature of the trial. However, patients and healthcare providers will be asked not to change or switch medication during the trial. Medication use and potential changes will be recorded.
Withdrawal
Participants can withdraw from the treatment or from the study at any time without consequences. The investigator can decide to withdraw a subject from the study for urgent medical reasons. Participants who withdraw from treatment are asked if they are willing to complete the remaining assessments.
Outcome measures and timeline
Data will be collected at baseline, post-treatment and at several time points over 1 year (see figure 1 and table 1 for an overview). To proceed with the study and comply with (potential) COVID-19 restrictions, all assessments are completed without any face-to-face contact (eg, assessments via secured online videoconferencing, telephone calls, online questionnaires). The outcome assessors will be blinded to treatment allocation.
Primary outcome
The primary outcome measure is change in depressive symptomatology as assessed monthly with the Inventory of Depression Symptomatology Self-Report (IDS-SR) over a 1-year follow-up period.69 See table 1 for an overview of all assessments.
Secondary outcomes
Time-related proportion of relapse/recurrence within a year will be examined with the SCID-5-S.60 The SCID-5-S will be administered at baseline (T-1) and 1-year follow-up (T12). The HAM-D will be administered at baseline (T-1), post-treatment (T2) and 1-year follow-up (T12) to assess clinician-rated depressive symptoms.70
At baseline (T0) and post-treatment (T2), cognitive functioning will be assessed with tests from the Amsterdam Cognition Scan (ACS)71 and PowerPoint presentations via a secured online videoconferencing assessment. The following neuropsychological tests from the ACS are included: Wordlist Learning, Delayed Recall and Recognition to assess verbal learning; Connect the Dots II to measure mental flexibility (inhibition and set-shifting ability); Digit Sequences I and II for verbal working memory; Place the Beads and Connect the Dots I to assess planning and processing speed. Using a videoconferencing meeting, the Stroop Color-Word Interference Test will be used to test mental flexibility, and the Test of Memory Malingering72 to assess malingering. Online cognitive functioning assessment can be an alternative to traditional pen-and-paper tests that yield similar results.71 73 74
Participants will be asked to complete the online questionnaires every 3 months during the 1-year study period (T0, T3, T6, T9, T12) to assess among others quality of life and healthcare costs. The following questionnaires are included: health-related quality of life as measured with the 5-Level version of EuroQol-5 Dimension,75 positive and negative affects measured with the Positive and Negative Affect Scale,76 dysfunctional attitudes assessed with the Dysfunctional Attitude Scale,77 daily hassles using the Everyday Problem Checklist,78 disability with the WHO Disability Assessment Schedule 2.079 and healthcare and associated costs and costs from productivity loss measured using the Treatment Inventory of Costs in Psychiatric Patients (TIC-P).80
Additional outcomes
At baseline, we will furthermore assess sociodemographic and participant characteristics, including age, gender, socioeconomic status and psychiatric history. At baseline, childhood trauma will be measured as well using the Childhood Trauma Questionnaire, a self-report 28-item questionnaire that measures five types of maltreatment: emotional, physical, and sexual abuse, and emotional and physical neglect.81
Sample size
A power analysis based on a linear mixed (fixed and random) effects model analysis (intraindividual r=0.5)82 indicated that a sample size of 92 is needed to detect a moderate (Cohen’s d: 0.5) effect size on the primary outcome with 90% power and using a two-sided 5% significance level. To account for an expected 20% dropout, 115 participants will be included.
Statistical analysis
Our primary hypothesis is that PCT with oNCRT will lead to a larger decrease in depressive symptoms (measured with the IDS-SR) over the course of 1 year, as compared with PCT alone.
The secondary hypotheses are that, compared with PCT alone, PCT plus oNCRT will lead to: longer time to depressive relapse; improved neuropsychological functioning; higher self-reported health-related quality of life; less self-reported disability; lower healthcare and associated costs and costs from productivity loss; changes in positive and negative affects, dysfunctional attitudes and stress.
The primary analyses will be intention to treat, that is, participants will be analysed according to their randomised allocation, regardless of the actual treatment and time in the study after baseline. Secondary analyses will be per protocol, defined as at least six PCT sessions and 6 weeks of oNCRT (in case of PCT+oNCRT allocation).
The effect of PCT+ relative to PCT− will be estimated using linear mixed models for fixed (treatment) and random effects (for patient, and possibly for centre) for all continuously distributed outcome variables. Continuous measures that are measured once, for instance, results of neuropsychological tests, will be compared using unpaired t-tests. Categorical outcomes will be tested with χ2 tests. Time to depressive relapse (as measured by the SCID-5-S) will be graphically analysed using the Kaplan-Meier method and the curves will be statistically compared between the randomised groups using the log rank test. To obtain an HR as a measure of effect size for the time to relapse outcome we will construct a Cox proportions hazards model to enable adjustment in the analyses of time to relapse. Prior to performing Cox regression, we will check the proportional hazards assumption graphically by creating log minus log plots.
In each analysis, adjustment will be performed for the stratification variable. If despite randomisation other prognostically important factors differ between the groups, they will be adjusted for in supplemental analyses. This will be done by adding them as covariates to the linear mixed models and the Cox regression model. Results are considered statistically significant at a two-sided significance level of alpha <0.05.
To deal with missing data, we will perform multiple imputation (MI) to avoid potential bias and decreased statistical power associated with complete case analysis. MI will be done by chained equations under the assumption that missing values were missing at random or missing completely at random. The missing data mechanism will be studied to as much as possible substantiate these assumptions. The amount of missing data and reasons for non-participation or non-response will be reported and a complete case analysis will be added as a sensitivity analysis.
Ethics and dissemination
The study was approved by the Medical Research Ethics Committee of the Academic Medical Center, Amsterdam, before study onset (protocol ID: NL74547.018.20, trial register: https://www.trialregister.nl/trial/9582 (URL). Registered on 9 July 2021). The procedures listed above are in accordance with the Declaration of Helsinki. All participants will be informed about the study and will consent with participation before assessments. Only staff members (eg, clinical interns, clerical personnel) authorised by the principal investigators, monitoring agency of the AMC and the Health and Youth Care Inspectorate will be allowed access to the data. Data will be shared anonymised with other researchers on reasonable request and after a data sharing agreement has been signed. The (anonymised) results of the study will be shared with the participating centres. The results will be presented on seminars and published in peer-reviewed journals.
Discussion
Partial remission of MDD is prevalent,4 5 8–11 83 and is associated with a fast return to the full depressive episode,10 a high risk of relapse,17 18 work and (psycho)social impairment4 19 20 and lower quality of life.4 21 This considerable burden highlights the importance of effective treatment for partial remission. Brief psychological interventions, including PCT, seem to reduce depressive symptoms and relapse.29 30 32 34–40 42 64 66 However, achieving full remission is still a clinical challenge. Treatment might be more effective if cognitive functioning of patients is targeted as well since cognitive deficits are present in (remitted and partially remitted) MDD43 45 46 84 and predict poor treatment response and worse functioning.47–49 Cognitive functioning of patients with (remitted) MDD can be improved by NCRT.52–56 Therefore, this study will examine the effectiveness of a multimodal approach, that is, adding oNCRT to PCT in a pragmatic RCT. To our knowledge, the current study is the first to assess if augmenting oNCRT to PCT further reduces depressive symptoms in partially remitted depressed patients. Our approach could provide an effective multimodal treatment for partially remitted individuals, for which currently few evidence-based treatments are available.
Supplementary Material
Footnotes
Contributors: CB, HB, GJG, MB, AML and MS were responsible for the funding. CB is the principal investigator and wrote the draft of the manuscript with JGJvdS and MB. MB and CB were responsible for the coordination of the project. CB designed the PCT intervention. MB, JGJvdS and AML were responsible for data collection, inclusion of participants, monitoring of the study and continued ethical approval. CB, AML, JGJvdS, GJG, MS, HB, IOB, NL, DAJPD and MB were involved in the design and ethical approval of the study. NL was involved in the patient perspective of the study. CB, AML, JGJvdS, GJG, MS, HB, IOB, NL, DAJPD and MB read, commented and approved the final manuscript.
Funding: This work is supported by the Dutch Brain Foundation (Hersenstichting). The grant was provided funding to CB (principal investigator), Professor of Clinical Psychology at the Department of Psychiatry, Amsterdam University Medical Centres, Academic Medical Center (project number: DR-2019-00321).
Disclaimer: This funding source had no role in the design of this study and will not have any role during its execution, analyses, interpretation of the data or decision to submit the results.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review: Not commissioned; externally peer reviewed.
Ethics statements
Patient consent for publication
Not required.
References
- 1.GBD 2017 Disease and Injury Incidence and Prevalence Collaborators . Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990-2017: a systematic analysis for the global burden of disease study 2017. Lancet 2018;392:1789–858. 10.1016/S0140-6736(18)32279-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Simon GE, Chisholm D, Treglia M, et al. Course of depression, health services costs, and work productivity in an international primary care study. Disease-a-Month 2003;49:293–308. 10.1067/mda.2003.28 [DOI] [PubMed] [Google Scholar]
- 3.Simon GE, Revicki D, Heiligenstein J, et al. Recovery from depression, work productivity, and health care costs among primary care patients. Gen Hosp Psychiatry 2000;22:153–62. 10.1016/s0163-8343(00)00072-4 [DOI] [PubMed] [Google Scholar]
- 4.Lenox-Smith A, Martinez JM, Perahia D, et al. Treatment and outcomes for patients with depression who are partial responders to SSRI treatment: post-hoc analysis findings from the finder European observational study. J Affect Disord 2014;169:149–56. 10.1016/j.jad.2014.08.003 [DOI] [PubMed] [Google Scholar]
- 5.Ezquiaga E, García A, Bravo F, et al. Factors associated with outcome in major depression: a 6-month prospective study. Soc Psychiatry Psychiatr Epidemiol 1998;33:552–7. 10.1007/s001270050093 [DOI] [PubMed] [Google Scholar]
- 6.Ramana R, Paykel ES, Cooper Z, et al. Remission and relapse in major depression: a two-year prospective follow-up study. Psychol Med 1995;25:1161–70. 10.1017/s0033291700033134 [DOI] [PubMed] [Google Scholar]
- 7.Paykel ES, Ramana R, Cooper Z, et al. Residual symptoms after partial remission: an important outcome in depression. Psychol Med 1995;25:1171–80. 10.1017/s0033291700033146 [DOI] [PubMed] [Google Scholar]
- 8.Viinamäki H, Hintikka J, Tanskanen A, et al. Partial remission in major depression: a two-phase, 12-month prospective study. Nord J Psychiatry 2002;56:33–7. 10.1080/08039480252803891 [DOI] [PubMed] [Google Scholar]
- 9.Johansson O, Lundh L-G, Bjärehed J. 12-Month outcome and predictors of recurrence in psychiatric treatment of depression: a retrospective study. Psychiatr Q 2015;86:407–17. 10.1007/s11126-015-9341-y [DOI] [PubMed] [Google Scholar]
- 10.Van Londen L, Molenaar RP, Goekoop JG, et al. Three- to 5-year prospective follow-up of outcome in major depression. Psychol Med 1998;28:731–5. 10.1017/S0033291797006466 [DOI] [PubMed] [Google Scholar]
- 11.Romera I, Pérez V, Ciudad A, et al. Residual symptoms and functioning in depression, does the type of residual symptom matter? A post-hoc analysis. BMC Psychiatry 2013;13:51. 10.1186/1471-244X-13-51 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Furukawa TA, Yoshimura R, Harai H. How many well vs. 1. unwell days can you expect over 10 years. once you become depressed, 2009: 290–7. [DOI] [PubMed] [Google Scholar]
- 13.Riihimäki KA, Vuorilehto MS, Melartin TK, et al. Five-Year outcome of major depressive disorder in primary health care. Psychol Med 2014;44:1369–79. 10.1017/S0033291711002303 [DOI] [PubMed] [Google Scholar]
- 14.Frank E, Prien RF, Jarrett RB, et al. Conceptualization and rationale for consensus definitions of terms in major depressive disorder. remission, recovery, relapse, and recurrence. Arch Gen Psychiatry 1991;48:851. 10.1001/archpsyc.1991.01810330075011 [DOI] [PubMed] [Google Scholar]
- 15.Bockting CL, Hollon SD, Jarrett RB, et al. A lifetime approach to major depressive disorder: the contributions of psychological interventions in preventing relapse and recurrence. Clin Psychol Rev 2015;41:16–26. 10.1016/j.cpr.2015.02.003 [DOI] [PubMed] [Google Scholar]
- 16.Rush AJ, Trivedi MH, Wisniewski SR, et al. Bupropion-SR, sertraline, or venlafaxine-XR after failure of SSRIs for depression. N Engl J Med 2006;354:1231–42. 10.1056/NEJMoa052963 [DOI] [PubMed] [Google Scholar]
- 17.Buckman JEJ, Underwood A, Clarke K, et al. Risk factors for relapse and recurrence of depression in adults and how they operate: a four-phase systematic review and meta-synthesis. Clin Psychol Rev 2018;64:13–38. 10.1016/j.cpr.2018.07.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hardeveld F, Spijker J, De Graaf R, et al. Prevalence and predictors of recurrence of major depressive disorder in the adult population. Acta Psychiatr Scand 2010;122:184–91. 10.1111/j.1600-0447.2009.01519.x [DOI] [PubMed] [Google Scholar]
- 19.Judd LL, Akiskal HS, Zeller PJ, et al. Psychosocial disability during the long-term course of unipolar major depressive disorder. Arch Gen Psychiatry 2000;57:375–80. 10.1001/archpsyc.57.4.375 [DOI] [PubMed] [Google Scholar]
- 20.Romera I, Perez V, Menchón JM, et al. Social and occupational functioning impairment in patients in partial versus complete remission of a major depressive disorder episode. A six-month prospective epidemiological study. Eur Psychiatry 2010;25:58–65. 10.1016/j.eurpsy.2009.02.007 [DOI] [PubMed] [Google Scholar]
- 21.Riihimäki K, Sintonen H, Vuorilehto M, et al. Health-Related quality of life of primary care patients with depressive disorders. Eur Psychiatry 2016;37:28–34. 10.1016/j.eurpsy.2016.04.008 [DOI] [PubMed] [Google Scholar]
- 22.Minor KL, Champion JE, Gotlib IH. Stability of DSM-IV criterion symptoms for major depressive disorder. J Psychiatr Res 2005;39:415–20. 10.1016/j.jpsychires.2004.11.001 [DOI] [PubMed] [Google Scholar]
- 23.Conradi HJ, Ormel J, de Jonge P. Presence of individual (residual) symptoms during depressive episodes and periods of remission: a 3-year prospective study. Psychol Med 2011;41:1165–74. 10.1017/S0033291710001911 [DOI] [PubMed] [Google Scholar]
- 24.Conradi HJ, Ormel J, de Jonge P. Presence of individual (residual) symptoms during depressive episodes and periods of remission: a 3-year prospective study. Psychol Med 2011;41:1165–74. 10.1017/S0033291710001911 [DOI] [PubMed] [Google Scholar]
- 25.Lin EH, Jacques P, Breland-noble AM. Apa guideline for the treatment of depression. clinical practice guideline for the treatment of depression across three age cohorts American psychological association Guideline development panel for the treatment of depressive disorders AD. American Psychological Association 2019:1–213 https://www.apa.org/depression-guideline/guideline.pdf [Google Scholar]
- 26.National Institute for Health and Care Excellence . Depression in adults: recognition and management management. clinical guideline. 90, 2009. [PubMed] [Google Scholar]
- 27.Paykel ES, Scott J, Teasdale JD, et al. Prevention of relapse in residual depression by cognitive therapy: a controlled trial. Arch Gen Psychiatry 1999;56:829. 10.1001/archpsyc.56.9.829 [DOI] [PubMed] [Google Scholar]
- 28.Segal ZV, Dimidjian S, Beck A, et al. Outcomes of online Mindfulness-Based cognitive therapy for patients with residual depressive symptoms: a randomized clinical trial. JAMA Psychiatry 2020;77:563. 10.1001/jamapsychiatry.2019.4693 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Watkins ER, Mullan E, Wingrove J, et al. Rumination-focused cognitive-behavioural therapy for residual depression: phase II randomised controlled trial. Br J Psychiatry 2011;199:317–22. 10.1192/bjp.bp.110.090282 [DOI] [PubMed] [Google Scholar]
- 30.Teismann T, von Brachel R, Hanning S, et al. A randomized controlled trial on the effectiveness of a rumination-focused group treatment for residual depression. Psychother Res 2014;24:80–90. 10.1080/10503307.2013.821636 [DOI] [PubMed] [Google Scholar]
- 31.Scott J, Teasdale JD, Paykel ES, et al. Effects of cognitive therapy on psychological symptoms and social functioning in residual depression. Br J Psychiatry 2000;177:440–6. 10.1192/bjp.177.5.440 [DOI] [PubMed] [Google Scholar]
- 32.Segal ZV, Dimidjian S, Beck A, et al. Outcomes of online Mindfulness-Based cognitive therapy for patients with residual depressive symptoms: a randomized clinical trial. JAMA Psychiatry 2020;77:563-573. 10.1001/jamapsychiatry.2019.4693 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Holländare F, Anthony SA, Randestad M, et al. Two-Year outcome of Internet-based relapse prevention for partially remitted depression. Behav Res Ther 2013;51:719–22. 10.1016/j.brat.2013.08.002 [DOI] [PubMed] [Google Scholar]
- 34.Biesheuvel-Leliefeld KEM, Kok GD, Bockting CLH, et al. Effectiveness of psychological interventions in preventing recurrence of depressive disorder: meta-analysis and meta-regression. J Affect Disord 2015;174:400–10. 10.1016/j.jad.2014.12.016 [DOI] [PubMed] [Google Scholar]
- 35.Breedvelt JJF, Brouwer ME, Harrer M. Psychological interventions as an alternative and add-on to antidepressant medication to prevent depressive relapse: systematic review and meta-analysis. Br J Psychiatry 2020;13. 10.1192/bjp.2020.198 [DOI] [PubMed] [Google Scholar]
- 36.de Jonge M, Bockting CLH, Kikkert MJ, et al. Preventive cognitive therapy versus care as usual in cognitive behavioral therapy responders: a randomized controlled trial. J Consult Clin Psychol 2019;87:521–9. 10.1037/ccp0000395 [DOI] [PubMed] [Google Scholar]
- 37.Brouwer ME, Molenaar NM, Burger H, et al. Tapering antidepressants while receiving digital preventive cognitive therapy during pregnancy: an experience sampling methodology trial. Front Psychiatry 2020;11:1–11. 10.3389/fpsyt.2020.574357 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Breedvelt JJF, Warren FC, Segal Z, et al. Continuation of antidepressants vs sequential psychological interventions to prevent relapse in depression: an individual participant data meta-analysis. JAMA Psychiatry 2021;78:868-875. 10.1001/jamapsychiatry.2021.0823 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Bockting CLH, Schene AH, Spinhoven P, et al. Preventing relapse/recurrence in recurrent depression with cognitive therapy: a randomized controlled trial. J Consult Clin Psychol 2005;73:647–57. 10.1037/0022-006X.73.4.647 [DOI] [PubMed] [Google Scholar]
- 40.Bockting CLH, Smid NH, Koeter MWJ, et al. Enduring effects of preventive cognitive therapy in adults remitted from recurrent depression: a 10 year follow-up of a randomized controlled trial. J Affect Disord 2015;185:188–94. 10.1016/j.jad.2015.06.048 [DOI] [PubMed] [Google Scholar]
- 41.Biesheuvel-Leliefeld KEM, Dijkstra-Kersten SMA, van Schaik DJF, et al. Effectiveness of supported self-help in recurrent depression: a randomized controlled trial in primary care. Psychother Psychosom 2017;86:220–30. 10.1159/000472260 [DOI] [PubMed] [Google Scholar]
- 42.Bockting CLH, Spinhoven P, Wouters LF, et al. Long-Term effects of preventive cognitive therapy in recurrent depression: a 5.5-year follow-up study. J Clin Psychiatry 2009;70:1621–8. 10.4088/JCP.08m04784blu [DOI] [PubMed] [Google Scholar]
- 43.Rock PL, Roiser JP, Riedel WJ, et al. Cognitive impairment in depression: a systematic review and meta-analysis. Psychol Med 2014;44:2029–40. 10.1017/S0033291713002535 [DOI] [PubMed] [Google Scholar]
- 44.Semkovska M, Quinlivan L, O'Grady T, et al. Cognitive function following a major depressive episode: a systematic review and meta-analysis. Lancet Psychiatry 2019;6:851–61. 10.1016/S2215-0366(19)30291-3 [DOI] [PubMed] [Google Scholar]
- 45.Snyder HR. Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: a meta-analysis and review. Psychol Bull 2013;139:81–132. 10.1037/a0028727 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Miskowiak K, Carvalho A. ‘Hot’ Cognition in Major Depressive Disorder: A Systematic Review. CNS & Neurological Disorders - Drug Targets 2015;13:1787–803. 10.2174/1871527313666141130205713 [DOI] [PubMed] [Google Scholar]
- 47.Groves SJ, Douglas KM, Porter RJ. A systematic review of cognitive predictors of treatment outcome in major depression. Front Psychiatry 2018;9:382. 10.3389/fpsyt.2018.00382 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Majer M, Ising M, Künzel H, et al. Impaired divided attention predicts delayed response and risk to relapse in subjects with depressive disorders. Psychol Med 2004;34:1453–63. 10.1017/S0033291704002697 [DOI] [PubMed] [Google Scholar]
- 49.Jaeger J, Berns S, Uzelac S, et al. Neurocognitive deficits and disability in major depressive disorder. Psychiatry Res 2006;145:39–48. 10.1016/j.psychres.2005.11.011 [DOI] [PubMed] [Google Scholar]
- 50.Roiser JP, Sahakian BJ. Hot and cold cognition in depression. CNS Spectr 2013;18:139–49. 10.1017/S1092852913000072 [DOI] [PubMed] [Google Scholar]
- 51.Ahern E, Bockting CLH, Semkovska M. A Hot-Cold cognitive model of depression: integrating the neuropsychological approach into the cognitive theory framework. Clinical Psychology in Europe 2019;1. 10.32872/cpe.v1i3.34396 [DOI] [Google Scholar]
- 52.Legemaat AM, Semkovska M, Brouwer M. Effectiveness of cognitive remediation in depression: a meta-analysis, 2021: 1–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Thérond A, Pezzoli P, Abbas M, et al. The efficacy of cognitive remediation in depression: a systematic literature review and meta-analysis. J Affect Disord 2021;284:238–46. 10.1016/j.jad.2021.02.009 [DOI] [PubMed] [Google Scholar]
- 54.Launder NH, Minkov R, Davey CG. Computerized cognitive training in people with depression: a systematic review and meta-analysis of randomized clinical trials. medRxiv 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Motter JN, Pimontel MA, Rindskopf D, et al. Computerized cognitive training and functional recovery in major depressive disorder: a meta-analysis. J Affect Disord 2016;189:184–91. 10.1016/j.jad.2015.09.022 [DOI] [PubMed] [Google Scholar]
- 56.Woolf C, Lampit A, Shahnawaz Z, et al. A systematic review and meta-analysis of cognitive training in adults with major depressive disorder. Neuropsychol Rev 2022;32:419-437. 10.1007/s11065-021-09487-3 [DOI] [PubMed] [Google Scholar]
- 57.Listunova L, Kienzle J, Bartolovic M, et al. Cognitive remediation therapy for partially remitted unipolar depression: a single-blind randomized controlled trial. J Affect Disord 2020;276:316–26. 10.1016/j.jad.2020.07.008 [DOI] [PubMed] [Google Scholar]
- 58.Harvey AG, Lee J, Williams J, et al. Improving outcome of psychosocial treatments by enhancing memory and learning. Perspect Psychol Sci 2014;9:161–79. 10.1177/1745691614521781 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.American Psychiatric Association . Diagnostic and statistical manual of mental disorders, fifth edition. Arlington, VA, US, 2013. [Google Scholar]
- 60.First MB, Williams JBW, Karg RS. SCID-5-S Gestructureerd klinisch interview voor DSM-5 Syndroomstoornissen. Nederlandse vertaling van Structured Clinical Interview for DSM-5® Disorders– Clinician Version (SCID-5-CV), first edition, en User’s Guide to Structured Clinical Interview for DSM. Amsterdam, Netherlands: Boom, 2016. [Google Scholar]
- 61.Endicott J, Cohen J, Nee J, et al. Hamilton depression rating scale. extracted from regular and change versions of the schedule for affective disorders and schizophrenia. Arch Gen Psychiatry 1981;38:98–103. 10.1001/archpsyc.1981.01780260100011 [DOI] [PubMed] [Google Scholar]
- 62.Bockting C. Preventieve cognitieve training bij terugkerende depressie. Houten, the Netherlands: Bohn Stafleu Van Loghum: Springer, 2009. [Google Scholar]
- 63.Beck AT, Rush AJ, Shaw BF. Cognitive therapy of depression. New York City, NY, US: The Guilford Press, 1979. [Google Scholar]
- 64.Bockting CLH, Klein NS, Elgersma HJ, et al. Effectiveness of preventive cognitive therapy while tapering antidepressants versus maintenance antidepressant treatment versus their combination in prevention of depressive relapse or recurrence (DRD study): a three-group, multicentre, randomised controlled trial. Lancet Psychiatry 2018;5:401–10. 10.1016/S2215-0366(18)30100-7 [DOI] [PubMed] [Google Scholar]
- 65.Brouwer ME, Molenaar NM, Burger H, et al. Tapering antidepressants while receiving digital preventive cognitive therapy during pregnancy: an experience sampling methodology trial. Frontiers in Psychiatry 2020;11:1–11. 10.3389/fpsyt.2020.574357 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Molenaar NM, Brouwer ME, Burger H, et al. Preventive cognitive therapy with antidepressant discontinuation during pregnancy: results from a randomized controlled trial. J Clin Psychiatry 2020;81. 10.4088/JCP.19l13099. [Epub ahead of print: 23 06 2020]. [DOI] [PubMed] [Google Scholar]
- 67.Shigekawa E, Fix M, Corbett G, et al. The current state of telehealth evidence: a rapid review. Health Aff 2018;37:1975–82. 10.1377/hlthaff.2018.05132 [DOI] [PubMed] [Google Scholar]
- 68.CogniFit Inc . Cognifit: Personalized Cognitive Programs [Online Application], 2021. [Google Scholar]
- 69.Rush AJ, Gullion CM, Basco MR, et al. The inventory of depressive symptomatology (IDS): psychometric properties. Psychol Med 1996;26:477–86. 10.1017/s0033291700035558 [DOI] [PubMed] [Google Scholar]
- 70.Hamilton M. Rating depressive patients. J Clin Psychiatry 1980;41:21–4. [PubMed] [Google Scholar]
- 71.Feenstra HEM, Murre JMJ, Vermeulen IE, et al. Reliability and validity of a self-administered tool for online neuropsychological testing: the Amsterdam cognition scan. J Clin Exp Neuropsychol 2018;40:253–73. 10.1080/13803395.2017.1339017 [DOI] [PubMed] [Google Scholar]
- 72.Tombaugh TN. Test of memory malingering: TOMM. Multy-Health Systems 1996. [Google Scholar]
- 73.Feenstra HE, Vermeulen IE, Murre JM, et al. Online self-administered cognitive testing using the Amsterdam cognition scan: establishing psychometric properties and normative data. J Med Internet Res 2018;20:e192. 10.2196/jmir.9298 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Brearly TW, Shura RD, Martindale SL, et al. Neuropsychological test administration by Videoconference: a systematic review and meta-analysis. Neuropsychol Rev 2017;27:174–86. 10.1007/s11065-017-9349-1 [DOI] [PubMed] [Google Scholar]
- 75.Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011;20:1727–36. 10.1007/s11136-011-9903-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Thompson ER. Development and validation of an internationally reliable short-form of the positive and negative affect schedule (PANAS). J Cross Cult Psychol 2007;38:227–42. 10.1177/0022022106297301 [DOI] [Google Scholar]
- 77.Weissman AN. The dysfunctional attitude scale: a validation study. In: Dissertation Abstracts international: section B sciences and engineering. 40, 1979: 1389–90. [Google Scholar]
- 78.AJJM V, van Tilburg MAL. Alledaagse Problemen Lijst (APL). Lisse, Netherlands: Swets & Zeitlinger Publishers, 1994. [Google Scholar]
- 79.World Health Organization . Measuring health and disability: manual for who disability assessment schedule (WHODAS 2.0). Geneva, Switzerland: WHO, 2010. [Google Scholar]
- 80.Bouwmans C, De Jong K, Timman R, et al. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Serv Res 2013;13:217. 10.1186/1472-6963-13-217 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Bernstein DP, Stein JA, Newcomb MD, et al. Development and validation of a brief screening version of the childhood trauma questionnaire. Child Abuse Negl 2003;27:169–90. 10.1016/s0145-2134(02)00541-0 [DOI] [PubMed] [Google Scholar]
- 82.Follmann D, Elliott P, Suh I, et al. Variance imputation for overviews of clinical trials with continuous response. J Clin Epidemiol 1992;45:769–73. 10.1016/0895-4356(92)90054-q [DOI] [PubMed] [Google Scholar]
- 83.Vuorenmaa J, Nordling E, Riihikangas R, et al. Depression and partial remission after short-term treatment. Nord J Psychiatry 1999;53:117–20. 10.1080/080394899426800 [DOI] [Google Scholar]
- 84.Semkovska M, Quinlivan L, O'Grady T, O’Grady T, et al. Cognitive function following a major depressive episode: a systematic review and meta-analysis. Lancet Psychiatry 2019;6:851–61. 10.1016/S2215-0366(19)30291-3 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
