Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 Feb 6;18(2):e0281501. doi: 10.1371/journal.pone.0281501

Guidelines’ recommendations for the treatment-resistant depression: A systematic review of their quality

Franciele Cordeiro Gabriel 1,*,#, Airton Tetelbom Stein 2,3,#, Daniela de Oliveira Melo 4,#, Gessica Caroline Henrique Fontes-Mota 1,, Itamires Benício dos Santos 4,, Camila da Silva Rodrigues 4,, Andrea Dourado 4,, Mônica Cristiane Rodrigues 5,, Renério Fráguas 6,, Ivan D Florez 7,8,9,#, Diogo Telles Correia 10,, Eliane Ribeiro 1,#
Editor: Norio Yasui-Furukori11
PMCID: PMC9901785  PMID: 36745622

Abstract

Introduction

Depression is a serious and widespread mental health disorder. A significant proportion of patients with depression fail to remit after two antidepressant treatment trials, a condition named treatment-resistant depression (TRD). Clinical practice guidelines (CPGs) are instruments aimed to improve diagnosis and treatment. This study objective is to systematically appraise the quality and elaborate a comparison of high-quality CPGs with high-quality recommendations aimed at TRD.

Methods and analysis

We searched several specialized databases and organizations that develop CPGs. Independent researchers assessed the quality of the CPGs and their recommendations using AGREE II and AGREE-REX instruments, respectively. We selected only high-quality CPGs that included definition and recommendations for TRD. We investigated their divergencies and convergencies as well as weak and strong points.

Results

Among seven high-quality CPGs with high-quality recommendations only two (Germany’s Nationale Versorgungs Leitlinie–NVL and US Department of Veterans Affairs and Department of Defense–VA/DoD) included specific TRD definition and were selected. We found no convergent therapeutic strategy among these two CPGs. Electroconvulsive therapy is recommended by the NVL but not by the VA/DoD, while repetitive transcranial magnetic stimulation is recommended by the VA/DoD but not by the NVL. While the NVL recommends the use of lithium, and a non-routine use of thyroid or other hormones, psychostimulants, and dopaminergic agents the VA/DoD does not even include these drugs among augmentation strategies. Instead, the VA/DoD recommends ketamine or esketamine as augmentation strategies, while the NVL does not mention these drugs. Other differences between these CPGs include antidepressant combination, psychotherapy as a therapeutic augmentation, and evaluation of the need for hospitalization all of which are only recommended by the NVL.

Conclusions

High-quality CPGs for the treatment of depression diverge regarding the definition and use of the term TRD. There is also no convergent approach to TRD from currently high-quality CPGs.

Introduction

Depression is a serious medical illness that negatively affects behavior. It is a common condition, affecting more than 300 million people worldwide and it is considered one of the most relevant public health problems in the 21st century [1]. Owing to its disabling nature, it can cause various professional, economic, social, and personal losses [2]. In addition, the number of people with depression has increased considerably over the last few years, overloading health systems and generating a greater need for resource optimization [3]. Patients with lower response to depression treatment have a higher risk of severe outcomes including job loss, isolation, and suicide, which may lead to an increased economic cost to society [4].

There are several effective classes of antidepressants including selective serotonin reuptake inhibitors (SSRIs), serotonin and norepinephrine reuptake inhibitors (SNRIs), tricyclic antidepressants, noradrenergic and serotonergic antidepressants, monoamine oxidase inhibitors, among others [5]. Around only one-third of patients will remit after treatment with an SSRI and only 25% to 27% will remit after a subsequent treatment trial with another antidepressant [6]. Consequently, a significant number of patients—up to 40%—will be classified as having treatment-resistant depression (TRD; i.e., they failed to remit after at least two antidepressant treatment trials) [6].

TRD is difficult to manage, and results are usually poor, especially when unstandardized approaches are used [710]. In this regard, clinical practice guidelines (CPGs) are essential tools for guiding clinical decisions. CPGs facilitate treatment standardization and are supported by the best available evidence gathered through rigorous systematic reviews. Moreover, high-quality CPGs also consider elements that are key before recommending interventions, such as costs, acceptability, feasibility, patients’ values and preferences, and the balance between benefits and harms [11, 12].

Unfortunately, in a recent review, only 4 out of 11 available CPGs for the treatment of depression met the minimum quality benchmark after their assessment with the AGREE II tool [13]. Another review found that only 6 out of 27 CPGs could be classified as high-quality guidelines [14].

Low-quality guidelines increase the likelihood of bias in the development of recommendations, which in turn can cause inconsistencies among recommendations [15, 16]. In a study comparing the recommendations for pharmacotherapy and neurostimulation in the treatment of depression, a high degree of inconsistency was found in the recommendations for the second and third lines of treatment [17]. Discrepancies in recommendations for first-line treatments and patients not responding to first-line treatment were also observed by MacQueen et al. [16], in a study analyzing CPGs used in primary healthcare for major depression, dysthymia, and minor depression.

High-quality CPGs contain recommendations are based on the best evidence, with a transparent and trustworthy process that is implementable and acceptable by stakeholders and patients. However, it should be noted that even high-quality CPGs, i.e., CPGs that obtain high scores on AGREE II assessment, do not necessarily guarantee credible and implementable recommendations [18]. In response to this gap between the quality of the guideline and the quality of recommendations, the AGREE Collaboration developed another instrument to evaluate the quality of the recommendations: the Appraisal of Guidelines Research and Evaluation-Recommendations Excellence—the AGREE-REX [19, 20]. AGREE-REX includes additional factors, such as clinical applicability, values and preferences, and implementability. These factors are considered by guideline developers and users to be associated with more feasible, credible, and implementable recommendations.

Previous studies have evaluated the methodological quality of CPGs for the treatment of depression using AGREE II and the discrepancies among recommendations [14, 2123]. However, currently, no study has specifically evaluated the quality of CPGs’ recommendations using the AGREE-REX instrument. To enhance evidence-based clinical practice implementation, it is essential to evaluate quality to help increase the reliability and applicability of recommendations. There is a particular need to have trustworthy guidelines for TRD. Thus, this systematic review aimed to identify and appraise the recommendations for the approach of TRD in CPGs.

Materials and methods

This study is a systematic review conducted across the following databases: MEDLINE (through PubMed), Embase, Cochrane CENTRAL, PsycINFO, and the Virtual Health Library. The complete database search strategy is presented in the S1 File. A manual search was also undertaken on the websites of organizations responsible for developing or compiling CPGs. The protocol for this systematic review has already been published [24]. The search was made in December 2021 and covers the period of January 2011 to December 2021. Then, in June 2022, we searched the literature to update the included CPGs.

Briefly, we included all documents that provided recommendations for the pharmacological management of treatment-resistant depression, regardless of the methodology used. We excluded CPGs that did not specifically refer to TRD, were intended for local use or were related to patients with specific comorbidities.

After excluding duplicates, titles and abstracts retrieved from the searches were independently screened by two reviewers to verify their eligibility. The documents were checked for their eligibility in full text (two full texts could not be retrieved).

Eligible references were obtained in full text and reviewed in duplicate and independently by two reviewers. Data extraction was also performed independently and in duplicate by two reviewers. Characteristics extracted from each CPG included: the year of publication or an updated version of the CPGs, classification of evidence, and institution or organization. This task also involved extracting the quality of the evidence and strength of the recommendations. Disagreements were resolved by consensus, or by a third researcher in all the previous steps.

The quality of the CPGs and their recommendations were evaluated using AGREE II [25, 26] and AGREE-REX, respectively [18]. Details about these instruments and how they were applied have been explained elsewhere [24].

Only CPGs considered to have high-quality with recommendations also categorized as high-quality were included in the data synthesis. CPGs with a score higher than 60% in domain 3 (rigor of development) of AGREE II were classified as high-quality. Recommendations with a score higher than 60% in domain 1 (clinical applicability) of AGREE-REX were classified as high-quality. Recommendations were grouped into two main topics, “terminology for TRD” and “recommended management strategies for TRD”. The terminologies and sequences of the therapeutic strategies were compared between the CPGs and their agreement and disagreement were synthesized in a table (Table 1).

Table 1. Recommendations for the management of TRD obtained from the selected CPGs.

Recommendations NVL CPG VA/DoD CPG
2015 [33] 2022 [32]
Augmentation drugs R R
 Sequenced augmentation NM NM
 Lithium R# NM
 Thyroid hormone or another hormone R* NM
 Psychostimulants R* NM
 Dopamine R* NM
 Ketamine NM R
 Esketamine NM R
Switch medication NM NM
 Sequence among switch NM NM
 Mention specific drugs/classes NM NM
Combination R# NM
 Sequence among combination NM NM
 Mention specific drugs/classes NM NM
Neuromodulation R R
 Sequence among neuromodulation NM NM
 Electroconvulsive therapy R NR
 Repetitive transcranial magnetic stimulation NM R
 Deep brain stimulation NM NR
 Vagal nerve stimulation NM CI
Psychotherapy R NM
 Sequence among psychotherapy NM NM
 Type NM NM
Evaluate the need for hospitalization R NM

R = recommended; NR = not recommended; NM = not mentioned in the text; CI = mentioned in the text but contraindicated in the recommendations;

* should not be used routinely;

# not listed in the recommendations section, but mentioned in the CPG text.

We adopted the definition of TRD as failure to respond after at least two antidepressant treatment trials with adequate dose and time of treatment as has been used in the STAR*D Trial [6]. This definition, although not universally accepted, is commonly used, and is recognized by practitioners and major organizations as a term referring to a specific clinical condition.

Results

We retrieved 5,063 documents from the searches, removed 419 duplicates, and ended up with 4,644 references. We discarded nonrelevant references by the title and abstract and retrieved 174 works for checking their eligibility in full text (two full texts could not be retrieved). A total of 126 documents were excluded and 48 documents were included after the full-text review. We also identified 15 documents from the guidelines’ repositories. Finally, 63 CPGs were selected. Of these 63 CPGs, 17 were classified as high-quality, and among them seven with high-quality recommendations. The flowchart showing this selection process is presented in S1 Fig. Here we examined these seven CPGs with high-quality recommendations. From these 7, five [2731] were excluded since they did not specifically refer to TRD. The reasons for the exclusion of each CPG were: the CPG from the National Institute for Health and Care Excellence—NICE, UK, 2022 [28] uses a stepped-care model, not involving specifically the concept of TRD to develop their recommendations; the CPG from the Spain Working Group, 2011 [31]: uses the term “depression resistance” and their recommendations were intended for an inadequate response after failure to one therapeutic trial and not after two trials; the CPG of the Colombian, Ministerio de Salud, 2013 [29]: only brings recommendations based on treatment failure after just one treatment trial instead of considering the failure after two trials; the Peru EsSalud, 2019 CPG [27]: focuses only on mild depression and does not address TRD; and the CPG from the American Psychological Association, 2019 [30]: has recommendations to partially responsive or no-responsive patients but does not use the TRD definition.

We included only two CPGs: the VA/DoD, Department of Veterans Affairs and Department of Defense, US (2022) [32], and the National Supply Guideline (Nationale Versorgungs Leitlinie—NVL) from Germany (2015) [33], which provided recommendations specifically elaborated for TRD defined as failure to respond to at least two pharmacological treatment trials with adequate dose and time of treatment (Table 1).

Although the CPGs from VA/DoD (2022) [32] and NVL (2015) [33] are similar regarding their high-quality recommendations, there they have some important divergencies. Of relevance, regarding augmentation with neuromodulation strategies, electroconvulsive therapy (ECT) is recommended by the NVL CPG [33], but not by the VA/DoD CPG [32], while repetitive transcranial magnetic stimulation is recommended by the VA/DoD CPG [32] but is not mentioned by the NVL CPG [33]. Differences also exist regarding augmentation with drugs. While the NVL CPG [33] recommends the use of lithium, and a non-routine use of thyroid or other hormones, psychostimulants, and dopaminergic agents the VA/DoD CPG [32] does not include these drugs among the augmentation strategies for TRD. Instead, the VA/DoD CPG [32] recommends ketamine or esketamine as augmentation strategies for TRD, while NVL CPG [33] does not include these drugs. Other differences between VA/DoD [32] and NVL [33] CPGs include antidepressant combination as a strategy for TRD, recommended only by NVL CPG [33]; psychotherapy as a therapeutic augmentation option recommended only by NVL CPG [33]; and evaluation of the need for hospitalization, recommended only by the NVL CPG [33].

Discussion

From the seven selected CPGs that contained high-quality recommendations, only two presented recommendations specifically addressing TRD based on the definition we adopted here. Therefore, we examined only these two CPGs, the VA/DoD from the Department of Veterans Affairs and Department of Defense, US [32], and the NVL from Germany [33]. Both had recommendations specifically elaborated for TRD defined as failure to respond to at least two pharmacological treatment trials with adequate dose and time of treatment. The remaining five high-quality CPGs did not specifically refer to TRD, one focused only on mild depression [27], one used a stepped-care model and a dimensional concept of responsiveness [28], two CPGs considered treatment failure after just one trial [29, 31], and one used the denomination partially responsive or no-responsive patients but did not use the TRD definition [30]. The NICE guideline [28] was updated in June 2022 to include interventional procedures guidance for “Implanted vagus nerve stimulation for treatment-resistant depression”. Even though in this specific recommendation the authors use the term “treatment-resistant”, they defend that this term should not be used and in the guideline as a whole, they adopted a stepped-care model replacing the concept of resistance by the level of response to treatment.

The concept of treatment-resistant depression

There is no consensus regarding the definition and use of the term TRD. Several authors have underlined the lack of a common or consensual terminology for treatment responsiveness of depression [34, 35]. The VA/DoD CPG [32] clearly defined treatment resistance following the STAR*D Trial, which considers TRD as a therapeutic failure after two adequate antidepressant therapies [6]. Although the CPG from NVL [33] did not clearly provide a single definition, they recognize the above definition as one of the most used [32]. Despite this definition being frequently used during the last decades, the challenge to achieve its widespread acceptance continues. It has been suggested that the reasons for that include the absence of standardized criteria to consider what constitutes an adequate treatment trial failure and if non-pharmacological treatments should be considered or not [36].

Five of the seven selected high-quality CPGs did not adopt the concept of resistant depression as described in the present article. The CPG by the Ministry of Health, Social Services and Equality from Spain (2014) [31] mentions the lack of a universally accepted definition for TRD, which makes it difficult to interpret findings and this leads to limitations in applying evidence-based recommendations. This CPG has a specific topic for resistant depression, although considers it as one that partially or does not respond to treatment, without requiring a minimum of two treatment failures [31]. The NICE 2022 CPG from the United Kingdom [28], abandoned the term “resistance” defending that it was perceived as pejorative, and not supported by evidence [28]. Instead, it recommends a stepped-care model replacing the concept of resistance with the level of response to treatment. The APA CPG [30] does not address resistant depression and uses the terms partial or non-responders.

This lack of consensus on definitions for resistant depression complicates the designing of clinical trials and may impair the care given to depression patients. Researchers, health professionals, and patients would benefit greatly from a standard definition of resistant depression.

Differences and similarities of recommendations from included CPGs

Both available CPGs that provide high-quality recommendations for TDR differ in some respects.

The VA/DoD [32] recommends ketamine or esketamine as drug augmentation strategies for TRD based on its support by a systematic review [37]. However, they recommend caution with the use of these medications since studies with better methodology, low risk of bias, and longer follow-ups are needed. The CPG from NVL [33], recommends drug augmentation for patients who do not respond to antidepressant treatment, but without requiring the diagnosis of TRD, including lithium, quetiapine, aripiprazole, olanzapine or risperidone [2733]. On the other hand, this CPG [33] recommends not use routinely carbamazepine, lamotrigine, pindolol, valproate, dopamine agonists, psychostimulants, or thyroid hormones as augmentation strategies after antidepressant treatment failure to unipolar depression.

The drug combination is briefly cited as a valid option for TRD by the CPG from NVL [33]. However, this CPG does not provide recommendations about which specific antidepressants or antidepressant classes could be combined. The VA/DoD CPG [32] does not mention the combination of antidepressant drugs neither for TRD nor for patients who presented a partial or limited response to initial treatment.

Both CPGs include drug switching as a treatment option after the first antidepressant failure, which is in line with the finding that most CPGs recommend drug switching before drug augmentation or a combination [38]. They do not mention antidepressant switching among the recommendations for TRD.

Among neuromodulation and other somatic strategies, the CPG from NVL [33] recommends electroconvulsive therapy but does not mention transcranial magnetic stimulation. The VA/DoD CPG [32] mentions various somatic strategies for patients with TRD including deep brain stimulation, electroconvulsive therapy, transcranial magnetic stimulation, and vagus nerve stimulation.

Considering strategies that are not recommended, the VA/DoD [32] does not recommend the use of vagal nerve stimulation. The authors point out that potential benefits could be overcome by common adverse effects of that procedure, including voice alteration, dysphagia, dyspnea, infection, dizziness, asthenia, chest pains, palpitations, or vocal cord paralysis. The CPG from NVL [33] has no specific non-recommendation except it does not recommend routine use of carbamazepine, lamotrigine, pindolol, valproate, dopamine agonists, psychostimulants or thyroid hormones for unipolar depression.

Regarding psychotherapy, only the CPG from NVL [33] highlights that psychotherapy should be one of the strategies for patients with TRD, while the VA/DoD [32] CPG says that this is a potentiation strategy for patients with partial or limited response to first-line treatment.

Conclusions

We found that most recent high-quality CPGs with high-quality recommendations do not provide recommendations for the treatment of TRD. It is important to notice that there is a lack of consensus regarding the definition and clinical application of TRD. Here we adopted the definition supported by the STAR*D Trial, which considers TRD as a therapeutic failure after two adequate antidepressant therapies [6]. Moreover, we observed that among the two CPGs that provide approaches for the treatment of TRD, there are a lot of divergences regarding which strategy should be followed.

Finally, we have observed that for two CPGs that provide approaches for the treatment of TRD, there are divergences regarding which strategy should be followed. This situation may reflect differences in the definitions used, different approaches or even the moment in which the research was conducted. We understand that the scientific community should discuss this topic in order to better identify patients with resistant depression. In closing, there are still important misdiagnoses which are arguably leading to inadequate management of resistant depression.

Supporting information

S1 File. Search strategy.

The search strategy used in the PubMed (Medline), Embase, Cochrane Library, PsycINFO, and BVS databases.

(DOCX)

S1 Fig. Flowchart of CPG selection.

(DOCX)

Acknowledgments

We thank Caroline Molino, Luciana Vasconcelos, and Nathália Celini Leite Santos for their invaluable assistance in helping us better understand the method of appraisal of CPGs.

Data Availability

All relevant data are within the paper and its Supporting information files.

Funding Statement

F.C.G. is a fellow of the Conselho Nacional de Pesquisa e Tecnologia (CNPq, grant number 141811/2020-0).

References

  • 1.World Health Organization. Depression and other common mental disorders: global health estimates [Internet]. Geneva: WHO; 2017 [cited 2017 Dec 8]. http://apps.who.int/iris/bitstream/10665/254610/1/WHO-MSD-MER-2017.2-eng.pdf
  • 2.Thompson C. Affective disorders: the instruments of psychiatric research. London: John Wiley & Sons; 2010. [Google Scholar]
  • 3.Cipriani A, Furukawa TA, Salanti G, Chaimani A, Atkinson LZ, Ogawa Y, et al. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet. 2018;391: 1357–66. doi: 10.1016/S0140-6736(17)32802-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Nemeroff CB. Prevalence and management of treatment-resistant depression. J Clin Psychiatry. 2007;68: 17–25. [PubMed] [Google Scholar]
  • 5.Taylor DM, Barnes TRE, Young AH. The Maudsley Prescribing Guidelines in Psychiatry. John Wiley and Sons, 13a Ed., 2018, 872p. [Google Scholar]
  • 6.Rush AJ, Warden D, Wisniewski SR, Fava M, Trivedi MH, Gaynes BN, et al. STAR*D: revising conventional wisdom. CNS Drugs. 2009;23: 627–47. doi: 10.2165/00023210-200923080-00001 [DOI] [PubMed] [Google Scholar]
  • 7.Dunner DL, Rush AJ, Russell JM, Burke M, Woodard S, Wingard P, et al. Prospective, long-term, multicenter study of the naturalistic outcomes of patients with treatment-resistant depression. J Clin Psychiatry. 2006;67: 688–95. doi: 10.4088/jcp.v67n0501 [DOI] [PubMed] [Google Scholar]
  • 8.Wooderson SC, Juruena MF, Fekadu A, Commane C, Donaldson C, Cowan M, et al. Prospective evaluation of specialist inpatient treatment for refractory affective disorders. J Affect Disord. 2011;131: 92–103. doi: 10.1016/j.jad.2010.11.002 [DOI] [PubMed] [Google Scholar]
  • 9.Fekadu A, Wooderson SC, Markopoulo K, Donaldson C, Papadopoulos A, Cleare AJ. What happens to patients with treatment-resistant depression? A systematic review of medium to long term outcome studies. J Affect Disord. 2009;116: 4–11. doi: 10.1016/j.jad.2008.10.014 [DOI] [PubMed] [Google Scholar]
  • 10.Fekadu A, Wooderson S, Donaldson C, Markopoulou K, Masterson B, Poon L, et al. A multidimensional tool to quantify treatment resistance in depression: the Maudsley staging method. J Clin Psychiatry. 2009;70: 177–84. doi: 10.4088/jcp.08m04309 [DOI] [PubMed] [Google Scholar]
  • 11.Institute of Medicine (US). Clinical practice guidelines we can trust. Washington, DC: National Academies Press; 2011. [Google Scholar]
  • 12.Mota DM, Vigo A, Kuchenbeckr RS. [Evaluation of the performance of the brazilian notification system for health surveillance: a tool in Brazil’s pharmacovigilance system]. Cien Saude Colet. 2020;25: 1955–66. Portuguese. doi: 10.1590/1413-81232020255.19522018 [DOI] [PubMed] [Google Scholar]
  • 13.Zafra-Tanaka JH, Goicochea-Lugo S, Villarreal-Zegarra D, Taype-Rondan A. Characteristics and quality of clinical practice guidelines for depression in adults: a scoping review. BMC Psychiatry. 2019;19: 79. doi: 10.1186/s12888-019-2057-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Gabriel FC, Melo DO, Fráguas R, Leite-Santos NC, Silva RAM, Ribeiro E. Pharmacological treatment of depression: a systematic review comparing clinical practice guideline recommendations. PLoS One. 2020;15: e0231700. doi: 10.1371/journal.pone.0231700 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Saturno Hernández PJ, Antón Botella JJ, Murcia Payá JF. Variability en la protocolización de la captación, diagnóstico y valoración inicial del paciente hipertenso en 40 centros de salud. Med Clin (Barc). 2000;114: 14–8. . [PubMed] [Google Scholar]
  • 16.Macqueen G, Santaguida P, Keshavarz H, Jaworska N, Levine M, Beyene J, et al. Systematic review of clinical practice guidelines for failed antidepressant treatment response in major depressive disorder, dysthymia, and subthreshold depression in adults. Can J Psychiatry. 2017;62: 11–23. doi: 10.1177/0706743716664885 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Bayes AJ, Parker GB. Comparison of guidelines for the treatment of unipolar depression: a focus on pharmacotherapy and neurostimulation. Acta Psychiatr Scand. 2018;137: 459–71. doi: 10.1111/acps.12878 [DOI] [PubMed] [Google Scholar]
  • 18.AGREE-REX Research Team. The appraisal of guidelines research & evaluation: recommendation excellence (AGREE-REX) [Internet]. [place unknown]: AGREE; 2019 [cited 2019 May 17]. https://www.agreetrust.org/wp-content/uploads/2019/04/AGREE-REX-2019.pdf
  • 19.Brouwers MC, Spithoff K, Kerkvliet K, Alonso-Coello P, Burgers J, Cluzeau F, et al. Development and validation of a tool to assess the quality of clinical practice guideline recommendations. JAMA Netw Open 2020;3: e205535. doi: 10.1001/jamanetworkopen.2020.5535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Brouwers MC, Spithoff K, Lavis J, Kho ME, Makarski J, Florez ID. What to do with all the AGREEs? The AGREE portfolio of tools to support the guideline enterprise. J Clin Epidemiol. 2020;125: 191–7. doi: 10.1016/j.jclinepi.2020.05.025 [DOI] [PubMed] [Google Scholar]
  • 21.Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, et al. The quality of clinical practice guidelines over the last two decades: a systematic review of guidelines evaluation studies. Qual Saf Health Care. 2010;19: e58. doi: 10.1136/qshc.2010.042077 [DOI] [PubMed] [Google Scholar]
  • 22.Kung J, Miller RR, Mackowiak PA. Failure of clinical practice guidelines to meet institute of medicine standards: two more decades of little, if any, prorgess. Arch Intern Med. 2012;172: 1628–33. doi: 10.1001/2013.jamainternmed.56 [DOI] [PubMed] [Google Scholar]
  • 23.Molino CGRC, Leite-Santos NC, Gabriel FC, Weinberg SK, Vasconcelos LP, Montovani-Silva RA, et al. Factors associated with high-quality guidelines for the pharmacologic management of chronic diseases in primary care: a systematic review. JAMA Intern Med. 2019;179:553–60. doi: 10.1001/jamainternmed.2018.7529 [DOI] [PubMed] [Google Scholar]
  • 24.Gabriel FC, Stein AT, de Melo DO, Fontes-Mota GCH, dos Santos IB, Rodrigues CdS, et al. (2022) Recommendations for the pharmacological treatment of treatment-resistant depression: A systematic review protocol. PLoS ONE. 2022;17(4): e0267323. doi: 10.1371/journal.pone.0267323 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Consórcio AGREE. Instrumento para avaliação de diretrizes clínicas. [place unknown]: AGREE; 2009 [cited 2021 06 29]. https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwiEiL6a0NL2AhUeupUCHdNUDZQQFnoECAgQAQ&url=https%3A%2F%2Fwww.agreetrust.org%2Fwp-content%2Fuploads%2F2013%2F06%2FAGREE_II_Brazilian_Portuguese.pdf&usg=AOvVaw2c8A5pFTt2dxe36g2ERT0g
  • 26.Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing in the development, reporting and evaluation of guidelines in the area of health. CMAJ. 2010;182: E839–42. doi: 10.1503/cmaj.090449 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Instituto de Evaluación de Tecnologías en Salud e Investigación (PE). Guía de práctica clínica para el tamizaje y el manejo del episodio depresivo leve en el primer nivel de atención. Lima: EsSalud; 2019. http://www.essalud.gob.pe/ietsi/pdfs/tecnologias_sanitarias/GPC_Depresion_V_Extensa.pdf.
  • 28.National Institute for Health and Care Excellence. Depression in adults: treatment and management. [London]: NICE; 2009. https://www.nice.org.uk/guidance/ng222. Accessed June 30, 2022. [PubMed]
  • 29.Ministerio de Salud (COL). Detección temprana y diagnóstico del episodio depresivo y trastorno depresivo recurrente en adultos: atención integral de los adultos con diagnóstico de episódio depresivo o trastorno depresivo recurrente: Guía de práctica clínica. Bogotá: Minsalud; 2013 [cited 2017 Jun 30]. http://www.iets.org.co/reportes-iets/Documentacin%20Reportes/Gu%C3%ADa.Completa.Depresion.2013.pdf.
  • 30.APA 2019American Psychological Association. Clinical practice guideline for the treatment of depression across three age cohorts. Washington, DC: APA; 2019. https://www.apa.org/depression-guideline/guideline.pdf.
  • 31.Working Group of the Clinical Practice Guideline on the Management of Depression in Adults (ES). Guideline on the management of depression in adults. [Madrid]: Ministry of Health, Social Services and Equality; 2014.
  • 32.VA/DoD Clinical Practice Guideline. (2022). The Management of Major Depressive Disorder. Washington, DC: U.S. Government Printing Office.
  • 33.Härter M, Schorr S, Schneider F, eds. S3-Leitlinie: nationale versorgungsleitlinie unipolare depression langfassung. 2nd ed. Berlin: Springer; 2015. [Google Scholar]
  • 34.Rybak YE, Lai KSP, Ramasubbu R, Vila-Rodriguez F, Blumberger DM, Chan P, et al. Treatment-resistant major depressive disorder: Canadian expert consensus on definition and assessment. Depress Anxiety. 2021. Apr;38(4):456–467. doi: 10.1002/da.23135 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Voineskos D, Daskalakis ZJ, Blumberger DM. Management of treatment-resistant depression: challenges and strategies. Neuropsychiatr Dis Treat. 2020;16:221–234. doi: 10.2147/NDT.S198774 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Berman RM, Narasimhan M Charney DS. Treatment-refractory depression: Definitions and characteristics. Depression & Anxiety. 1997; 5(4): 154–164. doi: [DOI] [PubMed] [Google Scholar]
  • 37.Fond G, Loundou A, Rabu C, Macgregor A, Lancon C, Brittner M, et al. Administração de cetamina em transtornos depressivos: uma revisão sistemática e meta-análise. Psicofarmacologia (Berl). 2014; 231(18):3663–76. doi: 10.1007/s00213-014-3664-5 [DOI] [PubMed] [Google Scholar]
  • 38.Gabriel FC, Stein AT, de Melo DO, et al. Quality of clinical practice guidelines for inadequate response to first-line treatment for depression according to AGREE II checklist and comparison of recommendations: a systematic review. BMJ Open 2022;12:e051918. doi: 10.1136/bmjopen-2021-051918 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Michael Gilbert McCaul

9 Nov 2022

PONE-D-22-21981Guidelines’ recommendations for the treatment-resistant depression: a systematic review of their quality

PLOS ONE

Dear Dr. Gabriel,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands with only minor revisions required. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Dec 24 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Michael Gilbert McCaul, MSc, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does the manuscript adhere to the experimental procedures and analyses described in the Registered Report Protocol?

If the manuscript reports any deviations from the planned experimental procedures and analyses, those must be reasonable and adequately justified.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

2. If the manuscript reports exploratory analyses or experimental procedures not outlined in the original Registered Report Protocol, are these reasonable, justified and methodologically sound?

A Registered Report may include valid exploratory analyses not previously outlined in the Registered Report Protocol, as long as they are described as such.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

3. Are the conclusions supported by the data and do they address the research question presented in the Registered Report Protocol?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. The conclusions must be drawn appropriately based on the research question(s) outlined in the Registered Report Protocol and on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

********** 

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

********** 

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: No

********** 

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Overall Comments

• This is a clear and well-written systematic review of the quality of guidelines’ recommendations for treatment-resistant depression. The authors provide an adequate rationale for conducting such an important study. They give sufficient explanations of the methods and analysis and key results that flowed well. I provide a few minor comments for possible edits in different sections of the manuscript.

Abstract

• Then/so – use one word instead. Line 57

• Consider summarising the results in the abstract – the details of which CPGs used specific terminologies can be described in the results section in the manuscript.

Introduction

• Consider using “people with depression” instead of “depressed people” – line 81

• Some of the studies you cited implicitly evaluated the quality of recommendations in the CPGs they reviewed. Consider rephrasing this line: “currently no study that has evaluated the quality of their recommendations”. Line 130-133.

Materials and methods

• Describe your exclusion criteria here. I see you mention some of these in the results section in Line 186-187.

Discussion

• You summarise the results again in the discussion section of the paper. The focus in this section should be a discussion of the implications of these differences/similarities or what they mean for clinical practice.

Reviewer #2: Thank you - this is a very interesting systematic review.

Some comments:

Line 147 to 150: please include the timeframe of the search.

Line 151: you should mention about excluding duplicates

Line 163 to 165: explain what each domain (i.e. domain 3 for AGREE II and domain 1 for AGREE-REX) are - you explained it

in the protocol but the reader should not need to go look up the protocol or the AGREE tools to understand which domain is being referred to.

Line 186: "7" should be "seven"

Table 1: explain abbreviations ("R", "NM", "CI") and the superscripts "#" and "*"

Line 242, 307, 466, 484: text in italics - should be normal text

Line 313: please reword this sentence - it does not read well. Consider something like "does not recommend routine use of carbamazepine..."

Line 331-2: Please clarify this sentence ("This situation...been conducted") - it is confusing

Line 333-7: Please reword this last sentence. It is long, repetitive and unclear

There are a number of grammatical errors (mostly punctuation) that should be corrected

********** 

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Feb 6;18(2):e0281501. doi: 10.1371/journal.pone.0281501.r002

Author response to Decision Letter 0


19 Dec 2022

November 23, 2022

Michael Gilbert McCaul, MSc, PhD

Academic Editor

PlosOne

Re: MS PONE-D-22-21981

Dear Dr McCaul,

Thank you very much for your e-mail of November 9, 2022, regarding our manuscript, PONE-D-22-21981. The reviewers’ comments were very helpful and significantly contributed to improve que quality of the manuscript’s revised version.

As requested, please find below the revised version of our paper, and the point-by-point list of revisions made. For your convenience, sections that were modified during the revision are highlighted in yellow in the revised version of the manuscript.

Reviewer #1: Overall Comments

• This is a clear and well-written systematic review of the quality of guidelines’ recommendations for treatment-resistant depression. The authors provide an adequate rationale for conducting such an important study. They give sufficient explanations of the methods and analysis and key results that flowed well. I provide a few minor comments for possible edits in different sections of the manuscript.

Reply: Thank you very much for your comments.

Abstract

• Then/so – use one word instead. Line 57

• Consider summarising the results in the abstract – the details of which CPGs used specific terminologies can be described in the results section in the manuscript.

Reply: A new summary was provided, which has the “then/so” expression corrected and included much more elements relating to the study results.

Introduction

• Consider using “people with depression” instead of “depressed people” – line 81

Reply: It has been corrected (line 77).

• Some of the studies you cited implicitly evaluated the quality of recommendations in the CPGs they reviewed. Consider rephrasing this line: “currently no study that has evaluated the quality of their recommendations”. Line 130-133.

Reply: Thanks for your comment. We rephrased this sentence to make it clear that we were referring to the fact that there were no papers evaluating CPGs’ recommendations specifically using the AGREE-REX instrument. (Lines 128-130)

Materials and methods

• Describe your exclusion criteria here. I see you mention some of these in the results section in Line 186-187.

Reply: Thanks for your comment. In addition of the mentioned study protocol, we introduced a short sentence in the methods section to briefly explain the study’s eligibility criteria. Please see lines 147-148.

Discussion

• You summarise the results again in the discussion section of the paper. The focus in this section should be a discussion of the implications of these differences/similarities or what they mean for clinical practice.

Reply: Thanks for your comment. We totally agree with your point. However, we have repeated some parts of the results in the discussion/conclusion sections in order to stress the urgency of the situation. We understand that a combined effort involving several stakeholders is required. As long as we have a lack of consensus for the definition itself (lines 276 – 279) and for the management strategies: 282-322), we’ll still continue to be unable to tackle this condition (lines: 337-339).

Reviewer #2: Thank you - this is a very interesting systematic review.

Reply: Thank you very much for your comments.

Some comments:

Line 147 to 150: please include the timeframe of the search.

Reply: Thanks for your comment. We have introduced this information. Please see lines 142-144.

Line 151: you should mention about excluding duplicates

Reply: Thanks for your comment. We have added this information on line 149.

Line 163 to 165: explain what each domain (i.e. domain 3 for AGREE II and domain 1 for AGREE-REX) are - you explained it in the protocol but the reader should not need to go look up the protocol or the AGREE tools to understand which domain is being referred to.

Reply: Thanks for your comment. We have included the denomination of each domain after it was mentioned. Please see lines 166-168.

Line 186: "7" should be "seven"

Reply: corrected.

Table 1: explain abbreviations ("R", "NM", "CI") and the superscripts "#" and "*"

Reply: the explanations have been included as table footnote.

Line 242, 307, 466, 484: text in italics - should be normal text.

Reply: Text in italics were converted to normal text.

Line 313: please reword this sentence - it does not read well. Consider something like "does not recommend routine use of carbamazepine..."

Reply: corrected.

Line 331-2: Please clarify this sentence ("This situation...been conducted") - it is confusing

Line 333-7: Please reword this last sentence. It is long, repetitive and unclear

Reply: The sentence has been changed. Please see lines 334-339.

There are a number of grammatical errors (mostly punctuation) that should be corrected

Reply: We sent the text to an English-speaking colleague to language revision.

We have addressed the comments and concerns listed by the Editor and the two expert Reviewers. The authors confirm that this manuscript has not been submitted to, and is not currently under review by, another journal.

We therefore shall be grateful if you would consider our revised paper for publication in your Journal.

Thank you for your consideration. We look forward to hearing from you.

Sincerely,

Franciele Cordeiro Gabriel

Department of Pharmacy, Faculty of Pharmaceutical Sciences,

University of São Paulo, São Paulo Brazil

Email: francordegabriel@gmail.com

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Norio Yasui-Furukori

25 Jan 2023

Guidelines’ recommendations for the treatment-resistant depression: a systematic review of their quality

PONE-D-22-21981R1

Dear Dr. Gabriel,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Norio Yasui-Furukori

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors have addressed all my comments. I am satisfied with their edits, and I recommend that this article be accepted for publication.

Reviewer #2: Changes notes, review reads well and is very interesting. All my concerns have been addressed. Thanks.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Acceptance letter

Norio Yasui-Furukori

27 Jan 2023

PONE-D-22-21981R1

Guidelines’ recommendations for the treatment-resistant depression: a systematic review of their quality

Dear Dr. Gabriel:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Norio Yasui-Furukori

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Search strategy.

    The search strategy used in the PubMed (Medline), Embase, Cochrane Library, PsycINFO, and BVS databases.

    (DOCX)

    S1 Fig. Flowchart of CPG selection.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES