Short abstract
Linked Article: Guelimi et al. Br J Dermatol 2022; 187:29–41.
The number of available systemic treatments for psoriasis, including biologics, has increased rapidly in recent years, necessitating up‐to‐date and comprehensive comparative effectiveness research to aid clinical decision making. A plethora of systematic reviews have been published assessing the effectiveness of systemic treatments for psoriasis, typically compared in randomized trials to placebo. More recently, the analytical methods in systematic reviews have been expanded through the application of network meta‐analysis (NMA), which enables head‐to‐head comparisons of active treatments using both direct (where treatments have been compared within trials) and indirect evidence (where treatments have been compared with a common comparator). 1 NMAs thus allow all treatments connected in a network to be compared and ranked with each other.
In this issue of the BJD, Guelimi et al. evaluate 47 NMAs published from 2006 to 2020 that assessed the effectiveness of systemic treatments for moderate‐to‐severe psoriasis. 2 The authors included systematic reviews of randomized controlled trials that assessed the efficacy or safety of a wide range of systemic treatments compared with placebo or another intervention.
Firstly, the authors concluded that there was a high level of redundancy from so many NMAs published on the same research question – on average three per year over 15 years – with the rate of publication increasing over time. This highlights the need for researchers and journals to check that existing NMAs have not been registered or published and, where they have, for authors to provide robust arguments for why an additional NMA is required.
Secondly, the authors noted that the rankings of treatments varied between the NMAs, even when they were published in the same year. This discrepancy may be attributed to the quality of the underlying systematic review and NMA, where more than 80% of the included NMAs were deemed to be critically low in terms of the confidence in their results, predominantly due to not registering or publishing the protocol, inadequate reporting of the literature search, or not performing a risk‐of‐bias assessment, which are fundamental components of a high‐quality systematic review. 3 This highlights the importance for NMAs to be conducted 1 and reported 4 using best‐practice methods, and authors should consider including an assessment of the confidence of the evidence (e.g. CINeMA) 5 so that the results are reproducible and provide a true account of the evidence to support consistent clinical decision making.
Another potential explanation for discrepant results between NMAs is possible bias related to industry funding. More than half (55%) of the included NMAs were funded by industry. This could lead to bias in the way an NMA is conducted by influencing the inclusion and exclusion criteria, outcomes analysed and statistical methods to achieve results favourable to a funder’s treatment.
Finally, studies were selective of the outcomes assessed: many focused solely on efficacy, were limited to short‐term outcomes, and did not consider safety. Systematic reviews should provide a global account of the evidence, focusing on both beneficial and harmful effects of interventions. It is important that, where possible, both short‐ and long‐term efficacy and safety outcomes are considered in systematic reviews.
This publication draws attention to the overuse of NMAs on systemic treatments for psoriasis. Researchers conducting future NMAs in psoriasis and other clinical areas should avoid redundancy and use robust methods and complete reporting.
Acknowledgments
the authors thank Dr A. Bastounis for his review of and comments on this commentary.
Conflicts of interest: J.L.B. has received compensation from the British Association of Dermatologists (BJD Associate Statistical Editor). A.M.D. has received compensation from the British Association of Dermatologists (BJD reviewer and Section Editor), the American Academy of Dermatology (guidelines writer) and the National Eczema Association (grant reviewer).
References
- 1. Chaimani A, Caldwell DM, Li T et al. Chapter 11: Undertaking network meta‐analyses. In: Cochrane Handbook for Systematic Reviews of Interventions (Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T et al., eds). Chichester: John Wiley & Sons Ltd, 2019; 285–320. [Google Scholar]
- 2. Guelimi R, Afach S, Régnaux J‐P et al. Overlapping network meta‐analyses on psoriasis systemic treatments, an overview: quantity does not make quality. Br J Dermatol 2022; 187:29–41. [DOI] [PubMed] [Google Scholar]
- 3. JPT Higgins, Thomas J, Chandler J, Cumpston M, Li T et al., eds. Cochrane Handbook for Systematic Reviews of Interventions, version 6.2. Available at: www.training.cochrane.org/handbook (last accessed 24 January 2022).
- 4. Hutton B, Salanti G, Caldwell DM et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta‐analyses of health care interventions: checklist and explanations. Ann Intern Med 2015; 162:777–84. [DOI] [PubMed] [Google Scholar]
- 5. Nikolakopoulou A, Higgins JPT, Papakonstantinou T et al. CINeMA: an approach for assessing confidence in the results of a network meta‐analysis. PLOS Med 2020; 17:e1003082. [DOI] [PMC free article] [PubMed] [Google Scholar]
