Abstract
Introduction
Whether bisphosphonates and RANKL inhibitors play a novel role in delaying cardiovascular calcification is unknown. Their action on regulatory enzymes in the mevalonic acid pathway, which is implicated in both bone and lipid metabolism, may be a novel therapeutic target to manage coronary artery disease (CAD). Such therapies may particularly be relevant in those for whom traditional cardiovascular therapies are no longer sufficient to control disease progression.
Methods and analysis
We will perform a systematic review which aims to synthesise evidence regarding whether use of bisphosphonates or use of the RANKL inhibitor denosumab delays coronary artery calcium (CAC) progression. Eligible studies will include longitudinal studies investigating CAC progression in patients aged >18 years taking either a bisphosphonate or denosumab compared with those who do not. Embase, MEDLINE and Cochrane will be searched using prespecified search terms. Studies will be screened by title and abstract independently and then in full to determine suitability for inclusion in the review. Extracted data will include that relating to study and participant characteristics. The primary outcome will be the CAC score. Secondary outcomes will include aortic and carotid artery calcification. Meta-analysis will be performed if sufficient data are available.
Ethics and dissemination
This study does not require ethics as it is a systematic review of the literature. The results of the review described within this protocol will be distributed via presentations at relevant conferences and publication within a peer-reviewed journal.
PROSPERO registration number
The systematic review pertaining to this protocol is registered with PROSPERO (Registration ID: CRD42022312377).
Keywords: Coronary heart disease, Calcium & bone, Cardiovascular imaging
Strengths and limitations of this study.
Studies included in the review will not be limited to study design; both randomised controlled trials and observational studies will be included if they otherwise meet the inclusion criteria. This means fewer potentially relevant studies will be missed in synthesising the literature on this topic.
The review will synthesise the evidence regarding the cardiovascular effects of both bisphosphonates and the RANKL inhibitor, denosumab, which has not been performed previously.
The review will be generalisable to the wider population as studies included will not be restricted to particular patient subgroups, such as those with chronic kidney disease, those undergoing haemodialysis, or postmenopausal women. This will allow for more thorough subgroup analyses if meta-analysis is conducted.
The review is limited to studies which have been published.
The review is limited to studies published in the English language.
Introduction
Coronary artery disease (CAD) remains the leading cause of morbidity and mortality globally, accounting for approximately 18 million deaths, annually.1 Coronary artery calcium (CAC) is a highly specific marker of established atherosclerotic plaques.2 CAC scores are attained from axial non-contrast CT slices and are calculated using a numerical value, known as the modified Agatston score.3 This can further be classified as a percentile based on the patient’s age, sex and ethnicity.4 The CAC score is a useful tool in predicting an asymptomatic patient’s risk of myocardial infarction and sudden cardiac death in the next 10 years.5 Evidence has shown that those with a moderately elevated CAC score may benefit from escalation of pharmacotherapy including statin therapy to diminish cardiovascular risk.6 7 Hence, the CAC score is highly useful in guiding pharmacotherapy in these intermediate-risk patients. The reverse is also advantageous in that CAC scores may help identify patients who would derive minimal benefit from medication, and thus, eliminate the risks of long-term side effects and ongoing costs from unwarranted therapy.
Bisphosphonates and NF-κB ligand (RANKL) inhibitors are medications typically indicated for the management of osteoporosis. Their introduction to the pharmacological sphere has considerably reduced the incidence of pathological fractures and consequent rates of disability in patients with osteoporosis. Novel evidence suggests that there may be a role for their use in reducing the progression of CAD via their effects on atheroma formation.8 9 Bisphosphonates have been shown to inhibit the progression of ectopic calcification through inhibitory action on the crucial regulatory enzyme, farnesyl pyrophosphate synthase, in the mevalonic acid pathway, which is implicated in both bone and lipid metabolism.8 9 RANKL inhibitors interfere with the glycoprotein, osteoprotegerin (OPG) and other signalling pathways, again involved in lipid metabolism. Furthermore, the pathophysiological processes underpinning both osteoporosis and atherosclerosis are hypothesised to overlap.10 While the exact mechanisms remain unclear, one key hypothesis has been proposed involving OPG, which prevents the development and survival of osteoclasts, which function to resorb bone.11 Therefore, in those with malfunctioning or deficient OPG, osteoclast-induced bone resorption is dysregulated, and inappropriate loss of the trabecular meshwork occurs, clinically resulting in osteopaenia or osteoporosis. Similarly, OPG is released from vascular smooth muscle cells in the tunica media of arteries and function in a parallel way.12 In clinical studies, deficient OPG serum levels have been shown to be associated with increased incidence of pathological fractures and cardiovascular mortality.13 14 This suggests that the fundamental biochemical mechanisms of the two pathologies are likely shared. Moreover, calcified plaques shown on unenhanced CT images are almost indistinguishable from bone itself, further suggesting that the underlying biochemical pathways involved in bone formation may be alike those in vascular calcification. The implication of such could mean an additional therapeutic target in managing CAD, which is especially noteworthy in those for whom traditional cardiovascular therapies are no longer sufficient to control disease progression.
There are two generations of bisphosphonates: the ‘simple’ bisphosphonates (S-BPs) and the more recently developed nitrogen-containing bisphosphonates (NC-BPs). These categories are established based on the molecular structure of the drug, as well as the mechanism by which the drug inhibits osteoclastic activity.15 Etidronate is one such S-BP whose effects on CAD and vascular calcification have been well documented. Three studies have shown that etidronate may delay CAD progression, which has been measured through the surrogate endpoints of aortic calcification scores, CAC scores and carotid artery intima-media thickness, respectively.16–18 Two other papers further support the notion that etidronate may delay or halt vascular calcification, specifically in the abdominal aorta.19 20 NC-BPs include alendronate, pamidronate, zoledronate and risedronate, of which alendronate is the most studied. The effects of N-BPs on vascular calcification are somewhat varying in the literature. Several randomised controlled trials (RCTs) have demonstrated that alendronate is protective against CAD progression, again through reduction in carotid intima-media thickness21 22 and total volume of vascular calcification.23 24 These trials all contained fewer than 75 patients, with effects on vascular calcification largely observed in patients with chronic kidney disease or in those receiving haemodialysis only. Meanwhile, one small pilot study by Hill et al showed that there was no significant difference in progression in CAC between those receiving alendronate and the control group.25
There is very limited evidence assessing the role of the RANKL inhibitor, denosumab, in progression of vascular calcification. A recent RCT revealed that there was no significant difference in CAC and carotid artery intima-media thickness between those on denosumab versus control after 12-month follow-up.26 Conversely, another study revealed that denosumab may indeed suppress the progression of CAC,27 although this was specific to patients with secondary hyperparathyroidism. These conflicting data highlight the need for amalgamation of the literature by means of a systematic review.
Over the last 10 years, two systematic reviews have been performed on similar topics. The first investigated the effects of bisphosphonates on multiple vessels, including the carotids, coronaries, and aorta in patients undergoing haemodialysis.28 However, the review published a decade ago included only two papers which investigated the effects of the S-BP, etidronate, on CAC specifically, in a highly selected population group, limiting the generalisability of the findings. The second, more recent study was also limited by the inclusion of small sample size studies and a short duration of follow-up. Consequently, the effect size of bisphosphonate use could not be accurately quantified. Furthermore, the authors recognised that some of the articles included in their study were of suboptimal quality, as the risk of bias was high in the categories of allocation concealment and blinding.29 This may have inadvertently led to an overestimation of the cardiovascular benefit of bisphosphonate use. Additionally, no systematic review has explored the impact of denosumab on vascular calcification.
Our review will not only further evaluate the effect of bisphosphonate use on cardiovascular disease, but it will also appraise the role of denosumab in CAC progression. If a true association between bisphosphonate or RANKL inhibitor use and CAC can be established by this review in a large cohort of individuals from a diverse range of ages, both sexes, and comorbidities, it may warrant their use in those with elevated CAC. This could prove vital in both the primary and the secondary prevention of cardiovascular events in those who are at high risk of severe complications.
Aims and objectives
The primary aim of the systematic review is to evaluate the relationship between the use of bisphosphonates and the RANKL inhibitor, denosumab, with CAC. A systematic review correlating the use of these medications with coronary artery calcification specifically has not yet been performed. We hypothesise that there will be an inverse relationship between bisphosphonate and denosumab use and CAC. Furthermore, this review aims to assess the relationship between these medications and the degree of aortic and carotid calcification.
Methods
Registration
The methods of the systematic review are described as per the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines. A checklist is included as online supplemental file 1. The final reporting of this study will be compliant with the main PRISMA statement. The systematic review pertaining to this protocol is registered with PROSPERO (Registration ID: CRD42022312377).
bmjopen-2022-066255supp001.pdf (84.4KB, pdf)
Eligibility criteria
Definitions as per PICO-D have been adapted for the purpose of this review. An article will be included in the study if it meets the PICO-D criteria as outlined in table 1. There are multiple controls which may be presented in studies suitable for inclusion, including patients receiving placebo, and patients receiving standard therapy. However, as different controls result in differing reported outcome measures, we will only include studies which use placebo as the control.
Table 1.
PICO-D criteria for inclusion of studies in the review
| Participants | Participants in the included studies must be over the age of 18 and have a CAC score documented. Participants will not be limited according to sex or presence of comorbidities. |
| Intervention | The intervention group must have a CAC score measured at baseline, prior to receiving bisphosphonate or denosumab therapy. CAC scoring must be repeated at least 6 months following the commencement of therapy. |
| Comparator | Patients who are not receiving or have not received the aforementioned medications. CAC must be measured at baseline and repeated at a second time point, which is at least 6 months following the initial CAC score. |
| Outcomes | Coronary artery calcification as quantified by the CAC score (modified Agatston score) or other appropriate method of measuring CAC. Studies will be included if they measure the CAC at least twice to monitor progression. |
CAC, coronary artery calcium.
Timing
Studies from all countries published from inception of database and the time of performing the review.
Design
This systematic review focuses on observational studies and RCTs. Studies will be excluded if they are performed on animals, are cases reports, case series, conference abstracts, letters to the editor, or review articles. Studies will also be excluded if they are published in a language other than English.
Information sources
A structured search of MEDLINE (inception–present), Embase (inception–present) and the Cochrane Central Register of Controlled Trials (CENTRAL) will be performed. Citation lists of any relevant papers found will be hand searched to identify any further pertinent articles.
Search strategy
The search strategy was developed by a medical librarian (online supplemental file 2), with search syntax altered as appropriate according to each database’s subject headings and thesaurus. Keywords included coronary artery calcium, bisphosphonates, RANKL inhibitors, and denosumab.
bmjopen-2022-066255supp002.pdf (70.7KB, pdf)
Data management and software
EndNote V.20.2.1 and Microsoft Excel V.2019 16.0.6742.2048 will be used for study selection and data extraction, respectively. The data in both files will be stored on a shared, password protected drive, accessible by other reviewers granted access by the principal investigator only. Versioned files will be created at key stages of the review, with older versions of the file kept for record-keeping purposes. Review Manager (RevMan V.5.4) will be used for meta-analysis if deemed appropriate.
Study selection
The articles yielded by the search will be screened by title and abstract against our inclusion and exclusion criteria. Following initial title/abstract screening, the full text of potentially eligible papers will then be appraised for final inclusion in the systematic review. They will be categorised into three groups: ‘appropriate’, ‘inappropriate’ and ‘unsure’, by two independent reviewers. Cross-referencing of this categorisation will then be performed. Articles that are classified as ‘appropriate’ by both reviewers will be reviewed in full text. Those classified as ‘inappropriate’ by both reviewers will be excluded. Articles that are categorised as ‘unsure’ by either reviewer will be further discussed with a third reviewer for classification.
Where there is a discrepancy in the inclusion status of any study, a third reviewer will act as the adjudicator. This process will be documented in a PRISMA flow diagram.
Data collection
Two independent reviewers (SLS, NM) will extract data items from included reviews as per a standardised data extraction form (online supplemental file 3). Authors of the included studies will be contacted if required to clarify information from the paper in question, or to gather missing data. The form will be piloted to be optimised by the two reviewers using a subset of randomly selected studies that satisfy the eligibility criteria. Reviewers will independently extract data from the rest of the included list of articles.
bmjopen-2022-066255supp003.xlsx (11.5KB, xlsx)
Data items
General information pertaining to each study will be extracted, including the title of the paper and its citation, author, and year of publication. Study characteristics will also be extracted, including country of origin, study design, aims and objectives of the study, number of participants in the control and intervention groups, respectively, medication dose, route, and frequency, and follow-up timeframe. Participant characteristics to be extracted will include the number of participants in the study, in total, and in each of the control and intervention groups. Demographic data will include age, sex, smoking status, body mass index, the presence of diagnosed pathologies including hypertension, diabetes, dyslipidaemia and chronic kidney disease, and a positive family history of CAD.
Outcomes and prioritisation
The primary outcome is difference in CAC from timepoint zero to follow-up in patients using either a bisphosphonate or denosumab compared with those who have not. As CAC is a virtually continuous variable, the mean difference (or standardised mean difference if more appropriate) will be reported on. The secondary outcomes of the review are carotid artery intima-media thickness and aortic calcification, both measured in cubic millimetres, in those using either a bisphosphonate or denosumab compared with placebo.
Risk of bias
Risk of bias will be assessed using the ROBINS-I tool30 for non-randomised studies and the RoB2 tool31 for RCTs. This will be completed as per the following categories for observational studies: bias due to confounding, bias in the selection of participants into the study, bias in classification of interventions, bias due to deviations from intended interventions, bias due to missing data, bias in the measurement of outcomes, and bias in the selection of the reported result. RCTs will be evaluated as per the following domains: bias arising from the randomisation process, bias due to deviations from intended interventions, bias due to missing outcome data, bias in the measurement of outcome, and bias in selection of the reported results. The studies will then be graded as low, moderate or high for risk of bias per criterion, and for overall bias.
Data synthesis and analysis
Studies will be included if they fulfil the eligibility criteria. Data will be presented narratively and complemented with tables and figures as appropriate. The outcomes of each study will be extracted, as well as any statistical significance. Raw data will be collected. P values will be reported where available, as stated by the study authors. Lastly, the main conclusions drawn by the authors will be extracted. Meta-analysis will be performed on the data using RevMan V.5.4. To account for heterogeneity, subgroup analysis will be performed to further explore any differences in CAC scores and medication use. The likely subgroups investigated will be women with osteoporosis and patients undergoing dialysis, as these groups have been studied more frequently, as identified in preliminary studies. Meta-regression will only be performed if more than 10 studies are included in the review, as per Cochrane recommendations. If suitable, a pooled analysis of the effect of bisphosphonate versus RANKL inhibitors on CAC will be performed.
Ethics and dissemination
This study is a systematic review; therefore, it does not require ethics approval. The results of the review described within this protocol will be distributed via presentations at relevant conferences and publication within a peer-reviewed journal.
Supplementary Material
Footnotes
Contributors: NM conducted scoping searches and piloted the data extraction form. SLS drafted the manuscript, designed the data extraction template and manages the overall review. KC, NSM and SRG reviewed and edited the manuscript. SLS, NSM and KC were involved in study selection, data extraction and data analysis. SLS and GS were involved in conceptualisation of the question. All authors read and approved the final manuscript before submission.
Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting or dissemination plans of this research.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Ethics statements
Patient consent for publication
Not applicable.
References
- 1.WHO . Cardiovascular diseases, 2022. Available: https://www.who.int/health-topics/cardiovascular-diseases#tab=tab_1
- 2.Chua A, Blankstein R, Ko B. Coronary artery calcium in primary prevention. Aust J Gen Pract 2020;49:464–9. 10.31128/AJGP-03-20-5277 [DOI] [PubMed] [Google Scholar]
- 3.Agatston AS, Janowitz WR, Hildner FJ, et al. Quantification of coronary artery calcium using ultrafast computed tomography. J Am Coll Cardiol 1990;15:827–32. 10.1016/0735-1097(90)90282-T [DOI] [PubMed] [Google Scholar]
- 4.Greenland P, Bonow RO, Brundage BH, et al. ACCF/AHA 2007 clinical expert consensus document on coronary artery calcium scoring by computed tomography in global cardiovascular risk assessment and in evaluation of patients with chest pain: a report of the American College of cardiology foundation clinical expert consensus task force (ACCF/AHA writing committee to update the 2000 expert consensus document on electron beam computed tomography) developed in collaboration with the society of atherosclerosis imaging and prevention and the society of cardiovascular computed tomography. J Am Coll Cardiol 2007;49:378–402. 10.1016/j.jacc.2006.10.001 [DOI] [PubMed] [Google Scholar]
- 5.Liew G, Chow C, van Pelt N, et al. Cardiac society of Australia and New Zealand position statement: coronary artery calcium scoring. Heart Lung Circ 2017;26:1239–51. 10.1016/j.hlc.2017.05.130 [DOI] [PubMed] [Google Scholar]
- 6.Miedema MD, Duprez DA, Misialek JR, et al. Use of coronary artery calcium testing to guide aspirin utilization for primary prevention: estimates from the multi-ethnic study of atherosclerosis. Circ Cardiovasc Qual Outcomes 2014;7:453–60. 10.1161/CIRCOUTCOMES.113.000690 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Mitchell JD, Fergestrom N, Gage BF, et al. Impact of statins on cardiovascular outcomes following coronary artery calcium scoring. J Am Coll Cardiol 2018;72:3233–42. 10.1016/j.jacc.2018.09.051 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Luckman SP, Hughes DE, Coxon FP, et al. Nitrogen-containing bisphosphonates inhibit the mevalonate pathway and prevent post-translational prenylation of GTP-binding proteins, including ras. J Bone Miner Res 1998;13:581–9. 10.1359/jbmr.1998.13.4.581 [DOI] [PubMed] [Google Scholar]
- 9.Wang B, Wang H, Li Y, et al. Lipid metabolism within the bone micro-environment is closely associated with bone metabolism in physiological and pathophysiological stages. Lipids Health Dis 2022;21:5. 10.1186/s12944-021-01615-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.West SL, O’Donnell E. Cardiovascular disease and bone loss—new research in identifying common disease pathophysiologies and predictors. AME Med J 2018;3:42. 10.21037/amj.2018.03.08 [DOI] [Google Scholar]
- 11.Boyle WJ, Simonet WS, Lacey DL. Osteoclast differentiation and activation. Nature 2003;423:337–42. 10.1038/nature01658 [DOI] [PubMed] [Google Scholar]
- 12.Callegari A, Coons ML, Ricks JL, et al. Increased calcification in osteoprotegerin-deficient smooth muscle cells: dependence on receptor activator of NF-κB ligand and interleukin 6. J Vasc Res 2014;51:118–31. 10.1159/000358920 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ziegler S, Kudlacek S, Luger A, et al. Osteoprotegerin plasma concentrations correlate with severity of peripheral artery disease. Atherosclerosis 2005;182:175–80. 10.1016/j.atherosclerosis.2005.01.042 [DOI] [PubMed] [Google Scholar]
- 14.Bjerre M, Hilden J, Kastrup J, et al. Osteoprotegerin independently predicts mortality in patients with stable coronary artery disease: the claricor trial. Scand J Clin Lab Invest 2014;74:657–64. 10.3109/00365513.2014.930510 [DOI] [PubMed] [Google Scholar]
- 15.Drake MT, Clarke BL, Khosla S. Bisphosphonates: mechanism of action and role in clinical practice. Mayo Clin Proc 2008;83:1032–45. 10.4065/83.9.1032 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Ariyoshi T, Eishi K, Sakamoto I, et al. Effect of etidronic acid on arterial calcification in dialysis patients. Clin Drug Investig 2006;26:215–22. 10.2165/00044011-200626040-00006 [DOI] [PubMed] [Google Scholar]
- 17.Nitta K, Akiba T, Suzuki K, et al. Effects of cyclic intermittent etidronate therapy on coronary artery calcification in patients receiving long-term hemodialysis. Am J Kidney Dis 2004;44:680–8. 10.1016/S0272-6386(04)00937-0 [DOI] [PubMed] [Google Scholar]
- 18.Koshiyama H, Nakamura Y, Tanaka S, et al. Decrease in carotid intima-media thickness after 1-year therapy with etidronate for osteopenia associated with type 2 diabetes. J Clin Endocrinol Metab 2000;85:2793–6. 10.1210/jc.85.8.2793 [DOI] [PubMed] [Google Scholar]
- 19.Hashiba H, Aizawa S, Tamura K, et al. Inhibition of the progression of aortic calcification by etidronate treatment in hemodialysis patients: long-term effects. Ther Apher Dial 2006;10:59–64. 10.1111/j.1744-9987.2006.00345.x [DOI] [PubMed] [Google Scholar]
- 20.Kawahara T, Nishikawa M, Kawahara C, et al. Atorvastatin, etidronate, or both in patients at high risk for atherosclerotic aortic plaques: a randomized, controlled trial. Circulation 2013;127:2327–35. 10.1161/CIRCULATIONAHA.113.001534 [DOI] [PubMed] [Google Scholar]
- 21.Delibasi T, Emral R, Erdogan MF, et al. Effects of alendronate sodium therapy on carotid intima media thickness in postmenopausal women with osteoporosis. Adv Ther 2007;24:319–25. 10.1007/BF02849900 [DOI] [PubMed] [Google Scholar]
- 22.Celiloglu M, Aydin Y, Balci P, et al. The effect of alendronate sodium on carotid artery intima-media thickness and lipid profile in women with postmenopausal osteoporosis. Menopause 2009;16:689–93. 10.1097/gme.0b013e318194cafd [DOI] [PubMed] [Google Scholar]
- 23.Okamoto M, Yamanaka S, Yoshimoto W, et al. Alendronate as an effective treatment for bone loss and vascular calcification in kidney transplant recipients. J Transplant 2014;2014:1–6. 10.1155/2014/269613 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Toussaint ND, Lau KK, Strauss BJ, et al. Effect of alendronate on vascular calcification in CKD stages 3 and 4: a pilot randomized controlled trial. Am J Kidney Dis 2010;56:57–68. 10.1053/j.ajkd.2009.12.039 [DOI] [PubMed] [Google Scholar]
- 25.Hill JA, Goldin JG, Gjertson D, et al. Progression of coronary artery calcification in patients taking alendronate for osteoporosis. Acad Radiol 2002;9:1148–52. 10.1016/S1076-6332(03)80516-0 [DOI] [PubMed] [Google Scholar]
- 26.Iseri K, Watanabe M, Yoshikawa H, et al. Effects of denosumab and alendronate on bone health and vascular function in hemodialysis patients: a randomized, controlled trial. J Bone Miner Res 2019;34:1014–24. 10.1002/jbmr.3676 [DOI] [PubMed] [Google Scholar]
- 27.Chen C-L, Chen N-C, Wu F-Z, et al. Impact of denosumab on cardiovascular calcification in patients with secondary hyperparathyroidism undergoing dialysis: a pilot study. Osteoporos Int 2020;31:1507–16. 10.1007/s00198-020-05391-3 [DOI] [PubMed] [Google Scholar]
- 28.Santos LL, Cavalcanti TB, Bandeira FA. Vascular effects of bisphosphonates–-A systematic review. Clin Med Insights Endocrinol Diabetes 2012;5:CMED.S10007. 10.4137/CMED.S10007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Caffarelli C, Montagnani A, Nuti R, et al. Bisphosphonates, atherosclerosis and vascular calcification: update and systematic review of clinical studies. Clin Interv Aging 2017;12:1819–28. 10.2147/CIA.S138002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ 2016;355:i4919. 10.1136/bmj.i4919 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Methods Bias C. Rob 2: a revised Cochrane risk-of-bias tool for randomized trials Cochrane; 2022. https://methods.cochrane.org/bias/resources/rob-2-revised-cochrane-risk-bias-tool-randomized-trials [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2022-066255supp001.pdf (84.4KB, pdf)
bmjopen-2022-066255supp002.pdf (70.7KB, pdf)
bmjopen-2022-066255supp003.xlsx (11.5KB, xlsx)
