Skip to main content
BMJ Open logoLink to BMJ Open
. 2020 Dec 7;10(12):e040768. doi: 10.1136/bmjopen-2020-040768

Study protocol for a multicentre, prospective cohort study of the association of angiotensin II type 1 receptor blockers on outcomes of coronavirus infection

James A Russell 1,, John C Marshall 2, Arthur Slutsky 3, Srinivas Murthy 4, Dave Sweet 5, Terry Lee 6, Joel Singer 6, David M Patrick 6, Bin Du 7, Zhiyong Peng 8, Matthew Cheng 9, Kevin D Burns 10, Michael O Harhay 11
PMCID: PMC7722825  PMID: 33293316

Abstract

Introduction

The COVID-19 epidemic grows and there are clinical trials of antivirals. There is an opportunity to complement these trials with investigation of angiotensin II type 1 receptor blockers (ARBs) because an ARB (losartan) was effective in murine influenza pneumonia.

Methods and analysis

Our innovative design includes: ARBs; alignment with the WHO Ordinal Scale (primary endpoint) to align with other COVID-19 trials; joint longitudinal analysis; and predictive biomarkers (angiotensins I, 1–7, II and ACE1 and ACE2). Our hypothesis is: ARBs decrease the need for hospitalisation, severity (need for ventilation, vasopressors, extracorporeal membrane oxygenation or renal replacement therapy) or mortality of hospitalised COVID-19 infected adults. Our two-pronged multicentre pragmatic observational cohort study examines safety and effectiveness of ARBs in (1) hospitalised adult patients with COVID-19 and (2) out-patients already on or not on ARBs. The primary outcome will be evaluated by ordinal logistic regression and main secondary outcomes by both joint longitudinal modelling analyses. We will compare rates of hospitalisation of ARB-exposed versus not ARB-exposed patients. We will also determine whether continuing ARBs or not decreases the primary outcome. Based on published COVID-19 cohorts, assuming 15% of patients are ARB-exposed, a total sample size of 497 patients can detect a proportional OR of 0.5 (alpha=0.05, 80% power) comparing WHO scale of ARB-exposed versus non-ARB-exposed patients.

Ethics and dissemination

This study has core institution approval (UBC Providence Healthcare Research Ethics Board) and site institution approvals (Health Research Ethics Board, University of Alberta; Comite d’etique de la recerche, CHU Sainte Justine (for McGill University and University of Sherbrook); Conjoint Health Research Ethics Board, University of Calgary; Queen’s University Health Sciences & Affiliated Hospitals Research Ethics Board; Research Ethics Board, Sunnybrook Health Sciences Centre; Veritas Independent Research Board (for Humber River Hospital); Mount Sinai Hospital Research Ethics Board; Unity Health Toronto Research Ethics Board, St. Michael’s Hospital). Results will be disseminated by peer-review publication and social media releases.

Trial registration number

NCT04510623

Keywords: adult intensive & critical care, cardiology, hypertension


Strengths and limitations of this study.

  • We have four strengths: first, our innovative design includes evaluation of use of angiotensin receptor blockers (ARBs) and aligns with the WHO Ordinal Scale (primary endpoint) to align with other COVID-19 trials.

  • Second, we will use adjusted ordinal logistic regression to assess the primary outcome (COVID-19 WHO Ordinal Scale) and adjusted regression analysis for the secondary outcomes.

  • Third, we measure and evaluate several biomarkers (angiotensins I, 1–7, II and ACE1 and ACE2) that are predictive of outcomes and response to ARBs in COVID-19.

  • Fourth, our two-pronged multicentre pragmatic observational cohort study will determine the safety and effectiveness of ARBs in1 (1) hospitalised adult patients with COVID-19 and2 (2) out-patients, already on or not on ARBs.

  • The limitations are that the study is not randomised and not blinded.

Introduction

The coronavirus (COVID-19) epidemic grows, mortality rate is 2% (lower than Severe Acute Respiratory Syndrome (SARS) (10%) and Middle East Respirtatory Syndrome (MERS) (36%)) but is 10% in hospitalised and 24%–62%1 in ICU-admitted patients in China.2–4 Interventions to date include quarantine, isolation and usual clinical care. There are no proven vaccines and just one antiviral—remdesivir5—is approved for COVID-19. However, the critical illness complications of COVID-19—septic shock, acute respiratory distress syndrome (ARDS) and acute kidney injury (AKI)—are caused in part by the host response. We have a unique opportunity to complement these trials of antivirals with investigation of modulation of the host response to improve outcomes of COVID-19.6 7

Publications at the time of our grant submission were used to derive power and sample size. Of 278 COVID-19 hospitalisations in China2–4 at that time, 7% had septic shock, 20% ARDS, 9% needed intubation and ventilation, 3% needed extracorporeal membrane oxygenation, 7% had AKI, 5% needed renal replacement therapy (RRT) and 8% died. Critically ill patients with COVID-19 have similar mortality as sepsis and ARDS. Mortality of ICU-admitted patients with COVID-193 4 was 2%–62%,8 similar to or higher than sepsis mortality (24% in 101 064 patients in Australia)9 and ARDS mortality (30% in a systematic review).10 Clearly there are opportunities to improve these outcomes.

COVID-19 binds ACE211 and so the ACE axis is central to septic shock, ARDS and COVID-19.12 SARS-CoV-2’s spike glycoprotein binds ACE2 10–20 times more avidly than does SARS111 and inactivates ACE2.13 Patients already on ARBs have lower sepsis mortality and do not have worse haemodynamic status (blood pressure14) than patients not on ARBs.15–17

The underlying mechanisms leading to the acute lung injury after viral infection mediated by an increase in angiotensin II18 (ie, microvascular damage, increased vascular permeability, secondary production of inflammatory cytokines, accelerated apoptosis, fibrosis). Local activation of the renin-angiotensin-aldosterone system may mediate lung and cardiac injury responses to SARS-CoV-2. SARS-CoV-2 infection increases lung and coronary microvascular thrombosis and coagulation (increased D-dimers), which is associated with increased COVID-19 mortality19 20. ATII binds the ATII receptor 1 (AGTR1) which increases expression of tissue factor (TF) and plasminogen activator inhibitor-1 (PAI-1).21 Losartan decreases TF22 and PAI-1.22 23 ARBs may also modulate ACE2 activity24 upregulating ACE2 in cardiac tissue25 and that could be an adverse effect of ARBs in COVID-19.

The most severe cases of COVID-19 that require ICU care have ARDS, septic shock and AKI. We also have had success in discovery of off-target drugs: proprotein convertase subtilisin/kexin type 9 inhibition26–28 and cholesteryl ester transfer protein inhibition29–31 for sepsis. Determining whether plasma angiotensin I, 1–7 and II and ACE and ACE2 levels predict response to ARBs is based on our genomics and protein biomarker research in which we identified predictive biomarkers (ie, predictive of response to angiotensin II,32 vasopressin,33 and norepinephrine34).

There is clinical equipoise regarding safety and effectiveness of ARBs in COVID-19.35–37 At the time of our study design and implementation there was only one study that separated ARBs use from ACE inhibitor (ACEi) use38 39 (n=362) finding no associations of ARBs or ACEi with mortality.38 A recent meta-analysis found that use of ARBs or ACEi use was associated with decreased mortality of COVID-19.40 ARBs or ACEi use in patients with COVID-19 with hypertension (n=1128) was associated with decreased mortality (9.8% vs 3.7%, RRR 60%, p = 0.03) compared with patients not on ARBs/ACEis in one study41 but not in Feng and colleagues.42 Li and colleagues38 found no differences in use of ACEis (9.1% vs 9.8%; p = 0.85), ARBs (19.5% vs 23.9%; p = 0.42), or the composite ACEis/ARBs (27.3% vs 33.0%; p = 0.34) between non-survivors and survivors.

Losartan (an ARB) decreases viral replication and lung injury in murine influenza pneumonia.8 ARBs are inexpensive clinically-available drugs used in hypertension and heart failure that could decrease morbidity and mortality of COVID-19. Angiotensin II worsens lung injury in influenza models2–4 because ACE2 is downregulated in H1N1, H5N1, H7N9 and SARS2–4 43 leading to increased angiotensin II. Angiotensin II levels are increased in COVID-1944 and human influenza and are associated with influenza viral load, disease progression and mortality.45 Losartan limits lung injury in murine influenza H7N9(8), viral titre and RNA and lung injury. ARBs could limit viral titre and organ injury.

Hypertension guidelines recommend ARBs if ACEis are not tolerated,46 are very commonly prescribed (59% of hypertension47), 35% of hypertensive patients with chronic kidney disease (CKD)48 and 32% of diabetics.49 ARBs are recommended first line therapy in Canadian heart failure guidelines.50 In Alberta, Canada, ARBs or ACEis were used in 50%–70% of patients with heart failure51 and 58% of patients in Nepal52 and 52%53 of US patients with heart failure.

If ARBs protect patients from COVID-19 because they are less sick and are not hospitalised, we may detect this in our study of hospitalised COVID-19. Thus, once hospitalised, ARB-exposed patients may not fare better than patients not on ARBs (ie, ARBs may protect them from getting sick enough to be admitted). To address that possibility, we collaborate with SM and his study of community COVID-19 (COVID-19: Improving the Evidence to Treat an Emerging Infection) to determine whether ARB treatment compared with not being on ARBs decreases the risk of hospitalisation.

Initially when we designed our study (ie, before the amendment), we sought to evaluate ARBs treatment versus no ARBs treatment but not ACEis because the available evidence in previous animal studies used ARB for attenuation of acute lung injury. We added an amendment to similarly evaluate ACEi treatment versus no ACEi treatment and ARBs/ACEi versus no ARBs/ACEi.

Overall purpose

This is a multicentre pragmatic cohort study of hospitalised patients with COVID-19 that leverages cutting-edge longitudinal data analysis methods. We will assess ARBs (losartan, irbesartan, candesartan, telmisartan, valsartan, eprosartan and alzilsartan used to treat hypertension and heart failure) for safety and effectiveness in decreasing need for vital organ support and mortality of hospitalised adults with COVID-19. There were two amendments after receiving Canadian Institutes of Health Research (CIHR) funding: to add other ACE pathway biomarkers and to evaluate ACEis (online supplemental file 1). There is a flow chart of ARBs Corona I shown in figure 1.

Figure 1.

Figure 1

Flow chart of patients. ARBs, angiotensin receptor blockers, ACEi, ACE inhibitor; ARB, angiotensin receptor blockers.

Supplementary data

bmjopen-2020-040768supp001.pdf (19.1KB, pdf)

Objectives

  • To accrue and retrospectively record clinical characteristics and outcomes of COVID-19 hospitalised patients.

  • To classify patients as ARB-exposed or not ARB-exposed.

  • To measure serum angiotensin II levels at hospital admission and compare to the primary outcome COVID-19 WHO Ordinal Scale as well as comparing ARB-exposed to ARB-non-exposed patients (and ACEi-exposed vs not ACEi-exposed) and the association of these treatments with the outcomes.

  • To do adjusted ordinal logistic regression for the primary outcome COVID-19 WHO Ordinal Scale and adjusted regression analysis for the secondary outcomes comparing ARB-exposed to not ARB-exposed hospitalised COVID-19 patients.

  • To do joint longitudinal analyses of organ dysfunction (as evaluated by the Sequential Organ Failure Assessment (SOFA) Score) over time comparing ARB-exposed to not ARB-exposed hospitalised patients with COVID-19.

  • To do ordinal logistic regression and interaction tests for the primary outcome COVID-19 WHO Ordinal Scale to determine whether and at what level plasma angiotensin II levels are associated with improved WHO Ordinal Scale in ARB-exposed patients with COVID-19.

  • To do logistic regression for the rates of hospitalisation of ARB-exposed to not ARB-exposed patients in the community (in collaboration with SM (COVID-19: Improving the Evidence to Treat an Emerging Infection).

  • To do ordinal logistic regression subgroup analysis in patients already on ARBs when they are hospitalised to determine whether continuing ARBs (or not) decreases WHO COVID-19 Ordinal Outcome Scale.

Our main hypothesis is that modulation of ACE2 by angiotensin receptor blockers is associated with decreased WHO COVID-19 Ordinal Outcome Scale (that evaluates the severity, need for ventilation, vasopressors, extracorporeal membrane oxygenation or RRT and mortality) of hospitalised COVID-19 infected adults.

Secondary biomarker hypothesis

Plasma angiotensin II levels are associated with effectiveness of ARBs in hospitalised COVID-19 adults. Secondary HospitalisationHypothesi: odulation of ACE2 by angiotensin receptor blockers is associated with decreased rate of hospitalisation for COVID-19. Secondary Continuing ARBs Hypothesis: In patients already on ARBs when they are hospitalised continuing ARBs is associated with decreased WHO COVID-19 Ordinal Outcome Scale.

Methods and analysis

Design, participants and timeframe of enrollment and visits

Our pragmatic multicentre cohort study comparing ARB use to no ARB use in COVID-19 is relatively simple, inexpensive, will be done quickly and thus addresses the urgency of COVID-19 research. We will compare outcomes of hospitalised adult patients with COVID-19 (1) who have use of any ARB within 24 hours of onset of COVID-19 symptoms with (2) patients who were not exposed to ARBs. At hospital admission we will obtain discarded blood from the routine blood work33 34 54 to measure plasma ACE pathway levels (see online supplemental file 1 regarding amendment) and do ordinal logistic regression of the interaction of plasma ACE pathway levels and ARB-exposed or not. For the hospitalisation hypothesis, we will obtain relevant data from SM’s CIHR-funded study: ‘COVID-19: Improving the Evidence to Treat an Emerging Infection’ and do logistic regression for the rates of hospitalisation of ARB-exposed to not ARB-exposed patients in out-patients. For the continuing ARBs or ACEi hypothesis, we will do ordinal logistic regression subgroup analysis in patients on ARBs (or ACEi) when hospitalised to determine whether continuing ARBs (or ACEi, or not) decreases WHO COVID-19 Ordinal Outcome Scale.

Inclusion criteria are individuals over 18 years of age who have confirmed COVID-19 infection (according to local hospital or provincial laboratories clinically approved laboratory testing for COVID-19). ARBs-exposed and ACEi-exposed patients are defined for inclusion by being on ARB or ACE prior to and at the time of the hospital admission for COVID-19. There are no exclusion criteria. We will enrol from 1 January 2020 until the conclusion of the COVID-19 epidemic at the centres in Canada (expected mid to end 2021).

Recruitment and power—sample size estimation

We used published cohorts of hospitalised adults with COVID-19 in China2–4 to determine expected severity and sample size. About 32% have WHO Ordinal Scale criteria 6–8 (vasopressors, ventilation, ECMO, RRT or death). Since about 30% of patients with COVID-19 had cardiovascular disease or hypertension2–4 it is conceivable that a significant proportion of the population could be on ARBs. Assuming that 50% of the 30% with cardiovascular disease are on an ARB, then about 15% of patients of the total cohort would be on an ARB. Ordinal logistic regression will be used to compare the primary outcome—WHO Ordinal Scale for COVID-19—in ARB-exposed versus non-ARB-exposed hospitalised patients. Based on data from three publications (tables 1 and 2), assuming 15% of the patients were ARB-exposed, a total sample size of 497 can detect a proportional OR of 0.5 (table 2, translated change in proportion in each category of the scale) at alpha=0.05 with 80% power for the comparison of WHO scale in five categories (WHO Ordinal Scale categories: 3–4, 5, 6, 7 and 8). The current sample size was selected for feasibility as there was no existing information available to determine the potential effect of ARB exposure on the WHO Ordinal Scale. Calculation was performed using posamsize in the Hmisc package of R 3.6.2 (R Foundation for Statistical Computing, Vienna, Austria).

Table 1.

Numbers of patients and per cent of patients who had WHO Ordinal Scale of 6, 7 or 8 (needed ventilation, vasopressors, RRT, ECMO or who died) in three publications2–4 regarding hospitalised patients in China who had COVID-19 used to derive sample size estimates to detect a one point or greater decrease of the WHO scale of ARB-exposed hospitalised patients compared with a control group of hospitalised patients with no ARB exposure

Publication Admitted to hospital WHO=6 WHO=7 WHO=8 WHO 6–8
Chen—Lancet 99 4 4 11 19
Wang—JAMA 138 17 13 6 36
Huang—Lancet 41 4 3 6 13
Totals 278 25 20 23 68
% 9.0 7.2 8.3 24.5

RRT, renal replacement therapy.

Table 2.

Sample size by proportional OR of ARB-exposed versus non ARB-exposed (five categories for WHO scale)

Proportion of patients Mean score Total sample size*
(by % ARB exposed)
WHO 3–4 WHO 5 WHO 6 WHO 7 WHO 8 All patients† 10% 15% 20% 50%
Non-ARB exposed 0.604 0.151 0.090 0.072 0.083 4.577
ARB exposed
OR=0.7 0.685 0.129 0.071 0.054 0.060 4.330 2656 1875 1494 956
OR=0.6 0.718 0.119 0.064 0.048 0.052 4.237 1295 914 729 466
OR=0.5 0.753 0.107 0.056 0.041 0.043 4.137 704 497 396 253
OR=0.4 0.792 0.093 0.047 0.033 0.035 4.030 403 284 227 145
OR=0.3 0.836 0.076 0.037 0.026 0.026 3.914 233 165 132 84

*Total size sample referred to the total of ARB exposed and non-ARB exposed.

†Assuming patients were evenly distributed across the WHO 3–4 categories.

Exam/visit components, measurements of exposure and disease and other measurements

Our Case Report Form is adapted from the ISARIC WHO Novel Coronavirus (nCoV) Acute Respiratory Infection Clinical Characterisation Data Tool (https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/early-investigations) because measurements are clinically available and our data will align with other studies of COVID-19.

We will record baseline characteristics (age, gender, heart rate, respiratory rate, temperature, blood pressure, SaO2, respiratory (PaO2/FiO2), creatinine and bilirubin, use of oxygen, vasopressors, ventilation and RRT. Use of ARBs is defined by taking an ARB up to within 24 hours of onset of COVID-19 symptoms. We will also record whether ARBs are continued after onset of symptoms and for how long.

The primary outcome is the COVID-19 WHO Ordinal Scale (table 3, J Marshall, personal communication).

Table 3.

WHO 2019-nCoV Ordinal Outcome Scale (J Marshall, personal communication, and Cao and colleagues73)

Uninfected 0 points
Ambulatory—no limitation of activities 1 point
Ambulatory—limitation of activities 2 points
Hospitalised—no oxygen (mild) 3 points
Hospitalised—oxygen (mild) 4 points
Hospitalised (severe) non-invasive ventilation or high-flow oxygen 5 points
Hospitalised (severe) intubation and ventilation 6 points
Hospitalised (severe) ventilation and additional organ support (vasopressors, RRT, ECMO) 7 points
Death 8 points

nCoV, novel coronavirus; RRT, renal replacement therapy.

Secondary outcomes are SOFA score55 (for joint longitudinal modelling), 28-day mortality, hospital length of stay, proportions admitted to ICU, ICU length of stay, need for ventilation, vasopressors and RRT (ie, days alive and free of ventilation, vasopressors and RRT within 14 days56) and severe adverse effects of ARBs. Comparison of ARB-exposed versus non ARB-exposed will be done by ordinal logistic regression analysis for the primary outcome and by logistic regression for binary secondary outcomes. Time to death and hospital length of stay will be analysed simultaneously using competing risk survival analysis. Given the heavily skewed distribution for days alive and free of ventilation/vasopressors/RRT, the comparison of these outcomes will be done based on quantile regression. Patients who die within the first 14 days will be assigned a value of 0 to maximise penalty for non-survival. No adjustment for multiplicity of inferences will be made for the secondary outcomes given the hypothesis generating nature of these analyses.

Adequacy of ARB intervention timing on COVID-19

ARB intervention in our study will have been for months–years before COVID-19 infection, optimising beneficial effects of ARB on COVID-19 replication, inflammation and permeability. In murine models, the ARB losartan was effective when given 30 min before H7N98; recombinant ACE2 was effective when given 3 hours prior, 8 hours and 3 days after murine H5N1.57 Clinicians are often uncertain whether to continue ARBs in patients hospitalised for non-cardiovascular conditions. Thus, in a subgroup analysis of patients already on ARBs when hospitalised, we will evaluate whether continuing ARBs or ACEi (the ARB or ACEi they were already on) or not decreases WHO COVID-19 Ordinal Outcome Scale.

Data management and statistical analyses

DAF vasopressors, ventilation and RRT will be calculated separately by subtracting the number of days on vasopressors, ventilation or RRT from the lesser of 14 or the number of days to death, scored as 1 if the patient is alive and free of vasopressors, ventilation or RRT56 and zero (0) if the patient had vasopressors, ventilation or RRT or is not alive (to maximise non-survival penalty).56

We will evaluate ARB-exposed versus not ARB-exposed and ACEi-exposed and not ACEi-exposed. The ACEi-exposed versus not ACEi-exposed patient analyses will be done exactly as described for the ARBs-exposed versus not ARBs-exposed patients. There will be a third analysis which compares ARB/ACEi versus no ARB/ACEi. All analyses will be adjusted for potential confounders (age, biological sex, blood pressure, and presence of heart failure, hypertension, renal failure and diabetes (the most common comorbidities of 2019 nCoV2–4 associated with increased risk of ICU admission4) using regression techniques rather than matching (eg, Propensity Score) because of the potential limited sample size and the possibility of discarding valuable data due to unmatched cases).

About 25% of patients with COVID-19 have organ dysfunction requiring critical care support. Comparisons of organ dysfunction are susceptible to bias from informative censoring (death, discharge, other competing risks58–61). Joint models handle data that is biassed from informative censoring by simultaneous estimation of two separate regression models with a shared random effect.62 63 Joint modelling of the longitudinal and survival processes allows each model to inform (ie, adjust) the other to mitigate potential biases caused by missing outcomes (eg, death). Joint longitudinal modelling of SOFA requires estimation of an unobserved SOFA trajectory, estimating the SOFA trajectory if there was no informative censoring. The most common joint models are longitudinal (eg, repeated measures or mixed-effects models) and time-to-event (survival) models.

We will compare ARB-exposed to not ARB-exposed patients’ SOFA score by fitting (i) a traditional linear mixed-effects model (ie, longitudinal model with a participant random-intercept) and (ii) several joint longitudinal and survival models of SOFA scores over time.64 Time-to-event survival data will be modelled using a Cox proportional hazards model for death; discharge and day 14 will be considered censoring events in death-specific Cox model. Shared random effects will be used to capture the association between the longitudinal and time-to-event models. We will explore multiple model specifications for the joint model by varying the functional form of time in both the fixed effects in the longitudinal component and the shared random effects specifications. For instance, we will test linear and quadratic effects, and spline terms with an increasing number of knots (up to 7 and 2 for the fixed effect and random effect of time, respectively). We will select the final model according to the Akaike Information Criterion and Bayesian Information Criterion. Standard errors for the coefficients of the joint model will be estimated via 1000 bootstrap replications, resampling at a participant level. We will test for the modification of treatment by study time by including an interaction term in the longitudinal submodel and by testing its significance using the Wald test. Finally, we will perform several sensitivity analyses to assess the robustness of our findings including fitting a joint model accounting for the competing risk of discharge. All models will be estimated using the joineRML package V.0.4.2 in the statistical software R.65 Joint models for longitudinal and survival data can also be implemented in other statistical software such as Stata66 and SAS.67

We collate in real time and evaluate the the most common severe adverse effects of ARBs: hypotension (systolic pressure <90 mm Hg or mean arterial pressure <65 mm Hg), hyperkalemia (potassium >6 mmol/L) and AKI (creatinine >200 mmol/L) comparing ARB-exposed with not ARB-exposed patients.

We will examine missing data fields to identify the type of missing data mechanisms. Most data will be missing at random; thus, as a sensitivity analysis, we will use multiple imputation technique to impute the missing data.68 69 Some data will be ‘informatively’ missing due to clinically relevant events: for example, death, discharge so we will examine statistical models to account for missing not at random (eg, joint longitudinal and time-to-event models,63 and inverse probability of censoring weighting70).

We will evaluate ARB-exposed versus not ARB-exposed, ACEi-exposed versus not ACEi-exposed and ARB/ACEi-exposed vs not ARB/ACEi-exposed in1 (1) heart failure and hypertension RRT and2 (2) patients who do or do not have ARB continued after hospital admission for the primary outcome and DAF vasopressors, ventilation and RRT. Sensitivity analyses will be carried out with adequate adjustments for missing data using multiple imputations technique as described above. The potential bias is that ARBs are not assigned randomly but are given for treatment of hypertension or heart failure thus having a poorer COVID-19 prognosis. We mitigate this bias by doing ordinal logistic regression adjusted analyses to control for confounding by indication and control for variables that increase risk of poor outcomes. We will do analyses that assess the potential of unmeasured confounding (eg, E-value and other recently developed techniques71 72).

Quality assurance and control plans

We will monitor 15% of eCRFs against key primary data. We have a weekly 2-hour Management Committee meeting in which data quality and control is a regular agenda item.

Patient and public involvement

The development of the research question, outcome measures and design was not informed by patients’ priorities, experience and preferences. Patients were not involved in the recruitment to and conduct of the study because this is an inpatient hospital-based cohort study. Patients will be included without consent and all data are anonymised so that patients cannot be informed of the results of the study. Patients will be included in the interpretation and dissemination of results through a relationship with the British Columbia Support Unit.

There are limitations of our study. In this association study we cannot determine causation but will add further evidence regarding ARBs or ACEi use in COVID-19 as a foundation for future RCTs in COVID-19 and other viral epidemics caused by viruses that bind ACE2. Another potential limitation is inadequate sample size. The use of ARBs by COVID-19-infected patients may not be adequately large; yet, 50% of hospitalised patients with COVID-19 had comorbidities56 40% cardiovascular or cerebrovascular disease2 in which ARBs are commonly prescribed. There is potential bias regarding ARB confounding by indication that we limit by doing1 (1) ordinal logistic regression analyses,2 (2) sensitivity analyses and3 (3) subgroup analyses to examine consistency of effects of ARBs on COVID-19 outcomes.

RCT(s) of ARBs in COVID-19 are now warranted and we are pleased to indicate that we have been funded by the CIHR for a multicentre randomised controlled trial of an ARB in COVID-19.

Ethics and dissemination

This study has core institution approval by the Providence Healthcare and University of British Columbia Human Research Committee and individual site institutional approvals. Results will be disseminated by peer-review publication and social media releases.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @srinmurthy99

Contributors: JR wrote the CIHR grant that led to this manuscript, the first draft and the final drafts of this manuscript. JCM, SM, DS, AS, TL, JS, DP, BD, ZP, MC and MOH contributed to the manuscript and to the CIHR grant that led to this manuscript. KDB contributed to the manuscript.

Funding: This study is funded by a grant from the Canadian Institutes of Health Research (CIHR #439993). John Boyd is a recipient of a Providence Health Care Research Scholarship. Keith Walley is supported by Canadian Institutes of Health Research (CIHR) Foundation Grant FDN 154311.

Competing interests: JR reports patents owned by the University of British Columbia (UBC) that are related to the use of PCSK9 inhibitor(s) in sepsis, and related to the use of vasopressin in septic shock and a patent owned by Ferring for use of selepressin in septic shock. JR is an inventor on these patents. JR was a founder, Director and shareholder in Cyon Therapeutics Inc. and is a shareholder in Molecular You Corp. JR reports receiving consulting fees in the last 3 years from: (1) Asahi Kesai Pharmaceuticals of America (AKPA) (was developing recombinant thrombomodulin in sepsis). (2) SIB Therapeutics LLC (developing a sepsis drug). (3) Ferring Pharmaceuticals (manufactures vasopressin and developing selepressin). JR is no longer actively consulting for the following: (4) La Jolla Pharmaceuticals (developing angiotensin II; JR chaired the DSMB of a trial of angiotensin II from 2015–2017). (5) PAR Pharma (sells prepared bags of vasopressin). JR reports having received an investigator-initiated grant from Grifols (entitled 'Is HBP a mechanism of albumin’s efficacy in human septic shock?') that was provided to and administered by UBC.

Patient consent for publication: Not required.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

References

  • 1.Yang X, Yu Y, Xu J, et al. . Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study. Lancet Respir Med 2020;8:475–81. 10.1016/S2213-2600(20)30079-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Chen N, Zhou M, Dong X, et al. . Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. Lancet 2020;395:507–13. 10.1016/S0140-6736(20)30211-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Huang C, Wang Y, Li X, et al. . Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Wang D, Hu B, Hu C, et al. . Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA 2020;323:1061. 10.1001/jama.2020.1585 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Grein J, Ohmagari N, Shin D, et al. . Compassionate use of Remdesivir for patients with severe Covid-19. N Engl J Med 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Fedson DS. Treating the host response to emerging virus diseases: lessons learned from sepsis, pneumonia, influenza and Ebola. Ann Transl Med 2016;4:421. 10.21037/atm.2016.11.03 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Yan Y, Liu Q, Li N, et al. . Angiotensin II receptor blocker as a novel therapy in acute lung injury induced by avian influenza A H5N1 virus infection in mouse. Sci China Life Sci 2015;58:208–11. 10.1007/s11427-015-4814-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Yang P, Gu H, Zhao Z, et al. . Angiotensin-Converting enzyme 2 (ACE2) mediates influenza H7N9 virus-induced acute lung injury. Sci Rep 2014;4:7027. 10.1038/srep07027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Kaukonen K-M, Bailey M, Suzuki S, et al. . Mortality related to severe sepsis and septic shock among critically ill patients in Australia and New Zealand, 2000-2012. JAMA 2014;311:1308–16. 10.1001/jama.2014.2637 [DOI] [PubMed] [Google Scholar]
  • 10.Máca J, Jor O, Holub M, et al. . Past and present ARDS mortality rates: a systematic review. Respir Care 2017;62:113–22. 10.4187/respcare.04716 [DOI] [PubMed] [Google Scholar]
  • 11.Wrapp D, Wang N, Corbett KS, et al. . Cryo-Em structure of the 2019-nCoV spike in the prefusion conformation. Science 2020;367:1260–3. 10.1126/science.abb2507 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Zhang H, Penninger JM, Li Y, et al. . Angiotensin-Converting enzyme 2 (ACE2) as a SARS-CoV-2 receptor: molecular mechanisms and potential therapeutic target. Intensive Care Med 2020;46:586–90. 10.1007/s00134-020-05985-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hoffmann M, Kleine-Weber H, Schroeder S, et al. . SARS-CoV-2 cell entry depends on ACE2 and TMPRSS2 and is blocked by a clinically proven protease inhibitor. Cell 2020;181:271–80. 10.1016/j.cell.2020.02.052 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.de Roquetaillade C, Jamme M, Charpentier J, et al. . Hemodynamic impact of cardiovascular antihypertensive medications in patients with sepsis-related acute circulatory failure. Shock 2020;54:315–20. 10.1097/SHK.0000000000001524 [DOI] [PubMed] [Google Scholar]
  • 15.Hsieh MS, How CK, Hsieh VC, et al. . Preadmission antihypertensive drug use and sepsis outcome: impact of angiotensin-converting enzyme inhibitors (ACEIs) and angiotensin receptor blockers (Arbs). Shock 2019. [DOI] [PubMed] [Google Scholar]
  • 16.Hsu W-T, Galm BP, Schrank G, et al. . Effect of renin-angiotensin-aldosterone system inhibitors on short-term mortality after sepsis: a population-based cohort study. Hypertension 2020;75:483–91. 10.1161/HYPERTENSIONAHA.119.13197 [DOI] [PubMed] [Google Scholar]
  • 17.Mortensen EM, Restrepo MI, Copeland LA, et al. . Impact of previous statin and angiotensin II receptor blocker use on mortality in patients hospitalized with sepsis. Pharmacotherapy 2007;27:1619–26. 10.1592/phco.27.12.1619 [DOI] [PubMed] [Google Scholar]
  • 18.Henry BM, Vikse J, Benoit S, et al. . Hyperinflammation and derangement of renin-angiotensin-aldosterone system in COVID-19: a novel hypothesis for clinically suspected hypercoagulopathy and microvascular immunothrombosis. Clin Chim Acta 2020;507:167–73. 10.1016/j.cca.2020.04.027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Zhou F, Yu T, Du R, et al. . Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet 2020;395:1054–62. 10.1016/S0140-6736(20)30566-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Yin S, Huang M, Li D, et al. . Difference of coagulation features between severe pneumonia induced by SARS-CoV2 and non-SARS-CoV2. J Thromb Thrombolysis 2020. 10.1007/s11239-020-02105-8. [Epub ahead of print: 03 Apr 2020]. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.D'Elia JA, Bayliss G, Gleason RE, et al. . Cardiovascular-renal complications and the possible role of plasminogen activator inhibitor: a review. Clin Kidney J 2016;9:705–12. 10.1093/ckj/sfw080 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Koh KK, Chung W-J, Ahn JY, et al. . Angiotensin II type 1 receptor blockers reduce tissue factor activity and plasminogen activator inhibitor type-1 antigen in hypertensive patients: a randomized, double-blind, placebo-controlled study. Atherosclerosis 2004;177:155–60. 10.1016/j.atherosclerosis.2004.07.008 [DOI] [PubMed] [Google Scholar]
  • 23.Liu J, Sun N-L, Yang J, et al. . Effects of losartan on fibrinolytic parameters and von Willebrand factor in Chinese subjects with hypertension: a comparative study versus atenolol. J Int Med Res 2009;37:595–600. 10.1177/147323000903700301 [DOI] [PubMed] [Google Scholar]
  • 24.Sarzani R, Giulietti F, Di Pentima C, et al. . Disequilibrium between the classic renin-angiotensin system and its opposing arm in SARS-CoV-2-related lung injury. Am J Physiol Lung Cell Mol Physiol 2020;319:L325–36. 10.1152/ajplung.00189.2020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Ferrario CM, Jessup J, Chappell MC, et al. . Effect of angiotensin-converting enzyme inhibition and angiotensin II receptor blockers on cardiac angiotensin-converting enzyme 2. Circulation 2005;111:2605–10. 10.1161/CIRCULATIONAHA.104.510461 [DOI] [PubMed] [Google Scholar]
  • 26.Leung AKK, Genga KR, Topchiy E, et al. . Reduced proprotein convertase subtilisin/kexin 9 (PCSK9) function increases lipoteichoic acid clearance and improves outcomes in gram positive septic shock patients. Sci Rep 2019;9:10588. 10.1038/s41598-019-46745-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Topchiy E, Cirstea M, Kong HJ, et al. . Lipopolysaccharide is cleared from the circulation by hepatocytes via the low density lipoprotein receptor. PLoS One 2016;11:e0155030. 10.1371/journal.pone.0155030 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Walley KR, Francis GA, Opal SM, et al. . The central role of proprotein convertase subtilisin/kexin type 9 in septic pathogen lipid transport and clearance. Am J Respir Crit Care Med 2015;192:1275–86. 10.1164/rccm.201505-0876CI [DOI] [PubMed] [Google Scholar]
  • 29.Genga KR, Trinder M, Kong HJ, et al. . Cetp genetic variant rs1800777 (allele a) is associated with abnormally low HDL-C levels and increased risk of AKI during sepsis. Sci Rep 2018;8:16764. 10.1038/s41598-018-35261-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Roveran Genga KTM, Kong HJ, Leung AKK, et al. . Cholesterylester transfer protein (CETP) genotype R468Q is associated with increased risk of sepsis-associated acute kidney injury (AKI). Sci Reports 2018. [Google Scholar]
  • 31.Trinder M, Genga KR, Kong HJ, et al. . Cholesteryl ester transfer protein influences high-density lipoprotein levels and survival in sepsis. Am J Respir Crit Care Med 2019;199:854–62. 10.1164/rccm.201806-1157OC [DOI] [PubMed] [Google Scholar]
  • 32.Nakada T-aki, Russell JA, Boyd JH, et al. . Association of angiotensin II type 1 receptor-associated protein gene polymorphism with increased mortality in septic shock. Crit Care Med 2011;39:1641–8. 10.1097/CCM.0b013e318218665a [DOI] [PubMed] [Google Scholar]
  • 33.Nakada T-A, Russell JA, Wellman H, et al. . Leucyl/cystinyl aminopeptidase gene variants in septic shock. Chest 2011;139:1042–9. 10.1378/chest.10-2517 [DOI] [PubMed] [Google Scholar]
  • 34.Nakada T-A, Russell JA, Boyd JH, et al. . Beta2-Adrenergic receptor gene polymorphism is associated with mortality in septic shock. Am J Respir Crit Care Med 2010;181:143–9. 10.1164/rccm.200903-0332OC [DOI] [PubMed] [Google Scholar]
  • 35.Danser AHJ, Epstein M, Batlle D. Renin-Angiotensin system blockers and the COVID-19 pandemic: at present there is no evidence to abandon renin-angiotensin system blockers. Hypertension 2020;75:1382–5. 10.1161/HYPERTENSIONAHA.120.15082 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Patel AB, Verma A. COVID-19 and angiotensin-converting enzyme inhibitors and angiotensin receptor blockers: what is the evidence? JAMA 2020;323:1769–70. 10.1001/jama.2020.4812 [DOI] [PubMed] [Google Scholar]
  • 37.Vaduganathan M, Vardeny O, Michel T, et al. . Renin-Angiotensin-Aldosterone system inhibitors in patients with Covid-19. N Engl J Med 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Li J, Wang X, Chen J, et al. . Association of renin-angiotensin system inhibitors with severity or risk of death in patients with hypertension hospitalized for coronavirus disease 2019 (COVID-19) infection in Wuhan, China.. JAMA Cardiol 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Mehra MR, Desai SS, Kuy S, et al. . Cardiovascular disease, drug therapy, and mortality in Covid-19. N Engl J Med 2020. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
  • 40.Zhang X, Yu J, Pan L-Y, et al. . ACEI/ARB use and risk of infection or severity or mortality of COVID-19: a systematic review and meta-analysis. Pharmacol Res 2020;158:104927. 10.1016/j.phrs.2020.104927 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Zhang P, Zhu L, Cai J, et al. . Association of inpatient use of angiotensin converting enzyme inhibitors and angiotensin II receptor blockers with mortality among patients with hypertension hospitalized with COVID-19. Circ Res 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Feng Y, Ling Y, Bai T, et al. . COVID-19 with different severity: a multi-center study of clinical features.. Am J Respir Crit Care Med 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Kuba K, Imai Y, Rao S, et al. . A crucial role of angiotensin converting enzyme 2 (ACE2) in SARS coronavirus-induced lung injury. Nat Med 2005;11:875–9. 10.1038/nm1267 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Liu Y, Yang Y, Zhang C, et al. . Clinical and biochemical indexes from 2019-nCoV infected patients linked to viral loads and lung injury. Sci China Life Sci 2020;63:364–74. 10.1007/s11427-020-1643-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Huang F, Guo J, Zou Z, et al. . Angiotensin II plasma levels are linked to disease severity and predict fatal outcomes in H7N9-infected patients. Nat Commun 2014;5:3595. 10.1038/ncomms4595 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Nerenberg KA, Zarnke KB, Leung AA, et al. . Hypertension Canada's 2018 guidelines for diagnosis, risk assessment, prevention, and treatment of hypertension in adults and children. Can J Cardiol 2018;34:506–25. 10.1016/j.cjca.2018.02.022 [DOI] [PubMed] [Google Scholar]
  • 47.Johansen ME, Yun J, Griggs JM, et al. . Anti-Hypertensive medication combinations in the United States. J Am Board Fam Med 2020;33:143–6. 10.3122/jabfm.2020.01.190134 [DOI] [PubMed] [Google Scholar]
  • 48.Murphy DP, Drawz PE, Foley RN. Trends in angiotensin-converting enzyme inhibitor and angiotensin II receptor blocker use among those with impaired kidney function in the United States. J Am Soc Nephrol 2019;30:1314–21. 10.1681/ASN.2018100971 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Ibrahim SL, Jiroutek MR, Holland MA, et al. . Utilization of angiotensin converting enzyme inhibitors (ACEI) and angiotensin receptor blockers (ARB) in patients diagnosed with diabetes: analysis from the National ambulatory medical care survey. Prev Med Rep 2016;3:166–70. 10.1016/j.pmedr.2016.01.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Ezekowitz JA, O'Meara E, McDonald MA, et al. . 2017 comprehensive update of the Canadian cardiovascular Society guidelines for the management of heart failure. Can J Cardiol 2017;33:1342–433. 10.1016/j.cjca.2017.08.022 [DOI] [PubMed] [Google Scholar]
  • 51.Chiu MH, Miller RJH, Barry R, et al. . Kidney function, ACE-Inhibitor/Angiotensin receptor blocker use, and survival following hospitalization for heart failure: a cohort study. Can J Kidney Health Dis 2018;5:2054358118804838. 10.1177/2054358118804838 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Ghimire R, Dhungana SP. Evaluation of drugs used in chronic heart failure at tertiary care centre: a hospital based study. J Cardiovasc Thorac Res 2019;11:79–84. 10.15171/jcvtr.2019.15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Tran RH, Aldemerdash A, Chang P, et al. . Guideline-Directed medical therapy and survival following hospitalization in patients with heart failure. Pharmacotherapy 2018;38:406–16. 10.1002/phar.2091 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Walley KR, Russell JA. Protein C -1641 AA is associated with decreased survival and more organ dysfunction in severe sepsis. Crit Care Med 2007;35:12–17. 10.1097/01.CCM.0000249823.44726.4E [DOI] [PubMed] [Google Scholar]
  • 55.Vincent JL, Moreno R, Takala J, et al. . The SOFA (sepsis-related organ failure assessment) score to describe organ dysfunction/failure. on behalf of the Working group on sepsis-related problems of the European Society of intensive care medicine. Intensive Care Med 1996;22:707–10. 10.1007/BF01709751 [DOI] [PubMed] [Google Scholar]
  • 56.Russell JA, Lee T, Singer J, et al. . Days alive and free as an alternative to a mortality outcome in pivotal vasopressor and septic shock trials. J Crit Care 2018;47:333–7. 10.1016/j.jcrc.2018.05.003 [DOI] [PubMed] [Google Scholar]
  • 57.Zou Z, Yan Y, Shu Y, et al. . Angiotensin-Converting enzyme 2 protects from lethal avian influenza A H5N1 infections. Nat Commun 2014;5:3594. 10.1038/ncomms4594 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Wang C, Scharfstein DO, Colantuoni E, et al. . Inference in randomized trials with death and missingness. Biometrics 2017;73:431–40. 10.1111/biom.12594 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Colantuoni E, Scharfstein DO, Wang C, et al. . Statistical methods to compare functional outcomes in randomized controlled trials with high mortality. BMJ 2018;360:j5748. 10.1136/bmj.j5748 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Hernán MA, Robins JM. Causal inference. Boca Raton: Chapman & Hall/CRC, 2017. [Google Scholar]
  • 61.McConnell S, Stuart EA, Devaney B. The truncation-by-death problem: what to do in an experimental evaluation when the outcome is not always defined. Eval Rev 2008;32:157–86. 10.1177/0193841X07309115 [DOI] [PubMed] [Google Scholar]
  • 62.Asar Özgür, Ritchie J, Kalra PA, et al. . Joint modelling of repeated measurement and time-to-event data: an introductory tutorial. Int J Epidemiol 2015;44:334–44. 10.1093/ije/dyu262 [DOI] [PubMed] [Google Scholar]
  • 63.Ibrahim JG, Chu H, Chen LM. Basic concepts and methods for joint models of longitudinal and survival data. J Clin Oncol 2010;28:2796–801. 10.1200/JCO.2009.25.0654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Henderson R, Diggle P, Dobson A. Joint modelling of longitudinal measurements and event time data. Biostatistics 2000;1:465–80. 10.1093/biostatistics/1.4.465 [DOI] [PubMed] [Google Scholar]
  • 65.Hickey GL, Philipson P, Jorgensen A, et al. . joineRML: a joint model and software package for time-to-event and multivariate longitudinal outcomes. BMC Med Res Methodol 2018;18:50. 10.1186/s12874-018-0502-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Crowther MJ, Abrams KR, Lambert PC. Joint modeling of longitudinal and survival data. Stata Journal 2013;13:165–84. [Google Scholar]
  • 67.Zhang D, Chen M-H, Ibrahim JG, et al. . JMFit: a SAS macro for joint models of longitudinal and survival data. J Stat Softw 2016;71:1–3. 10.18637/jss.v071.i03 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Little RJ, D'Agostino R, Cohen ML, et al. . The prevention and treatment of missing data in clinical trials. N Engl J Med 2012;367:1355–60. 10.1056/NEJMsr1203730 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.O'Neill RT, Temple R. The prevention and treatment of missing data in clinical trials: an FDA perspective on the importance of dealing with it. Clin Pharmacol Ther 2012;91:550–4. 10.1038/clpt.2011.340 [DOI] [PubMed] [Google Scholar]
  • 70.Hernán MA, Robins JM. Estimating causal effects from epidemiological data. J Epidemiol Community Health 2006;60:578–86. 10.1136/jech.2004.029496 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Kasza J, Wolfe R, Schuster T. Assessing the impact of unmeasured confounding for binary outcomes using confounding functions. Int J Epidemiol 2017;46:1303–11. 10.1093/ije/dyx023 [DOI] [PubMed] [Google Scholar]
  • 72.VanderWeele TJ, Ding P. Sensitivity analysis in observational research: introducing the E-Value. Ann Intern Med 2017;167:268–74. 10.7326/M16-2607 [DOI] [PubMed] [Google Scholar]
  • 73.Cao B, Wang Y, Wen D, et al. . A trial of Lopinavir-Ritonavir in adults hospitalized with severe Covid-19. N Engl J Med 2020;382:1787–99. 10.1056/NEJMoa2001282 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2020-040768supp001.pdf (19.1KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES