Abstract
Background
We compared the efficacy of the antiviral agent, remdesivir, versus standard-of-care treatment in adults with severe coronavirus disease 2019 (COVID-19) using data from a phase 3 remdesivir trial and a retrospective cohort of patients with severe COVID-19 treated with standard of care.
Methods
GS-US-540–5773 is an ongoing phase 3, randomized, open-label trial comparing two courses of remdesivir (remdesivir-cohort). GS-US-540–5807 is an ongoing real-world, retrospective cohort study of clinical outcomes in patients receiving standard-of-care treatment (non-remdesivir-cohort). Inclusion criteria were similar between studies: patients had confirmed severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, were hospitalized, had oxygen saturation ≤94% on room air or required supplemental oxygen, and had pulmonary infiltrates. Stabilized inverse probability of treatment weighted multivariable logistic regression was used to estimate the treatment effect of remdesivir versus standard of care. The primary endpoint was the proportion of patients with recovery on day 14, dichotomized from a 7-point clinical status ordinal scale. A key secondary endpoint was mortality.
Results
After the inverse probability of treatment weighting procedure, 312 and 818 patients were counted in the remdesivir- and non-remdesivir-cohorts, respectively. At day 14, 74.4% of patients in the remdesivir-cohort had recovered versus 59.0% in the non-remdesivir-cohort (adjusted odds ratio [aOR] 2.03: 95% confidence interval [CI]: 1.34–3.08, P < .001). At day 14, 7.6% of patients in the remdesivir-cohort had died versus 12.5% in the non-remdesivir-cohort (aOR 0.38, 95% CI: .22–.68, P = .001).
Conclusions
In this comparative analysis, by day 14, remdesivir was associated with significantly greater recovery and 62% reduced odds of death versus standard-of-care treatment in patients with severe COVID-19.
Clinical Trials Registration
NCT04292899 and EUPAS34303.
Keywords: SARS-CoV-2, severe COVID-19, remdesivir, antiviral treatment
In this comparative analysis, remdesivir was associated with significantly lower mortality and higher recovery than standard-of-care treatment without remdesivir in patients with severe COVID-19. Ongoing studies will further determine the utility of remdesivir for the treatment of severe COVID-19.
(See the Editorial Commentary by Gandhi on pages e4175–8.)
Coronavirus disease 2019 (COVID-19) is a major global public health and socioeconomic crisis, with over 18 million cases identified worldwide and more than 700 000 deaths (as of 06 Aug 2020) [1]. As a result, considerable international efforts are underway to find effective treatments involving multiple possible mechanisms. No therapy was fully approved for the treatment of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection at the time of writing. Remdesivir, a prodrug of an adenosine analog that inhibits viral RNA dependent RNA polymerase [2], was recently granted Emergency Use Authorization by the US Food and Drug Administration [3]. Remdesivir has in vitro activity against SARS-CoV-2 [4, 5], and early clinical data suggest promise as a treatment for COVID-19 [6–8]. Preliminary reported findings from the randomized National Institute of Allergy and Infectious Diseases (NIAID) Adaptive COVID-19 Treatment Trial indicated benefits of a 10-day course of remdesivir versus placebo, including significantly faster (32%) recovery time and numerically lower mortality [8]. Additionally, an open-label, randomized clinical trial (GS-US-540–5773) comparing 2 remdesivir courses demonstrated that outcomes of 5-day and 10-day regimens of remdesivir were not significantly different and had acceptable safety [7]. Although a randomized study in China failed to demonstrate statistically significant clinical benefit of remdesivir [9]. the study was underpowered because of lack of enrollment and early study closure due to local disease control [10]. Although additional comparative trials are ongoing, data comparing remdesivir to standard of care remain limited.
We compared the efficacy of remdesivir, using data from the prospective GS-US-540–5773 randomized trial to a concurrent, retrospective cohort of patients with severe COVID-19 not treated with remdesivir using the stabilized inverse probability of treatment weighting (IPTW) method.
METHODS
Study Design
We compared interim data from 2 ongoing studies. First, a phase 3, randomized, open-label study comparing 2 doses of intravenous remdesivir in patients with severe COVID-19 (NCT04292899/GS-US-540–5773 [hereafter study 5773]) was conducted at 45 sites in the United States, Italy, Spain, Germany, Hong Kong, Singapore, South Korea, and Taiwan [7]. The first patient visit for this study was 9 March 2020. The planned analysis cutoff date was 10 April 2020; an extension is ongoing. Patients were randomized 1:1 to receive: standard-of-care treatment (subject to clinical practice stipulated by individual sites) plus remdesivir 200 mg on day 1, followed by remdesivir 100 mg daily on days 2–5; or standard of care plus remdesivir 200 mg on day 1, followed by remdesivir 100 mg daily on days 2–10 (remdesivir-cohort). Because safety and efficacy were not significantly different between doses [7], data from both arms were combined for the present analysis. Study 5773 was approved by the institutional review board or independent ethics committee at each participating site and was conducted in accordance with the principles of the Declaration of Helsinki and the International Conference on Harmonization–Good Clinical Practice guidelines. All patients provided written informed consent.
The second study is a real-world, retrospective, longitudinal cohort study of clinical outcomes in adults with severe COVID-19 (EUPAS34303/GS-US-540–5807 [hereafter study 5807]) conducted at 16 sites in the United States, United Kingdom, Belgium, Singapore, and South Korea. The first hospitalization occurred on 6 February 2020 with an interim analysis cutoff of 10 April 2020. Patients received standard-of-care treatment according to local clinical practice at that time (non-remdesivir-cohort). This study was developed to align with study 5773 in terms of study design, patient eligibility, and outcomes. Study 5807 complies with Good Pharmacoepidemiology Practice and Good Pharmacovigilance Practice.
Patients
Detailed methods for study 5773 have been reported [7]. Briefly, hospitalized patients included in the interim analysis were at least 18 years of age with SARS-CoV-2 infection confirmed by polymerase chain reaction (PCR). Patients had oxygen saturation (SpO2) of ≤94% on room air or required supplemental oxygen, and all had radiographic evidence of pulmonary infiltrates. Patients were excluded if they were receiving medications that may potentially treat COVID-19 (see Supplementary Digital Content 6) at entry, but some received these treatments during the study. Patients on mechanical ventilation at screening were excluded; however, 13 patients who required ventilation between screening and the start of remdesivir treatment were included.
Study 5807 inclusion criteria were designed to align with those of study 5773. Patients were 18 years of age or older with SARS-CoV-2 infection confirmed by PCR. Patients were hospitalized, with SpO2 of ≤94% on room air or required supplemental oxygen, with radiographic evidence of pulmonary infiltrates, and did not receive remdesivir. Exclusion criteria were retroactively applied to study 5807 to ensure the 2 study populations were comparable. These exclusions were: veno-arterial extracorporeal membrane oxygenation on day 1; alanine transferase or aspartate transferase >5 times the upper limit of normal; creatinine clearance <50 mL/min using the Cockcroft-Gault formula at day 1; and being pregnant or breastfeeding. Patients were allowed to receive medications that may potentially treat COVID-19, excluding remdesivir.
Endpoints and Assessments
Study 5773 individual study endpoints and assessments have been reported [7]. In study 5807, the coprimary endpoints are clinical status assessed by a 7-point ordinal scale on day 14 (1 = death, 7 = discharged alive; Table 1) and all-cause mortality at day 28, which were not assessed in this interim analysis. Other endpoints, assessments, and data abstraction/management are detailed in Supplementary Digital Content 2.
Table 1.
Ordinal Scale of Clinical Status and Definition of Recovery
| Score | Status | Status Score at Baseline | Recovery Score Required at Day 14 |
|---|---|---|---|
| 1 | Death | NA | NA |
| 2 | Hospitalized, on invasive mechanical ventilation or ECMO | 2 | 5–7 |
| 3 | Hospitalized, on noninvasive ventilation or high-flow oxygen devices | 3 | 5–7 |
| 4 | Hospitalized, requiring low-flow supplemental oxygen | 4 | 5–7 |
| 5 | Hospitalized, not requiring supplemental oxygen (ie, breathing room air), but requiring ongoing medical care | 5 | 6–7 |
| 6 | Hospitalized, not requiring supplemental oxygen (ie, breathing room air) or ongoing medical care | 6 | 7 |
| 7 | Not hospitalized | NA | NA |
Recovery was defined as having a score of 5–7 points for patients with a baseline score of 2–4, or a score of 6–7 for patients with a baseline score of 5, or a score of 7 for patients with a baseline score of 6.
Abbreviations: ECMO, extracorporeal membrane oxygenation; NA, not applicable.
Interim data from study 5773 and study 5807, reported herein, were compared in a prespecified analysis, with a focus on efficacy alone. The primary endpoint in this planned interim analysis was recovery on day 14, based on the 7-point ordinal scale: improvement to a score of 5–7 for baseline of 2–4, 6 or 7 for baseline score of 5, and 7 for baseline score of 6 (Table 1; see Supplementary Digital Content 2 for rationale for selecting this endpoint). Secondary endpoints of the interim analysis include death at day 14; clinical improvement on day 14 (2-point improvement in score or discharged alive); and 1-point or more improvement in clinical status on day 14.
Safety analyses for study 5773 have been described [7]. Safety data were not collected for study 5807.
Statistical Analysis
The planned sample size of study 5773 was 400 patients [7]. As data for study 5807 were collected concurrently with study 5773 enrollment, and the remdesivir-cohort disease characteristics were unknown, we originally planned to identify up to 2000 eligible patients in study 5807 to have a sufficient sample for analyses based on propensity score. The full analysis set for the comparison included all eligible patients enrolled from study start to cutoff date in both studies, with their propensity scores within the common support region of both treatment cohorts. Included patients from study 5773 also had to receive at least 1 dose of remdesivir; additional exclusion criteria were retroactively applied to study 5807 (as described above). Patients from Italian sites in study 5773 were excluded, an a priori decision based on lack of comparative patients in study 5807 and given differences in mortality outcomes seen in Italy compared to other sites (see Supplemental Digital Content 4 for rationale). In study 5773 and study 5807, day 1 was defined as randomization and hospital admission, respectively.
Because the 2 cohorts were from 2 different studies and were not randomized, imbalance in baseline characteristics may have existed that could confound the interpretation of a potential treatment effect of remdesivir. To approximate a randomized clinical trial and reduce selection bias, propensity score methods that aim to make treated and untreated groups as comparable as possible were used. The propensity score is defined as the probability of treatment assignment conditional on the observed baseline characteristics and was calculated using a logistic regression model with treatment assignment (remdesivir vs no remdesivir) as the dependent variable and the following observed baseline characteristics as the independent variables: age, sex, race, region (US, Ex-US), obesity, medical history (yes vs no for hypertension, cardiovascular disease, diabetes mellitus, chronic obstructive pulmonary disease, and asthma), medications used to treat COVID-19, and baseline clinical status (7-point ordinal scale).
As the study objective was to estimate the treatment effect of remdesivir versus standard of care on the entire study population, a weighted analysis was adopted over a matched approach to minimize losses in sample size (and thus statistical power). Under the average treatment effect framework, the stabilized IPTW method was used after trimming the patients in either cohort whose propensity scores fell out of the common support region of the propensity score distribution. The sample created using IPTW assumes that the distribution of baseline characteristics is independent of treatment assignment in order to yield the average treatment effect [11]. Balance was verified by assessing various metrics including the absolute standardized differences of the independent variables included in the model to estimate the propensity score. Hydroxychloroquine was widely used to treat COVID-19 in the United States starting in March 2020. Because hydroxychloroquine use was discouraged in study 5773, hydroxychloroquine use was not balanced between the 2 cohorts before weighting. The addition of hydroxychloroquine to the IPTW resulted in further imbalance in other prognostic factors, especially the baseline clinical status, which suggests that the treatment decision of hydroxychloroquine was made differently in the 2 cohorts. We performed the primary analysis excluding hydroxychloroquine from the propensity score and confirmed the robustness of the primary analysis with a sensitivity analysis including hydroxychloroquine in the propensity score.
The proportion of patients with recovery on day 14 was analyzed through a multivariable logistic regression model using IPTW weighted likelihood, including treatment group as the independent variable and all the baseline factors in the aforementioned propensity score calculation model as covariates. Moreover, stepwise model selection was performed with nonsignificant covariates removed from the final weighted logistic regression model. Hydroxychloroquine was included in both primary and sensitivity weighted logistic regression models.
Secondary endpoints were analyzed in the same way as the primary endpoint.
If an ongoing hospitalized patient (alive and not discharged) or a patient discharged or transferred to hospice or another facility had a missing clinical status at a visit, the last available postbaseline clinical status before the visit with a missing value was used for that visit. All other analyses were based on complete cases analysis. SAS® Version 9.4 (SAS Institute Inc., Cary, NC, USA) was used.
RESULTS
Study Population
Of 397 patients who received remdesivir in study 5773, 298 were included in this analysis (remdesivir-cohort), whereas 816 were included from study 5807 (non-remdesivir-cohort) (Figure 1). After applying the IPTW method, as expected, modest changes in the apparent sample size were noted [12], and 312 and 818 patients were analyzed in the remdesivir- and non-remdesivir-cohorts, respectively. All outcomes are reported for this weighted analysis group (see Supplemental Digital Content 7 for further explanation of weighting methods).
Figure 1.
Study population. *Based on IPTW, the number of patients in the remdesivir and non-remdesivir cohorts were modestly different from the original sample size (some patients weighted more, and some patients weighted less based on the patients’ propensity scores). Abbreviations: IPTW, stabilized inverse probability of treatment weighting method; OSA, ordinal scale assessment.
Table 2 summarizes baseline demographics, disease characteristics, and concomitant medications for COVID-19 before and after applying IPTW. Baseline characteristics were balanced between the 2 cohorts after weighting for the factors included in the propensity score model described in the statistical analysis section (see Supplemental Digital Content 5). However, because hydroxychloroquine was not included in the propensity weighting (see statistical methods), imbalance was present even after weighting.
Table 2.
Demographics and Baseline Disease Characteristics, Before and After Stabilized Inverse Probability of Treatment Weighting
| Cohort Before Inverse Probability Weighting | Cohort After Inverse Probability Weightingd | |||
|---|---|---|---|---|
| Remdesivir-cohort (N = 298) | Non-remdesivir-cohort (N = 816) | Remdesivir-cohort (N = 312) | Non-remdesivir-cohort (N = 818) | |
| Age, % | ||||
| <40 years | 11 | 11 | 10 | 11 |
| 40–64 years | 45 | 54 | 50 | 50 |
| ≥65 years | 44 | 35 | 40 | 39 |
| Male sex, % | 61 | 60 | 59 | 59 |
| Race, % | ||||
| White | 61 | 36 | 41 | 43 |
| Black/African American | 14 | 29 | 29 | 25 |
| Asian | 14 | 6 | 7 | 8 |
| Other / not provided | 11 | 28 | 22 | 24 |
| Region, % | ||||
| North America (USA) | 76 | 95 | 92 | 91 |
| Europea | 15 | 4 | 5 | 7 |
| Asiaa | 8 | 1 | 3 | 2 |
| Body mass index (kg/m2), median (IQR) | 29 (25, 34) | 31 (27, 36) | 31 (26, 35) | 31 (27, 35) |
| Most common coexisting conditions,b % | ||||
| Hypertension | 51 | 46 | 47 | 49 |
| Cancer | 12 | 11 | 12 | 12 |
| Diabetes mellitus | 25 | 26 | 30 | 26 |
| Cardiovascular disease | 30 | 17 | 23 | 22 |
| Asthma | 14 | 11 | 10 | 13 |
| Immunologic disease | 10 | 5 | 9 | 5 |
| Chronic obstructive pulmonary disease | 5 | 6 | 12 | 6 |
| Renal insufficiency | 9 | 5 | 9 | 5 |
| Baseline clinical status on the 7-point scale, % | ||||
| 2—on invasive mechanical ventilation or ECMO | 4 | 7 | 8 | 6 |
| 3—on noninvasive ventilation or high-flow oxygen | 17 | 13 | 11 | 14 |
| 4—on low-flow supplemental oxygen | 63 | 60 | 63 | 61 |
| 5—not on supplemental oxygen, requiring medical care | 16 | 21 | 17 | 19 |
| 6—no medical care needed | 0 | 0 | 0 | 0 |
| Medications potentially active against SARS-CoV-2,c % | ||||
| Azithromycin | 39 | 19 | 24 | 24 |
| Hydroxychloroquine group | 17 | 75 | 15 | 72 |
| HIV protease inhibitor | 9 | 4 | 5 | 5 |
| Biologics | 7 | 7 | 8 | 6 |
| Ribavirin | 1 | 2 | 2 | 2 |
| Duration of symptoms before baseline, median (IQR), days | 8 (5, 11) | 7 (4, 8) | 8 (6, 11) | 7 (4, 8) |
| Initial AST (U/L), median (IQR) | 43 (31, 63) | 43 (32, 62) | 47 (34, 66) | 41 (31, 60) |
| Initial ALT (U/L), median (IQR) | 33 (21, 57) | 33 (22, 51) | 36 (22, 65) | 32 (21, 49) |
| Initial estimated glomerular filtration rate by Cockcroft-Gault (mL/min), median (IQR) | 104 (79, 140) | 97 (73, 131) | 112 (82, 145) | 94 (72, 129) |
Abbreviations: ALT, alanine aminotransferase; AST, aspartate aminotransferase; ECMO, extracorporeal membrane oxygenation; HIV, human immunodeficiency virus; IQR, interquartile range; SARS-CoV2, severe acute respiratory syndrome coronavirus 2.
aEuropean countries included Germany, Spain, Belgium, and United Kingdom; Asian countries included Hong Kong, Republic of Korea, Singapore, and Taiwan.
bConditions with more than 5% incidence are reported. Immunologic diseases included rheumatoid arthritis, inflammatory bowel disease, and systemic lupus erythematosus.
cHydroxychloroquine group included aminoquinolines, chloroquine, hydroxychloroquine, and hydroxychloroquine sulfate; biologics included interferons, investigational biologics, plasma, sarilumab, siltuximab, and tocilizumab.
dPatient numbers are modified based on inverse probability treatment weighting procedures. Percentages provided for the weighted groups may not add to 100% due to rounding. Variables included in the weighting include age, gender, race, region (US, Ex-US), obesity, medical history (yes vs no for hypertension, cardiovascular disease, diabetes mellitus, chronic obstructive pulmonary disease, asthma, and immunologic disease), medications used to treat COVID-19, and baseline clinical status (7-point ordinal scale).
Recovery and Improvement
At day 14, after IPTW, 74.4% of patients in the remdesivir-cohort versus 59.0% in the non-remdesivir-cohort reached the primary recovery endpoint (Figure 2A). In the weighted multivariable logistic regression model, the adjusted odds of recovery for the remdesivir-cohort was 2.03-fold higher than for the non-remdesivir-cohort (95% confidence interval [CI]: 1.34–3.08, P < .001). Additionally, greater 14-day recovery was associated with younger age, female sex, higher baseline ordinal scale (less need for high-flow or invasive oxygen), not having hypertension and not receiving a biologic agent or hydroxychloroquine (Table 3). Results of the sensitivity analysis that included hydroxychloroquine in the propensity score yielded similar results (odds ratio [OR] 1.68, 95% CI: 1.2–2.2, P = .002), despite the further imbalance in other baseline prognostic factors (see Supplemental Digital Content 5, Figure B).
Figure 2.
Proportion (95% confidence interval) of patients at day 14 in the remdesivir-cohort and non-remdesivir-cohort with: (A) recovery, based on the 7-point ordinal scale* and (B) mortality** (after stabilized inverse probability of treatment weighting). *Recovery was defined as baseline score of 2–4 improved to 5–7, or baseline score of 5 improved to 6–7, or baseline score of 6 improved to 7. P-values, odds ratios between treatment groups, and its 95% confidence interval were from the weighted logistic regression model with all baseline factors included in the model as covariates. After stepwise model selection, insignificant baseline factors were removed from the final model. The final model for day 14 included age, sex, baseline ordinal scale, hypertension, and COVID-19 antiviral medications within the biologic and hydroxychloroquine groups. **P-values, odds ratios between treatment groups, and its 95% confidence interval were from the weighted logistic regression model with all baseline factors included in the model as covariates. After stepwise model selection insignificant baseline factors removed from the final model. The final model for day 14 included age, race, baseline ordinal scale, cardiovascular, and chronic obstructive pulmonary disease. Abbreviation: COVID-19, coronavirus disease 2019.
Table 3.
Odds Ratio of Recovery and All-cause Death at Day 14 From Weighted Logistic Regression Model Using All Variables Used for Propensity Scores (Stepwise Model Selection)
| Variable (Reference Category) | Odds Ratio of Recovery at Day 14 | Odds Ratio 95% Confidence Interval | P value | Odds Ratio of Death at Day 14 | Odds Ratio 95% Confidence Interval | P value |
|---|---|---|---|---|---|---|
| Remdesivir treatment (no remdesivir) | 2.03 | 1.34–3.08 | <.001 | 0.38 | .22–.68 | .001 |
| Age, years (65 or older) | ||||||
| <40 | 6.61 | 3.46–12.61 | <.001 | 0.27 | .11–.68 | .005 |
| 40–64 | 2.28 | 1.67–3.13 | <.001 | 0.33 | .21–.54 | <.001 |
| Sex, male (female) | 0.67 | .49–.91 | .01 | NAa | NAa | NAa |
| Race (White) | ||||||
| Asian | NAa | NAa | NAa | 1.92 | .89–4.15 | .10 |
| Black or African | NAa | NAa | NAa | 2.37 | 1.37–4.10 | .002 |
| Other | NAa | NAa | NAa | 1.77 | .99–3.16 | .05 |
| Baseline ordinal scale (score of 5) | ||||||
| 2—invasive ventilation | 0.02 | .01–.05 | <.001 | 9.39 | 4.30–20.49 | <.001 |
| 3—high-flow oxygen | 0.08 | .05–.14 | <.001 | 5.11 | 2.57–10.17 | <.001 |
| 4—low-flow oxygen | 0.81 | .54–1.20 | .29 | 0.72 | .37–1.40 | .34 |
| Medications potentially active against SARS-CoV-2 (not received agent)b | ||||||
| Received biologic agent | 0.17 | .10–.31 | <.001 | NAa | NAa | NAa |
| Received hydroxychloroquine group | 0.49 | .35–.70 | <.001 | NAa | NAa | NAa |
| Coexisting conditions (no condition present) | ||||||
| Cardiovascular disease | NAa | NAa | NAa | 2.23 | 1.40–3.57 | <.001 |
| Chronic obstructive pulmonary disease | NAa | NAa | NAa | 3.06 | 1.63–5.76 | <.001 |
| Hypertension | 0.70 | .51–.95 | .02 | NAa | NAa | NAa |
Abbreviations: NA, not applicable; SARS-CoV 2, severe acute respiratory syndrome coronavirus 2.
aAfter stepwise model selection, these variables were not significant and removed from the final weighted logistic regression model.
bHydroxychloroquine group included aminoquinolines, chloroquine, hydroxychloroquine, and hydroxychloroquine sulfate; biologics included interferons, investigational biologics, plasma, sarilumab, siltuximab, and tocilizumab.
An improvement in clinical status of at least 2 points (or being discharged alive) at day 14 was seen in 71.9% and 58.8% of weighted patients in the remdesivir- and non-remdesivir-cohorts, respectively (adjusted odds ratio [aOR] 1.64; 95% CI: 1.10–2.43; P = .01). A clinical status improvement of at least 1 point at day 14 was seen in 76.2% and 60.2% of weighted patients in the remdesivir- and non-remdesivir-cohorts, respectively (aOR 2.04; 95% CI: 1.37–3.05; P < .001).
Mortality
Up to day 14, the weighted mortality in the remdesivir-cohort versus the non-remdesivir-cohort was 7.6% versus 12.5%, respectively (Figure 2B). In the weighted multivariable logistic regression model, receipt of remdesivir was associated with a 62% lower adjusted odds of death (OR 0.38, 95% CI: .22–.68, P = .001). Additionally, lower mortality was associated with younger age, being White versus Black/African American, higher baseline ordinal scale (less need for oxygen or invasive oxygen) and the absence of prior cardiovascular disease or chronic obstructive pulmonary disease. Results of the sensitivity analysis that included hydroxychloroquine in the propensity score yielded similar results (OR of death 0.34, 95% CI: .19–.62, P < .001).
DISCUSSION
There is an urgent need for effective treatments for severe COVID-19, which is associated with high mortality (estimates ranging from 8 to 28%) [13, 14]. Building on the promising in vitro and preclinical activity of remdesivir [4–6], and given that other placebo-controlled studies were planned or underway, study 5773 was designed to provide severely ill patients with access to remdesivir and to determine the optimal treatment duration [7]. In the absence of a comparator arm, study 5807 was designed to provide a synthetic control group by retrospectively collecting data from contemporaneously hospitalized patients with severe COVID-19, treated per local standard of care, using enrollment criteria similar to those of study 5773. The comparison of remdesivir-treated patients with non-remdesivir-treated patients used robust statistical methodologies appropriate for nonrandomized cohort studies.
In our analysis, after IPTW, 74.4% of patients in the remdesivir-cohort versus 59.0% in the non-remdesivir-cohort achieved the primary recovery endpoint at day 14, reflecting a 2-fold higher adjusted odds of recovery. Significantly lower mortality was also observed in those treated with remdesivir compared with the non-remdesivir-cohort patients: 7.6% versus 12.5%, respectively, with 62% lower adjusted odds of all-cause death. This is the second study to demonstrate the potential benefit of remdesivir versus a comparator for SARS-CoV-2-infected patients with severe disease and the first to demonstrate a significant reduction in mortality. Consistent with our findings, preliminary data from the randomized NIAID Adaptive COVID-19 Treatment Trial also found that remdesivir had faster time to recovery versus placebo [8].
Our results are highly encouraging because studies of other antiviral agents have shown limited benefit, lacked a comparator, or observed significant toxicity [15–21]. In the one comparative study published to date, 199 patients with severe COVID-19 were randomized to receive lopinavir-ritonavir or standard care, with no significant benefit in recovery or mortality demonstrated [20].
The methodology used for our comparative study has several strengths that contribute to the robustness of the efficacy results. Data for remdesivir-treated patients came from study 5773, a large, multicenter phase 3 trial, and information abstracted from study 5807 included rigorously collected, detailed, patient-level data (including patient oxygenation status and support, vital signs, laboratory and radiology findings) that underwent thorough cleaning and review. Propensity score weighting balanced known factors associated with poor COVID-19 prognosis, and final models included all significant factors potentially associated with outcomes. Both studies ran in parallel, in an attempt to avoid confounding due to evolving or changing standards of care as the pandemic progressed. Finally, our population is broadly representative of the wider population with severe COVID-19 with respect to age, sex, and comorbidities, based on data from several other studies [6, 21–24].
There are also limitations of this analysis. Most importantly, the comparison was not randomized, and although all efforts were made to balance the cohorts for known factors associated with poor COVID-19 prognosis using IPTW and multivariable regression, there may be some factors that could not be well balanced as a result of inherent differences in care between centers. Imbalance was notable in the use of hydroxychloroquine, before and after IPTW (Table 2). The imbalance is not unexpected, as we did not include hydroxychloroquine in the propensity score model due to the reasons mentioned earlier. Instead, hydroxychloroquine was adjusted for in the final weighted logistic regression analysis; we found improved recovery was associated with remdesivir use after adjustments. We also performed a sensitivity analysis, including hydroxychloroquine in the propensity score calculation, which yielded better balance in hydroxychloroquine use but imbalance in other important factors (see Supplemental Digital Content 5, Figure B). Adjustment for these factors yielded risk estimates for recovery and mortality that were concordant with those of the primary analysis. It is important to note that our comparative cohort analysis was not designed to evaluate the independent effect of hydroxychloroquine, which was associated with higher in-hospital mortality in a recent observational analysis [25].
Similarly, in either study, there may be confounding factors for COVID-19 prognosis, as yet unknown, such as the impact of other therapies that were unaccounted for and socioeconomic status. The open-label design of study 5773 also introduces the possibility of bias between the two arms, although multivariable models showed no significant difference in outcomes between the 5- and 10-day remdesivir dosing durations. Because some patients in the remdesivir-cohort did receive other potential COVID-19 treatments, this was not a direct comparison of remdesivir versus standard care. However, use of other medications was adjusted for in the multivariable models to capture the independent effect of remdesivir. Finally, as clinicians caring for patients in the remdesivir cohort (study 5773) knew their patients were receiving an antiviral with potential activity against SARS-CoV-2, whereas clinicians in the non-remdesivir-cohort (study 5807) did not have access to a potentially active agent, clinicians in study 5807 may have used experimental agents that may have limited benefit and potentially be harmful.
Study 5773 and study 5807 are ongoing. Analysis of the results of the comparative analysis with the full cohort, including Italian sites, is planned. Study 5807 ultimately aims to enroll up to 3500 patients and 50 centers globally, providing a baseline for comparison against other potential future treatments.
In conclusion, remdesivir treatment was associated with significantly higher recovery rates and lower mortality than standard-of-care treatment without remdesivir in patients with severe COVID-19. The results are concordant with preliminary data from the NIAID randomized Adaptive COVID-19 Treatment Trial [8]. Ongoing studies and real-world data will further determine the optimal role of remdesivir for the treatment of COVID-19.
Supplementary Data
Supplementary materials are available at Clinical Infectious Diseases online. Consisting of data provided by the authors to benefit the reader, the posted materials are not copyedited and are the sole responsibility of the authors, so questions or comments should be addressed to the corresponding author.
Notes
Author contributions. S. A. O., K. K. P., A. S. G., B. B., E. G. P.-H., N. S. S., S. W., T. L. W., S. S., J. S., B. C., S. D. W., S. M. A., A. S. V., P. R., R. L. G., T. Y. O. T., and J. I B. acquired the study data. I.-H. L., H. H., R. H. H., A. P. C., L. L., L. Z., B. N. B., R. M.-G., C.P., H. E., J. G., H. D.-C., L. E. S., A. O. O., D. M. B. conceived and designed the study and analyzed the data. All authors interpreted the data, were involved with drafting or critical revisions of the manuscript, and provided approval of the final manuscript for submission.
Acknowledgments. The authors extend their gratitude to the participants and their families, participating sites, site investigators, and study staff. The incredible work of the site investigators and their healthcare teams in times of enormous challenges and personal risk cannot be overstated. The full list of site investigators is provided in Supplemental Digital Content 1). The authors dedicate this work to those that are or have been ill with COVID-19 and to the memory of healthcare workers who have given their lives in the care of these patients. Medical writing support was provided by Ryan Woodrow and Emma McConnell from Aspire Scientific Ltd (Bollington, UK), and was funded by Gilead Sciences, Inc., Foster City, CA, USA. Gilead Sciences makes available anonymized individual patient data upon request or as required by law or regulation with external researchers. Approval of such requests is at Gilead Sciences’s discretion and is dependent on the nature of the request, the merit of the research proposed, the availability of the data, and the intended use of the data. Data requests should be sent to datarequest@gilead.com. Data from GS-US-540–5807 can only be provided with each participating Institution’s prior written consent.
Financial support. This work was supported by Gilead Sciences, Inc., Foster City, CA, USA.
Potential conflicts of interest. K. K. P. reports nonfinancial support, budget for IRB, administrative fees, time effort for data entry and query resolution for protocol 5807, and clinical trial site support for protocols GS-US-540–5773 and GS-US-540–5774, from Gilead Sciences. A. S. G. reports grants from Gilead Sciences. B. B. reports speaker and advisory board fees from Gilead Sciences. E. G. P.-H. reports grants from Gilead Sciences. S. W. reports grants from Gilead Sciences. T. L. W. reports grants from Gilead Sciences and personal fees from EMD Serono, Genetics Institute, LLC, Merck KGaA, Pfizer, Inc., and Wyeth LLC. S. S. reports grants from Gilead Sciences. J. S. reports personal fees from Gilead Sciences. S. D. W. reports grants from NEAT ID Foundation. P. R. reports grants from Gilead Sciences. R. L. G. reports nonfinancial support from Gilead Sciences. I.-H. L., H. H., R. H. H., A. P. C., L. L., L. Z., B. N. B., R. M.-G., C. P., H. E., J. G., H. D.-C., L. E. S., A. O. O., and D. M. B. are employees and stockholders of Gilead Sciences. J. I B. reports grants and personal fees from Gilead sciences, personal fees from ViiV Healthcare, personal fees and nonfinancial support from MSD, and nonfinancial support from Janssen. All other authors report no potential conflicts. All authors have submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Conflicts that the editors consider relevant to the content of the manuscript have been disclosed.
References
- 1. Johns Hopkins University and Medicine. Coronavirus resource center. Available at: https://coronavirus.jhu.edu/. Accessed 06 August 2020.
- 2. Gordon CJ, Tchesnokov EP, Feng JY, Porter DP, Götte M. The antiviral compound remdesivir potently inhibits RNA-dependent RNA polymerase from Middle East respiratory syndrome coronavirus. J Biol Chem 2020; 295:4773–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. US Food & Drug Administration. Remdesivir emergency use authorization letter. Available at: https://www.fda.gov/media/137564/download. Accessed 6 May 2020.
- 4. Choy KT, Wong AY, Kaewpreedee P, et al. Remdesivir, lopinavir, emetine, and homoharringtonine inhibit SARS-CoV-2 replication in vitro. Antiviral Res 2020; 178:104786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Wang M, Cao R, Zhang L, et al. Remdesivir and chloroquine effectively inhibit the recently emerged novel coronavirus (2019-nCoV) in vitro. Cell Res 2020; 30:269–71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Grein J, Ohmagari N, Shin D, et al. Compassionate use of remdesivir for patients with severe Covid-19. N Engl J Med 2020. doi: 10.1056/NEJMoa2007016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Goldman JD, Boon Lye DC, Hui D, et al. Remdesivir for 5 or 10 days in patients with severe Covid-19. N Engl J Med 2020. doi: 10.1056/NEJMoa2015301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Beigel JH, Tomashek KM, Dodd LE, et al. Remdesivir for the treatment of Covid-19—preliminary report. N Engl J Med 2020. doi: 10.1056/NEJMoa2007764. [DOI] [PubMed] [Google Scholar]
- 9. Wang Y, Zhang D, Du G, et al. Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. Lancet 2020; 395:1569–78. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Norrie JD. Remdesivir for COVID-19: challenges of underpowered studies. Lancet 2020; 395:1525–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Robins JM, Hernán MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology 2000; 11:550–60. [DOI] [PubMed] [Google Scholar]
- 12. Xu S, Ross C, Raebel MA, Shetterly S, Blanchette C, Smith D. Use of stabilized inverse propensity scores as weights to directly estimate relative risk and its confidence intervals. Value Health 2010; 13:273–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Zhou F, Yu T, Du R, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet 2020; 395:1054–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Verity R, Okell LC, Dorigatti I, et al. Estimates of the severity of coronavirus disease 2019: a model-based analysis. Lancet Infect Dis 2020; 20:669–77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Gao J, Tian Z, Yang X. Breakthrough: chloroquine phosphate has shown apparent efficacy in treatment of COVID-19 associated pneumonia in clinical studies. Biosci Trends 2020; 14:72–3. [DOI] [PubMed] [Google Scholar]
- 16. Gautret P, Lagier JC, Parola P, et al. Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an open-label non-randomized clinical trial. Int J Antimicrob Agents 2020; 56:105949. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 17. Chen Z, Hu J, Zhang Z, et al. Efficacy of hydroxychloroquine in patients with COVID-19: results of a randomized clinical trial. medRxiv 2020. doi: 10.1101/2020.03.22.20040758. [DOI] [Google Scholar]
- 18. Liu F, Xu A, Zhang Y, et al. Patients of COVID-19 may benefit from sustained lopinavir-combined regimen and the increase of eosinophil may predict the outcome of COVID-19 progression. Int J Infect Dis 2020; 95:183–91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Ye XT, Luo YL, Xia SC, et al. Clinical efficacy of lopinavir/ritonavir in the treatment of coronavirus disease 2019. Eur Rev Med Pharmacol Sci 2020; 24: 3390–6. [DOI] [PubMed] [Google Scholar]
- 20. Cao B, Wang Y, Wen D, et al. A trial of lopinavir-ritonavir in adults hospitalized with severe Covid-19. N Engl J Med 2020; 382:1787–99. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Borba MGS, Val FFA, Sampaio VS, et al. ; CloroCovid-19 Team . Effect of high vs low doses of chloroquine diphosphate as adjunctive therapy for patients hospitalized with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection: a randomized clinical trial. JAMA Netw Open 2020; 3:e208857. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Weiss P, Murdoch DR. Clinical course and mortality risk of severe COVID-19. Lancet 2020; 395:1014–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Li X, Xu S, Yu M, et al. Risk factors for severity and mortality in adult COVID-19 inpatients in Wuhan. J Allergy Clin Immunol 2020. doi: 10.1016/j.jaci.2020.04.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Zhang J, Wang X, Jia X, et al. Risk factors for disease severity, unimprovement, and mortality in COVID-19 patients in Wuhan, China. Clin Microbiol Infect 2020; 26:767–72. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Mehra MR, Desai SS, Ruschitzka F, Patel AN. Hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis. Lancet 2020. doi: 10.1016/S0140-6736(20)31180-6. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.


