Skip to main content
Infectious Diseases and Therapy logoLink to Infectious Diseases and Therapy
. 2022 Nov 28;12(1):257–271. doi: 10.1007/s40121-022-00729-2

Efficacy and Safety of Nirmatrelvir/Ritonavir, Molnupiravir, and Remdesivir in a Real-World Cohort of Outpatients with COVID-19 at High Risk of Progression: The PISA Outpatient Clinic Experience

Giusy Tiseo 1,, Chiara Barbieri 1, Valentina Galfo 1, Sara Occhineri 1, Tommaso Matucci 1, Francesco Almerigogna 1, Jona Kalo 1, Pietro Sponga 1, Mario Cesaretti 1, Gabriele Marchetti 1, Arianna Forniti 1, Claudio Caroselli 1, Simone Ferranti 1, Manuela Pogliaghi 1, Marina Polidori 1, Silvia Fabiani 1, Stefano Verdenelli 1, Enrico Tagliaferri 1, Niccolò Riccardi 1, Lorenzo Roberto Suardi 1, Claudia Carmignani 2, Serena Batini 3, Luca Puccetti 3, Riccardo Iapoce 1, Francesco Menichetti 1, Marco Falcone 1,
PMCID: PMC9707131  PMID: 36441485

Abstract

Introduction

Different antivirals are available for the treatment of outpatients with COVID-19. Our aim was to describe a real-world experience of outpatient management of COVID-19 subjects at high risk of progression.

Methods

This prospective observational study conducted in the University Hospital of Pisa (January 2022–July 2022) included consecutive COVID-19 outpatients with at least one risk factor for disease progression. Patients received nirmatrelvir/ritonavir, molnupiravir, or 3-day remdesivir, according to the Italian Medicines Agency (AIFA) indications. All patients were followed up until 30 days from the first positive nasopharyngeal swab. The primary endpoint was a composite of death or hospitalization. Secondary endpoints were occurrence of adverse events and a negative test within 10 days from the first positive test. Multivariable analysis was performed to identify factors associated with death or hospitalization.

Results

Overall, 562 outpatients were included: 114 (20.3%) received molnupiravir, 252 (44.8%) nirmatrelvir/ritonavir, and 196 (34.9%) 3-day remdesivir. The composite endpoint occurred in 2.5% of patients and was more frequent in patients treated with remdesivir (5.1%) compared with molnupiravir (1.8%) or nirmatrelvir/ritonavir (0.8%, ANOVA among groups p = 0.012). On multivariable Cox regression analysis, presence of ≥ 3 comorbidities, hematological disease, gastrointestinal symptoms, and each-day increment from symptoms onset were factors associated with death or hospitalization, while antiviral treatment was not a predictor. Adverse events occurred more frequently in the nirmatrelvir/ritonavir group (49.2%). Nirmatrelvir/ritonavir compared with remdesivir was associated with a higher probability of having a negative test within 10 days from the first positive one.

Conclusion

Death or hospitalization did not differ among high-risk COVID-19 outpatients treated with currently available antivirals. Safety and time to a negative test differed among the three drugs.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40121-022-00729-2.

Keywords: COVID-19, SARS-CoV-2, Molnupiravir, Nirmatrelvir/ritonavir, Remdesivir, Progression

Key Summary Points

In this real-world study, the risk of COVID-19 progression was not statistically different in high-risk patients treated with nirmatrelvir/ritonavir, molnupiravir, or 3-day remdesivir.
Death or hospitalization in COVID-19 outpatients treated with available antivirals was 2.5%.
Adverse events were more frequent in patients who received nirmatrelvir/ritonavir.
Nirmatrelvir/ritonavir compared with remdesivir was associated with a higher likelihood of having a negative test within 10 days of the first positive one.

Introduction

Since the start of the pandemic, a variety of prophylactic and therapeutic treatments have been developed to combat COVID-19 [1, 2]. Monoclonal antibodies (mAbs) initially demonstrated a reduction in hospitalizations or deaths by 70–87% among outpatients, and represented an effective therapeutic option in vulnerable populations before or after exposure to SARS-CoV-2 [3]. However, the neutralizing ability of mAbs progressively decreased with the emergence of new variants of concern (VOC) [4]. The recent emergence of the heavily mutated Omicron variant has posed a challenge to this treatment strategy. As a matter of fact, all available mAbs, including sotrovimab and tixagevimab, seem to have no or reduced neutralizing activity against the last Omicron BA.2 and BA.5 variants [5, 6]. From December 2021, new therapeutic options for the outpatient management of COVID-19 have been authorized by regulatory agencies [79]. Nirmatrelvir/ritonavir, molnupiravir, and early 3-day remdesivir have been approved as outpatient treatments for patients at increased risk of progression. Interestingly, the susceptibilities of Omicron BA.2 to remdesivir, molnupiravir, and nirmatrelvir are similar to those of the ancestral strain and other VOCs [10]. Phase 3 clinical studies showed different efficacy of the three agents. Molnupiravir demonstrated a reduced risk of hospitalization or death compared with placebo [7.3% versus 14.1%, −6.8 percentage points difference; 95% confidence interval (CI) −11.3 to −2.4, p = 0.001] [7]. In some reports, molnupiravir has been found to reduce the risk of hospitalization or death by approximately 50% [11]. The randomized controlled trial on nirmatrelvir/ritonavir, reported that 3 out of 389 patients (0.77%) in the nirmatrelvir group versus 27/385 (7%) in the placebo group (−6.32 percentage points difference, 95% CI 9.04 to −3.59, p < 0.001) had hospitalization or death by day 28 [8]. The relative risk reduction was 89.1% [8]. Similarly, in the randomized controlled trial by Gottlieb and colleagues, 2 out of 279 patients (0.7%) in the remdesivir group versus 15 out of 283 (5.3%) in the placebo group had a COVID-19–related hospitalization by day 28, with a relative risk reduction of 87% in the remdesivir group [9].

The aim of this study is to describe a real-world experience of outpatient management of patients with high risk of progression to severe COVID-19 who received nirmatrelvir/ritonavir, molnupiravir, or 3-day remdesivir.

Methods

Study Design

This is a prospective observational study conducted in the University Hospital of Pisa (Italy) from 1 January 2022 to 1 July 2022. Consecutive outpatients with documented COVID-19 by antigen or reverse transcriptase–polymerase chain reaction (RT–PCR) test on a nasopharyngeal swab who received one authorized antiviral treatment were eligible for the study. Eligible patients were referred to our ambulatory service by the family physician or other outpatient services through a dedicated phone system active 12 h daily 7 days a week. Patients were eligible for the treatment if they did not require supplemental oxygen therapy, were not hospitalized due to COVID-19, and had mild-to-moderate COVID-19. Mild and moderate illness were defined according to National Institute of Health (NIH) guidelines [mild disease: individuals who have any of the various signs and symptoms of COVID-19 but who do not have shortness of breath, dyspnea, or abnormal chest imaging; moderate disease: individuals who show evidence of lower respiratory disease during clinical assessment or imaging and who have an oxygen saturation measured by pulse oximetry (SpO2) ≥ 94% on room air] [12]. Patients were eligible if they had mild-to-moderate COVID-19 and at least one of the risk factors associated with progression to severe disease reported in Table 1. Asymptomatic patients were not included according to indications from the Italian Medicines Agency (AIFA).

Table 1.

Indications for the administration of early antiviral treatment in patients with COVID-19 who do not require hospitalization

Risk factors for progression (at least one of the following should be present) Timing, administration route, and contraindications by antivirals
All three antivirals Nirmatrelvir/ritonavir Molnupiravir Remdesivir

Mild-to-moderate COVID-19

And at least one of the following:

• Oncological/oncohematological pathology in active phase

• Chronic renal insufficiency

• COPD and/or other chronic respiratory disease (asthma, pulmonary fibrosis)

• Primary or acquired immunodeficiency

• Obesity (BMI > 30 kg/m2)

• Cardio-cerebrovascular disease (heart failure, coronary heart disease, cardiomyopathy, hypertension with organ damage, stroke)

• Diabetes mellitus uncompensated (HbA1c > 9.0%) or with chronic complications

• Age > 65 years

• Chronic liver disease

• Hemoglobinopathies

• Neurodevelopmental, neurodegenerative diseases

Allowed within 5 days from symptoms onset

Administered orally for five consecutive days

Renal adjustment: GFR > 60 ml/min: 300 mg of nirmatrelvir plus 100 mg of ritonavir twice daily

GFR 30–60 ml/min: 150 mg of nirmatrelvir plus 100 mg of ritonavir

GFR < 30 ml/min: contraindicated

Allowed within 5 days from symptoms onset

Administered orally for five consecutive days

Allowed within 7 days from symptoms onset

Administered iv for 3 consecutive days

Contraindicated in GFR < 30 ml/min

BMI body mass index, COPD chronic obstructive pulmonary disease, GFR glomerular filtration rate

Included patients received an ambulatory visit, which included collection of medical history, physical examination, vital signs evaluation, and blood examinations. Information about comorbidities, symptoms onset, and medications were collected by the attending physician. Patients were then allocated to one of the three available treatments according to inclusion/exclusion criteria for each antiviral (see below) and presence of potential drug–drug interactions. The final decision to start one of the three antivirals was made according to AIFA recommendations and based on the judgment of the attending physician. The ambulatory was active 7 days a week.

All patients were followed-up until 30 days from their first positive nasopharyngeal swab. Follow-up included a new ambulatory visit or, alternatively, a phone visit at days 7 and 30 from the start of antiviral treatment. Patients repeated antigenic nasopharyngeal swabs at day 7 and then, if still positive, on days 10 and 14 from the first positive nasopharyngeal swabs or until a negative test. The occurrence of adverse events (AEs) was recorded through the administration of a dedicated questionnaire by members of the study team at the end of the study.

Compliance with Ethics Guidelines

All patients signed a written informed consent. The study was conducted according to the principles stated in the Declaration of Helsinki, and approved by the local Ethical Committee of the Area Vasta Nord Ovest of Tuscany region (IRB number 230320).

Treatment Exposure

Patients received one of the three authorized antivirals according to indications from AIFA. There are some differences in the timing, administration, and contraindications for the three antivirals (Table 1).

Nirmatrelvir/ritonavir consists of nirmatrelvir, a novel SARS-CoV-2 main protease inhibitor targeting 3CLpro of SARS-CoV-2, plus ritonavir, an inhibitor of cytochrome P-450 3A4 to decrease nirmatrelvir metabolism that increases its serum levels [13]. It was prescribed within 5 days from the onset of symptoms and administered for a full 5-day treatment oral course. Dosage was adjusted according to renal function: in patients with estimated glomerular filtration rate (GFR) > 60 ml/min nirmatrelvir/ritonavir was administered at the dose of 300 mg of nirmatrelvir plus 100 mg of ritonavir twice daily, in patients with GFR 30–60 ml/min at a dose of 150 mg of nirmatrelvir plus 100 mg of ritonavir, and in patients with GFR < 30 ml/min it was not used.

Molnupiravir, an inhibitor of the RNA-dependent RNA polymerase (RdRp) enzyme of SARS-CoV-2 [14], was administered within 5 days from symptoms onset at the dose of 800 mg twice for a full 5-day oral course. No dose adjustment was made according to renal function.

Remdesivir was administered within 7 days from symptoms onset at the dose of 200 mg intravenously (iv) the first day and 100 mg iv the second and third day (3-day course). No dose adjustment was made according to renal function, but was not administered in patients with GFR < 30 ml/min.

Study Outcomes

The primary composite endpoint is death or hospitalization for COVID-19 in the overall population and among the three treatment groups.

The secondary study endpoints are: occurrence of AEs and negative nasopharyngeal swab within 10 days from the first positive test.

Study Variables and Definitions

For each patient, sociodemographic data including age and sex were collected. Data on comorbidities and conditions associated with high risk for severe COVID-19, including body mass index (BMI), diabetes mellitus, hypertension, cardiovascular and cerebrovascular disease, chronic lung disease, chronic liver disease, chronic kidney disease, neurological disorders, immunosuppression, solid cancer, hematological disease, autoimmune disease, solid organ transplantation, and neurological disease were recorded. Immunosuppression was defined by the presence of acquired immunosuppressive state or use of immunosuppressive therapy such as steroids (prednisolone > 0.5 mg/kg/d or equivalent for > 1 month), chemotherapy, or antitumor necrosis factor therapy, or the use of tacrolimus, cyclosporin, and/or mycophenolate. Obesity was defined by a BMI > 30 kg/m2.

In addition, information about COVID-19 vaccination dates were recorded. COVID-19 vaccination status was classified into two categories: adequate versus nonadequate, based on the timing of the last vaccine dose before study entry, as previously described [15]. Unvaccinated subjects and those who received only the first vaccine dose were considered nonadequately vaccinated. For the second vaccine dose and subsequent doses given more than 180 days apart, a patient was considered to be adequately vaccinated if he/she received the last dose in the previous 8–180 days. If the gap between the last two doses was less than 180 days, a patient was considered adequately vaccinated starting from the date of the last vaccine dose up to 180 days after [15].

Information about symptoms related to COVID-19 was collected. The attending physician investigated the presence of fever, fatigue, cough, dyspnea, myalgias, and gastrointestinal symptoms (including nausea, vomiting, and diarrhea) in each patient.

Regarding the occurrence of an AE, AEs indicated any untoward medical occurrence associated with the use of the antiviral, whether or not they were considered drug related. Data about the occurrence of AEs requiring drug discontinuation were collected. Data about hospitalization due to COVID-19 or death were recorded. Hospitalized patients were treated as previously described [16].

Statistical Analysis

Continuous variables were summarized with mean and standard deviation (SD) or median and interquartile ranges (IQRs) according to their distribution. Kruskal–Wallis, Mann–Whitney U, and chi-squared tests were performed to compare baseline characteristics among the groups, as appropriate.

The variable “time from first positive to negative nasopharyngeal swab” was dichotomized in ≤ 10 and > 10 days and the variable “age” in ≤ 80 and > 80 years according to Classification and Regression Tree analysis.

According to the primary outcome, to explore differences among the three groups (molnupiravir, nirmatrelvir/ritonavir, early-remdesivir) a one-way analysis of variance (ANOVA) was performed, with p-values adjusted using the Scheffé correction and the Bonferroni method for multiple comparisons.

Then, a multivariable Cox regression analysis was performed to identify factors independently associated with the composite endpoint using a forward stepwise procedure. Variables with statistical significance in the univariate analysis (p < 0.05) and those deemed of clinical relevance were entered in the multivariate model. Variables included for significance in univariate analysis included: age ≤ 80 years old, presence of three or more comorbidities, time from start of symptoms to antiviral treatment, cerebrovascular disease, hematological disease, chronic liver disease, autoimmune disease, presence of cough and gastrointestinal symptoms, and antiviral; variables included for clinical relevance included: chronic lung disease, immunosuppression, and adequate COVID-19 vaccination. The variable “antiviral treatments” was categorized into three categories: remdesivir (entered as reference variable), nirmatrelvir/ritonavir, and molnupiravir. Since antiviral treatments might not be started with the same timing from symptoms onset, the variable “antiviral treatments” was modeled as a time-dependent variable. More specifically, the variable “T_COV_” was created as a function of the time variable (time from symptoms onset to antiviral administration) “T_” and the covariate in question (type of antiviral), and has been included as a covariate in the Cox Regression model [17].

A post-hoc power analysis was performed based on proportions of death or hospitalization reported in the three randomized controlled trials in patients treated with molnupiravir (7.3%), nirmatrelvir/ritonavir (0.77%), and remdesivir (0.7%), respectively [79]. Our study has a power of 87.5% (α 0.05) to identify differences between molnupiravir and nirmatrelvir/ritonavir and 84.8% (α 0.05) to highlight differences between molnupiravir and remdesivir. Conversely, our sample is underpowered to identify potential differences between remdesivir and nirmatrelvir/ritonavir.

According to the secondary outcome, we described the proportion of AEs in the three groups. A multivariable Cox regression analysis was performed to identify factors independently associated with the occurrence of a negative nasopharyngeal swabs within 10 days from the first positive swab using the same methodology. This outcome was also explored in three further comparisons: nirmatrelvir/ritonavir versus molnupiravir, nirmatrelvir/ritonavir versus remdesivir, and molnupiravir versus remdesivir.

Results are expressed as the hazard ratio (HR) and their 95% CIs. Values of p < 0.05 were considered statistically significant. Statistical analyses were performed with the SPSS, version 27.0 (IBM, Armonk, NY, USA).

Results

Study Population Characteristics

A total of 562 outpatients with COVID-19 were included: 114 (20.3%) received molnupiravir, 252 (44.8%) nirmatrelvir/ritonavir, and 196 (34.9%) remdesivir. The median age was 69 (55–78.25) years old and 455 (81%) patients had adequate COVID-19 vaccination. Comparison of patients in the three treatment groups is presented in Table 2. Patients who received remdesivir were older, more frequently had more than two comorbidities, were more frequently affected by cardiovascular disease, and were more commonly solid organ transplant recipients compared with patients in the orally administered antiviral treatment groups. The time from symptoms onset to antiviral treatment was longer in the remdesivir (4 days, IQR 3–5 days) than in molnupiravir or nirmatrelvir/ritonavir group (3 days, IQR 2–4 days, p < 0.001). Adequate COVID-19 vaccination status was higher in patients treated with nirmltrevir/ritonavir.

Table 2.

Comparison between patients with COVID-19 receiving different antiviral treatments

Variable Molnupiravir
N = 114 (%)
Nirmatrelvir/ritonavir
N = 252 (%)
Remdesivir
N = 196 (%)
p-Value
Age, years, median (IQR) 69.5 (57.75–80) 65 (51.25–75.75) 72 (55–80) 0.015
Time from symptoms onset, days, median (IQR) 3 (2–4) 3 (2–4) 4 (3–5)  < 0.001
Male sex 62 (54.4%) 127 (50.4%) 113 (57.7%) 0.307
Vaccination status
 Adequate COVID-19 vaccination 85 (74.6%) 219 (86.9%) 151 (77%) 0.005
 Time from the last COVID-19 vaccine dose, days, median (IQR) 136 (82–189) 137 (93–172) 122 (85–178) 0.702
Number of comorbidities
  ≤ 1 comorbidity 26 (22.8%) 78 (31%) 25 (12.8%)  < 0.001
  ≥ 2 comorbidities 88 (77.2%) 174 (69%) 170 (86.7%)  < 0.001
  ≥ 3 comorbidities 61 (53.5%) 93 (36.9%) 118 (60.2%)  < 0.001
Comorbidities
 Obesity, BMI ≥ 30 kg/m2 38 (33.3%) 53 (21%) 51 (26%) 0.041
 Chronic lung disease 33 (28.9%) 67 (26.6%) 56 (28.6%) 0.853
 Immunosuppression (primary or acquired) 20 (17.5%) 54 (21.4%) 55 (28.1%) 0.078
 Diabetes mellitus 25 (21.9%) 49 (19.4%) 31 (15.8%) 0.378
 Arterial hypertension 63 (55.3%) 99 (39.3%) 104 (53.1%) 0.002
 Cardiovascular disease 51 (44.7%) 65 (25.9%) 91 (46.7%)  < 0.001
 Cerebrovascular disease 17 (14.9%) 19 (7.5%) 19 (9.7%) 0.089
 Solid cancer 20 (17.5%) 56 (22.2%) 43 (21.9%) 0.567
 Hematological disease 8 (7%) 32 (12.7%) 25 (12.8%) 0.235
 Chronic kidney disease 11 (9.6%) 11 (9.6%) 18 (9.2%) 0.013
 Chronic liver disease 1 (0.9%) 10 (4%) 14 (7.1%) 0.032
 Autoimmune disease 19 (16.7%) 34 (13.5%) 31 (15.8%) 0.670
 Solid organ transplantation 2 (1.8%) 1 (0.4%) 16 (8.2%)  < 0.001
 Neurological disease 2 (1.8%) 12 (4.8%) 8 (4.1%) 0.385
Symptoms of COVID-19
 Fever 71 (62.3%) 176 (69.8%) 117 (59.7%) 0.068
 Cough 90 (78.9%) 180 (71.4%) 162 (82.7%) 0.017
 Dyspnea 4 (3.5%) 16 (6.3%) 14 (7.1%) 0.418
 Fatigue 49 (43%) 100 (39.7%) 97 (49.5%) 0.114
 Myalgia 36 (31.6%) 80 (31.7%) 76 (38.8%) 0.241
 Gastrointestinal symptoms 18 (15.8%) 29 (11.5%) 20 (10.2%) 0.330
Outcomes
 Composite endpoint of death or hospitalization 2 (1.8%) 2 (0.8%) 10 (5.1%) 0.012*
 30-day mortality 1 (0.9%) 1 (0.4%) 0 0.453
 Hospitalization rate 1 (0.9%) 1 (0.4%) 10 (5.1%) 0.002
 Negative swab ≤ 10 days from the first swab 30 (26.3%) 104 (41.3%) 40 (20.4%)  < 0.001**
 Time from positive swab to negative test, days, median (IQR) 13 (10–18) 11 (9–16) 14 (11–17)  < 0.001

Italics indicate statistical significance (p < 0.05).

*Test for multiple comparison (primary endpoint): one-way ANOVA with Scheffé test (α 0.05): molnupiravir versus remdesivir p = 0.187, molnupiravir versus nirmatrelvir/ritonavir p = 0.860, nirmatrelvir/ritonavir versus remdesivir p = 0.015. One-way ANOVA Bonferroni correction (α 0.05): molnupiravir versus remdesivir p = 0.202, molnupiravir versus nirmatrelvir/ritonavir p = 0.99, nirmatrelvir/ritonavir versus remdesivir p = 0.011. **Test for multiple comparison (secondary endpoint): one-way ANOVA with Scheffé test (α 0.05): molnupiravir versus remdesivir p = 0.361, molnupiravir versus nirmatrelvir/ritonavir p = 0.023, nirmatrelvir/ritonavir versus remdesivir p = 0.015. One-way ANOVA Bonferroni correction (α 0.05): molnupiravir versus remdesivir p = 0.461, molnupiravir versus nirmatrelvir/ritonavir p = 0.018, nirmatrelvir/ritonavir versus remdesivir p < 0.001

Primary Outcome

Overall, the composite endpoint of death or hospitalization due to COVID-19 occurred in 14/562 (2.5%) patients. This event occurred more frequently in patients treated with remdesivir (n = 10/196, 5.1%) compared with those who received molnupiravir (n = 2/114, 1.8%) or nirmatrelvir/ritonavir (n = 2/252, 0.8%, difference among group p = 0.012). Adjustment for multiple comparison showed that this difference was statistically significant comparing nirmatrelvir/ritonavir versus remdesivir, but not comparing molnupiravir versus remdesivir or nirmatrelvir/ritonavir versus molnupiravir (Table 2).

With respect to patients who achieved clinical cure, patients who met the composite endpoint were older, more frequently had more than three comorbidities, were more likely to be affected by cerebrovascular disease, hematological disease, chronic liver disease, and autoimmune disease, and had a longer time from symptom onset to antiviral treatment (Supplementary Material, Table S1). Patients who died or required hospitalization more frequently received remdesivir (n = 10/14, 71.4%) compared with those who did not (n = 186/548, 33.9%, p = 0.01). On multivariable Cox regression analysis, the presence of three or more comorbidities (HR 6.89, 95% CI 1.52–31.14, p = 0.012), hematological disease (HR 5.59, 95% CI 5.59, 95% CI 1.84–16.94, p = 0.002), gastrointestinal symptoms (HR 3.87, 95% CI 1.27–11.81), and each-day increment from symptom onset to antiviral treatments (HR 1.54, 95% CI 1.03–2.28, p = 0.034) were factors independently associated with death or need for hospitalization due to COVID-19 (Table 3). The type of antiviral treatment was not independently associated with the risk of death or hospitalization (nirmatrelvir/ritonavir HR 1.46, 95% CI 0.21–9.92, p = 0.7; molnupiravir HR 2.68, 95% CI 0.4–17.95, p = 0.311; remdesivir as reference variable).

Table 3.

Multivariable Cox regression analysis of factors independently associated with the composite endpoint (death or hospitalization)

Variable HR (95% CI) p-Value
Three or more comorbidities 6.89 (1.52–31.14) 0.012
Hematological disease 5.59 (1.84–16.94) 0.002
Gastrointestinal symptoms 3.87 (1.27–11.81) 0.017
Time from symptom onset to antiviral treatments, each-day increment 1.54 (1.03–2.28) 0.034
Antiviral treatments
 Remdesivir Reference variable
 Nirmatrelvir/ritonavir 1.46 (0.21–9.92) 0.7
 Molnupiravir 2.68 (0.4–17.95) 0.311

The following variables were included in the multivariable logistic regression model, using stepwise selection: age ≤ 80 years old, presence of three or more comorbidities, time from start of symptoms to antiviral treatment, cerebrovascular disease, hematological disease, chronic liver disease, autoimmune disease, presence of cough and gastrointestinal symptoms, antiviral treatments (all variables significant at univariate analysis), chronic lung disease, immunosuppression, and adequate COVID-19 vaccination (for clinical relevance). Antiviral treatments were modeled as a time-dependent variable

Italics indicate statistical significance (p < 0.05)

Secondary Outcomes

Data about safety were recorded in 541 patients who completed the safety questionnaire (safety evaluable population). As presented in Table 4, AEs occurred more frequently in the nirmatrelvir/ritonavir (n = 116/236, 49.2%) group compared with the molnupiravir (n = 23/109, 21.1%) and remdesivir groups (9/196, 4.6%, p < 0.001).

Table 4.

Incidence of adverse events in the safety evaluable population (N = 541)

Variable Molnupiravir
N = 109 (%)
Nirmatrelvir/ritonavir
N = 236 (%)
Remdesivir
N = 196 (%)
p-Value
Any adverse event 23 (21.1%) 116 (49.2%) 9 (4.6%)  < 0.001
More than one adverse event 2 (1.8%) 14 (5.9%) 1 (0.5%) 0.004
Discontinuation because of adverse event 4 (3.7%) 5 (2.1%) 0 0.043
Description of adverse event
 Bradycardia* 0 0 7 (3.6%) 0.002
 Hypotension 0 2 (0.8%) 1 (0.5%) 0.612
 Skin rash 3 (2.8%) 0 0 0.003
 Headache 1 (0.9%) 3 (1.3%) 0 0.299
 Gastrointestinal disorders** 14 (12.8%) 23 (9.7%) 2 (1%)  < 0.001
 Dysgeusia 3 (2.8%) 99 (41.9%) 0  < 0.001
 Insomnia 1 (0.9%) 1 (0.4%) 0 0.442
 Leukopenia 1 (0.9%) 0 0 0.137
 AST/ALT increase (two times upper limits of normal (ULN)) 1 (0.9%) 0 0 0.137
Rebound of symptoms after antiviral discontinuation 2 (1.8%) 5 (2.1%) 0 0.130

Italics indicate statistical significance (p < 0.05)

*RR < 50 bpm; **including nausea, vomiting, diarrhea

Among patients who received nirmatrelvir/ritonavir, the most common AE was dysgeusia (n = 99/236, 41.9%), followed by gastrointestinal disorders (n = 23/236, 9.7%) and headache (n = 3/236, 1.3%); two patients (0.8%) had hypotension because of concomitant antihypertensive drugs that were not discontinued and one patient (0.4%) complained of insomnia. Among patients treated with molnupiravir, the most common AEs were gastrointestinal disorders (n = 14/109,12.8%). Other AEs were rare and represented by skin rash (n = 3/109, 2.8%), dysgeusia (n = 3/109, 2.8%), headache (n = 1/109, 0.9%), and insomnia (n = 1/109, 0.9%). One patient had transient leukopenia and one had a slight increase in their transaminases values. In patients treated with remdesivir, AEs were very rare and mainly represented by asymptomatic bradycardia (n = 7/196, 3.6%).

Discontinuation because of an AE was uncommon in the three study groups (molnupiravir 4/109, 3.7%; nirmatrelvir/ritonavir 5/236, 2.1%; remdesivir none). Overall, 7 (1.3%) patients reported a rebound of symptoms after the complete course of antivirals: 2/109 (1.8%) and 5/236 (2.1%) in the nirmatrelvir/ritonavir and molnupiravir group, respectively (p = NS).

Negative swab within 10 days from the first positive swab was more common in patients who received nirmatrelvir/ritonavir (n = 104/252, 41.3%) compared with molnupiravir (n = 30/114, n = 26.3%) and remdesivir (n = 40/196, 20.4%, difference among groups p < 0.001).

Comparison of patients who had a negative swab ≤ 10 days from the first positive one and those who did not is reported in Supplementary Material, Table S2. On multivariable Cox regression analysis (Table 5), adequate COVID-19 vaccination (HR 1.53, 95% CI 1.04–2.23, p = 0.03), age < 80 years old (HR 1.8, 95% CI 1.23–2.6, p = 0.003), and nirmatrelvir/ritonavir compared with remdesivir (HR 1.73, 95% CI 1.25–2.4, p < 0.001) were factors independently associated with increased probability of having a negative nasopharyngeal swab within 10 days from the first positive swab. Each-day increase from symptoms onset to antiviral treatment was associated with a reduced chance of having a negative swab within 10 days from the first positive one (HR 0.88, 95% CI 0.78–0.98).

Table 5.

Cox regression analysis of factors independently associated with a negative test within 10 days from the first positive nasopharyngeal swab

Variable HR (95% CI) p-Value
Adequate COVID-19 vaccination 1.53 (1.04–2.23) 0.03
Age < 80 years 1.8 (1.23–2.6) 0.003
Antiviral treatment
 Remdesivir Reference variable
 Nirmatrelvir/ritonavir 1.73 (1.25–2.4)  < 0.001
 Molnupiravir 1.28 (0.86–1.9) 0.227
Time from symptom onset to antiviral treatment (each-day increase) 0.88 (0.78–0.98) 0.017

Italics indicate statistical significance (p < 0.05). The following variables were included in the multivariable logistic regression model, using stepwise selection: age < 80 years, adequate COVID-19 vaccination, ≥ two comorbidities, hypertension, time from symptom onset (significant at univariate analysis), hematological malignancy, immunosuppression, and chronic lung disease (clinical relevance). Antiviral treatments were modeled as a time-dependent variable

Subgroup analysis revealed that nirmatrelvir/ritonavir was independently associated with increased probability of having a negative swab within 10 days from the first one compared with remdesivir, also in the subgroup of patients with immunosuppression, more than two comorbidities, adequate vaccination status, and subjects more than 65 years old (Fig. 1). Comparing patients who received nirmatrelvir/ritonavir to those who received molnupiravir, there was no difference in the probability of having a negative swab within 10 days, with exception of the subgroup of patients with more than two comorbidities and those more than 65 years old (Supplementary Material, Fig. S1). Comparison of molnupiravir and remdesivir revealed no differences in achieving this outcome, except for patients with chronic kidney disease (Supplementary Material, Fig. S2).

Fig. 1.

Fig. 1

Multivariable hazard ratios for factors associated with increased probability to have a negative nasopharyngeal swab within 10 days from the first positive one in patients treated with nirmatrelvir/ritonavir versus those treated with remdesivir. The multivariable model was adjusted for age < 80 years, adequate COVID-19 vaccination, ≥ two comorbidities, hypertension, time from symptom onset, hematological malignancy, immunosuppression, and chronic lung disease. Antiviral treatments were modeled as a time-dependent variable

Discussion

In this real-world experience of outpatient management of COVID-19, the risk of progression (death or hospitalization) did not differ among patients treated with molnupiravir, nirmatrelvir/ritonavir, or 3-day remdesivir. In this cohort of high-risk subjects, we observed that only 2.5% of treated patients died or were hospitalized due to COVID-19. Although nirmatrelvir/ritonavir is associated with a faster negative nasopharyngeal swab, it is also associated with a higher incidence of AEs, mainly represented by dysgeusia.

Notably, this study was conducted while Omicron was the dominant variant. A recent comparative analysis showed that Omicron is associated with a reduced risk of hospitalization and death compared with the Delta variant, but also highlighted a considerable variation in the severity according to age [18]. In fact, among subjects infected with the Omicron variant, hospital admission up to 14 days after a positive test and 28-day mortality were 11.1% and 5.12% in patients ≥ 80 years, respectively [19]. Similarly, other studies reported that the risk of hospitalization in Omicron-infected subjects ranged from 1% to 5% [20, 21], but these data are not stratified according to individual risk factors for progression or receipt of antiviral treatments. Notably, the proportion of death or hospitalization due to COVID-19 in our cohort of patients (2.5%) was low considering that the median age was 69 years, that a quarter of patients had immunosuppressive state, and 11% were affected by solid or hematological malignancy.

In this real-world experience, there was no statistically significant difference in the risk of COVID-19 progression in the three treatment groups. However, we highlighted that the choice of antivirals should be individualized according to patients’ comorbidities and characteristics. Nirmatrelvir/ritonavir have interactions with other drugs and should be avoided in some categories of patients, such as solid organ transplant recipients who received chronic immunosuppressive therapy, such as tacrolimus or mycophenolate, for whom other alternative antivirals might be appropriate. The use of oral antivirals is easier with respect to 3-day iv remdesivir. Early use of remdesivir is associated with reduced risk of disease progression [22], but a dedicated service equipped with nursing staff is needed for outpatients. Moreover, although the oral administration is easier to handle, it should be underlined that oral antivirals, especially nirmatrelvir/ritonavir, are not free from AEs. We found that almost half of patients treated with nirmatrelvir/ritonavir developed an AE, mainly represented by dysgeusia. Although AEs were usually mild, dysgeusia and gastrointestinal symptoms may be disabling for COVID-19 patients, especially for elderly and frail ones. Thus, patients who received nirmatrelvir/ritonavir should be carefully screened through an evaluation of baseline renal function and exclusion of drug–drug interactions, and the decision to discontinue some drugs during the course of therapy as well as monitoring potential AEs is essential. Thus, implementing ambulatory services equipped with Infectious Diseases (ID) specialists caring for outpatients with COVID-19 may represent a promising strategy to reduce hospitalizations due to COVID-19 and improve patient care and safety.

We found that patients treated with nirmatrelvir/ritonavir had a higher probability of having a negative test within 10 days from the first positive one. This data may be affected by some study limitations: this is not an interventional study and patients did not receive a nasopharyngeal swab every day. However, this happened in all three study groups. This endpoint may be particularly important for some patients, such as onco-hematological patients who wait for a negative test to start chemotherapy or other interventions, and patients who need negative test to undergo diagnostic procedures for other underlying diseases. This advantage of nirmatrelvir/ritonavir remained also after adjustment for relevant confounding factors, such as adequate COVID-19 vaccination status, and in specific subgroups, such as patients with immunosuppressive status and elderly patients. This advantage disappears when we compared nirmatrelvir/ritonavir with molnupiravir.

Finally, we found that about 2% of patients treated with nirmatrelvir/ritonavir and molnupiravir experienced a rebound of symptoms after the antiviral discontinuation. Here, we only documented rebound of symptoms and were not able to perform virological study on these cases. Cases of recrudescence of SARS-CoV-2 infection after nirmatrelvir/ritonavir treatment are being increasingly reported [23, 24]. However, it is not known if rebound may occur in the general population of infected patients or whether is unique to nirmatrelvir/ritonavir. A large study available as a preprint showed that there are no significant differences in COVID-19 rebound risks between nirmatrelvir/ritonavir and molnupiravir, while patients who experience rebound had significantly higher prevalence of underlying medical conditions than those without [25]. The phenomenon of COVID-19 rebound associated with specific antiviral treatments should be further investigated. However, the risk of rebound should not represent an obstacle to antiviral treatments.

This study has several limitations. It is an observational study and allocation bias may occur among the three study groups. Although in the analysis we took into account a large number of confounders associated with high risk for severe COVID-19, residual confounding among the three groups remains of concern. We did not perform a systematic identification of the SARS-CoV-2 variant. However, this study was conducted during the spread of Omicron variant in Italy. We were not able to perform daily nasopharyngeal swab to assess negative test results. However, our study design well reflects the real-world management of COVID-19 patients. Finally, since this is a real-world experience, we included all consecutive patients admitted to our outpatient clinic during the study period and the sample size was not calculated a priori. However, we performed a post-hoc power analysis [26]. Our sample has a power higher than 80% to identify differences between molnupiravir versus nirmatrelvir/ritonavir and between molnupiravir versus remdesivir, but it is underpowered to evaluate differences between nirmatrelvir/ritonavir versus remdesivir. Further studies are needed to highlight differences between these latter antivirals, especially in patients with immunosuppression.

Conclusions

We reported a real-world experience of outpatients management of COVID-19 in subjects at high risk of progression treated with the three available antivirals: nirmatrelvir/ritonavir, molnupiravir, and remdesivir. Despite the limitations related to its observational nature and statistical power, our study detected no differences in the risk of COVID-19 progression among the three treatments. Patients treated with nirmatrelvir/ritonavir more frequently reported mild AEs, but had a higher probability of having a negative test within 10 days from the SARS-CoV2 infection. An early individualized outpatient treatment, taking into consideration timing of symptom onset, potential drug–drug interactions, and underlying diseases may represent the cornerstone of COVID-19 management in the Omicron era.

Supplementary Information

Below is the link to the electronic supplementary material.

Acknowledgements

We thank the participants of the study.

Funding

No funding or sponsorship was received for this study or publication of this article. The Rapid Service Fee was funded by the University of Pisa.

Author Contributions

Concept and design: Giusy Tiseo and Marco Falcone; Conducting the research and data collection: Chiara Barbieri, Valentina Galfo, Sara Occhineri, Tommaso Matucci, Francesco Almerigogna, Jona Kalo, Pietro Sponga, Mario Cesaretti, Gabriele Marchetti, Arianna Forniti, Claudio Caroselli, Simone Ferranti, Manuela Pogliaghi, Marina Polidori, Silvia Fabiani, Stefano Verdenelli, Enrico Tagliaferri, Niccolò Riccardi, Lorenzo Roberto Suardi, Claudia Carmignani, Serena Batini, Luca Puccetti, Riccardo Iapoce; Drafting of the manuscript: Giusy Tiseo; Statistical analysis: Giusy Tiseo; Critical revision of the manuscript for important intellectual content: Francesco Menichetti and Marco Falcone. Visualization, Validation and final approval: all the authors.

Disclosures

Giusy Tiseo received honoraria for educational meetings by Shionogi. Francesco Menichetti has participated in advisory boards and/or received speaker honoraria from Angelini, Correvio, Merck Sharp & Dohme (MSD), Nordic Pharma, Pfizer, Astellas, Gilead, Bristol-Myers Squibb (BMS), Janssen, ViiV, bioMérieux, Biotest, Becton Dickinson, Pfizer, and Shionogi. Marco Falcone received unconditional grants/or speaker honoraria from MSD, Angelini, Shionogi, Pfizer, Menarini, TermoFisher, Gilead and Nordic Pharma. Declared conflicts of interest are outside the submitted work and did not affect the scientific objectivity of this study. Chiara Barbieri, Valentina Galfo, Sara Occhineri, Tommaso Matucci, Francesco Almerigogna, Jona Kalo, Pietro Sponga, Mario Cesaretti, Gabriele Marchetti, Arianna Forniti, Claudio Caroselli, Simone Ferranti, Manuela Pogliaghi, Marina Polidori, Silvia Fabiani, Stefano Verdenelli, Enrico Tagliaferri, Niccolò Riccardi, Lorenzo Roberto Suardi, Claudia Carmignani, Serena Batini, Luca Puccetti and Riccardo Iapoce have nothing to declare.

Compliance with Ethics Guidelines

All patients signed a written informed consent. The study was conducted according to the principles stated in the Declaration of Helsinki, and approved by the local Ethical Committee of the Area Vasta Nord Ovest of Tuscany region (IRB number 230320).

Data Availability

The datasets analyzed during the current study are available from the corresponding author on reasonable request.

Footnotes

“Corresponding author Prof. Marco Falcone, Department of Clinical and Experimental Medicine, University of Pisa, Italy, Via Paradisa 2, 56124, Pisa, Italy, marco.falcone@unipi.it. Alternate corresponding author Dr Giusy Tiseo, Department of Clinical and Experimental Medicine, University of Pisa, Italy.”

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Giusy Tiseo, Email: tiseogiusy@gmail.com.

Marco Falcone, Email: marco.falcone@unipi.it.

References

  • 1.Tiseo G, Yahav D, Paul M, Tinelli M, Gavazzi G, Mussini C, et al. What have we learned from the first to the second wave of COVID-19 pandemic? An international survey from the ESCMID Study Group for Infection in the Elderly (ESGIE) group. Eur J Clin Microbiol Infect Dis. 2022;41:281–288. doi: 10.1007/s10096-021-04377-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Menichetti F, Popoli P, Puopolo M, Spila Alegiani S, Tiseo G, et al. Effect of high-titer convalescent plasma on progression to severe respiratory failure or death in hospitalized patients with COVID-19 pneumonia: a randomized clinical trial. JAMA Netw Open. 2021;4:e2136246. doi: 10.1001/jamanetworkopen.2021.36246. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Taylor PC, Adams AC, Hufford MM, de la Torre I, Winthrop K, Gottlieb RL. Neutralizing monoclonal antibodies for treatment of COVID-19. Nat Rev Immunol. 2021;21:382–393. doi: 10.1038/s41577-021-00542-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Falcone M, Tiseo G, Valoriani B, Barbieri C, Occhineri S, Mazzetti P, et al. Efficacy of bamlanivimab/etesevimab and casirivimab/imdevimab in preventing progression to severe COVID-19 and role of variants of concern. Infect Dis Ther. 2021;10:2479–2488. doi: 10.1007/s40121-021-00525-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Yamasoba D, Kosugi Y, Kimura I, Fujita S, Uriu K, Ito J, Sato K, Genotype to Phenotype Japan (G2P-Japan) Consortium Neutralisation sensitivity of SARS-CoV-2 omicron subvariants to therapeutic monoclonal antibodies. Lancet Infect Dis. 2022;22:942–943. doi: 10.1016/S1473-3099(22)00365-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Zhou H, Tada T, Dcosta BM, Landau NR. Neutralization of SARS-CoV-2 omicron BA.2 by therapeutic monoclonal antibodies. bioRxiv [Preprint] 2022 doi: 10.1101/2022.02.15.480166. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Jayk Bernal A, Gomes da Silva MM, Musungaie DB, Kovalchuk E, Gonzalez A, Delos Reyes V, et al. Molnupiravir for oral treatment of Covid-19 in nonhospitalized patients. N Engl J Med. 2022;386:509–520. doi: 10.1056/NEJMoa2116044. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Hammond J, Leister-Tebbe H, Gardner A, Abreu P, Bao W, Wisemandle W, et al. Oral nirmatrelvir for high-risk, nonhospitalized adults with Covid-19. N Engl J Med. 2022;386:1397–1408. doi: 10.1056/NEJMoa2118542. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Gottlieb RL, Vaca CE, Paredes R, Mera J, Webb BJ, Perez G, et al. Early remdesivir to prevent progression to severe COVID-19 in outpatients. N Engl J Med. 2022;386:305–315. doi: 10.1056/NEJMoa2116846. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Takashita E, Kinoshita N, Yamayoshi S, Sakai-Tagawa Y, Fujisaki S, Ito M, et al. Efficacy of antiviral agents against the SARS-CoV-2 omicron subvariant BA.2. N Engl J Med. 2022;386:1475–1477. doi: 10.1056/NEJMc2201933. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Mahase E. Covid-19: molnupiravir reduces risk of hospital admission or death by 50% in patients at risk, MSD reports. BMJ. 2021;375:n2422. doi: 10.1136/bmj.n2422. [DOI] [PubMed] [Google Scholar]
  • 12.NIH COVID-19 Treatmment Guidelines. Last Updated: September 26, 2022. https://www.covid19treatmentguidelines.nih.gov/overview/clinical-spectrum/
  • 13.Lamb YN. Nirmatrelvir plus ritonavir: first approval. Drugs. 2022;82:585–591. doi: 10.1007/s40265-022-01692-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kabinger F, Stiller C, Schmitzová J, Dienemann C, Kokic G, Hillen HS, Höbartner C, Cramer P. Mechanism of molnupiravir-induced SARS-CoV-2 mutagenesis. Nat Struct Mol Biol. 2021;28:740–746. doi: 10.1038/s41594-021-00651-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Najjar-Debbiny R, Gronich N, Weber G, Khoury J, Amar M, Stein N, et al. Effectiveness of paxlovid in reducing severe COVID-19 and mortality in high risk patients. Clin Infect Dis 2022;ciac443 [DOI] [PMC free article] [PubMed]
  • 16.Falcone M, Tiseo G, Barbieri G, Galfo V, Russo A, Virdis A, et al. Role of low-molecular-weight heparin in hospitalized patients with severe acute respiratory syndrome coronavirus 2 pneumonia: a prospective observational study. Open Forum Infect Dis. 2020;7:ofaa563. doi: 10.1093/ofid/ofaa563. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Munoz-Price LS, Frencken JF, Tarima S, Bonten M. Handling time-dependent variables: antibiotics and antibiotic resistance. Clin Infect Dis. 2016;62:1558–1563. doi: 10.1093/cid/ciw191. [DOI] [PubMed] [Google Scholar]
  • 18.Prendki V, Tiseo G, Falcone M, ESCMID Study Group for Infections in the Elderly (ESGIE) Caring for older adults during the COVID-19 pandemic. Clin Microbiol Infect. 2022;28:785–791. doi: 10.1016/j.cmi.2022.02.040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Nyberg T, Ferguson NM, Nash SG, Webster HH, Flaxman S, Andrews N, et al. Comparative analysis of the risks of hospitalisation and death associated with SARS-CoV-2 omicron (B.1.1.529) and delta (B.1.617.2) variants in England: a cohort study. Lancet. 2022;399:1303–1312. doi: 10.1016/S0140-6736(22)00462-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Ridgway JP, Tideman S, Wright B, Robicsek A. Decreased Risk of Coronavirus Disease 2019–related hospitalization associated with the omicron variant of Severe Acute Respiratory Syndrome Coronavirus 2. Open Forum Infect Dis 2022;ofac288. [DOI] [PMC free article] [PubMed]
  • 21.Bager P, Wohlfahrt J, Bhatt S, Stegger M, Legarth R, Møller CH, et al. Risk of hospitalisation associated with infection with SARS-CoV-2 omicron variant versus delta variant in Denmark: an observational cohort study. Lancet Infect Dis. 2022;22:967–976. doi: 10.1016/S1473-3099(22)00154-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Falcone M, Suardi LR, Tiseo G, Barbieri C, Giusti L, Galfo V, et al. Early use of remdesivir and risk of disease progression in hospitalized patients with mild to moderate COVID-19. Clin Ther. 2022;44:364–373. doi: 10.1016/j.clinthera.2022.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Carlin AF, Clark AE, Chaillon A, Garretson AF, Bray W, Porrachia M, et al. Virologic and immunologic characterization of COVID-19 recrudescence after nirmatrelvir/ritonavir treatment. Clin Infect Dis 2022;ciac496 [DOI] [PMC free article] [PubMed]
  • 24.Rubin R. From Positive to negative to positive again-the mystery of why COVID-19 rebounds in some patients who take paxlovid. JAMA. 2022;327:2380–2382. doi: 10.1001/jama.2022.9925. [DOI] [PubMed] [Google Scholar]
  • 25.Wang L, Berger NA, Davis PB, Kaelber DC, Volkow ND, Xu R. COVID-19 rebound after paxlovid and molnupiravir during January-June. medRxiv 2022 Jun 22:2022.06.21.22276724 [Preprint].
  • 26.Shreffler J, Huecker MR. Type I and Type II Errors and Statistical Power. 2022 Mar 18. In: StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing; 2022 Jan–. PMID: 32491462. [PubMed]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

The datasets analyzed during the current study are available from the corresponding author on reasonable request.


Articles from Infectious Diseases and Therapy are provided here courtesy of Springer

RESOURCES