Skip to main content
PLOS One logoLink to PLOS One
. 2023 Jan 24;18(1):e0279779. doi: 10.1371/journal.pone.0279779

Performance evaluation of the Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG test by comparison with the surrogate virus neutralizing antibody test and clinical assessment

Maika Takahashi 1, Kaori Saito 2, Tomohiko Ai 2, Shuko Nojiri 3, Abdullah Khasawneh 2, Faith Jessica Paran 4, Yuki Horiuchi 2, Satomi Takei 2, Takamasa Yamamoto 1, Mitsuru Wakita 1, Makoto Hiki 5,6, Takashi Miida 2, Toshio Naito 4,7, Kazuhisa Takahashi 4,8, Yoko Tabe 2,4,*
Editor: Etsuro Ito9
PMCID: PMC9873150  PMID: 36693058

Abstract

Background

Despite the worldwide campaigns of COVID-19 vaccinations, the pandemic is still a major medical and social problem. The Ortho VITROS SARS-CoV-2 spike-specific quantitative IgG (VITROS S-IgG) assay has been developed to assess neutralizing antibody (NT antibody) against SARS-CoV-2 spike (S) antibodies. However, it has not been evaluated in Japan, where the total cases and death toll are lower than the rest of the world.

Methods

The clinical performance of VITROS S-IgG was evaluated by comparing with the NT antibody levels measured by the surrogate virus neutralizing antibody test (sVNT). A total of 332 serum samples from 188 individuals were used. Of these, 219 samples were from 75 COVID-19 patients: 96 samples from 20 severe/critical cases (Group S), and 123 samples from 55 mild/moderate cases (Group M). The remaining 113 samples were from 113 healthcare workers who had received 2 doses of the BNT162b2 vaccine.

Results

VITROS S-IgG showed good correlation with the cPass sVNT assay (Spearman rho = 0.91). Both VITROS S-IgG and cPass sVNT showed significantly higher plateau levels of antibodies in Group S compared to Group M. Regarding the humoral immune responses after BNT162b2 vaccination, individuals who were negative for SARS-CoV-2 nucleocapsid (N)-specific antibodies had statistically lower titers of both S-IgG and sVNT compared to individuals with a history of COVID-19 and individuals who were positive for N-specific antibodies without history of COVID-19. In individuals who were positive for N-specific antibodies, S-IgG and sVNT titers were similar to individuals with a history of COVID-19.

Conclusions

Although the automated quantitative immunoassay VITROS S-IgG showed a reasonable correlation with sVNT antibodies, there is some discrepancy between Vitros S-IgG and cPass sVNT in milder cases. Thus, VITROS S-IgG can be a useful diagnostic tool in assessing the immune responses to vaccination and herd immunity. However, careful analysis is necessary to interpret the results.

Introduction

Coronavirus disease 19 (COVID-19), caused by SARS-CoV-2 infection, is an unprecedented threat to public health and the economy [1]. The absence of specific treatment options has resulted in the important implementation of precautions and diagnostic testing.

The usual choice for COVID-19 diagnosis is molecular testing, particularly RT-PCR, which is a reliable tool for detecting active SARS-CoV-2 infection [2]. Antigen testing has been also developed for rapid detection of pathogens without complicated procedures [3]. However, these tests cannot detect SARS-CoV-2 during certain periods after infection [4]. PCR and antigen tests for virus detection are not competing options for exposure detection, since they can be performed at different time points within their relevant diagnostic windows of clinical development [5]. Therefore, serological tests detecting SARS-CoV-2-specific antibodies have been used as a complement to RT-PCR and antigen testing in the diagnosis of COVID-19 [68].

Furthermore, serological tests are essential tools to evaluate neutralizing antibody (NT antibody) titers upon vaccination and to assess SARS-CoV-2 seroprevalence in cohorts [9, 10]. NT antibodies targeting the receptor-binding domain (RBD) of the spike (S) protein can reduce viral infectivity by binding to the surface epitopes of viral particles, blocking virus entry into host cells [11]. Therefore, there is a need for a widely available assay that correlates well with neutralizing activity, has a short turnaround time, has high throughput, and is cost effective.

SARS-CoV-2 serologic assays using spike proteins as target antigens are known to be correlated with virus neutralization activity [12], which can be a pivotal tool for assessing the effect of vaccination. VITROS Immunodiagnostic Products Anti-SARS-CoV-2 IgG Quantitative Reagent (VITROS S-IgG), released by Ortho Clinical Diagnostics, was developed for the detection of IgG antibodies against the S1 subunit including receptor binding domain (RBD) of the spike protein of SARS-CoV-2.

GenScript cPass SARS-CoV-2 Neutralization Antibody Detection Kit, an enzyme-linked immunosorbent assay (ELISA)-based surrogate virus neutralization test (sVNT), mimics the reaction between human ACE2 receptor and RBD. It has been reported that the cPass SARS-CoV-2 NT antibody test (cPass sVNT) is a useful indicator of virus-neutralizing activity and has a good correlation with the cell-culture-based virus neutralization assay using live SARS-CoV-2, the gold standard method of assessing NT antibodies [13, 14].

To evaluate the clinical performance of VITROS S-IgG in detecting neutralizing activity, we investigated the quantitative correlation between it and the cPass sVNT.

Materials and methods

Patient cohorts

A total of 188 individual (332 samples) were included in this study. This includes 219 samples obtained from 75 laboratory-confirmed COVID-19 cases between April 2020 and January 2021, and 113 samples from 113 healthcare workers 2 months after their second doses of BNT162b2 vaccine between March and April 2021 in the Juntendo University Hospital, located in Tokyo, Japan. All samples were obtained from Juntendo University Hospital in Tokyo, Japan. A confirmed case of COVID-19 was defined as a positive result of a RT-PCR assay from pharyngeal swab specimens using the 2019 Novel Coronavirus Detection Kit (Shimadzu, Kyoto, Japan). We first categorized SARS-CoV-2 infected patients into mild, moderate, severe, and critical according to the WHO criteria (https://www.who.int/publications/i/item/WHO-2019-nCoV-clinical-2021-2). Mild COVID-19 was defined as respiratory symptoms without evidence of pneumonia or hypoxia, while moderate or severe infection was defined as presence of clinical and radiological evidence of pneumonia. In moderate cases, SpO2 ≥94% is observed in room air, while one of the following was required to identify the severe and critical cases: respiratory rate >30 breaths/min or SpO2 <94% on room air. Critical illness was defined as respiratory failure, septic shock, and/or multiple organ dysfunction (COVID-19 Clinical management: living guidance https://www.who.int/publications/i/item/clinical-management-of-covid-19). We then organized them into Group M, which included mild and moderate cases, and Group S, which included severe and critical cases. Group M patients with a high-risk background were hospitalized and included in the long-term evaluation study.

Of the 75 confirmed COVID-19 patients, 20 cases fall under Group S (critical 4, severe 16) and produced 96 samples (critical 25, severe 71), while 55 cases (moderate 51, mild 4) fall under Group M and produced 123 samples (moderate 103, mild 20).

This study was approved by the Juntendo University Hospital institutional review board (IRB # 20–036) and conducted according to the Helsinki Declarations, using the opt-out method of the hospital website.

Serologic testing for SARS-CoV-2 by Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG (VITROS S-IgG)

The IgG antibodies against the S1 subunit of the spike protein of SARS-CoV-2 were quantitatively measured using VITROS Immunodiagnostic Products Anti-SARS-CoV-2 IgG Quantitative Reagent (Ortho Clinical Diagnostics, New Jersey) on the VITROS 3600 automated immunoassay analyzer (Ortho Clinical Diagnostics). The VITROS Anti-SARS-CoV-2 IgG assay is a chemiluminescent enzyme immunoassay (CLEIA) using a solid-phase SARS-CoV-2 spike protein antigen to capture antibodies and a horseradish peroxidase (HRP)–labeled recombinant SARS-CoV-2 antigen as a detection reagent. The assay is qualitative, and reports results as reactive or nonreactive based on a manufacturer-defined cutoff index (COI; signal sample/ cutoff) of 1.0, with reactive values falling above this decision limit and nonreactive values below. Placement of the cut-off for a reactive sample is set to ≥17.8 BAU (Binding Antibody Units) /mL (https://www.fda.gov/media/150675/download).

The SARS-CoV-2 nucleocapsid-specific total immunoglobulin (N-total Ig) was measured using Elecsys Anti-SARS-CoV-2 electrochemiluminescence immunoassay (Roche Diagnosis, Basel, Switzerland) on a cobas e801 analytical unit. The immunoassay utilizes a double-antigen sandwich test principle and a recombinant protein representing the nucleocapsid antigen for the determination of antibodies to SARS-CoV-2. The results are presented in the form of COI. A COI≧1.0 was interpreted as positive. (https://www.fda.gov/media/137605/download).

Surrogate virus neutralizing antibody detection test by the GenScript cPass SARS-CoV-2 Antibody Detection Kit (cPass sVNT)

Following the company’s instructions, surrogate virus neutralizing (sVN) antibodies were measured by the GenScript cPass SARS-CoV-2 Antibody Detection Kit (cPass sVNT), a blocking enzyme-linked immunosorbent assay (GenScript, Piscataway, New Jersey, USA). The samples and controls were briefly pre-incubated with the HRP-labeled recombinant RBD proteins and the mixture was added to the capture plate pre-coated with the hACE2 proteins. After the complex of sVN antibody with RBD-HRP was removed by washing, the wells were read at 450 nm in a microtiter plate reader. The percent signal inhibition for the detection of sVN antibodies were calculated as follows:

% Signal Inhibition = (1—OD value of Sample /OD value of Negative Control) × 100% (cutoff value: 30% signal inhibition). The specifications of VITROS S-IgG and cPass sVNT are summarized in Table 1.

Table 1. Specifications of VITROS S-IgG and cPass sVNT.

Product Name VITROS Immunodiagnostic Products Anti-SARS-CoV-2 IgG Quantitative Reagent Pack cPass™ SARS-CoV-2 Neutralization Antibody Detection Kit
Manufacturer Ortho Clinical Diagnostics Inc. GenScript USA Inc.
Platform VITROS 3600 analyzer ELISA system
Method CLEIA ELISA
Target antigen Spike protein S1 RBD
Immunoglobulin class IgG Pan-Ig
Sensitivity (%, 95% CI) 91.9 (87.7–95.1)* 100 (87.1–100.0) **
Specificity (%, 95% CI) 100 (99.3–100.0) 100 (95.8–100.0) ***
Unit BAU/mL %
Cut-off 17.8 30

CLEIA, chemiluminescent enzyme immunoassay; ELISA, enzyme-linked immunosorbent assay; RBD, receptor binding domain

*Sensitivity was calculated from PCR positive samples collected after 15 days or later from symptom onset.

**Positive percent agreement with plaque reduction neutralization test (PRNT).

***Negative percent agreement with PRNT.

Statistical analysis

Statistical analyses were performed using GraphPad prism. (GraphPad Software, San Diego, California, USA, www.graphpad.com). Correlation analysis between VITROS S-IgG and cPass sVNT titers was performed using Spearman correlation coefficient. For experiments involving only two groups, the Mann-Whitney U test and Kruskal-Wallis test were performed.

For longitudinal analysis, when experiments involved more than two groups, one-way analysis of variance (ANOVA) followed by Tukey multiple-comparison post hoc analysis were used to analyze statistical differences. Models were fitted to a four-parameter logistic function, with a constrained lower asymptote set to the limit of detection, the infection point, a scale parameter, and the upper asymptote for Group S and Group M. sVN antibody titers were fitted and a comparison between Group S and Group M was conducted in a Z test from the estimations.

Results

Correlation of VITROS S-IgG and cPass sVNT

Fig 1 shows the correlation between the simultaneously-measured quantitative VITROS S-IgG and cPass sVNT values in 277 samples, including 164 samples from 64 COVID-19 patients and 113 samples from 113 vaccinated individuals. The correlation of the quantitative results of VITORS S-IgG with % inhibition values of cPass sVNT was 0.91 of Spearman’s rho value (p < 0.0001).

Fig 1. Comparison of VITROS S-IgG values and cPass sVNT titers.

Fig 1

The concordance between the qualitative results of VITROS S-IgG and cPass SARS-CoV-2 neutralization test in SARS CoV-2 positive patients are shown in Table 2. The positive percent agreement of VITROS S-IgG with cPass sVNT was 85.0% (198/233), and the negative percent agreement was 84.1% (37/44). The overall percent agreement of VITROS S-IgG with cPass sVNT was 84.8% (235/277). Among VITROS S-IgG positive samples, 96.6% (198/205) showed positive for cPass sVNT. However, we observed that 48.6% of VITROS S-IgG negative samples were cPass sVNT positive (35/72).

Table 2. Agreement between VITROS S-IgG and cPass sVNT.

cPass sVNT
positive negative
VITROS S-IgG
positive 198 7
negative 35 37

Correlation of VITROS S-IgG and cPass sVNT was evaluated using 277 serum samples: 164 from 64 COVID-19 patients and 113 from 113 vaccinated individuals. P value was evaluated by Spearman’s rank-order correlation coefficient (rho). The vertical axis is in logarithmic notation.

Seroprevalence and changes of VITROS S-IgG antibody titers in COVID-19 patients

The seroprevalence of S-IgG was investigated using the VITROS S-IgG antibody assay with 219 longitudinally assessed samples from the 75 COVID-19 patients. Fig 2 shows chronological changes of S-IgG antibody titers and positivities detected by the VITROS S-IgG antibody assay after symptom onset. In Group S, the S-IgG level increased every week after onset with a significant increase from week 2 to week 3 (p<0.0001, Kruskal-Wallis test). In Group M, S-IgG level increased significantly from week 1 to week 2 (p<0.0001) and week 2 to week 3 (p<0.05). The S-IgG value of Group S was significantly higher than that of Group M during week 3 and week 4 after symptom onset (p<0.0001, Mann–Whitney U test). The clinical sensitivity of VITROS S-IgG was shown in Table 3. Sensitivity increased proportionally with time post-infection, reaching approximately 40% in critical, severe, and moderate cases 2 weeks after symptom onset, and 100% after 4 weeks. However, in mild cases, no VITROS S-IgG seroconversion was observed even at 4 weeks after onset.

Fig 2. The time course of VITROS S-IgG titers in COVID-19 patients after symptom onset.

Fig 2

Table 3. Clinical sensitivity of VITROS S-IgG.

weeks from onset critical (n = 4)* severe (n = 16) moderate (n = 51) mild (n = 4)
sample # positive # (%) sample # positive # (%) sample # positive # (%) sample # positive # (%)
1 3 0 (0) 10 1 (10) 36 2 (6) 9 0 (0)
2 11 4 (36) 36 15 (42) 45 17 (38) 7 0 (0)
3 8 5 (63) 18 18 (100) 19 16 (84) 3 0 (0)
4 3 3 (100) 5 5 (100) 2 2 (100) 1 0 (0)
5 0 0 (N/A) 2 2 (100) 1 1 (100) 0 0 (N/A)

* patient number

N/A, not applicable

S-IgG titers were measured for SARS-CoV-2 PCR-positive patient samples for the indicated weekly timeframes post symptom onset using the VITROS S-IgG antibody assay. Ninety-six samples from 20 severe to critical cases (Group S) and 123 samples from 55 mild to moderate cases (Group M) were tested. The levels of S-IgG antibody in Group S and Group M were compared. Gray bars indicate Group S and open bars indicate Group M. The vertical axis is in logarithmic notation. The data are presented as means with interquartile ranges. Statistical significance is indicated as follows: *p < 0.05, **p < 0.0001 (Mann-Whitney U test).

Kinetics of surrogate neutralizing antibody in COVID-19 patients

Next, we evaluated the kinetics of sVN antibody using the cPass sVNT with 164 longitudinally-assessed samples from the 65 COVID-19 patients—84 samples from 20 patients of Group S and 80 samples from 45 of Group M.

Changes of cPass sVNT titers after symptom onset are shown in Fig 3. In Group S, cPass sVNT levels increased every week after symptom onset with a significant increase from week 2 to week 3 (p<0.0001), reaching an apparent plateau at week 4. In Group M, cPass sVNT values increased moderately with a significant increase from week 2 to week 3 (p<0.05). The sVNT value of Group S was significantly higher than that of Group M during week 4. (p<0.0001, Mann–Whitney U test). Table 4 shows cPass sVNT positivity after symptom onset. In critical, severe, and mild cases, 100% sensitivity was observed 3 weeks after onset. Four weeks after symptom onset, all cases tested were positive for cPass sVNT.

Fig 3. The time course of cPass sVNT titers in COVID-19 patients after symptom onset.

Fig 3

Table 4. Clinical sensitivity of cPass sVNT.

weeks from onset critical (n = 4)* severe (n = 16) moderate (n = 42) mild (n = 3)
sample # positive # (%) sample # positive # (%) sample # positive # (%) sample # positive # (%)
1 3 2 (67) 6 2 (33) 17 7 (41) 1 0 (0)
2 9 5 (56) 31 22 (71) 35 25 (71) 4 2 (50)
3 7 7 (100) 18 18 (100) 18 14 (78) 1 1 (100)
4 3 3 (100) 5 5 (100) 2 2 (100) 1 1 (100)
5 0 0 (N/A) 2 2 (100) 1 1 (100) 0 0 (N/A)

* patient number

N/A, not applicable

sVN antibody values were measured for SARS-CoV-2 PCR-positive patient samples for the indicated weekly timeframes post-onset of symptoms using cPass sVNT. 84 samples from 20 severe to critical cases (Group S) and 80 samples from 45 mild to moderate cases (Group M) were tested. The levels of S-IgG antibody in Group S and Group M were compared. Gray bars indicate Group S and open bars indicate Group M. The vertical axis is in logarithmic notation. The data are presented as means with interquartile ranges. Statistical significance is indicated as follows: *p < 0.05; **p < 0.0001 (Mann-Whitney U test).

Longitudinal assessment of antibody level in COVID-19 patients

To examine changes in antibody levels over time, we plotted the titers of inpatients measured two or more times in a row (Fig 4). A total of 190 samples from 46 cases were collected up to 31 days after symptom onset to determine the antibodies’ rate of change. The 45 cases were divided into two groups: group S (20 cases, including 16 severe and 4 critical cases) and group M (25 cases, including 4 mild and 21 moderate cases). All mild, moderate, and severe cases were cured and discharged. All critical cases have deceased. We determined the kinetics of the emergence of S-IgG and NT antibodies using nonlinear mixed-effects models, as described in Materials and Methods. VITROS S-IgG values and cPass sVNT titers from hospitalized patients were plotted against time from symptom onset and fitted (Fig 4A and 4B, lower graphs). We observed highly significant differences of the plateau values between Group S and Group M individuals both for the VITORS S-IgG values and for the cPass sVNT titers (p = 0.032 and p<0.0001 by Wilcoxon test, respectively).

Fig 4. Longitudinal change of S-IgG and sVNT values.

Fig 4

Longitudinal changes of S-IgG antibody and sVN antibody levels were investigated for the indicated weekly timeframes post-onset of symptoms.

  1. (A) The VITROS S-IgG assay was performed using 96 samples from 20 severe and critical cases (Group S) and 94 samples from 25 mild and moderate cases (Group M).

  2. (B) The cPass sVNT was performed using 83 samples from 20 cases of Group S and 50 samples from 14 cases of Group M.

The graphs at the bottom show the comparisons of the fitted plateau values after day 15 post symptom onset of Group S and Group M for VITROS S-IgG (A) and cPass sVNT (B) titers (Wilcoxon Z test, lower panels). The vertical axes are in logarithmic notation. Group S: critical, light blue lines; severe, dark blue lines. Group M: moderate, red lines; mild, purple lines.

Distribution of VITROS S-IgG and cPass sVNT values after second vaccination

Finally, we investigated VITROS S-IgG and cPass sVNT levels in 113 healthcare workers who received two doses of BNT162b2 mRNA vaccine by May 13, 2021. The serum samples were obtained between June 8 and 21. Because seropositive individuals with N-specific antibodies are considered previously infected with SARS-CoV-2 with asymptomatic COVID-19, the positivity of N-specific antibodies was further detected. All tested individuals, except one immunosuppressed case suffering from collagen disease, were seropositive with both VITROS S-IgG and cPass sVNT. The median antibody titer was 777.0 BAU/ml (IQR 457.7–1355.0) for S-IgG and 95.4% (IQR 89.8–97.1) for sVNT. The post-vaccination healthcare workers were then divided into 3 groups; Group 1, N-specific antibody-negative/no COVID-19 history (n = 73); Group 2, N-specific antibody-positive/no COVID-19 history (n = 25); and Group 3, with COVID-19 history, the time of onset of COVID-19 varied from 2 to 14 months (n = 15).

As shown in Fig 5, both VITROS S-IgG and cPass sVNT values were statistically lower in the individuals who were negative for N-specific antibody compared to the ones with a history of COVID-19 and those who were positive for N-specific antibodies without previously diagnosed COVID-19. The N-specific antibody positive individuals showed comparable S-IgG and sVNT titers to those of the ones who had been diagnosed with COVID-19. We further investigated whether the values of S-IgG and sVN antibody values were changed over time after vaccination. As shown in Fig 6, both VITROS S-IgG and cPass sVNT titers did not decrease significantly over time up to 75 days after the second vaccination, regardless of previous COVID-19 infection.

Fig 5. Distribution of VITROS S-IgG and cPass sVNT values in participants after second vaccination.

Fig 5

Fig 6. Change in VITROS S-IgG and cPass sVNT titers over time after second vaccination.

Fig 6

VITROS S-IgG levels (A) and cPass sVNT values (B) were quantified in post-vaccination healthcare workers (n = 113). Group 1, N-specific antibody negative without COVID-19 history (n = 73); Group 2, N-specific antibody positive without COVID-19 history (n = 25); Group 3, with COVID-19 history (n = 15). Open circles in Group 3 were the individuals with negative N-specific antibody (n = 3). The vertical axis of VITROS S-IgG levels (A) is logarithmic notation. Statistical analysis was performed using one-way ANOVA, and statistical significance is indicated as follows: **p < 0.0001; ns, no significant difference.

VITROS S-IgG levels (A) and cPass sVNT values (B) were quantified in post-vaccination healthcare workers (n = 113). Group 1, N-specific antibody negative without COVID-19 history (n = 73); Group 2, N-specific antibody positive without COVID-19 history (n = 25); Group 3, with COVID-19 history (n = 15). Scatterplot and regression line colors indicate the antibody response. The 95% CIs are calculated by prediction ± 1.96 × standard error of prediction. The vertical axis of VITROS S-IgG levels (A) is in logarithmic notation.

Discussion

In this study, we evaluated the commercially-available automated quantitative immunoassay Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG (VITROS S-IgG) test by comparing it with sVN antibody levels detected by the cPass sVNT and clinical assessment. To the best of our knowledge, this is the first report to study the correlation of VITROS S-IgG with sVN antibodies.

Currently, the neutralizing activity of the detected S-specific antibodies after vaccination is a major concern. In response to this, sVNT was developed and reported to be correlated well with the “gold standard” plaque reduction neutralizing test (PRNT) [14, 15]. In this study, we observed that Ortho VITROS S-IgG immunoassay strongly correlated with the sVN antibody titers detected by cPass sVNT. These results consistent with recent reports concerning immunoassays other than VITROS S-IgG, which demonstrate good correlations between S-specific antibodies and NT antibodies measured by cPass sVNT [16, 17]. However, almost half of the VITROS S-IgG negative samples were found to be cPass sVNT positive. Moreover, in longitudinal evaluations from COVID-19 patients, S1-IgG was negative in all mild cases, but cPass sVNT was positive in some. VITROS S-IgG quantitatively detects only IgG subclass antibodies against the S1 subunit of the spike protein. In contrast, cPass sVNT qualitatively detects total surrogate neutralizing antibodies in an isotype-independent manner which determines antibodies have neutralizing activity (i.e., binding inhibitory effect) if they bind to RBD by 30% or more. Previous reports have shown that the sVNT assay detects a substantial level of sVN antibodies regardless of the IgM/IgG ratio [13], which indicates that there are sVN antibodies with RBD binding ability even below the cutoff value of Vitros S-IgG. However, further research is warranted to determine whether sVNT detected NT antibody levels are directly related to protection against infection.

Two weeks after symptom onset, Group S showed significantly higher values than Group M in both VITROS S-IgG and cPass sVNT assays. These findings are consistent with previous reports demonstrating that elevated NT antibody levels due to SARS-CoV-2 coincide with disease progression [18, 19]. Because NT antibodies can block infection directly, the role of the antibody response in COVID-19 immunopathology is unclear.

In terms of the COVID-19 humoral immune response after vaccination, we observed good agreement between VITROS S-IgG and cPass sVNT levels in the healthcare workers sampled 2 months after the second dose of BNT162b2 vaccination. A high titer of S-specific antibodies was observed in N-specific seropositive individuals who have not been diagnosed with COVID-19 by RT-PCR since they lacked COVID-19 related symptoms. S-specific antibody titers of N-positive individuals were comparable to those of COVID-19 infected cases. We did not observe significant decrease of VITROS S-IgG and cPass sVNT titers up to 75 days after the second vaccination. Several studies on the durability of humoral response have shown that levels of both S-IgG and NT antibody decrease modestly until about 8 months after SARS-CoV-2 infection in recovered cases [20, 21]. However, significant reductions in these antibodies have been reported within 6 months after the second dose of the BNT162b2 vaccine [22], with frequent incidence of breakthrough infections [23, 24]. In this study, no significant decrease in VITROS S-IgG and cPass sVNT titers was observed up to 75 days after the second vaccination, regardless of previous COVID-19 infection history. More long-term longitudinal evaluations are required to clarify whether previous infections affect the efficacies of vaccinations.

This study had several limitations. First, it was conducted in a single university hospital. Second, specificity of the tests has not been validated using pre-COVID-19 clinical specimens. Third, because the COVID-19 samples were obtained from hospitalized patients after SARS-CoV-2 wave, specificity was not evaluated with the samples pre wave and asymptomatic COVID-19 cases were not included. Forth, post-vaccination antibody measurements were made only once and chronological changes in antibody titers could not be followed for the same individuals. Fifth, to measure NT antibody activity levels, we utilized the cPass sVNT kit, a surrogate test for NT antibody, but did not perform the “gold standard” PRNT.

Antibody responses represent key immune correlates of protection for SARS-CoV-2 as well as a diagnostic tool. VITROS automated quantitative immunoassay system offers high-throughput, widely available laboratory measurement of antibodies as an advantage compared to the time-consuming, low-throughput cPass sVNT. However, this study revealed that patients with low antibody titers, such as mild cases of COVID-19, could be cPass sVNT positive but VITROS S-IgG negative. This is a major disadvantage of VITROS S-IgG for use as a quantitative marker of neutralizing activity.

In conclusion, we observed that the automated quantitative immunoassay VITROS S-IgG showed good diagnostic performance and a reasonable correlation with the sVN antibodies detected by the cPass sVNT. However, this study also demonstrated the limitation in using VITROS S-IgG as a direct quantitative marker of neutralization activity capacity. These findings indicate that the VITROS S-IgG may be a useful diagnostic tool and can be utilized to assess response to vaccination and herd immunity with careful interpretation.

Acknowledgments

The authors thank the Department of Research Support Utilizing Bioresource Bank, Juntendo University Graduate School of Medicine, for use of their facilities.

Data Availability

All relevant data are presented and shared in the main figures and tables of the paper.

Funding Statement

This work was supported in part by Japan Agency for Medical Research and Development (grant No. JP20fk0108472) to Toshio Naito and by Japan Society for the Promotion of Science Grants-in Aid for Scientific Research (grant No. 22K15675) to Dr. Satomi Takei. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Cutler DM, Summers LH. The COVID-19 Pandemic and the $16 Trillion Virus. Jama. 2020;324(15):1495–6. doi: 10.1001/jama.2020.19759 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Sethuraman N, Jeremiah SS, Ryo A. Interpreting Diagnostic Tests for SARS-CoV-2. Jama. 2020;323(22):2249–51. doi: 10.1001/jama.2020.8259 [DOI] [PubMed] [Google Scholar]
  • 3.Saito K, Ai T, Kawai A, Matsui J, Fukushima Y, Kikukawa N, et al. Author Correction: Performance and usefulness of a novel automated immunoassay HISCL SARS-CoV-2 Antigen assay kit for the diagnosis of COVID-19. Sci Rep. 2021;11(1):23968. doi: 10.1038/s41598-021-03518-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Mina MJ, Parker R, Larremore DB. Rethinking Covid-19 Test Sensitivity—A Strategy for Containment. N Engl J Med. 2020;383(22):e120. doi: 10.1056/NEJMp2025631 [DOI] [PubMed] [Google Scholar]
  • 5.Vandenberg O, Martiny D, Rochas O, van Belkum A, Kozlakidis Z. Considerations for diagnostic COVID-19 tests. Nat Rev Microbiol. 2021;19(3):171–83. doi: 10.1038/s41579-020-00461-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Igawa G, Yamamoto T, Baba Y, Shinozuka K, Yuri M, Wakita M, et al. Clinical Evaluation of Siemens SARS-CoV-2 Total Antibody assay and IgG assay using the Dimension EXL 200 in the Tokyo Metropolitan area. Heliyon. 2021;7(11):e08393. doi: 10.1016/j.heliyon.2021.e08393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Wakita M, Idei M, Saito K, Horiuchi Y, Yamatani K, Ishikawa S, et al. Comparison of the clinical performance and usefulness of five SARS-CoV-2 antibody tests. PLoS One. 2021;16(2):e0246536. doi: 10.1371/journal.pone.0246536 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Hiki M, Tabe Y, Ai T, Matsue Y, Harada N, Sugimoto K, et al. Seroprevalence of anti-SARS-CoV-2 antibodies in Japanese COVID-19 patients. PLoS One. 2021;16(4):e0249449. doi: 10.1371/journal.pone.0249449 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Weitz JS, Beckett SJ, Coenen AR, Demory D, Dominguez-Mirazo M, Dushoff J, et al. Modeling shield immunity to reduce COVID-19 epidemic spread. Nat Med. 2020;26(6):849–54. doi: 10.1038/s41591-020-0895-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Krammer F, Simon V. Serology assays to manage COVID-19. Science. 2020;368(6495):1060–1. doi: 10.1126/science.abc1227 [DOI] [PubMed] [Google Scholar]
  • 11.Weisberg SP, Connors TJ, Zhu Y, Baldwin MR, Lin WH, Wontakal S, et al. Distinct antibody responses to SARS-CoV-2 in children and adults across the COVID-19 clinical spectrum. Nat Immunol. 2021;22(1):25–31. doi: 10.1038/s41590-020-00826-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Weidner L, Gänsdorfer S, Unterweger S, Weseslindtner L, Drexler C, Farcet M, et al. Quantification of SARS-CoV-2 antibodies with eight commercially available immunoassays. J Clin Virol. 2020;129:104540. doi: 10.1016/j.jcv.2020.104540 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Tan CW, Chia WN, Qin X, Liu P, Chen MI, Tiu C, et al. A SARS-CoV-2 surrogate virus neutralization test based on antibody-mediated blockage of ACE2-spike protein-protein interaction. Nat Biotechnol. 2020;38(9):1073–8. doi: 10.1038/s41587-020-0631-z [DOI] [PubMed] [Google Scholar]
  • 14.Sholukh AM, Fiore-Gartland A, Ford ES, Miner MD, Hou YJ, Tse LV, et al. Evaluation of Cell-Based and Surrogate SARS-CoV-2 Neutralization Assays. J Clin Microbiol. 2021;59(10):e0052721. doi: 10.1128/JCM.00527-21 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Perera RAPM, Ko R, Tsang OTY, Hui DSC, Kwan MYM, Brackman CJ, et al. Evaluation of a SARS-CoV-2 surrogate virus neutralization test for detection of antibody in human, canine, cat, and hamster sera. J Clin Microbiol. 2021;59:e02504–20. doi: 10.1128/JCM.02504-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Jung K, Shin S, Nam M, Hong YJ, Roh EY, Park KU, et al. Performance evaluation of three automated quantitative immunoassays and their correlation with a surrogate virus neutralization test in coronavirus disease 19 patients and pre-pandemic controls. J Clin Lab Anal. 2021;35(9):e23921. doi: 10.1002/jcla.23921 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Kim Y, Lee JH, Ko GY, Ryu JH, Jang JH, Bae H, et al. Quantitative SARS-CoV-2 Spike Antibody Response in COVID-19 Patients Using Three Fully Automated Immunoassays and a Surrogate Virus Neutralization Test. Diagnostics (Basel). 2021;11(8). doi: 10.3390/diagnostics11081496 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Wang Y, Zhang L, Sang L, Ye F, Ruan S, Zhong B, et al. Kinetics of viral load and antibody response in relation to COVID-19 severity. J Clin Invest. 2020;130(10):5235–44. doi: 10.1172/JCI138759 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Liu L, To KK, Chan KH, Wong YC, Zhou R, Kwan KY, et al. High neutralizing antibody titer in intensive care unit patients with COVID-19. Emerg Microbes Infect. 2020;9(1):1664–70. doi: 10.1080/22221751.2020.1791738 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Dan JM, Mateus J, Kato Y, Hastie KM, Yu ED, Faliti CE, et al. Immunological memory to SARS-CoV-2 assessed for up to 8 months after infection. Science. 2021;371(6529). doi: 10.1126/science.abf4063 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Vanshylla K, Di Cristanziano V, Kleipass F, Dewald F, Schommers P, Gieselmann L, et al. Kinetics and correlates of the neutralizing antibody response to SARS-CoV-2 infection in humans. Cell Host Microbe. 2021;29(6):917–29.e4. doi: 10.1016/j.chom.2021.04.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Levin EG, Lustig Y, Cohen C, Fluss R, Indenbaum V, Amit S, et al. Waning Immune Humoral Response to BNT162b2 Covid-19 Vaccine over 6 Months. N Engl J Med. 2021;385(24):e84. doi: 10.1056/NEJMoa2114583 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Anderson M, Stec M, Rewane A, Landay A, Cloherty G, Moy J. SARS-CoV-2 Antibody Responses in Infection-Naive or Previously Infected Individuals After 1 and 2 Doses of the BNT162b2 Vaccine. JAMA Netw Open. 2021;4(8):e2119741. doi: 10.1001/jamanetworkopen.2021.19741 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Hall VJ, Foulkes S, Charlett A, Atti A, Monk EJM, Simmons R, et al. SARS-CoV-2 infection rates of antibody-positive compared with antibody-negative health-care workers in England: a large, multicentre, prospective cohort study (SIREN). Lancet. 2021;397(10283):1459–69. doi: 10.1016/S0140-6736(21)00675-9 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Etsuro Ito

8 Jul 2022

PONE-D-22-15685Performance evaluation of the Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG test by comparison with neutralizing antibody and clinical assessmentPLOS ONE

Dear Dr. Tabe,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

As pointed out by one of the reviewers, please describe the details of patient characters.

Please submit your revised manuscript by Aug 18 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Etsuro Ito

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. Thank you for stating the following financial disclosure: 

"This work was supported in part by This research was partially supported by AMED under Grant Number JP20fk0108472 to TN."

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." 

If this statement is not correct you must amend it as needed. 

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

4. Thank you for stating the following in the Competing Interests section: 

"Ortho Clinical Diagnostics provided Anti-SARS-CoV-2 IgG Quantitative Reagent, and Roche Diagnosis provided reagents for Elecsys Anti-SARS-CoV-2 assay free of cost to the researchers. The companies did not take part in 1) the study design, 2) the data interpretation, and 3) the writing of this paper."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. 

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

5. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

6. Please amend the manuscript submission data (via Edit Submission) to include author Takashi Miida.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Takahashi M. et al. evaluated the performance of the Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG kit. This work would give the useful information to the readers, but it is necessary to improve this manuscript for publication in PLoS One.

1) Line 229: Table 1 does not summarize the clinical background characteristics. Please add the table to show the clinical information.

2) Fig. 1: The power of antibody detection seems different between cPass sVNT and VITROS S-IgG. Why? Please explain the reason.

3) Fig. 2: Fig. 2 (A), (B), and (C) are redundant. Please avoid the repetition. (I think that all results shown in (A), (B), and (C) can be unified in (C).)

4) Fig.3: Fig. 3 (A), (B), and (C) are also redundant. Please avoid the repetition.

5) Please show and discuss the specificity and sensitivity of VITROS S-IgG and cPass sVNT. Authors should clearly state the advantages and disadvantages of VITROS S-IgG as compared with cPass sVNT.

6) I recommend adding the new table for easy understanding of the details of VITROS S-IgG and cPass sVNT (manufacturer, method, antigen, immunoglobulin class, unit etc.).

7) The amount of antibody can be affected by how long time has passed after vaccination. However, there was no information on the timing of sample collection from the vaccinees. Please show this point.

8) In addition, no information was shown when the patients in Group 3 were vaccinated and diagnosed with COVID-19. The timings of vaccination, sample collection, and infection should influence the antibody titer. Please clarify these points.

Reviewer #2: In this manuscript, Takahashi et al evaluated the performance of Ortho VITROS SARS-CoV-2 spike-specific quantitative IgG (VITROS S-IgG) assay, in comparison with GenScript cPass SARS-CoV-2 Neutralization Antibody Detection Kit (cPass sVNT assay). They described that VITROS S-IgG showed good correlation with the cPass sVNT assay. They concluded that VITROS S-IgG is useful as a diagnostic tool and can be utilized for assessing immune response to vaccination and herd immunity.

This is the first report to show the correlation of VITROS S-IgG with NT antibodies, but there are several points which have to be improved for publication in PLoS One.

Major points

1. Page 7, lines 108 to 112.

The authors should describe the details of the patients’ characteristics of Group S and Group M, which are explained in the COVID-19 clinical management Living Guideline from WHO.

2. Page 6, lines 90 to 94.

cPass sVNT assay is a surrogate test for neutralizing antibody using pseudovirus as the authors mentioned in the abstract and the main text; the comparison shown in this manuscript was not performed using cell-culture test which is the gold standard method for virus-neutralization. The authors should describe it as a limitation of this study in the discussion.

3. Figure 1 and Table 1

There are few description regarding Table 1 in the main text. Assuming that Figure 1 and Table 1 show the same content, the correlation between VITROS S-IgG and cPass sVNT assay is not excellent; The agreement of result calculated from Table 1 is 85%. The authors should explain it in the discussion.

Minor points

1. Page 8, lines 116 to 118.

The approvable number from Juntendo IRB is required.

2. Page 14, line 229.

Table 1 shows “Agreement between Vitros S-IgG and cPass”, but not “summarizes the clinical background characteristics”. The authors should reconcile these expression. In addition, the order of items in the table 1 should be corrected; VITROS S-IgG should be shown in the left column, rather than in the upper right in the table. The explanation for “(%)” is needed, because it is hard to understand which ratio is shown as “(%)”. “Positive” should be shown preferentially upward than “Negative”.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Etsuro Ito

20 Oct 2022

PONE-D-22-15685R1Performance evaluation of the Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG test by comparison with neutralizing antibody and clinical assessmentPLOS ONE

Dear Dr. Tabe,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. After your revision, I sent your manuscript to the 2 reviewers who previously reviewed.One of the reviewers was satisfied with your revision but the other one was not (he decided reject).So, I had to send your manuscript to other two reviewers for the fair judgement and then received the comments from these two.Thus, I need to ask you to revise your manuscript again.Please consider the comments from Reviewers #3 and #4.Thank you for your patience.

Please submit your revised manuscript by Dec 04 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Etsuro Ito

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

Reviewer #3: (No Response)

Reviewer #4: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: (No Response)

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: No

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I feel that the quality of the revised manuscript has been much improved, but this version still has some points to be changed for considering publication in PLoS One.

1) I would like to emphasize that cPass sVNT assay does not show NT titers but the inhibition values of ACE2-RBD interaction as the surrogate based on ELISA. The use of the word "neutralizing antibody" or "NT" would cause the readers to misunderstand. I recommend using other words like "surrogate neutralizing antibody" or "sVNT" in the whole manuscript. Please consider the revision of the title, in particular.

2) The authors concluded that VITROS S-IgG shows good correlation with the cPass sVNT assay. However, I feel that the interpretation of the results by the authors was not reasonable. Table 2 demonstrates that the performance of VITROS S-IgG was quite different from that of cPass sVNT. Table 3 and Table 4 also show that cPass sVNT had the higher clinical sensitivity than the VITROS S-IgG (for example, cPass sVNT assay showed 4 positives in 7 samples, but VITROS S-IgG assay did 0 positive in 20 samples in mild cases). Fig.1 to 4 clearly exhibited that VITROS S-IgG had the lower sensitivity than cPass sVNT.

3) Previously, I requested the authors to explain the reason why the power of antibody detection was higher in cPass sVNT than VITROS S-IgG. However, the explanation in the revised manuscript was still insufficient.

Reviewer #2: (No Response)

Reviewer #3: The authors compared the clinical performance of VITRO S-IgG and the NT antibody levels (sVNT assay) using 332 serum samples collected from 188 individuals. The samples were grouped into Group S (severe or critical) and Group M (mild or moderate) with 113 samples obtained from healthcare workers who had received two doses of BNT162b2 vaccine.

The manuscript is well written, and the methodology of the research and its statistical analysis is in a sound manner. In addition, the authors adequately have followed the suggestions of the reviewers and revised their manuscript appropriately. Although these may be trivial things, the manuscript seems to contain some erroneous grammatical usages of English. They should be amended before the manuscript reaches the decision of acceptance for its publication in PLoS One. It is strongly recommended that the manuscript should undergo English editing services. Furthermore, there is a minor point which should be considered for the authors to revise, as below.

A minor point: in line 310(R1), table 5 is not informative and should be omitted. This table only presents the number of the patients accompanied by their disease severity, group, sex, and past medical history, all of which are not relevant to the substance of this research. This information can be summarized and simply included in the main text.

Reviewer #4: The manuscript is well written but a few changes are recommended. IN the abstract , this sentence is unclear and (N-specific) is not defined.

"In regard to the COVID-19 humoral immune response after the second dose of the BNT162b2 vaccination, similar levels of VITROS S-IgG and cPass sVNT were observed with high titers in N-specific seropositive individuals in both VITROS S-IgG and cPass sVNT."

In the discussion (line 391) the is a paragraph about complement, T cells. This manuscript look at neither complement nor T cells and the paragraph seems speculative and not based on the current data.

Table 4 is cutoff on right side

There are 2 blank pages.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

Reviewer #4: No

**********

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 2

Etsuro Ito

14 Dec 2022

Performance evaluation of the Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG test by comparison with the surrogate virus neutralizing antibody test and clinical assessment

PONE-D-22-15685R2

Dear Dr. Tabe,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Etsuro Ito

Academic Editor

PLOS ONE

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #3: (No Response)

Reviewer #4: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #3: (No Response)

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #3: (No Response)

Reviewer #4: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #3: (No Response)

Reviewer #4: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #3: (No Response)

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #3: The authors addressed all the comments raised by the reviewer. This research is relatively small-scale but performed in a sound manner.

Reviewer #4: Looks ok for publication . All comments have been addressed . The authors have responded to criticism and made changes as suggested

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #3: No

Reviewer #4: No

**********

Acceptance letter

Etsuro Ito

16 Jan 2023

PONE-D-22-15685R2

Performance evaluation of the Ortho VITROS SARS-CoV-2 Spike-Specific Quantitative IgG test by comparison with the surrogate virus neutralizing antibody test and clinical assessment

Dear Dr. Tabe:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof. Etsuro Ito

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response to Reviewers_Takahashi_R1.docx

    Attachment

    Submitted filename: Response to Reviewers_Takahashi_R2_1130.docx

    Data Availability Statement

    All relevant data are presented and shared in the main figures and tables of the paper.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES