Skip to main content
Journal of Clinical Microbiology logoLink to Journal of Clinical Microbiology
. 2022 May 18;60(6):e00600-22. doi: 10.1128/jcm.00600-22

Partial ORF1ab Gene Target Failure with Omicron BA.2.12.1

Kyle G Rodino a,, David R Peaper b, Brendan J Kelly c, Frederic Bushman d,e, Andrew Marques d,e, Hriju Adhikari d,e, Zheng Jin Tu f, Rebecca Marrero Rolon g, Lars F Westblade g,h, Daniel A Green i, Gregory J Berry i, Fann Wu i, Medini K Annavajhala j, Anne-Catrin Uhlemann j, Bijal A Parikh k, Tracy McMillen l, Krupa Jani l, N Esther Babady l,m, Anne M Hahn n, Robert T Koch n, Nathan D Grubaugh n,o; Yale SARS-CoV-2 Genomic Surveillance Initiative, Daniel D Rhoads f,p,q
Editor: Alexander J McAdamr
PMCID: PMC9199403  PMID: 35582905

ABSTRACT

Mutations in the genome of SARS-CoV-2 can affect the performance of molecular diagnostic assays. In some cases, such as S-gene target failure, the impact can serve as a unique indicator of a particular SARS-CoV-2 variant and provide a method for rapid detection. Here, we describe partial ORF1ab gene target failure (pOGTF) on the cobas SARS-CoV-2 assays, defined by a ≥2-thermocycle delay in detection of the ORF1ab gene compared to that of the E-gene. We demonstrate that pOGTF is 98.6% sensitive and 99.9% specific for SARS-CoV-2 lineage BA.2.12.1, an emerging variant in the United States with spike L452Q and S704L mutations that may affect transmission, infectivity, and/or immune evasion. Increasing rates of pOGTF closely mirrored rates of BA.2.12.1 sequences uploaded to public databases, and, importantly, increasing local rates of pOGTF also mirrored increasing overall test positivity. Use of pOGTF as a proxy for BA.2.12.1 provides faster tracking of the variant than whole-genome sequencing and can benefit laboratories without sequencing capabilities.

KEYWORDS: cycle threshold (CT) value, ORF1ab gene, partial ORF1ab gene target failure (pORF1ab), RT-PCR, SARS-CoV-2, whole-genome sequencing (WGS)

INTRODUCTION

Mutations in the primer/probe binding sites of the SARS-CoV-2 genome can affect oligonucleotide binding and molecular test performance. Throughout the pandemic, a number of such mutations have been described, resulting in partial or complete PCR target failure (1). Mutations that impair diagnostic detection is a criterion that the United States (U.S.) Centers for Disease Control and Prevention (CDC) considers when classifying a novel SARS-CoV-2 lineage as a variant of concern (2). Most nucleic acid amplification tests (NAAT) that are used for in vitro diagnostic (IVD) clinical testing and have received emergency use authorization (EUA) from the U.S. Food and Drug Administration (FDA) employ multitarget assay design. This limits the diagnostic impact of a SARS-CoV-2 mutation that causes single-target failure, as the additional primer/probe target sequences remain unaltered and adequately detect the presence of viral nucleic acid.

Viral mutations can negatively affect assay performance, but these phenomena have proven useful in certain situations. Whole-genome sequencing (WGS) of SARS-CoV-2 remains inadequately implemented or unavailable in many medical centers across the United States due to logistical, cost, and time constraints. Moreover, full genomic characterization of circulating variants often takes multiple weeks from sample collection to data reporting to public health agencies. Specific mutations that yield unique NAAT performance characteristics can provide broader and more rapid assessment of circulating lineages than WGS. For example, the well-characterized 6-bp deletion in the spike gene resulting in the absence of amino acids H69/V70 (69 to 70del) results in complete loss of detection of the spike gene target on the Thermo Fisher Scientific TaqPath COVID-19 assay (Thermo Fisher Scientific, Waltham, MA), commonly termed S-gene target failure (SGTF). SGTF was a hallmark of the Alpha (B.1.1.7) variant allowing for sequence-free estimation of Alpha’s emergence and prevalence in early 2021 (3). Utility in tracking SGTF was also observed in late 2021 with the introduction of the Omicron (B.1.1.529.1 [BA.1]) variant, which contained the same characteristic 69 to 70del. Rapid estimation of Omicron emergence was possible as the preceding dominant variant, Delta, did not harbor the 69 to 70del and was therefore S-gene target positive (SGTP) (4). Finally, in early 2022, SGTF tracking proved useful in monitoring the transition from BA.1 Omicron to BA.2 Omicron (B.1.1.529.2), as the latter lacked the 69 to 70del and was SGTP, which served as a reliable proxy for identifying BA.2 (5).

While the impact of the 69 to 70del was dramatic, resulting in complete SGTF, other genomic mutations may result in subtler changes, including abnormal variance between cycle threshold (CT) values of multitarget SARS-CoV-2 assays (610). Here, we describe partial ORF1ab gene target failure (pOGTF) as detected by abnormal delta of the CT values from the E and ORF1ab (dEO) targets of the cobas SARS-CoV-2 assay and cobas SARS-CoV-2 & influenza A/B assay (Roche Molecular Systems, Inc.; Branchburg, NJ) linked to BA.2.12.1, which has rapidly emerged in the U.S. in March and April 2022 and has become the dominant SARS-CoV-2 lineage in central New York state (11).

MATERIALS AND METHODS

Study population.

Samples used in this study included upper respiratory specimens (e.g., nasopharyngeal, anterior nares, nasal swabs, and saliva) collected in a transport medium validated by the individual testing laboratory, obtained from patients undergoing standard of care testing for COVID-19 between 6 March 2022 and 16 April 2022, a period of time corresponding to MMWR epidemiologic weeks 10 to 15 (12). Samples included in the dEO analysis were tested for the presence of SARS-CoV-2 on the cobas SARS-CoV-2 or cobas SARS-CoV-2 & influenza A/B assays at the originating laboratory. Samples sent for SARS-CoV-2 WGS may have been tested on a variety of other FDA EUA SARS-CoV-2 diagnostic platforms, and not a cobas SARS-CoV-2 assay, depending on workflows and testing protocols of the originating laboratory. Laboratories contributing to this study and appropriate IRB determination include the Cleveland Clinic Foundation (CCF) Clinical Microbiology Laboratory (IRB no. 18-318), the Clinical Microbiology Laboratory of Columbia University Irving Medical Center (CUIMC; IRB no. AAT0123), the Clinical Microbiology and SARS-CoV-2 Molecular Testing Laboratories at the Hospital of the University of Pennsylvania (HUP; IRB no. 848605), the Clinical Microbiology Service at Memorial Sloan Kettering (MSK; IRB no. 18-491), the Clinical Microbiology Laboratory of Weill Cornell Medical Center (WCMC; IRB no. 20-03021671), the Barnes-Jewish Hospital Molecular Infectious Disease Laboratory and Washington University in St. Louis (WUSTL; IRB no. 20211131), and Clinical Virology Laboratory at Yale-New Haven Hospital (YNHH) and Yale School of Public Health (IRB no. 2000031374).

Cobas SARS-CoV-2 assays.

The cobas SARS-CoV-2 and cobas SARS-CoV-2 & influenza A/B assays are available on the Roche cobas 6800 and 8800 analyzers (Roche Molecular Systems, Inc.). Both assays perform qualitative detection of SARS-CoV-2 using two genome targets: the ORF1ab gene that is specific to SARS-CoV-2 and the pan-sarbecovirus envelope (E) gene. Details on the oligonucleotide sequences and the specific genomic regions targeted by the NAAT are not publicly available. MS2 bacteriophage is used as an internal RNA processing control. RNA extraction, reverse transcription, target amplification, and result analysis all occur on the instrument. Positive results are determined by amplification curves that cross a predetermined threshold thus generating CT values for these loci. These CT values are available to the laboratory but are not included in patient reports by any of the performing laboratories. Only qualitative interpretations (SARS-CoV-2 detected, not detected, or presumptive positive) of the results are reported, which is congruent with the EUA instructions for use. Samples do not have to be positive for both gene targets to be called positive by the assay (ORF1ab gene-only detected, positive; E-gene-only detected, presumptive positive). However, only results positive for both targets were used in this study to allow for CT value comparison. No samples with E-gene CT value of ≤30 and ORF1ab gene “not detected” were identified, and therefore requiring both targets to be positive did not exclude any samples. CT values used in this study as well as dates of sample collection and/or testing were either directly obtained from instruments or extracted from the laboratory information system depending on the testing laboratory.

Identification of samples as dEO outliers.

At all study sites, initial recognition of dEO was determined by manual review of CT values, noticing ≥1 or ≥2 cycle difference between the ORF1ab and E CT values, with ORF1ab CT value greater than E-gene CT value, depending on the institution. The exception was HUP, where a model of expected difference in CT values between two parallel targets as a function of the minimum observed CT value in the pair was used in order to accommodate the observation that the expected difference in CT values across targets increases at higher CT values. The expected variation in the CT value difference was likewise allowed to vary with the minimum observed CT value in the pair. Bayesian mixed-effect linear regression models, incorporating random effects (slope and intercept) for sequencing platform (i.e., amplicon-target pair), were fit using Stan Hamiltonian Monte Carlo via the brms package in R (13, 14). Model parameters were established using CT value data collected across seven platforms from March to June 2021, and the parameterized model was used to monitor for dEO (and other target pair) outliers, with outliers identified as differences beyond the 99% posterior credible interval of the expected CT value difference for the minimum CT value observed in the pair. Model code and sample reproducible report are available at https://github.com/bjklab/SARS-CoV-2_Ct_report.

SARS-CoV-2 whole-genome sequencing.

At CCF, NGS sequencing libraries were prepared with Illumina COVIDSeq test kit according to the manufacturer’s recommendation. These libraries were sequenced paired end with read length of 151 bases using a NextSeq550 instrument (Illumina, San Diego, CA). Data analysis was performed with an in-house developed bioinformatics pipeline. Sequence reads were mapped to reference genome Wuhan-Hu-1 (NC_045512.2) using BWA (version 0.7.15), and variant calling was performed with both Freebayes (version 1.3.4) and LoFreq (version 2.1.5). Average coverage is ×6,567 and minimum coverage for mutation is ×10. Samples below this minimum coverage at the S-gene codon 452 were considered unreliable, and these genotypes were not considered in this study. Manual review of mutations was performed with Integrative Genomics Viewer (IGV) to remove any artifacts. Variant classification was performed with the Pangolin program (https://pangolin.cog-uk.io/ version v4.0.5, lineages version 2022-04-09). Derived genomes with related information were deposited into the GISAID database. Samples from CUIMC and WCMC campuses were sequenced using the Oxford Nanopore (Oxford Nanopore Technologies, Oxford, UK) Midnight protocol targeting 1,200-bp tiled amplicons across the length of the genome, as described previously (15). Samples were sequenced on an Oxford Nanopore GridION using R9.4.1 flow cells, with negative controls included on each run. Variant calling and consensus genome generation were performed using the Oxford Nextflow ARTIC pipeline. Viral lineage classification, identification of mutations, and phylogenetic analyses were performed using Pangolin v4.0.5 and Nextclade v1.11.0. Genomic data from CUIMC is routinely uploaded to GISAID and to GenBank (under NCBI BioProject PRJNA751551). At YNHH, HUP, and MSK, sequencing was performed as described previously, but Pangolin v4.0.5 was used (1619). Sequencing results from WUSTL were not available at the time of writing.

Data analysis.

All charts and analyses were generated and performed with GraphPad Prism v8.2.1. Nonlinear regression of BA.2.12.1 and non-BA.2.12.1 was performed, and best-fit straight lines using the least-squares method and y intercepts were compared for differences. Receiver operating characteristic (ROC) curve to determine the performance characteristics of different dEO cutoff values was generated by classifying samples with lineage information available as either “BA.2.12.1” or “Other.” Positive and negative predictive values of pOGTF for the detection of BA.2.12.1 were calculated using samples with lineage information classified as either BA.2.12.1 or Other where pOGTF was considered a dEO of ≥2 with an E-gene CT value of ≤30.

Data availability.

All SARS-CoV-2 viral genomes have been deposited in GISAID and/or NCBI GenBank with GISAID accession numbers listed in Table S1 in the supplemental material.

RESULTS

Difference in CT values for the E-gene target compared to those for the ORF1ab gene target (dEO) from 6 March 2022 to 16 April 2022 were plotted (Fig. 1, Table S1 in the supplemental material). Using an E-gene CT value cutoff of ≤30 thermocycles to avoid nonspecific variation between values near the limit of detection of the assay, an outlier group with abnormal difference between the two CT values was identified. These data indicate delayed detection of the ORF1ab target compared to that of the E-gene target. In total, 427 of 3,462 total positive samples, run on either the cobas SARS-CoV-2 assay and cobas SARS-CoV-2 & influenza A/B assay, exhibited pOGTF during the study period.

FIG 1.

FIG 1

CT values for ORF1ab and E-gene targets from cobas instruments. SARS-CoV-2 was detected in 3,462 unique samples from 6 March 2022 to 16 April 2022, and ORF1ab and E-gene CT values are plotted. The results clustered into two visibly distinct groups. The upper-left group (dashed box) represents partial ORF1ab gene target failure (pOGTF), and the lower-right group has no target failure. The dashed vertical line indicates an E-gene CT value of 30 that was used as a cutoff for subsequent analyses. Samples with only a single gene detected were not included and are not shown. Abbreviations: Cleveland Clinic Foundation (CCF), Columbia University Irving Medical Center (CUIMC), Hospital of the University of Pennsylvania (HUP), Memorial Sloan Kettering (MSK), Weill Cornell Medical Center (WCMC), Washington University in St. Louis (WUSTL), and Yale-New Haven Hospital (YNHH).

Following institution-specific workflows for SARS-CoV-2 surveillance sequencing, a subset of samples (832) from the study period underwent WGS and lineage determination, including 70 samples showing pOGTF (Table S1). Overwhelmingly, pOGTF samples were determined to be BA.2.12.1 (69/70), with the first WGS-confirmed detection of BA.2.12.1 among study participants occurring in the first week of March in the YNHH cohort and remaining study sites also confirming BA.2.12.1 from pOGTF specimens in late March. The single discrepant result, CCF-0259, demonstrated pOGTF but was identified as BA.2. The remaining 762 non-pOGTF samples sequenced comprised various other lineages (Table S1), with only one determined to be BA.2.12.1 (YNHH-0835). The emergence of samples with pOGTF coincided with increases in BA.2.12.1, and preliminary evidence suggested that pOGTF may be a marker for BA.2.12.1. To explore this, ORF1ab and E-gene CT values were plotted for samples confirmed as BA.2.12.1 or another lineage by sequencing. BA.2.12.1 samples also clustered as dEO outliers (Fig. 2). Best-fit straight lines demonstrated these groups to be different populations with significantly different y intercepts (P < 0.0001). Further analysis of sequencing data demonstrated that BA.2.12.1, a sublineage of BA.2, contains at least five characteristic mutations of interest to this study compared to the parent strain. These include two missense mutations altering amino acids in the spike gene, g.22917 T > G (S:L452Q) and g.23673 C > T (S:S704L), and three synonymous mutations, g.11674 C > T (ORF1ab), g.15009 T > C (ORF1ab), and g.21721 C > T (S). Likely, one of the two ORF1ab synonymous mutations causes reduced efficiency of amplification and/or detection of the target in the cobas SARS-CoV-2 and cobas SARS-CoV-2 & influenza A/B assays, which results in pOGTF and abnormal dEO.

FIG 2.

FIG 2

SARS-CoV-2 lineage designation and cobas CT values. SARS-CoV-2 lineage was determined for 832 samples, including 70 samples with BA.2.12.1 (red) and 762 samples with other lineages (blue). ORF1ab and E-gene CT values are plotted, and the BA.2.12.1 group demonstrates partial ORF1ab gene target failure (pOGTF) as indicated by the elevated y intercept. Linear regression was performed, and best-fit curves for BA.2.12.1 and all other lineages had significantly different y intercepts (P < 0.0001). Only samples with E-gene CT values of ≤30 were used for regression analysis.

We used the subset of samples with lineage information to generate an ROC curve to determine the performance characteristics of different cutoff values for dEO (Fig. 3). At a dEO cutoff of 2.1, the sensitivity was 98.6% while the specificity was 99.9% generated during the ROC analysis. After review of the primary data, there was no difference in performance using a cutoff of 2.0 versus 2.1, and thus dEO of ≥2.0 was selected for simplicity of use in identifying samples with pOGTF (Table 1 and 2). When this criterion was applied to our population of samples with lineage information with E-gene CT values of ≤30, the positive and negative predictive values were 98.6% and 99.9%, respectively. Using the thresholds of E-gene CT values of ≤30 and dEO of ≥2 to define pOGTF, we reanalyzed the cobas SARS-CoV-2 and cobas SARS-CoV-2 & influenza A/B results from all study sites, finding that the pOGTF group showed a mean dEO of 4.02 (95% confidence interval [CI] of 3.95 to 4.09) cycles compared to −0.13 (95% CI of −0.15 to −0.11) cycles in the non-pOGTF group (Table 3).

FIG 3.

FIG 3

ROC curve analysis for dEO as a marker for BA.2.12.1. For samples with available sequencing data, dEO was calculated, and samples were classified as “BA.2.12.1” or “Not BA.2.12.1.” A total of 70 BA.2.12.1 and 762 other lineage samples were included. ROC analysis was performed in GraphPad Prism, and full ROC curve (A) and a detailed view (B) are shown. Only samples with E-gene CT values of ≤30 were used.

TABLE 1.

Contingency table using dEO threshold of ≥2 for samples with E-gene CT of ≤30 as a marker of BA.2.12.1

Data analyzed BA.2.12.1 = yes BA.2.12.1 = no Total
pOGTF = yes 69 1 70
pOGTF = no 1 761 762
Total 70 762 832

TABLE 2.

Performance analysis using dEO threshold of ≥2 for samples with E-gene CT of ≤30 as a marker of BA.2.12.1a

Affected characteristic Value 95% CI
Sensitivity 0.9857 0.9234 to 0.9993
Specificity 0.9987 0.9926 to 0.9999
Positive predictive value 0.9857 0.9234 to 0.9993
Negative predictive value 0.9987 0.9926 to 0.9999
Likelihood ratio 751.1
a

pOGTF for BA.2.12.1 was detected using two-sided Fisher’s exact test with a P value of <0.0001, indicating statistical significance (P < 0.05).

TABLE 3.

Descriptive statistics for the entire data set for samples with E-gene CT of ≤30

Characteristic pOGTF = yes (dEO ≥2) pOGTF = no (dEO <2)
No. of values 427 2,208
Minimum 2.200 −7.570
25% percentile 3.600 −0.3000
Median 4.000 −0.2000
75% percentile 4.400 0.05000
Maximum 10.50 1.900
Range 8.300 9.470
95% CI of median
 Actual confidence level 95.80% 95.00%
 Lower confidence limit 3.900 −0.2000
 Upper confidence limit 4.040 −0.2000
Mean 4.021 −0.1301
Std. deviation 0.7207 0.3699
Std. error of mean 0.03488 0.007872
Lower 95% CI of mean 3.952 −0.1455
Upper 95% CI of mean 4.089 −0.1146
Skewness 1.815 −3.163
Kurtosis 14.95 74.78

To better understand the relationship between pOGTF, the emergence of BA.2.12.1, and overall test positivity, we reviewed publicly available GISAID data to identify the number of all sequences and BA.2.12.1 sequences uploaded from North America for the same time period as our study. Over a 6-week period, the number of sequences submitted was stable, but the proportion of BA.2.12.1 samples increased over time to approximately 17% of all sequences (Fig. 4A). Our total testing data using the pOGTF threshold also revealed a similar rise in samples demonstrating pOGTF, with the proportion of positive samples with pOGTF steadily increasing over the study period, peaking in the final week of the study (April 10 to 16) (Fig. 4B). This rise is continuing. Importantly, the rise in pOGTF at our institutions has also corresponded to an increase in overall test positivity, consistent with concerns of increased transmissibility of the BA.2.12.1 variant.

FIG 4.

FIG 4

Increasing BA.2.12.1 prevalence relates to pOGTF and local positivity. (A) All North American samples submitted to GISAID from the indicated period of time were extracted on 2 May 2022, and the percentage of all sequences classified as BA.2.12.1 was calculated. (B) Percent positivity and percent partial ORF1ab gene target failure (pOGTF) for all samples tested by cobas SARS-CoV-2 or cobas SARS-CoV-2 & influenza A/B assays at participating institutions for the indicated weeks. For Cleveland Clinic data, percent positive data included additional samples tested by an alternative platform. All samples regardless of E-gene CT value were included. Percent pOGTF was calculated for all samples with E-gene CT values of ≤30 with or without a delta of the CT values from the E and ORF1ab (dEO) of ≥2 cycles.

DISCUSSION

Roles for CT values have been hotly debated throughout the pandemic (2030). Multiple sources of preanalytic and analytic variability, along with the qualitative nature of SARS-CoV-2 assays, can complicate interpretation, particularly on a patient-by-patient basis (3133). We find the diagnostic implication of target failure, both full or partial, to be useful. With enough data points, a normal dispersion between CT values of multitarget assays can be constructed and monitored for evidence of abnormal differences in CT values between two targets (Fig. 1) (6, 7). Abnormal divergence between CT values may indicate polymorphisms that affect detection of individual target genes, particularly when the values are well above the limit of detection (610). Outliers showing abnormally large differences between targets or delayed detection of a given target relative to that of other targets may indicate mutations affecting the primer/probe binding sites and warrant further characterization by WGS. Unfortunately, target failure cannot always be assessed by the user. Target failure can potentially be assessed if the following are true: (i) RT-PCR is used, (ii) CT values are visible to the user, (iii) each target being probed uses a discrete fluorophore, and (iv) a target is detected within the linear dynamic range of the assay.

Tracking unique assay performance characteristics as a marker of a specific variant has demonstrated value through more rapid assessment than WGS, as has been readily apparent with SGTF in the Alpha and Omicron (BA.1 and BA.2) waves of the COVID-19 pandemic. Here, we describe the use of pOGTF on the cobas SARS-CoV-2 and cobas SARS-CoV-2 & influenza A/B assays to rapidly identify the emergence of BA.2.12.1. pOGTF is a highly reliable proxy for BA.2.12.1, particularly for samples with CT values of ≤30 thermocycles. This phenomenon is useful for rapid recognition, particularly for laboratories that lack sequencing capabilities. The CDC Nowcast variant proportion projection for the week ending 30 April 2022 estimates BA.2.12.1 at 36.5% (28.9 to 44.9%) nationally, with higher proportions in the Northeast of the United States (34). Our data are congruent with these projections, showing highest concentration in the U.S. Northeast with spread into the U.S. Midwest through mid-April, and we demonstrate that pOGTF can be used for real-time BA.2.12.1 tracking. Notably, estimates of the BA.2.12.1 variant fraction using pOGTF are higher than WGS-derived projections. This increased fraction may indicate that BA.2.12.1 is spreading more quickly than has been estimated.

Two pOGTF discrepancies were identified: a BA.2 lacking the BA.2.12.1-related ORF1ab mutations, yet exhibiting pOGTF, and a BA.2.12.1 with all expected ORF1ab polymorphisms present but lacking pOGTF. The reason for these discrepancies is unknown but may include many sources of error from preanalytical factors through sequence data analysis.

The emergence of BA.2.12.1 at our study sites has coincided with increased positivity rates (Fig. 4), suggesting that this variant is at least partially responsible for increased community transmission. Increased transmissibility is likely attributable in part to the spike L452Q mutation present in BA.2.12.1, which is not found in the parent strain but was present in Lambda (C.37). A similar mutation, L452R, was observed with Delta (B.1.617.2) and is present in BA.4 (B.1.1.529.4) and BA.5 (B.1.1.529.5). L452Q has been implicated as an important driver of human transmission, enhancing infectivity and receptor binding while reducing vaccine-derived immunity (35).

For routine diagnostic laboratories, identifying mutations responsible for altering commercial assay performance is hindered by a lack of public information regarding the primer/probe target regions of commercially available FDA EUA assays. As stated during the 26 July 2021 CDC Clinical Laboratory COVID-19 Response Call, “…ideally genomic regions targeted by IVDs would be made publicly available by manufacturers, so prospective investigation of polymorphisms occurring within target regions could be identified” (36). In the context of a global pandemic and under FDA EUA, the authors support disclosure of primer/probe target regions to facilitate monitoring for mutations that could affect diagnostic assay performance. We acknowledge the potential financial risks in publishing propriety sequences but feel that this is appropriate during a Declaration of a Public Health Emergency. As in the case of pOGTF with BA.2.12.1, two putative mutations in ORF1ab (g.11674 C > T and g.15009 T > C) have been identified, but the responsible mutation affecting the assay performance has not yet been confirmed. If the former, this supports Wang et al.’s conclusion that cytidines in assay target regions are particularly susceptible to mutations for SARS-CoV-2 (37). Additional challenges for sentinel laboratories in identifying assay-affecting mutations are the frequency of the observation and quantity of testing. Sentinel laboratories may struggle to identify an emerging pattern when restricted to local data. It may therefore be easier to identify target failure using larger data sets or by retrospectively retesting samples with mutations identified by WGS if the genomic regions targeted by the NAAT are publicly available.

Currently, mutations affecting primer/probe binding are self-monitored by manufacturers, which may pose a conflict of interest (38). Recognition of a mutation negatively affecting test performance could require assay redesign, revalidation, and resubmission to FDA for updated EUA, posing a number of potential commercial risks. Monitoring relies on publicly generated and openly shared genomic data (GISAID and GenBank), but the lag in availability of WGS data may delay detection of new variants that affect assay performance by weeks. Additionally, if a variant emerges in a locale with low sequencing surveillance, recognition may be delayed further. As demonstrated herein, monitoring of assay performance through real-time evaluation of CT values has utility in SARS-CoV-2 variant surveillance and could inform clinical and logistical decision making. Widespread real-time uploading of SARS-CoV-2 NAAT CT values to an FDA or manufacturer-sponsored database, similar to the data curation available for BioFire Syndromic Trends Epidemiology Tool, could permit rapid detection, and thus response, to emerging variants (39).

This study has some limitations. Not all SARS-CoV-2 tests were performed on the cobas SARS-CoV-2 assays as multiple NAAT platforms are used at each participating site, and operational workflow may have unintentionally introduced biases (e.g., directing samples from certain patient populations or need for rapid result to particular platforms) to the study set. All analyses were performed on a per-sample and not a per-subject basis, and a single subject’s samples could have been included multiple times within the data set. However, the impact of this possibility is diminished by the multicenter nature of this study and large amount of data. While pOGTF is currently specific to BA.2.12.1, the specificity, sensitivity, and predictive values may change over time as SARS-CoV-2 continues to evolve and the lineages prevalent in the population changes. Additionally, the same data set used to generate the dEO cutoff was used to establish these performance characteristics. Although pOGTF can be a rapid and useful tool for monitoring BA.2.12.1, WGS remains important in confirming the lineage, assessing for additional mutations, and detecting new variants that decrease the specificity of the association of pOGTF with BA.2.12.1. To our current knowledge, the pOGTF phenomenon is limited to the cobas assays performed using the 6800 or 8800 test systems, and the findings of this study are not generalizable to other test systems.

ACKNOWLEDGMENTS

We thank the ASM ClinMicroNet Listserv for providing a platform for communication and collaboration between clinical microbiology laboratory directors, which allowed this group of authors to connect on this shared observation.

K.G.R., B.J.K., F.B., and A.M. acknowledge funding provided by a contract award from the Centers for Disease Control and Prevention (CDC BAA 200-2021-10986 and 75D30121C11102/000HCVL1-2021-55232), by philanthropic donations to the Penn Center for Research on Coronaviruses and Other Emerging Pathogens, and in part by NIH grant R61/33-HL137063 and AI140442—supplement for SARS-CoV-2. Additional assistance was provided by the Penn Center for AIDS Research (P30-AI045008) and in part with Federal funds from the National Institute of Allergy and Infectious Diseases, National Institutes of Health, Department of Health and Human Services, under contract no. 75N93021C00015. B.J.K. is also supported by NIH K23 AI121485. D.A.G., G.J.B., F.W., M.K.A., and A.-C.U. acknowledge in part NIH funding (U01 DA053949) and the Columbia University Biobank team. T.M., K.J., and N.E.B. acknowledge funding in part through the National Institute of Heath/National Cancer Institute Cancer Center Support (Grant P30 CA008748) and Philanthropic Funds from the Burns Family. NDG acknowledges funding provided by the Centers for Disease Control and Prevention Broad Agency Announcement (75D30120C09570).

K.G.R., B.J.K., F.B., and A.M. also acknowledge assistance with data collection and analysis by Daniel Danoski, Michael Kosenski, Amee Aghera, Irina Petlakh, and the Penn Medicine Data Analytics Center. D.D.R. and T.Z. acknowledge Ashley Figula, who first recognized the pOGTF phenomenon, which prompted this study, and we thank the Ohio Department of Health for its support of Cleveland Clinic’s SARS-CoV-2 genomic surveillance. L.F.W. and R.M.R. acknowledge Kathy Fauntleroy and Selma Salter from New York-Presbyterian/Weill Cornell Medical Center and Melissa Cushing from Weill Cornell Medicine. We gratefully acknowledge both the originating and submitting laboratories for the sequence data in GISAID EpiCoV on which the SARS-CoV-2 variant prevalence data are partially based.

The Yale SARS-CoV-2 Genomic Surveillance Initiative consists of Kendall Billig, Mallery Breban, Chantal Vogels, Kien Pham, Nicholas Chen, Chrispin Chaguza, Irina Tikhonova, Christopher Castaldi, Shrikant Mane, Bony De Kumar, David Ferguson, Nicholas Kerantzas, Marie Landry, and Wade Schulz.

Footnotes

Supplemental material is available online only.

Supplemental file 1
Table S1. Download jcm.00600-22-s0001.pdf, PDF file, 1.2 MB (1.2MB, pdf)

Contributor Information

Kyle G. Rodino, Email: Kyle.rodino@pennmedicine.upenn.edu.

Alexander J. McAdam, Boston Children's Hospital

REFERENCES

  • 1.Rhoads DD, Plunkett D, Nakitandwe J, Dempsey A, Tu ZJ, Procop GW, Bosler D, Rubin BP, Loeffelholz MJ, Brock JE. 2021. Endemic SARS-CoV-2 polymorphisms can cause a higher diagnostic target failure rate than estimated by aggregate global sequencing data. J Clin Microbiol 59:e0091321. 10.1128/JCM.00913-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Centers for Disease Control and Prevention. 2021. SARS-CoV-2 variant classifications and definitions. https://www.cdc.gov/coronavirus/2019-ncov/variants/variant-classifications.html. Accessed April 18, 2022.
  • 3.Public Health England. 2020. Investigation of novel SARS-CoV-2 variant: variant of concern 202012/01. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/959361/Technical_Briefing_VOC202012-2_Briefing_2.pdf. Accessed April 20, 2022.
  • 4.UK Health Security Agency. 2021. SARS-CoV-2 variants of concern and variants under investigation in England. Variant of concern: Omicron, VOC21NOV-01 (B.1.1.529). Technical briefing 30. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1038404/Technical_Briefing_30.pdf. Accessed April 18, 2022.
  • 5.UK Health Security Agency. 2022. SARS-CoV-2 variants of concern and variants under investigation in England. Technical briefing 38. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1060337/Technical-Briefing-38-11March2022.pdf. Accessed April 20, 2022.
  • 6.Tahan S, Parikh BA, Droit L, Wallace MA, Burnham CD, Wang D. 2021. SARS-CoV-2 E gene variant alters analytical sensitivity characteristics of viral detection using a commercial reverse transcription-PCR assay. J Clin Microbiol 59:e0007521. 10.1128/JCM.00075-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Vanaerschot M, Mann SA, Webber JT, Kamm J, Bell SM, Bell J, Hong SN, Nguyen MP, Chan LY, Bhatt KD, Tan M, Detweiler AM, Espinosa A, Wu W, Batson J, Dynerman D, Wadford DA, Puschnik AS, Neff N, Ahyong V, Miller S, Ayscue P, Tato CM, Paul S, Kistler AL, DeRisi JL, Crawford ED. 2020. Identification of a polymorphism in the N gene of SARS-CoV-2 that adversely impacts detection by reverse transcription-PCR. J Clin Microbiol 59. 10.1128/JCM.02369-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Artesi M, Bontems S, Gobbels P, Franckh M, Maes P, Boreux R, Meex C, Melin P, Hayette MP, Bours V, Durkin K. 2020. A recurrent mutation at position 26340 of SARS-CoV-2 is associated with failure of the E gene quantitative reverse transcription-PCR utilized in a commercial dual-target diagnostic assay. J Clin Microbiol 58. 10.1128/JCM.01598-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Ziegler K, Steininger P, Ziegler R, Steinmann J, Korn K, Ensser A. 2020. SARS-CoV-2 samples may escape detection because of a single point mutation in the N gene. Euro Surveill 25:2001650. 10.2807/1560-7917.ES.2020.25.39.2001650. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hasan MR, Sundararaju S, Manickam C, Mirza F, Al-Hail H, Lorenz S, Tang P. 2021. A novel point mutation in the N gene of SARS-CoV-2 may affect the detection of the virus by reverse transcription-quantitative PCR. J Clin Microbiol 59. 10.1128/JCM.03278-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.NYSDOH. 2022. New York State Department of Health Announces emergence of recently identified, highly contagious omicron subvariants in New York and urges continued vigilance against COVID-19. https://www.health.ny.gov/press/releases/2022/2022-04-13_covid-19.htm. Accessed April 18, 2022.
  • 12.Babady NE, McMillen T, Jani K, Viale A, Robilotti EV, Aslam A, Diver M, Sokoli D, Mason G, Shah MK, Korenstein D, Kamboj M. 2021. Performance of severe acute respiratory syndrome coronavirus 2 real-time RT-PCR tests on oral rinses and saliva samples. J Mol Diagn 23:3–9. 10.1016/j.jmoldx.2020.10.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Carpenter B, Gelman A, Hoffman MD, Lee D, Goodrich B, Betancourt M, Brubaker M, Guo J, Li P, Riddell A. 2017. Stan: a probabilistic programming language. J Stat Soft 76:1–32. 10.18637/jss.v076.i01. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Burkner P-C. 2017. brms: an R package for Bayesian multilevel models using Stan. J J Stat Softw 80:1–28. [Google Scholar]
  • 15.Annavajhala MK, Mohri H, Wang P, Nair M, Zucker JE, Sheng Z, Gomez-Simmonds A, Kelley AL, Tagliavia M, Huang Y, Bedford T, Ho DD, Uhlemann AC. 2021. Emergence and expansion of SARS-CoV-2 B.1.526 after identification in New York. Nature 597:703–708. 10.1038/s41586-021-03908-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Chaguza C, Coppi A, Earnest R, Ferguson D, Kerantzas N, Warner F, Young HP, Breban MI, Billig K, Koch RT, Pham K, Kalinich CC, Ott IM, Fauver JR, Hahn AM, Tikhonova IR, Castaldi C, De Kumar B, Pettker CM, Warren JL, Weinberger DM, Landry ML, Peaper DR, Schulz W, Vogels CBF, Grubaugh ND. 2022. Rapid emergence of SARS-CoV-2 Omicron variant is associated with an infection advantage over Delta in vaccinated persons. Med 10.1016/j.medj.2022.03.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Everett J, Hokama P, Roche AM, Reddy S, Hwang Y, Kessler L, Glascock A, Li Y, Whelan JN, Weiss SR, Sherrill-Mix S, McCormick K, Whiteside SA, Graham-Wooten J, Khatib LA, Fitzgerald AS, Collman RG, Bushman F. 2021. SARS-CoV-2 genomic variation in space and time in hospitalized patients in Philadelphia. mBio 12. 10.1128/mBio.03456-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Aslam A, Singh J, Robilotti E, Chow K, Bist T, Reidy-Lagunes D, Shah M, Korenstein D, Babady NE, Kamboj M. 2021. Severe acute respiratory syndrome coronavirus 2 surveillance and exposure in the perioperative setting with universal testing and personal protective equipment policies. Clin Infect Dis 73:e3013–e3018. 10.1093/cid/ciaa1607. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Chow K, Aslam A, McClure T, Singh J, Burns J, McMillen T, Jani K, Lucca A, Bubb T, Robilotti EV, Babady NE, Kamboj M. 2021. Risk of healthcare-associated transmission of SARS-CoV-2 in hospitalized cancer patients. Clin Infect Dis 74:1579–1585. 10.1093/cid/ciab670. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Binnicker MJ. 2020. Can the severe acute respiratory syndrome coronavirus 2 polymerase chain reaction cycle threshold value and time from symptom onset to testing predict infectivity? Clin Infect Dis 71:2667–2668. 10.1093/cid/ciaa735. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Binnicker MJ. 2021. Can testing predict SARS-CoV-2 infectivity? The potential for certain methods to be surrogates for replication-competent virus. J Clin Microbiol 59:e0046921. 10.1128/JCM.00469-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Tom MR, Mina MJ. 2020. To interpret the SARS-CoV-2 test, consider the cycle threshold value. Clin Infect Dis 71:2252–2254. 10.1093/cid/ciaa619. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Bullard J, Dust K, Funk D, Strong JE, Alexander D, Garnett L, Boodman C, Bello A, Hedley A, Schiffman Z, Doan K, Bastien N, Li Y, Van Caeseele PG, Poliquin G. 2020. Predicting infectious severe acute respiratory syndrome coronavirus 2 from diagnostic samples. Clin Infect Dis 71:2663–2666. 10.1093/cid/ciaa638. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Rhoads DD, Pinsky BA. 2021. The truth about SARS-CoV-2 cycle threshold values is rarely pure and never simple. Clin Chem 68:16–18. 10.1093/clinchem/hvab146. [DOI] [PubMed] [Google Scholar]
  • 25.Magleby R, Westblade LF, Trzebucki A, Simon MS, Rajan M, Park J, Goyal P, Safford MM, Satlin MJ. 2021. Impact of severe acute respiratory syndrome coronavirus 2 viral load on risk of intubation and mortality among hospitalized patients with coronavirus disease 2019. Clin Infect Dis 73:e4197–e4205. 10.1093/cid/ciaa851. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Westblade LF, Brar G, Pinheiro LC, Paidoussis D, Rajan M, Martin P, Goyal P, Sepulveda JL, Zhang L, George G, Liu D, Whittier S, Plate M, Small CB, Rand JH, Cushing MM, Walsh TJ, Cooke J, Safford MM, Loda M, Satlin MJ. 2020. SARS-CoV-2 viral load predicts mortality in patients with and without cancer who are hospitalized with COVID-19. Cancer Cell 38:661–671.e2. 10.1016/j.ccell.2020.09.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Westblade LF, Magleby R, Trzebucki A, Simon MS, Rajan M, Park J, Goyal P, Safford MM, Satlin MJ. 2021. Reply to Rhoads, et al. Clin Infect Dis 72:e687. 10.1093/cid/ciaa1201. [DOI] [PubMed] [Google Scholar]
  • 28.Rajyalakshmi B, Samavedam S, Reddy PR, Aluru N. 2021. Prognostic value of “cycle threshold” in confirmed COVID-19 patients. Indian J Crit Care Med 25:322–326. 10.5005/jp-journals-10071-23765. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Rao SN, Manissero D, Steele VR, Pareja J. 2020. A systematic review of the clinical utility of cycle threshold values in the context of COVID-19. Infect Dis Ther 9:573–586. 10.1007/s40121-020-00324-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Miller EH, Zucker J, Castor D, Annavajhala MK, Sepulveda JL, Green DA, Whittier S, Scherer M, Medrano N, Sobieszczyk ME, Yin MT, Kuhn L, Uhlemann AC. 2021. Pretest symptom duration and cycle threshold values for severe acute respiratory syndrome coronavirus 2 reverse-transcription polymerase chain reaction predict coronavirus disease 2019 mortality. Open Forum Infect Dis 8:ofab003. 10.1093/ofid/ofab003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Rhoads D, Peaper DR, She RC, Nolte FS, Wojewoda CM, Anderson NW, Pritt BS. 2021. College of American Pathologists (CAP) microbiology committee perspective: caution must be used in interpreting the cycle threshold (Ct) value. Clin Infect Dis 72:e685–e686. 10.1093/cid/ciaa1199. [DOI] [PubMed] [Google Scholar]
  • 32.Infectious Diseases Society of American and Association for Molecular Pathology. 2021. IDSA and AMP joint statement on the use of SARS-CoV-2 PCR cycle threshold (Ct) values for clinical decision-making. https://www.idsociety.org/globalassets/idsa/public-health/covid-19/idsa-amp-statement.pdf. Accessed April 19, 2022.
  • 33.American Association for Clinical Chemistry. 2021. AACC recommendation for reporting SARS-CoV-2 cycle threshold (CT) values. https://www.aacc.org/science-and-research/covid-19-resources/statements-on-covid-19-testing/aacc-recommendation-for-reporting-sars-cov-2-cycle-threshold-ct-values. Accessed April 19, 2022.
  • 34.Centers for Disease Control and Prevention. 2020. COVID data tracker. https://covid.cdc.gov/covid-data-tracker. Accessed May 4, 2022.
  • 35.Kimura I, Kosugi Y, Wu J, Zahradnik J, Yamasoba D, Butlertanaka EP, Tanaka YL, Uriu K, Liu Y, Morizako N, Shirakawa K, Kazuma Y, Nomura R, Horisawa Y, Tokunaga K, Ueno T, Takaori-Kondo A, Schreiber G, Arase H, Motozono C, Saito A, Nakagawa S, Sato K, Genotype to Phenotype Japan (G2P-Japan) Consortium . 2022. The SARS-CoV-2 Lambda variant exhibits enhanced infectivity and immune resistance. Cell Rep 38:110218. 10.1016/j.celrep.2021.110218. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Rhoads D. 2021. Genomic changes causing SARS-CoV-2 detection partial failure. In Clinical laboratory COVID-19 response call July 26, 2021. Centers for Disease Control and Prevention, Atlanta, GA. https://www.cdc.gov/csels/dls/preparedlabs/documents/covid-19-response-calls/transcript_07_26_2021.pdf. [Google Scholar]
  • 37.Wang R, Hozumi Y, Yin C, Wei GW. 2020. Mutations on COVID-19 diagnostic targets. Genomics 112:5204–5213. 10.1016/j.ygeno.2020.09.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.United States Food and Drug Administration. 2021. Establishing additional conditions of authorization for the EUAs of certain molecular, antigen and serology IVDs related to viral mutations. https://www.fda.gov/media/152406/download. Accessed April 21, 2022.
  • 39.Meyers L, Ginocchio CC, Faucett AN, Nolte FS, Gesteland PH, Leber A, Janowiak D, Donovan V, Dien Bard J, Spitzer S, Stellrecht KA, Salimnia H, Selvarangan R, Juretschko S, Daly JA, Wallentine JC, Lindsey K, Moore F, Reed SL, Aguero-Rosenfeld M, Fey PD, Storch GA, Melnick SJ, Robinson CC, Meredith JF, Cook CV, Nelson RK, Jones JD, Scarpino SV, Althouse BM, Ririe KM, Malin BA, Poritz MA. 2018. Automated real-time collection of pathogen-specific diagnostic data: syndromic infectious disease epidemiology. JMIR Public Health Surveill 4:e59. 10.2196/publichealth.9876. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental file 1

Table S1. Download jcm.00600-22-s0001.pdf, PDF file, 1.2 MB (1.2MB, pdf)

Data Availability Statement

All SARS-CoV-2 viral genomes have been deposited in GISAID and/or NCBI GenBank with GISAID accession numbers listed in Table S1 in the supplemental material.


Articles from Journal of Clinical Microbiology are provided here courtesy of American Society for Microbiology (ASM)

RESOURCES