Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Apr 4;17(4):e0265220. doi: 10.1371/journal.pone.0265220

Comparison of different sequencing techniques for identification of SARS-CoV-2 variants of concern with multiplex real-time PCR

Diyanath Ranasinghe 1,#, Tibutius Thanesh Pramanayagam Jayadas 1,#, Deshni Jayathilaka 1,#, Chandima Jeewandara 1,#, Osanda Dissanayake 1, Dinuka Guruge 2, Dinuka Ariyaratne 1, Dumni Gunasinghe 1, Laksiri Gomes 1, Ayesha Wijesinghe 1, Ruwan Wijayamuni 1, Gathsaurie Neelika Malavige 1,*
Editor: Ruslan Kalendar3
PMCID: PMC8979425  PMID: 35377884

Abstract

As different SARS-CoV-2 variants emerge and with the continuous evolvement of sub lineages of the delta variant, it is crucial that all countries carry out sequencing of at least >1% of their infections, in order to detect emergence of variants with higher transmissibility and with ability to evade immunity. However, due to limited resources as many resource poor countries are unable to sequence adequate number of viruses, we compared to usefulness of a two-step commercially available multiplex real-time PCR assay to detect important single nucleotide polymorphisms (SNPs) associated with the variants and compared the sensitivity, accuracy and cost effectiveness of the Illumina sequencing platform and the Oxford Nanopore Technologies’ (ONT) platform. 138/143 (96.5%) identified as the alpha and 36/39 (92.3%) samples identified as the delta variants due to the presence of lineage defining SNPs by the multiplex real time PCR, were assigned to the same lineage by either of the two sequencing platforms. 34/37 of the samples sequenced by ONT had <5% ambiguous bases, while 21/37 samples sequenced using Illumina generated <5%. However, the mean PHRED scores averaged at 32.35 by Illumina reads but 10.78 in ONT. This difference results in a base error probability of 1 in 10 by the ONT and 1 in 1000 for Illumina sequencing platform. Sub-consensus single nucleotide variations (SNV) are highly correlated between both platforms (R2 = 0.79) while indels appear to have a weaker correlation (R2 = 0.13). Although the ONT had a slightly higher error rate compared to the Illumina technology, it achieved higher coverage with a lower number or reads, generated less ambiguous bases and was significantly less expensive than Illumina sequencing technology.

Introduction

Since the emergence of the SARS-CoV-2 virus two years ago, it continues to evolve giving rise to many variants with higher transmissibility and immune evasion abilities [1]. Despite a lower mutation rate of SARS-CoV-2 compared to many other RNA viruses such as HIV and influenza, [2], many SARS-CoV-2 variants of concern (VOCs) have emerged, which continue to drive the pandemic. Although the ongoing COVID-19 vaccine drive and other control measures has resulted in a reduction in the number of cases and deaths, many countries still report intense transmission rates [3]. This high rate of continued transmission of the virus is likely to give rise to new variants, which may evade immunity induced by vaccines, or may have a higher transmissibility than the dominant delta variant. This is already evident with the emergence of many delta-sub lineages [4], which some are under investigation for higher transmissibility. In order to detect such possible new variants emerging, the WHO has recommended that all countries carry out genomic sequencing in at least 1% of their infections [5].

Although there are many sub-lineages of delta emerging [4], so far the WHO has named four SARS CoV-2 variants as variants of concern (VOC), which are they are alpha (B.1.1.7), beta (B.1.351), gamma (P.1) and delta (B.1.617.2)[5]. Even though sequencing is the gold standard to identify VOCs, it is time consuming and expensive for many lower income and lower middle-income countries. In addition, although many developed countries sequence over 5% of their positive cases, many lower income countries are unable to sequence 1% and many sequence <0.2% [6]. Therefore, in order to carry out surveillance to monitor the current VOCs and to identify mutations of concern than may occur in such variants, cheaper and rapid methods are required that can be used in resource poor settings. The B.1.1.7 variant (alpha) was identified initially in the UK due to the changes in the SARS-CoV-2 real-time PCR results that occurred in the primers targeting the spike protein (S-drop) when using the Taq Path (Thermo Fisher Scientific Inc.) [7]. Subsequently, many multiplex real-time PCR assays were developed to identify Single Nucleotide Polymorphisms (SNPs) that associate with these four VOC such as the HV69-70del, K417N, N417T, W152C, E484K, N501Y, L452R, D614G, P681H or V1176F [8]. The combination of these different SNPs in the SARS-CoV-2 which can be identified by these multiplex real-time PCR can therefore be used to identify these four VOCs [9].

Many sequencing platforms are currently used to sequence the SARS-CoV-2 virus, which have their advantages and disadvantages [10]. Comparison of different sequencing protocols have shown that they have significant differences in sensitivity, reproducibility, and precision for detection of SNPs [11]. However, with the continued emergence and spread of new delta sub lineages, in addition to carrying out surveillance for VOCs, it is crucial to carry out whole genomic sequencing to identify variants which develop mutations of concern, that may evade immunity or may associate with higher transmissibility. However, as many lower income countries such as Sri Lanka, do not have adequate resources to carry out sequencing of >1% of the positive samples, we investigated the sensitivity and accuracy of a two-step commercially available multiple real-time PCR assay for detection of different SNPs associated with VOCs. In addition, we compared to sensitivity, reproducibility, precision of identification SNPs and the cost of sequencing using the Illumina and Oxford Nanopore sequencing platforms.

Methodology

Samples

Initial RT-PCR of diagnostic sputum or nasopharyngeal swabs were carried out on 190 samples using TaqPath COVID-19 CE-IVD RT-PCR kit (Thermo Fisher Scientific, USA) according to the manufacturer’s instructions. We have tested these samples during April to August 2021, which was the period Sri Lanka experienced its B.1.1.7 (Alpha) outbreak (mid-April) followed by a massive B.1.617.2 (Delta) outbreak in July 2021. Of the 190 samples, all analysed by the multiplex real-time PCR to detect SNPs of VOCs. 97 were subjected to sequencing by the Illumina platform, 56 by the Oxford nanopore sequencing technology and 37 by both methods. Those with a cycle threshold (Ct) values of <30 were subjected to genomic sequencing and further multiplex q RT-PCR for identification of SNPs associated with VOCs. Briefly, viral RNA was extracted using QIAamp viral RNA mini kit (Qiagen, USA), SpinStarTM Viral Nucleic Acid Extraction kit 1.0 (ADT Biotech, Malaysia) or FastGene RNA Viral Kit, (Nippon Genetics, Germany) according to manufacturer’s instructions.

Ethical approval for the study was obtained by the Ethics Review Committee of the University of Sri Jayewardenepura. The samples for RT-PCR and sequencing of these individuals was sent to our laboratory for diagnostic purposes and for sequencing in order to carry out surveillance to detect the circulating SARS-CoV-2 variants. The data was fully anonymized before we accessed it for the analysis and the Ethics Review Committee provided a waiver for informed written consent in order for the details of these patients be included in this study.

Multiplex qRT-PCR for identification of SNPs in VOCs

Multiplex qRT-PCR to detect SNPs was carried out using the SARS-COV-2 variant PCR Allplex™ (Seegene, South Korea) assay 1 and assay 2 in all 190 samples. The variant assay 1 detects SNPs for 501Y, E484K and 69–70 deletion, whereas variant assay 2 detects the SNPs L452R, W152C, K417T and K17N. The variant PCR assays were carried out according to the manufacturer’s instructions using 5μl of the extracted RNA from samples (S1 methods). All the thermal cycling steps were carried out in a CFX96 Deep Well, Real time System (Bio-Rad, USA).

Genomic sequencing using Oxford Nanopore (ONT) platform

The extracted RNA of 56/190 samples were subjected to nanopore sequencing according to the manufacture’s instruction using the SQK-RBK110.96 rapid barcoding kit (ONT, Oxford, UK). 1200 bp tiled PCR amplicons were generated with midnight primers as described in Freed et al., 2020 [12]. All the thermal cycling steps were carried out in a QuantStudio™ 5 Real-Time PCR Instrument (Applied biosystems, Singapore). Barcodes were attached to resulting amplicons and pooled together before the clean-up step. Finally, 800ng of library was loaded into R9.4.1 flow cell and sequenced on the Oxford Nanopore Minion Mk1C. The run was stopped once desired number of reads (~15,000 reads per sample) were achieved.

Genomic sequencing using the illumina platform

97 were subjected to sequencing by the Illumina sequencing platform. Library preparation Illumina sequencing was carried out using the AmpliSeq for Illumina SARS-CoV-2 Community Panel, in combination with AmpliSeq for Illumina library prep, index, and accessories (Illumina, San Diego, USA). The methodology is further described in (S1 methods).

Bioinformatics and statistical analysis

Data from Illumina Nextseq 550 platform were base called using inbuilt bcl2fastq and the resulting data were analyzed using the Dragen somatic pipeline on Basespace sequencing hub [13]. Resulting Binary alignment files (BAM), variant call files (VCF) and consensus fasta sequences were taken further for comparison. ONT fast5 data were base called and demultiplexed using guppy version 4.4.2 occupying the fast model with a 60 single end barcode score. Resultant fastq files were analyzed using Nextflow wf-artic version v0.3.2 (https://github.com/epi2me-labs/wf-artic) with “fast_min_variant_c507” model. Read length cutoff values obtained were in the range of 150bp and 1200bp, without barcode trimming. Resulting BAM, VCF and consensus fasta sequences were carried forward. Fastq and Bam statistics were generated using fastp 2 [14], Nanocomp 3 [15], samtools version 1.9 and in-house scripts. VCF data were processed using vcftools version 0.1.15 and bcftools version 1.7 [16]. Multi-way pileup (mpileup) was made from ONT and Illumina alignments before analyzing with VarScan2 [17] for detection of low frequency variants.

Fasta sequences were run through the Covsurver variant annotation pipeline (https://www.gisaid.org/epiflu-applications/covsurver-mutations-app/) and for lineage assessment each sequence was assessed using Pangolin version v3.1.11 [18] with the lineage version of 2021-08-09 and Serious constellations of reoccurring phylogenetically-independent origin (Scorpio) version 0.3.12 (https://github.com/cov-lineages/scorpio). All the consensus fasta sequences were aligned to the reference sequence MN908947.3 using MAFFT version 7.487 and a maximum likelihood phylogenetic tree was created using IQ-TREE version 1.6.1 [19] occupying the best fit TIM2+F+R2 model with 1000 bootstrap replicates. Raw fastq and consensus fasta files for 74 datasets were deposited to GISAID (S1 Table). Plots were generated in R version 4.0.1 using ggplot2, dplyr and tidyverse.

Results

Multiplex real-time PCR to detect SNPs of VOCs was carried out initially in 190 deidentified samples. These 190 samples were then sequenced either on Illumina or ONT (depending on the availability of sequencing reagents) to evaluate the accuracy of the variant PCR. 37/190 of the samples were sequenced with both the Illumina and ONT platforms to compare the quality and accuracy of the data generated by these two platforms.

Comparison between next generation sequencing with multiplex real-time PCR assays for detection of SNP (variant PCR assay)

143/190 samples were positive for the SNP N501Y and HV69/70 deletion in the spike protein by the multiplex PCR and therefore, considered to be as B.1.1.7. The samples in which these two SNPs were not detected (n = 47) were re-screened using the variant assay 2, which detected the SNPs L452R, W152C, K417T and K17N. Based on the results of the variant assay 2, 39 samples were positive only for the spike L452R mutation and were therefore, considered to be B.1.617. One sample with spike K417N mutation along with N501Y and HV69/70 deletion from the assay was considered to be B.1.351. 7/190 samples were not assigned to be any VOC as they did not have any of the SNPs associated with the VOCs.

105/109 (96.3%) samples interpreted as B.1.1.7 by the variant PCR assay were assigned to the same Pango lineage when sequenced with Illumina workflow, while the 4/109 samples had inadequate sequencing coverage to be assigned a lineage. 17/20 (85%) samples which were considered to be B.1.617 due to the presence of the spike L452R, were confirmed as B.1.617.2 by Illumina sequencing. Rest of the B.1.617 (3/20) were assigned to B.1.1.372, C.36 and B.1. 5/5 (100%) samples in which the SNPs were not detected, were classified into B.1, B.1.1 or B.1.411 with the Illumina sequencing workflow.

52/55 (94.5%) samples interpreted as B.1.1.7 were confirmed by the ONT sequencing workflow while 3/55 lacked sequencing coverage. 32/35 (91.4%) samples concluded to be B.1.617 by the variant PCR assay were confirmed to be B.1.617.2 and 3/35 were assigned to C.36 lineage with the ONT sequencing. One sample concluded as B.1.351 was assigned to B.1.351.3 lineage by the Pango assessment (S2 Table). Of the 305/332 individual mutations detected by the variant PCR assay were confirmed by at least one of the sequencing methods. Rest of the unconfirmed spike mutations were masked by N bases in the consensus sequences due to either reduced coverage or low base call accuracy.

Comparison between illumina and ONT sequencing platforms

Sequencing statistics

37 SARS-CoV-2 samples sequenced using both approaches had more than 45% of the genome coverage and were included in the analysis for comparison of both techniques. Ampliseq SARS-CoV-2 primers used for Illumina library contained 247 amplicons in 2 pools covering >99% of the genome (reference positions between 30 to 29842). The Midnight primer scheme used in the ONT, with just 29 primers in two pools created 1200bp long amplicons and typically covered 54 to 29903 positions. The 150bp Illumina library yielded ~50 million bases, whereas 1200bp ONT library yielded only ~9 million. However, despite the lower number of reads with ONT, it was able to achieve twice the coverage depth of which was achieved by the Illumina platform (Table 1). With the Illumina sequencing technology, the samples required an average of 372,654 reads per sample, whereas ONT achieved even higher coverage depth with an average 9741 reads per sample due to its ability to score ultra-long reads. The higher proportion of ambiguous bases generated by the Illumina platform, resulted in non-detection of several mutations in each sample. We observed one consistent amplicon drop at third amplicon in ONT dataset due to K634N mutation in ORF1a, which is prevalent in Sri Lankan delta sub-lineage, B.1.617.2.AY.28.

Table 1. Basic sequencing matrices for Illumina and Oxford Nanopore (ONT) outputs of 37.
Sequencing metrics Illumina ONT
Number of samples 37 37
Alignment start and end positions 30–29842 54–29903
Mean Coverage depth 109 266
Total Number of reads 372,654 9741
Yielded bases 50,576,802 9,307,884
Fraction of bases aligned 0.928 0.897
Mean Read length 140 945
Average per read identity 99.6 91.4
Average PHRED score 32.35 10.78
No of SNPs 31 36
No of amino acid substitutions 22 25
No of deletions 14 15
No of Amino acid substitutions 22 25
No of frameshift mutations 0 2
% of ambiguous bases 9% 6%
No of samples with < 10% ambiguous bases 25 29
Successful Pangolin calls 31 34
Successful Scorpio calls 25 31
Run time (h) for 96 samples 26 14
Cost per sample (USD) ~150–250 ~10–40

Illumina raw reads had an average PHRED quality score (probability of error per base call in a log scale) of 32.35 with a highest score of 36 which is between 1 in 1000 to 1 in 10,000 probability of calling an incorrect base. (99.9–99.99% accuracy). ONT on the other hand had recorded an average score of 10.78 with a 16.2 highest PHRED quality score indicating between 1 in 10 to 1 in 100 probability of error (90% - 99% accuracy). This explains the average per read identity to the reference genome of 99.6% in Illumina reads and 91.4% in ONT reads (Table 1 and Fig 1).

Fig 1. PHRED base call quality score distribution of samples sequenced by Illumina and ONT.

Fig 1

Distribution plot of PHRED (probability of error per base call in a log scale) quality score (x axis) and error probability (secondary x axis) derived from the PHRED score for the data set sequenced from Illumina (n = 37) and ONT (n = 37). The scores of ONT are shown in blue and Illumina in red. The mean PHRED scores/error probability are shown with the dashed line for each technology. The mean PHRED scores averaged at 32.35 in Illumina reads and 10.78 in ONT.

Consensus accuracy

We used iVar [20] and Medaka workflows to call consensus for Illumina and ONT respectively. ONT detected more average mutations per sample compared to Illumina (36 vs 31) and majority of them were non-synonymous mutations scoring average of 22 and 25 amino acid substitutions in Illumina and ONT respectively. Some known amino acid mutations such as Spike N501Y and NSP12 P323L were constantly missed in Illumina consensus sequences which was caused by masking of those regions due to drop of coverage (Fig 2). However, average number of deletions per sample were between 14 to15 range for both approaches (Fig 3). Average percentage of ambiguous (N) bases was higher in Illumina sequences compared to ONT (9% vs 6%), whereas samples with less than 10% ambiguous bases were higher for ONT compared to Illumina (29 vs 25). The ONT consensus sequences had 2 frameshift mutations at nucleotide positions of 1634 and 21992, whereas no frameshift mutations were found in the Illumina dataset.

Fig 2. Comparison of amino acid changes detected in SARS-CoV-2 genomes by both sequencing technologies.

Fig 2

Annotated amino acid substitutions and deletions detected in each sample (n = 37). Mutations colored in green indicates they are synonymously detected by both sequencing technologies, whereas yellow and red indicate mutations detected exclusively by only one technology. The X axis indicates each amino acid, which is denoted by the original amino acid, its position in the protein and the substitution/deletion. Amino acid deletions are denoted by “del”.

Fig 3. Percentage of ambiguous bases (% of N) compared to the no of mutations (SNP) detected in each sample.

Fig 3

The trend between percentage of ambiguous bases is shown in the x axis and number of mutations projected onto the consensus sequences is shown in the y axis. The numbers displayed on each shape denotes the sample identification number (n = 37) sequenced by Illumina (red) or ONT (blue). Both technologies had detected a maximum SNPs with 1% - 5% ambiguous bases. The consensus sequences generated by Illumina had a varying percentage of ambiguous bases between 1% - 30%, whereas ONT sequencing generated either < 5% or more than 40% ambiguous bases due to its longer read lengths. Altogether ONT had detected more SNPs than Illumina between of 1% - 5% ambiguous bases.

Due to improved coverage over the SARS-CoV-2 genome, more samples which were sequenced using the ONT platform were lineage callable by both Pango and Scorpio nomenclature (Table 1). Pango lineage calls of 31/37 were identical in both platforms while only 2/37 lineage calls were different between the two sequencing platforms; two ONT datasets classified as C.36 were called as B.1 and B.1.1.372 with the Illumina datasets. 4/37 samples generated >31% ambiguous bases with either platform hence failed the lineage calling.

In the combined phylogenetic tree of consensus sequences, 28/37 samples paired with their counterpart sequences, while those that were not paired together had moderate to high (3% - 31%) ambiguous bases in one of the counterpart sequences. Higher than 98% bootstrap support can be observed in 21/37 samples which had > 90% genome coverage from both sequencing technologies (Fig 4).

Fig 4. Combined maximum likelihood phylogenetic tree created using sequence pairs of 37 the samples.

Fig 4

The ML tree was generated using the consensus sequences of each sequencing technology with 1000 bootstrap replicates using TIM2+F+R2 model. Tree is rooted on SARS-CoV-2 reference MN908947.3 and with samples sequences by Illumina coloured red and those sequenced by ONT coloured blue. Bootstrap support values are shown on each branch. 21/37 samples coupled together with < 98% bootstrap support had > 90% genome coverage from both Illumina and ONT datasets while 7/37 samples coupled together with less than 98% bootstrap support. 9/37 of the samples which failed to couple with their counterpart from ONT or Illumina had moderate to high (3% - 31%) ambiguous bases in either sequences.

Intra-sample variation

We further analyzed BAM alignments using VarScan2 to determine the rate of both consensus and sub-consensus variants between two technologies. Collectively, 191 single nucleotide variants (SNVs) and 9 indels were detected in the read pileup of Illumina dataset, while 226 SNVs and 304 indels were detected in ONT read pileup. However, 175 SNVs were concordant across both datasets suggesting they are true variants. 15 SNVs detected only in the Illumina dataset are of very low allele frequency (5%-0.1%) whereas 51 SNVs detected only in the ONT dataset are of allele frequency ranging between 52%-0.1% (S3 Table). 8 indels were concordant between both platforms while a significant number (296) of false positive indels were detected in the ONT dataset with allele frequency between 52% - 0.1%. We also observed a clear correlation between the SNV frequencies (R2 = 0.79) while a very weak correlation between indel frequencies (R2 = 0.13) of Illumina and ONT datasets (Fig 5).

Fig 5. Correlation of sub-consensus allele frequencies observed for SNV and Indels between two sequencing technologies.

Fig 5

a) Correlation between sub-consensus single nucleotide substitution frequencies observed for Illumina and ONT. Nucleotide substitutions detected exclusively by one technology are indicated in green and blue whereas the substitutions detected by both technologies are colored red. Even though more nucleotide substitutions exclusive to ONT were observed, there is a clear positive correlation (R2 = 0.79) between two sequencing technologies. b) Correlation between sub-consensus indel frequencies observed for Illumina and ONT. More indels exclusive to ONT can be seen with a weak correlation (R2 = 0.13) between the indel frequencies between two technologies suggesting ONT tend to result in more false-positive indels.

Discussion

In this study we compared the accuracy and sensitivity of a commercial multiple real-time PCR assay for detection of different SNPs with two sequencing technologies in identifying SARS-CoV-2 VOCs. 190 samples which were tested by the variant PCR technique showed 100% concordance with the results of either Illumina or ONT sequencing platforms as far as the VOC assignment. However, 3 samples which were considered to be B.1.617 due to the presence of the SNP L452R, were assigned to the C.36 Pangolin lineage following sequencing. Since there are many variants with the L452R [21], when multiple SARS-CoV-2 variants are co-circulating, classifying a virus into the B.1.617 lineage based on the L452R mutation alone, would result in inaccuracies. However, for the SNPs E484K, K417T, L452R, K417N, W152C and 69/70 deletion no false positive or false negatives were detected. Therefore, the VOCs assigned to either B.1.1.7 or B.1.351 showed 100% accuracy with both sequencing platforms. Therefore, the variant PCR appears to be a relatively inexpensive and rapid technique to carry out surveillance for SARS-CoV-2 variants in resource poor settings. However, with the dominance of the delta variant globally [22], these variant PCR assays have limited value in detection of new mutations of concern arising in the delta variant that may give rise to higher transmissibility and immune evasion.

In this study we also compared to accuracy and ease of use of two sequencing platforms. The ONT rapid barcoding workflow occupies transposase-based library preparation, which does not require individual sample washes and allows samples to be processed uniformly without quantification or normalization [23]. For Illumina, traditional ligation-based library preparation was used which required extended preparation time and effort. Run time per 96 samples on ONT is nearly a half the time required for Illumina (26 hours compared to 14 hours) mainly due to the ability of real-time data analysis with ONT. The rapid barcoding library preparation method used for the ONT platform also required less reagents and therefore, was cheaper than Illumina sequencing. Although the single ended barcoding of the transposase-based libraries is thought to result in improper demultiplexing and sample crossover, it has shown to rarely affect variant calling and consensus generation in ONT [12].

The Illumina sequencing produced ~200bp long amplicons, whereas the ONT sequencing platform produced 1200bp. The long amplicons generated by the ONT sequencing achieved higher coverage and less ambiguous bases even with 10,000 reads (after filtering). As a result of this, certain mutations were not detected by the Illumina platform due to a larger proportion of ambiguous bases. For instance, 34/37 of the samples sequenced by ONT had <5% ambiguous bases, while 21/37 samples sequenced using Illumina generated <5%. However, the mean PHRED scores averaged at 32.35 in Illumina reads but 10.78 in ONT. This difference results in a base call error probability of 1 in 10 by the ONT and 1 in 1000 for Illumina sequencing platform. The reduced accuracy in base calls and increase the frequency of erroneous bases can be minimized by using high accuracy or super accuracy models of guppy basecaller [24]. 31/37 samples had identical Pango lineage calls despite having ambiguous bases as high as 30% in the Illumina dataset. Only two samples (13.8% - 0.02% ambiguous bases) resulted in different lineage calls, which were non-VOCs (C.36 and B.1.1.372). Even though it is evident that consensus sequences with >30% ambiguous bases fail to be assigned to a Pango pipeline, the two platforms resulted in 100% concordance when it comes to calling VOCs from the sequences with >70% genome coverage. While short read sequencing is considered as the gold standard for sequencing of viral genomes [25], despite ONT having a slightly higher error rate, ONT appears to generate high quality data at a very affordable cost. Therefore, ONT appears to be the most cost effective, high throughout sequencing technology, especially suited for countries with limited resources for genomic surveillance and for identification of emerging variants of concern.

In summary, we have compared the usefulness, accuracy and reliability of two sequencing technologies and also compared the usefulness of a commercial multiplex real-time PCR for surveillance of VOCs, by identification of SNPs associated with the VOCs. We found that the multiplex real-time PCR assay detected the alpha variant with 96.3% accuracy and the delta variant with 85% accuracy, when compared with Illumina sequencing technology. Although the ONT had a slightly higher error rate compared to the Illumina technology, it achieved higher coverage with a lower number or reads, generated less ambiguous bases and was significantly less expensive than Illumina sequencing technology.

Supporting information

S1 Table. Metadata of 190 samples used in the comparison.

(XLSX)

S2 Table. Comparison statistics of RT-PCR vs each sequencing technology.

(XLSX)

S3 Table. Sub-consensus SNV and Indel frequency data of ONT and Illumina.

(XLSX)

S1 Methods. Methods in detail used in the experiment.

(RTF)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

GNM, CJ: World Health Organization GNM, CJ: World bank, Sri Lanka Covid 19 Emergency Response and Health Systems Preparedness Project (ERHSP) of Ministry of Health Sri Lanka funded by World Bank.

References

  • 1.Dyson L, Hill EM, Moore S, Curran-Sebastian J, Tildesley MJ, Lythgoe KA, et al. Possible future waves of SARS-CoV-2 infection generated by variants of concern with a range of characteristics. Nat Commun. 2021;12:5730. doi: 10.1038/s41467-021-25915-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Luo R, Delaunay-Moisan A, Timmis K, Danchin A. SARS-CoV-2 biology and variants: anticipation of viral evolution and what needs to be done. Environ Microbiol. 2021;23:2339–63. doi: 10.1111/1462-2920.15487 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.O-OE Ritchie H., Beltekian D., Mathieu E., Hasell J., Macdonald B., Giattino C., Appel C., Lucas Rodés-Guirao, Rose M. Coronavirus Pandemic (COVID-19). OurWorldInData.org; 2021. doi: 10.1016/j.ajodo.2020.06.055 [DOI] [Google Scholar]
  • 4.Alaa Abdel Latif JLM, Manar Alkuzweny, Ginger Tsueng, Marco Cano, Emily Haag, Jerry Zhou, Mark Zeller, Emory Hufbauer, Nate Matteson, Chunlei Wu, Kristian G. Andersen, Andrew I. Su, Karthik Gangavarapu, Laura D. Hughes. Global variant report. Center for Viral Systems Biology; 2021.
  • 5.WHO. Guidance for surveillance of SARS-CoV-2 variants: Interim guidance, 9 August 2021. WHO Headquarters (HQ)2021.
  • 6.GISAID. SARS-CoV-2 sequence entries with complete collection date information shared via GISAID. 2021.
  • 7.Borges V, Sousa C, Menezes L, Goncalves AM, Picao M, Almeida JP, et al. Tracking SARS-CoV-2 lineage B.1.1.7 dissemination: insights from nationwide spike gene target failure (SGTF) and spike gene late detection (SGTL) data, Portugal, week 49 2020 to week 3 2021. Euro Surveill. 2021;26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.WHO. Methods for the detection and identification of SARS-CoV-2 variants, March 2021. World Health Organization. Regional Office for Europe.2021. p. 6. [Google Scholar]
  • 9.Harper H, Burridge A, Winfield M, Finn A, Davidson A, Matthews D, et al. Detecting SARS-CoV-2 variants with SNP genotyping. PloS one. 2021;16:e0243185. doi: 10.1371/journal.pone.0243185 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hourdel V, Kwasiborski A, Baliere C, Matheus S, Batejat CF, Manuguerra JC, et al. Rapid Genomic Characterization of SARS-CoV-2 by Direct Amplicon-Based Sequencing Through Comparison of MinION and Illumina iSeq100(TM) System. Front Microbiol. 2020;11:571328. doi: 10.3389/fmicb.2020.571328 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Liu T, Chen Z, Chen W, Chen X, Hosseini M, Yang Z, et al. A benchmarking study of SARS-CoV-2 whole-genome sequencing protocols using COVID-19 patient samples. iScience. 2021;24:102892. doi: 10.1016/j.isci.2021.102892 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Freed NE, Vlkova M, Faisal MB, Silander OK. Rapid and inexpensive whole-genome sequencing of SARS-CoV-2 using 1200 bp tiled amplicons and Oxford Nanopore Rapid Barcoding. Biol Methods Protoc. 2020;5:bpaa014. doi: 10.1093/biomethods/bpaa014 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Illumina. BaseSpace Sequence Hub. 2021.
  • 14.Chen S, Zhou Y, Chen Y, Gu J. fastp: an ultra-fast all-in-one FASTQ preprocessor. Bioinformatics. 2018;34:i884–i90. doi: 10.1093/bioinformatics/bty560 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.De Coster W, D’Hert S, Schultz DT, Cruts M, Van Broeckhoven C. NanoPack: visualizing and processing long-read sequencing data. Bioinformatics. 2018;34:2666–9. doi: 10.1093/bioinformatics/bty149 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Danecek P, Auton A, Abecasis G, Albers CA, Banks E, DePristo MA, et al. The variant call format and VCFtools. Bioinformatics. 2011;27:2156–8. doi: 10.1093/bioinformatics/btr330 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Koboldt DC, Zhang Q, Larson DE, Shen D, McLellan MD, Lin L, et al. VarScan 2: somatic mutation and copy number alteration discovery in cancer by exome sequencing. Genome Res. 2012;22:568–76. doi: 10.1101/gr.129684.111 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Rambaut A, Holmes EC, O’Toole A, Hill V, McCrone JT, Ruis C, et al. A dynamic nomenclature proposal for SARS-CoV-2 lineages to assist genomic epidemiology. Nat Microbiol. 2020. doi: 10.1038/s41564-020-0770-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Nguyen LT, Schmidt HA, von Haeseler A, Minh BQ. IQ-TREE: a fast and effective stochastic algorithm for estimating maximum-likelihood phylogenies. Mol Biol Evol. 2015;32:268–74. doi: 10.1093/molbev/msu300 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Grubaugh ND, Gangavarapu K, Quick J, Matteson NL, De Jesus JG, Main BJ, et al. An amplicon-based sequencing framework for accurately measuring intrahost virus diversity using PrimalSeq and iVar. Genome Biol. 2019;20:8. doi: 10.1186/s13059-018-1618-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Tchesnokova V, Kulasekara H, Larson L, Bowers V, Rechkina E, Kisiela D, et al. Acquisition of the L452R Mutation in the ACE2-Binding Interface of Spike Protein Triggers Recent Massive Expansion of SARS-CoV-2 Variants. Journal of clinical microbiology. 2021;59:e0092121. doi: 10.1128/JCM.00921-21 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.GISAID. Genomic epidemiology of hCoV-19. 2020.
  • 23.Radukic MT, Brandt D, Haak M, Muller KM, Kalinowski J. Nanopore sequencing of native adeno-associated virus (AAV) single-stranded DNA using a transposase-based rapid protocol. NAR Genom Bioinform. 2020;2:lqaa074. doi: 10.1093/nargab/lqaa074 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Wick RR, Judd LM, Holt KE. Performance of neural network basecalling tools for Oxford Nanopore sequencing. Genome Biol. 2019;20:129. doi: 10.1186/s13059-019-1727-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Bull RA, Adikari TN, Ferguson JM, Hammond JM, Stevanovski I, Beukers AG, et al. Analytical validity of nanopore sequencing for rapid SARS-CoV-2 genome analysis. Nat Commun. 2020;11:6272. doi: 10.1038/s41467-020-20075-6 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Ruslan Kalendar

10 Jan 2022

PONE-D-21-37979Comparison of different sequencing techniques with multiplex real-time PCR for detection to identify SARS-CoV-2 variants of concernPLOS ONE

Dear Dr. Malavige,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Feb 24 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Ruslan Kalendar

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. 

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Reviewer #1: 

In this study, RTPCR for single nucleotide polymorphisms was high accuracy for VOC identification. There were three false positive results for B.1.617 due to an isolated L452R mutation but B.1.1.7 or B.1.351 calls were 100% accurate. The authors also compared Oxford Nanopore technology (ONT) to Illumina sequencing. Higher call accuracy was observed with Illumina among 37 samples consistent with what would be expected but ONT had higher sequence coverage. This study was conducted prior to emergence of the omicron VOC and further experiments would need to be performed to evaluate these RTPCRs for differentiation from omicron. Overall, this was a proof-of-concept study that RTPCR may be useful for differentiating known predominant VOCs and ONT is acceptable in resource-limited settings. This is a relevant topic but there were major methodological limitations.

Major limitations: While ONT and Illumina Nextseq 550 platforms are compared, they are then used interchangeably for the RTPCR comparison. The results should be separated for comparisons to each gold standards. The immediate translation of RTPCR findings is limited by the shift to the omicron variant, but there is still utility in this study as a proof-of-concept.

If the accuracy was unchanged between sequencing platforms, this needs to be described. This is particularly relevant when 7 of 27 lineage calls were different by different methods. A table for information about the RTPCR performance compared to each sequencing method would be helpful to this end. The authors should consider including a 2x2 table for sensitivity/specificity in the supplement or describe it more clearly (i.e., the % agreement) in the results to support statements of good sensitivity and accuracy.

The dates or months that samples were collected would be useful to put into context each sequencing method for the RTPCR comparison. The dates/months that variants were introduced in this population should also be described.

Minor:

The title "Comparison of different sequencing techniques with multiplex real-time PCR for detection to identify SARS-CoV-2 variants of concern" is not grammatically correct. It should be "for detection" or "for identification"

In the abstract, regarding the sentence “34/37 of the samples sequenced by ONT had <5% ambiguous bases, while 21/37 samples sequenced using the Illumina generated <15% ambiguous bases”, it is not clear why cutoffs change. The authors could use the sentence from the results “samples with less than 10% ambiguous bases were higher for ONT compared to 21 Illumina (29 vs 25).”

Only two RTPCR panels described. In abstract and the introduction, the authors should state two panels by the same commercial vendor are used. Currently, it seems like many panels were going to be compared.

Under methods, it is unclear what kit, primers or probes were used for initial detection for the 30 cycle threshold cut off. It should be described if RTPCR was run in duplicate or triplicate.

“Due to improved coverage over the SARS-CoV-2 genome, 1 more samples which were sequenced using the ONT platform were lineage call-able by both Pango and Scorpio nomenclature.” – Please list the number in the text and/or cite the table.

In the discussion, I would recommend writing “less expensive” rather than “cheaper” as a potential benefit. Cost effectiveness was not evaluated. So, I would consider reframing the language to state that the error rate is acceptable when resources for Illumina sequencing may not be available.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Apr 4;17(4):e0265220. doi: 10.1371/journal.pone.0265220.r002

Author response to Decision Letter 0


12 Feb 2022

7th February 2022

Dr. Ruslan Kalendar

Academic Editor

PLOS ONE

Dear Dr. Kalendar,

Submission of manuscript titled ‘Comparison of different sequencing techniques for identification of SARS-CoV-2 variants of concern with multiplex real-time PCR’

We wish to thank the reviewers for carefully going through our manuscript and the useful suggestions they have made. We have incorporated all these changes in the revised version and letter and have addressed all issues raised by the reviewers. We have highlighted the changes in the revised manuscript.

Reviewer #1:

In this study, RTPCR for single nucleotide polymorphisms was high accuracy for VOC identification. There were three false positive results for B.1.617 due to an isolated L452R mutation but B.1.1.7 or B.1.351 calls were 100% accurate. The authors also compared Oxford Nanopore technology (ONT) to Illumina sequencing. Higher call accuracy was observed with Illumina among 37 samples consistent with what would be expected but ONT had higher sequence coverage. This study was conducted prior to emergence of the omicron VOC and further experiments would need to be performed to evaluate these RTPCRs for differentiation from omicron. Overall, this was a proof-of-concept study that RTPCR may be useful for differentiating known predominant VOCs and ONT is acceptable in resource-limited settings. This is a relevant topic but there were major methodological limitations.

Major limitations:

1) While ONT and Illumina Nextseq 550 platforms are compared, they are then used interchangeably for the RTPCR comparison. The results should be separated for comparisons to each gold standards. The immediate translation of RTPCR findings is limited by the shift to the omicron variant, but there is still utility in this study as a proof-of-concept.

Response: We highly value and appreciate the reviewer’s suggestions. We have separated the RT-PCR vs NGS comparison into two sections calculating percentages for each NGS technology, in the revised version of the manuscript.

We also completely agree with the comment the reviewer has made regarding detection of Omicron. Since the spread of the Omicron variant in Sri Lanka, we are in the process of assessing our in-house RTPCR assay for identifying Omicron and we have been able to successfully differente Omicron BA.1 from other variants (by presence of E484K, N501Y, HV69/70, L452R, and K417N). We have also been able to identify BA.2 from BA.1 due to the absence of HV69.70 in BA.2. However, as we have just started assessing the usefulness of this RTPCR for BA.1 and BA.2, we have not included this data in this manuscript.

2) If the accuracy was unchanged between sequencing platforms, this needs to be described. This is particularly relevant when 7 of 27 lineage calls were different by different methods.

Response: We thank the reviewer for this suggestion. This section was rewritten taking genome coverage into account and ignoring the differences in sub lineages (AY classification was changed by Pango team after we submitted the paper so it can be confusing to use those obsolete sub lineages). Only a classification at VOC level was used (pango lineage version 2021-08-09)

3) A table for information about the RTPCR performance compared to each sequencing method would be helpful to this end. The authors should consider including a 2x2 table for sensitivity/specificity in the supplement or describe it more clearly (i.e., the % agreement) in the results to support statements of good sensitivity and accuracy.

Response: we thank the reviewer for this suggestion. We have added summary table and a Venn diagram to supplementary table 2.

4) The dates or months that samples were collected would be useful to put into context each sequencing method for the RTPCR comparison. The dates/months that variants were introduced in this population should also be described.

Response: We thank the reviewer for this suggestion. We have included the collection dates and deposited dates for all the samples in supplementary table 1. In addition, we have added a few lines to the methods section regarding the outbreak periods.

Minor:

5) The title "Comparison of different sequencing techniques with multiplex real-time PCR for detection to identify SARS-CoV-2 variants of concern" is not grammatically correct. It should be "for detection" or "for identification"

Response: We apologize for this mistake and we have corrected it as suggested by the reviewer.

6) In the abstract, regarding the sentence “34/37 of the samples sequenced by ONT had <5% ambiguous bases, while 21/37 samples sequenced using the Illumina generated <15% ambiguous bases”, it is not clear why cutoffs change. The authors could use the sentence from the results “samples with less than 10% ambiguous bases were higher for ONT compared to 21 Illumina (29 vs 25).”

Response: We thank the reviewer for pointing this out. We have corrected this throughout the text.

7) Only two RTPCR panels described. In abstract and the introduction, the authors should state two panels by the same commercial vendor are used. Currently, it seems like many panels were going to be compared.

Response: We apologize for this mistake. We have corrected this in the revised version of the manuscript.

8) Under methods, it is unclear what kit, primers or probes were used for initial detection for the 30-cycle threshold cut off. It should be described if RTPCR was run in duplicate or triplicate.

Response: We apologize for this omission. We have included this in the methods section in the revised version. .

9) “Due to improved coverage over the SARS-CoV-2 genome, 1 more sample which were sequenced using the ONT platform were lineage call-able by both Pango and Scorpio nomenclature.” – Please list the number in the text and/or cite the table.

Response: we thank the reviewer for pointing out this omission. We have corrected this in the revised version.

10) In the discussion, I would recommend writing “less expensive” rather than “cheaper” as a potential benefit. Cost effectiveness was not evaluated. So, I would consider reframing the language to state that the error rate is acceptable when resources for Illumina sequencing may not be available.

Response: We agree with the reviewer that this is a more suitable word to use. We have corrected this in the revised version of the manuscript.

Thank you for considering our manuscript for publication with PLOS One.

Yours Sincerely,

Prof. Neelika Malavige

Attachment

Submitted filename: Response to Reviewers_1.docx

Decision Letter 1

Ruslan Kalendar

28 Feb 2022

Comparison of different sequencing techniques for identification of SARS-CoV-2 variants of concern with multiplex real-time PCR

PONE-D-21-37979R1

Dear Dr. Malavige,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Ruslan Kalendar

Academic Editor

PLOS ONE

Acceptance letter

Ruslan Kalendar

15 Mar 2022

PONE-D-21-37979R1

Comparison of different sequencing techniques for identification of SARS-CoV-2 variants of concern with multiplex real-time PCR

Dear Dr. Malavige:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Ruslan Kalendar

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Metadata of 190 samples used in the comparison.

    (XLSX)

    S2 Table. Comparison statistics of RT-PCR vs each sequencing technology.

    (XLSX)

    S3 Table. Sub-consensus SNV and Indel frequency data of ONT and Illumina.

    (XLSX)

    S1 Methods. Methods in detail used in the experiment.

    (RTF)

    Attachment

    Submitted filename: Response to Reviewers_1.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES