Skip to main content
HRB Open Research logoLink to HRB Open Research
. 2021 Oct 15;4:85. Originally published 2021 Jul 30. [Version 2] doi: 10.12688/hrbopenres.13353.2

Concordance between PCR-based extraction-free saliva and nasopharyngeal swabs for SARS-CoV-2 testing

Chiara De Santi 1,a, Benson Jacob 2, Patricia Kroich 1, Sean Doyle 2, Rebecca Ward 1, Brian Li 1, Owain Donnelly 2, Amy Dykes 2, Trisha Neelakant 2, David Neary 2, Ross McGuinness 2, Jacqueline Cafferkey 3, Kieran Ryan 4, Veronica Quadu 5, Killian McGrogan 5, Alejandro Garcia Leon 6, Patrick Mallon 6, Fidelma Fitzpatrick 3,7, Hilary Humphreys 3,7, Eoghan De Barra 2,8,#, Steve W Kerrigan 1,#, Gianpiero L Cavalleri 1,9,#
PMCID: PMC8408542  PMID: 34522839

Version Changes

Revised. Amendments from Version 1

We thank the reviewers for their summary, comments and suggestions. We have now addressed the points raised in the different sections of the manuscript and we revised Figure 2 legend. Briefly, we added some information about the longitudinal study and the rationale behind exclusion criteria for saliva testing in the methods section (‘sample collection’ paragraph). We also added a comment regarding the thickness of the saliva samples and the care that should be taken to handle them in a laboratory setting to avoid cross-contamination (‘saliva sample processing’ paragraph). In the discussion section, we commented on the comparison of Ct values between NPS and saliva and on the diagnostic performance of PCR-based saliva compared to antigen testing (although antigen approaches were not tested in parallel in our cohorts). Finally, we expanded the reference list as appropriate to match the revised text and we corrected some typos.

Abstract

Introduction: Saliva represents a less invasive alternative to nasopharyngeal swab (NPS) for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) detection. SalivaDirect is a nucleic acid extraction-free method for detecting SARS-CoV2 in saliva specimens. Studies evaluating the concordance of gold standard NPS and newly developed SalivaDirect protocols are limited. The aim of our study was to assess SalivaDirect as an alternative method for COVID-19 testing.

Methods: Matching NPS and saliva samples were analysed from a cohort of symptomatic (n=127) and asymptomatic (n=181) participants recruited from hospital and university settings, respectively. RNA was extracted from NPS while saliva samples were subjected to the SalivaDirect protocol before RT-qPCR analysis. The presence of SARS-Cov-2 was assessed using RdRp and N1 gene targets in NPS and saliva, respectively.

Results: Overall we observed 94.3% sensitivity (95% CI 87.2-97.5%), and 95.9% specificity (95% CI 92.4-97.8%) in saliva when compared to matching NPS samples. Analysis of concordance demonstrated 95.5% accuracy overall for the saliva test relative to NPS, and a very high level of agreement (κ coefficient = 0.889, 95% CI 0.833–0.946) between the two sets of specimens. Fourteen of 308 samples were discordant, all from symptomatic patients. Ct values were >30 in 13/14 and >35 in 6/14 samples. No significant difference was found in the Ct values of matching NPS and saliva sample ( p=0.860). A highly significant correlation (r = 0.475, p<0.0001) was also found between the Ct values of the concordant positive saliva and NPS specimens.

Conclusions: Use of saliva processed according to the SalivaDirect protocol represents a valid method to detect SARS-CoV-2. Accurate and less invasive saliva screening is an attractive alternative to current testing methods based on NPS and would afford greater capacity to test asymptomatic populations especially in the context of frequent testing.

Keywords: SARS-CoV-2, Saliva, SalivaDirect, Nasopharyngeal swabs, RT-qPCR

Introduction

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is a novel coronavirus that rapidly spread across the globe in late December 2019 and was declared a pandemic by the World Health Organization (WHO) in March 2020 [ press conference WHO 11 th March 2020]. Containing the spread of SARS-CoV-2 has been a significant challenge worldwide mainly because both asymptomatic and symptomatic individuals can transmit the virus ( Huff & Singh, 2020). A key approach to limiting cross-infection is robust testing and contact tracing. Currently, the gold standard for diagnosis is nucleic acid detection by reverse transcription quantitative PCR (RT-qPCR) ( Adhikari et al., 2020). Nasopharyngeal swabs (NPS) were initially adopted as the preferred sampling procedure for SARS-CoV-2, due to established diagnostic practices for other respiratory infections ( Li et al., 2013; Lieberman et al., 2009). However, NPS are invasive and may induce coughing and sneezing, increasing the risk of transmission to healthcare professionals (HCP) conducting the procedure ( Kim et al., 2016). NPS discomfort can also be a barrier to repeated, frequent testing as swabbing can induce effects that can last up to 24 hours post procedure including epistaxis, headaches, earaches and rhinorrhea ( Gupta et al., 2021).

Testing for SARS-CoV-2 in saliva mitigates many of the challenges associated with NPS sampling ( Tan et al., 2021; Vaz et al., 2020; Wyllie et al., 2020). Although various different protocols for SARS-CoV-2 testing in saliva have been proposed, including colorimetric reverse transcription loop-mediated isothermal amplification (RT-LAMP) and lateral flow assays ( Faustini et al., 2020; Lalli et al., 2021), RT-qPCR is the most common used modality ( Caulley et al., 2021; Migueres et al., 2020; Teo et al., 2021) with a reported sensitivity between ~ 69 to 100% ( Azzi et al., 2020; Kojima et al., 2020; Pasomsub et al., 2021; Skolimowska et al., 2020; To et al., 2020).

SalivaDirect is a nucleic acid extraction-free, cost effective and reliable method for detecting SARS-CoV2 which has been authorised for use by the FDA ( Vogels et al., 2021, FDA press release 15 th August 2020). Using SalivaDirect, specimens can be self-collected in a sterile sample tube without a viral transport medium. Proteinase K addition and a short heat-treatment step precede RT-qPCR analysis ( Vogels et al., 2021). Initial studies using SalivaDirect reported a significant positive agreement (94%) between paired saliva and NPS samples obtained from a hospital cohort of 37 asymptomatic HCP and 30 COVID-19-positive inpatients ( Vogels et al., 2021). In another study, matched saliva and NPS samples obtained from 30 individuals with COVID-19 illustrated a 88.2% concordance when using the SalivaDirect protocol ( Rodríguez Flores et al., 2021).

Data comparing the concordance of ‘gold standard’ NPS and the SalivaDirect protocol for ongoing testing as part of an infection prevention and control programme are limited. In the present study, we set out to compare matching NPS and extraction-free saliva samples for detection of SARS-CoV-2 viral RNA via RT-qPCR, to assess the suitability of saliva as an alternative specimen for COVID-19 testing. We studied two key demographics – asymptomatic university students and hospital inpatients admitted with respiratory symptoms due to COVID-19 related illnesses.

Methods

Ethical considerations

This study was approved by the Ethics Committee of Royal College of Surgeons in Ireland (RCSI) (study code: REC202010011) and the National Research Ethics Committee for COVID-19 (20-NREC-COV-056). All subjects involved in this study provided written informed consent.

Sample collection

Research participants were recruited at two sites; a symptomatic patient cohort (n=127) was assembled at Beaumont Hospital, Dublin, Ireland and an asymptomatic ‘student’ cohort (n=181) at RCSI University of Medicine and Health Sciences, Dublin, Ireland. Recruitment took place during the period from November 2020 to March 2021 for the symptomatic population and in December 2020 and January 2021 for the asymptomatic student cohort.

Symptomatic individuals were inpatients at Beaumont Hospital who tested positive for SARS-CoV-2 on NPS-based diagnostic admission testing, carried out in the hospital’s clinical microbiology laboratory (using either the CerTest Biotec VIASURE SARS-CoV-2 real time PCR detection kit or Cepheid Xpert Xpress SARS-CoV-2). Patients were recruited to the research study post admission to hospital. Individuals in the symptomatic arm provided a research NPS sample, (collected by a trained professional), and a saliva sample (collected by passive drooling). The research NPS and saliva were collected on the same day. Asymptomatic students were recruited via an in-house screening programme at RCSI. NPS samples were collected by a trained professional with a saliva sample collected by passive drooling immediately afterwards. In both cohorts, exclusion criteria for participation to the study were any of the following activities conducted in the half hour prior to saliva sample collection: smoking, drinking any liquids, food, nasal sprays, tooth brushing and/or mouth washing. We set these as exclusion criteria as these activities might leave residues in the saliva (thereby influencing the samples quality of the sample and associated handling in the laboratory) or affect the samples viral load in the sample ( Eduardo et al., 2021; Seneviratne et al., 2021)

NPS sample processing

NPS from the symptomatic cohort were placed in 2 ml of Viral Transport Media and sent to the CEPHR Laboratory using a biomedical courier. Samples were aliquoted into 2 ml cryovials and stored at -80°C until further use. Using 250 µl of the biobanked NPS, RNA was extracted using the automated platform for nucleic acid extraction EX3600 (Liferiver Biotech, Shanghai, China) according to manufacturer’s instructions, with a nucleic acid elution volume of 60 µl. Following RNA extraction, samples underwent RT-qPCR for SARS-CoV-2 with primers directed against the RNA-dependent RNA polymerase ( RdRp) region of the viral genome, using the COVID-19 Genesig Real-Time PCR assay ( Primerdesign Ltd, Hampshire, United Kingdom) on The LightCycler 480 PCR platform ( Roche Diagnostics, Basel, Switzerland) with the following thermocycling conditions: 10 min 55°C, 2 min 95°C, 45 cycles of 10 sec 95°C/60 sec 60°C. Each run included a SARS-CoV-2 positive control (RNA), internal control, no-template control and a positive control of extraction (RNA from SARS-CoV-2 virus - 2019-nCoV/Italy-INMI1). Samples with quantification cycle (Cq) values below 40 cycles were defined as SARS-CoV-2-detected.

NPS from the asymptomatic cohort were processed in the COVID-19 Testing Lab at RCSI. RNA extraction for NPS samples was performed using a MagMax Viral/Pathogen II Nucleic Acid Isolation Kit ( ThermoFisher Scientific), as per manufacturers’ instructions on a KingFisher Flex Purification system (model 5400630, ThermoFisher Scientific) instrument using 200 µL of NPS sample input. RT-qPCR followed the Centers for Disease Control and Prevention (CDC) protocol ( Lu et al., 2020). Briefly, amplification of the SARS-CoV-2 nucleocapsid gene ( N1 and N2) and internal control ( RP) was performed using TaqPath 1-Step RT-qPCR Master Mix (4x, ThermoFisher Scientific) with the following sets of primers and probes: N1_F primer 5′- GACCCCAAAATCAGCGAAAT -3′ (500nM), N1_R primer 5′- TCTGGTTACTGCCAGTTGAATCTG -3′ (500nM), and N1_probe 5′-FAM-ACCCCGCATTACGTTTGGTGGACC -BHQ1-3′ (125nM); N2_F primer 5′- TTACAAACATTGGCCGCAAA -3′ (500nM), N2_R primer 5′- GCGCGACATTCCGAAGAA -3′ (500nM), and N2_probe 5′-Cy3- ACAATTTGCCCCCAGCGCTTCAG -BHQ1-3′ (125nM); RP_F primer 5′- AGATTTGGACCTGCGAGCG -3′ (500nM), RP_R primer 5′- GAGCGGCTGTCTCCACAAGT -3′ (500nM), and RP_probe 5′-Cy5- TTCTGACCTGAAGGCTCTGCGCG -BHQ1-3′ (125nM). The TaqPath RT-qPCR Master Mix (15 µL) was added to 5 µL of the RNA extracted from each NPS sample and run on a QuantStudio 7 (ThermoFisher Scientific) Pro Real-Time PCR with the following thermocycling conditions: 2 min 25°C, 15 min 50°C, 2 min 95°C and 45 cycles of 3 sec 95°C/30 sec 55°C. Cycle threshold (Ct) values lower than 40 was interpreted as detection of the gene and viral status of the clinical samples was called as per CDC recommendation ( Lu et al., 2020).

Saliva sample processing

All saliva specimens ( i.e. from both the symptomatic and asymptomatic cohorts) were processed in the COVID-19 Testing Laboratory at RCSI using the SalivaDirect protocol ( Vogels et al., 2021). Briefly, 50 µl of each saliva sample was added to 2.5 µl of proteinase K (50 mg/ml, ThermoFisher Scientific), vortexed and incubated at 95ºC for 5 minutes to ensure inactivation of the virus. The handling of the saliva samples (which were of a thick consistency) was performed with particular attention in order to avoid between-samples contamination. RT-qPCR amplification was performed using TaqPath 1-Step RT-qPCR Master Mix (4x, ThermoFisher Scientific), and the CDC N1 and RP sets of primers and probes as per SalivaDirect protocol at the following concentrations: N1_F primer (400nM), N1_R primer (400nM), and N1_probe (200nM); RP_F primer (150nM), RP_R primer (150nM), and RP_probe (200nM). The TaqPath RT-qPCR Master Mix (15 µL) was added to 5 µL of the “extraction-free” saliva sample and run on a QuantStudio 7 Pro Real-Time PCR with the following thermocycling conditions: 10 min 52°C, 2 min 95°C and 45 cycles of 10 sec 95°C/30 sec 55°C. Ct values lower than 40 were interpreted as detection of the gene and viral status was called as per SalivaDirect recommendation ( Vogels et al., 2021).

RNA extraction from saliva and SARS-CoV-2 detection using TaqPath COVID-19 CE-IVD RT-PCR Kit

In some cases, i.e. when the saliva and NPS testing results were not concordant, saliva samples were extracted using the MagMax Viral/Pathogen II Nucleic Acid Isolation Kit (ThermoFisher Scientific) following the protocol described above for NPS processing. This was a quality control step introduced to reduce the risk of false positive or negative results from saliva processed according to SalivaDirect protocol. RT-qPCR amplification of the SARS-CoV-2 ORF1 gene, N gene and S gene was performed using TaqPath 1‑Step Multiplex Master Mix (No ROX) (4X) and the TaqPath COVID-19 CE-IVD RT-PCR Kit as per manufacturers’ instructions. Briefly, 15 µL of the prepared mix were added to 10 µL of the RNA extracted from each saliva sample and run on a QuantStudio 7 Pro Real-Time PCR with the following thermocycling conditions: 2 min 25°C, 10 min 53°C, 2 min 95°C, and 40 cycles of 3 sec 95°C/30 sec 60°C. Ct values lower than 37 were interpreted as indicating the expression of that gene and viral status was called as per TaqPath COVID-19 CE-IVD RT-PCR Kit manufacturers’ instructions.

Statistical analyses

All statistical analyses were performed using GraphPad PRISM version 8.0.0 (GraphPad Software, San Diego, CA, USA). Sensitivity, specificity and 95% confidence intervals (CI) were calculated to assess diagnostic performance. Agreement between the NPS and saliva specimens for the virus detection ability was also assessed using Cohen’s Kappa (κ coefficient). Paired t-tests were used to compare the Ct values between NPS and saliva. Correlation between NPS and saliva Ct values were quantified using the Pearson correlation coefficient (Pearson r). All p-values were two-sided and p <0.05 was considered significant.

Results

A total of 308 individuals, 181 asymptomatic students and 127 symptomatic patients, were included in this study ( Table 1).

Table 1. Demographic and clinical characteristics of the symptomatic (n=127) and asymptomatic (n=181) cohorts.

For the symptomatic patients, we report the maximum COVID-19 disease severity (as per WHO guidelines) reached during their hospital stay.

Hospitalised
patients (n=127)
Students (n=181)
Sex (%) Male 44.9 45.4
Female 37.8 52.4
Unknown 17.3 2.2
Age (years) Median (IQR $ ) 68 (26) 24 (3)
Clinical Phenotype (%) Mild: 31.5 Asymptomatic: 100
Moderate: 20.5
Severe: 18.9
Critical *: 9.4
Unknown: 19.7

$Interquantile Range; *Critical COVID-19 severity score included both sepsis (n=3) and acute respiratory distress syndrome (ARDS) (n=9).

We first tested the correlation between NPS and saliva testing results in the symptomatic cohort. SARS-CoV-2 was detected in 86 of 127 patient NPS, while it was undetected in 41. Saliva testing in the same cohort indicated that 90 patients tested positive for SARS-CoV-2, while 37 tested negative. The sensitivity of saliva compared to NPS was 94.2% (95% CI 87.1-97.4%), while the specificity was 78.1% (95% CI 63.3-88%) in our symptomatic cohort.

We next tested the correlation between NPS and saliva in the asymptomatic cohort. Of 181 students, one tested positive both in NPS and saliva samples, while 180 tested negative in both. Sensitivity (95% CI 5-100%) and specificity (95% CI 97.9-100%) were therefore both 100% in this cohort.

The overall concordance between NPS and saliva testing is shown in Table 2. In the combined cohort, the sensitivity of saliva compared to NPS was 94.3% (95% CI 87.2-97.5%), while the specificity was 95.9% (95% CI 92.4-97.8%). Analysis of the concordance between the NPS and saliva specimens demonstrated an overall 95.5% accuracy for the saliva test relative to NPS and a very high level of agreement (κ coefficient = 0.889, 95% CI 0.833–0.946) between the two specimens. Nonetheless, we found 14 discordant samples between saliva and NPS. SARS-CoV-2 was detected in nine saliva samples but not detected in their matched NPS. On the other hand, viral RNA was not detected in five saliva samples but detected in the matched NPS. All 14 discordant samples belonged to the symptomatic hospitalised cohort. Ct values were >30 in 13/14 of these discordant samples and >35 in 6/14 samples.

Table 2. Diagnostic performance of SalivaDirect protocol compared to the gold standard NPS testing in a symptomatic (n=127) and asymptomatic (n=181) cohorts.

Nasopharyngeal
swab
Positive Negative
Salivadirect – Saliva Positive 82 9
Negative 5 212
Total 87 221
Positive agreement = 94.3 % (95 % CI 87.2-97.5 %)
Negative agreement = 95.9 % (95 % CI 92.4-97.8 %)

To further explore the discordant results, we extracted RNA from the 14 discordant saliva samples and retested the samples with the TaqPath COVID-19 CE-IVD RT-PCR kit. SARS-CoV-2 viral RNA detection was confirmed in 7/9 ‘false positive’ saliva samples, indicating these were actually true positives which the NPS test failed to detect. The remaining two saliva samples in which SARS-CoV-2 was undetected had Ct values ≥35 using the SalivaDirect protocol. All five ‘false negative’ also tested negative using the TaqPath protocol, indicating that in this case saliva testing failed to detect the virus which was instead detected by NPS testing. The RdRp Ct values from NPS from these samples were >30 using the Genesig Real-Time PCR assay.

We next compared the Ct values of the concordant positive saliva and NPS samples ( Figure 1A) in the symptomatic cohort. N1 Ct values were reported for saliva samples according to SalivaDirect protocol, and RdRp Ct values for the NPS were reported, as it is the target gene of the Genesig Real-Time PCR assay. The overall mean and standard deviation (SD) Ct value for the positive NPS specimens and saliva samples was 26.36 (SD 7.03) and 26.49 (SD 6.04), respectively. The difference in mean Ct values (0.132) was not statistically significant ( p=0.860). We also found a highly significant correlation between the Ct values of the positive saliva and NPS specimens (Pearson r = 0.475, p<0.0001, Figure 1B).

Figure 1. Comparison of Ct values from concordant positive saliva and NPS samples from the symptomatic cohort (n=81).

Figure 1.

( A) The mean Ct values for saliva specimens are not significantly different than the mean for NPS specimens. The lines indicate samples from the same patient. ( B) Correlation of Ct values between saliva ( N1) and NPS ( RdRp) PCR. The scatter plot shows the comparison of Ct values between the two methods.

Finally, we compared NPS and saliva test results obtained from the hospitalised symptomatic patients (127 individuals) with the results from their initial positive diagnostic SARS-CoV-2 swab, which was performed on admission to hospital. The average time between the initial diagnostic NPS and the paired (same day) research saliva and NPS was 4.73 days (95% CI 4.05-5.42) post initial diagnosis. As expected, the positive agreement of NPS and saliva testing decreased with time, but a similar pattern for saliva and NPS is notable (see Figure 2).

Figure 2. Percentage of sensitivity of saliva and repeat NPS in the symptomatic cohort (n=127).

Figure 2.

X axis: the delay (in days) between the positive NPS on hospital admission and the collection of the matching saliva and NPS sample. Matching NPS/saliva samples taken > 7 days post admission were pooled and reported as ‘>7’ (average of 11.53 days, 95% CI 10.02-13.03).

Discussion

Use of saliva to detect SARS-CoV-2 represents a valid and accurate alternative to NPS sampling. Our results indicate a 94.3% sensitivity and 95.9% specificity of saliva when compared to a matching NPS taken on the same day in a combined cohort of symptomatic and asymptomatic individuals. Our results are consistent with the original publication of the SalivaDirect method, where the positive agreement was 94% in the hospitalised cohort, and sensitivity and specificity of saliva versus NPS in 3779 asymptomatic individuals were 89.5% and >99.9%, respectively ( Vogels et al., 2021). A separate study reported a sensitivity of 88.2% of saliva samples assessed with SalivaDirect when compared to matching NPS samples taken from 30 COVID-19-positive individuals ( Rodríguez Flores et al., 2021).

In samples where the virus was detected, we observed a strong correlation between viral gene Ct values across NPS and saliva samples, consistent with recent reports ( Braz-Silva et al., 2020; Mahmoud et al., 2021). Saliva-positive samples often differ from NPS in terms of Ct values/viral load ( Braz-Silva et al., 2021; Skolimowska et al., 2020; Wyllie et al., 2020), however in our hands NPS and saliva samples showed similar Ct values, possibly due to the fact that we tested for different viral genes for NPS ( RdRp) and saliva ( N1).

Although we found an overall accuracy of 95.5%, 14 samples from the symptomatic cohort were discordant between matching NPS and saliva samples, with five individuals testing positive by NPS only and nine by saliva only. The majority of these samples showed Ct values (of either RdRp for NPS or N1 for saliva) over 30, suggesting that a higher discordance between NPS and saliva testing results could be observed for high Ct values, as reported before ( Kandel et al., 2020). When we extracted RNA from the 14 discordant saliva samples and tested them using an alternative PCR protocol, we found two ‘false positives’ in saliva. This confirmatory step in case of high Ct values from the SalivaDirect protocol could therefore be helpful to avoid false positives, which are proportionally greater in low prevalence settings ( Basile et al., 2020; Healy et al., 2021).

In the hospitalised symptomatic cohort, we assessed the positivity rate in NPS, and saliva samples taken a variable amount of time after the first diagnosis. As expected, the positive agreement between the first diagnosis and the saliva or repeat NPS decreased over time, reflecting recovery and viral clearance. These findings are consistent with other longitudinal studies of COVID-19 testing ( Smith et al., 2021; Wyllie et al., 2020). However, our results are the first to show that the drop in performance is consistent across saliva and NPS, thereby showing once again that the SalivaDirect accuracy is very similar to the gold-standard RT-qPCR from NPS.

Limitations of the current study include the presence of only one positive in the asymptomatic population which limits the value of the sensitivity calculation in that cohort. In addition, a more closely matched control group would have been beneficial in this study, as samples from a healthy student population were compared to the symptomatic hospitalised cohort. Lastly, the use of Ct values shows a trend of the viral load but does not allow exact quantification of viral copies/ml due to the absence of a standard curve included in the RT-qPCR analyses.

Overall, although the sensitivity and specificity are slightly lower, this work suggests that the SalivaDirect protocol represents a valid alternative to NPS. Other diagnostic assays are available including lateral flow antigen tests (LFAT). However, a pilot study applying LFAT in an asymptomatic population in the UK indicated a sensitivity of only ~49% when compared to gold standard NPS testing ( Wise, 2020). More recent studies have reported sensitivities for rapid antigen testing compared to NPS-based molecular testing (i.e. RT-qPCR) of ~93% ( Fernandez-Montero et al., 2021; Krüger et al., 2021; Van der Moeren et al., 2021) in the presence of low Ct values/high viral load, however these values dropped when including high Ct values/low viral load (71.4%, 79.8% and 82.2% in the three works, respectively). In our hands SalivaDirect sensitivity compared to NPS was retained for high Ct values by showing a sensitivity of 100% for Ct values lower than 30 and 94.3% overall. Most importantly, rapid antigen tests currently in use still require NPS as the sampling method, which is widely perceived as uncomfortable and could be a barrier for repeated testing. On the other hand, SalivaDirect employs saliva as input, which is less invasive and hence a more acceptable sampling method compared to NPS ( Goldfarb et al., 2021; Kinloch et al., 2020) and whose collection does not require direct interaction between HCP and individuals. This offers several advantages, decreasing the potential for cross-infection as well as alleviating testing bottlenecks by decreasing the need for qualified HCP, personal protective equipment, and swab supply ( Wyllie et al., 2020). Saliva can be self-collected, although individuals should be instructed in proper use of the self-collection tube, including its decontamination after saliva collection. These advantages are particularly relevant in the context of a surveillance programme where compliance rates play a crucial role in the long-term success of the screening initiative and individuals would benefit from a less invasive and accurate sampling method, easier to collect in a serial manner.

Data availability

DRYAD: Concordance between PCR-based extraction-free saliva and nasopharyngeal swabs for SARS-CoV-2 testing, https://doi.org/10.5061/dryad.ksn02v74n ( De Santi, 2021)

This project contains the following underlying data:

  • 1.

    Ct_values_for_matched_NPS_and_saliva_samples_(asymptomatic_cohort).xlsx.This table shows the Ct values of N1 (both for NPS and saliva) in the samples belonging to the asymptomatic cohort (n=181 students).

  • 2.

    Ct_values_for_matched_NPS_and_saliva_samples_(symptomatic_cohort).xlsx. This table shows the Ct values of RdRp (NPS) and N1 (saliva) in the samples belonging to the symptomatic cohort (n=127 hospitalised symptomatic individuals).

Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).

Acknowledgements

We are grateful to the students at the Royal College of Surgeons in Ireland and inpatients at Beaumont hospital who shared their samples and data for this study. We would like to thank our colleagues Jennifer Dowling, Richard Carroll, Stephanie Annett and Sudipto Das (School of Pharmacy and Biomolecular Sciences, RCSI) for their advice and support in setting up the COVID-19 Testing Laboratory at RCSI. We also thank Prof Samuel McConkey (Department of International Health and Tropical Medicine, RCSI) for his input in the discussion around this manuscript. Finally, we thank Zoe Yandle and Jonathan Dean (National Virus Reference Laboratory) and Prof Jonathan Ball (University of Nottingham) for their advices about setting up saliva testing at RCSI.

Funding Statement

This study was supported by the Royal College of Surgeons in Ireland and by Science Foundation Ireland Grant 20/COV/0185.

[version 2; peer review: 2 approved]

References

  1. Adhikari SP, Meng S, Wu YJ, et al. : Epidemiology, causes, clinical manifestation and diagnosis, prevention and control of coronavirus disease (COVID-19) during the early outbreak period: a scoping review. Infect Dis Poverty. 2020;9(1):29. 10.1186/s40249-020-00646-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Azzi L, Carcano G, Gianfagna F, et al. : Saliva is a reliable tool to detect SARS-CoV-2. J Infect. 2020;81(1):e45–e50. 10.1016/j.jinf.2020.04.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Basile K, Maddocks S, Kok J, et al. : Accuracy amidst ambiguity: false positive SARS-CoV-2 nucleic acid tests when COVID-19 prevalence is low. Pathology. 2020;52(7):809–811. 10.1016/j.pathol.2020.09.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Braz-Silva PH, Mamana AC, Romano CM, et al. : Performance of at-home self-collected saliva and nasal-oropharyngeal swabs in the surveillance of COVID-19. J Oral Microbiol. 2020;13(1):1858002. 10.1080/20002297.2020.1858002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Caulley L, Corsten M, Eapen L, et al. : Salivary Detection of COVID-19. Ann Intern Med. 2021;174(1):131–133. 10.7326/M20-4738 [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. De Santi C: Concordance between PCR-based extraction-free saliva and nasopharyngeal swabs for SARS-CoV-2 testing. Dryad, Dataset,2021. 10.5061/dryad.ksn02v74n [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Eduardo FP, Corrêa L, Heller D, et al. : Salivary SARS-CoV-2 load reduction with mouthwash use: A randomized pilot clinical trial. Heliyon. 2021;7(6):e07346. 10.1016/j.heliyon.2021.e07346 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Faustini SE, Jossi SE, Perez-Toledo M, et al. : Detection of antibodies to the SARS-CoV-2 spike glycoprotein in both serum and saliva enhances detection of infection. medRxiv. 2020; 2020.06.16.20133025. 10.1101/2020.06.16.20133025 [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Fernandez-Montero A, Argemi J, Rodríguez JA, et al. : Validation of a rapid antigen test as a screening tool for SARS-CoV-2 infection in asymptomatic populations. Sensitivity, specificity and predictive values. EClinicalMedicine. 2021;37:100954. 10.1016/j.eclinm.2021.100954 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Goldfarb DM, Tilley P, Al-Rawahi GN, et al. : Self-Collected Saline Gargle Samples as an Alternative to Health Care Worker-Collected Nasopharyngeal Swabs for COVID-19 Diagnosis in Outpatients. J Clin Microbiol. 2021;9(4):e02427–20. 10.1128/JCM.02427-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Gupta K, Bellino PM, Charness ME: Adverse effects of nasopharyngeal swabs: Three-dimensional printed versus commercial swabs. Infect Control Hosp Epidemiol. 2021;42(5):641–642. 10.1017/ice.2020.297 [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Healy B, Khan A, Metezai H, et al. : The impact of false positive COVID-19 results in an area of low prevalence. Clin Med (Lond). 2021;21(1):e54–e56. 10.7861/clinmed.2020-0839 [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Huff HV, Singh A: Asymptomatic Transmission During the Coronavirus Disease 2019 Pandemic and Implications for Public Health Strategies. Clin Infect Dis. 2020;71(10):2752–2756. 10.1093/cid/ciaa654 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Kandel C, Zheng J, McCready J, et al. : Detection of SARS-CoV-2 from Saliva as Compared to Nasopharyngeal Swabs in Outpatients. Viruses. 2020;12(11):1314. 10.3390/v12111314 [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Kim YG, Yun SG, Kim MY, et al. : Comparison between Saliva and Nasopharyngeal Swab Specimens for Detection of Respiratory Viruses by Multiplex Reverse Transcription-PCR. J Clin Microbiol. 2016;55(1):226–233. 10.1128/JCM.01704-16 [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Kinloch NN, Shahid A, Ritchie G, et al. : Evaluation of Nasopharyngeal Swab Collection Techniques for Nucleic Acid Recovery and Participant Experience: Recommendations for COVID-19 Diagnostics. Open Forum Infect Dis. 2020;7(11):ofaa488. 10.1093/ofid/ofaa488 [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Kojima N, Turner F, Slepnev V, et al. : Self-Collected Oral Fluid and Nasal Swab Specimens Demonstrate Comparable Sensitivity to Clinician-Collected Nasopharyngeal Swab Specimens for the Detection of SARS-CoV-2. Clin Infect Dis. 2020; ciaa1589. 10.1093/cid/ciaa1589 [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Krüger LJ, Klein JAF, Tobian F, et al. : Evaluation of accuracy, exclusivity, limit-of-detection and ease-of-use of LumiraDx™: An antigen-detecting point-of-care device for SARS-CoV-2. Infection. 2021;1–12. 10.1007/s15010-021-01681-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Lalli MA, Langmade JS, Chen X, et al. : Rapid and Extraction-Free Detection of SARS-CoV-2 from Saliva by Colorimetric Reverse-Transcription Loop-Mediated Isothermal Amplification. Clin Chem. 2021;67(2):415–424. 10.1093/clinchem/hvaa267 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Li L, Chen QY, Li YY, et al. : Comparison among nasopharyngeal swab, nasal wash, and oropharyngeal swab for respiratory virus detection in adults with acute pharyngitis. BMC Infect Dis. 2013;13:281. 10.1186/1471-2334-13-281 [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Lieberman D, Lieberman D, Shimoni A, et al. : Identification of respiratory viruses in adults: nasopharyngeal versus oropharyngeal sampling. J Clin Microbiol. 2009;47(11):3439–3443. 10.1128/JCM.00886-09 [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Lu X, Wang L, Sakthivel SK, et al. : US CDC Real-Time Reverse Transcription PCR Panel for Detection of Severe Acute Respiratory Syndrome Coronavirus 2. Emerg Infect Dis. 2020;26(8):1654–1665. 10.3201/eid2608.201246 [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Mahmoud SA, Ganesan S, Ibrahim E, et al. : Evaluation of RNA extraction free method for detection of SARS-COV-2 in salivary samples for mass screening for COVID-19. Biomed Res Int. 2021;2021:5568350. 10.1155/2021/5568350 [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Migueres M, Mengelle C, Dimeglio C, et al. : Saliva sampling for diagnosing SARS-CoV-2 infections in symptomatic patients and asymptomatic carriers. J Clin Virol. 2020;130:104580. 10.1016/j.jcv.2020.104580 [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Pasomsub E, Watcharananan SP, Boonyawat K, et al. : Saliva sample as a non-invasive specimen for the diagnosis of coronavirus disease 2019: a cross-sectional study. Clin Microbiol Infect. 2021;27(2):285.e1–285.e4. 10.1016/j.cmi.2020.05.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Rodríguez Flores SN, Rodríguez-Martínez LM, Reyes-Berrones BL, et al. : Comparison Between a Standard and SalivaDirect RNA Extraction Protocol for Molecular Diagnosis of SARS-CoV-2 Using Nasopharyngeal Swab and Saliva Clinical Samples. Front Bioeng Biotechnol. 2021;9:638902. 10.3389/fbioe.2021.638902 [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Seneviratne CJ, Balan P, Ko KKK, et al. : Efficacy of commercial mouth-rinses on SARS-CoV-2 viral load in saliva: randomized control trial in Singapore. Infection. 2021;49(2):305–311. 10.1007/s15010-020-01563-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Skolimowska K, Rayment M, Jones R, et al. : Non-invasive saliva specimens for the diagnosis of COVID-19: caution in mild outpatient cohorts with low prevalence. Clin Microbiol Infect. 2020;26(12):1711–1713. 10.1016/j.cmi.2020.07.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Smith RL, Gibson LL, Martinez PP, et al. : Longitudinal assessment of diagnostic test performance over the course of acute SARS-CoV-2 infection. MedRxiv [PREPRINT]. 2021. 10.1101/2021.03.19.21253964 [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Tan SH, Allicock O, Armstrong-Hough M, et al. : Saliva as a gold-standard sample for SARS-CoV-2 detection. Lancet Respir Med. 2021;9(6):562–564. 10.1016/S2213-2600(21)00178-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Teo AKJ, Choudhury Y, Tan IB, et al. : Saliva is more sensitive than nasopharyngeal or nasal swabs for diagnosis of asymptomatic and mild COVID-19 infection. Sci Rep. 2021;11(1):3134. 10.1038/s41598-021-82787-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. To KKW, Tsang OTY, Yip CCY, et al. : Consistent Detection of 2019 Novel Coronavirus in Saliva. Clin Infect Dis. 2020;71(15):841–843. 10.1093/cid/ciaa149 [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Van der Moeren N, Zwart VF, Lodder EB, et al. : Evaluation of the test accuracy of a SARS-CoV-2 rapid antigen test in symptomatic community dwelling individuals in the Netherlands. PLoS One. 2021;16(5):e0250886. 10.1371/journal.pone.0250886 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Vaz SN, de Santana DS, Netto EM, et al. : Saliva is a reliable, non-invasive specimen for SARS-CoV-2 detection. Brazilian J Infect Dis. 2020;24(5):422–427. 10.1016/j.bjid.2020.08.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Vogels CBF, Watkins AE, Harden CA, et al. : SalivaDirect: A simplified and flexible platform to enhance SARS-CoV-2 testing capacity. Med (N Y). 2021;2(3):263–280.e6. 10.1016/j.medj.2020.12.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Wise J: Covid-19: Lateral flow tests miss over half of cases, Liverpool pilot data show. BMJ. 2020;371:m4848. 10.1136/bmj.m4848 [DOI] [PubMed] [Google Scholar]
  37. Wyllie AL, Fournier J, Casanovas-Massana A, et al. : Saliva or Nasopharyngeal Swab Specimens for Detection of SARS-CoV-2. N Engl J Med. 2020;383(13):1283–1286. 10.1056/NEJMc2016359 [DOI] [PMC free article] [PubMed] [Google Scholar]
HRB Open Res. 2021 Aug 31. doi: 10.21956/hrbopenres.14541.r29961

Reviewer response for version 1

Mario A Rodríguez-Pérez 1, Luis Mario Rodríguez-Martínez 2, Sofia Nohemí Rodríguez-Flores 3

General comments

The present study compares NPS and Saliva as a COVID-19 sample source. The study included the diagnosis of a “cohort” of 127 symptomatic participants and 181 asymptomatic participants with COVID-19; however, it is not clear how many samples were taken per patient, the date (day), and the viral loads expressed as CTs. Figure 2 depicts that the sampling was conducted several times; however, in fragments of the writing text it appears that only one sample was taken per participant; thus, it would not be a cohort as it is from a longitudinal study.  Instead, this study would be cross-sectional since the sample was taken per participant in a single moment.  The authors should clarify which is correct.

The number of samples evaluated of 308 is enough to widely support the findings: 94.3% sensitivity and specificity of 95.9%.

In this comparison study, the authors have evaluated two systems:  Firstly, the CDC protocols using RT-qPCR with N1, N2 genes, and RP for SARS-CoV-2; Secondly, if the sample was not concordant in its result, it was evaluated with the TaqPath COVID-19 CE-IVD RT-PCR kit, which uses the ORF, N, and S genes as a confirmatory test. Finally, this implied a robust and reliable result; this was done for the 14 non concordant (discordant) samples found.

Particular comments and edits

Methods

Saliva sample processing

“Briefly, 50 µl of each saliva sample was added to 2.5 µl of proteinase K”- Mention the concentration or units of proteinase K added and Brand.

Mention about RT-qPCR cycle changes with NPS and saliva.

“RNA extraction from saliva and SarS-CoV-2 detection using TaqPath COVID-19 CE-IVD RT-PCR Kit”. Correct in subtitle "SarS-CoV-2" to "SARS-CoV-2"

Results

“Sensitivity (95% CI 5-100%) and specificity (95% CI 97.9-100%) were, therefore, both 100% in this cohort.”

95%-CIs surrounding the point estimator of sensitivity is too wide (5-100%). Re-calculate values or clarify.

Table 2 could be improved, for example, place 3 columns indicating detection method, positive, and negative. Transfer results of NPS into a row.

Figure 2 in the Y-axis named as "Sensitivity" correct to "Sensitivity (%).

In the Figure´s legend, instead of "Sensitivity (in%) ..." correct to "Percentage of sensitivity ..."

Discussion

Discuss what it may imply that by testing saliva this does not meet the established requirements (smoking, drinking fluids, etc.)

It should be compared to currently used methods for rapid detection showing over 90% sensitivity.  Why use SalivaDirect and not those?

Did the authors notice any disadvantages of using the SalivaDirect? If so, discuss it.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Epidemiology

We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

HRB Open Res. 2021 Oct 1.
Chiara De Santi 1

We thank the reviewers for their summary, comments and suggestions. Please find a point-by-point answer to the reviewers' queries below:

General comments

The present study compares NPS and Saliva as a COVID-19 sample source. The study included the diagnosis of a “cohort” of 127 symptomatic participants and 181 asymptomatic participants with COVID-19; however, it is not clear how many samples were taken per patient, the date (day), and the viral loads expressed as CTs. Figure 2 depicts that the sampling was conducted several times; however, in fragments of the writing text it appears that only one sample was taken per participant; thus, it would not be a cohort as it is from a longitudinal study. Instead, this study would be cross-sectional since the sample was taken per participant in a single moment. The authors should clarify which is correct.

The number of samples evaluated of 308 is enough to widely support the findings: 94.3% sensitivity and specificity of 95.9%.

In this comparison study, the authors have evaluated two systems: Firstly, the CDC protocols using RT-qPCR with N1, N2 genes, and RP for SARS-CoV-2; Secondly, if the sample was not concordant in its result, it was evaluated with the TaqPath COVID-19 CE-IVD RT-PCR kit, which uses the ORF, N, and S genes as a confirmatory test. Finally, this implied a robust and reliable result; this was done for the 14 non concordant (discordant) samples found.

Answer: We thank the reviewer for their summary and comments. In response to the comment on the longitudinal vs cross-sectional study definition, we have now added explanatory sentences both in the methods and results section. Briefly, the symptomatic cohort consisted of inpatients who provided a first NPS sample on admission to hospital (tested in the hospital laboratories). They were recruited to the study while in hospital and provided a second NPS sample on the same day as the saliva sample, both available for research purposes/the current study. Therefore, we consider this section of the work a longitudinal study. However, the asymptomatic cohort (students) only provided one same day NPS/saliva sample during their appointment as per routine in-house screening at our University (RCSI).

Methods

Saliva sample processing

“Briefly, 50 μl of each saliva sample was added to 2.5 μl of proteinase K”- Mention the concentration or units of proteinase K added and Brand.

Answer : This detail has now been added to the methods section text.

Mention about RT-qPCR cycle changes with NPS and saliva.

Answer: The comparison between Cts from concordant NPS and saliva samples (for the symptomatic cohort) is addressed in the results section (“We next compared the Ct values of the concordant positive saliva and NPS samples (Figure 1A) in the symptomatic cohort…”) and shown in Figure 1. Although we did observe strong correlation between the Ct values in NSP and saliva as expected from the literature, we did not see significant differences in Ct count as other relevant publications have reported. This point has not been added to the discussion section, where we mention that it should be noted that we tested for different viral genes for NPS ( RdRp) and saliva ( N1).

“RNA extraction from saliva and SarS-CoV-2 detection using TaqPath COVID-19 CE-IVD RT-PCR Kit”. Correct in subtitle "SarS-CoV-2" to "SARS-CoV-2"

Answer: This has now been changed in the method section.

Results

“Sensitivity (95% CI 5-100%) and specificity (95% CI 97.9-100%) were, therefore, both 100% in this

cohort.” 95%-CIs surrounding the point estimator of sensitivity is too wide (5-100%). Re-calculate values or

clarify.

Answer: The 95%-CIs surrounding the sensitivity ( CI 5-100%) is correctly calculated. The wide interval is to be expected given that only one student tested positive in our asymptomatic cohort. We acknowledge in the discussion the limited value of this sensitivity value. We therefore combined the two cohorts of symptomatic and asymptomatic for the overall sensitivity (94.3%; 95% CI 87.2-97.5%) and specificity values (95.9%; 95% CI 92.4-97.8%).

Table 2 could be improved, for example, place 3 columns indicating detection method, positive, and negative. Transfer results of NPS into a row.

Answer: The data in Table 2 regarding sensitivities and sensitivities of SalivaDirect when compared to NPS are presented in the same format as presented in several publications (Skolimowska et al., 2020; Braz-Silva et al., 2020; Mahmoud et al., 2021; Pasomsub et al., 2021 etc) and we think that consistency allows for the easiest comparison of various tests for the readers.

Figure 2 in the Y-axis named as "Sensitivity" correct to "Sensitivity (%). In the Figure´s legend, instead of "Sensitivity (in%) ..." correct to "Percentage of sensitivity ..."

Answer: The suggested changes have been made to figure 2 and associated legend.

Discussion

Discuss what it may imply that by testing saliva this does not meet the established requirements (smoking, drinking fluids, etc.).

Answer: Smoking, drinking any liquids, food, nasal sprays, tooth brushing and/or mouth washing might affect the quality of the saliva sample and/or the validity of the saliva testing. For example, the use of mouth wash was shown to reduce the viral load in saliva samples (Seneviratne et al., 2021) and therefore using mouth wash prior to providing a saliva sample should be avoided. Presence of food, mucus and residues such as those from brushing teeth or smoking can decrease the quality of the samples and prove their handling more difficult due to particles presence in the saliva. A sentence about the effects of these activities on saliva testing has now been added to the method section.

It should be compared to currently used methods for rapid detection showing over 90% sensitivity. Why use SalivaDirect and not those?

Answer: We thank the reviewer for this comment. In the general context, it has been well established that rapid antigen testing have a high sensitivity (over 90%) in case of high viral load/low Ct values (although antigen approaches were not tested in parallel in our cohorts). For example, Van der Moeren and co-authors showed that BD Veritor System for Rapid Detection of SARS-CoV-2 has an overall sensitivity of 78.9% and reaching 93% for samples with Cts lower than 30 (Van der Moeren N, et al. PLoS One. 2021. PMID: 33983971). In another study, Fernandez-Montero reported a sensitivity of Roche SARS-CoV-2 Rapid Antigen Test of 71.43%, which increases to 93.75% when Cts were lower than 25 (Fernandez-Montero et al., EClinicalMedicine. 2021 Jul;37:100954. doi: 10.1016/j.eclinm.2021.100954, PMID: 34127960). In our hands the sensitivity of saliva testing compared to NPS was maintained for high Cts – it was 100% for Cts in NPS lower than 30, and, as reported in our manuscript, 94.3% overall. But most importantly, the rapid antigen tests currently available still required a nasopharyngeal swab (often self-administered in case of asymptomatic screening programmes) which is widely perceived as uncomfortable and linked to coughing, sneezing, headache which can be a barrier to repeated testing (for example with younger students). Therefore, we propose PCR-based saliva testing as a valid alternative to NSP, especially when employing SalivaDirect protocol which skips the RNA extraction step (thereby saving money and time), is a relatively cheap and accurate method to detect SARS-CoV-2, especially for those individuals who will require repeated testing. Moreover, reproducible finding of PCR-based saliva testing is a prerequisite to developing and validating rapid antigen saliva tests, which so far haven’t reached satisfactory diagnostic performance (Nagura-Ikeda et al., J Clin Microbiol. 2020 Aug 24;58(9):e01438-20; Audigé et al., Microorganisms. 2021 Aug 10;9(8):1700). We have now added a sentence in the discussion section that reinforce the advantages of this approach for PCR-based SARS-CoV-2 testing.

Did the authors notice any disadvantages of using the SalivaDirect? If so, discuss it.

Answer: We found no significant disadvantage in using SalivaDirect compared to RNA extraction-based saliva testing. However we did notice that the handling of the saliva samples was more challenging than the NPS (they were more gloopy, the colour and density varied greatly among the samples). We have now mention this in the methods section.

HRB Open Res. 2021 Aug 19. doi: 10.21956/hrbopenres.14541.r30007

Reviewer response for version 1

Stephanie Russo Perniciaro 1

This paper describes and contextualizes the results of a study comparing nasopharyngeal swab samples for SARS-CoV-2 detection with saliva samples for SARS-CoV-2 detection. The authors enrolled a symptomatic cohort and an asymptomatic cohort, and observed high concordance between nasopharyngeal swabs and saliva samples. Out of ~300 total samples, 14 were discordant. The sensitivity and specificity of saliva testing with the SalivaDirect protocol were high, similar to other studies of the implementation of this low-cost protocol.

The authors' analysis is thorough and appropriate for the data. Having only one person with a positive test in one of the two study cohort populations makes full generalizability of the results difficult, but the authors address this and contextualize it appropriately.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Epidemiology, infectious diseases, respiratory infections

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    DRYAD: Concordance between PCR-based extraction-free saliva and nasopharyngeal swabs for SARS-CoV-2 testing, https://doi.org/10.5061/dryad.ksn02v74n ( De Santi, 2021)

    This project contains the following underlying data:

    • 1.

      Ct_values_for_matched_NPS_and_saliva_samples_(asymptomatic_cohort).xlsx.This table shows the Ct values of N1 (both for NPS and saliva) in the samples belonging to the asymptomatic cohort (n=181 students).

    • 2.

      Ct_values_for_matched_NPS_and_saliva_samples_(symptomatic_cohort).xlsx. This table shows the Ct values of RdRp (NPS) and N1 (saliva) in the samples belonging to the symptomatic cohort (n=127 hospitalised symptomatic individuals).

    Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).


    Articles from HRB Open Research are provided here courtesy of Health Research Board Ireland

    RESOURCES