Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Feb 25;17(2):e0264130. doi: 10.1371/journal.pone.0264130

Sample-to-answer, extraction-free, real-time RT-LAMP test for SARS-CoV-2 in nasopharyngeal, nasal, and saliva samples: Implications and use for surveillance testing

Kathryn A Kundrod 1,#, Mary E Natoli 1,#, Megan M Chang 1,#, Chelsey A Smith 1, Sai Paul 1, Dereq Ogoe 2, Christopher Goh 2, Akshaya Santhanaraj 2, Anthony Price 3, Karen W Eldin 4, Keyur P Patel 5, Ellen Baker 3, Kathleen M Schmeler 3, Rebecca Richards-Kortum 1,*
Editor: A M Abd El-Aty6
PMCID: PMC8880874  PMID: 35213596

Abstract

The global COVID-19 pandemic has highlighted the need for rapid, accurate and accessible nucleic acid tests to enable timely identification of infected individuals. We optimized a sample-to-answer nucleic acid test for SARS-CoV-2 that provides results in <1 hour using inexpensive and readily available reagents. The test workflow includes a simple lysis and viral inactivation protocol followed by direct isothermal amplification of viral RNA using RT-LAMP. The assay was validated using two different instruments, a portable isothermal fluorimeter and a standard thermocycler. Results of the RT-LAMP assay were compared to traditional RT-qPCR for nasopharyngeal swabs, nasal swabs, and saliva collected from a cohort of patients hospitalized due to COVID-19. For all three sample types, positive agreement with RT-LAMP performed using the isothermal fluorimeter was 100% for samples with Ct <30 and 69–91% for samples with Ct <40. Following validation, the test was successfully scaled to test the saliva of up to 400 asymptomatic individuals per day as part of the campus surveillance program at Rice University. Successful development, validation, and scaling of this sample-to-answer, extraction-free real-time RT-LAMP test for SARS-CoV-2 adds a highly adaptable tool to efforts to control the COVID-19 pandemic, and can inform test development strategies for future infectious disease threats.

Introduction

The global COVID-19 pandemic caused by the SARS-CoV-2 virus has demonstrated the need for highly accessible diagnostic and surveillance tests. Testing is a critical component of effective pandemic response and is used to identify outbreaks, inform contact tracing efforts, and contain viral spread. Diagnostic testing on individuals with suspected infections is necessary to provide appropriate clinical care and to maintain separation between individuals with and without confirmed SARS-CoV-2 infections, especially in hospital settings. In addition, SARS-CoV-2 transmission by individuals who are asymptomatic requires routine population-level surveillance for effective outbreak containment when rates of community transmission are high. Accordingly, SARS-CoV-2 testing capacity had to scale quickly to meet massive global demands.

The first diagnostic tests that received Emergency Use Authorization (EUA) from the United States Food and Drug Administration (U.S. FDA) were based on RT-qPCR, the standard-of-care method for detecting viral RNA. Traditionally, RT-qPCR testing requires sample collection into an appropriate medium, RNA extraction, and RT-qPCR reaction assembly prior to running the test on a thermocycler. Shortly after RT-qPCR testing became available across the country, supply shortages of sample collection kits, RNA extraction kits, RT-qPCR reagents, automated laboratory liquid handlers, and thermocyclers were common and unpredictable. Traditional RT-qPCR remains the standard-of-care method for SARS-CoV-2 diagnosis, but given the supply chain challenges and infrastructure required, alternative methods for surveillance were desirable.

A few key findings related to SARS-CoV-2 transmission cleared a path for alternatives to traditional RT-qPCR for surveillance testing. First, epidemiologic modeling indicated that test frequency mattered more than test sensitivity for effective outbreak prevention [13]. In addition, data showed “super-spreading”, or transmission from presymptomatic or asymptomatic individuals with high viral loads, was a major driver of outbreaks [46]. Finally, test results from alternative specimen types like saliva were shown to correlate well with results from nasopharyngeal swabs and to be better indicators of infectivity [711]. Together, these findings informed the most critical goals of a SARS-CoV-2 surveillance program: frequent testing to detect asymptomatic individuals with high viral loads, and the flexibility to use alternative specimen types and methods that avoid the supply chain shortages associated with RT-qPCR.

Isothermal nucleic acid amplification technologies are a promising alternative to RT-qPCR due to their speed, reduced instrumentation requirements, and robustness to sample inhibitors. Of existing isothermal amplification methods, loop-mediated isothermal amplification (LAMP) is the most widely used globally [12]. Soon after SARS-CoV-2 sequences were published at the onset of the COVID-19 pandemic, scientists quickly developed reverse transcription LAMP (RT-LAMP) assays [1317] and started global collaborations to develop and implement RT-LAMP for SARS-CoV-2 surveillance testing [18]. Given the high sensitivity, specificity, and concordance with RT-qPCR, RT-LAMP has been established as an effective tool to detect SARS-CoV-2, and has been incorporated into several tests that received EUA from the U.S. FDA [1924]. However, existing RT-LAMP tests include complicated workflows that require RNA extraction [16, 2528] or risk environmental cross-contamination [29], are costly [30], and/or have been validated with limited sample types and patient populations [17, 25, 27, 3134], thus limiting their flexibility and adoption in at-scale surveillance testing.

Here, we present an RT-LAMP test for SARS-CoV-2 with a sample-to-answer workflow optimized for use with saliva, nasal, or nasopharyngeal swabs that can be performed with a standard thermocycler or portable isothermal fluorimeter. The test uses a simple lysis and inactivation protocol adapted from Rabe and Cepko [17] and provides results in <1 hour using inexpensive and readily available reagents. Test performance was compared to that of RT-qPCR using nasopharyngeal swabs, nasal swabs and saliva obtained from patients hospitalized due to COVID-19. Following test validation, we piloted a saliva-based RT-LAMP testing program at Rice University and transitioned to a surveillance testing program. Between August 2020 and October 2021, up to 400 individuals were tested per day. The simple workflow, reliance on more readily available reagents, and effective detection of high viral load samples indicate that the optimized RT-LAMP assay presented here is an effective strategy for SARS-CoV-2 surveillance.

Materials and methods

Oligonucleotide primers and probes

The oligonucleotide primers for the SARS-CoV-2 RT-LAMP assay were the N2 and E1 primer sets designed by New England Biolabs, Inc. [35] and the Orf1a-HMSe (As1e) primer set designed by Rabe and Cepko [17], which target the N, E, and ORF1a genes. The ACTB primer set designed by New England Biolabs, Inc [35] to amplify the human beta actin gene was used as an extraction control. Primers were ordered from Integrated DNA Technologies (IDT) (Coralville, IA) either individually, or as a custom mix prepared by IDT using the same methods. FIP and BIP primers were HPLC-purified, and all remaining primers underwent standard desalting purification by IDT. Primers were resuspended in 1X TE buffer at a 1 mM concentration and combined to make a 25X mix consisting of 40 μM FIP and BIP, 5 μM F3 and B3, and 10 μM LF and LB in 1X TE buffer. 2019-nCOV CDC primer and probe mixes were purchased in EUA or RUO kits from IDT, and were used interchangeably in RT-qPCR.

Target preparation and storage

Synthetic viral RNA from Twist Biosciences (San Francisco, CA, SKU 102019) was used as a positive control in RT-LAMP and RT-qPCR. Upon receipt, the concentration of control RNA obtained from Twist was determined by RT-qPCR using SARS-CoV-2 genomic RNA as a reference standard (ATCC®, Manassas, VA, VR-1991D), and the RNA was stored in single-use 5 μL aliquots at -80°C until use. Aliquots were diluted in nuclease-free water unless otherwise noted, kept on ice, and used within four hours of dilution.

NATtrol SARS-Related Coronavirus 2 (Zeptometrix, Buffalo, NY, NATSARS(COV2)-ST) was used as a pseudovirus control to assess the performance of candidate lysis buffers and the limit of detection of the RT-LAMP assay, and as a positive control for lysis during clinical sample testing. Pseudovirus was diluted to desired concentrations in nuclease-free water or an appropriate biological matrix before use.

Hs_RPP30 Positive Control plasmid from IDT was used as a positive control in RT-qPCR for the human RNase P assay, and human mixed gender genomic DNA (gDNA) (Promega, Madison, WI) was used as a positive control in the RT-LAMP beta actin assay. Positive controls were stored at 4°C (NATtrol pseudovirus), or in single-use aliquots at ≤ -20°C (Hs_RPP30 and gDNA), and diluted in nuclease-free water before use.

RT-LAMP reactions

All RT-LAMP reagents were purchased from New England Biolabs (NEB, Ipswich, MA). Twenty-five μL RT-LAMP reactions to detect SARS-CoV-2 contained 12.5 μL of 2X E1700 Master Mix, 1 μL of 25X N2 primer mix, 1 μL of 25X E1 primer mix, and 0.5 μL of 50X fluorescent dye (NEB B1700). Unless otherwise noted, reactions also contained 1 μL of 25X As1e primer mix. RT-LAMP reactions to detect beta actin contained 12.5 μL of 2X E1700 Master Mix, 1 μL of 25X ACTB primer mix, and 0.5 μL of 50X fluorescent dye. All reactions contained 5 μL of sample unless otherwise noted, and reactions were supplemented with nuclease-free water to reach a final reaction volume of 25 μL. Reactions were run at 65°C for 45 minutes in a Bio-Rad CFX96 thermocycler with heated lid set to 105°C, and fluorescence measurements were taken every 10 seconds on the SYBR channel. Fluorescent drift baseline correction was applied to all data, and data were analyzed using the Bio-Rad CFX Maestro Software for CFX Real-Time PCR Instruments.

For RT-LAMP reactions run on the Axxin T8-ISO (T8), assay components described above were doubled to achieve 50 μL reaction volumes with two exceptions [36]: fluorescent dye was used at a 5X concentration instead of 50X [37], and 0.2 μL of Tte UvrD helicase (NEB) was included with each reaction [38, 39]. Reactions contained 10 μL of sample unless otherwise noted. Reactions were assembled in clear high-profile 8-tube strips, overlaid with 25 μL of molecular-grade mineral oil (Sigma Aldrich, St Louis, MO, 69794) and sealed with domed caps (Bio-Rad, Hercules, CA). Reactions were incubated at 65°C on the Axxin T8 for 45 minutes, and fluorescence readings were taken every 10 seconds on the FAM channel, which was set to 7% PWM.

RT-qPCR reactions

RT-qPCR reactions were set up using the Applied Biosystems TaqMan RNA-to-Ct 1-Step Kit (ThermoFisher, Waltham, MA) and 2019-nCov CDC EUA N1, N2, or RPP combined primer/probe mix (IDT). Each reaction contained 10 μL 2X RT-PCR Mix, 0.5 μL 40X RT Enzyme Mix, 1.5 μL combined primer/probe mix, 3 μL nuclease-free water, and 5 μL purified RNA template. Thermal cycling was performed according to manufacturer instructions, and amplification data were analyzed using the Bio-Rad CFX Maestro Software for CFX Real-Time PCR Instruments.

Clean reaction setup

All amplification reactions were assembled and sealed prior to amplification in a dedicated pre-amplification room that was regularly decontaminated with bleach and RNaseAway (ThermoFisher) and had limited personnel access. Stringent training was implemented for laboratory personnel, separate filtered pipette tips were used for all materials, and gloves were changed frequently. Once reactions were run, reaction tubes were disposed of, without being opened, to prevent post-amplification contamination of future reactions.

Lysis buffer optimization

Lysis buffer preparation

All lysis buffer reagents were of molecular or reagent grade. First, a concentrated TCEP/EDTA/NaOH buffer, adapted from Rabe and Cepko [17], was prepared as follows: 358 mg of TCEP-HCl (Millipore Sigma, Burlington, MA, 580567) were dissolved in 568 μL of nuclease-free water, and 1 mL of 0.5 M EDTA, pH = 8 (ThermoFisher AM9260G) was added. A 7 M GuHCl solution was prepared by adding 2,009 mg GuHCl (Promega H5381 or H5383, used interchangeably) to 1.5 mL nuclease-free water and adding additional nuclease-free water to a final volume of 3 mL. Next, 575 μL of 10 N NaOH (Fisher Scientific, Pittsburgh, PA, SS267) and 2,009 μL of 7 M GuHCl were added to the TCEP/EDTA solution, yielding 5 mL of 100X lysis buffer with 250 mM TCEP, 100 mM EDTA, 1.15 N NaOH, and 4 M GuHCl. Performance of the TCEP-based lysis buffer was evaluated at concentrations of 1X, 2X, 5X, and 10X, with and without the addition of GuHCl. For clinical sample collection, 100X lysis buffer with GuHCl was diluted 1:20 in nuclease-free water to yield 5X lysis buffer. All solutions were sterile-filtered through a 0.2-micron filter (Pall Life Sciences, Port Washington, NY, Acrodisc 4652), then stored at 4°C for up to 7 days. pH was measured for each batch, and a pH value less than 9.0 was considered adequate. If the buffer pH was greater than or equal to 9.0, all buffer reagents were replaced, and a new batch was prepared.

Lysis efficiency evaluation

Self-collected nasal swabs from asymptomatic donors were obtained with written informed consent under a protocol approved by the Rice University Institutional Review Board (2020–354). Nasal swabs were placed into 500 μL of nuclease-free water and vortexed for 20 seconds. Nasal swab eluate from at least five swabs were pooled to simulate a patient sample. Nasal swab eluate was spiked with Zeptometrix pseudovirus and combined with 100X lysis buffer and 7 M GuHCl to simulate 50 copies/μL and effective concentrations of 1X, 2X, 5X, or 10X lysis buffer components with a final effective concentration of either 0 or 200 mM GuHCl. In conditions without GuHCl, an appropriate volume of water was added such that nasal eluate volumes were consistent across conditions. Spiked samples in each candidate buffer were heat inactivated at 95°C for 5 minutes, then column purified using the RNeasy Mini kit (Qiagen, Hilden, Germany) following the manufacturer’s protocol for RNA cleanup with two modifications: PBS was substituted for Buffer RLT, and 15 second spin steps were increased to 1 minute. In the final step of the extraction protocol, RNA was eluted into 50 μL of nuclease-free water, then amplified using the 2019-nCov CDC EUA N1 RT-qPCR assay as described above. Ct values from baseline-subtracted, curve-fit data were determined by the Bio-Rad CFX Maestro software.

RNase activity evaluation

RNase activity of heat-inactivated spiked nasal samples was evaluated using the RNaseAlert QC Kit v2 (ThermoFisher) according to manufacturer instructions. Briefly, 10 μL of 10X RNaseAlert Lab Test Buffer, 10 μL of RNaseAlert substrate, 10 μL of sample, and 70 μL of nuclease-free water were combined in each well of an opaque-bottom black 96-well plate (Corning 3915). Negative (nuclease-free water) and positive (5 μL RNase A) controls were included. Samples were incubated in a BioTek Cytation 5 Cell Imaging Multi-Mode Reader at 37°C, and real-time fluorescence data (Ex: 490 nm, Em: 520 nm) were collected at 5 minute intervals for a period of 1 hour. Data at the 1 hour timepoint were analyzed.

Limit of detection

The limits of detection of the RT-LAMP assay were assessed by diluting Zeptometrix pseudovirus in pooled negative nasopharyngeal matrix or pooled negative saliva. Pooled negative nasopharyngeal matrix was generated from 10 nasopharyngeal swabs that were confirmed negative by a clinical laboratory using the Cepheid Xpert System SARS-CoV-2 real-time PCR, or Applied Biosystems TaqPath COVID-19 real-time PCR tests using the MagNA Pure 24 Total NA Isolation Kit (Roche Molecular Systems, 07658036001). Each of these swabs was collected into 300 μL of 5X lysis buffer. Pooled saliva was generated by combining equal volumes of passive drool collected from 5 asymptomatic donors under a protocol approved by the Rice University Institutional Review Board (2020–354), and confirmed negative by RT-LAMP. Spiked samples prepared in nasopharyngeal matrix were diluted to concentrations of 1–10 copies/μL, vortexed for 20 seconds, then heat inactivated at 95°C for 5 minutes. Spiked samples prepared in pooled saliva were combined 20:1 with 100X lysis buffer and 7 M GuHCl to achieve an effective 5X lysis buffer concentration, 200 mM GuHCl, and 2–20 copies/μL, then vortexed for 20 seconds and heat inactivated at 95°C for 6 minutes. All samples were kept on ice before being input into RT-LAMP reactions for amplification on either the Bio-Rad CFX96 or the Axxin T8. Twenty replicates of each concentration were tested, and the percentage of replicates with positive amplification was calculated at each concentration. Probit analysis was then used to determine the limit of detection. Dose-effect functions were fit by XLSTAT for Microsoft Excel (Addinsoft, New York, NY) and the limit of detection was defined as the concentration for which there was a 95% detection probability.

Participant samples

Enrollment and sample collection from inpatients at Lyndon B. Johnson (LBJ) Hospital

Nasopharyngeal, nasal, and saliva specimens were collected from hospitalized participants at Lyndon B. Johnson (LBJ) Hospital after obtaining written informed consent under a protocol reviewed and approved by The University of Texas MD Anderson Cancer Center, Harris Health and Rice University Institutional Review Boards (2020–0318). Participants were eligible if they (1) qualified for SARS-CoV-2 testing according to institutional criteria at the time of enrollment; (2) were willing and able to provide informed consent; (3) were able to perform protocol-required activities; and (4) were able to speak and read English or Spanish. All participants had confirmed SARS-CoV-2 infections by a hospital RT-qPCR test on a nasopharyngeal sample within 72 hours of enrollment in our study. In some cases, participants were enrolled before their hospital RT-qPCR test result was returned; if the result was negative, the participant was excluded from analysis.

Nasopharyngeal sampling was performed by a single provider using the methods described by Marty et al. [40] and remained consistent throughout the study. Briefly, swabs were held in place at the back of the nasopharynx for several seconds, then slowly removed while rotating. Nasal and saliva collection methods were optimized using samples from the first 41 participants enrolled in our study. Various nasal collection strategies were tested, which included self-collection or provider-collection, sampling one nostril or both nostrils, and sampling each nostril 5 or 10 times. Saliva collection strategies consisted of collection of drool directly into a pre-aliquoted volume of lysis buffer, either with swabs, sponges, or passive drool, and collecting saliva by passive drool into a sterile tube and subsequently metering the volume of saliva combined with lysis buffer.

Nasopharyngeal swabs were collected into 1.5 mL sterile Sarstedt screw-top tubes (Nümbrecht, Germany) containing 300 μL of 5X lysis buffer. Nasal samples were collected into 2 mL sterile Sarstedt screw-top tubes containing 500 μL of 5X lysis buffer. Due to the shape of the swabs, a different tube and slightly more volume was required to fully submerge the nasal swabs compared to the nasopharyngeal swabs. Following collection, the shaft of the collection swab was cut at the height of the tube, and the tube was closed. Saliva samples were collected by passive drool into empty sterile tubes, unless otherwise indicated. All samples were stored in coolers with ice packs until arrival at the testing lab, which was within four hours of collection.

Processing of samples collected at LBJ Hospital

Upon receipt, nasopharyngeal and nasal samples were vortexed for 20 seconds and heated in a heat block at 95°C for 5 minutes. Saliva samples collected into lysis buffer were processed similarly, but heating was extended to 6 minutes. Raw saliva samples collected without lysis buffer were combined 20:1 with 100X lysis buffer containing GuHCl, vortexed for 20 seconds, and heated at 95°C for 6 minutes. Samples were kept on ice following heat inactivation until testing. For each sample, three replicates were tested in RT-LAMP on the Bio-Rad CFX96, and one replicate was tested in RT-LAMP on the Axxin T8. All experiments in which patient samples were tested included a positive control of synthetic RNA prepared in 5X lysis buffer at 10–100 copies/μL, and a no-template control using water. After saliva processing conditions were optimized, a lysis control of Zeptometrix pseudovirus in pooled saliva (Innovative Research, Novi, Michigan) was also included.

To quantify Ct values of all samples collected at LBJ Hospital, RNA was extracted from 200 μL of each heat-inactivated clinical sample using the PureLink Viral RNA/DNA Mini Kit (Invitrogen, Carlsbad, CA) according to manufacturer’s instructions. Carrier RNA was not included in the extraction and purification procedure. Purified RNA was eluted in 50 μL nuclease-free water, then amplified in the 2019-nCov CDC EUA N1, N2, and RPP RT-qPCR assays with both no-template controls and positive SARS-CoV-2 (Twist RNA) and RPP plasmid controls (IDT). Ct values from baseline-subtracted, curve-fit data were determined by the Bio-Rad CFX Maestro software.

Following initial testing, all samples were stored at -80°C, and samples used for retesting underwent a maximum of 3 freeze-thaw cycles.

Enrollment and sample collection from asymptomatic individuals undergoing surveillance testing

Members of the Rice University community without symptoms of COVID-19 underwent weekly or twice-weekly surveillance testing per university guidelines beginning in August 2020. To evaluate the performance of the developed RT-LAMP test when implemented in a high-throughput format, members of the Rice University community were offered the opportunity to complete their testing requirement by enrolling in a research protocol that was reviewed and approved by the Rice University Institutional Review Board (2021–28). Eligible participants included Rice University students, staff, or faculty who were not exhibiting symptoms of COVID, had no history of a positive nucleic acid, antigen, or antibody test result for SARS-CoV-2, and were willing and able to provide informed consent.

Following initial evaluation of the high-throughput RT-LAMP test, the test was piloted and then offered routinely as one of several options available to Rice University individuals for required campus-wide surveillance testing, following guidelines for universities established by the Centers for Medicare and Medicaid Services [41]. For minors, authorization was provided by the minor, parent or guardian.

Participants visited a dedicated collection site, where staff assisted in completing written informed consent forms during the piloting phase, or written testing authorization forms during the surveillance phase. Participants then provided saliva samples by passive drool into a barcoded, sterile 5 mL tube (MTC Bio or Eppendorf) and placed their barcoded sample into a cooler with ice. Samples remained on ice for up to four hours before they were transported to a high-throughput RT-LAMP lab for testing.

High-throughput RT-LAMP setup

The high-throughput lab was equipped with four Hamilton Microlab Prep instruments and four Bio-Rad CFX96 thermocyclers. Saliva samples were combined with lysis buffer and inactivated manually, using the same heating methods as described above. RT-LAMP master mix was prepared and manually plated into 96-well plates. Plates were placed onto Isofreeze cold blocks (Thomas Scientific, 1148D62) for the duration of assay setup. Inactivated samples were added to RT-LAMP master mix by a Hamilton Microlab Prep within 30 minutes of the time that the master mix was prepared. The Microlab Prep liquid handler was programmed to transfer 5 μL of inactivated saliva from each participant into a distinct master-mix containing well on a 96-well plate. The transfer step included mixing by pipetting during the transfer. The plate was sealed manually with an optically-clear MicroSeal B PCR plate sealing film (Bio-Rad MSB1001), spun in a plate quick-spin centrifuge for 30 seconds (Fisherbrand 14-955-300), and placed onto the Bio-Rad CFX96 for amplification and detection using the same settings previously described for RT-LAMP reactions.

One replicate was run per-person, and any suspected positives were re-run in triplicate. Samples were determined to be positive or negative using the algorithm described in the Data analysis section below. Participants with a positive saliva RT-LAMP test were scheduled for a confirmatory nasal RT-qPCR test from a contracted testing partner.

With every run of the SARS-CoV-2 assay, a subset of participant samples was also tested in the beta actin RT-LAMP assay as a plate and process control designed to help identify issues like sample degradation during transport, insufficient lysis, or LAMP reagent quality deterioration. If greater than 20% of participant samples included in the beta actin assay failed to amplify, lysis buffer was discarded and re-prepared with fresh reagents.

Study data, including consent forms, participant information, and test results, were collected and managed using REDCap (Research Electronic Data Capture version 10.9.2) electronic data capture tools hosted at The University of Texas MD Anderson Cancer Center or Rice University [42, 43]. REDCap is a secure, web-based software platform designed to support data capture for research studies, providing 1) an intuitive interface for validated data capture; 2) audit trails for tracking data manipulation and export procedures; 3) automated export procedures for seamless data downloads to common statistical packages; and 4) procedures for data integration and interoperability with external sources.

The unused portion of all samples was stored at -80°C, and samples used for retesting underwent a maximum of 3 freeze-thaw cycles [44].

Data analysis

Bio-Rad CFX96 RT-LAMP data

For all RT-LAMP data acquired on Bio-Rad thermocyclers, fluorescent drift baseline correction was applied to baseline-subtracted, curve-fit data by the Bio-Rad CFX Maestro Software. In some cases, fluorescent drift baseline correction resulted in negative slopes. In these cases, Ct values from uncorrected fluorescence data were used in subsequent analysis. Reactions given a Ct value by the software prior to the end of the incubation period were considered positive. Samples tested in triplicate were considered positive if all three replicates were given a Ct value, or negative if none of the three replicates were given a Ct value. If one or two of three replicates were given a Ct value, the following algorithm was applied: (1) If any of the three replicates amplified before 30 minutes (< 81 cycles), the sample was considered positive. (2) If at least one of the three replicates amplified between 30 and 45 minutes (81–121 cycles), both of the following conditions had to be met for the sample to be considered positive: (A) the melt curve derivative peak of at least one replicate was within 1°C of the melt curve derivative peak of a positive control run on the same plate and (B) the melt curve derivative remained positive between 65–70°C. (3) Otherwise, the sample was considered negative.

For high-throughput LAMP samples run with a single replicate, the sample was suspected positive if it amplified before 30 minutes, or if it amplified between 30 and 45 minutes and the melt curve derivative peak was within 1°C of the melt curve derivative peak of a positive control run on the same plate and the melt curve derivative remained positive between 65–70°C. Suspected positives were subsequently re-tested in RT-LAMP in triplicate, and the above algorithm was applied to determine positivity.

Axxin T8 RT-LAMP data

For all RT-LAMP data acquired on Axxin T8, baseline subtraction was applied to each reaction by averaging the raw fluorescence value between 2–5 minutes and subtracting the averaged value from all of the fluorescence data points from that reaction. Samples were considered positive if (1) the amplitude of the baseline-subtracted data reached > 500 millivolts (mV) between 5 and 45 minutes, and (2) the maximum slope of the baseline-subtracted data between 0 and 45 minutes was greater than 100 mV/s. Samples were considered negative if both conditions were not met. The time to positivity was defined as the time at which the amplitude of the baseline-subtracted data reached > 500 mV. Amplification curves in figures are shown with relative fluorescence units (RFU) for clarity, where 1 RFU = 1 mV as reported by the T8-ISO.

Statistical analyses

Data were initially analyzed using Microsoft Excel (version 16.48), then input into GraphPad Prism (version 9.1.0) for statistical tests and data visualization. 95% confidence intervals were calculated with the modified Wald method using GraphPad QuickCalc.

Results

Sample-to-answer workflow

The developed test combines extraction-free sample lysis and inactivation with isothermal amplification using RT-LAMP for real-time detection of SARS-CoV-2, and is suitable for testing in near point-of-care settings (Fig 1A–1F). In a near point-of-care use case, the test requires sample collection and lysis tubes, prepared lysis buffer, a heat block, pipettes, RT-LAMP reagents, and a real-time isothermal fluorimeter, such as the Axxin T8 (Fig 1A). Sample collection, inactivation, and amplification requires <5 user steps per sample, and results can be obtained in <1 hour. Moreover, the assay can be adapted to accommodate higher throughputs needed for population surveillance by incorporating automation and real-time thermocycling machines, such as the Bio-Rad CFX96 (Fig 1G–1M), while still maintaining rapid time to result. The higher throughput format of the developed RT-LAMP test was implemented in an asymptomatic surveillance population at Rice University.

Fig 1. Near point-of-care and high-throughput sample-to-answer workflows.

Fig 1

(A-F) Near point-of-care workflow. (A) Equipment and consumables needed to run the RT-LAMP assay, including saliva collection and lysis tubes, a heat block, pipettes, mineral oil, and a benchtop fluorimeter. A nasal swab and lysis tube (inset) can be substituted for saliva collection materials. To perform the test, (B) either a nasal swab or saliva sample is collected and combined with lysis buffer, then (C) the sample is heated at 95° C for 5 (nasal) or 6 (saliva) minutes. (D) The lysed sample is then added to RT-LAMP reagents and (E) reactions are sealed and placed in a benchtop fluorimeter and heated at 65° C for 45 minutes with real-time fluorescence monitoring. (F) Results are displayed after the full incubation period. (G-M) High-throughput saliva workflow. (G) Consumables and pipettes needed to run the RT-LAMP assay, excluding Hamilton robotics consumables. To perform the test, (H) lysis buffer and (I) saliva are combined and (J) heated at 95° C for 6 minutes. (K) RT-LAMP master mix is prepared and added to a 96-well plate. (L) Inactivated samples are added to RT-LAMP master mix by a Hamilton MicroLab Prep. The plate is sealed and (M) placed onto the Bio-Rad CFX96 for amplification and detection. Results are analyzed within the Bio-Rad Maestro software.

RT-LAMP primer set evaluation

First, a multiplexed RT-LAMP assay was validated using previously published primer sets N2, E1 and As1e targeting the N, E, and ORF1a genes, respectively. Recent literature suggests that the use of multiple primer sets in RT-LAMP increases sensitivity compared to single primer set reactions [45, 46], and that the use of N2/E1 and N2/E1/As1e can more than double the percentage of replicates that amplify at low viral loads [35]. Accordingly, we compared these multiplexed primer set combinations, and found that the two primer sets were comparably sensitive across all input concentrations tested. However, the combination of N2, E1, and As1e primer sets in RT-LAMP resulted in faster times to amplification, with a significant difference (p<0.001) seen at 50 input copies (S1 Fig). Thus, the triplex RT-LAMP assay was chosen due to its sensitivity, rapid time to amplification, and negligible increase in cost compared to the duplex RT-LAMP assay.

Lysis buffer evaluation

To circumvent expensive and time-intensive nucleic acid extraction steps for a simple sample-to-answer workflow, we developed an extraction-free lysis and inactivation protocol. Recent work has demonstrated that TCEP/EDTA buffers, in combination with heat treatment at 95°C, are effective at viral lysis and endogenous RNase inactivation, and render patient samples safe for downstream handling [17, 47, 48]. Further, GuHCl, another strong lysis reagent and RNase inactivation reagent [49, 50], has been shown to increase sensitivity and speed in RT-LAMP with our chosen primer sets [35]. Thus, we evaluated a TCEP/EDTA lysis buffer at a range of effective concentrations between 1X-10X, with and without GuHCl, combined with a heating step at 95°C for 5 minutes. We found that increasing buffer concentration resulted in a statistically significant increase in lysis efficiency, with 5X concentration achieving the most complete lysis (Fig 2A). Increasing lysis buffer concentration also led to more complete RNase inactivation, with the addition of 200 mM GuHCl leading to significantly more RNase inactivation (Fig 2B; p<0.0001). We concluded that a 5X concentration of lysis buffer with 200 mM GuHCl was optimal due to its efficient lysis and thorough inactivation of RNases. We validated that the buffer was well-tolerated for direct addition into LAMP by comparing time-to-amplification for RNA prepared in 5X lysis buffer with 200 mM GuHCl to that of RNA in nuclease-free water, and found that times-to-amplification were comparable (S2 Fig).

Fig 2. Lysis buffer evaluation and optimization.

Fig 2

Four lysis buffer concentrations (1X, 2X, 5X, and 10X) with and without 200 mM GuHCl were evaluated. Candidate buffers were combined with negative nasal swab eluate, spiked with Zeptometrix pseudovirus and heated at 95° C for 5 minutes. (A) Average Ct values resulting from lysed samples amplified in the CDC N1 RT-qPCR assay following column purification (± standard deviation; n = 6 for each condition). Significance determined using a two-way ANOVA with post-hoc Tukey’s test. (B) Average relative fluorescence values from lysed samples at the 1-hour timepoint of an RNase Alert assay (± standard deviation; n = 3 for each condition). Significance determined using two-way ANOVA. **** indicates p<0.0001, ** indicates p<0.01, * indicates p<0.05.

Given the challenges of obtaining nasopharyngeal swabs, the supply chain limitations for appropriate nasal swabs, and the emergence of saliva as a sensitive alternate specimen type, we next sought to adapt the lysis and inactivation protocol for saliva samples. However, initial experiments resulted in up to a 25-fold increase in the limit of detection for RT-LAMP with saliva samples relative to nasal and nasopharyngeal samples. We hypothesized that this higher limit of detection was due to a combination of incomplete lysis and a more inhibitory sample matrix. To investigate, we tested a range of heat times between 5 and 10 minutes using pooled saliva spiked with Zeptometrix at a concentration of 100 copies/μL. We found that heating times did not have a significant impact on time to amplification, but longer heat times did result in less variable time to amplification (S3 Fig). The least variable amplification time was seen when saliva was heated for 6–7 minutes at 95°C. To minimize hands-on sample processing time, 6 minutes was chosen as the heat time with saliva samples.

Limit of detection

Using the optimized lysis buffer and heating profiles, the limit of detection of the assay was found to be 20 virions per reaction on the Bio-Rad CFX 96 (Fig 3A) and 23 virions per reaction on the Axxin T8 (Fig 3B) in nasopharyngeal samples. In saliva, the limit of detection was 93 virions per reaction on the Bio-Rad CFX 96 (Fig 3C) and 116 virions per reaction on the Axxin T8 (Fig 3D). The limits of detection on the Bio-Rad CFX96 and the Axxin T8 were comparable, suggesting that modifications made in translating the assay to a point-of-care instrument did not impact sensitivity. Notably, the limit of detection is higher in saliva, which is a more complex sample matrix that has been shown to impact LAMP sensitivity [14, 31, 32, 51], probably due to the presence of mucins [52] and nucleases [5355].

Fig 3. Limit of detection in negative pooled matrix.

Fig 3

The limit of detection was assessed by spiking Zeptometrix pseudovirus into pooled nasopharyngeal matrix collected in lysis buffer that had previously tested negative for SARS-CoV-2 in RT-qPCR using the CDC assay, or negative pooled saliva combined with lysis buffer. Samples were heat-inactivated at 95° C for 5 minutes (A,B) or 6 minutes (C,D), and tested on either the Bio-Rad CFX96 or Axxin T8. The limit of detection at 95% probability was determined using probit analysis to be: (A) 20 copies per reaction on the Bio-Rad CFX96 and (B) 23 copies per reaction on the Axxin T8 for nasopharyngeal samples. The limit of detection in saliva was found to be: (C) 93 copies per reaction on the Bio-Rad CFX96 and (D) 116 copies per reaction on the Axxin T8.

Participant sample optimization and evaluation

A total of 94 participants from LBJ Hospital were enrolled between June 2020 and January 2021, from which nasopharyngeal, nasal, and/or saliva samples were collected and evaluated in both RT-qPCR and our RT-LAMP assay (Fig 4). 88 participants were confirmed to have SARS-CoV-2 infections by RT-qPCR on a nasopharyngeal swab obtained for clinical care purposes; of these, 10 participants did not provide nasopharyngeal swabs for research purposes, 2 did not provide nasal swabs, and 2 did not provide saliva samples, leading to a total of 78, 86, and 86 nasopharyngeal, nasal, and saliva samples collected for the study that were evaluated in RT-qPCR. A total of 35 nasal and saliva samples were used to optimize collection methods as described below, resulting in 41 participants with paired nasopharyngeal, nasal, and saliva samples collected under optimal conditions and assessed in RT-qPCR.

Fig 4. Testing and analysis flowchart by sample type.

Fig 4

Flowchart shows the number of participants who were enrolled and confirmed to have SARS-CoV-2 infections, and the corresponding number of samples by type that were collected and analyzed by RT-qPCR and by RT-LAMP.

Nasal swab collection optimization

Due to supply chain shortages of swabs, nasal samples were collected using a variety of swab types, and nasal swab collection methods were optimized throughout the course of our clinical sample collection period. We tested the effects of swab type (Puritan polyester swabs or Copan flocked swabs), swab collector (health-care provider or patient self-collection), number of nostrils sampled (one or both), and number of rotations per nostril (5–10). We found that the swab type and swabbing method greatly impacted viral RNA detection in RT-qPCR when compared to the paired nasopharyngeal swab. Although nasal swabs required a slightly higher collection volume than nasopharyngeal swabs (500 μL vs. 300 μL), we anticipate that any differences in sensitivity attributed to this would be on the same order of magnitude and likely negligible. Previous reports have similarly detailed that specimen collection strategies impact test sensitivity [56]. Of the collection methods tested, the optimal strategy was found to be a provider-collected nasal sample using a Copan flocked swab that was rotated ten times in each nostril. This optimal collection strategy resulted in a positive RT-qPCR agreement with a paired nasopharyngeal swab of 71%, compared to an agreement of only 47% when using non-optimal swabs and collection methods (S4A Fig). The positive agreement for paired nasal and nasopharyngeal swabs undergoing RT-qPCR with the optimal sample collection method is comparable to that in other reports [57]. Samples collected under non-optimal conditions were excluded from subsequent analyses.

RT-LAMP optimization with nasal swabs

Initial results with optimized nasal swab collection methods indicated low concordance between RT-LAMP and RT-qPCR when nasal swabs had Ct>30. We hypothesized that RT-LAMP reactions were target-limited, and increasing the sample volume would increase the amount of viral RNA available for amplification. Therefore, we retested a subset of nasal samples (n = 4) that had initially discordant RT-LAMP and RT-qPCR results and/or RT-LAMP results in which fewer than three replicates amplified with sample volumes of 5 μL, 7 μL, and 9 μL (S4B Fig). Only one sample amplified in all three conditions, and sample volumes of 7 μL and 9 μL amplified more slowly than 5 μL. This suggested that increased sample volume was inhibitory to RT-LAMP, probably due to inhibition from lysis buffer components, particularly GuHCl. Thus, 5 μL was determined to be the optimal sample volume for nasal samples.

Saliva collection optimization

A variety of saliva collection and inactivation methods were used throughout our clinical study due to evolving biosafety considerations. Saliva collection and inactivation methods had notable effects on viral RNA detection in RT-qPCR and concordance with paired nasopharyngeal swabs. Initially, saliva was collected with swabs or sponges directly into tubes with 5X lysis buffer and heated before opening to ensure viral inactivation prior to sample handling. However, when RT-qPCR was performed on saliva samples collected in this manner, only 40% of these samples were positive by RT-qPCR despite having a positive nasopharyngeal swab (S5A Fig). This agreement between saliva and nasopharyngeal samples was much lower than previous reports [7, 11, 58]. We hypothesized that swabs and sponges did not collect sufficient cellular material, resulting in poor concordance.

We then began to collect saliva through passive drool into sterile tubes pre-loaded with a small volume of 100X lysis buffer; these tubes were vortexed and heated before sample handling. Although concordance with RT-qPCR increased to 55%, this was still considered to be an inadequate sample collection method. We attributed the low concordance to the variable ratio of saliva to lysis buffer, possibly resulting in incomplete RNase inactivation and/or viral lysis.

Finally, as laboratory biosafety guidelines for handling SARS-CoV-2 at our institution evolved, we were able to collect saliva into empty sterile tubes and combine saliva and lysis buffer in a controlled 20:1 ratio before heating. Under these conditions, concordance between RT-qPCR on paired nasopharyngeal samples increased to 78%, and thus this method was determined to be the best saliva collection and processing method. Saliva samples that were not collected under these conditions were excluded from subsequent analyses.

RT-LAMP optimization with saliva

Initial testing of saliva samples collected under the chosen best conditions showed poor RT-LAMP concordance with RT-qPCR results from the same sample. We observed that performance was worse with samples tested on the Axxin T8 than on the Bio-Rad CFX96, which we hypothesized to be due to the increased sample volume used with the Axxin T8, and accordingly, increased inhibitors in the reaction. Thus, we investigated whether reducing saliva sample volume could improve performance for RT-LAMP. A subset of five saliva samples with initially discordant results between RT-LAMP and RT-qPCR were retested at sample volumes of 2.5 μL, 3.75 μL, and 5 μL (S5B Fig). 5 μL volumes of saliva input into RT-LAMP resulted in amplification of only two of five samples, indicating that a 5 μL sample input may be inhibitory to the reaction. Similarly, only two of five samples amplified at input volumes of 2.5 μL, likely due to insufficient viral input. When tested at a sample volume of 3.75 μL, four of five samples had at least one positive replicate. Thus, 3.75 μL sample volumes were deemed to be optimal at maximizing viral input while minimizing inhibitors in the RT-LAMP reaction.

All saliva samples with sufficient remaining volume were tested with 3.75 μL sample input volumes on the Bio-Rad CFX96 and with 7.5 μL sample input volumes in 50 μL reactions on the Axxin T8. RT-LAMP results were then compared to initial results obtained with higher sample volumes (S6 Fig). For the Bio-Rad CFX96, concordance with RT-qPCR was similar at both sample input volumes, but time to amplification was on average 6.6 min faster at the lower sample volume (S6A Fig). Decreasing sample volume in RT-LAMP reactions on the Axxin T8 increased concordance with RT-qPCR, and reduced average time to amplification by 5.9 min. Therefore, 3.75 μL and 7.5 μL sample volumes were selected as the best volumes for subsequent RT-LAMP performance evaluation on the on the Bio-Rad CFX96 and the Axxin T8, respectively.

Importantly, the re-optimization undertaken here highlights the value of testing real patient samples rather than contrived samples, especially with complex sample matrices such as saliva, as contrived samples cannot capture the person-to-person variability nor disease-induced changes in composition [55], pH [48], or viscosity [59] that may occur.

Heterogenous Ct distribution among participant samples

The distributions of Ct values by sample type were plotted for 41 participants from whom all three sample types were collected under optimal conditions (Fig 5A–5C). The peak of the distribution of Ct values was lowest for nasopharyngeal swabs and highest for nasal swabs. The highest variability in Ct values was observed for saliva samples.

Fig 5. Ct distribution by sample type.

Fig 5

The frequency distribution of Ct values obtained by RT-qPCR for (A) nasopharyngeal swabs, (B) nasal swabs, and (C) saliva samples from patients who provided all three sample types (n = 41). The Ct values of corresponding nasopharyngeal, nasal, and saliva samples from the same patients are plotted and stratified by (D) nasal swab Ct<30, (E) nasal swab 30<Ct<35 (F) nasal swab Ct>35 and (G) negative nasal swab.

To investigate the relationship between sample type and viral load, participant samples were divided into four groups based on the Ct value measured for the nasal swab, and the corresponding nasopharyngeal, nasal, and saliva Ct values were plotted (Fig 5D–5G). Nasal swabs from the same patient consistently had higher Ct values than the corresponding nasopharyngeal swab, whereas the Ct value of the corresponding saliva sample was variable. These trends in viral load distribution among the sample types likely reflect that the patients tested were late in their course of infection [60], and support findings that viral RNA is persistently detected in nasopharyngeal swabs longer than saliva [7, 57, 60, 61] or nasal samples [57, 60].

Optimized RT-LAMP test performance on participant samples

A total of 69 nasopharyngeal swabs, 42 nasal swabs, and 35 saliva samples were tested using the optimized RT-LAMP assay. Inactivated lysate was directly input into RT-LAMP for evaluation on both the Bio-Rad CFX96 and the Axxin T8. Samples were also purified and assessed in RT-qPCR, and Ct values obtained from the N1 and N2 assay were averaged for each sample. RT-LAMP results were then compared to RT-qPCR to assess positive and negative agreement at varying Ct thresholds.

For nasopharyngeal swabs, RT-LAMP on the Axxin T8 showed overall positive agreement of 91% (95% confidence interval [CI]: 81–96%) with RT-qPCR. Positive agreement with RT-qPCR was 95% (95% CI: 86–99%) for nasopharyngeal samples with Ct<35, and 100% (95% CI: 90–100%) for samples with Ct<30. Comparable results were obtained for RT-LAMP performed on the Bio-Rad CFX96 (Fig 6A–6C).

Fig 6. RT-LAMP performance on clinical samples.

Fig 6

(A,B) Summary of RT-LAMP results for nasopharyngeal samples, stratified by the Ct value obtained in RT-qPCR. Nasopharyngeal samples were tested on (A) the Bio-Rad CFX96 and (B) the Axxin T8. (C) Positive agreement and 95% confidence intervals with RT-qPCR at varying Ct thresholds. (D,E) Summary of RT-LAMP results for nasal samples compared to the nasal sample Ct value obtained in RT-qPCR, when tested on (D) the Bio-Rad CFX96 and (E) the Axxin T8. (F) Positive and negative agreement with RT-qPCR and 95% confidence intervals for nasal samples. (G,H) Summary of RT-LAMP results for saliva samples compared to the saliva sample Ct value obtained in RT-qPCR, when tested on (G) the Bio-Rad CFX96 and (H) the Axxin T8. (I) Positive and negative agreement with RT-qPCR and 95% confidence intervals for saliva samples.

For nasal swabs, agreement between RT-LAMP and RT-qPCR was similarly high for samples with Ct<30 (100%, 95% CI: 56–100%) and Ct<35 (100%, 95% CI: 72–100%) on the Axxin T8 (Fig 6D–6F). Overall, agreement was 69% for samples tested on the Axxin T8 (95% CI: 50–84%), due in part to the high number of nasal samples with Ct>35 in the population tested. Similar positive agreement results were obtained on the Bio-Rad CFX96, and negative agreement on both instruments was 94% (95% CI: 70–100%).

For saliva, agreement between RT-LAMP and RT-qPCR was 100% (95% CI: 76–100%) for samples with Ct<30, 86% (95% CI: 65–96%) for samples with Ct<35, and 69% (95% CI: 51–83%) overall for samples tested using the Axxin T8. Comparable results were obtained on the Bio-Rad CFX96 (Fig 6G–6I). Concordance between RT-LAMP and RT-qPCR was slightly lower for saliva than for nasal swabs, which we attribute to the higher limit of detection for saliva than nasal and nasopharyngeal samples noted earlier, and the variability of saliva as a clinical matrix.

Overall, RT-LAMP results in this hospitalized cohort of participants showed good concordance with RT-qPCR from the same sample; however, although nasopharyngeal swab collection is impractical for surveillance testing, it is considered the most stringent reference standard. For this reason, we sought to evaluate differences in sensitivity of nasal RT-qPCR, nasal RT-LAMP, and saliva RT-LAMP. We compared performance of these three testing methods within the same cohort of hospitalized patients, using nasopharyngeal swab RT-qPCR as the reference standard and stratifying results by the reference Ct value. The sensitivity of nasal and saliva RT-LAMP and nasal RT-qPCR exceeded 90% for participants whose nasopharyngeal swab had a Ct <25 (S7 Fig). For participants with a nasopharyngeal swab Ct<30, the sensitivity of RT-LAMP for both saliva and nasal swabs was approximately 60%, and approximately 50% at Ct <35. In this hospitalized cohort of patients, the overall sensitivity of RT-LAMP was 54% (95% CI: 36–70%) for saliva samples and 47% (95% CI: 31–64%) for nasal swabs, both less than the corresponding 71% sensitivity of nasal RT-qPCR (95% CI: 55–83%).

Considering public health recommendations emphasizing frequency of testing over test sensitivity [13], we implemented our developed RT-LAMP saliva workflow as part of Rice’s surveillance strategy. Saliva was chosen as the sample type for this application, due to comparable detection of SARS-CoV-2 in saliva and nasal swabs for samples with low Ct values (Fig 6), and practical advantages of saliva including circumventing nasal swab shortages and reliability of self-collected saliva.

RT-LAMP as a surveillance test

As of December 16, 2021, a total of 24,927 participants at Rice University were tested in the high-throughput RT-LAMP assay. Thirty-seven people had presumptive positive test results, and the remainder of the participants tested presumptively negative. Individuals who tested positive by saliva RT-LAMP, and five percent of individuals who tested negative by saliva RT-LAMP between September 2020 and January 2021, were directed to undergo a follow-up confirmatory nasal RT-qPCR within 24–48 hours. Data were available for nine of the 37 confirmatory tests, which were performed by one of Rice University’s contracted COVID-19 testing providers on a self-collected nasal sample. Eight received a positive confirmatory test result and one received a negative confirmatory test result. The research team did not have access to laboratory results for the other 22 positive confirmatory tests which were performed by non-Rice affiliated community providers. All negative validation tests (n = 116) were confirmed negative.

Presumptive positive test results increased dramatically upon the arrival of the delta variant to Houston (S8 Fig), which occurred roughly between July 1 and November 1, 2021. The overall positivity rate prior to July 1 was 0.08%; the positivity rate between July 1 and November 1, 2021 was 0.20%. Additional changes over this period of time that might affect positivity rate include changes to campus-wide policies and testing intervals and the number of people on campus; however the trend seen in LAMP testing presumptive positivity was used in part to inform new guidance on masks and gathering size.

Ct values obtained from these nine confirmatory nasal RT-qPCR tests were summarized (Fig 7A). The average Ct value for nasal samples from these eight individuals was 21.1 ± 4.4, with a range between 16.7 and 28.2. This is slightly lower than the average (27.1 ± 7.2) and range (12.9–38.0) of Ct values for participants who received positive nasal RT-qPCR tests in Rice University’s routine surveillance program (Fig 7A). Fig 7B compares the frequency distribution of Ct values for nasal swabs obtained in Rice University’s routine surveillance program to that of the hospitalized cohort of patients enrolled in this study. Samples with low Ct values were more commonly found in the asymptomatic surveillance population than the hospitalized population, confirming other findings [65]. Over half of participants in the surveillance population had Ct values ≤25, whereas only <10% of hospitalized participants had Ct values ≤25. Recent literature suggests nasopharyngeal swab Ct values above thresholds ranging from 24 to 35 are no longer infectious [6265], highlighting the importance of a surveillance test that accurately detects samples with low Ct values.

Fig 7. Nasal Ct distributions in surveillance population and hospitalized patient population.

Fig 7

(A) Mean, standard deviation, and range of Ct values and (B) frequency distributions of Ct values for confirmatory nasal RT-qPCR tests after an individual tested positive with LAMP (n = 8), for individuals who tested positive as part of Rice University’s surveillance testing program with the testing provider who conducted confirmatory RT-qPCR tests (n = 136), and for all hospitalized patients who tested positive by nasal RT-qPCR (n = 35).

Discussion

We have described a sensitive and specific RT-LAMP test to detect SARS-CoV-2 RNA from unextracted swab and saliva samples. The inactivation protocol employed adds to the growing body of literature of TCEP/EDTA and heat-based strategies for viral lysis and endogenous RNase inactivation, and further demonstrates the compatibility of this method with multiple sample types.

The use of three unique primer sets in the RT-LAMP assay allows the test to target distinct regions of the SARS-CoV-2 viral genome, decreasing the likelihood that viral mutations would prevent amplification. The triplex assay achieves a low limit of detection of 20–23 copies per reaction, approaching that of RT-qPCR, for nasopharyngeal and nasal swab eluates. For saliva samples, the limit of detection is slightly higher, though still clinically relevant, at 93–116 copies per reaction. Our test falls within reported limits of detection in the literature for RT-LAMP SARS-CoV-2 tests, which range from 5–500 copies per reaction [16, 17, 2528, 31, 32, 35, 48, 6668], and is comparable to commercially available point-of-care tests [6971]. To the best of our knowledge, RT-LAMP assays developed thus far for SARS-CoV-2 detection in clinical samples have largely relied on two primer sets targeting the viral genome for increased sensitivity, either in separate tubes [28, 29, 34, 48, 68] or in a duplex reaction [25, 29, 32, 33, 46, 72]. Few reports have explored triplex reactions [26, 35, 45].

In this study, we demonstrate that the limits of detection of the assay on the Bio-Rad CFX96 and the Axxin T8 are comparable, suggesting that modifications made in translating the assay to a point-of-care instrument did not impact sensitivity. The Axxin T8 requires a modest up-front equipment cost around $6,500 USD, can be powered by batteries, and is reusable, eliminating much of the plastic waste that will be generated by single-use at-home or point-of-care SARS-CoV-2 tests. Furthermore, reaction vessels remain closed, and amplicons never need to be manipulated for analysis, reducing the likelihood of environmental cross-contamination [73]. Successful implementation and validation of the RT-LAMP assay on the Axxin T8 has overcome the challenges of adapting assays to point-of-care instruments [36] and shows the potential of the use of this workflow near the point-of-care. FDA Emergency Use Authorization and widespread use of the Lucira COVID-19 All-In-One Test Kit at the time of publication illustrates the potential for similar technologies to be translated for true point-of-care use. To facilitate use in settings with limited laboratory infrastructure or trained personnel, RT-LAMP reaction mixtures would need to be lyophilized [7476] to eliminate the manual reaction assembly that is currently required. Additionally, the saliva-specific workflow involves handling potentially infectious material, as the lysis and inactivation protocol requires users to combine saliva with lysis buffer before heating. The development of a collection and lysis module that meters saliva into lysis buffer could address this limitation.

The developed RT-LAMP test showed positive agreements of 87–100% for Ct <30 and 76–100% for Ct <35 compared with the hospital gold standard RT-qPCR test across all sample types and instruments, highlighting the utility of the test in the reported range of Ct values that are correlated with infectivity (<24–35) [6265]. Recognizing that viral RNA persists much longer in nasopharyngeal specimens than in saliva and nasal swabs [7, 57, 60, 61], potentially affecting the Ct distributions from hospitalized patients who were tested in our study toward the end of their infection, we also analyzed the Ct values of positive samples identified through our asymptomatic testing program. We found that nasal swab Ct values from the asymptomatic individuals trended lower than those measured from hospitalized patients, likely due to higher viral load occurring earlier in the course of infection [57, 63, 7779]. As such, our results suggest that nasal or saliva samples likely work equally well in asymptomatic surveillance testing, when catching low-Ct value samples is the most important consideration. Nasopharyngeal swabs were a more sensitive sample type overall in our study, especially when people may have been late in the course of their infection, but the increased resources and personnel required to obtain nasopharyngeal swabs are not practical for asymptomatic surveillance. Our results add to other recent literature suggesting that sample type should be chosen carefully based on target population and testing goals.

Finally, the developed saliva RT-LAMP test was successfully scaled for surveillance testing of up to 400 members of the Rice University campus community per day. Scaling at Rice University involved sourcing dedicated equipment for testing, onboarding a team of laboratory technicians and student staff, and establishing sample collection and handling protocols. Sourcing thermocyclers and automated liquid handlers at the height of the pandemic was difficult and involved long lead times; these processes should be started as soon as the decision to perform in-house testing is made. Laboratory technicians relied on one to two liquid handlers and thermocyclers at a time to support testing of up to 400 people per day. Notably, the ability to rapidly optimize and validate the test in samples from hospitalized patients was essential to select a sample type and design the collection workflow. These lessons learned could be helpful in rapidly replicating surveillance testing for other emerging infectious diseases. Considering estimated equipment, reagent, and consumable costs, as well as personnel time, number of user steps, and limit of detection, the developed RT-LAMP test has a number of advantages over RT-qPCR tests, including a lower cost (S1 Table).

We have described a sample-to-answer test that involves a simple heat step for lysis and viral inactivation, transfer of the sample to amplification reagents, and incubation at a single temperature for nucleic acid amplification and real-time detection. We demonstrate two workflows, one that uses a portable isothermal fluorimeter and can be performed near the point-of-care to test tens of samples per day and a high-throughput format that uses a standard thermocycler to test hundreds of samples per day. The test is compatible with multiple sample matrices, including nasopharyngeal, nasal, and saliva samples. Compared with traditional RT-qPCR-based testing methods, this RT-LAMP test has the potential to circumvent supply chain bottlenecks for commonly used reagents and adds a highly adaptable method for surveillance testing for the COVID-19 pandemic.

Supporting information

S1 Fig. Multiplexed primer set selection.

Synthetic SARS-CoV-2 RNA was prepared in nuclease-free water and amplified in RT-LAMP on the Bio-Rad CFX96 using multiplexed primer sets N2/E1 or N2/E1/As1e. (A) Average time to amplification by number of input copies and primer set. The number of replicates that amplified out of 6 is indicated on each bar. Error bars indicate standard deviation of replicates that amplified. (B) Real-time amplification curves for 5, 10, 20, and 50 input copies of RNA per reaction. ***indicates p≤.001; significance determined using an unpaired two-tailed t-test.

(TIF)

S2 Fig. Lysis buffer tolerance in RT-LAMP.

Synthetic SARS-CoV-2 RNA was prepared in either nuclease-free water or 5X lysis buffer with 200 mM GuHCl at a concentration of 10 copies/μL (50 copies per reaction) and amplified in RT-LAMP on the Bio-Rad CFX96. Average time to amplification ± standard deviation is shown (n = 3 for each condition). Time to amplification is not significantly different between the two conditions (p≥0.6; significance determined using unpaired two-tailed t-test).

(TIF)

S3 Fig. Saliva heat inactivation time.

Negative pooled saliva was spiked with Zeptometrix pseudovirus to achieve a concentration of 100 copies/μL, then combined with lysis buffer and heat inactivated at 95°C for 5–10 minutes. The resulting lysate was amplified in RT-LAMP on the Bio-Rad CFX96. Average time to amplification was not statistically different between the heat inactivation time conditions (n = 6 per condition; p = 0.72 determined by one-way ANOVA) but variability of time to amplification was reduced at 6 and 7 minutes of heating.

(TIF)

S4 Fig. Nasal optimization.

(A) Collection method optimization. Comparison of RT-qPCR results on nasal samples collected with various swabs and swabbing strategies. Nasal RT-qPCR results are stratified by the Ct value of the paired nasopharyngeal swab. (B) Ct (RT-qPCR) or average time to amplification in RT-LAMP (5 μL, 7 μL, 9 μL, indicating sample volume; n = 3 for each condition) of a subset of nasal samples that were initially discordant with RT-qPCR or inconclusive in RT-LAMP with 5 μL samples. Data shown by sample number in order of increasing Ct values; # indicates conditions where only 1 of 3 replicates amplified, ## indicates conditions where 2 of 3 replicates amplified.

(TIF)

S5 Fig. Saliva optimization.

(A) Collection method optimization. Comparison of RT-qPCR results on saliva samples collected with various methods, including by swab or sponge, passive drool directly into buffer resulting in variable saliva to buffer ratios, or metering buffer into drool at a controlled ratio. Saliva RT-qPCR results are stratified by the Ct value of the paired nasopharyngeal swab. (B) Ct (RT-qPCR) or average time to amplification in RT-LAMP (2.5 μL, 3.75 μL, 5 μL, indicating sample volume; n = 3 for each condition) of a subset of saliva samples that were initially discordant with RT-qPCR with 5 μL samples. Data shown by sample number in order of increasing Ct values; # indicates conditions where only 1 of 3 replicates amplified, ## indicates conditions where 2 of 3 replicates amplified.

(TIF)

S6 Fig. Validation of optimal saliva volume.

(A) RT-LAMP results for saliva samples tested on the Bio-Rad CFX96, plotted by Ct value of the corresponding RT-qPCR result, using 5 μL sample volume (left) and 3.75 μL sample volume (right), with a table below summarizing positive percent agreement and 95% confidence intervals at different Ct thresholds. (B) RT-LAMP result of saliva samples on the Axxin T8, plotted by Ct value of the corresponding RT-qPCR result, using 10 μL sample volume (left) and 7.5 μL sample volume (right), with a table below summarizing positive percent agreement and 95% confidence intervals at different Ct thresholds.

(TIF)

S7 Fig. RT-LAMP performance compared to RT-qPCR on nasal swabs.

(A) Nasal RT-qPCR results are stratified by the Ct value of the paired nasopharyngeal swab. The table below the graph summarizes percent agreement and 95% confidence intervals at different Ct thresholds. (B) Saliva LAMP and Nasal LAMP results from samples tested on the Bio-Rad CFX96 are stratified by the Ct value of the paired nasopharyngeal swab, with tables summarizing percent agreement and 95% confidence intervals at different Ct thresholds.

(TIF)

S8 Fig. Cumulative presumptive positive samples in LAMP testing.

Cumulative number of samples with presumptive positive results by date. Dashed line: university guidance that fully vaccinated individuals no longer need to test (23 April 2021); dotted line: university guidance that fully vaccinated individuals should resume testing (3 August 2021).

(TIF)

S1 Table. Test comparison.

Summary of estimated equipment costs, reagent and consumable costs, personnel time, user steps, and limit of detection for RT-qPCR tests and RT-LAMP tests for SARS-CoV-2.

(TIF)

S1 Data

(XLSX)

Acknowledgments

We gratefully thank Dr. Nathan Butlin and Dr. Nathan Tanner for helpful discussions and thoughtful feedback throughout this project. We also thank the numerous collaborators who helped make the clinical studies possible: Rebecca Elias for assistance with Institutional Review Board protocol submissions; Dr. Abbhi Rajagopal, Mark Munsell, Joseph Thomas, and Jackson Coole for help establishing databases in REDCap; Liam Sweeney, Charles Swope, Kaye Tryels, Sonya Polk-Davis, Angela Muhammad-Ali, Shayla Elliot, Lara Medina, Chelsea Ja’nae, Jessica Thornell, Olalekan Ojeshina, and Nancy Arevalo for their assistance in obtaining samples for initial test development; Arturo Barrera, Jessica Gallegos, Cindy Melendez, Ana López, Keiry Paiz, Jose Garcia, and Anthony Price for clinical coordination at Lyndon B. Johnson Hospital; and Anthony Price and Dr. Ellen Baker for coordinating sample collection during scale-up of the RT-LAMP at Rice University. We gratefully acknowledge Emilie Newsham for help testing clinical samples and Imran Vohra for photography. We thank Dr. Kevin Kirby, Dr. Yousif Shamoo, Jerusha Kasch, Tanner Gardner, Kate Abad, Tina Villard, Lisa Basgall, Abigal Tucker, Leon Lian, and Dr. Jessica McKelvey from Rice University’s Crisis Management Advisory Council, Crisis Management Team, and Student Health Centers for support and coordination of the scale-up of the RT-LAMP test at Rice University. Finally, we gratefully acknowledge our student staff members who ran our surveillance testing site, including Norman Zheng, Parker Towns, Keith McCord, Myles Nobles, Grace Waterman, Prince Alino, Keziah Chow, Brittany Bui, George Hung, Emilie Newsham, Angelica Torres, Trinity King, and Lourdes Vivas De Lorenzi.

Citation diversity statement

Recent work in several scientific fields has identified a bias in citation practice, specifically that publications written by scholars from underrepresented and historically excluded backgrounds and identities are under-cited relative to the number of papers in the field. We recognize this bias and have worked diligently to assess the inclusivity of our reference list and to ensure that we reference appropriate papers from diverse authors.

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

Funding for this work was provided from the American people by USAID through an IAVI research grant CCID 9204 under award AID-OAA-A16-00032 between IAVI and USAID, and through internal funding by Rice University. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Larremore DB, Wilder B, Lester E, Shehata S, Burke JM, Hay JA, et al. Test sensitivity is secondary to frequency and turnaround time for COVID-19 screening. Sci Adv. 2021;7. doi: 10.1126/sciadv.abd5393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Chin ET, Huynh BQ, Chapman LAC, Murrill M, Basu S, Lo NC. Frequency of Routine Testing for Coronavirus Disease 2019 (COVID-19) in High-risk Healthcare Environments to Reduce Outbreaks. Clin Infect Dis. 2021;73: e3127–e3129. doi: 10.1093/cid/ciaa1383 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Paltiel AD, Zheng A, Walensky RP. Assessment of SARS-CoV-2 Screening Strategies to Permit the Safe Reopening of College Campuses in the United States. JAMA Netw Open. 2020;3: e2016818. doi: 10.1001/jamanetworkopen.2020.16818 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Prather KA, Wang CC, Schooley RT. Reducing transmission of SARS-CoV-2. Science. 2020;368: 1422–1424. doi: 10.1126/science.abc6197 [DOI] [PubMed] [Google Scholar]
  • 5.Goyal A, Reeves DB, Cardozo-Ojeda EF, Schiffer JT, Mayer BT. Viral load and contact heterogeneity predict SARS-CoV-2 transmission and super-spreading events. Elife. 2021;10: e63537. doi: 10.7554/eLife.63537 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Moghadas SM, Fitzpatrick MC, Sah P, Pandey A, Shoukat A, Singer BH, et al. The implications of silent transmission for the control of COVID-19 outbreaks. Proc Natl Acad Sci U S A. 2020;117: 17513–17515. doi: 10.1073/pnas.2008373117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Wyllie AL, Fournier J, Casanovas-Massana A, Campbell M, Tokuyama M, Vijayakumar P, et al. Saliva or Nasopharyngeal Swab Specimens for Detection of SARS-CoV-2. N Engl J Med. 2020;383: 1283–1286. doi: 10.1056/NEJMc2016359 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Iwasaki S, Fujisawa S, Nakakubo S, Kamada K, Yamashita Y, Fukumoto T, et al. Comparison of SARS-CoV-2 detection in nasopharyngeal swab and saliva. J Infect. 2020;81: e145–e147. doi: 10.1016/j.jinf.2020.05.071 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Azzi L, Carcano G, Gianfagna F, Grossi P, Gasperina DD, Genoni A, et al. Saliva is a reliable tool to detect SARS-CoV-2. J Infect. 2020;81: e45–e50. doi: 10.1016/j.jinf.2020.04.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Johnson AJ, Zhou S, Hoops SL, Hillmann B, Schomaker M, Kincaid R, et al. Saliva Testing Is Accurate for Early-Stage and Presymptomatic COVID-19. Microbiol Spectr. 2021;9: e00086–21. doi: 10.1128/Spectrum.00086-21 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Bastos ML, Perlman-Arrow S, Menzies D, Campbell JR. The Sensitivity and Costs of Testing for SARS-CoV-2 Infection With Saliva Versus Nasopharyngeal Swabs. Ann Intern Med. 2021;174: 501–510. doi: 10.7326/M20-6569 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Craw P, Balachandran W. Isothermal nucleic acid amplification technologies for point-of-care diagnostics: A critical review. Lab Chip. 2012;12: 2469–2486. doi: 10.1039/c2lc40100b [DOI] [PubMed] [Google Scholar]
  • 13.Zhang Y, Odiwuor N, Xiong J, Sun L, Nyaruaba RO, Wei H, et al. Rapid Molecular Detection of SARS-CoV-2 (COVID-19) Virus RNA Using Colorimetric LAMP. medRxiv. 2020. doi: 10.1101/2020.02.26.20028373 [DOI] [Google Scholar]
  • 14.Yu L, Wu S, Hao X, Dong X, Mao L, Pelechano V, et al. Rapid Detection of COVID-19 Coronavirus Using a Reverse Transcriptional Loop-Mediated Isothermal Amplification (RT-LAMP) Diagnostic Platform. Clin Chem. 2020;66: 975–977. doi: 10.1093/clinchem/hvaa102 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Jiang M, Pan W, Arasthfer A, Fang W, Ling L, Fang H, et al. Development and Validation of a Rapid, Single-Step Reverse Transcriptase Loop-Mediated Isothermal Amplification (RT-LAMP) System Potentially to Be Used for Reliable and High-Throughput Screening of COVID-19. Front Cell Infect Microbiol. 2020;10. doi: 10.3389/fcimb.2020.00331 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Lamb LE, Bartolone SN, Ward E, Chancellor MB. Rapid detection of novel coronavirus/Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) by reverse transcription-loop-mediated isothermal amplification. PLoS One. 2020;15: e0234682. doi: 10.1371/journal.pone.0234682 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Rabe BA, Cepko C. SARS-CoV-2 detection using isothermal amplification and a rapid, inexpensive protocol for sample inactivation and purification. Proc Natl Acad Sci U S A. 2020;117: 24450–24458. doi: 10.1073/pnas.2011221117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Buck MD, Poirier EZ, Cardoso A, Frederico B, Canton J, Barrell S, et al. Standard operating procedures for SARS-CoV-2 detection by a clinical diagnostic RT-LAMP assay. medRxiv. 2020. doi: 10.1101/2020.06.29.20142430 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.EMERGENCY USE AUTHORIZATION (EUA) SUMMARY FOR THE COLOR SARS-COV-2 RT-LAMP DIAGNOSTIC ASSAY.
  • 20.AQ-TOP COVID-19 Rapid Detection Kit For in vitro diagnostic use only RX only For use under Emergency Use Authorization (EUA) only Instructions for Use | V1.1.
  • 21.MobileDetect-BIO BCC19 Test Kit—Instructions for Use.
  • 22.SARS-CoV-2 RNA DETECTR Assay ACCELERATED EMERGENCY USE AUTHORIZATION (EUA) SUMMARY SARS-COV-2 RNA DETECTR ASSAY (UCSF Health Clinical Laboratories, UCSF Clinical Labs at China Basin).
  • 23.INSTRUCTIONS FOR USE Sherlock TM CRISPR SARS-CoV-2 kit Rx Only For Emergency Use Authorization (EUA) only.
  • 24.Lucira COVID-19 All-In-One Test Kit Instruction for Use.
  • 25.Mohon AN, Oberding L, Hundt J, van Marle G, Pabbaraju K, Berenger BM, et al. Optimization and clinical validation of dual-target RT-LAMP for SARS-CoV-2. J Virol Methods. 2020;286: 113972. doi: 10.1016/j.jviromet.2020.113972 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Jang WS, Lim DH, Yoon J, Kim A, Lim M, Nam J, et al. Development of a multiplex Loop-Mediated Isothermal Amplification (LAMP) assay for onsite diagnosis of SARS CoV-2. PLoS One. 2021;16: e0248042. doi: 10.1371/journal.pone.0248042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Baek YH, Um J, Antigua KJC, Park JH, Kim Y, Oh S, et al. Development of a reverse transcription-loop-mediated isothermal amplification as a rapid early-detection method for novel SARS-CoV-2. Emerg Microbes Infect. 2020;9: 998–1007. doi: 10.1080/22221751.2020.1756698 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Yan C, Cui J, Huang L, Du B, Chen L, Xue G, et al. Rapid and visual detection of 2019 novel coronavirus (SARS-CoV-2) by a reverse transcription loop-mediated isothermal amplification assay. Clin Microbiol Infect. 2020;26: 773–779. doi: 10.1016/j.cmi.2020.04.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Schermer B, Fabretti F, Damagnez M, Di Cristanziano V, Heger E, Arjune S, et al. Rapid SARS-CoV-2 testing in primary material based on a novel multiplex RT-LAMP assay. PLoS One. 2020;15: 11. doi: 10.1371/journal.pone.0238612 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Cairns E. Lucira brings a $50 home Covid-19 test to the US–slowly. Evaluate Vantage. 18 Nov 2020. https://www.evaluate.com/vantage/articles/news/snippets/lucira-brings-50-home-covid-19-test-us-slowly
  • 31.Janíková M, Hodosy J, Boor P, Klempa B, Celec P. Loop-mediated isothermal amplification for the detection of SARS-CoV-2 in saliva. Microb Biotechnol. 2021;14: 307–316. doi: 10.1111/1751-7915.13737 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Lalli MA, Langmade JS, Chen X, Fronick CC, Sawyer CS, Burcea LC, et al. Rapid and Extraction-Free Detection of SARS-CoV-2 from Saliva by Colorimetric Reverse-Transcription Loop-Mediated Isothermal Amplification. Clin Chem. 2021;67: 415–424. doi: 10.1093/clinchem/hvaa267 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Bikos DA, Hwang C, Brileya KA, Parker A, Loveday EK, Rodriguez M, et al. SLAMP: A Rapid Fluorometric RT-LAMP Assay for Sensitive and Specific Detection of SARS-CoV-2 from Human Saliva. medRxiv. 2021. doi: 10.1101/2021.03.31.21254634 [DOI] [Google Scholar]
  • 34.Bokelmann L, Nickel O, Maricic T, Pääbo S, Meyer M, Borte S, et al. Point-of-care bulk testing for SARS-CoV-2 by combining hybridization capture with improved colorimetric LAMP. Nat Commun. 2021;12: 1–8. doi: 10.1038/s41467-020-20314-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Zhang Y, Ren G, Buss J, Barry AJ, Patton GC, Tanner NA. Enhancing colorimetric loop-mediated isothermal amplification speed and sensitivity with guanidine chloride. Biotechniques. 2020;69: 178–185. doi: 10.2144/btn-2020-0078 [DOI] [PubMed] [Google Scholar]
  • 36.Natoli ME, Kundrod KA, Chang MM, Smith CA, Paul S, Coole JB, et al. Improving Performance of a SARS-CoV-2 RT-LAMP Assay for Use With a Portable Isothermal Fluorimeter: Towards a Point-of-Care Molecular Testing Strategy. J Biomol Tech. 2021;32: 180–185. doi: 10.7171/jbt.21-3203-013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Tanner N. Optimized Integration of New England Biolabs ® Loop-mediated Isothermal Amplification (LAMP) Reagents with Axxin ISO Instruments.
  • 38.Paul R, Ostermann E, Wei Q. Advances in point-of-care nucleic acid extraction technologies for rapid diagnosis of human and plant diseases. Biosens Bioelectron. 2020;169: 112592. doi: 10.1016/j.bios.2020.112592 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Edgü G, Freund LJ, Hartje S, Tacke E, Hofferbert HR, Twyman RM, et al. Fast, precise, and reliable multiplex detection of potato viruses by loop-mediated isothermal amplification. Int J Mol Sci. 2020;21: 1–19. doi: 10.3390/ijms21228741 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Marty FM, Chen K, Verrill KA. How to Obtain a Nasopharyngeal Swab Specimen. N Engl J Med. 2020;382: e76. doi: 10.1056/NEJMvcm2010260 [DOI] [PubMed] [Google Scholar]
  • 41.CLIA University Lab Testing. 2020. https://www.cms.gov/files/document/clia-university-lab-testing.pdf
  • 42.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42: 377–381. doi: 10.1016/j.jbi.2008.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform. 2019;95: 103208. doi: 10.1016/j.jbi.2019.103208 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Dzung A, Cheng PF, Stoffel C, Tastanova A, Turko P, Levesque MP, et al. Prolonged Unfrozen Storage and Repeated Freeze-Thawing of SARS-CoV-2 Patient Samples Have Minor Effects on SARS-CoV-2 Detectability by RT-PCR. J Mol Diagnostics. 2021;23: 691–697. doi: 10.1016/j.jmoldx.2021.03.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Yamazaki W, Matsumura Y, Thongchankaew-Seo U, Yamazaki Y, Nagao M. Development of a point-of-care test to detect SARS-CoV-2 from saliva which combines a simple RNA extraction method with colorimetric reverse transcription loop-mediated isothermal amplification detection. J Clin Virol. 2021;136: 104760. doi: 10.1016/j.jcv.2021.104760 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Bhadra S, Riedel TE, Lakhotia S, Tran ND, Ellington AD. High-Surety Isothermal Amplification and Detection of SARS-CoV-2. Rasmussen AL, editor. mSphere. 2021;6: e00911–20. doi: 10.1128/mSphere.00911-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Myhrvold C, Freije CA, Gootenberg JS, Abudayyeh OO, Metsky HC, Durbin AF, et al. Field-deployable viral diagnostics using CRISPR-Cas13. Science. 2018;360: 444–448. doi: 10.1126/science.aas8836 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Yang Q, Meyerson NR, Clark SK, Paige CL, Fattor WT, Gilchrist AR, et al. Saliva TwoStep for rapid detection of asymptomatic SARS-CoV-2 carriers. Elife. 2021;10. doi: 10.7554/eLife.65113 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.MacDonald RJ, Swift GH, Przybyla AE, Chirgwin JM. Isolation of RNA Using Guanidinium Salts. Methods Enzymol. 1987;152: 219–227. doi: 10.1016/0076-6879(87)52023-7 [DOI] [PubMed] [Google Scholar]
  • 50.Cox RA. [103a] The use of guanidinium chloride in the isolation of nucleic acids. Methods Enzymol. 1968;12: 120–129. doi: 10.1016/0076-6879(67)12123-X [DOI] [Google Scholar]
  • 51.Singh R, Savargaonkar D, Bhatt R, Valecha N. Rapid detection of Plasmodium vivax in saliva and blood using loop mediated isothermal amplification (LAMP) assay. J Infect. 2013;67: 245–247. doi: 10.1016/j.jinf.2013.04.016 [DOI] [PubMed] [Google Scholar]
  • 52.de Almeida PDV, Grégio AMT, Machado MÂN, De Lima AAS, Azevedo LR. Saliva Composition and Functions: A Comprehensive Review. J Contemp Dent Pract. 2008;9: 72–80. doi: 10.5005/jcdp-9-3-72 [DOI] [PubMed] [Google Scholar]
  • 53.Nishibata Y, Koshimoto S, Ogaki K, Ishikawa E, Wada K, Yoshinari M, et al. RNase in the saliva can affect the detection of severe acute respiratory syndrome coronavirus 2 by real-time one-step polymerase chain reaction using saliva samples. Pathol Res Pract. 2021;220: 153381. doi: 10.1016/j.prp.2021.153381 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Sullivan R, Heavey S, Graham DG, Wellman R, Khan S, Thrumurthy S, et al. An optimised saliva collection method to produce high-yield, high-quality RNA for translational research. PLoS One. 2020;15: e0229791. doi: 10.1371/journal.pone.0229791 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Hasan HR, Al-Issa YAH. A Study of RNase Enzymes in Saliva Samples from Women with Breast Tumors. Med J Islam World Acad Sci. 2011;19: 21–26. [Google Scholar]
  • 56.Nairz M, Bellmann-Weiler R, Ladstätter M, Schüllner F, Zimmermann M, Koller A-M, et al. Overcoming limitations in the availability of swabs systems used for SARS-CoV-2 laboratory diagnostics. Sci Rep. 2021;11: 2261. doi: 10.1038/s41598-021-81782-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Turner F, Vandenberg A, Slepnev VI, Car S, Starritt RE, Seger MV, et al. Post-Disease Divergence in SARS-CoV-2 RNA Detection between Nasopharyngeal, Anterior Nares and Saliva/Oral Fluid Specimens—Significant Implications for Policy & Public Health. medRxiv. 2021. doi: 10.1101/2021.01.26.21250523 [DOI] [Google Scholar]
  • 58.Vogels CBF, Watkins AE, Harden CA, Brackney DE, Shafer J, Wang J, et al. SalivaDirect: A simplified and flexible platform to enhance SARS-CoV-2 testing capacity. Med. 2021;2: 263–280.e6. doi: 10.1016/j.medj.2020.12.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Landry ML, Criscuolo J, Peaper DR. Challenges in use of saliva for detection of SARS CoV-2 RNA in symptomatic outpatients. J Clin Virol. 2020;130: 104567. doi: 10.1016/j.jcv.2020.104567 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Hanson KE, Barker AP, Hillyard DR, Gilmore N, Barrett JW, Orlandi RR, et al. Self-collected anterior nasal and saliva specimens versus health care worker-collected nasopharyngeal swabs for the molecular detection of SARS-CoV-2. J Clin Microbiol. 2020;58: 1824–1844. doi: 10.1128/JCM.01824-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Nagura-Ikeda M, Imai K, Tabata S, Miyoshi K, Murahara N, Mizuno T, et al. Clinical Evaluation of Self-Collected Saliva by Quantitative Reverse Transcription-PCR (RT-qPCR), Direct RT-qPCR, Reverse Transcription–Loop-Mediated Isothermal Amplification, and a Rapid Antigen Test To Diagnose COVID-19. Miller MB, editor. J Clin Microbiol. 2020;58. doi: 10.1128/JCM.01438-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.La Scola B, Le Bideau M, Andreani J, Hoang VT, Grimaldier C, Colson P, et al. Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39: 1059–1061. doi: 10.1007/s10096-020-03913-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Walsh KA, Jordan K, Clyne B, Rohde D, Drummond L, Byrne P, et al. SARS-CoV-2 detection, viral load and infectivity over the course of an infection. J Infect. 2020;81: 357–371. doi: 10.1016/j.jinf.2020.06.067 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Engelmann I, Alidjinou EK, Ogiez J, Pagneux Q, Miloudi S, Benhalima I, et al. Preanalytical Issues and Cycle Threshold Values in SARS-CoV-2 Real-Time RT-PCR Testing: Should Test Results Include These? ACS Omega. 2021;6: 6528–6536. doi: 10.1021/acsomega.1c00166 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Jefferson T, Spencer EA, Brassey J, Heneghan C. Viral cultures for COVID-19 infectious potential assessment–a systematic review. Clin Infect Dis. 2020. doi: 10.1093/cid/ciaa1764 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Bektaş A, Covington MF, Aidelberg G, Arce A, Matute T, Núñez I, et al. Accessible LAMP-Enabled Rapid Test (ALERT) for Detecting SARS-CoV-2. Viruses. 2021;13: 742. doi: 10.3390/v13050742 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Amaral C, Antunes W, Moe E, Duarte AG, Lima LMP, Santos C, et al. A molecular test based on RT-LAMP for rapid, sensitive and inexpensive colorimetric detection of SARS-CoV-2 in clinical samples. Sci Rep. 2021;11: 16430. doi: 10.1038/s41598-021-95799-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Butler-Laporte G, Lawandi A, Schiller I, Yao M, Dendukuri N, McDonald EG, et al. Comparison of Saliva and Nasopharyngeal Swab Nucleic Acid Amplification Testing for Detection of SARS-CoV-2. JAMA Intern Med. 2021;181: 353–360. doi: 10.1001/jamainternmed.2020.8876 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Smithgall MC, Scherberkova I, Whittier S, Green DA. Comparison of Cepheid Xpert Xpress and Abbott ID Now to Roche cobas for the Rapid Detection of SARS-CoV-2. J Clin Virol. 2020;128: 104428. doi: 10.1016/j.jcv.2020.104428 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Basu A, Zinger T, Inglima K, Woo KM, Atie O, Yurasits L, et al. Performance of abbott id now covid-19 rapid nucleic acid amplification test using nasopharyngeal swabs transported in viral transport media and dry nasal swabs in a New York city academic institution. J Clin Microbiol. 2020;58. doi: 10.1128/JCM.01136-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Zhen W, Smith E, Manji R, Schron D, Berry GJ. Clinical evaluation of three sample-to-answer platforms for detection of sars-cov-2. J Clin Microbiol. 2020;58. doi: 10.1128/JCM.00783-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Zhu X, Wang X, Han L, Chen T, Wang L, Li H, et al. Multiplex reverse transcription loop-mediated isothermal amplification combined with nanoparticle-based lateral flow biosensor for the diagnosis of COVID-19. Biosens Bioelectron. 2020;166: 112437. doi: 10.1016/j.bios.2020.112437 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Robinson-McCarthy L, Mijalis AJ, Filsinger GT, de duig H, Donghia NM, Schaus TE, et al. New recommended policies for pathogen surveillance testing of researchers and improved stewardship of diagnostic DNA. 2020. doi: 10.1128/mBio.02772-20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Carter C, Akrami K, Hall D, Smith D, Aronoff-Spencer E. Lyophilized visually readable loop-mediated isothermal reverse transcriptase nucleic acid amplification test for detection Ebola Zaire RNA. J Virol Methods. 2017;244: 32–38. doi: 10.1016/j.jviromet.2017.02.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Chen HW, Weissenberger G, Ching WM. Development of lyophilized loop-mediated isothermal amplification reagents for the detection of Leptospira. Mil Med. 2016;181: 227–231. doi: 10.7205/MILMED-D-15-00149 [DOI] [PubMed] [Google Scholar]
  • 76.Chen HW, Ching WM. Evaluation of the stability of lyophilized loop-mediated isothermal amplification reagents for the detection of Coxiella burnetii. Heliyon. 2017;3: e00415. doi: 10.1016/j.heliyon.2017.e00415 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Zhu J, Guo J, Xu Y, Chen X. Viral dynamics of SARS-CoV-2 in saliva from infected patients. J Infect. 2020;81: e48–e50. doi: 10.1016/j.jinf.2020.06.059 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Wölfel R, Corman VM, Guggemos W, Seilmaier M, Zange S, Müller MA, et al. Virological assessment of hospitalized patients with COVID-2019. Nature. 2020;581: 465–469. doi: 10.1038/s41586-020-2196-x [DOI] [PubMed] [Google Scholar]
  • 79.Huang Y, Chen S, Yang Z, Guan W, Liu D, Lin Z, et al. SARS-CoV-2 viral load in clinical samples from critically ill patients. American Journal of Respiratory and Critical Care Medicine. American Thoracic Society; 2020. pp. 1435–1438. doi: 10.1164/rccm.202003-0572LE [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

A M Abd El-Aty

Transfer Alert

This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.

20 Sep 2021

PONE-D-21-25506Sample-to-answer, extraction-free, real-time RT-LAMP test for SARS-CoV-2 in nasopharyngeal, nasal, and saliva samples: Implications and use for surveillance testingPLOS ONE

Dear Dr. Richards-Kortum,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

ACADEMIC EDITOR: As appended below, the reviewers have raised major concern/critique and suggested further justification/work to consolidate the findings. Do go through the comments and amend the MS accordingly. 

Please submit your revised manuscript by Nov 04 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

A. M. Abd El-Aty

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

5. We note that Figure 1 in your submission contain [map/satellite] images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figure(s) [#] to publish the content specifically under the CC BY 4.0 license.  

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Overall the manuscript is well written and clear. There are a few sections where some of the methods for comparison are a bit low on numbers or used non-optimal specimens or controls. This does not add any unjustified conclusions, but could have more optimal conditions set. Here are following comments and recommendations for the manuscript.

Major Comments

What is the extraction method for the taqpath assay that was used for the RT-PCR reference method? This assay can have a variety of extraction methods that can have large differences on sensitivity.

What was the rationale for placing NP into 300uls and Nasal into 500uls. Although small, this dilution factor could cause some of the differences between sensitivity when comparing results.

The addition of multiple freeze thaws an cause degradation of specimens. Generally, a specimens should not go through more than 1 freeze thaw. Was any testing performed to determine that the CT values did not increase after each freeze thaw.

What was the rational for testing surveillance specimens in triplicate? Was this to increase sensitivity due to issues found in previous experiments?

Testing a subset of specimens for internal controls is not a traditional method. What was the number of specimens that failed and how often was re-testing needed.

For the surveillance testing, was all specimens also tested on a RT-PCR as a reference method. If so this comparison should be highlighted to discuss PPA and NPA.

Minor Comments

Ln89-103 This section is written as an abstract with data instead of a lead in for the introduction.

Overall the manuscript is a bit long and could have portions removed to make it a more concise manuscript. I would suggest modifying to reduce the length. Some examples that could be removed are parts of the materials and methods for example the NP collection method, methods for reducing cross contamination.

LoD study: The testing that was performed was with a construct quality control material instead of an inactivated virus. Was any testing performed with virus for sensitivity as the construct vs real virus could have downstream effects of extraction methods.

Figure 3 – What was the # of copies per… ml or ul?

When looking at the amount of saliva added to the specimens for saliva, what was the starting CT for those specimens, this can be from the NP sample.

Reviewer #2: A well written manuscript with very detail description of the methods and procedures.

The use of multiple primer sets can increase sensitivity, but it increases primer cost. Need some information on the cost difference.

The authors may want to address cross-contamination issue when the sample preparation step is done manually and pipetted into tubes.

The manuscript should address the total cost (including labor) needed to perform each LAMP test in the near POC (using Axxin device) and high throughput (using the Bio-Rad thermal cycle) settings versus real-time RT-PCR tests performed primarily in high throughput lab.

This work confirms the previous findings that samples with low Ct values were more commonly found in the asymptomatic surveillance population than the hospitalized population.

The manuscript stated that “sample collection, inactivation, and amplification requires <5 user steps, and results can be obtained in <1 hour.” It is unclear if this is for a single sample or the same turn-around-time can be obtained if 8 samples are collected and processed for the Axxin incubator/detector.

Overall, this manuscript provides readers with information on the success of using LAMP assay to perform surveillance testing in a university campus setting. I’d recommend it for publication with minor revision.

Reviewer #3: Thank you for inviting me to peer review the manuscript titled “Sample-to-answer, extraction-free, real-time RT-LAMP test for SARS-CoV-2 in nasopharyngeal, nasal, and saliva samples: Implications and use for surveillance testing" by Kathryn A. Kundrod et al. The authors optimized a RT-LAMP based nucleic acid test for SARS-CoV-2 detection for nasopharyngeal swabs, nasal swabs, and saliva collected from hospitalized patients. They used Hamilton Microlab Prep device to automate the procedure (It should be noted that currently a FDA EUA approved LAMP-based test is also available for home testing, Lucira COVID-19 All-In-One Test Kit, prescribed to be used in PoC and also at a home setting for suspected people older than 14. This is not mentioned in the manuscript). The manuscript is well written and could be interesting to the readers. After careful reading, I decide to accept this paper for publication.

Reviewer # 4:In this study, Kundrod et al. undertake broad validation of RT-LAMP for community-based screening that addresses many fundamental concerns about faster, simpler techniques being developed around the world in the wake of COVID-19. Through laboratory-based comparisons with the clinical standard, detailed description of LOD in different sample types and under various conditions in a clinical cohort, and application in a community-based setting with low incidence, the authors clearly demonstrate the utility of RT-LAMP to detect those with high levels of viral RNA more quickly than the current standard. The study is very well-written, with clearly explained objectives that seem highly relevant to those (like myself) who are new to the field. As a result, I can find very little to criticize about it, and can’t wait to apply the lessons described by the authors in my own work. If possible, it would be nice to see some additional discussion about the cost vs. benefit of the surveillance activities undertaken - how much did each of those 9 cases cost? How low does the cost have to be to justify detection of such a small proportion of positives? Practically speaking, won’t people just stick with symptom screening and hope for the best, because it is exponentially cheaper? The point about repeat testing vs. sensitivity is well-taken, since someone could have a low viral load just prior to peak infectivity. But information about how many asymptomatic individuals were tested how many times is not given. Individuals were tested weekly or bi-weekly, but based on your experience what would be the ideal time interval between samples, to minimize the amount of samples required to monitor a given population? Just out of curiosity, not because I think the paper requires any major revision.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Feb 25;17(2):e0264130. doi: 10.1371/journal.pone.0264130.r002

Author response to Decision Letter 0


3 Nov 2021

Thank you for the opportunity to revise our manuscript. Our response to specific reviewer comments was uploaded as an attached Reviewer Response file.

Attachment

Submitted filename: Response to Reviews_v3_clean.pdf

Decision Letter 1

A M Abd El-Aty

23 Nov 2021

PONE-D-21-25506R1Sample-to-answer, extraction-free, real-time RT-LAMP test for SARS-CoV-2 in nasopharyngeal, nasal, and saliva samples: Implications and use for surveillance testingPLOS ONE

Dear Dr. Richards-Kortum,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

ACADEMIC EDITOR: Still, reviewer # 2 is raising a major concern over the revised form of the MS. Do go through the comments and amend the MS accordingly. 

==============================

Please submit your revised manuscript by Jan 07 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

A. M. Abd El-Aty

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The manuscript submitted by Richards-Kortum et al entitled “Samples-to-answer, extraction-free real-time RT-LAMP test for SARS-CoV-2 in NP, NS, and saliva samples: Implications for surveillance testing” describes a study where the authors developed a RT-LAMP assay for detection of SARS-CoV-2 from NP, NS, and saliva samples. The assay uses 3 viral targets and an internal human control. Initially they optimized the assay for extraction and amplification using synthetic controls. When optimized they validated the assay with previous positive hospitalized patients. Results from these studies are similar with others where NP was most sensitive followed by NS and saliva samples. Also similar to other publications isothermal LAMP showed a reduced sensitivity compared to traditional RT-PCR assays. The authors then used the assay for a local screening of 400 individuals. A subset of positives was confirmed positive by a RT-PCR instrument. Overall, the manuscript is well written; however, these data are similar to other assays on the market. The most novel aspect is the surveillance testing, which could use some additional details and clarity. Prior to submission the following comments and suggestions should be addressed.

Major Comments

Validation patient samples were all identified as previous positive patients which can skew results for the validation due to a higher-than-average prevalence. I would suggest increasing the number of negative samples tested to adequately evaluate the specificity of the assay or at minimum discuss this as a limitation.

Figure 7: In the abstract the follow up screening was performed using 400 individuals, but the numbers in the text ln668 had 20,645 and all of these seem to be nasal and not saliva. The figure also has these listed out as nasal swabs. Additional clarification is needed for these numbers. Also, why were only 8 of the 136 followed up with confirmatory RT-qPCR testing. Could there be a risk of FP results as the NPA was not adequately evaluated in the validation.

You mention that during the screening period you saw an increase in positives with emergence of Delta variant. What percentage of the screened specimens were found to be presumptive positive during the Delta surge? This may be a reason why you see lower CT values in this cohort compared to hospitalized patients as Delta appears to have a higher viral load.

The manuscript is very detailed, but at this point of the pandemic there are several manuscripts detailing results that were found in the optimization of the assay and the most novel aspect of surveliiance testing at Rice is quickly summarized in the results and discussion. My suggestion is to move most of the optimization data to supplemental and create a short summary few paragraphs in either the results or discussion. This would allow you to expand discussion for the validation and surveillance data

Minor Comments

Abstract: Add data for > Ct 30

Introduction: Although it is well written, the introduction could be cut down. With the amount of literature in the field on SARS-CoV-2 I would remove lines 58-66 and could likely combine the first paragraph and the third.

Ln301: is the “was not” a typo, or did you use assent template for minors?

As you went back to patients that were positive for the validation, how long was the new collection from time of collection, especially as you continually discuss the viral load vs time course of infection.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Feb 25;17(2):e0264130. doi: 10.1371/journal.pone.0264130.r004

Author response to Decision Letter 1


23 Dec 2021

Thank you for the opportunity to revise our manuscript. Our responses to the reviewer comments are included in the uploaded Response to Reviewers document.

Attachment

Submitted filename: Response to Reviews 2_v3_clean.pdf

Decision Letter 2

A M Abd El-Aty

4 Feb 2022

Sample-to-answer, extraction-free, real-time RT-LAMP test for SARS-CoV-2 in nasopharyngeal, nasal, and saliva samples: Implications and use for surveillance testing

PONE-D-21-25506R2

Dear Dr. Richards-Kortum,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

A. M. Abd El-Aty

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #4: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #4: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #4: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #4: I have reviewed the paper in its current form, and as a whole the work seems to have been performed in a reasonable manner. I have two observations:

1. I do not agree with the author's decision to ignore a reviewer's suggestion that optimization information be placed in a supplemental appendix. I think the manuscript would be more readable if this were done. I suspect the vast majority of readers will just skim or skip over this part. My objection is not sufficiently strenuous to make me wish to bar publication on this basis, but I believe the editors should give this consideration.

2. The authors state that all their data is available, but they do not provide a link to a repository for deidentified data, or a supplemental appendix with full data. Thus, I DO NOT believe they have met the requirement for data availability.

Possibly I missed something in my review, but I did not find this information in either the original submission or either revision.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #4: No

Acceptance letter

A M Abd El-Aty

16 Feb 2022

PONE-D-21-25506R2

Sample-to-answer, extraction-free, real-time RT-LAMP test for SARS-CoV-2 in nasopharyngeal, nasal, and saliva samples: Implications and use for surveillance testing

Dear Dr. Richards-Kortum:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof. A. M. Abd El-Aty

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Multiplexed primer set selection.

    Synthetic SARS-CoV-2 RNA was prepared in nuclease-free water and amplified in RT-LAMP on the Bio-Rad CFX96 using multiplexed primer sets N2/E1 or N2/E1/As1e. (A) Average time to amplification by number of input copies and primer set. The number of replicates that amplified out of 6 is indicated on each bar. Error bars indicate standard deviation of replicates that amplified. (B) Real-time amplification curves for 5, 10, 20, and 50 input copies of RNA per reaction. ***indicates p≤.001; significance determined using an unpaired two-tailed t-test.

    (TIF)

    S2 Fig. Lysis buffer tolerance in RT-LAMP.

    Synthetic SARS-CoV-2 RNA was prepared in either nuclease-free water or 5X lysis buffer with 200 mM GuHCl at a concentration of 10 copies/μL (50 copies per reaction) and amplified in RT-LAMP on the Bio-Rad CFX96. Average time to amplification ± standard deviation is shown (n = 3 for each condition). Time to amplification is not significantly different between the two conditions (p≥0.6; significance determined using unpaired two-tailed t-test).

    (TIF)

    S3 Fig. Saliva heat inactivation time.

    Negative pooled saliva was spiked with Zeptometrix pseudovirus to achieve a concentration of 100 copies/μL, then combined with lysis buffer and heat inactivated at 95°C for 5–10 minutes. The resulting lysate was amplified in RT-LAMP on the Bio-Rad CFX96. Average time to amplification was not statistically different between the heat inactivation time conditions (n = 6 per condition; p = 0.72 determined by one-way ANOVA) but variability of time to amplification was reduced at 6 and 7 minutes of heating.

    (TIF)

    S4 Fig. Nasal optimization.

    (A) Collection method optimization. Comparison of RT-qPCR results on nasal samples collected with various swabs and swabbing strategies. Nasal RT-qPCR results are stratified by the Ct value of the paired nasopharyngeal swab. (B) Ct (RT-qPCR) or average time to amplification in RT-LAMP (5 μL, 7 μL, 9 μL, indicating sample volume; n = 3 for each condition) of a subset of nasal samples that were initially discordant with RT-qPCR or inconclusive in RT-LAMP with 5 μL samples. Data shown by sample number in order of increasing Ct values; # indicates conditions where only 1 of 3 replicates amplified, ## indicates conditions where 2 of 3 replicates amplified.

    (TIF)

    S5 Fig. Saliva optimization.

    (A) Collection method optimization. Comparison of RT-qPCR results on saliva samples collected with various methods, including by swab or sponge, passive drool directly into buffer resulting in variable saliva to buffer ratios, or metering buffer into drool at a controlled ratio. Saliva RT-qPCR results are stratified by the Ct value of the paired nasopharyngeal swab. (B) Ct (RT-qPCR) or average time to amplification in RT-LAMP (2.5 μL, 3.75 μL, 5 μL, indicating sample volume; n = 3 for each condition) of a subset of saliva samples that were initially discordant with RT-qPCR with 5 μL samples. Data shown by sample number in order of increasing Ct values; # indicates conditions where only 1 of 3 replicates amplified, ## indicates conditions where 2 of 3 replicates amplified.

    (TIF)

    S6 Fig. Validation of optimal saliva volume.

    (A) RT-LAMP results for saliva samples tested on the Bio-Rad CFX96, plotted by Ct value of the corresponding RT-qPCR result, using 5 μL sample volume (left) and 3.75 μL sample volume (right), with a table below summarizing positive percent agreement and 95% confidence intervals at different Ct thresholds. (B) RT-LAMP result of saliva samples on the Axxin T8, plotted by Ct value of the corresponding RT-qPCR result, using 10 μL sample volume (left) and 7.5 μL sample volume (right), with a table below summarizing positive percent agreement and 95% confidence intervals at different Ct thresholds.

    (TIF)

    S7 Fig. RT-LAMP performance compared to RT-qPCR on nasal swabs.

    (A) Nasal RT-qPCR results are stratified by the Ct value of the paired nasopharyngeal swab. The table below the graph summarizes percent agreement and 95% confidence intervals at different Ct thresholds. (B) Saliva LAMP and Nasal LAMP results from samples tested on the Bio-Rad CFX96 are stratified by the Ct value of the paired nasopharyngeal swab, with tables summarizing percent agreement and 95% confidence intervals at different Ct thresholds.

    (TIF)

    S8 Fig. Cumulative presumptive positive samples in LAMP testing.

    Cumulative number of samples with presumptive positive results by date. Dashed line: university guidance that fully vaccinated individuals no longer need to test (23 April 2021); dotted line: university guidance that fully vaccinated individuals should resume testing (3 August 2021).

    (TIF)

    S1 Table. Test comparison.

    Summary of estimated equipment costs, reagent and consumable costs, personnel time, user steps, and limit of detection for RT-qPCR tests and RT-LAMP tests for SARS-CoV-2.

    (TIF)

    S1 Data

    (XLSX)

    Attachment

    Submitted filename: Response to Reviews_v3_clean.pdf

    Attachment

    Submitted filename: Response to Reviews 2_v3_clean.pdf

    Data Availability Statement

    All relevant data are within the manuscript and its Supporting information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES