Abstract
The COVID-19 pandemic caused by the SARS-CoV-2 is a serious health threat causing worldwide morbidity and mortality. Real-time reverse transcription PCR (RT-qPCR) is currently the standard for SARS-CoV-2 detection. Although various nucleic acid-based assays have been developed to aid the detection of SARS-CoV-2 from COVID-19 patient samples, the objective of this study was to develop a diagnostic test that can be completed in 30 minutes without having to isolate RNA from the samples. Here, we present an RNA amplification detection method performed using reverse transcription loop-mediated isothermal amplification (RT-LAMP) reactions to achieve specific, rapid (30 min), and sensitive (<100 copies) fluorescent detection in real-time of SARS-CoV-2 directly from patient nasopharyngeal swab (NP) samples. When compared to RT-qPCR, positive NP swab samples assayed by fluorescent RT-LAMP had 98% (n = 41/42) concordance and negative NP swab samples assayed by fluorescent RT-LAMP had 87% (n = 59/68) concordance for the same samples. Importantly, the fluorescent RT-LAMP results were obtained without purification of RNA from the NP swab samples in contrast to RT-qPCR. We also show that the fluorescent RT-LAMP assay can specifically detect live virus directly from cultures of both SARS-CoV-2 wild type (WA1/2020), and a SARS-CoV-2 B.1.1.7 (alpha) variant strain with equal sensitivity to RT-qPCR. RT-LAMP has several advantages over RT-qPCR including isothermal amplification, speed (<30 min), reduced costs, and similar sensitivity and specificity.
Introduction
COVID-19 is a pandemic disease caused by SARS-CoV-2 [1, 2]. The animal reservoir for SARS-CoV-2 is unknown, but it is believed to be of zoonotic origin as SARS-CoV-2 isolates from bats and pangolins are genetically related to human isolates [3, 4]. SARS-CoV-2 has initiated a pandemic, and according to the WHO Coronavirus (COVID-19) Detailed Surveillance Data Dashboard, currently there are more than 170 million confirmed COVID-19 cases and more than 3.8 million deaths from COVID-19 worldwide. SARS-CoV-2 is an RNA virus with a genome that encodes four structural proteins, i.e. the spike (S) protein, the envelope (E) protein, the membrane (M) protein and the nucleocapsid (N) protein, and the remainder polyproteins that are cleaved into various non-structural proteins important for replication [5, 6]. SARS-CoV-2 infects a variety of cell types by binding to its receptor, i.e. angiotensin-converting enzyme-2 (ACE2) by the receptor-binding domain (RBD) on the spike (S) protein that is proteolytically-activated by human serine proteases [7, 8]. Cell entry depends on binding of the surface unit, S1, of the S protein to ACE2 to facilitate viral attachment to the target cells, and entry requires S protein cleavage at the S1/S2 and the S2’ site and allows fusion of viral and cellular membranes, a process driven by the S2 subunit [9]. The virus is transmitted from person to person through aerosol [10, 11]. The pathological symptoms of infection can vary but include influenza-like respiratory illness, dry cough, fever, and pulmonary complications [12], however many SARS-CoV-2 infected individuals are asymptomatic and capable of increasing the spread of the disease [13, 14]. Researchers are currently testing 100 vaccines in clinical trials on humans, and several have reached the final stages of testing. Three COVID-19 vaccines to date have been authorized and recommended for use in the United States, i.e. the Pfizer-BioNTech mRNA vaccine, the Moderna mRNA vaccine, and the Janssen-Johnson & Johnson viral vector vaccine [15]. Therefore, precautions to control disease and infection prevention practices are critical and need to be supported by diagnostics, which is a crucial component when caring for a patient with suspected or confirmed SARS-CoV-2 infection.
In addition to the Centers for Disease Control and Prevention (CDC) RT-PCR SARS-CoV-2 test [16], many other diagnostic tests have recently become available. RT-qPCR is the gold standard in diagnostic testing but its use is expensive, time-consuming, and labor-intensive. An advantage of RT-qPCR is the ability to tune the reaction using multiple temperatures allowing for multiplex target discrimination, optimized primer annealing, denaturation, and extension. Further, these properties can be adjusted at each cycle, and RT-qPCR can monitor reaction progress by non-specific dyes (e.g., SYBR Green) or TaqMan probes [17]. However, isothermal detection platforms offer key advantages over RT-qPCR platforms in terms of reduced cost, speed, and reduced labor yet have the same sensitivity. Specifically, isothermal detection platforms allow amplification at constant temperatures and avoid the need for thermal cycling required for RT-qPCR. Here, we describe a one-step isothermal amplification/detection method that is amenable to lab-based or POC/field deployment. Loop-mediated isothermal amplification (LAMP) reactions use a strand-displacing DNA polymerase (and reverse transcriptase for RNA targets) with four to six primers resulting in exponential amplification [18, 19]. LAMP is a one-step reaction allowing all the primers and enzymes to be incubated isothermally in a single step. Reverse transcription LAMP (RT-LAMP) is useful for detecting RNA-based viruses as it combines conventional LAMP with a reverse transcriptase enzyme, allowing for simultaneous reverse transcription and amplification. The endpoint for LAMP can be real-time detection using fluorescence or absorbance [20]. The RT-LAMP assay has been shown to detect SARS-CoV-2 in ≤30 minutes using patient samples such as saliva and nasopharyngeal swabs [21, 22]. However, to achieve these results, the sample preparation includes a viral RNA extraction step that increases the cost and time required to perform the assay. The LAMP detection step is performed using direct visual assessment of color change using an indicator to show a positive reaction, e.g. a shift from dark blue to lighter blue using hydroxynaphthol blue [23, 24], or pink to yellow using creosol red [25]. However, the assessment of color change has issues including unexpected signals derived from primer-dimer and/or non-primer reactions. Fluorescent dyes can be used in the LAMP reaction for fluorescence monitoring which improves detection and solves the problem of non-primer-derived signals [26, 27]. Thus, RT-LAMP has several advantages over RT-qPCR, and when fluorescence is used as an endpoint for RT-LAMP there is also improved detection arguing fluorescent RT-LAMP superiority [28]. Further, fluorescent RT-LAMP can be deployed as a point-of-care (POC) test filling a role that is vital for disease management and control.
Materials and methods
Fluorescent RT-LAMP reactions
All RT-LAMP reactions were performed using a Warm Start LAMP 2X master mix (New England Biolabs, Ipswitch, MA, USA) and an AriaMX Real-Time PCR System machine (Agilent Technologies, Santa Clara, CA) for 30 min and monitored once per minute for fluorescence in the SYBR/FAM channel. Reactions contained warm Start LAMP Kit 2X Master Mix (12.5 μl NEB), LAMP primer mix (10X, 2.5 μl, IDT), assay target (RNA, or live virus, or clinical specimen, 2 μl), SYBR-like fluorescent dye diluted 8-fold in deionized water (50X, 0.5 μl, NEB) and deionized water (7.5 μl) for a total of 25 μl. The 10X LAMP primer mix contained FIP/ BIP at 10μM, LF/ LB at 2 μM and 4 μM, respectively, prepared in deionized RNAse DNAse free water. Primers were designed from multiple alignments of SARS-CoV-2 N gene (nts 251–468) with (USA-WA1/2020, GenBank accession number MN985325.1) as a reference genome using PrimerExplorer V software. Primers were commercially synthesized by Integrated DNA technologies (IDT, Coralville, IA) (S1 Table). Final concentrations of RT-LAMP primers LAMP primers (S1 Table) were used for the fluorescent reaction: FIP/BIP 1.0 μM, F3/B3, and LF/LB primers were used at 0.2 μM and 0.4 μM, respectively.
Preparation of RT-LAMP templates
NP swab samples / cell culture derived virus
For NP swabs, a 20 μl aliquot was mixed 1:1 (v:v) with 2X LAMP Lysis Buffer (LLB): 2% Triton X-100 (Sigma, St. Louis, MO) adjusted to pH = 8.0 with 2M Tris-HCL (Sigma, St. Louis, MO) and 80 U/ml Proteinase K (NEB) followed by incubation at room temperature (RT) for 15 min, then incubation at 95°C for 10 min to inactivate the Proteinase K. The patient sample lysate (2 μl) was used as target directly in the fluorescent RT-LAMP reactions without further processing. Fluorescent RT-LAMP reactions using virus-infected cell culture supernatant samples were used to detect live viruses. SARS-CoV-2 (USA-WA1/2020, GenBank: MN985325.1), and alpha variant B1.1.7 (20I/501Y.V1, GenBank: MW422255.1), human coronavirus strains, OC43 (GenBank: AY585228.1), 229E (GenBank: AF304460.1), and NL63 (GenBank: AY567487.2) (BEI Resources, USA) were used to infect Vero cells and cultured to 107 PFU/ml. A 20 μl aliquot of the infected cell culture supernatants was mixed with 20 μl of 2X LLB and incubated at RT for 15 min followed by 10 min 95°C incubation to inactivate Proteinase K. Fluorescent RT-LAMP was performed using 2 μl of the sample lysate.
Fluorescent RT-LAMP reaction using virus-infected cell culture supernatant samples
An identical process was used to detect live viruses. SARS-CoV-2 (USA-WA1/2020, GenBank: MN985325.1), and alpha variant B.1.1.7 (20I/501Y.V1, GenBank: MW422255.1) were inoculated on Vero cells and cultured to 107 pfu/ml. A 20 μl aliquot of the infected cell culture supernatants was mixed with 20 μl of 2X LLB and incubated at RT for 15 min followed by 10 min 95°C incubation to inactivate Proteinase K. Fluorescent RT-LAMP was performed using 2 μl of the sample lysate. We also examined human coronavirus strains, OC43 (GenBank: AY585228.1), 229E (GenBank: AF304460.1), and NL63 (GenBank: AY567487.2), all of which were obtained from BEI Resources and cultured using Vero cells for detection in fluorescent RT-LAMP as specificity controls.
Optimizing the limit of detection/fluorescent end-point cutoff
The fluorescent LAMP reaction contained an intercalating fluorescent SYBR-like dye with excitation (λExci = 497 nm) and emission (λEmis = 520 nm) when complexed with the double-stranded DNA LAMP reaction product. This allowed for easy monitoring of the accumulation of double-stranded DNA in the RT-LAMP reaction with a real-time thermocycler using a standard SYBR/FAM channel for fluorescence. Using a log dilution series (ranging from 108 to 10 copies of the N gene) of purified RNA templates described below (N gene IVT RNA and viral genomic RNA), we measured the signal from the fluorescent RT-LAMP reaction at 1 min intervals analogous to a standard dye-based RT-qPCR reaction utilizing a 30 min total time cut-off. The results were compared to the cycle threshold (Ct) values obtained from our RT-qPCR assay (described below) for the same purified RNA templates. In the fluorescent RT-LAMP reaction, the purified RNA templates representing ~100 copies or more of the N gene generated strong fluorescence by 30 min and were readily detectable by RT-qPCR. RNA templates diluted beyond 10 copies of the N gene did not generate fluorescence signal within 30 min in fluorescent RT-LAMP and were negative in RT-qPCR with a cut-off of 40 cycles. Based on this observation, and consistent with other related RT-LAMP publications [29, 30], we used fluorescence at 30 min to determine whether a sample was positive or negative.
RT-qPCR
Serial log dilutions of a 2019-nCoV_N_positive control plasmid (IDT) containing the SARS-CoV-2 (Wuhan-Hu-1 strain, GenBank: MN908947) N gene from 105 copies/μl to 1 copy/μl, or SARS-CoV-2 genomic viral RNA (vRNA), or SARS-CoV-2 N gene in vitro transcribed RNA (IVT RNA) from 1ng/μl to 0.1fg/μl corresponding to 107 copies/μl to 1 copies/μl, or 108 copies/μl to 10 copies/μl, respectively, were prepared in nuclease-free water. Nuclease-free water was used as a no-template control for all reactions. The SARS-CoV-2 RNA templates were added to LunaScript RT SuperMix (NEB) at 2 μl in a 20 μl reaction and reverse transcribed for 10 min at 55°C. The cDNA from this reaction was used directly at 1 μl in a 20 μl reaction with Luna Universal Probe qPCR Master Mix (NEB) and 1 μl of the SARS-CoV-2 CDC EUA N1 probe assay (IDT) and amplified for 40 cycles in a two-step reaction (15s/95°C, and 30s/60°C) after an initial 1 min pre-amplification hold at 95°C on an AriaMx Real-Time PCR System (Agilent). SARS-CoV-2 plasmid DNA was RT-qPCR amplified by adding 1 μl to a 20 μl reaction with the same qPCR master mix and probe assay using the same two-step amplification protocol after an initial 3 min pre-amplification hold at 95°C. Results from the N gene control plasmid were used to construct a standard curve relating the N gene copy number to RT-qPCR Ct values (S3 Fig). The N gene copy numbers of the SARS-CoV-2 IVT RNA or SARS-CoV-2 genomic vRNA per unit mass were extrapolated from this curve.
For analysis of clinical samples, RNA was extracted from 200 μl of patient nasopharyngeal swab liquid in saline using the RNAdvance Viral Reagent Kit (Beckman Coulter, Indianapolis, IN) and eluted in a final volume of 40 μl of nuclease-free water. RT-qPCR analysis of purified RNA from patient samples as described above was performed using the CDC EUA N1 probe assay and the CDC EUA human RNAseP internal control probe assay to validate sample RNA extraction in separate reactions.
SARS-CoV-2 RNA
Genomic RNA from SARS-CoV-2 (USA-WA1/2020 GenBank: MN985325.1) and the SARS-CoV-2 variant B.1.1.7 (SARS-CoV-2/human/USA/SEARCH-5574-SAN/2020 GenBank: MW422255.1) was purified from 200 μl of virus-infected Vero cell culture supernatant using an RNAeasy kit (Qiagen) according to the manufacturer’s instructions and eluted in 40 μl of nuclease-free deionized water and stored at -80°C.
In vitro transcribed (IVT) RNA
The 1260 bp complete coding sequence of SARS-CoV-2 Wuhan-Hu-1 strain N gene (GenBank: MN908947) was amplified from 2019-nCoV_N_Positive Control plasmid (IDT) using primers (IDT) SARS2N_F and SARS2N_R (S1 Table) in standard end-point PCR with Q5 DNA polymerase (NEB). The PCR band representing the N gene coding sequence was subcloned into plasmid pMiniT2.0 (NEB) with the 5’ end of the coding sequence proximal to the vector-provided T7 polymerase promoter and confirmed by Sanger sequencing. HiScribe T7 RNA Synthesis Kit (NEB) was used to produce the SARS-CoV-2 N gene single-stranded positive-sense RNA via in-vitro transcription from the pMiniT2.0 construct. The IVT RNA was digested with DNase1 (NEB) and purified using RNAClean XP (Beckman Coulter). Purified IVT RNA was eluted in nuclease-free water, adjusted to a final concentration of 1 μg/μl in nuclease-free water, and stored at -80°C.
Analysis of NP swab samples
Deidentified samples were collected from consenting adult volunteers by the Georgia National Guard or the University of Georgia (UGA) COVID-19 Task Force following written approval and were tested from frozen -80°C samples collected by the Georgia Taskforce for COVID-19, the Georgia National Guard, or the University of Georgia Diagnostic Laboratories. NP samples were collected using a sterile swab applicator that was placed in 1 mL of saline. The University of Georgia (UGA) Diagnostic Laboratories determined the SARS-CoV-2 status of the NP samples using an Applied Biosystems TaqPath COVID-19 EUA assay (ThermoFisher) to detect SARS-CoV-2 RNA in a multiplex RT-qPCR format. The assay is specific for three SARS-CoV-2 genome regions, i.e. spike (S) gene, nucleocapsid (N) gene, and orf-1ab. We analyzed the same NP samples using the CDC EUA N1 RT-qPCR assay for the detection of SARS-CoV-2 RNA. The CDC EUA N1 RT-qPCR assay is singleplex and specific for the SARS-CoV-2 N gene. Fifty SARS-CoV-2 positive samples and 84 SARS-CoV-2 negative samples were tested in our laboratory using the CDC EUA N1 RT-qPCR assay to detect the N gene sequence. All NP samples were subsequently tested in a fluorescent RT-LAMP assay for comparative SARS-CoV-2 diagnostic analysis with CDC EUA N1 RT-qPCR assay.
Results
Analytical sensitivity of fluorescent RT-LAMP using IVT RNA and genomic viral RNA
We examined the sensitivity of the fluorescent RT-LAMP assay, by comparison, to the CDC EUA N1 RT-qPCR assay. The limit of detection (LOD) in the RT-qPCR assay using SARS-CoV-2 (Wuhan-Hu-1) IVT RNA was 0.1 fg of RNA corresponding to 10 copies of the N gene sequence (Fig 1). The LOD by RT-qPCR was 100 copies of purified viral genomic RNA from SARS-CoV-2 USA-WA1/2020 (S1A Fig). The fluorescent RT-LAMP assay rapidly and sensitively detected SARS-CoV-2 IVT RNA with a LOD of approximately 10–100 N gene copies with efficient isothermal amplification across seven logs of target concentration (Fig 2). The fluorescent RT-LAMP assay can detect 100 copies of SARS-CoV-2 (USA-WA1/2020 GenBank: MN985325.1) viral genomic RNA equaling the sensitivity of RT-qPCR (S1B Fig).
Fluorescent RT-LAMP detects the SARS-CoV-2 B.1.1.7 (alpha) variant
SARS-CoV-2 (WA1/2020) or SARS-CoV-2 B1.1.7 (alpha) variant (20I/501Y.V1) infected (MOI = 0.1) Vero cell culture supernatants were examined by fluorescent RT-LAMP. We demonstrated that the fluorescent RT-LAMP assay successfully detected the SARS-CoV-2 B1.1.7 (alpha) variant with equal sensitivity to that of SARS-CoV-2 at a LOD of approximately 100 pfu/ml (Fig 3A and 3B). To confirm RT-LAMP specificity, we tested human coronavirus strains, OC43 (GenBank: AY585228.1), 229E (GenBank: AF304460.1), and NL63 (GenBank: AY567487.2) infected (MOI = 1.0) Vero cells. All human coronavirus strains tested did not produce a detectable fluorescent signal in the fluorescent RT-LAMP assay (Fig 3C). The sensitivity of fluorescent RT-LAMP detection of both the variant and the wild-type SARS-CoV-2 strains compared favorably with the RT-qPCR results for RNA purified from an equivalent amount of SARS-CoV-2 infected Vero cell culture supernatant (Fig 4).
Fluorescent RT-LAMP detects SARS-CoV-2 in nasopharyngeal swab samples
We determined the presence of SARS-CoV-2 directly in clinical nasopharyngeal swab samples collected from patients using fluorescent RT-LAMP. Nasal swabs and NP swabs from suspected COVID-19 patients were collected by personnel from the Georgia COVID-19 Task Force and the University of Georgia Diagnostic Laboratories and confirmed positive or negative for SARS-CoV-2 using an Applied Biosystems TaqPath COVID-19 EUA kit to detect SARS-CoV-2 RNA in a multiplex RT-qPCR format. In comparing fluorescent RT-LAMP to RT-qPCR, we chose to evaluate the singleplex N gene-specific SARS-CoV-2 CDC EUA N1 RT-qPCR assay since it shares close target specificity with our fluorescent RT-LAMP assay (S1 Table). Using the same NP samples, we used the CDC EUA N1 RT-qPCR assay on both SARS-CoV-2 positive (n = 50) and SARS-CoV-2 negative (n = 84) NP samples in triplicate. Positive samples in the CDC EUA N1 RT-qPCR probe assay with Ct values <40 for each of the three repeat samples were considered N gene positives in our comparative analysis. We determined that 84% (n = 42/50) of the previously established SARS-CoV-2 positive NP samples were N gene-positive (Ct<40) by the CDC EUA N1 RT-qPCR assay for each of three repeat measurements (Table 1). The mean Ct of the SARS-CoV-2 N gene-positive NP samples (n = 42) ranged from 16 to 34 cycles with an overall mean Ct of 25.7, 95% CI [24–27] using the SARS-CoV-2 CDC EUA N1 RT-qPCR assay. Negative samples with no Ct value in the CDC EUA N1 RT-qPCR assay for any of three repeat measurements were considered true N gene negatives. For the previously confirmed SARS-CoV-2 negative NP samples, we determined that 81% (n = 68/84) gave matching N gene negative results, i.e. no Ct value in any of the three repeat measurements using the SARS-CoV-2 CDC EUA N1 RT-qPCR assay (Table 2).
Table 1. Fluorescent RT- LAMP on SARS-CoV-2 positive NP swab samples.
SARS-CoV-2 CDC EUA N1 RT-qPCR Mean Ct [95%CI] | Number of Samples | RT-LAMP Concordant Results (%) | RT-LAMP Discordant Results (%) | Mean RT-LAMP (min) [95% CI] |
---|---|---|---|---|
Below assay cut-off (Ct<40) M = 25.7, 95% CI [24.0–27.3] | 42 | 41 (98) | 1 (2) | mean = 23 |
95% CI [22– 24] | ||||
No Ct | 8 | 1 (12) | 7 (88) | na |
Positive samples | 50 | 42 (84) | 8 (16) | na |
Patient samples were previously confirmed as SARS-CoV-2 positive or negative by the UGA Diagnostic Laboratories using the ThermoFisher Applied Biosystems TaqPath COVID-19 EUA Combo Kit to detect SARS-CoV-2 RNA in a multiplex RT-qPCR format specific for three SARS-CoV-2 genome regions: S gene, N gene, and orf-1ab. We further analyzed the same NP samples by RT-qPCR using the singleplex CDC EUA N1 probe assay with a cut-off of 40 cycles, and the N gene-specific fluorescent RT-LAMP assay with a cut-off at 30 min. FIP/BIP, F3/B3, and LF/LB primers and an SYBR-like fluorescent dye were used in the RT-LAMP assay. The SARS-CoV-2 positive sample fluorescent RT-LAMP results (n = 50) were grouped according to their CDC EUA N1 RT-qPCR assay result: samples below the assay cut-off (Ct<40) n = 42/50, or samples above the assay cut-off (no Ct) n = 8/50. The number of positive samples having a fluorescent RT-LAMP assay value less than the 30 min assay cut-off (n = 41/42) has concordant results to RT-qPCR for these samples. One specimen (n = 1/42) had discordant results in the fluorescent RT-LAMP assay as it failed to produce a signal above the background in the 30 min assay time. The average fluorescent RT-LAMP assay value (23 minutes) is calculated for the group of positive samples (n = 41) at the 95%CI, 23 [22–24]. Samples having (no Ct) result in RT-qPCR (8/50) had discordant fluorescent RT-LAMP results signified by a positive signal in the RT-LAMP assay (n = 7/8). Fluorescent LAMP is measured by the time in minutes required to generate fluorescence signal (ΔR) over baseline in the assay.
Table 2. Fluorescent RT- LAMP of SARS-CoV-2 negative NP swab samples.
SARS-CoV-2 CDC EUA N1 RT-qPCR Result | Number of Samples | RT-LAMP Concordant Results (%) | RT-LAMP Discordant Results (%) |
---|---|---|---|
No Ct | 68 | 59 (87) | 9 (13) |
Below assay cut-off (Ct<40) | 16 | 7 (44) | 9 (56) |
All Negative samples | 84 | 66 (79) | 18 (21) |
NP samples were previously confirmed as SARS-CoV-2 positive or negative by the UGA Diagnostic Laboratories using the ThermoFisher Applied Biosystems TaqPath COVID-19 EUA Kit to detect SARS-CoV-2 RNA in a multiplex RT-qPCR format specific for three SARS-CoV-2 genome regions: S gene, N gene, and orf-1ab. We further analyzed the same NP samples by RT-qPCR using the singleplex CDC EUA N1 probe assay with a cut-off of 40 cycles, and the N gene-specific fluorescent RT-LAMP assay with a cut-off at 30 min. FIP/BIP, F3/B3, and LF/LB primers and an SYBR-like fluorescent dye were used in the RT-LAMP assay. The SARS-CoV-2 negative sample fluorescent RT-LAMP results (n = 84) were grouped according to their CDC EUA N1 RT-qPCR assay result: samples showing No Ct (n = 68/84), or samples having Ct below the assay cut-off Ct<40 (n = 16/84). N = 68 of the negative NP samples failed to signal in our RT-qPCR assay, as expected. Of this group, n = 59/68 gave concordant fluorescent RT-LAMP assay results failing to signal above baseline in the 30 min assay time, and n = 9/68 gave discordant fluorescent RT-LAMP assay results signified by a positive fluorescent RT-LAMP signal in the 30 min assay time. Some of the negative NP samples gave RT-qPCR Ct values below the assay cut-off (n = 16/84) suggesting a positive result. This is unexpected from negative samples but likely is related to the differential specificities between our singleplex CDC EUA N1 RT-qPCR assay and the multiplex RT-qPCR assay used by the UGA Diagnostic Laboratories. Of this group of samples, n = 7/16 also gave a positive fluorescent RT-LAMP signal, while n = 9/16 failed to signal above baseline in the 30 min assay time. Fluorescent RT-LAMP is measured by the time in minutes required to generate fluorescence signal (ΔR) over baseline in the assay.
The fluorescent RT-LAMP assays were performed in triplicate using the same NP samples that were previously determined to be positive for SARS-CoV-2 (n = 50) by the UGA Diagnostic Laboratories. The fluorescent RT-LAMP assay values for the SARS-CoV-2 N gene-positive NP samples ranged from 18 to 28 minutes with an overall mean of 23 minutes and 95% CI [22–24]. The results for N gene-positive NP samples showed 98% (n = 41/42) concordance with RT-qPCR for SARS-CoV-2 positivity (Table 1). N gene NP samples with no Ct result in the CDC EUA N1 RT-qPCR assay (8/50) had discordant fluorescent RT-LAMP results as indicated by a positive signal in the RT-LAMP assay (n = 7/8).
A fluorescent RT-LAMP assay was performed on the same NP samples that were previously shown to be SARS-CoV-2 negative (n = 84) by the UGA Diagnostic Laboratories. Results for the fluorescent RT-LAMP assay on the N gene negative NP samples showed 87% (n = 59/68) concordance with RT-qPCR for SARS-CoV-2 (Table 2), while 13% (n = 9/68) of N gene negative samples gave discordant fluorescent RT-LAMP assay results as determined by a positive result in the 30 minute assay time. When compared to RT-qPCR, N gene-positive samples assayed by fluorescent RT-LAMP had 98% (n = 41/42) concordance, while fluorescent RT-LAMP values were 87% (n = 59/68) concordant with RT-qPCR. Importantly, the fluorescent RT-LAMP assay results were obtained without purification of RNA from the NP samples in contrast to the RT-qPCR assay protocol.
Discussion
The benchmark method for the detection of SARS-CoV-2 from patient samples is the RT-qPCR assay requiring RNA extraction, highly trained laboratory personnel, and expensive equipment and reagents. Currently, the majority of clinical diagnosis for SARS-CoV-2 are performed by central testing laboratories that typically takes >24h for return of results. These clinical RT-qPCR assays are used typically with symptomatic patients, are not required to be low-cost, but rely on their analytical sensitivity to produce a definitive diagnosis even if only a single testing opportunity is available. Diagnostic assays used in surveillance are designed to detect the prevalence of SARS-CoV-2. These tests should be cost-effective, rapid, and easy to perform allowing for frequent testing. We sought to improve upon SARS-CoV-2 diagnostic testing by reducing the time for confirmation of a result, lowering costs to acquire the results, and developing a reliable, sensitive, and specific rapid assay. Many emerging studies have shown that RT-LAMP can meet these requirements for screening and testing for SARS-CoV-2 and potentially be a complementary tool to RT-qPCR [18, 31, 32]. Several RT-LAMP studies have focused on developing point-of-care (POC) diagnostic assays by detection of SARS-CoV-2 RNA in clinical samples [33, 34]. Other POC RT-LAMP studies have developed assays to allow multiplexing of more than one genomic target, while others have focused on optimizing RT-LAMP conditions to improve detection of SARS-CoV-2 genomes [35], but direct detection of the virus has been limited.
In this study, we show that fluorescent RT-LAMP has similar performance to RT-qPCR in detecting SARS-CoV-2 from the same clinical samples, and importantly, that fluorescent RT-LAMP can sensitively and reliably detect virus from only minimally pre-processed nasal swabs. Despite differences in SARS-CoV-2 detection in NP samples between the multiplex assay and the RT-LAMP assay, we believe that comparative sensitivity and specificity is important for accelerating diagnostic applications. Likely, the broad target specificity associated with the multiplex RT-qPCR assay used by the UGA Diagnostic Laboratories may in part account for the difference in sensitivity we obtained on the same NP samples using the singleplex CDC EUA N1 RT-qPCR assay. It is also possible that RNA degradation of the NP samples may have occurred by the time we obtained them as they were stored in saline and subsequently underwent several freeze-thaw cycles which may have contributed to differences in sensitivity associated with our RT-qPCR assay.
Of the group of SARS-CoV-2 positive NP samples from the UGA Diagnostic Laboratories, we found 84% (n = 42/50) to be N gene-positive as determined by our RT-qPCR assay. Importantly, fluorescent RT-LAMP assay results were 98% (n = 41/42) concordant as N gene-positive samples. Eight SARS-CoV-2 positive NP samples determined by the UGA Diagnostic Laboratories failed to amplify the N gene target in our RT-qPCR assay. However, the internal control amplicon (human RNase P) amplified in all NP samples tested s that the extracted RNA was intact. We found n = 7/8 positive NP samples by the fluorescent RT-LAMP assay for the failed RT-qPCR NP samples which was discordant with our RT-qPCR result for these NP samples but in agreement with NP samples showing SARS-CoV-2 positive standing by the UGA Diagnostic Laboratories. This may suggest that sample preparation differences (e.g. RNA purification for RT-qPCR or the minimal pre-processing for RT-LAMP) may contribute to the different results. We show that the fluorescent RT-LAMP assay sensitivity is more than sufficient to reliably detect SARS-CoV-2 in NP samples to virus load, as SARS-CoV-2 patients have been reported to have a range from 641 copies/mL to 1011 copies/mL with a median of 104–105 [36]. Of the SARS-CoV-2 negative NP samples from the UGA Diagnostic Laboratories, 81% (n = 68/84) were N gene negatives as determined by our RT-qPCR assay. Fluorescent RT-LAMP assay results were 87% (n = 59/68) concordant confirming N gene negative samples, and 16 NP negative samples were positive in our RT-qPCR assay. These results likely represent RT-qPCR false-positives that were SARS-COV-2 negative as determined by the UGA Diagnostic Laboratories with differences likely owing to the broad-specificity of the RT-qPCR assay. The N gene negative NP specimens by RT-LAMP were 13% (n = 9/68) with positive results discordant with RT-qPCR results.
We show that the fluorescent RT-LAMP assay sensitively and specifically detects wild-type SARS-CoV-2 and the B.1.1.7 (Alpha) variant in virus-infected Vero cell culture supernatants after the minimal pre-processing steps. The fluorescent RT-LAMP assay primers were designed based on the nucleotide sequence of the N gene reported for the SARS-CoV-2 (WA1/2020) strain. A majority of the sequence divergence associated with variant strains is located in the S gene, while the N gene nucleotide sequence is highly conserved. The N gene RT-LAMP primer sequences are 100% conserved among the wild type and variant SARS-CoV-2 strains (S2 Fig). This conservation allows our RT-LAMP assay to detect various SARS-CoV-2 strains. Also, the specificity of our fluorescent RT-LAMP assay is shown by the failure of three closely related human coronavirus strains, i.e. OC43, 229E, and NL63, to give any positive signal over the baseline in this 30 minute assay (S2 Fig).
Overall, the fluorescent RT-LAMP assay was shown to be positive for >98% of NP samples (n = 41/42) that were N gene-positive samples by RT-qPCR, and negative for 87% (n = 59/68) of NP samples that were N gene negative samples by RT-qPCR. Discordant results in RT-qPCR and fluorescent RT-LAMP could represent false positives from spurious amplification from primer-dimer sometimes associated with RT-LAMP assays, sample contamination, variability among different RT-qPCR tests detecting different or multiple SARS-CoV-2 amplicons, or increased sensitivity of RT-LAMP compared to RT-qPCR. RT-LAMP employing six primers has high-specificity for selected amplification targets when compared to standard PCR utilizing only two primers, or RT-qPCR employing an additionally labeled probe oligo. Careful design of the six LAMP primers, particularly the inner primers FIP and BIP to avoid self-complementarity, and optimized formulation can help to mitigate these concerns. Our data shows that the fluorescent RT-LAMP assay is comparable to RT-qPCR and useful for detecting SARS-CoV-2 infected NP samples having a moderate viral load. Importantly, the viral load does not indicate either the course of infection or COVID-19 disease severity because the viral load is not representative of the overall viral burden of an infected individual, and the level of SARS-CoV-2 is not the only attribute affecting disease in an individual [37–39].
Supporting information
Data Availability
All relevant data are within the manuscript and its Supporting Information files.
Funding Statement
Funding was through the Georgia COVID-19 Task Force and the Georgia Research Alliance to RT. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Krammer F. SARS-CoV-2 vaccines in development. Nature. 2020;586(7830):516–27. Epub 2020/09/24. doi: 10.1038/s41586-020-2798-3 . [DOI] [PubMed] [Google Scholar]
- 2.Poland GA, Ovsyannikova IG, Kennedy RB. SARS-CoV-2 immunity: review and applications to phase 3 vaccine candidates. Lancet. 2020;396(10262):1595–606. Epub 2020/10/17. doi: 10.1016/S0140-6736(20)32137-1 ; PubMed Central PMCID: PMC7553736. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Mahdy MAA, Younis W, Ewaida Z. An Overview of SARS-CoV-2 and Animal Infection. Front Vet Sci. 2020;7:596391. Epub 2020/12/29. doi: 10.3389/fvets.2020.596391; PubMed Central PMCID: PMC7759518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Irving AT, Ahn M, Goh G, Anderson DE, Wang LF. Lessons from the host defences of bats, a unique viral reservoir. Nature. 2021;589(7842):363–70. Epub 2021/01/22. doi: 10.1038/s41586-020-03128-0 . [DOI] [PubMed] [Google Scholar]
- 5.Whittaker GR, Daniel S, Millet JK. Coronavirus entry: how we arrived at SARS-CoV-2. Curr Opin Virol. 2021;47:113–20. Epub 2021/03/22. doi: 10.1016/j.coviro.2021.02.006 ; PubMed Central PMCID: PMC7942143. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Das A, Ahmed R, Akhtar S, Begum K, Banu S. An overview of basic molecular biology of SARS-CoV-2 and current COVID-19 prevention strategies. Gene Rep. 2021:101122. Epub 2021/04/07. doi: 10.1016/j.genrep.2021.101122; PubMed Central PMCID: PMC8012276. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Alturki SO, Alturki SO, Connors J, Cusimano G, Kutzler MA, Izmirly AM, et al. The 2020 Pandemic: Current SARS-CoV-2 Vaccine Development. Front Immunol. 2020;11:1880. Epub 2020/09/26. doi: 10.3389/fimmu.2020.01880; PubMed Central PMCID: PMC7466534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Costa LB, Perez LG, Palmeira VA, Macedo ECT, Ribeiro VT, Lanza K, et al. Insights on SARS-CoV-2 Molecular Interactions With the Renin-Angiotensin System. Front Cell Dev Biol. 2020;8:559841. Epub 2020/10/13. doi: 10.3389/fcell.2020.559841; PubMed Central PMCID: PMC7525006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Hoffmann M, Kleine-Weber H, Schroeder S, Kruger N, Herrler T, Erichsen S, et al. SARS-CoV-2 Cell Entry Depends on ACE2 and TMPRSS2 and Is Blocked by a Clinically Proven Protease Inhibitor. Cell. 2020;181(2):271–80 e8. Epub 2020/03/07. doi: 10.1016/j.cell.2020.02.052 ; PubMed Central PMCID: PMC7102627. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sosnowski TR. Inhaled aerosols: their role in COVID-19 transmission including biophysical interactions in the lungs. Curr Opin Colloid Interface Sci. 2021:101451. Epub 2021/03/31. doi: 10.1016/j.cocis.2021.101451; PubMed Central PMCID: PMC7989069 personal relationships that could have appeared to influence the work reported in this paper. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Allam M, Cai S, Ganesh S, Venkatesan M, Doodhwala S, Song Z, et al. COVID-19 Diagnostics, Tools, and Prevention. Diagnostics (Basel). 2020;10(6). Epub 2020/06/21. doi: 10.3390/diagnostics10060409; PubMed Central PMCID: PMC7344926. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.To KK, Sridhar S, Chiu KH, Hung DL, Li X, Hung IF, et al. Lessons learned 1 year after SARS-CoV-2 emergence leading to COVID-19 pandemic. Emerg Microbes Infect. 2021;10(1):507–35. Epub 2021/03/06. doi: 10.1080/22221751.2021.1898291 ; PubMed Central PMCID: PMC8006950. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Syangtan G, Bista S, Dawadi P, Rayamajhee B, Shrestha LB, Tuladhar R, et al. Asymptomatic SARS-CoV-2 Carriers: A Systematic Review and Meta-Analysis. Front Public Health. 2020;8:587374. Epub 2021/02/09. doi: 10.3389/fpubh.2020.587374; PubMed Central PMCID: PMC7855302. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Wiersinga WJ, Rhodes A, Cheng AC, Peacock SJ, Prescott HC. Pathophysiology, Transmission, Diagnosis, and Treatment of Coronavirus Disease 2019 (COVID-19): A Review. JAMA. 2020;324(8):782–93. Epub 2020/07/11. doi: 10.1001/jama.2020.12839 . [DOI] [PubMed] [Google Scholar]
- 15.Canedo-Marroquin G, Saavedra F, Andrade CA, Berrios RV, Rodriguez-Guilarte L, Opazo MC, et al. SARS-CoV-2: Immune Response Elicited by Infection and Development of Vaccines and Treatments. Front Immunol. 2020;11:569760. Epub 2020/12/29. doi: 10.3389/fimmu.2020.569760; PubMed Central PMCID: PMC7759609. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Moore NM, Li H, Schejbal D, Lindsley J, Hayden MK. Comparison of Two Commercial Molecular Tests and a Laboratory-Developed Modification of the CDC 2019-nCoV Reverse Transcriptase PCR Assay for the Detection of SARS-CoV-2. J Clin Microbiol. 2020;58(8). Epub 2020/05/29. doi: 10.1128/JCM.00938-20; PubMed Central PMCID: PMC7383545. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Nygaard V, Hovig E. Methods for quantitation of gene expression. Front Biosci (Landmark Ed). 2009;14:552–69. Epub 2009/03/11. doi: 10.2741/3262 . [DOI] [PubMed] [Google Scholar]
- 18.Moehling TJ, Choi G, Dugan LC, Salit M, Meagher RJ. LAMP Diagnostics at the Point-of-Care: Emerging Trends and Perspectives for the Developer Community. Expert Rev Mol Diagn. 2021;21(1):43–61. Epub 2021/01/22. doi: 10.1080/14737159.2021.1873769 . [DOI] [PubMed] [Google Scholar]
- 19.Augustine R, Hasan A, Das S, Ahmed R, Mori Y, Notomi T, et al. Loop-Mediated Isothermal Amplification (LAMP): A Rapid, Sensitive, Specific, and Cost-Effective Point-of-Care Test for Coronaviruses in the Context of COVID-19 Pandemic. Biology (Basel). 2020;9(8). Epub 2020/07/28. doi: 10.3390/biology9080182; PubMed Central PMCID: PMC7464797. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Zhang X, Lowe SB, Gooding JJ. Brief review of monitoring methods for loop-mediated isothermal amplification (LAMP). Biosens Bioelectron. 2014;61:491–9. Epub 2014/06/21. doi: 10.1016/j.bios.2014.05.039 . [DOI] [PubMed] [Google Scholar]
- 21.Chaouch M. Loop-mediated isothermal amplification (LAMP): An effective molecular point-of-care technique for the rapid diagnosis of coronavirus SARS-CoV-2. Rev Med Virol. 2021:e2215. Epub 2021/01/22. doi: 10.1002/rmv.2215; PubMed Central PMCID: PMC7995099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Sagredo-Olivares K, Morales-Gomez C, Aitken-Saavedra J. Evaluation of saliva as a complementary technique to the diagnosis of COVID-19: a systematic review. Med Oral Patol Oral Cir Bucal. 2021. Epub 2021/02/21. doi: 10.4317/medoral.24424. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Park JY, Park S, Park YR, Kang DY, Kim EM, Jeon HS, et al. Reverse-transcription loop-mediated isothermal amplification (RT-LAMP) assay for the visual detection of European and North American porcine reproductive and respiratory syndrome viruses. J Virol Methods. 2016;237:10–3. Epub 2016/08/21. doi: 10.1016/j.jviromet.2016.08.008 . [DOI] [PubMed] [Google Scholar]
- 24.Bakre AA, Jones LP, Bennett HK, Bobbitt DE, Tripp RA. Detection of swine influenza virus in nasal specimens by reverse transcription-loop-mediated isothermal amplification (RT-LAMP). J Virol Methods. 2021;288:114015. Epub 2020/12/04. doi: 10.1016/j.jviromet.2020.114015; PubMed Central PMCID: PMC7799534. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Ji J, Xu X, Wu Q, Wang X, Li W, Yao L, et al. Simple and visible detection of duck hepatitis B virus in ducks and geese using loop-mediated isothermal amplification. Poult Sci. 2020;99(2):791–6. Epub 2020/02/08. doi: 10.1016/j.psj.2019.12.024 ; PubMed Central PMCID: PMC7587725. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Garneret P, Coz E, Martin E, Manuguerra JC, Brient-Litzler E, Enouf V, et al. Performing point-of-care molecular testing for SARS-CoV-2 with RNA extraction and isothermal amplification. PLoS One. 2021;16(1):e0243712. Epub 2021/01/12. doi: 10.1371/journal.pone.0243712; PubMed Central PMCID: PMC7799764. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Gonzalez-Gonzalez E, Lara-Mayorga IM, Rodriguez-Sanchez IP, Zhang YS, Martinez-Chapa SO, Santiago GT, et al. Colorimetric loop-mediated isothermal amplification (LAMP) for cost-effective and quantitative detection of SARS-CoV-2: the change in color in LAMP-based assays quantitatively correlates with viral copy number. Anal Methods. 2021;13(2):169–78. Epub 2021/01/06. doi: 10.1039/d0ay01658f . [DOI] [PubMed] [Google Scholar]
- 28.Naji E, Fadajan Z, Afshar D, Fazeli M. Comparison of Reverse Transcription Loop-Mediated Isothermal Amplification Method with SYBR Green Real-Time RT-PCR and Direct Fluorescent Antibody Test for Diagnosis of Rabies. Jpn J Infect Dis. 2020;73(1):19–25. Epub 2019/09/03. doi: 10.7883/yoken.JJID.2019.009 . [DOI] [PubMed] [Google Scholar]
- 29.Le Thi N, Ikuyo T, Nguyen Gia B, Truong Thai P, Vu Thi TV, Bui Minh V, et al. A clinic-based direct real-time fluorescent reverse transcription loop-mediated isothermal amplification assay for influenza virus. J Virol Methods. 2020;277:113801. Epub 2019/12/16. doi: 10.1016/j.jviromet.2019.113801. [DOI] [PubMed] [Google Scholar]
- 30.Tomita N, Mori Y, Kanda H, Notomi T. Loop-mediated isothermal amplification (LAMP) of gene sequences and simple visual detection of products. Nat Protoc. 2008;3(5):877–82. Epub 2008/05/03. doi: 10.1038/nprot.2008.57 . [DOI] [PubMed] [Google Scholar]
- 31.Wei S, Suryawanshi H, Djandji A, Kohl E, Morgan S, Hod EA, et al. Field-deployable, rapid diagnostic testing of saliva for SARS-CoV-2. Sci Rep. 2021;11(1):5448. Epub 2021/03/23. doi: 10.1038/s41598-021-84792-8; PubMed Central PMCID: PMC7943555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Shabani E, Dowlatshahi S, Abdekhodaie MJ. Laboratory detection methods for the human coronaviruses. Eur J Clin Microbiol Infect Dis. 2021;40(2):225–46. Epub 2020/09/29. doi: 10.1007/s10096-020-04001-8 ; PubMed Central PMCID: PMC7520381. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Rai P, Kumar BK, Deekshit VK, Karunasagar I, Karunasagar I. Detection technologies and recent developments in the diagnosis of COVID-19 infection. Appl Microbiol Biotechnol. 2021;105(2):441–55. Epub 2021/01/05. doi: 10.1007/s00253-020-11061-5 ; PubMed Central PMCID: PMC7780074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Ganguli A, Mostafa A, Berger J, Aydin MY, Sun F, Ramirez SAS, et al. Rapid isothermal amplification and portable detection system for SARS-CoV-2. Proc Natl Acad Sci U S A. 2020;117(37):22727–35. Epub 2020/09/02. doi: 10.1073/pnas.2014739117 ; PubMed Central PMCID: PMC7502724. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Schermer B, Fabretti F, Damagnez M, Di Cristanziano V, Heger E, Arjune S, et al. Rapid SARS-CoV-2 testing in primary material based on a novel multiplex RT-LAMP assay. PLoS One. 2020;15(11):e0238612. Epub 2020/11/03. doi: 10.1371/journal.pone.0238612; PubMed Central PMCID: PMC7605681 to SHERLOCK technology filed by the Broad Institute, with the specific aim of ensuring this technology can be made freely, widely, and rapidly available for research and deployment (US provisional application no. 62/975,743, "CRISPR Effector System Based Coronavirus Diagnostics"). This does not alter our adherence to PLOS ONE`s policies on sharing data and materials. O.O.A., J.S.G., and F.Z. are co-founders, scientific advisors, and hold equity interests in Sherlock Biosciences, Inc., and Pine Trees Health, Inc. F.Z. is also a co-founder of Editas Medicine, Beam Therapeutics, Pairwise Plants, and Arbor Biotechnologies. NAT is employed by New England Biolabs, Inc, manufacturer of the LAMP reagents and some additional enzymes described in this manuscript. All of the aforementioned does not alter our adherence to PLOS ONE`s policies on sharing data and materials. The remaining authors declare no competing financial interests. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Pan Y, Zhang D, Yang P, Poon LLM, Wang Q. Viral load of SARS-CoV-2 in clinical samples. The Lancet Infectious Diseases. 2020;20(4):411–2. doi: 10.1016/S1473-3099(20)30113-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Ge H, Wang X, Yuan X, Xiao G, Wang C, Deng T, et al. The epidemiology and clinical information about COVID-19. Eur J Clin Microbiol Infect Dis. 2020;39(6):1011–9. Epub 2020/04/16. doi: 10.1007/s10096-020-03874-z ; PubMed Central PMCID: PMC7154215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Ouassou H, Kharchoufa L, Bouhrim M, Daoudi NE, Imtara H, Bencheikh N, et al. The Pathogenesis of Coronavirus Disease 2019 (COVID-19): Evaluation and Prevention. J Immunol Res. 2020;2020:1357983. Epub 2020/07/17. doi: 10.1155/2020/1357983; PubMed Central PMCID: PMC7352127 publication of this article. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Attaway AH, Scheraga RG, Bhimraj A, Biehl M, Hatipoglu U. Severe covid-19 pneumonia: pathogenesis and clinical management. BMJ. 2021;372:n436. Epub 2021/03/12. doi: 10.1136/bmj.n436. [DOI] [PubMed] [Google Scholar]