Abstract
The purpose of this systematic review is to evaluate the test accuracy of reverse-transcription loop-mediated isothermal amplification (RT-LAMP) and reverse transcription-PCR (RT-PCR) for the diagnosis of coronavirus disease 2019 (COVID-19). We comprehensively searched PUBMED, Web of Science, the Cochrane Library, the Chinese National Knowledge Infrastructure, and the Chinese Biomedical Literature Service System until September 1, 2021. We included clinical studies assessing the sensitivity and specificity of RT-PCR and RT-LAMP using respiratory samples. Thirty-three studies were included with 9360 suspected cases of SARS-CoV-2 infection. The RT-PCR or other comprehensive diagnostic method was defined as the reference method. The results showed that the overall pooled sensitivity of RT-PCR and RT-LAMP was 0.96 (95 % CI, 0.93−0.98) and 0.92 (95 % CI, 0.85−0.96), respectively. RT-PCR and RT-LAMP had a 0.06 (95 % CI, 0.04−0.08) and 0.12 (95 % CI, 0.06−0.16) false-negative rates (FNR), respectively. Moreover, subgroup analysis showed mixed sampling and multiple target gene diagnosis methods had better diagnostic value than single-site sampling and a single target gene. The sensitivity and FNR were also significantly affected by the reference method. Comparing RT-LAMP with established suboptimal RT-PCR may exaggerate the performance of RT-LAMP. RT-PCR and RT-LAMP showed high values in the diagnosis of COVID-19, but there was still a FNR of about 6%–12%.
Keywords: COVID-19, Diagnostic accuracy, RT-PCR, RT-LAMP, False-negative rate
1. Introduction
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the causative agent of the coronavirus disease 2019 (CoVID19) pandemic. The control and management of this pandemic have faced unprecedented challenges (Wiersinga et al., 2020). Isolating infected individuals, contact tracing, extensive diagnostic testing, and vaccinations are crucial to limit this infection (Bosetti et al., 2021). Accurate diagnosis is the basis to ensure the effective implementation of the above strategies.
Reverse transcription-PCR (RT-PCR) and reverse-transcription loop-mediated isothermal amplification (RT-LAMP) are two widespread testing methods, and each has distinct advantages. Evidence to date indicates that RT–PCR is considered the most sensitive method for the detection and quantification of SARS−COV-2 nucleic acid (Walsh et al., 2020). RT-LAMP is a reliable and rapid screening test, which can be used in the field or under non-laboratory conditions(Ganguli, 2020). However, there are analytical and interpretation issues with the molecular detection results of SARS−COV-2 infection. The false negative results of molecular tests would need detailed analysis (Bohn et al., 2020; Xiao et al., 2020).
Most clinical studies assessed agreement between different nucleic-acid amplification tests (NAATs) to evaluate the diagnostic accuracy. Generally, the existing PCR is the reference standard, and the new method is the index test. Although PCR is the current widely accepted reference test for detecting SARS−COV-2, it does not have excellent sensitivity and specificity (Ducray et al., 2020; Ridgway et al., 2020; Zhifeng et al., 2020). Therefore, a meta-analysis based on clinical research should consider the influence of references on the analysis and interpretation of results.
At present, some systematic analyses have evaluated the diagnostic accuracy of nucleic acid detection methods in COVID-19 diagnosis, but the sensitivity observed in various studies is inconsistent. A recent meta-analysis showed that the sensitivity of RT-PCR for detection of SARS−COV-2 in nasopharyngeal swabs (NPS) and sputum samples was 73.3 % and 97.2 %, respectively (Böger et al., 2021). Mustafa et al. found that the pooled sensitivity of NAATs evaluating SARS−COV-2 was 90.4 %. Furthermore, they argue that since there is no gold standard for diagnosing coronavirus infection, any existing NAATs can be used as a reference standard (Mustafa Hellou et al., 2021). A systematic review showed that the sensitivity of RT-LAMP was 94 % in purified RNA from COVID-19 patient samples and 78 % in crude samples. And RT-LAMP was prone to false-negative results in low viral load samples (Subsoontorn et al., 2020). Although these studies reported the performance of molecular detection in SARS−COV-2 infection, few of them consider the impact of inconsistent reference standards on the results. The reference method is essential for evaluating the performance of the detection method. Comparing the new suboptimal analysis with the established but suboptimal analysis may lead to untrue conclusions about the performance of the new way (Bohn et al., 2020).
Moreover, in these meta-analyses mentioned above, few studies have explored the significance of false-negative rate (FNR) in diagnosing SARS−COV-2 infection in detail. False-positive can result in unnecessary case isolation and further testing. However, FNR may present delays with prompt isolation and treatment, leading to the spread of infection (Xiao et al., 2020). The FNR might be related to the current outbreaks growing and epidemic rebound of SARS−COV-2. Taking the epidemic situation in Shijiazhuang, China, as an example, as of January 23, 2021, three rounds of mass testing have been carried out, with a total of more than 30 million tests in 17 days. Patients with a positive result in the three tests were 354, 247, and 30, respectively. Eighty percent of them are from quarantine sites (Li, 2021). Besides the low viral load and extended incubation period, the FNR has become another important factor of concern (Kucirka et al., 2020; Walsh et al., 2020). Therefore, to put nucleic acid testing in perspective, clearly understanding the diagnostic accuracy of different detection methods is essential for diagnosis, prevention, and control of this pandemic.
This study evaluated the diagnostic accuracy of RT-PCR and RT-LAMP and the potential effects of reference methods on diagnostic accuracy. Detailed subgroup analyses, FNR, and false positive rates (FPR) were included in this meta-analysis.
2. Method
2.1. Search strategy
We searched PubMed, the Cochrane Library, Web of Science, China National Knowledge Infrastructure (CNKI), and the Chinese Bio-Medical Literature Service System (Sino Med) without limits of language (the literature time limit is updated September 1; 2021). The search strategy included the following search string: “(COVID-19 OR novel coronavirus disease OR SARS−COV-2) AND (laboratory molecular test OR nucleic acid amplification tests OR RT-PCR OR RT-LAMP) AND (diagnostic)”. We performed manual searches in the references lists.
2.2. Inclusion and exclusion criteria
We included clinical studies assessing the diagnostic accuracy of RT-PCR and RT-LAMP using respiratory samples. Sensitivity (Se) and specificity (Sp) were quantitatively reported. We included both case-control and prospective cohort studies published until September 1, 2021. Animal or in-vitro studies and case reports were excluded.
Included: (i) Diseases: COVID-19 infection or suspected cases; (ii) Type of study: Diagnostic accuracy test or comparsion between different nucleic acid assay; prospective study or retrospective study; (iii) Index test methods: RT-LAMP and RT-PCR; (iv) Reference standard: RT-PCR (currently recognized as the gold standard for detection) or the other methods (such as clinical diagnosis, sequencing, a combined result of different RT-PCR assays.
Excluded: (i) Diagnostic tests for other diseases; (ii) The accuracy study of chest computed tomography (CT), serum antibody detection, and other non-nucleic acid detection methods in COVID-19 diagnosis; (iii) Case reports, in vitro cell experiments, and animal experiments; (iv) incomplete data or the inability to extract relevant data; (v) the studies that are missing in patient selection and reference method reporting were excluded.
2.3. Data collection and quality assessment
The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool was used to assess the quality, the potential for bias, and the applicability of each selected study. Two review authors (DS and YB) independently screened studies and resolved disagreements with a third review author (YH). The QUADAS-2 tool evaluates four domains of bias: patient selection, index test, reference test, and flow and timing of testing. Studies considered to have a high risk of bias were not included in the meta-analysis. Two review authors (RP and YY) independently extracted study characteristics and 2 × 2 diagnostic-accuracy table data, which were checked by two authors (LM and SL).
2.4. Statistical analyses
Spearman correlation coefficient between the logarithm of sensitivity (Se) and the logarithm of (1-Sp) was calculated to detect the threshold effect. Generally, a strong positive correlation indicates the existence of a threshold effect (Leeflang, 2014). Deek's Funnel graph method was used to detect publication bias, and the result was determined by funnel plot and P value of the slope coefficient.
We performed an analysis of diagnostic trials based on the extracted data of true positive (TP), false positive (FP), false negative (FN), true negative (TN). The bivariate random-effects model of Midas command of Stata 12.0 software was used. The diagnostic performance of RT-PCR and RT-LAMP was shown in terms of summary sensitivity (Se), specificity (Sp), likelihood ratio (LR), and summary receiver operating curve (SROC), with a 95 % confidence interval (CI). The results were visually represented using forest plots.
The FNR and FPR were calculated according to the formula:
FNR = FN/ (FN + TP); FPR = FP/ (FP + TN) |
We obtained summary estimates of FNR and FPR by using random-effects meta-analysis. SROC curves were built to describe the relationship between test sensitivity and specificity. An area under the SROC close to 1 indicated an excellent diagnostic performance of the test. All analyses were performed using STATA 12.0.
This meta-analysis evaluated diagnostic test accuracy indexes, including authenticity evaluation indexes (Se, Sp, FNR, FPR) and comprehensive evaluation indexes (LR and SROC curves). Results were presented as summary values (95 % CI). The heterogeneity of the studies was established by I2, with I2 > 50 % considered moderate heterogeneity and I2 > 75 % defined as high heterogeneity. Our study conducted subgroup analyses to explore the possible sources of heterogeneity. Meanwhile, we assumed the prevalence of 10 %, 20 %, and 30 % of the population, respectively, to calculate the positive predictive value (PPV) and negative predictive value (NPV) under different prevalence rates.
We hypothesized that the population prevalence (P) of COVID-19 was 10 %, 20 %, and 30 %, respectively. The PPV and the NPV were calculated as follow:
PPV = Se * P/ Se* P+ (1-P)* (1-Sp); NPV = Sp* (1-P)/ Sp* (1-P) + (1-Se)* P
3. Result
3.1. Search result
A total of 2584 non-duplicated studies were obtained, and 2274 studies were excluded at the title and abstract level. Finally, 145 full-text articles were evaluated. Through further screening and evaluation of bias risk and applicability of research, 112 full texts have been excluded. Reasons for exclusion: the included study population was unqualified (P). The intervention measures were other detection methods (I). RT-PCR was a reference test, but the index test was another non-nucleic acid detection method (C). Outcome indicators are unavailable, or data cannot be extracted (O). Risk assessment shows a high risk, such as not mentioning whether or not to use the blind method. Other reasons: The number of studies updated in the later stage was insufficient for analysis, so they were excluded. When more similar files are updated later, further analysis can be carried out. Thirty-three studies were included, with 13 related studies on the diagnostic accuracy of RT-LAMP and 16 on RT-PCR (Fig. 1 ).
3.2. Risk of bias and applicability concerns
We assessed the risk of bias according to the QUADAS-2 tool. Implementation of coded or blinded studies was described in 11 studies (Bisoffi et al., 2020; Bordi et al., 2020; Boutin et al., 2020; Chow et al., 2020; Dao Thi, 2020; Gibani et al., 2020; Harrington et al., 2020; Hu et al., 2020; Smith et al., 2020; Yan et al., 2020; Zhen et al., 2020b). Patient inclusion was not continuous and randomized in 9 case-control studies (Baek et al., 2020; Chow et al., 2020; Fukumoto et al., 2020; Li et al., 2020; Matzkies et al., 2020; Mitchell and George, 2020; Shen et al., 2020; Smithgall et al., 2020; Williams et al., 2020). That may overestimate the test's diagnostic accuracy and bring some risks for the interpretation of the results (Fig. 2 ). The results of the publication bias test showed that the Deek's funnel plot was symmetric, and P value of slope coefficient is equal to 0.076 (P > 0.05), indicating no publication bias (Fig. S1).
3.3. Characteristics of included studies
Characteristics of included studies are shown in detail in Table 1 . Four studies assessed more than one index test to compare consistency between different tests. In order to fully present the data of these studies, we included these duplicates in our meta-analysis (Bulterys et al., 2020; Hu et al., 2020; Smithgall et al., 2020; Zhen et al., 2020b). RT-PCR was defined as a reference method in most of the included studies. Mixed respiratory tract samples or deep sputum samples from the trachea or throat were reported in 7/33 studies. Clinical diagnosis, sequencing, and multiple RT-PCR combinations were used as the reference criteria in four studies (Bisoffi et al., 2020; Fukumoto et al., 2020; Shen et al., 2020; Zhen et al., 2020a).
Table 1.
author | country | index test | index test gene target | reference text | reference test gene target | sample type | ||||
---|---|---|---|---|---|---|---|---|---|---|
TP | FP | FN | TN | |||||||
(Baek et al., 2020) | Korea | RT-LAMP | N | RT-qPCR | – | NPS | 14 | 2 | 0 | 138 |
(Basu et al., 2020) | USA | RT-LAMP | RdRp | real time RT-PCR | E, N2 | NPS | 17 | 1 | 14 | 69 |
(Bisoffi et al., 2020) | Italy | RT-PCR | S, RdRp, | Other a | – | NPS | 78 | 0 | 7 | 261 |
Italy | real-time RT-PCR | N | Other a | – | NPS | 64 | 1 | 20 | 260 | |
Italy | real-time RT-PCR | E, RdRp | Other a | – | NPS | 52 | 1 | 33 | 260 | |
(Bordi et al., 2020) | Italy | real-time RT-PCR | ORF1ab, S | real time RT-PCR | E, RdRp | NPS | 99 | 8 | 0 | 171 |
(Boutin et al., 2020) | Canada | real-time RT-PCR | E | RT-PCR | ORF1, E | NPS/OPS | 279 | 2 | 22 | 74 |
(Bulterys et al., 2020) | USA | iAMP | ORF1ab, N | real time RT-PCR | E | NPS | 24 | 0 | 5 | 50 |
USA | real-time RT-PCR | E, S, N | real time RT-PCR | E | NPS | 26 | 0 | 4 | 50 | |
USA | real-time RT-PCR | N | real time RT-PCR | E | NPS | 27 | 0 | 3 | 50 | |
(Chen et al., 2020) | Hong Kong, China | RT-PCR | ORF1ab, N, E | RT-PCR | RdRp,E | NPS | 89 | 0 | 2 | 123 |
(Chow et al., 2020) | China, Hong Kong | RT-LAMP | orf3a, E | RT-qPCR | N1 | total respiratory samples | 219 | 0 | 4 | 143 |
(Cradic et al., 2020) | US | RT-LAMP | RdRp | real time RT-PCR | ORF1ab, S | NPS | 30 | 0 | 3 | 151 |
(Dao Thi, 2020) | Germany | RT-LAMP | ORF1ab, N | RT-qPCR | E | NPS | 79 | 6 | 2 | 681 |
(Fukumoto et al., 2020) | Japan | RT-PCR | – | RT-qPCR | – | total | 52 | 3 | 1 | 15 |
(Gibani et al., 2020) | UK | real-time RT-PCR | E, N, RdRp | RT-PCR | ORF2ab, S, N | NPS | 67 | 0 | 4 | 315 |
(Harrington et al., 2020) | USA | RT-LAMP | RdRp | real time RT-PCR | RdRp, N | NPS | 139 | 2 | 47 | 336 |
(Hogan, 2020) | USA | RT-PCR + lateral flow | N | real time RT-PCR | E | NPS | 34 | 0 | 16 | 50 |
(Hu et al., 2020) | China | RT-LAMP | S | RT-qPCR | ORF1ab, N | NPS | 72 | 4 | 9 | 396 |
China | RT-qPCR | ORF2ab, N | RT-qPCR + NGS | ORF1ab, N | NPS | 66 | 0 | 15 | 400 | |
(Jiang et al., 2020) | China | RT-LAMP | ORF1ab, N | RT-qPCR | ORF1ab, N | NPS | 32 | 0 | 3 | 133 |
China | RT-LAMP | ORF1ab, N | RT-qPCR | ORF1ab, N | NPS | 11 | 1 | 1 | 79 | |
(Kitagawa et al., 2020) | Japan | RT-LAMP | – | RT-qPCR | N | NPS | 30 | 2 | 0 | 44 |
(Li et al., 2020) | China | RT-MCDA | ORF1ab, N | RT-qPCR | – | total respiratory samples | 20 | 2 | 0 | 43 |
(Michael J. Loeffelholz et al., 2020) | USA | real-time RT-PCR | E, N2 | real time RT-PCR | ORF1ab, E, N, S, RdRp | NPS, tracheal aspirate | 219 | 11 | 1 | 250 |
(Lu et al., 2020) | China | RT-LAMP | N | RT-qPCR | ORF1ab,N,E | NPS | 34 | 2 | 2 | 20 |
(Matzkies et al., 2020) | Austria | RT-PCR | S | RT qPCR | ORF1ab, E | NPS/OPS | 47 | 0 | 21 | 27 |
(Mitchell and George, 2020) | US | RT-LAMP | RdRp | real time RT-PCR | N | NPS | 33 | 0 | 13 | 15 |
(Rödel et al., 2020) | Germany | RT-LAMP | M | RT-PCR | E | NPS | 72 | 0 | 24 | 41 |
(Shen et al., 2020) | China | RT-qPCR | ORF1ab, N | Other a | – | throat swab | 38 | 2 | 2 | 14 |
China | RT-qPCR | ORF1ab, N | Other a | – | throat swab | 36 | 2 | 4 | 14 | |
China | RT-qPCR | ORF1ab | Other a | – | throat swab | 33 | 3 | 7 | 13 | |
(Smith et al., 2020) | USA | RT-PCR | ORF1ab | TMA, RT-PCR | ORF1ab,ORF8 | NPS | 74 | 0 | 1 | 74 |
(Smithgall et al., 2020) | USA | RT-LAMP | RdRp | RT-PCR | ORF1ab, E | NPS | 74 | 0 | 1 | 75 |
USA | RT-PCR | N2, E | RT-PCR | ORF1ab, E | NPS | 65 | 0 | 23 | 25 | |
(Saleem et al., 2020) | USA | real-time RT-PCR | E, N | real time RT-PCR | ORF1ab | NPS | 87 | 2 | 1 | 23 |
(Wang et al., 2020) | China | RT-qPCR | ORF1ab, N | RT-qPCR | ORF1ab, N | throat swabs | 53 | 0 | 1 | 50 |
(Williams et al., 2020) | Australia | real-time RT-PCR | – | RT-PCR | RdRp,E | NPS | 25 | 14 | 0 | 142 |
(Wolters et al., 2020) | Netherlands | real-time RT-PCR | N2, E | RT-PCR | E,RdRp | NPS | 53 | 0 | 1 | 621 |
(Yan et al., 2020) | China | RT-LAMP | ORF1ab, S | RT-qPCR | ORF1ab, S | total respiratory samples | 30 | 0 | 0 | 30 |
(Zhen et al., 2020a) | USA | real-time RT-PCR | N1, N2 | Other a | – | NPS | 58 | 0 | 0 | 72 |
USA | RT-PCR | S, ORF1ab | Other a | – | NPS | 51 | 1 | 0 | 52 | |
USA | RT-PCR | N | Other a | – | NPS | 51 | 0 | 0 | 53 | |
USA | RT-PCR | ORF1ab | Other a | – | NPS | 49 | 0 | 2 | 53 | |
(Zhen et al., 2020b) | USA | RT-LAMP | RdRp | RT-PCR | ORF1ab | NPS | 51 | 2 | 0 | 51 |
USA | real-time RT-PCR | N, S, ORF1ab | RT-PCR | N, S, ORF1ab | NPS | 50 | 0 | 7 | 50 |
NPS, nasopharyngeal swab; NGS, next-generation sequencing; OPS, oropharyngeal swab; RT-LAMP, reverse-transcription loop-mediated isothermal amplification; RT-PCR, reverse transcription-PCR; RT-qPCR, reverse transcription quantitative real time PCR; iAMP, the Atila isothermal amplification assay; RT-MCDA, transcription multiple cross displacement amplification,which is a new rapid isothermal amplification technique. a Other reference: clinical diagnosis, sequencing, combination of the results of multiple detection methods.
3.4. Analysis of diagnostic threshold effect
Threshold effect is one of the main causes of heterogeneity in diagnostic tests. The threshold effect between studies can be determined by calculating the Spearman correlation coefficient between the Se and Sp of included studies. When Se is positively correlated with 1-Sp, it indicates a threshold effect.
The Spearman correlation coefficient of RT-LAMP is equal to -0.218 (P = 0.435). The Spearman correlation coefficient of RT-PCR is equal to -0.365 (P > 0.5). The above results indicate no threshold effect.
3.5. The meta-analysis of diagnostic accuracy of RT-LAMP and RT-PCR
Meta-analysis results showed that the pooled sensitivity and specificity of RT-LAMP in the diagnosis of COVID-19 were 0.92 (95 % CI, 0.85−0.96) and 0.99 (95 % CI, 0.99−0.99), respectively. The pooled sensitivity and specificity of RT-PCR for the diagnosis of COVID-19 were 0.96 (95 % CI, 0.93−0.98) and 1.00 (95 % CI, 0.98–1.00), respectively (Fig. 3 ). However, results of both RT-PCR and RT-LAMP showed high heterogeneity (I2 > 50 %), especially RT-PCR.
Besides, the meta-analysis showed that the FNR and the FPR of RT-LAMP were 0.12 (95 %CI, 0.06−0.16) and 0.01 (95 % CI, 0.00−0.01), respectively. The FNR and FPR of RT-PCR were 0.06 (95 % CI, 0.04−0.08) and 0.01 (95 % CI, 0.00−0.01), respectively (Fig. 4 ).
The positive likelihood ratio (PLR) and negative likelihood ratio (NLR) of RT-LAMP were 112.28 (70.51–178.78) and 0.08 (0.04−0.15), RT-PCR were 193.11(57.52–648.39) and 0.04(0.02−0.07), respectively (Fig. S2). The areas under the SROC of RT-LAMP and RT-PCR were 0.99(0.98–1.00) and 1.00(0.99–1.00), respectively (Fig. S3).
The positive predictive values (PPV) and negative predictive values (NPV) of RT-LAMP and RT-PCR are shown in Table 2 .
Table 2.
Prevalence (P)a | RT-LAMP |
RT-PCR |
||
---|---|---|---|---|
PPV | NPV | PPV | NPV | |
P = 10 % | 91 % | 99 % | 100 % | 100 % |
P = 20 % | 96 % | 98 % | 100 % | 99 % |
P = 30 % | 98 % | 97 % | 100 % | 98 % |
NPV, negative predictive value; PPV, positive predictive value; RT-LAMP, reverse-transcription loop-mediated isothermal amplification; RT-PCR, reverse transcription-PCR.
Prevalence is the estimated prevalence.
3.6. Subgroup analysis
Subgroup analyses of RT-LAMP diagnostic values are shown in Fig. 5 . Compared with nasopharyngeal swabs(NPS)or oropharyngeal swabs (OPS), the mixed sample of the respiratory tract showed better sensitivity (0.98) and lower FNR (0.02). Compared with a single target gene, multiple target genes has higher sensitivity (0.95) and a lower FNR (0.03). Interestingly, when the reference method was RT-PCR with multiple target genes, the sensitivity and FNR of RT-LAMP were 0.84 and 0.15, respectively; when the reference method was RT-PCR with a single target gene, the sensitivity and FNR of RT-LAMP were 0.90 and 0.11, respectively.
Subgroup analyses of RT-PCR diagnostic values are shown in Fig. 6 . When the samples were NPS or OPS, the FNR of RT-PCR was 0.06, but the heterogeneity of the results was high (I2 > 75 %). The RT-PCR with multiple target genes had higher sensitivity (0.95) and a lower FNR (0.05) compared with a single target gene. Of note, the sensitivity of RT-PCR was 0.96 (95 % CI, 0.90−0.98) when multi-target gene RT-PCR was used as the reference method. However, when other methods (clinical diagnosis, sequencing, combination of the results of multiple detection methods) were used as the reference, the sensitivity of RT-PCR was only 0.84, and the FNR was as high as 0.15.
4. Discussion
A recent systematic review showed that nucleic acid testing has a high sensitivity (86 %) and specificity (96 %) in the diagnosis of acute respiratory syndrome due to coronavirus (Floriano et al., 2020). However, data on COVID-19 were not mentioned in the study of Floriano et al. In other COVID-19 related meta-analysis and systematic analyses, there is no further detailed classification of reference standards, and the heterogeneity of research results is high (Böger et al., 2021; Castro et al., 2020).
In this systematic review, the pooled sensitivity of RT-LAMP and RT-PCR was 92 % and 96 %, respecitively. The pooled specificity of RT-LAMP and RT-PCR was 99 % and 100 %, respecitively. The positive LR and negative LR results of the two methods suggest a high diagnostic value. Moreover, the area under the SROC was above 0.9. However, the I2 in most of these results was more than 50 %.
Our study found that compared with NPS/OPS, mixed samples from multiple parts of the respiratory tract have better sensitivity and lower FNR, which is consistent with the results of other studies (Böger et al., 2021; Mustafa Hellou et al., 2021). The guideline for preventing and treating COVID-19 in China indicates that molecular diagnosis detection should use at least two gene targets to minimize the risk of false-negative (Jin et al., 2020). Our results also showed that RT-PCR and RT-LAMP with more than one target gene showed better diagnostic value than a single target gene. When RT-PCR was used as a reference method to evaluate the accuracy of RT-LAMP, the sensitivity of RT-LAMP with multi-gene targets was 15 % higher than that of RT-LAMP with a single gene target. Similarly, the sensitivity of RT-PCR with multiple-gene targets increased by 5%.
We can speculate that the detection method with multi-gene targets has high sensitivity and a low FNR. When RT-PCR with multi-gene targets is used as a reference method, the higher the consistency between the index test results and the reference, the higher the diagnostic value. However, from our results, the above rules are only applicable to comparing different RT-PCR methods. When other methods that are likely to correctly classify infected persons, such as clinical diagnosis and sequencing, are used as reference standards, the sensitivity of RT-PCR decreases to 87 % and FNR increases to 15 %. Therefore, RT-PCR is not a perfect gold standard. When RT-PCR (single gene target) was used as the reference method to evaluate RT-LAMP, RT-LAMP showed high sensitivity due to selecting the reference method with a low diagnostic value. Therefore, comparing RT-LAMP with established suboptimal RT-PCR may exaggerate the diagnostic value of RT-LAMP.
Due to the high heterogeneity of the above results, the conclusions need to be treated with caution. Therefore, a better reference method and research design to evaluate the diagnostic accuracy of nucleic acid detection are required. There are many influencing factors in diagnostic trials, which will result in high heterogeneity in the meta-analysis of diagnostic trials. Several factors can result in False-negative results, such as sampling, sample transportation, storage, RNA extraction, the incubation period prior to the symptom (Loeffelholz and Tang, 2020; Touma, 2020).
The advantage of this study is to analyze the diagnostic accuracy of RT-PCR and RT-LAMP more deeply based on previous evidence. Our study investigated the potential effects of different reference methods on diagnostic accuracy and performed subgroup analysis. Besides, compared to similar studies, we chose a more comprehensive evaluation index to evaluate the diagnostic accuracies of the two methods. To the best of our knowledge, this study is the first to use FNR and FPR as evaluation indexes of diagnostic accuracy-test meta-analysis. This may help to extend understanding and further explain problems in clinical diagnosis and epidemiology.
Our systematic review and meta-analysis has several limitations. Firstly, some results showed high heterogeneity. Although, the heterogeneity of analysis results can be reduced through subgroup analysis, some may still have high heterogeneity (I2 > 50 %). This may be related to the inevitable clinical heterogeneity among studies. Secondly, we unified the reference method as RT-PCR, and stratified analysis according to different subgroups. However, different reagent manufacturers and experimental platforms will lead to inevitable heterogeneity. Besides, without a definitive reference standard, it may produce uncertain factors in the design and analysis of such consistent research (Petitti, 2001). These may explain the considerable heterogeneity of most meta-analyses on the same subject.
5. Conclusion
RT-PCR and RT-LAMP have high diagnostic values in the diagnosis of COVID-19. However, meta-analysis results of the sensitivity and FNR showed high heterogeneity. The accuracy of diagnostic tests is closely related to the sample type and reference criteria. RT-PCR has high sensitivity and a low FNR (pooled FNR of about 6%). The overall pooled specificity of RT-LAMP and RT-PCR was as high as 99 %. However, the sensitivity of RT-LAMP was poor, and about 12 % of true positive patients were considered negative. RT-PCR is the most commonly used reference method at present. The premise is that PCR has excellent sensitivity and specificity, but this is not the case. Therefore, choosing accurate and reliable reference methods is essential when evaluating the diagnostic accuracy of nucleic acid detection methods.
Author contribution statement
Conceptualization: NC; RP; methodology: DS; XR; YL; software: WZ; YY; validation: YH; SL; LM; formal analysis: RP; YB; WZ; investigation and data curation: RP; DS; YB; YY; writing-original draft: RP; SL; writing-review and editing: RP; XR; YH; LM; supervision: NC; SL.
Funding statement
This work is supported by the Belt and Road Special Project of Lanzhou University (grant numbers 2018ldbrzd008).
Footnotes
Supplementary material related to this article can be found, in the online version, at doi:https://doi.org/10.1016/j.jviromet.2021.114392.
Appendix A. Supplementary data
The following is Supplementary data to this article:
References
- Baek Y.H., Um J., Antigua K.J.C. Development of a reverse transcription-loop-mediated isothermal amplification as a rapid early-detection method for novel SARS-CoV-2. Emerg. Microbes Infect. 2020;9:998–1007. doi: 10.1080/22221751.2020.1756698. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Basu A., Zinger T., Inglima K., Woo K.M., Atie O., Yurasits L., See B., Aguero-Rosenfeld M.E. Performance of Abbott ID Now COVID -19 Rapid Nucleic Acid Amplification Test Using Nasopharyngeal Swabs Transported in Viral Transport Media and Dry Nasal Swabs in a New York City Academic Institution. J. Clin. Microbiol. 2020:58. doi: 10.1128/jcm.01136-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bisoffi Z., Pomari E., Deiana M., Piubelli C., Ronzoni N., Beltrame A., Bertoli G., Riccardi N., Perandin F., Formenti F., Gobbi F., Buonfrate D., Silva R. Sensitivity, specificity and predictive values of molecular and serological tests for COVID-19: a longitudinal study in emergency room. Diagnostics Basel (Basel) 2020;10 doi: 10.3390/diagnostics10090669. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Böger B., Fachi M.M., Vilhena R.O., Cobre A.F., Tonin F.S., Pontarolo R. Systematic review with meta-analysis of the accuracy of diagnostic tests for COVID-19. Am. J. Infect. Control. 2021;49:21–29. doi: 10.1016/j.ajic.2020.07.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bohn M.K., Mancini N., Loh T.P., Wang C.B., Grimmler M., Gramegna M., Yuen K.Y., Mueller R., Koch D., Sethi S., Rawlinson W.D., Clementi M., Erasmus R., Leportier M., Kwon G.C., Menezes M.E., Patru M.M., Singh K., Ferrari M., Najjar O., Horvath A.R., Adeli K., Lippi G. IFCC interim guidelines on molecular testing of SARS-CoV-2 infection. Clin. Chem. Lab. Med. 2020;58:1993–2000. doi: 10.1515/cclm-2020-1412. [DOI] [PubMed] [Google Scholar]
- Bordi L., Piralla A., Lalle E., Giardina F., Colavita F., Tallarita M., Sberna G., Novazzi F., Meschi S., Castilletti C., Brisci A., Minnucci G., Tettamanzi V., Baldanti F., Capobianchi M.R. Rapid and sensitive detection of SARS-CoV-2 RNA using the SimplexaTM COVID-19 direct assay. J. Clin. Virol. 2020;128 doi: 10.1016/j.jcv.2020.104416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bosetti P., Kiem C.T., Yazdanpanah Y., Fontanet A., Lina B., Colizza V., Cauchemez S. Impact of mass testing during an epidemic rebound of SARS-CoV-2: a modelling study using the example of France. Euro Surveill. 2021;26 doi: 10.2807/1560-7917.es.2020.26.1.2001978. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutin C.A., Grandjean-Lapierre S., Gagnon S., Labbé A.C., Charest H., Roger M., Coutlée F. Comparison of SARS-CoV-2 detection from combined nasopharyngeal/oropharyngeal swab samples by a laboratory-developed real-time RT-PCR test and the Roche SARS-CoV-2 assay on a cobas 8800 instrument. J. Clin. Virol. 2020;132 doi: 10.1016/j.jcv.2020.104615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bulterys P.L., Garamani N., Stevens B., Sahoo M.K., Huang C., Hogan C.A., Zehnder J., Pinsky B.A. Comparison of a laboratory-developed test targeting the envelope gene with three nucleic acid amplification tests for detection of SARS-CoV-2. Emerg. Microbes Infect. 2020;129 doi: 10.1016/j.jcv.2020.104427. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Castro R., Luz P.M., Wakimoto M.D., Veloso V.G., Grinsztejn B., Perazzo H. COVID-19: a meta-analysis of diagnostic test accuracy of commercial assays registered in Brazil. Braz. J. Infect. Dis. 2020;24:180–187. doi: 10.1016/j.bjid.2020.04.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen J.H., Yip C.C., Chan J.F., Poon R.W., To K.K. Clinical performance of the luminex NxTAG CoV extended panel for SARS-CoV-2 detection in nasopharyngeal specimens from COVID-19 patients in Hong Kong. J. Clin. Microbiol. 2020;58 doi: 10.1128/jcm.00936-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chow F.W., Chan T.T., Tam A.R., Zhao S., Yao W., Fung J., Cheng F.K., Lo G.C. A rapid, simple, inexpensive, and mobile colorimetric assay COVID-19-LAMP for mass on-site screening of COVID-19. Int. J. Mol. Sci. 2020;21 doi: 10.3390/ijms21155380. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cradic K., Lockhart M., Ozbolt P., Fatica L., Landon L., Lieber M., Yang D., Swickard J., Wongchaowart N., Fuhrman S., Antonara S. Clinical evaluation and utilization of multiple molecular in vitro diagnostic assays for the detection of SARS-CoV-2. Am. J. Clin. Pathol. 2020;154:201–207. doi: 10.1093/ajcp/aqaa097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dao Thi V.L. A colorimetric RT-LAMP assay and LAMP-sequencing for detecting SARS-CoV-2 RNA in clinical samples. Exp. Biol. Med. (Maywood) 2020;12 doi: 10.1126/scitranslmed.abc7075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ducray V., Vlachomitrou A.S., Bouscambert-Duchamp M., Si-Mohamed S. Chest CT for rapid triage of patients in multiple emergency departments during COVID-19 epidemic: experience report from a large French university hospital. Eur. Radiol. 2020;31:1–9. doi: 10.1007/s00330-020-07154-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Floriano I., Silvinato A., Bernardo W.M., Reis J.C., Soledade G. Accuracy of the Polymerase Chain Reaction (PCR) test in the diagnosis of acute respiratory syndrome due to coronavirus: a systematic review and meta-analysis. Eur. Respir. J. 2020;66:880–888. doi: 10.1590/1806-9282.66.7.880. [DOI] [PubMed] [Google Scholar]
- Fukumoto T., Iwasaki S., Fujisawa S., Hayasaka K., Sato K., Oguri S., Taki K., Nakakubo S., Kamada K., Yamashita Y., Konno S., Nishida M., Sugita J., Teshima T. Efficacy of a novel SARS-CoV-2 detection kit without RNA extraction and purification. Int. J. Infect. Dis. 2020;98:16–17. doi: 10.1016/j.ijid.2020.06.074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ganguli A. Rapid isothermal amplification and portable detection system for SARS-CoV-2. Educ. Res. 2020;117:22727–22735. doi: 10.1073/pnas.2014739117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gibani M.M., Toumazou C., Sohbati M., Sahoo R., Karvela M., Hon T.K., De Mateo S., Burdett A., Leung K.Y.F., Barnett J., Orbeladze A., Luan S., Pournias S., Sun J., Flower B., Bedzo-Nutakor J., Amran M., Quinlan R., Skolimowska K., Herrera C., Rowan A., Badhan A., Klaber R., Davies G., Muir D., Randell P., Crook D., Taylor G.P., Barclay W., Mughal N., Moore L.S.P., Jeffery K., Cooke G.S. Assessing a novel, lab-free, point-of-care test for SARS-CoV-2 (CovidNudge): a diagnostic accuracy study. The Lancet. Microbe. 2020;1:e300–e307. doi: 10.1016/s2666-5247(20)30121-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harrington A., Cox B., Snowdon J., Bakst J., Ley E., Grajales P., Maggiore J., Kahn S. Comparison of abbott ID now and Abbott m2000 methods for the detection of SARS-CoV-2 from nasopharyngeal and nasal swabs from symptomatic patients. J. Clin. Microbiol. 2020;58 doi: 10.1128/JCM.00798-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hogan C.A. Comparison of the accula SARS-CoV-2 test with a laboratory developed assay for detection of SARS-CoV-2 RNA in clinical nasopharyngeal specimens. J. Clin. Microbiol. 2020 doi: 10.1128/jcm.01072-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hu X., Deng X., Li J., Chen J., Wang Z., Zhang X., Fang Z., Li H. Development and clinical application of a rapid and sensitive loop-mediated isothermal amplification test for SARS-CoV-2 infection. mSphere. 2020 doi: 10.1128/mSphere.00808-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jiang M., Pan W., Arasthfer A., Fang W., Ling L., Fang H., Daneshnia F., Yu J., Liao W., Pei H., Li X., Lass-Flörl C. Development and validation of a rapid, single-step reverse transcriptase loop-mediated isothermal amplification (RT-LAMP) system potentially to Be used for reliable and high-throughput screening of COVID-19. Front. Cell. Infect. Microbiol. 2020;10:331. doi: 10.3389/fcimb.2020.00331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jin Y.H., Zhan Q.Y., Peng Z.Y., Ren X.Q., Yin X.T., Cai L., Yuan Y.F., Yue J.R., Zhang X.C., Yang Q.W., Ji J., Xia J., Li Y.R., Zhou F.X., Gao Y.D., Yu Z., Xu F., Tu M.L., Tan L.M., Yang M., Chen F., Zhang X.J., Zeng M., Zhu Y., Liu X.C., Yang J., Zhao D.C., Ding Y.F., Hou N., Wang F.B., Chen H., Zhang Y.G., Li W., Chen W., Shi Y.X., Yang X.Z., Wang X.J., Zhong Y.J., Zhao M.J., Li B.H., Ma L.L., Zi H., Wang N., Wang Y.Y., Yu S.F., Li L.Y., Huang Q., Weng H., Ren X.Y., Luo L.S., Fan M.R., Huang D., Xue H.Y., Yu L.X., Gao J.P., Deng T., Zeng X.T. Chemoprophylaxis, diagnosis, treatments, and discharge management of COVID-19: an evidence-based clinical practice guideline (updated version) Mil. Med. Res. 2020;7:41. doi: 10.1186/s40779-020-00270-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kitagawa Y., Orihara Y., Kawamura R., Imai K., Sakai J., Tarumoto N., Matsuoka M., Takeuchi S., Maesaki S., Maeda T. Evaluation of rapid diagnosis of novel coronavirus disease (COVID-19) using loop-mediated isothermal amplification. Pediatr. Pulmonol. 2020;129 doi: 10.1016/j.jcv.2020.104446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kucirka L.M., Lauer S.A., Laeyendecker O., Boon D., Lessler J. Variation in false-negative rate of reverse transcriptase polymerase chain reaction–Based SARS-CoV-2 tests by time since exposure. Ann. Intern. Med. 2020 doi: 10.7326/m20-1495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Leeflang M.M. Systematic reviews and meta-analyses of diagnostic test accuracy. Clin. Microbiol. Infect. 2014;20:105–113. doi: 10.1111/1469-0691.12474. [DOI] [PubMed] [Google Scholar]
- Li M.N. Analysis of COVID-19 epidemic evolution characteristics and regional prevention and control countermeasures based on spatiotemporal data [D] Jiangxi University of Science and Technology. 2021 doi: 10.27176/d.cnki.gnfyc.2021.000198. [DOI] [Google Scholar]
- Li S., Jiang W., Huang J., Liu Y., Ren L., Zhuang L., Zheng Q., Wang M., Yang R., Zeng Y., Wang Y. Highly sensitive and specific diagnosis of coronavirus disease 19 (COVID-19) by reverse transcription multiple cross displacement amplification-labelled nanoparticles biosensor. Eur. Respir. J. 2020;56 doi: 10.1183/13993003.02060-2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Loeffelholz M.J., Tang Y.W. Laboratory diagnosis of emerging human coronavirus infections - the state of the art. Allergy. 2020;9:747–756. doi: 10.1080/22221751.2020.1745095. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Loeffelholz Michael J., Swaminathan S., Chakravorty S., Kwiatkowski R.W., Chu V.C., Kop J., Gaur R., Sin M.L.Y., Nguyen D., Singh S., Zhang N., Persing D.H. Multicenter evaluation of the cepheid xpert xpress SARS-CoV-2 test. J. Clin. Microbiol. 2020 doi: 10.1128/jcm.00926-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lu R., Wu X., Wan Z., Li Y., Jin X., Zhang C. A novel reverse transcription loop-mediated isothermal amplification method for rapid detection of SARS-CoV-2. Int. J. Mol. Sci. 2020;21 doi: 10.3390/ijms21082826. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Matzkies L.M., Leitner E., Stelzl E., Assig K., Bozic M., Siebenhofer D., Mustafa M.E., Steinmetz I., Kessler H.H. Lack of sensitivity of an IVD/CE-labelled kit targeting the S gene for detection of SARS-CoV-2. Clin. Microbiol. Infect. 2020;26 doi: 10.1016/j.cmi.2020.06.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mitchell S.L., George K.S. Evaluation of the COVID19 ID NOW EUA assay. J. Clin. Virol. 2020;128 doi: 10.1016/j.jcv.2020.104429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mustafa Hellou M., Górska A., Mazzaferri F., Cremonini E., Gentilotti E., De Nardo P., Poran I., Leeflang M.M., Tacconelli E., Paul M. Nucleic acid amplification tests on respiratory samples for the diagnosis of coronavirus infections: a systematic review and meta-analysis. Clin. Microbiol. Infect. 2021;27:341–351. doi: 10.1016/j.cmi.2020.11.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petitti D.B. Approaches to heterogeneity in meta-analysis. Stat. Med. 2001;20:3625–3633. doi: 10.1002/sim.1091. [DOI] [PubMed] [Google Scholar]
- Ridgway J.P., Pisano J., Landon E., Beavis K.G., Robicsek A. Clinical sensitivity of severe acute respiratory syndrome coronavirus 2 nucleic acid amplification tests for diagnosing coronavirus disease 2019. Open Forum Infect. Dis. 2020;7 doi: 10.1093/ofid/ofaa315. ofaa315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rödel J., Egerer R., Suleyman A., Sommer-Schmid B., Baier M., Henke A., Edel B., Löffler B. Use of the variplexTM SARS-CoV-2 RT-LAMP as a rapid molecular assay to complement RT-PCR for COVID-19 diagnosis. J. Clin. Virol. 2020;132 doi: 10.1016/j.jcv.2020.104616. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saleem S., Ali A., Suleman M., Babar Z., Shafiq A., Khan M., Wei D.Q., Stevens B., Hogan C.A., Sahoo M.K., Huang C., Garamani N., Zehnder J., Kurzer J., Pinsky B.A. Comparison of a point-of-Care assay and a high-complexity assay for detection of SARS-CoV-2 RNA. J. Biomol. Struct. Dyn. 2020 doi: 10.1093/jalm/jfaa135. [DOI] [Google Scholar]
- Shen L., Huang F., Chen X., Xiong Z., Yang X., Li H., Cheng F., Guo J., Gong G. Diagnostic efficacy of three test kits for SARS-CoV-2 nucleic acid detection. Zhejiang Da Xue Xue Bao Yi Xue Ban. 2020;49:185–190. doi: 10.3785/j.issn.1008-9292.2020.03.09. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith E., Zhen W., Manji R., Schron D., Duong S., Berry G.J. Analytical and clinical comparison of three nucleic acid amplification tests for SARS-CoV-2 detection. J. Clin. Microbiol. 2020;58 doi: 10.1128/jcm.01134-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smithgall M.C., Scherberkova I., Whittier S., Green D.A. Comparison of cepheid xpert xpress and abbott ID now to Roche cobas for the rapid detection of SARS-CoV-2. J. Clin. Virol. 2020;128 doi: 10.1016/j.jcv.2020.104428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Subsoontorn P., Lohitnavy M., Kongkaew C. The diagnostic accuracy of isothermal nucleic acid point-of-care tests for human coronaviruses: a systematic review and meta-analysis. Sci. Rep. 2020;10:22349. doi: 10.1038/s41598-020-79237-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Touma M. COVID-19: molecular diagnostics overview. J. Mol. Med. 2020;98:947–954. doi: 10.1007/s00109-020-01931-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walsh K.A., Jordan K., Clyne B., Rohde D., Drummond L., Byrne P., Ahern S., Carty P.G., O’Brien K.K., O’Murchu E., O’Neill M., Smith S.M., Ryan M., Harrington P. SARS-CoV-2 detection, viral load and infectivity over the course of an infection. J. Infect. 2020;81:357–371. doi: 10.1016/j.jinf.2020.06.067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang J., Cai K., Zhang R., He X., Shen X., Liu J., Xu J., Qiu F., Lei W., Wang J., Li X., Gao Y., Jiang Y., Xu W., Ma X. 2020. Novel One-Step Single-Tube Nested Quantitative Real-Time PCR Assay for Highly Sensitive Detection of SARS-CoV-2; pp. 9399–9404. 92. [DOI] [PubMed] [Google Scholar]
- Wiersinga W.J., Rhodes A., Cheng A.C., Peacock S.J., Prescott H.C. Pathophysiology, transmission, diagnosis, and treatment of coronavirus disease 2019 (COVID-19): a review. Jama. 2020;324:782–793. doi: 10.1001/jama.2020.12839. [DOI] [PubMed] [Google Scholar]
- Williams E., Bond K., Chong B., Giltrap D., Eaton M., Kyriakou P., Calvert P., Zhang B., Siwan M., Howden B., Druce J., Catton M., Williamson D.A. Implementation and evaluation of a novel real-time multiplex assay for SARS-CoV-2: in-field learnings from a clinical microbiology laboratory. Pathology. 2020;52:754–759. doi: 10.1016/j.pathol.2020.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wolters F., van de Bovenkamp J., van den Bosch B., van den Brink S., Broeders M., Chung N.H., Favié B., Goderski G., Kuijpers J., Overdevest I., Rahamat-Langedoen J., Wijsman L., Melchers W.J., Meijer A. Multi-center evaluation of cepheid xpert® xpress SARS-CoV-2 point-of-care test during the SARS-CoV-2 pandemic. J. Clin. Virol. 2020:128. doi: 10.1016/j.jcv.2020.104426. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xiao A.T., Tong Y.X., Zhang S. False negative of RT-PCR and prolonged nucleic acid conversion in COVID-19: rather than recurrence. J. Med. Virol. 2020;92:1755–1756. doi: 10.1002/jmv.25855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yan C., Cui J., Huang L., Du B., Chen L., Xue G., Li S., Zhang W., Zhao L., Sun Y., Yao H., Li N., Zhao H., Feng Y., Liu S., Zhang Q., Liu D., Yuan J. Rapid and visual detection of 2019 novel coronavirus (SARS-CoV-2) by a reverse transcription loop-mediated isothermal amplification assay. Clin. Microbiol. Infect. 2020;26:773–779. doi: 10.1016/j.cmi.2020.04.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhen W., Manji R., Smith E., Berry G.J. Comparison of four molecular in vitro diagnostic assays for the detection of SARS-CoV-2 in nasopharyngeal specimens. J. Clin. Microbiol. 2020;58 doi: 10.1128/jcm.00743-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhen W., Smith E., Manji R., Schron D., Berry G.J. Clinical evaluation of three sample-to-Answer platforms for detection of SARS-CoV-2. Int. Breastfeed. J. 2020;58 doi: 10.1128/jcm.00783-20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhifeng J., Feng A., Li T. Consistency analysis of COVID-19 nucleic acid tests and the changes of lung CT. J. Clin. Virol. 2020;127 doi: 10.1016/j.jcv.2020.104359. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.