False-negative results of initial RT-PCR assays for COVID-19: A systematic review

Ingrid Arevalo-Rodriguez; Diana Buitrago-Garcia; Daniel Simancas-Racines; Paula Zambrano-Achig; Rosa Del Campo; Agustin Ciapponi; Omar Sued; Laura Martinez-García; Anne W Rutjes; Nicola Low; Patrick M Bossuyt; Jose A Perez-Molina; Javier Zamora

doi:10.1371/journal.pone.0242958

. 2020 Dec 10;15(12):e0242958. doi: 10.1371/journal.pone.0242958

False-negative results of initial RT-PCR assays for COVID-19: A systematic review

Ingrid Arevalo-Rodriguez ^1,^2,^*, Diana Buitrago-Garcia ^3,⁴, Daniel Simancas-Racines ⁵, Paula Zambrano-Achig ⁶, Rosa Del Campo ⁶, Agustin Ciapponi ⁷, Omar Sued ⁸, Laura Martinez-García ^2,⁶, Anne W Rutjes ^3,⁴, Nicola Low ^3,⁴, Patrick M Bossuyt ⁹, Jose A Perez-Molina ^10,¹¹, Javier Zamora ^1,^2,¹²

Editor: Daniela Flavia Hozbor¹³

¹Clinical Biostatistics Unit, Hospital Universitario Ramón y Cajal- IRYCIS, Madrid, Spain

²CIBER of Epidemiology and Public Health, Madrid, Spain

³Institute of Social and Preventive Medicine (ISPM), University of Bern, Bern, Switzerland

⁴Graduate School for Health Sciences, University of Bern, Bern, Switzerland

⁵Centro de Investigación en Salud Pública y Epidemiología Clínica (CISPEC), Facultad de Ciencias de la Salud “Eugenio Espejo”, Universidad UTE, Quito, Ecuador

⁶Department of Microbiology, Ramón y Cajal University Hospital, Ramón y Cajal Health Research Institute (IRYCIS), Madrid, Spain

⁷Instituto de Efectividad Clínica y Sanitaria (IECS-CONICET), Buenos Aires, Argentina

⁸Fundación Huésped, Buenos Aires, Argentina

⁹Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, The Netherlands

¹⁰Infectious Diseases Department, National Referral Centre for Tropical Diseases, Hospital Universitario Ramón y Cajal, Madrid, Spain

¹¹Instituto Ramón y Cajal de Investigación Sanitaria, Madrid, Spain

¹²Institute of Applied Health Research, University of Birmingham, Birmingham, United Kingdom

¹³Universidad Nacional de la Plata, ARGENTINA

Competing Interests: The authors have declared that no competing interests exist.

^✉

* E-mail: ingrid.arevalo@salud.madrid.org

Roles

Ingrid Arevalo-Rodriguez: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

Diana Buitrago-Garcia: Conceptualization, Investigation, Methodology, Validation, Writing – original draft, Writing – review & editing

Daniel Simancas-Racines: Conceptualization, Data curation, Investigation, Methodology, Validation, Writing – original draft, Writing – review & editing

Paula Zambrano-Achig: Investigation, Methodology, Writing – original draft, Writing – review & editing

Rosa Del Campo: Conceptualization, Data curation, Investigation, Methodology, Validation, Writing – original draft, Writing – review & editing

Agustin Ciapponi: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Validation, Writing – original draft, Writing – review & editing

Omar Sued: Formal analysis, Investigation, Writing – original draft, Writing – review & editing

Laura Martinez-García: Data curation, Formal analysis, Investigation, Validation, Writing – original draft, Writing – review & editing

Anne W Rutjes: Conceptualization, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

Nicola Low: Conceptualization, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

Patrick M Bossuyt: Supervision, Validation, Writing – review & editing

Jose A Perez-Molina: Conceptualization, Data curation, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

Javier Zamora: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing

Daniela Flavia Hozbor: Editor

PMCID: PMC7728293 PMID: 33301459

Abstract

Background

A false-negative case of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection is defined as a person with suspected infection and an initial negative result by reverse transcription-polymerase chain reaction (RT-PCR) test, with a positive result on a subsequent test. False-negative cases have important implications for isolation and risk of transmission of infected people and for the management of coronavirus disease 2019 (COVID-19). We aimed to review and critically appraise evidence about the rate of RT-PCR false-negatives at initial testing for COVID-19.

Methods

We searched MEDLINE, EMBASE, LILACS, as well as COVID-19 repositories, including the EPPI-Centre living systematic map of evidence about COVID-19 and the Coronavirus Open Access Project living evidence database. Two authors independently screened and selected studies according to the eligibility criteria and collected data from the included studies. The risk of bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. We calculated the proportion of false-negative test results using a multilevel mixed-effect logistic regression model. The certainty of the evidence about false-negative cases was rated using the GRADE approach for tests and strategies. All information in this article is current up to July 17, 2020.

Results

We included 34 studies enrolling 12,057 COVID-19 confirmed cases. All studies were affected by several risks of bias and applicability concerns. The pooled estimate of false-negative proportion was highly affected by unexplained heterogeneity (tau-squared = 1.39; 90% prediction interval from 0.02 to 0.54). The certainty of the evidence was judged as very low due to the risk of bias, indirectness, and inconsistency issues.

Conclusions

There is substantial and largely unexplained heterogeneity in the proportion of false-negative RT-PCR results. The collected evidence has several limitations, including risk of bias issues, high heterogeneity, and concerns about its applicability. Nonetheless, our findings reinforce the need for repeated testing in patients with suspicion of SARS-Cov-2 infection given that up to 54% of COVID-19 patients may have an initial false-negative RT-PCR (very low certainty of evidence).

Systematic review registration

Protocol available on the OSF website: https://tinyurl.com/vvbgqya.

Introduction

Accurate laboratory tests are essential for the diagnosis and management of emerging infectious diseases. On December 31, 2019, the World Health Organization (WHO) was alerted about a cluster of patients with pneumonia in Wuhan City, Hubei province, China [1]. Chinese authorities confirmed, a week later, an outbreak of a novel coronavirus. The virus has been named as severe acute respiratory coronavirus 2 (SARS-CoV-2) (SARS-CoV-2) [2], and the clinical disease that it causes is coronavirus disease 2019 (COVID-19), which has become a worldwide public health emergency and reached pandemic status [3, 4]. By October 16 2020, there was a total of 39.023.292 confirmed cases, and 1.099.586 confirmed cases worldwide [5].

Clinical suspicion of COVID-19 is based primarily on respiratory symptoms such as fever, cough, and shortness of breath as primary manifestations [6, 7]. The spectrum of symptoms and clinical signs associated with COVID-19 has expanded with increasing knowledge about SARS-CoV-2. Although most of the cases present mild symptoms, some cases have developed pneumonia, severe respiratory diseases, kidney failure or heart failure [8–11]. The death rate from SARS-CoV-2 infection is estimated to be of 0.68% (95% CI from 0.53 to 0.82) [12] SARS-CoV-2 mainly spreads through person-to-person contact via respiratory droplets from coughing and sneezing, and through surfaces that have been contaminated with these droplets [13]. A proportion of cases will, however, remain asymptomatic throughout the course of infection, estimated as around 20% in a range of settings [14, 15].

Because the signs of infection mentioned above are non-specific, confirmation of cases is currently based on the detection of nucleic acid amplification tests that detect viral ribonucleic acid (RNA) sequences by reverse transcription-polymerase chain reaction (RT-PCR) [16]. Different RT-PCR assays have been proposed, all of which include the N gene that codes for the viral nucleocapsid. Other alternative targets are the E gene, for the viral envelope; the S gene for the spike protein; and the Hel gene for the RNA polymerase gene (RdRp/Helicase) [16, 17]. Molecular criteria for in vitro diagnosis of COVID-19 disease are heterogeneous, and usually require the detection of two or more SARS-CoV-2 genes [18].

A person with a negative RT-PCR result at initial testing, with a subsequent positive test result, is considered as a false-negative diagnosis. Clinical practice guidelines and consensus statements recommend repeated RT-PCR testing to confirm a clinical diagnosis, especially in the presence of symptoms associated with COVID-19 [19–23]. Researchers have suggested that these failures in SARS-CoV-2 detection are related to multiple preanalytical and analytical factors, such as lack of standardisation for specimen collection, delays or poor storage conditions before arrival in the laboratory, the use of inadequately validated assays, contamination during the procedure, insufficient viral specimens and load, the incubation period of the disease, and the presence of mutations that escape detection or PCR inhibitors [18, 24].

The availability of accurate laboratory tools for COVID-19 is essential for case identification, contact tracing, and optimisation of infection control measures, as it was shown by previous epidemics caused by SARS-CoV and the Middle East Respiratory Syndrome Coronavirus (MERS-CoV) [25–27]. Due to the significant burden on health systems around the globe caused by the COVID-19 pandemic, and the potential consequences at several levels of missing a COVID-19 case, we aimed to obtain through a systematic review of the literature, a summary estimate of the proportion of false-negatives related to the detection of SARS-CoV-2 using RT-PCR assays at the first healthcare encounter (initial testing).

Materials and methods

We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy Studies (PRISMA-DTA) to report this review [28]. This manuscript reflects the third update of our literature searches with information current up to July 2020. The initial review protocol, previous reports of findings by date of search and supplementary material are available in the Open Science Framework repository (https://tinyurl.com/vvbgqya).

Criteria for considering studies for this review

We included observational studies (including diagnostic test accuracy studies) reporting the initial use of RT-PCR to detect SARS-CoV-2 RNA in patients with suspected infection by clinical or epidemiological criteria. We primarily aimed to include studies enrolling consecutive patients who received an RT-PCR test at the first healthcare encounter (initial testing), with further confirmation of SARS-CoV-2 infection of initial negative cases by an additional RT-PCR evaluation. We did not impose limits by age, gender, or study location.

We aimed to include all types of RT-PCR kits, regardless of the brand or manufacturer, the RNA extraction method used, the number of target gene assays assessed, or the cycle threshold value for positivity. We excluded studies that focused on other populations or reporting samples/specimens instead of patients (such as monitoring or discharge of COVID-19 confirmed cases, population screening and patients with comorbidities), studies only providing the absolute number of false-negatives or without clear information about numerical information, and studies reporting validation of novel assays or comparing sample collection/sample specimens (i.e. focus on agreement). Full eligibility criteria can be found in the S1 File.

Search methods for identification of studies

We carried out a comprehensive and sensitive search strategy based on search terms developed for the COVID-19 Open Access Project by researchers and librarians at the Institute of Social and Preventive Medicine, University of Bern (https://ispmbern.github.io/covid-19/living-review/collectingdata.html) in the following databases:

MEDLINE (Ovid SP, 1946 to July 17, 2020)
Embase (Ovid SP, 1982 to July 17, 2020)
LILACS (iAH English) (BIREME, 1982 to July 17, 2020)

We did not apply any language restrictions to electronic searches (S2 File). As additional sources of potential studies, we searched in repositories of preprint articles, registries for ongoing or recently completed clinical trials (clinicaltrials.gov; the World Health Organization International Trials Registry and Platform, and the ISRCTN Registry), and the reference lists of all relevant papers. We also screened the following resources for additional information:

The WHO Database of publications on coronavirus disease (COVID-19) (Available on https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov).
The LOVE (Living OVerview of Evidence) centralised repository developed by Epistemonikos (available on https://app.iloveevidence.com/topics)
The Living systematic map of the evidence about COVID-19 produced by the Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre) [29].
The COVID-19 Open Access Project Living Evidence on COVID-19, developed at the Institute of Social and Preventive Medicine, University of Bern (available on https://ispmbern.github.io/covid-19/)

Data collection and analysis

For the selection of eligible studies, two out of three reviewers (IAR, DBG or PZA) independently screened the search results based on their titles and abstract. We retrieved the full-text copy of each study assessed as potentially eligible, and two out of three reviewers (IAR, DBG or PZA) confirmed eligibility according to the selection criteria. In case of disagreements, we reached consensus by discussion. For data extraction, one reviewer extracted qualitative and quantitative data from eligible studies, and an additional reviewer checked all the extracted information for accuracy. We contacted study authors to supply missing information about critical characteristics of included studies.

Assessment of methodological quality

Two authors independently assessed the risk of bias of included studies, and disagreements were resolved through discussion. We evaluated the methodological quality using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool [30]. We decided to also apply the QUADAS-2 tool for case series studies due to the lack of tools to assess the risk of bias associated with these studies. However, for a more comprehensive assessment of the limitations of the included studies, we adapted the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Case Series [31]. This tool included items about inclusion criteria, measurement of asymptomatic status, follow-up of the course of the disease, and availability of numerator and denominator. We added questions about the representativeness of the source and target populations as well.

Statistical analysis and data synthesis

For all included studies, we extracted data to calculate the proportion of false-negative results. The numerator (false-negative cases) was the number of cases initially considered negative by RT-PCR. The denominator was the total number of SARS-CoV-2 infections, detected on an additional test by RT-PCR, using the same or a different assay. We presented the results of estimated proportions (with 95% CIs) in a forest plot to assess the between-study variability. We aimed to calculate a summary estimate of the false-negative rate with the corresponding 95% CI using a multilevel mixed-effect logistic regression model in Stata 16^®. This method allowed us to estimate the between-study heterogeneity from the variance of study-specific random intercepts. We computed 90% prediction intervals to include the between-study variation. The 90% prediction interval shows the range of true false-negative proportions that can be expected in 90% of future settings, comparable to the ones included in the meta-analysis. We expressed heterogeneity in primary study results using the Tau-square statistic.

We planned to investigate the potential sources of heterogeneity using a descriptive approach and performing a random-effects meta-regression analysis, including covariates, one at each time, into the logistic model. Anticipated sources of heterogeneity included the type of specimen collected, the presence or not of clinical findings, the number of RNA targets genes under assessment, and the time of symptom evolution.

Summary of findings and certainty of the evidence

We rated the certainty of the evidence about false-negative cases following the GRADE approach for tests and strategies [32, 33]. We assessed the quality of evidence as high, moderate, low, or very low, depending on several factors, including risk of bias, imprecision, inconsistency, indirectness, and publication bias. We illustrate the consequences of the numerical findings in a population of 100 tested, according to three different prevalence estimates of the disease provided by the stakeholders involved in this review.

Results

Electronic searches yielded 2536 references from the selected databases. In addition, we obtained 186 additional references searching in other resources (Fig 1). Our initial screening of titles and abstracts identified 171 references to assess in full text. We excluded 137 studies mostly due to: a) ineligible setting (no initial SARS-CoV-2 testing); b) incomplete or no data about false-negative cases and COVID-19 confirmed cases; c) ineligible population (i.e. pooling sample, analysis based on samples instead of patients) (S3 File). The between reviewers agreement in the selection of references in the title & abstract stage was moderate (kappa statistic = 0.56), while the agreement in the full-text selection was substantial (kappa statistic = 0.75). We included 34 studies in our synthesis [34–67] that dealt with 12057 patients (Fig 1).

The sample sizes ranged from 18 to 5,700 COVID-19 confirmed cases (median 90; interquartile range–IQR = 46.5 to 204). Twelve studies focused on the estimation of diagnostic test accuracy of alternative tests in populations with suspected COVID-19 at the beginning of the study [34, 37–41, 44, 46, 47, 51, 57, 65]. The remaining studies reported information from case series, most of which included confirmed cases of COVID-19 at the beginning of the study [35, 36, 42, 43, 45, 48–50, 52–56, 58–64, 66, 67]. One study focused its data collection only on children [53] and other only on healthcare workers [48].

Data collection from cases ranged from January 1 [58] to April 15, 2020 [41, 48]; two studies did not provide complete information about the time of recruitment [35, 45]. Ten studies were carried out in institutions outside of China [35, 37, 41, 45, 46, 48, 49, 52, 54, 61]. The age of participants was reported in different ways in 21 studies providing information of COVID-19 confirmed cases [38–45, 47, 51, 53–55, 58, 59, 61–65, 67]: for studies reporting a mean, the average ranged from 2.5 [53] to 56 years [58], while for studies reporting medians, the corresponding range was 45 [44] to 63 years [54]. These 21 studies reported a total of 5331 men and 4067 women (Table 1).

Table 1. Characteristics of included studies.

ID	Data collection	Country	Setting	Age (years)	% Male: % Female	Type of specimen	RT-PCR Brand	Target genes	Days from symptoms onset (days)
Ai T 2020 [34]	January 6- February 6	China	Tongji Hospital of Tongji MedicalCollege of Huazhong University of Science and Technology, Wuhan, Hubei, China	Mean 51 ± 15	46:54 ^b	Throat swab	• TaqMan One-Step RT-PCR Kits from Shanghai Huirui Biotechnology Co., Ltd	Not reported	Not reported
Ai T 2020 [34]	January 6- February 6	China		Range from 2 to 95 ^b	46:54 ^b	Throat swab	• Shanghai BioGerm Medical Biotechnology Co., Ltd	Not reported	Not reported
Albert E 2020 [35]	Unclear-April 14	Spain	Hospital Clínico Universitario of Valencia	Median 65 years; range from 3 to 98 ^c	57:43 ^c	Nasopharyngeal or oropharyngeal swabs, upper RT samples	• LightMix Modular SARS‐CoV‐2 (COVID‐19) E‐gene/LightMix Modular SARS‐CoV‐2 (COVID‐19) RdRP gene from TIB MOLBIOL GmHD	E, RdRp, S	Median 5 days; range: 1–14 days
							• SARS‐CoV‐2 Real‐time PCR Kit from Vircell Diagnostics
							• SARS‐CoV‐2 (S gene)–BD Max System (Viasure Real‐Time PCR Detection Kits; CerTest, Zaragoza, Spain).
Bernheim A 2020 [36]	January 18- February 2	China	Hospitals from four provinces in China: Nanchang (Jiangxi Province), Zhuhai (Guangdong Province), Chengdu (Sichuan province) and Guilin (Guangxi province)	Mean 45 ±15,6 ^b	50:50 ^b	Bronchoalveolar lavage, endotracheal aspirate, nasopharyngeal swab, or oropharyngeal swab	• Sansure Biotech Inc. (Changsha, China), Shanghai Zhijiang Biotechnology Co. (Shanghai, China),	Not reported	Range from 0 to 12
Bernheim A 2020 [36]	January 18- February 2	China		Mean 45 ±15,6 ^b	50:50 ^b		• Da An Gene Co. (Guangzhou, China).	Not reported	Range from 0 to 12
Besutti G 2020 [37]	March 13–23	Italy	AUSL-IRCCS di Reggio Emilia, Reggio Emilia, Italy	Mean 59 ± 15.8 ^b	59:41 ^b	Nasopharyngeal and oropharyngeal swabs	GeneFinder^™ COVID -19 PLUS Real Real Amp Kit	Not reported	Not reported
Chen D 2020 [38]	January 19-February 20	China	Five non-specialised infectious disease hospitals in Guangzhou	Mean 49.7 ± 15.7 ^a	43:57 ^a	Nasopharyngeal or oropharyngeal swabs	Not reported	Not reported	Not reported
Chen HJ 2020 [39]	January 26-February 4	China	Hainan General Hospital	Mean 54.5 ± 11.8 ^a	68:32 ^a	Not reported	Not reported	Not reported	Mean 6,3 ± 5,6 days
Chen ZH 2020 [40]	January 24-February 6	China	The Hangzhou Xixi Hospital Affiliated to Zhejiang Chinese Medical University	Mean 46.9 ± 11.1 ^a	55:45 ^a	Not reported	Not reported	Not reported	Mean 2; range 1 to 4,5 days
Çinkooğlu A 2020 [41]	March 15-April 15	Turkey	Ege University Faculty of Medicine	Means from 39.9 to 51 ^a	47:53 ^a	Not reported	Not reported	Not reported	Not reported
Dai H 2020 [42]	January 10-February 7	China	13 hospitals in Jiangsu	Mean 44.6 ± 14.8 ^a	58:42 ^a	Respiratory samples	Not reported	Not reported	Not reported
Duan X 2020 [43]	January 10-February 8	China	The First Affiliated Hospital, College of Clinical Medicine, Medical College of Henan University of Science and Technology, Luoyang	Mean 52 ± 19.3 ^a	60:40 ^a	Nasal and pharyngeal swab specimens	Not reported	Not reported	Mean 6,64 ± 3,82 days
Fang Y 2020 [44]	January 19-February 4	China	Taizhou Enze Medical Center (Group) Enze Hospital, China	Median 45;	57:43 ^a	Throat swab, sputum	Not reported	Not reported	Mean 3±3
Fang Y 2020 [44]	January 19-February 4	China	Taizhou Enze Medical Center (Group) Enze Hospital, China	IQR: 39–55 ^a	57:43 ^a	Throat swab, sputum	Not reported	Not reported	Mean 3±3
Fechner C 2020 [45]	Unclear	Switzerland	Cantonal Hospital Lucerne	Mean 63 ± 15.7 ^a	75:25 ^a	Nasopharyngeal or oropharyngeal swabs	Not reported	Not reported	Not reported
Gietema 2020 [46]	March 13–24	Netherlands	Maastricht University Medical Centre (MUMC+), the Netherlands	Median 66; IQR: 55–76 ^b	59:41 ^b	Nasopharyngeal and/or oropharyngeal swab	• Tib-Molbiol (Berlin, Germany)	RdRp, E	Not reported
Gietema 2020 [46]	March 13–24	Netherlands		Median 66; IQR: 55–76 ^b	59:41 ^b	Nasopharyngeal and/or oropharyngeal swab	• Biolegio (Netherlands)	RdRp, E	Not reported
He JL 2020 [68]	January 10 –February 28	China	University of Hong Kong-Shenzhen Hospital, China	Median 52; range: 8 to 74 ^a	50:50 ^a	Nasopharyngeal swab, oropharyngeal swab, endotracheal aspirate, or bronchoalveolar lavage	BGI Genomics (Shenzhen, China)	Not reported	Not reported
Lan FY 2020 [48]	March 9-April 15	USA	Massachusetts community healthcare system	Mean 43.6 ± 12.9 ^b	21:79 ^b	Nasopharyngeal swabs	• CDC 2019-Novel RT-PCR	Not reported	Not reported
							• Roche Cobas SARS-CoV-2
							• Abbott Real Time SARS-CoV-2
Lee TH 2020 [49]	January-February 29	Singapore	National Centre for Infectious Diseases, Singapore	Not reported	Not reported	Nasopharyngeal swabs, sputum, and stool if diarrhoea is present	• Laboratory developed test	N +ORF1ab	Median 5 days; range from 1 to 24 days
Lee TH 2020 [49]	January-February 29	Singapore	National Centre for Infectious Diseases, Singapore	Not reported	Not reported		• A*STAR Fortitude Kit (Accelerate Technologies, Singapore)	N +ORF1ab	Median 5 days; range from 1 to 24 days
Li Y 2020 [50]	February 2–17	China	Hankou Hospital of Wuhan, China	Median 57; range: 22 to 88 ^b	56:44 ^b	Pharyngeal swab specimens	Shengxiang Biotechnology Co (novel coronavirus 2019-nCoV nucleic acid detection kit (fluorescence PCR method) ^d	ORF1ab ^d	Not reported
Long C 2020 [51]	January 20-February 8	China	Yichang Yiling Hospital, China	Mean 44,8 ±18,2 ^a	56:44 ^a	Not reported	DAAN GENE ^d	ORF1ab ^d	Only duration of fever reported: 2,6 ± 1,7 days
Long DR 2020 [52]	March 2–30	USA	University of Washington Virology clinical laboratory	Means from 56.7 to 61.6 ^c	57:43 ^c	Nasopharyngeal swabs	• Laboratory-developed test (LDT) two-target/two-control assay modified from the CDC	N1, N2, ORF1ab, E, S	Not reported
							• Panther Fusion SARS-CoV-2 assay (Hologic, Marlborough, MA, target genes two conserved regions of ORF1ab);
							• Roche RT-PCR (Basel, Switzerland, target E gene)
							• DiaSorin (Saluggia, Italy, target ORF1ab and S genes).
Ma H 2020 [53]	January 21-February 14	China	Wuhan Children’s Hospital	Mean 2.5; range: 0.9 to 7 ^a	56:44 ^a	Not reported	Not reported	Not reported	Not reported
Richardson 2020 [54]	March 1-April 4	USA	12 hospitals in New York City, Long Island, and Westchester County, New York (Northwell Health system), USA	Median 63; IQR: 52–75 ^a	60:40 ^a	Nasopharyngeal swabs	Not reported	Not reported	Not reported
Shen N 2020 [55]	January 22-February 18	China	Tongji Hospital in Wuhan	Median 56; IQR: 42–66	49:51	Throat swabs	SARS-CoV-2 nucleic acid detection kit (Shanghai Huirui Biotechnology Co. Ltd)	N +ORF1ab	Not reported
Wang P 2020 [56]	January 25-March 16	China	First People’s Hospital of Jingmen, Hubei Province	Median 58; range: 21–95	46:54	Throat swabs	RT-PCR reagent BioGerm (Shanghai BioGerm Medical Technology Co., Ltd.)	N +ORF1ab	Not reported
Wen Z 2020 [57]	January 21-February 14	China	Two areas in Henan Province, China	Median 16; range: 12 to 98 ^b	47:53 ^b	throat-swab, sputum, or alveolar lavage fluid specimens	Not reported	Not reported	Not reported
Wong HYF 2020 [58]	January 1-March 5	China	Four tertiary and regional hospitals in Hong Kong (Queen Mary Hospital, Pamela Youde Nethersole Eastern Hospital, Queen Elizabeth Hospital, and Ruttonjee Hospital), China	Mean 56; range: 16 to 96 ^a	41:59 ^a	nasopharyngeal swabs and throat swabs	QuantiNova Probe RT-PCR Kit (QIAGEN, Hilden, Germany)	RdRp	Not reported
Wu J 2020 [59]	January 22-February 14	China	First People’s Hospital of Yancheng City, the Second People’s Hospital of Yancheng City, and the Fifth People’s Hospital of Wuxi, China	Median 46.1; IQR: 30.7 to 61.5	49:51	nose swab and/or throat swab	Bio-germ, Shanghai, China	N +ORF1ab	Not reported
Xie X 2020 [60]	January 16-February 2	China	Database of Radiology Quality Control Centre, Hunan/ 3 cities in Hunan Province, China	Not reported	Not reported	swab test; no further details provided	Not reported	Not reported	Not reported
Young BE 2020 [61]	January 23-February 3	Singapore	4 hospitals in Singapore	Median 47; range: 31–73 ^a	50:50 ^a	Nasopharyngeal swabs	QuantiTect Probe RT-PCR kit (Qiagen)	N, S, ORF1ab	Median 13; range 5–24 days
Zhang H 2020 [62]	January 22-February 28	China	Huanggang Central Hospital and The Second Affiliated Hospital of Shandong First Medical University	Median 48.3; IQR: 33–56 ^a	56:44 ^a	Not reported	The Beijing Genomics Institute (BGI, Beijing, China)	Not reported	Not reported
Zhang JJ 2020 [63]	December 29-February 16	China	Zhongnan Hospital of Wuhan University and No.7 hospital of Wuhan, China	Median 57; range: 22 to 88 ^a	53:47 ^a	Pharyngeal swab	Shanghai bio-germ Medical Technology Co Ltd	N +ORF1ab	Not reported
Zhao JJ [64]	January 11-February 9	China	Shenzhen Third People’s Hospital	Median 48; IQR: 35–61 ^a	49:51 ^a	Throat swabs, Nasal swabs	Not reported	Not reported	Not reported
Zhifeng 2020 [65]	January 25-February 6	China	Xiaogan Central Hospital, China	Range: 23 to 82 ^a	59:41 ^a	Throat swabs	Multiple brands ^d	N +ORF1ab	Mean 6,5 days ^d
Zhou H 2020 [66]	January 19-February 15	China	First Affiliated Hospital, Zhejiang University School of Medicine	Mean 53.3; range: 14–96 ^c	59:41 ^c	Bronchoalveolar lavage, endotracheal aspirate, or nasopharyngeal swab	Not reported	Not reported	Not reported
Zhou S 2020 [67]	January 16-February 12	China	Tongji Hospital of Tongji Medical College, Huazhong University of Science and Technology	Mean 52.3 ± 13.1 ^a	54:46 ^a	Pharyngeal swab	Not reported	Not reported	Not reported

Open in a new tab

Notes:

^a) Information from COVID-19 confirmed cases only;

^b) Information from COVID-19 suspected (positive and negative);

^c) information from other groups reported by the authors;

^d) data provided by the corresponding author (personal communication).

CDC: Center for Disease Control and Prevention; LDT: Laboratory-developed test; ORF1ab: Open Reading Frame 1ab; RdRp gene: RNA polymerase gene; RT-PCR: Reverse transcription polymerase chain reaction; SARS-CoV-2: Severe acute respiratory syndrome coronavirus 2.

In all cases, the presence of infection was confirmed after detection of SARS-CoV-2 RNA in any real-time RT-PCR assay that was repeated after a negative result. The specimens collected for the RT-PCR assessment were heterogeneous in most of the included studies; in 13 studies the authors reported the use of nasopharyngeal swabs [35–38, 45–47, 49, 52, 54, 58, 61, 66], along with oropharyngeal swabs in seven of these 13 studies [35–38, 45–47] (Table 1). The name/brand of the SARS-CoV-2 nucleic acid detection kit used was reported by 19 studies [34–37, 46–52, 55, 56, 58, 59, 61–63, 65], and 13 studies reported the target genes under assessment for positivity [35, 46, 49–52, 55, 56, 58, 59, 61, 63, 65], with the ORF1ab being the most frequently used (8 studies). Ten studies provided heterogeneous information about the time from the symptom onset to initial testing [35, 36, 39, 40, 43, 44, 49, 51, 61, 65] (Table 1).

Quality of included studies

After classification with the QUADAS-2 tool (Fig 2 and S4 File), the domain most affected by a high risk of bias was the flow and timing domain, as some studies had not repeated the RT-PCR testing to all patients with negative results at initial testing [37, 45, 46, 52, 54, 55]; besides, some studies did not provide information about the interval of time for the administration of a new RT-PCR assay. In the patient selection domain, the risk of bias and applicability concerns were judged as high or unclear for several studies in which participant selection was driven by prior testing with RT-PCR, Chest CT findings or serology tests. In most of the studies it was unclear if a standard testing protocol was used, or if authors restricted participant sampling to those who had received all test [34–36, 38–41, 47, 48, 51, 53, 57, 58, 60, 64, 67].

In the index test domain, several studies lacked to provide details about the criteria for positive results, such as the target genes under assessment of the SARS-CoV-2 nucleic acid detection kit used, so that their risk of bias and applicability remained unclear [34, 36–45, 47, 48, 50, 51, 53, 54, 57, 60, 64, 66, 67]. Finally, two studies were judged at unclear risk of bias and applicability in the reference standard domain, since the authors did not report the characteristics of the repeated RT-PCR and their administration in sufficient detail [39, 52]. Six studies were considered as at low risk of bias in all QUADAS-II domains assessed [49, 56, 59, 61, 62, 65], while 20 were considered as at unclear risk due to at least one domain was judged with unclear risk of bias. The remaining eight studies were considered high risk of bias as at least one domain was judged at high risk [37, 38, 46, 51, 52, 54, 55, 63].

The assessment of limitations using the adapted JBI case-series tool provided a similar picture owing to the uncertainty regarding the consecutive inclusion of patients and follow-up time after the first RT-PCR result (S4 File). Additionally, due to the selection of patients, the majority of included studies were not an adequate sample of the target population (S4 File).

Findings

We analysed information from 34 studies collecting information from 12,057 patients confirmed to have SARS-CoV-2 infection and 1060 cases with RT-PCR negative findings in their initial assessment. False-negative rates ranged from 0.018 [45] to 0.58 [57], with a median of 0.11 (Fig 2).

The summary estimate of the false-negative rate was 0.13 (95% CI 0.09 to 0.19). The data were characterised by a considerable between-study heterogeneity, the 90% prediction interval ranged from 0.02 to 0.54 (tau-squared = 1.39).

Assessment of the effect of potential sources of heterogeneity was limited because stratified information for relevant subgroups was not available in most studies (Table 2). There were no differences related to the duration of symptoms at the time of first RT-PCR test based on information derived from nine studies provided means and medians of symptoms onset (Table 2). Comparison of false-negative rates of studies using different RT-PCR kits targetting (nucleocapside N-gene and/or ORF1ab gene) makes no significant differences (Table 2). In addition, most studies (28 out of 34) reported a mix of specimen types collected for RT-PCR assessment; those reporting the use of nasopharyngeal swabs provided a range of false-negative from 0.018 to 0.33, while those reporting the additional use of oropharyngeal swabs reported a range of false-negative from 0.02 to 0.33. The analysis by country (China versus other countries) showed a potential effect on the summary estimations; the pooled estimate in non-Chinese countries was 0.06 (CI 95% = 0.04 to 0.09; 90% prediction interval 0.02 to 0.17; tau-squared = 0.36). Using meta-regression, we found a positive association of country with the false-negative rate (Table 2).

Table 2. Assessment of sources of heterogeneity.

Variable		Number of studies (patients)	Heterogeneity (Tau-squared)	P-value
Days of symptoms (average/median)	Less than 5 days	3 (120)	0.01	0.145
Days of symptoms (average/median)	Five days or more	6 (817)	0.87	0.145
PCR target	N gene	8 (2911)	1.09	0.448
	No N gene	5 (615)	0.30	0.448
	ORF1ab gene	10 (3188)	0.91	0.144
	No ORF1ab gene	3 (338)	0.00	0.144
Country	China	24 (4798)	1.31	0.002
Country	Other countries	10 (7259)	0.36	0.002
Type of design	Accuracy	12 (1798)	1.52	0.407
Type of design	Case series	22 (10259)	1.28	0.407
Risk of bias	High risk	8 (8947)	0.79	Reference
	Unclear risk	20 (2549)	1.31	0.357
	Low risk	6 (561)	0.60	0.004

Open in a new tab

Additional post-hoc analysis by type of study did not provide a reduction of the observed heterogeneity (accuracy studies = 0.16, 95% CI 0.08 to 0.28, tau-squared = 1.52; case-series = 0.12, 95% CI 0.08 to 0.18, tau-square = 1.28). The false-negative proportion seemed higher in studies assessing test accuracy than in case series, although confidence intervals overlapped. An analysis by the global risk of bias (based on the QUADAS-II domains) showed a difference between high risk versus low-risk studies (high-risk studies = 0.08, 95% CI 0.04 to 0.14, tau-square = 0.79; low-risk studies = 0.33, 95% CI 0.20 to 0.49, Tau-square = 0.60), although the heterogeneity remains similar to those reported for the total group (Table 2).

Summary of findings under the GRADE approach

Since we could not warrant that the average estimates from the meta-analysis were valid and representative estimates of the true value of the false-negative proportion in the current practice, we used the estimated predictive interval in the analysis of the certainty of the evidence, using the GRADE approach. We illustrated the consequences of the range of false-negative rates in a population of 100 tested, according to three different prevalence estimates seen in current clinical practice by participant stakeholders and similar to those estimated by the included studies (10%, 30%, and 50%) (Fig 3). Using a prevalence of 50%, we found that 1 to 27 cases would be misdiagnosed and would not receive adequate clinical management; in addition, they could require repeated testing at some point in their hospitalisation or require another testing for competing diagnoses. The quality of the evidence was judged to be very low due to issues related to the risk of bias, indirectness, and inconsistency (Fig 3). This numerical approach should be interpreted with caution due to the multiple limitations of the evidence described above (Fig 3).

Fig 3 — **Notes**= 1) Evidence downgraded one level due to risk of bias issues: multiple unclear risk related to patient selection and index test, several studies at high risk of bias in flow and timing Domain; 2) Evidence downgraded one level due to indirectness: unclear or high concerns about applicability of selected populations enrolled in studies; 3) Evidence downgraded one level due to inconsistency: tausquare =1.39.

Discussion

Our systematic review identified 34 studies and 12,507 participants providing information about the proportion of false-negative (FN) cases in the detection of SARS-CoV-2 by RT-PCR assays at first use. Individual studies estimates of false-negative rate ranged from 0.018 to 0.58. Included studies were affected by several sources of potential bias, especially related to testing protocol to rule in/rule out the presence of SARS-CoV-2 infection, the analysis of a selected sample of COVID-19 patients, as well as the unclear report of key index test characteristics.

The meta-analysis of the FN rates showed a considerable between study variability in estimates, which was not explained by any of the protocol defined characteristics. This variability is a limitation for the interpretation of the summary estimate of the proportion of the FN test results. Kucirka et al. also detected similar uncertainties in their bayesian modelling of false-negative rates of RT-PCR by time since exposure, based on information from seven studies and 1330 respiratory samples [69]. As an alternative, we illustrated the impact of heterogeneity by showing the number of false-negative cases expected in a cohort of 100 patients tested under three different prevalence of the disease scenarios. We based our calculations on the limits of the false-negative prediction interval. Using a prevalence of 50%, we found that in 100 persons tested, up to 27 cases would be misdiagnosed, putting them at risk of not receiving adequate clinical management or delaying isolation. We emphasised that these numerical approaches should be interpreted with caution due to very-low quality of evidence.

Our systematic review faced other challenges in its development. First, our study was initially planned as a rapid review aiming to provide a quick response to our local clinicians at the beginning of the COVID-19 pandemic. Due to the permanent involvement of clinicians managing COVID-19 patients at this point, we were able to define a review question that responds to a clinical inquiry relevant to current clinical practice [70–72]. However, due to the increasing number of publications potentially eligible to answer the review question, our approach evolved into a living-systematic review with regular updates of the evidence. This manuscript reflects the third update of our literature searches with information current up to July 2020. To promote transparency in the development of this review, we have uploaded our previous results in the Open Science Framework repository for public consultation (https://tinyurl.com/vvbgqya).

A second challenge is related to the type of studies providing information about the false-negative rate associated with RT-PCR at initial testing. We expected to find studies specifically aimed to estimate the number of initial negative results of RT-PCR assays, with further confirmation of SARS-Cov-2 infection with an additional RT-PCR within the following days to the first result. On the contrary, we found that the reporting of false-negative rate was not the primary aim of any of the include studies. In some cases, these Figs were reported as descriptive statistics of the collected sample. Although we carried out a comprehensive and sensitive search strategy including major databases and repositories of preprint publications, we cannot discard that some eligible studies have not been identified yet due to the limitation of the reporting in key study sections, such as the abstract and methods.

Finally, as we have remarked in the findings section of this review, we found a considerable heterogeneity in the data insufficiently explained by the statistical analysis performed. Suggested sources of heterogeneity such as the type of specimen collected, the time to onset of symptoms (as an approach to viral load), as well as the name of the RT-PCR kit used, were partially or not reported at all by the included studies. This variability on COVID-19 testing data and the challenge to provide a pooled estimation with a useful clinical meaning have been previously remarked as the main constraint in the development of systematic reviews on this field [73]. Despite our efforts in the analysis of data, we only were able to find some reduction of this variability comparing those studies performed in China versus those carried out in other countries (i.e. USA, Singapore, and the Netherlands). We believe that information provided by Chinese studies reflects early experiences with the diagnosis of COVID-19; their findings are probably affected by several unreported issues, such as the RT-PCR kits in use (likely the first kits developed for SARS-CoV-2 detection), the lack of standardised methods for COVID-19 testing and, in general, the limited knowledge about this new infection at the beginning of 2020.

Despite the heterogeneous data available to address the review question, our study involved a rigorous assessment of potential sources of bias and applicability concerns, a formal statistical analysis and a final evaluation of the certainty of the evidence using a well-known system (GRADE). Although not all studies included in this review were accuracy studies, we decided to apply the QUADAS-II tool regardless of the type of design. However, even though QUADAS-II was not developed to evaluate case series, we preferred to standardise the quality assessment to report on a common pool of issues. We added the assessment of all studies as an appendix, using an adapted checklist tool for case-series to provide complementary information to this assessment. Due to the multiple difficulties associated with the lack of reporting of included studies, and due to the high probability of new studies being published in the short-term, we provided some recommendations for future studies candidates to be included in an update of this review:

Inclusion of a series of consecutive patients instead of selected groups, to avoid spectrum bias.
Description of RT-PCR scheme in use, including target genes under assessment and positivity criteria.
Description of preanalytical steps (conservation of samples, time until being sent to the laboratory, training of personal).
Clear reporting of the time since the onset of symptoms, especially for those patients with clinical findings at admission
Reporting of the number of additional RT-PCR assays performed
Details about the application of the reference standard, including the time of administration after the index test (initial RT-PCR)
If possible, database sharing could allow re-analyses by independent researchers, including individual-patient data (IPD)-meta-analysis and increasing thus the confidence on the new evidence
Adding serological samples to a cohort of individuals with compatible symptoms and negative PCR to warrant an independent verification of infection.

Conclusions

Our findings reinforce the need for repeated testing in patients with suspicion of being infected, due to either clinical or epidemiological reasons, given that up to 54% of COVID-19 patients may have an initial negative RT-PCR result (certainty of evidence: very low). The collected evidence has several limitations in terms of risk of bias and applicability. Incomplete reporting of several key factors hampered a comprehensive analysis of collected data. An update of this review is warrented when additional studies become available.

Supporting information

S1 File. PICO question/ eligibility criteria.

(PDF)

Click here for additional data file.^{(405.7KB, pdf)}

S2 File. Search strategies.

(PDF)

Click here for additional data file.^{(181.6KB, pdf)}

S3 File. Characteristic of excluded studies.

(PDF)

Click here for additional data file.^{(621.7KB, pdf)}

S4 File. JBI case series tool- quality assessment of included studies.

(PDF)

Click here for additional data file.^{(269.2KB, pdf)}

S1 Checklist

(DOCX)

Click here for additional data file.^{(28.3KB, docx)}

Data Availability

All relevant data are within the manuscript and its Supporting information files.

Funding Statement

The author(s) received no specific funding for this work.

References

1.World Health Organization. Coronavirus disease 2019 (COVID-19): Situation Report– 1. Geneve, Switzerland: 2020 January 20–2020. Report No.
2.Pang J, Wang MX, Ang IYH, Tan SHX, Lewis RF, Chen JI, et al. Potential Rapid Diagnostics, Vaccine and Therapeutics for 2019 Novel Coronavirus (2019-nCoV): A Systematic Review. J Clin Med. 2020;9(3). 10.3390/jcm9030623 . [DOI] [PMC free article] [PubMed] [Google Scholar]
3.Meo SA, Alhowikan AM, Al-Khlaiwi T, Meo IM, Halepoto DM, Iqbal M, et al. Novel coronavirus 2019-nCoV: prevalence, biological and clinical characteristics comparison with SARS-CoV and MERS-CoV. European review for medical and pharmacological sciences. 2020;24(4):2012–9. Epub 2020/03/07. 10.26355/eurrev_202002_20379 . [DOI] [PubMed] [Google Scholar]
4.World Health Organization. Coronavirus disease 2019 (COVID-19): Situation Report– 51. Geneve, Switzerland: 2020 March 11–2020. Report No.
5.World Health Organization. Weekly Operational Update on COVID-19: 16 October 2020. Geneve, Switzerland: 2020 October 16–2020. Report No.
6.Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497–506. 10.1016/S0140-6736(20)30183-5 . [DOI] [PMC free article] [PubMed] [Google Scholar]
7.Chen Q, Quan B, Li X, Gao G, Zheng W, Zhang J, et al. A report of clinical diagnosis and treatment of nine cases of coronavirus disease 2019. J Med Virol. 2020. 10.1002/jmv.25755 . [DOI] [PMC free article] [PubMed] [Google Scholar]
8.Paules CI, Marston HD, Fauci AS. Coronavirus Infections—More Than Just the Common Cold. JAMA. 2020;323(8):707–8. 10.1001/jama.2020.0757 [DOI] [PubMed] [Google Scholar]
9.Young BE, Ong SWX, Kalimuddin S, Low JG, Tan SY, Loh J, et al. Epidemiologic Features and Clinical Course of Patients Infected With SARS-CoV-2 in Singapore. JAMA. 2020. 10.1001/jama.2020.3204 [DOI] [PMC free article] [PubMed] [Google Scholar]
10.Verity R, Okell LC, Dorigatti I, Winskill P, Whittaker C, Imai N, et al. Estimates of the severity of coronavirus disease 2019: a model-based analysis. The Lancet Infectious Diseases. 10.1016/S1473-3099(20)30243-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
11.Potere N, Valeriani E, Candeloro M, Tana M, Porreca E, Abbate A, et al. Acute complications and mortality in hospitalized patients with coronavirus disease 2019: a systematic review and meta-analysis. Crit Care. 2020;24(1):389 Epub 2020/07/04. 10.1186/s13054-020-03022-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
12.Meyerowitz-Katz G, Merone L. A systematic review and meta-analysis of published research data on COVID-19 infection-fatality rates. medRxiv. 2020:2020.05.03.20089854. 10.1016/j.ijid.2020.09.1464 [DOI] [PMC free article] [PubMed] [Google Scholar]
13.Azman AS, Luquero FJ. From China: hope and lessons for COVID-19 control. The Lancet Infectious Diseases. 10.1016/S1473-3099(20)30264-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
14.Buitrago-Garcia DC, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Salanti G, et al. The role of asymptomatic SARS-CoV-2 infections: rapid living systematic review and meta-analysis. medRxiv. 2020:2020.04.25.20079103. [DOI] [PMC free article] [PubMed] [Google Scholar]
15.Buitrago-Garcia D, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Ipekci AM, et al. Occurrence and transmission potential of asymptomatic and presymptomatic SARS-CoV-2 infections: A living systematic review and meta-analysis. PLoS Med. 2020;17(9):e1003346 Epub 2020/09/23. 10.1371/journal.pmed.1003346 ; following competing interests: GS has participated in two scientific meetings for Merck and Biogen. NL is a member of the PLOS Medicine editorial board. [DOI] [PMC free article] [PubMed] [Google Scholar]
16.Chu DKW, Pan Y, Cheng SMS, Hui KPY, Krishnan P, Liu Y, et al. Molecular Diagnosis of a Novel Coronavirus (2019-nCoV) Causing an Outbreak of Pneumonia. Clinical chemistry. 2020;66(4):549–55. Epub 2020/02/08. 10.1093/clinchem/hvaa029 [DOI] [PMC free article] [PubMed] [Google Scholar]
17.Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DKW, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2020;25(3). Epub 2020/01/30. 10.2807/1560-7917.es.2020.25.3.2000045 [DOI] [PMC free article] [PubMed] [Google Scholar]
18.Lippi G, Simundic AM, Plebani M. Potential preanalytical and analytical vulnerabilities in the laboratory diagnosis of coronavirus disease 2019 (COVID-19). Clinical chemistry and laboratory medicine. 2020. Epub 2020/03/17. 10.1515/cclm-2020-0285 . [DOI] [PubMed] [Google Scholar]
19.World Health Organization. Laboratory testing for coronavirus disease (COVID-19) in suspected human cases Interim guidance. Geneve, Switzerland: World Health Organization,; 2020. [Google Scholar]
20.Asociación Colombiana de Infectología. Consenso Colombiano de Atención, Diagnóstico y Manejo de la Infección por SARS-CoV-2/ COVID-19 en establecimientos de atención de la salud. Infectio. 2020;24(3 (S1)):1–163. 10.22354/in.v24i3.851. [DOI] [Google Scholar]
21.Hanson KE, Caliendo AM, CA Arias, Englund JA, Lee MJ, Loeb M, et al. Infectious Diseases Society of America Guidelines on the Diagnosis of COVID-19. Arlington, VA: Infectious Diseases Society of America; 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
22.National Institute for Communicable Diseases Department. Clinical Management of Suspected or confirmed COVID-19 Disease. In: Department of Health, editor. V2 ed South Africa: Republic of South Africa; 2020. [Google Scholar]
23.Pakistan Chest Society (PCS) Guidelines Working Group. Guidelines on Management of Patients with COVID-19. Pakistan: Pakistan Chest Society; 2020. [Google Scholar]
24.Li D, Wang D, Dong J, Wang N, Huang H, Xu H, et al. False-Negative Results of Real-Time Reverse-Transcriptase Polymerase Chain Reaction for Severe Acute Respiratory Syndrome Coronavirus 2: Role of Deep-Learning-Based CT Diagnosis and Insights from Two Cases. Korean journal of radiology. 2020;21(4):505–8. Epub 2020/03/17. 10.3348/kjr.2020.0146 [DOI] [PMC free article] [PubMed] [Google Scholar]
25.Gostin LO. Public Health Emergency Preparedness: Globalizing Risk, Localizing Threats. JAMA. 2018;320(17):1743–4. 10.1001/jama.2018.16491 [DOI] [PubMed] [Google Scholar]
26.Lin C, Ye R, Xia YL. A meta-analysis to evaluate the effectiveness of real-time PCR for diagnosing novel coronavirus infections. Genetics and molecular research: GMR. 2015;14(4):15634–41. Epub 2015/12/05. 10.4238/2015.December.1.15 . [DOI] [PubMed] [Google Scholar]
27.Sharfstein JM, Becker SJ, Mello MM. Diagnostic Testing for the Novel Coronavirus. JAMA. 2020. 10.1001/jama.2020.3864 [DOI] [PubMed] [Google Scholar]
28.McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, et al. Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: The PRISMA-DTA statement. JAMA. 2018;319(4):338–96. 10.1001/jama.2017.19163 [DOI] [PubMed] [Google Scholar]
29.Digital Solution Foundry, EPPI-Centre. EPPI-Mapper. Version 125: EPPI-Centre, UCL Social Research Institute, University Collegue London; 2020.
30.Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Annals of internal medicine. 2011;155(8):529–36. Epub 2011/10/19. 10.7326/0003-4819-155-8-201110180-00009 . [DOI] [PubMed] [Google Scholar]
31.The Joanna Briggs Institute. Checklist for Case Series Adelaide, Australia: The Joanna Briggs Institute,; 2017.
32.Schünemann HJ, Mustafa RA, Brozek J, Steingart KR, Leeflang M, Murad MH, et al. GRADE guidelines: 21 part 1. Study design, risk of bias and indirectness in rating the certainty across a body of evidence for test accuracy. Journal of Clinical Epidemiology. 10.1016/j.jclinepi.2019.12.020 [DOI] [PubMed] [Google Scholar]
33.Schünemann HJ, Mustafa RA, Brozek J, Steingart KR, Leeflang M, Murad MH, et al. GRADE guidelines: 21 part 2. Inconsistency, Imprecision, publication bias and other domains for rating the certainty of evidence for test accuracy and presenting it in evidence profiles and summary of findings tables. Journal of Clinical Epidemiology. 10.1016/j.jclinepi.2019.12.021 [DOI] [PubMed] [Google Scholar]
34.Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W, et al. Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology. 2020:200642 10.1148/radiol.2020200642 . [DOI] [PMC free article] [PubMed] [Google Scholar]
35.Albert E, Ferrer B, Torres I, Serrano A, Alcaraz MJ, Buesa J, et al. Amplification of human β-glucoronidase gene for appraising the accuracy of negative SARS-CoV-2 RT-PCR results in upper respiratory tract specimens. J Med Virol. 2020. rayyan-84652710. [DOI] [PMC free article] [PubMed] [Google Scholar]
36.Bernheim A, Mei X, Huang M, Yang Y, Fayad ZA, Zhang N, et al. Chest CT Findings in Coronavirus Disease-19 (COVID-19): Relationship to Duration of Infection. Radiology. 2020:200463 10.1148/radiol.2020200463 . [DOI] [PMC free article] [PubMed] [Google Scholar]
37.Besutti G, Giorgi Rossi P, Iotti V, Spaggiari L, Bonacini R, Nitrosi A, et al. Accuracy of CT in a cohort of symptomatic patients with suspected COVID-19 pneumonia during the outbreak peak in Italy. European radiology. 2020. rayyan-84651884. [DOI] [PMC free article] [PubMed] [Google Scholar]
38.Chen D, Jiang X, Hong Y, Wen Z, Wei S, Peng G, et al. Can Chest CT Features Distinguish Patients With Negative From Those With Positive Initial RT-PCR Results for Coronavirus Disease (COVID-19)? AJR American journal of roentgenology. 2020:01-May rayyan-84653196. 10.2214/AJR.20.23012 [DOI] [PubMed] [Google Scholar]
39.Chen HJ QJ, Wu B, Huang T, Gao Y, Wang ZP, Chen Y, et al. Early Chest CT Features of Patients with 2019 Novel Coronavirus (COVID-19) Pneumonia: Relationship to Diagnosis and Prognosis. In: College) HGHAHHoHM, editor.: Research Square; 2020. p. 21. [DOI] [PMC free article] [PubMed]
40.Chen ZH, Li YJ, Wang XJ, Ye YF, Wu BL, Zhang Y, et al. Chest CT of COVID-19 in patients with a negative first RT-PCR test: Comparison with patients with a positive first RT-PCR test. Medicine (Baltimore). 2020;99(26):e20837 rayyan-84652253. 10.1097/MD.0000000000020837 [DOI] [PMC free article] [PubMed] [Google Scholar]
41.Çinkooğlu A, Hepdurgun C, Bayraktaroğlu S, Ceylan N, Savaş R. CT imaging features of COVID-19 pneumonia: initial experience from Turkey. Diagn Interv Radiol. 2020. rayyan-84652386. 10.5152/dir.2020.20307 [DOI] [PMC free article] [PubMed] [Google Scholar]
42.Dai H, Zhang X, Xia J, Zhang T, Shang Y, Huang R, et al. High-resolution Chest CT Features and Clinical Characteristics of Patients Infected with COVID-19 in Jiangsu, China. International journal of infectious diseases: IJID: official publication of the International Society for Infectious Diseases. 2020;95:106–12. Epub 2020/04/10. 10.1016/j.ijid.2020.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
43.Duan X, Guo X, Qiang J. A retrospective study of the initial 25 COVID-19 patients in Luoyang, China. Jpn J Radiol. 2020;38(7):683–90. Epub 2020/05/28. 10.1007/s11604-020-00988-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
44.Fang Y, Zhang H, Xie J, Lin M, Ying L, Pang P, et al. Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR. Radiology. 2020:200432 10.1148/radiol.2020200432 . [DOI] [PMC free article] [PubMed] [Google Scholar]
45.Fechner C, Strobel K, Treumann T, Sonderegger B, Azzola A, Fornaro J, et al. COVID-19 and the role of imaging: early experiences in Central Switzerland. Swiss Med Wkly. 2020;150:w20304 rayyan-84652303. 10.4414/smw.2020.20304 [DOI] [PubMed] [Google Scholar]
46.Gietema HA, Zelis N, Nobel JM, Lambriks LJG, van Alphen LB, Oude Lashof AML, et al. CT in relation to RT-PCR in diagnosing COVID-19 in the Netherlands: a prospective study. medRxiv. 2020:2020.04.22.20070441. 10.1371/journal.pone.0235844 [DOI] [PMC free article] [PubMed] [Google Scholar]
47.He JL, Luo L, Luo ZD, Lyu JX, Ng MY, Shen XP, et al. Diagnostic performance between CT and initial real-time RT-PCR for clinically suspected 2019 coronavirus disease (COVID-19) patients outside Wuhan, China. Respir Med. 2020;168:105980 rayyan-84653215. 10.1016/j.rmed.2020.105980 [DOI] [PMC free article] [PubMed] [Google Scholar]
48.Lan FY, Filler R, Mathew S, Buley J, Iliaki E, Bruno-Murtha LA, et al. COVID-19 symptoms predictive of healthcare workers’ SARS-CoV-2 PCR results. PLoS ONE. 2020;15(6):e0235460 rayyan-84652250. 10.1371/journal.pone.0235460 [DOI] [PMC free article] [PubMed] [Google Scholar]
49.Lee TH, Lin RJ, Lin RTP, Barkham T, Rao P, Leo YS, et al. Testing for SARS-CoV-2: Can We Stop at Two? Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. 2020. Epub 2020/04/20. 10.1093/cid/ciaa459 . [DOI] [PMC free article] [PubMed] [Google Scholar]
50.Li Y, Yao L, Li J, Chen L, Song Y, Cai Z, et al. Stability issues of RT-PCR testing of SARS-CoV-2 for hospitalized patients clinically diagnosed with COVID-19. J Med Virol. 2020. Epub 2020/03/29. 10.1002/jmv.25786 . [DOI] [PMC free article] [PubMed] [Google Scholar]
51.Long C, Xu H, Shen Q, Zhang X, Fan B, Wang C, et al. Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT? European journal of radiology. 2020;126:108961 Epub 2020/04/02. 10.1016/j.ejrad.2020.108961 [DOI] [PMC free article] [PubMed] [Google Scholar]
52.Long DR, Gombar S, Hogan CA, Greninger AL, Shah VO, Bryson-Cahn C, et al. Occurrence and Timing of Subsequent SARS-CoV-2 RT-PCR Positivity Among Initially Negative Patients. Clin Infect Dis. 2020. rayyan-84652613. [DOI] [PMC free article] [PubMed] [Google Scholar]
53.Ma H, Hu J, Tian J, Zhou X, Li H, Laws MT, et al. A single-center, retrospective study of COVID-19 features in children: a descriptive investigation. BMC Med. 2020;18(1):123 rayyan-84653168. 10.1186/s12916-020-01596-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
54.Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area. JAMA. 2020. 10.1001/jama.2020.6775 [DOI] [PMC free article] [PubMed] [Google Scholar]
55.Shen N, Zhu Y, Wang X, Peng J, Liu W, Wang F, et al. Characteristics and diagnosis rate of 5630 subjects receiving SARS-CoV-2 nucleic acid tests from Wuhan, China. JCI Insight. 2020;5(10). Epub 2020/05/01. 10.1172/jci.insight.137662 [DOI] [PMC free article] [PubMed] [Google Scholar]
56.Wang P. Combination of Serological Total Antibody and RT-PCR Test for Detection of SARS-CoV-2 Infections. J Virol Methods. 2020:113919 rayyan-84652376. 10.1016/j.jviromet.2020.113919 [DOI] [PMC free article] [PubMed] [Google Scholar]
57.Wen Z, Chi Y, Zhang L, Liu H, Du K, Li Z, et al. Coronavirus Disease 2019: Initial Detection on Chest CT in a Retrospective Multicenter Study of 103 Chinese Subjects. Radiology: Cardiothoracic Imaging. 2020;2(2):e200092. [DOI] [PMC free article] [PubMed] [Google Scholar]
58.Wong HYF, Lam HYS, Fong AH, Leung ST, Chin TW, Lo CSY, et al. Frequency and Distribution of Chest Radiographic Findings in COVID-19 Positive Patients. Radiology. 2019:201160. Epub 2020/03/29. [DOI] [PMC free article] [PubMed] [Google Scholar]
59.Wu J, Liu J, Zhao X, Liu C, Wang W, Wang D, et al. Clinical Characteristics of Imported Cases of COVID-19 in Jiangsu Province: A Multicenter Descriptive Study. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. 2020. Epub 2020/02/29. [DOI] [PMC free article] [PubMed] [Google Scholar]
60.Xie X, Zhong Z, Zhao W, Zheng C, Wang F, Liu J. Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing. Radiology. 2020:200343 10.1148/radiol.2020200343 . [DOI] [PMC free article] [PubMed] [Google Scholar]
61.Young BE, Ong SWX, Kalimuddin S, Low JG, Tan SY, Loh J, et al. Epidemiologic Features and Clinical Course of Patients Infected With SARS-CoV-2 in Singapore. Jama. 2020;323(15):1488–94. Epub 2020/03/04. Sanofi and Roche. Dr Wang reported receiving grants from the Ministry of Health, Singapore. No other disclosures were reported. [DOI] [PMC free article] [PubMed] [Google Scholar]
62.Zhang H, Shang W, Liu Q, Zhang X, Zheng M, Yue M. Clinical characteristics of 194 cases of COVID-19 in Huanggang and Taian, China. Infection. 2020. rayyan-84653097. 10.1007/s15010-020-01440-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
63.Zhang JJ, Cao YY, Dong X, Wang BC, Liao MY, Lin J, et al. Distinct characteristics of COVID-19 patients with initial rRT-PCR-positive and rRT-PCR-negative results for SARS-CoV-2. Allergy. 2020. Epub 2020/04/14. 10.1111/all.14316 . [DOI] [PMC free article] [PubMed] [Google Scholar]
64.Zhao J YQ, Wang H, Liu W, Liao X, Su Y, Wang X, et al. Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019. In: Hospital STPs, editor. MedRxiv2020. p. 28.
65.Zhifeng J, Feng A, Li T. Consistency analysis of COVID-19 nucleic acid tests and the changes of lung CT. Journal of clinical virology: the official publication of the Pan American Society for Clinical Virology. 2020;127:104359 Epub 2020/04/18. 10.1016/j.jcv.2020.104359 [DOI] [PMC free article] [PubMed] [Google Scholar]
66.Zhou H, Xu K, Shen Y, Fang Q, Chen F, Sheng J, et al. Coronavirus disease 2019 (COVID-19): chest CT characteristics benefit to early disease recognition and patient classification-a single center experience. Ann Transl Med. 2020;8(11):679 rayyan-84652107. 10.21037/atm-20-2119a [DOI] [PMC free article] [PubMed] [Google Scholar]
67.Zhou S, Zhu T, Wang Y, Xia L. Imaging features and evolution on CT in 100 COVID-19 pneumonia patients in Wuhan, China. European radiology. 2020. rayyan-84653193. [DOI] [PMC free article] [PubMed] [Google Scholar]
68.He J-L, Luo L, Luo Z-D, Lyu J-X, Ng M-Y, Shen X-P, et al. Diagnostic performance between CT and initial real-time RT-PCR for clinically suspected 2019 coronavirus disease (COVID-19) patients outside Wuhan, China. Respiratory Medicine. 10.1016/j.rmed.2020.105980 . [DOI] [PMC free article] [PubMed] [Google Scholar]
69.Kucirka LM, Lauer SA, Laeyendecker O, Boon D, Lessler J. Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction-Based SARS-CoV-2 Tests by Time Since Exposure. LID— 10.7326/M20-1495 LID - M20-1495. (1539–3704 (Electronic)). [DOI] [PMC free article] [PubMed]
70.Wilson MG, Lavis JN, Gauvin FP. Developing a rapid-response program for health system decision-makers in Canada: findings from an issue brief and stakeholder dialogue. Systematic reviews. 2015;4:25 Epub 2015/04/16. 10.1186/s13643-015-0009-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
71.Moore G, Redman S, Rudge S, Haynes A. Do policy-makers find commissioned rapid reviews useful? Health Res Policy Syst. 2018;16(1):17 Epub 2018/02/28. 10.1186/s12961-018-0293-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
72.Hartling L, Guise JM, Hempel S, Featherstone R, Mitchell MD, Motu’apuaka ML, et al. Fit for purpose: perspectives on rapid reviews from end-user interviews. Systematic reviews. 2017;6(1):32 10.1186/s13643-017-0425-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
73.Bossuyt PM. Testing COVID-19 tests faces methodological challenges. Journal of clinical epidemiology. 10.1016/j.jclinepi.2020.06.037 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

S1 File. PICO question/ eligibility criteria.

(PDF)

Click here for additional data file.^{(405.7KB, pdf)}

S2 File. Search strategies.

(PDF)

Click here for additional data file.^{(181.6KB, pdf)}

S3 File. Characteristic of excluded studies.

(PDF)

Click here for additional data file.^{(621.7KB, pdf)}

S4 File. JBI case series tool- quality assessment of included studies.

(PDF)

Click here for additional data file.^{(269.2KB, pdf)}

S1 Checklist

(DOCX)

Click here for additional data file.^{(28.3KB, docx)}

Data Availability Statement

All relevant data are within the manuscript and its Supporting information files.

[pone.0242958.ref001] 1.World Health Organization. Coronavirus disease 2019 (COVID-19): Situation Report– 1. Geneve, Switzerland: 2020 January 20–2020. Report No.

[pone.0242958.ref002] 2.Pang J, Wang MX, Ang IYH, Tan SHX, Lewis RF, Chen JI, et al. Potential Rapid Diagnostics, Vaccine and Therapeutics for 2019 Novel Coronavirus (2019-nCoV): A Systematic Review. J Clin Med. 2020;9(3). 10.3390/jcm9030623 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref003] 3.Meo SA, Alhowikan AM, Al-Khlaiwi T, Meo IM, Halepoto DM, Iqbal M, et al. Novel coronavirus 2019-nCoV: prevalence, biological and clinical characteristics comparison with SARS-CoV and MERS-CoV. European review for medical and pharmacological sciences. 2020;24(4):2012–9. Epub 2020/03/07. 10.26355/eurrev_202002_20379 . [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref004] 4.World Health Organization. Coronavirus disease 2019 (COVID-19): Situation Report– 51. Geneve, Switzerland: 2020 March 11–2020. Report No.

[pone.0242958.ref005] 5.World Health Organization. Weekly Operational Update on COVID-19: 16 October 2020. Geneve, Switzerland: 2020 October 16–2020. Report No.

[pone.0242958.ref006] 6.Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet. 2020;395(10223):497–506. 10.1016/S0140-6736(20)30183-5 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref007] 7.Chen Q, Quan B, Li X, Gao G, Zheng W, Zhang J, et al. A report of clinical diagnosis and treatment of nine cases of coronavirus disease 2019. J Med Virol. 2020. 10.1002/jmv.25755 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref008] 8.Paules CI, Marston HD, Fauci AS. Coronavirus Infections—More Than Just the Common Cold. JAMA. 2020;323(8):707–8. 10.1001/jama.2020.0757 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref009] 9.Young BE, Ong SWX, Kalimuddin S, Low JG, Tan SY, Loh J, et al. Epidemiologic Features and Clinical Course of Patients Infected With SARS-CoV-2 in Singapore. JAMA. 2020. 10.1001/jama.2020.3204 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref010] 10.Verity R, Okell LC, Dorigatti I, Winskill P, Whittaker C, Imai N, et al. Estimates of the severity of coronavirus disease 2019: a model-based analysis. The Lancet Infectious Diseases. 10.1016/S1473-3099(20)30243-7 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref011] 11.Potere N, Valeriani E, Candeloro M, Tana M, Porreca E, Abbate A, et al. Acute complications and mortality in hospitalized patients with coronavirus disease 2019: a systematic review and meta-analysis. Crit Care. 2020;24(1):389 Epub 2020/07/04. 10.1186/s13054-020-03022-1 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref012] 12.Meyerowitz-Katz G, Merone L. A systematic review and meta-analysis of published research data on COVID-19 infection-fatality rates. medRxiv. 2020:2020.05.03.20089854. 10.1016/j.ijid.2020.09.1464 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref013] 13.Azman AS, Luquero FJ. From China: hope and lessons for COVID-19 control. The Lancet Infectious Diseases. 10.1016/S1473-3099(20)30264-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref014] 14.Buitrago-Garcia DC, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Salanti G, et al. The role of asymptomatic SARS-CoV-2 infections: rapid living systematic review and meta-analysis. medRxiv. 2020:2020.04.25.20079103. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref015] 15.Buitrago-Garcia D, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Ipekci AM, et al. Occurrence and transmission potential of asymptomatic and presymptomatic SARS-CoV-2 infections: A living systematic review and meta-analysis. PLoS Med. 2020;17(9):e1003346 Epub 2020/09/23. 10.1371/journal.pmed.1003346 ; following competing interests: GS has participated in two scientific meetings for Merck and Biogen. NL is a member of the PLOS Medicine editorial board. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref016] 16.Chu DKW, Pan Y, Cheng SMS, Hui KPY, Krishnan P, Liu Y, et al. Molecular Diagnosis of a Novel Coronavirus (2019-nCoV) Causing an Outbreak of Pneumonia. Clinical chemistry. 2020;66(4):549–55. Epub 2020/02/08. 10.1093/clinchem/hvaa029 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref017] 17.Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DKW, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro surveillance: bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin. 2020;25(3). Epub 2020/01/30. 10.2807/1560-7917.es.2020.25.3.2000045 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref018] 18.Lippi G, Simundic AM, Plebani M. Potential preanalytical and analytical vulnerabilities in the laboratory diagnosis of coronavirus disease 2019 (COVID-19). Clinical chemistry and laboratory medicine. 2020. Epub 2020/03/17. 10.1515/cclm-2020-0285 . [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref019] 19.World Health Organization. Laboratory testing for coronavirus disease (COVID-19) in suspected human cases Interim guidance. Geneve, Switzerland: World Health Organization,; 2020. [Google Scholar]

[pone.0242958.ref020] 20.Asociación Colombiana de Infectología. Consenso Colombiano de Atención, Diagnóstico y Manejo de la Infección por SARS-CoV-2/ COVID-19 en establecimientos de atención de la salud. Infectio. 2020;24(3 (S1)):1–163. 10.22354/in.v24i3.851. [DOI] [Google Scholar]

[pone.0242958.ref021] 21.Hanson KE, Caliendo AM, CA Arias, Englund JA, Lee MJ, Loeb M, et al. Infectious Diseases Society of America Guidelines on the Diagnosis of COVID-19. Arlington, VA: Infectious Diseases Society of America; 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref022] 22.National Institute for Communicable Diseases Department. Clinical Management of Suspected or confirmed COVID-19 Disease. In: Department of Health, editor. V2 ed South Africa: Republic of South Africa; 2020. [Google Scholar]

[pone.0242958.ref023] 23.Pakistan Chest Society (PCS) Guidelines Working Group. Guidelines on Management of Patients with COVID-19. Pakistan: Pakistan Chest Society; 2020. [Google Scholar]

[pone.0242958.ref024] 24.Li D, Wang D, Dong J, Wang N, Huang H, Xu H, et al. False-Negative Results of Real-Time Reverse-Transcriptase Polymerase Chain Reaction for Severe Acute Respiratory Syndrome Coronavirus 2: Role of Deep-Learning-Based CT Diagnosis and Insights from Two Cases. Korean journal of radiology. 2020;21(4):505–8. Epub 2020/03/17. 10.3348/kjr.2020.0146 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref025] 25.Gostin LO. Public Health Emergency Preparedness: Globalizing Risk, Localizing Threats. JAMA. 2018;320(17):1743–4. 10.1001/jama.2018.16491 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref026] 26.Lin C, Ye R, Xia YL. A meta-analysis to evaluate the effectiveness of real-time PCR for diagnosing novel coronavirus infections. Genetics and molecular research: GMR. 2015;14(4):15634–41. Epub 2015/12/05. 10.4238/2015.December.1.15 . [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref027] 27.Sharfstein JM, Becker SJ, Mello MM. Diagnostic Testing for the Novel Coronavirus. JAMA. 2020. 10.1001/jama.2020.3864 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref028] 28.McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, et al. Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: The PRISMA-DTA statement. JAMA. 2018;319(4):338–96. 10.1001/jama.2017.19163 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref029] 29.Digital Solution Foundry, EPPI-Centre. EPPI-Mapper. Version 125: EPPI-Centre, UCL Social Research Institute, University Collegue London; 2020.

[pone.0242958.ref030] 30.Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Annals of internal medicine. 2011;155(8):529–36. Epub 2011/10/19. 10.7326/0003-4819-155-8-201110180-00009 . [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref031] 31.The Joanna Briggs Institute. Checklist for Case Series Adelaide, Australia: The Joanna Briggs Institute,; 2017.

[pone.0242958.ref032] 32.Schünemann HJ, Mustafa RA, Brozek J, Steingart KR, Leeflang M, Murad MH, et al. GRADE guidelines: 21 part 1. Study design, risk of bias and indirectness in rating the certainty across a body of evidence for test accuracy. Journal of Clinical Epidemiology. 10.1016/j.jclinepi.2019.12.020 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref033] 33.Schünemann HJ, Mustafa RA, Brozek J, Steingart KR, Leeflang M, Murad MH, et al. GRADE guidelines: 21 part 2. Inconsistency, Imprecision, publication bias and other domains for rating the certainty of evidence for test accuracy and presenting it in evidence profiles and summary of findings tables. Journal of Clinical Epidemiology. 10.1016/j.jclinepi.2019.12.021 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref034] 34.Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W, et al. Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology. 2020:200642 10.1148/radiol.2020200642 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref035] 35.Albert E, Ferrer B, Torres I, Serrano A, Alcaraz MJ, Buesa J, et al. Amplification of human β-glucoronidase gene for appraising the accuracy of negative SARS-CoV-2 RT-PCR results in upper respiratory tract specimens. J Med Virol. 2020. rayyan-84652710. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref036] 36.Bernheim A, Mei X, Huang M, Yang Y, Fayad ZA, Zhang N, et al. Chest CT Findings in Coronavirus Disease-19 (COVID-19): Relationship to Duration of Infection. Radiology. 2020:200463 10.1148/radiol.2020200463 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref037] 37.Besutti G, Giorgi Rossi P, Iotti V, Spaggiari L, Bonacini R, Nitrosi A, et al. Accuracy of CT in a cohort of symptomatic patients with suspected COVID-19 pneumonia during the outbreak peak in Italy. European radiology. 2020. rayyan-84651884. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref038] 38.Chen D, Jiang X, Hong Y, Wen Z, Wei S, Peng G, et al. Can Chest CT Features Distinguish Patients With Negative From Those With Positive Initial RT-PCR Results for Coronavirus Disease (COVID-19)? AJR American journal of roentgenology. 2020:01-May rayyan-84653196. 10.2214/AJR.20.23012 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref039] 39.Chen HJ QJ, Wu B, Huang T, Gao Y, Wang ZP, Chen Y, et al. Early Chest CT Features of Patients with 2019 Novel Coronavirus (COVID-19) Pneumonia: Relationship to Diagnosis and Prognosis. In: College) HGHAHHoHM, editor.: Research Square; 2020. p. 21. [DOI] [PMC free article] [PubMed]

[pone.0242958.ref040] 40.Chen ZH, Li YJ, Wang XJ, Ye YF, Wu BL, Zhang Y, et al. Chest CT of COVID-19 in patients with a negative first RT-PCR test: Comparison with patients with a positive first RT-PCR test. Medicine (Baltimore). 2020;99(26):e20837 rayyan-84652253. 10.1097/MD.0000000000020837 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref041] 41.Çinkooğlu A, Hepdurgun C, Bayraktaroğlu S, Ceylan N, Savaş R. CT imaging features of COVID-19 pneumonia: initial experience from Turkey. Diagn Interv Radiol. 2020. rayyan-84652386. 10.5152/dir.2020.20307 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref042] 42.Dai H, Zhang X, Xia J, Zhang T, Shang Y, Huang R, et al. High-resolution Chest CT Features and Clinical Characteristics of Patients Infected with COVID-19 in Jiangsu, China. International journal of infectious diseases: IJID: official publication of the International Society for Infectious Diseases. 2020;95:106–12. Epub 2020/04/10. 10.1016/j.ijid.2020.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref043] 43.Duan X, Guo X, Qiang J. A retrospective study of the initial 25 COVID-19 patients in Luoyang, China. Jpn J Radiol. 2020;38(7):683–90. Epub 2020/05/28. 10.1007/s11604-020-00988-4 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref044] 44.Fang Y, Zhang H, Xie J, Lin M, Ying L, Pang P, et al. Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR. Radiology. 2020:200432 10.1148/radiol.2020200432 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref045] 45.Fechner C, Strobel K, Treumann T, Sonderegger B, Azzola A, Fornaro J, et al. COVID-19 and the role of imaging: early experiences in Central Switzerland. Swiss Med Wkly. 2020;150:w20304 rayyan-84652303. 10.4414/smw.2020.20304 [DOI] [PubMed] [Google Scholar]

[pone.0242958.ref046] 46.Gietema HA, Zelis N, Nobel JM, Lambriks LJG, van Alphen LB, Oude Lashof AML, et al. CT in relation to RT-PCR in diagnosing COVID-19 in the Netherlands: a prospective study. medRxiv. 2020:2020.04.22.20070441. 10.1371/journal.pone.0235844 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref047] 47.He JL, Luo L, Luo ZD, Lyu JX, Ng MY, Shen XP, et al. Diagnostic performance between CT and initial real-time RT-PCR for clinically suspected 2019 coronavirus disease (COVID-19) patients outside Wuhan, China. Respir Med. 2020;168:105980 rayyan-84653215. 10.1016/j.rmed.2020.105980 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref048] 48.Lan FY, Filler R, Mathew S, Buley J, Iliaki E, Bruno-Murtha LA, et al. COVID-19 symptoms predictive of healthcare workers’ SARS-CoV-2 PCR results. PLoS ONE. 2020;15(6):e0235460 rayyan-84652250. 10.1371/journal.pone.0235460 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref049] 49.Lee TH, Lin RJ, Lin RTP, Barkham T, Rao P, Leo YS, et al. Testing for SARS-CoV-2: Can We Stop at Two? Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. 2020. Epub 2020/04/20. 10.1093/cid/ciaa459 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref050] 50.Li Y, Yao L, Li J, Chen L, Song Y, Cai Z, et al. Stability issues of RT-PCR testing of SARS-CoV-2 for hospitalized patients clinically diagnosed with COVID-19. J Med Virol. 2020. Epub 2020/03/29. 10.1002/jmv.25786 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref051] 51.Long C, Xu H, Shen Q, Zhang X, Fan B, Wang C, et al. Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT? European journal of radiology. 2020;126:108961 Epub 2020/04/02. 10.1016/j.ejrad.2020.108961 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref052] 52.Long DR, Gombar S, Hogan CA, Greninger AL, Shah VO, Bryson-Cahn C, et al. Occurrence and Timing of Subsequent SARS-CoV-2 RT-PCR Positivity Among Initially Negative Patients. Clin Infect Dis. 2020. rayyan-84652613. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref053] 53.Ma H, Hu J, Tian J, Zhou X, Li H, Laws MT, et al. A single-center, retrospective study of COVID-19 features in children: a descriptive investigation. BMC Med. 2020;18(1):123 rayyan-84653168. 10.1186/s12916-020-01596-9 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref054] 54.Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area. JAMA. 2020. 10.1001/jama.2020.6775 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref055] 55.Shen N, Zhu Y, Wang X, Peng J, Liu W, Wang F, et al. Characteristics and diagnosis rate of 5630 subjects receiving SARS-CoV-2 nucleic acid tests from Wuhan, China. JCI Insight. 2020;5(10). Epub 2020/05/01. 10.1172/jci.insight.137662 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref056] 56.Wang P. Combination of Serological Total Antibody and RT-PCR Test for Detection of SARS-CoV-2 Infections. J Virol Methods. 2020:113919 rayyan-84652376. 10.1016/j.jviromet.2020.113919 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref057] 57.Wen Z, Chi Y, Zhang L, Liu H, Du K, Li Z, et al. Coronavirus Disease 2019: Initial Detection on Chest CT in a Retrospective Multicenter Study of 103 Chinese Subjects. Radiology: Cardiothoracic Imaging. 2020;2(2):e200092. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref058] 58.Wong HYF, Lam HYS, Fong AH, Leung ST, Chin TW, Lo CSY, et al. Frequency and Distribution of Chest Radiographic Findings in COVID-19 Positive Patients. Radiology. 2019:201160. Epub 2020/03/29. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref059] 59.Wu J, Liu J, Zhao X, Liu C, Wang W, Wang D, et al. Clinical Characteristics of Imported Cases of COVID-19 in Jiangsu Province: A Multicenter Descriptive Study. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. 2020. Epub 2020/02/29. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref060] 60.Xie X, Zhong Z, Zhao W, Zheng C, Wang F, Liu J. Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR Testing. Radiology. 2020:200343 10.1148/radiol.2020200343 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref061] 61.Young BE, Ong SWX, Kalimuddin S, Low JG, Tan SY, Loh J, et al. Epidemiologic Features and Clinical Course of Patients Infected With SARS-CoV-2 in Singapore. Jama. 2020;323(15):1488–94. Epub 2020/03/04. Sanofi and Roche. Dr Wang reported receiving grants from the Ministry of Health, Singapore. No other disclosures were reported. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref062] 62.Zhang H, Shang W, Liu Q, Zhang X, Zheng M, Yue M. Clinical characteristics of 194 cases of COVID-19 in Huanggang and Taian, China. Infection. 2020. rayyan-84653097. 10.1007/s15010-020-01440-5 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref063] 63.Zhang JJ, Cao YY, Dong X, Wang BC, Liao MY, Lin J, et al. Distinct characteristics of COVID-19 patients with initial rRT-PCR-positive and rRT-PCR-negative results for SARS-CoV-2. Allergy. 2020. Epub 2020/04/14. 10.1111/all.14316 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref064] 64.Zhao J YQ, Wang H, Liu W, Liao X, Su Y, Wang X, et al. Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019. In: Hospital STPs, editor. MedRxiv2020. p. 28.

[pone.0242958.ref065] 65.Zhifeng J, Feng A, Li T. Consistency analysis of COVID-19 nucleic acid tests and the changes of lung CT. Journal of clinical virology: the official publication of the Pan American Society for Clinical Virology. 2020;127:104359 Epub 2020/04/18. 10.1016/j.jcv.2020.104359 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref066] 66.Zhou H, Xu K, Shen Y, Fang Q, Chen F, Sheng J, et al. Coronavirus disease 2019 (COVID-19): chest CT characteristics benefit to early disease recognition and patient classification-a single center experience. Ann Transl Med. 2020;8(11):679 rayyan-84652107. 10.21037/atm-20-2119a [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref067] 67.Zhou S, Zhu T, Wang Y, Xia L. Imaging features and evolution on CT in 100 COVID-19 pneumonia patients in Wuhan, China. European radiology. 2020. rayyan-84653193. [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref068] 68.He J-L, Luo L, Luo Z-D, Lyu J-X, Ng M-Y, Shen X-P, et al. Diagnostic performance between CT and initial real-time RT-PCR for clinically suspected 2019 coronavirus disease (COVID-19) patients outside Wuhan, China. Respiratory Medicine. 10.1016/j.rmed.2020.105980 . [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref069] 69.Kucirka LM, Lauer SA, Laeyendecker O, Boon D, Lessler J. Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction-Based SARS-CoV-2 Tests by Time Since Exposure. LID— 10.7326/M20-1495 LID - M20-1495. (1539–3704 (Electronic)). [DOI] [PMC free article] [PubMed]

[pone.0242958.ref070] 70.Wilson MG, Lavis JN, Gauvin FP. Developing a rapid-response program for health system decision-makers in Canada: findings from an issue brief and stakeholder dialogue. Systematic reviews. 2015;4:25 Epub 2015/04/16. 10.1186/s13643-015-0009-3 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref071] 71.Moore G, Redman S, Rudge S, Haynes A. Do policy-makers find commissioned rapid reviews useful? Health Res Policy Syst. 2018;16(1):17 Epub 2018/02/28. 10.1186/s12961-018-0293-1 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref072] 72.Hartling L, Guise JM, Hempel S, Featherstone R, Mitchell MD, Motu’apuaka ML, et al. Fit for purpose: perspectives on rapid reviews from end-user interviews. Systematic reviews. 2017;6(1):32 10.1186/s13643-017-0425-7 [DOI] [PMC free article] [PubMed] [Google Scholar]

[pone.0242958.ref073] 73.Bossuyt PM. Testing COVID-19 tests faces methodological challenges. Journal of clinical epidemiology. 10.1016/j.jclinepi.2020.06.037 [DOI] [PMC free article] [PubMed] [Google Scholar]

PERMALINK

False-negative results of initial RT-PCR assays for COVID-19: A systematic review

Ingrid Arevalo-Rodriguez

Diana Buitrago-Garcia

Daniel Simancas-Racines

Paula Zambrano-Achig

Rosa Del Campo

Agustin Ciapponi

Omar Sued

Laura Martinez-García

Anne W Rutjes

Nicola Low

Patrick M Bossuyt

Jose A Perez-Molina

Javier Zamora

Roles

Abstract

Background

Methods

Results

Conclusions

Systematic review registration

Introduction

Materials and methods

Criteria for considering studies for this review

Search methods for identification of studies

Data collection and analysis

Assessment of methodological quality

Statistical analysis and data synthesis

Summary of findings and certainty of the evidence

Results

Fig 1. PRISMA flow diagram.

Table 1. Characteristics of included studies.

Quality of included studies

Fig 2. Forest plot included studies.

Findings

Table 2. Assessment of sources of heterogeneity.

Summary of findings under the GRADE approach

Fig 3. Summary of findings (GRADE assessment).

Discussion

Conclusions

Supporting information

Data Availability

Funding Statement

References

Associated Data

Supplementary Materials

Data Availability Statement

ACTIONS

PERMALINK

RESOURCES

Similar articles

Cited by other articles

Links to NCBI Databases