Skip to main content
. 2021 Mar 24;2021(3):CD013705. doi: 10.1002/14651858.CD013705.pub2
Study Study design; inclusion criteria Setting; country (recruitment dates) Participant characteristics Reference standard
Samples and timing
Missing data or uninterpretable results
Assennato 2020
Preprint
172 (88; 91 after retesting with RT‐PCR)
Single group;
symptomatic individuals with suspected COVID‐19 sent for routine laboratory diagnosis; supplied via PHE
Recruitment: not stated
Laboratory‐based (no further details); UK
(Not stated)
‘symptomatic'; no further details
Not stated
RT‐PCR (single assay);
Threshold ≤ 36 Ct
Target: (1) RdRp, E gene
(2) RdRp 'different region'
As for index; combined nose and throat swab in VTM
Timing: not stated
Interval: not stated; seems likely reference was carried out for routine diagnostic testing
None reported
Index: 3 FP and 1 FN result retested using SAMBA‐II; same results obtained on repeat
Reference: 3 FP and 1 FN result were re‐tested*
‐ all 3 FPs found to be borderline +ve for ≥ 1 target gene on either Colindale or Cambridge (Wuhan) test (reclassified as TP)
‐ the FN result remained +ve on both RT‐PCR assays
Broder 2020
Accepted manuscript
35 (35)
Single group (cases);
Samples +ve on RT‐PCR (Roche Cobas 6800) with lower range of viral load (E target Ct ≥ 30)
Recruitment: not stated; deliberate sampling according to viral load
Laboratory‐based (not stated); USA
(Not stated)
Not stated; lower viral load
Not stated
RT‐PCR (single assay)
Target: E gene (unclear if other genetic targets as well)
N/A
As for index test; NP swab
Timing: not stated; presume on presentation
Interval: same samples; index within 3 days of reference
None reported
Index: none reported
Reference: samples +ve on reference were tested by in‐house assay using modified CDC protocol
Chen 2020a
Published
58 (58); can only include data for 55 +ve on NP swabs
Single group (cases);
archived paired samples from COVID‐19 inpatients
Recruitment: not stated
Hospital in‐patient (no further detail); People’s Republic of China
(Not stated)
Not stated
Median age 38 years; 28, 48% male
RT‐PCR (single assay)
Target: RdRp
N/A only cases included
Not stated; infer single ‐ve
Same as index test
Timing: not stated; prior to index test
Interval: simultaneous; same samples
None reported, however 3 samples +ve only on saliva excluded by review team
Not stated
Index: not stated
Reference: none reported
Collier 2020
Preprint and published version (25‐8‐20)
149 (32)
Single group;
patients admitted with a possible diagnosis of COVID‐19
Recruitment: consecutive
Hospital inpatient (no further detail); UK
(6 April‐2 May 2020)
Not stated
Mean age 62.7 years, 70, 47% male
RT‐PCR (single assay)
Target: not stated
Not stated; separate swab used as participants were excluded if > 18‐h interval between swab collections
Timing: not stated
Interval: < 18 h
Yes; 5 discarded VTM, 1 timing of PHE swab not reported, 1 inadequate SAMBA swab, 2 swab interval > 24 h
Index: not described
"Indeterminate … tests were repeated … until a valid result was obtained."
Discrepant results re‐tested on original samples
Reference: "indeterminate … tests were repeated on a replicate … swab until a valid result was obtained."
Discrepant results re‐tested on original samples
Cradic 2020(a)
published
184 (33)
Single group;
symptomatic patients meeting criteria for testing
Recruitment: not stated
Mixed (ED or inpatients); USA
(Not stated )
All symptomatic, no further details.
Not stated
Composite; result obtained from at least 2 of 3 commercial assays (includes 2 RT‐PCRs and Abbot ID NOW)
Target: RdRp, S or ORF1ab gene (either present), ORF1ab or E gene (both present for +ve, either present for presumptive +ve)
Same as index test
Timing: not stated
Interval: simultaneous ‐ same swab
None reported
Index: none reported
Reference: none reported
Cradic 2020(b)
published
182 (13)
Single group;
presenting to ED with signs/symptoms of COVID‐19 submitted for routine laboratory testing (n = 182)
Recruitment: not stated
Hospital A&E (ED); USA
(Not stated )
All symptomatic, no further details.
Not stated
RT‐PCR (single assay)
Target: S or ORF1ab gene (either present)
NP swab in UTM, same as index
Timing: not stated
Interval: simultaneous; paired swabs
None reported
Index: none reported
Reference: none reported
Dust 2020
Published
38 (20)
Two‐group;
[1] SARS‐CoV‐2 +ve samples submitted for routine viral diagnostic testing
[2] samples +ve for other respiratory infection
Convenience sampling
Recruitment: retrospective
Laboratory‐based (unclear; submitted to laboratory); Canada
(Not stated)
Not reported RT‐PCR (single assay);
Ct threshold not stated
Target: E, N1
NP (as for index)
Timing: not stated
Interval: simultaneous (same swab)
None reported
Index: none reported
Reference: none reported
Ghofrani 2020
Published
113 (17)
Single group
Patients with both RT‐PCR and POC test results available (n = 113), including:
[1] symptomatic patients with a PCR swab test close to presentation and a re‐swab for POC testing
[2] patients with +ve RT‐PCR results and remnant NP swabs available for POC test,
[3] asymptomatic patients with +ve POC result on admission who were re‐swabbed for RT‐PCR confirmation.
N per group was not reported
Recruitment: convenience
Mixed (hospital and community); USA
(6 April‐21 April 2020)
'Majority' symptomatic, no further details
Not stated
RT‐PCR (no details)
Target: not stated
Mixed; either paired swabs (within 3 days of each other) or same samples used
Timing: not stated
Interval: some same sample; paired samples could be up to 3 days apart
None reported
Index: none reported
Reference: none reported
Gibani 2020
Published
418 ()
Three sources of participants:
[1] self‐referred, HCWs or their family members with suspected COVID‐19 who were not admitted to hospital (n = 280)
[2] ED patients with suspected COVID‐19 (n = 15)
[3] hospital inpatient admissions with or without suspected COVID‐19 (n = 91)
Total N 418 paired samples; 32 excluded as invalid (patient group not reported), 24 invalid on DnaNudge and 8 on RT‐PCR)
[1] and [2] not reported
[3] consecutive
Recruitment: prospective
Mixed (community, A&E, inpatient); London or Oxford, UK
([1] 10 April‐12 May
[2] 2‐24 April
[3] 12‐18 May)
Only group [3] were inpatient
median age 46 years (IQR 31–66); 124, 32% male
RT‐PCR (multiple assays)
Target: see above
NOP (paired)
Timing: not stated
Interval: simultaneous (paired)
Additional 47 samples not 'paired'; not collected on same date
32 samples excluded; 24 invalid on DNANudge (failed to amplify RNaseP; 22/24 with associated RT‐PCR result were ‐ve) and 8 on RT‐PCR (all 8 from 1 site)
Index: none reported
Reference: none reported
Goldenberger 2020
Published
19 (10)
Two‐group;
[1] SARS‐CoV‐2 +ve samples selected to reflect a broad range of Ct values
[2] SARS‐CoV‐2 ‐ve samples (n = 9)
Sampled from patients suspected of COVID‐19 undergoing routine diagnostics within a 1‐week period
Convenience
Recruitment: unclear
Laboratory‐based (unclear); Switzerland
(1 week during 2020 pandemic)
Not reported RT‐PCR (single assay);
Threshold NR but all PCR+ < 33 Ct
Target: E, ORF1
NP (same as index)
Timing: not stated
Interval: simultaneous (same swab)
None reported
Index: none reported
Reference: none reported
Harrington 2020
Accepted manuscript
524 (186)
Single group;
Symptomatic patients meeting diagnostic criteria for COVID‐19
Recruitment: consecutive
Hospital A&E (EDs (n = 3) or urgent care centres (n = 2)); USA
(Not reported)
Not stated RT‐PCR (single assay)
Target: not stated
Not specifically stated; presume yes as central lab used
NP swabs (paired)
Timing: VTM (no detail)
Interval: simultaneous swab collection (different swabs for index and reference)
None reported
Index: none reported
Reference: 2 initial FPs had repeat sampling:
‐ 1 retested on RT‐PCR only and was +ve (designated as TP)
‐ 1 retested on RT‐PCR and ID Now and was ‐ve on both (designated as TN)
Hogan 2020
Preprint
100 (50)
Single group;
adult patients from one hospital and paediatric and adult samples from surrounding hospitals
Recruitment: unclear; equal numbers of +ve and ‐ve RT‐PCR samples
Laboratory‐based (clinical virology laboratory); USA
(7‐13 April 2020)
Not stated RT‐PCR (single assay)
Target: E gene
As for index test; NP swab
Timing: not stated
Interval: not stated implies tests undertaken soon after collection
None reported
3 invalid results were re‐tested; 1 +ve and 2 ‐ve
Index: 1 known RT‐PCR+ sample with faint +ve test line re‐tested (same result; considered +ve)
Reference: none reported
Hou 2020
Accepted manuscript
285 (153)
Single group;
remnant OP swabs submitted for SARS‐CoV‐2 testing
Recruitment: not stated
Laboratory‐based (mixed inpatient and outpatient); China
(February‐April 2020)
178 (62.5%) inpatient; 107 (37.5%) outpatients. Site 2 were all inpatients
220 (77.2%) aged ≤ 65 years; 159 (55.8%) male
RT‐PCR (multiple assays)
Target: not stated
OP (same as for rapid test)
Timing: not stated
Interval: simultaneous (same swab); time period of frozen storage was not reported
None reported
Index: none reported
Reference: none reported
Jin 2020
Published
52 (6)
Single group;
paired dry swabs and NP or OP swabs in UTM (includes pre‐admission screening for surgical patients)
Recruitment: unclear
Laboratory‐based (unclear); USA
(23‐26 April 2020)
Not stated RT‐PCR (single assay)
Target: ORF1/a, E gene
Not stated for paired samples, but for full cohort NP and OP swabs in VTM used (400 uL)
Timing: not stated
Interval: simultaneous (paired swabs)
None reported
Index: none reported
Reference: none reported
Jokela 2020
Preprint
107 (61); only 90 tested with Xpert Xpress
Two‐group:
NP or OP swab samples sent to university laboratory:
[1] for SARS‐CoV‐2 testing (n = 97),
[2] pre‐pandemic samples sent for testing due to suspicion of other respiratory virus infection (n = 10)
Recruitment: not stated
Laboratory‐based (not reported); Finland
(March‐May 2020)
Not stated RT‐PCR (multiple assays)
Target: 1) N gene, 2) orf1ab and E, 3) orf1ab and N
NP or OP, as for index
Timing: not stated
Interval: simultaneous (same samples)
107 samples tested with Novodiag but only 90 for Xpert
None reported
Index: none reported
Reference: none reported
Lephart 2020 [A]
Preprint
[1] 75 (16)
Single group;
‐ patients presenting to ED (75)
Recruitment: not stated
Second cohort of 13 cases excluded
Hospital A&E ([1] ED; [2] in‐patient); USA
(22 April‐5 May 2020)
Not reported Composite: result from ≥ 2 of 4 commercial assays (includes ID NOW and 3 RT‐PCR assays (incl Xpert Xpress))
Target: not stated
Three ‐ves (on different assays) required for absence of infection (same as for Xpert Xpress)
Timing: within 24 h of sample collection (on presentation at ED); no further detail
Interval: same swab [B], or paired collection [A]
None reported
Index: [A] no invalid results
[B] 1 'invalid' result; not reported if this was a 'presumptive +ve' (E gene only) on Xpert Xpress or no result
Reference: none reported
Lieberman 2020
Accepted manuscript
169 (87)
Single group;
Samples submitted for clinical diagnostic testing
Recruitment: not stated
Laboratory‐based (not reported); USA
(Not stated)
Not stated RT‐PCR (single assay);
Threshold not stated
Target: NI, N2
As for index test; NP swab
Timing: not stated
Interval: all testing conducted within 72 h
None reported; review team excluded data for 28 specimens comparing Panther Fusion with DiaSorin Simplexa
Not stated
Index: not stated
Reference: inconclusive' (ie one genetic target detected) considered +ve
Loeffelholz 2020
Accepted manuscript
486 (220)
Two‐group;
patients referred for COVID‐19 testing at according to the local criteria
Recruitment: convenience; deliberate sampling to enrich for +ve specimens
Laboratory‐based (not stated); USA, UK, France, Italy
(1 March‐2 April 2020)
Not stated
Adults at all sites except New York City Dept. Health and Mental Hygiene and Niguarda Hospital where all age groups were tested (ages not stated)
RT‐PCR (multiple assays)
Target: different targets depending on RT‐PCR test used (see cut‐off index)
Same as for index test
Timing: as for index test
Interval: same samples but majority of index tests performed after frozen storage for undefined period
4 Xpert Xpress test results lost permanently (single instrument computer malfunction); + 1 invalid excluded
1 Xpert Xpress test invalid due to cartridge error
Index: presumptive +ve results not reanalysed by Xpert Xpress; all discrepant results reanalysed by a 3rd RT‐PCR method
Reference: inconclusive results analyzed by a 3rd RT‐PCR method
Mitchell 2020
Accepted manuscript
61 (46)
Single group;
Samples +ve and ‐ve on one of two SARS‐CoV‐2 RT‐PCR assays
Recruitment: not stated; possible deliberate sampling of +ve cases
Laboratory‐based (2 independent laboratories); USA
(Not stated)
Not stated RT‐PCR (one of two assays)
Target: not stated
As for index test
Timing: as for index test
Interval: same samples but used at different times (samples used for index test stored at −80 ℃)
None reported
Index: none reported
Reference: none reported
Moore 2020
Preprint
200 (125)
Two‐group;
symptomatic (fever or cough or shortness of breath) adult and pediatric outpatients, ED patients, and inpatients
Recruitment: consecutive (first 94 participants), then deliberate sampling used
Mixed (outpatients, ED patients and inpatients); USA
(27 March‐9 April 2020)
79 (39.5%) hospitalised including 29 in ICU, 76 (38%) ambulatory care including 55 seen in a designated COVID‐19 screening clinic), and 45 (23%) seen at ED.
Mean age 50 years (SD 17 years), 92 (46%) men
RT‐PCR (multiple assays);
Threshold ≤ 40 Ct or presence of amplification curve
Target: a. N1, N2
b. N, RdRp
As for index test; NP swab
Timing: not stated
Interval: all 3 tests conducted within 72 h of sample collection
2 invalid excluded
2 results were invalid on ID Now and were not retested (excluded)
Index: none reported
Reference: discordant results on RT‐PCR had record review to determine presence/absence COVID‐19 infection
Moran 2020
Accepted manuscript
103 (42)
Single group;
inpatients and ambulatory patients
Recruitment: not stated
Laboratory‐based (inpatient and ambulatory; samples selected from central laboratory); USA
(Not stated)
Not stated RT‐PCR (single assay)
Target: ORF1, E
As for index; nasal or NP swabs
Timing: not stated
Interval: not stated; same sample
None reported
Index: single FP (‐ve on E gene and low +ve on N gene) retested with Xpert Xpress and considered ‐ve on both targets
Reference: single FP was retested on RT‐PCR and found to be repeatedly ‐ve
Rhoads 2020
Accpeted manuscript
96 (96)
Single group (cases);
Samples +ve using standard of care testing
Recruitment: convenience
Laboratory‐based (includes self‐collected and provided‐collected samples); USA
(Not stated)
Not stated RT‐PCR (multiple assays)
Target: N1 and N2
As for index test
Timing: as for index test
Interval: same samples used
None reported
Index: none reported
Reference: RT‐PCR detected only one of two targets for two samples (both considered +ve (diagnosed as +ve on original sample testing); both were ‐ve on index test)
Smithgall 2020 [A]
Published
113 (88)
Two‐group
Routine clinical testing by RT‐PCR
Recruitment: unclear; describes deliberate sampling of samples with high, medium and low Ct values on RT‐PCR
Laboratory‐based (inpatient and ED); USA
(8 April‐13 April)
Not stated
111 adult (range 23‐101 years; average 65 years for RT‐PCR+ and 43 years for RT‐PCR‐); 2 paediatric (age 1 day and 5 days)
61, 54% male
RT‐PCR (single assay)
Threshold ≤ 37 Ct on both target genes
Target: ORF1 a/b, E‐gene
Not stated
As for index test
Timing: as for index test
Interval: simultaneous; same samples used
None reported
Index: Xpert: 1 sample was a presumptive +ve based on detection of E‐gene target but not the N2 target
Reference: none reported
SoRelle 2020
Published letter
83 (39)
Unclear design;
participants symptomatic for COVID‐19
Sampling: not stated
Recruitment: not stated
Laboratory‐based (unclear); USA
(Not reported)
All symptomatic
Not reported
RT‐PCR (multiple assays)
Target: not stated
NP in VTM (paired)
Timing: not stated
Interval: paired
None reported
Index: none reported
Reference: none reported; presumptive +ves not mentioned
Stevens 2020
Accepted manuscript
104 (54)
Unclear design;
Residual samples from symptomatic and asymptomatic individuals undergoing routine testing; selected to represent the full range of Ct values
Sampling: convenience
Recruitment: retrospective
Laboratory‐based (serving adult and pediatric tertiary care hospitals); USA
(31 March‐7 April)
Unclear; 'symptomatic and asymptomatic';
Of 54 cases, 10 (19%) were low viral low (Ct > 35)
Not reported
RT‐PCR (single assay)
Target: 2 regions of ORF1ab
NP in VTM; as for index test
Timing: not stated
Interval: same sample
6 samples excluded due to insufficient sample volume
1 RT‐PCR+ sample re‐tested on Xpert Xpress due to initial interpretation of no results (invalid); Xpert +ve on re‐test
Index: no presumptive +ves were observed
Reference: 1 RT‐PCR+ sample that was ‐ve on both targets for Xpert Xpress (FN) was re‐tested on Panther Fusion and found to be ‐ve (TN)
Szymczak 2020
Published
79 (29 +ve on stool; 48 previously +ve on NP/OP swab)
Single group;
remnant samples from patients with symptomatic diarrhoea submitted for routine diagnostic testing
Recruitment: convenience
Laboratory‐based (unclear); USA
(21 April‐15 May 2020)
All symptomatic for diarrhoea
Not stated
RT‐PCR (single assay)
Target: two ORF1a regions
Stool, as for index
Timing: some samples frozen at −80 °C prior to testing with Hologic Panther Fusion
Interval: simultaneous; same swabs
None reported
Index: discrepant results re‐tested with both index and reference test
Reference: as above
Thwe 2020
Published
161 (14)
Single group;
symptomatic patients with paired samples
Sampling: not stated
Recruitment: retrospective
Laboratory‐based (inpatient and ED); USA
(April‐May 2020 ("4 weeks data"))
All symptomatic
Not stated
RT‐PCR (single assay)
Target: not stated
NP in VTM (paired)
Timing: not stated
Interval: paired
None reported (review team excluded 21 samples with Xpert Xpress as reference standard)
None reported
Index: none reported
Reference: none reported; no discrepant analysis
Wolters 2020
Accepted manuscript
88 (58)
Two‐group;
Samples selected from laboratories on the basis of presence/absence of 2 genetic targets on RT‐PCR
Recruitment: not stated; deliberate sampling according to target gene
Laboratory‐based (not stated; 3 laboratories); The Netherlands
(January‐March 2020)
Not stated RT‐PCR (multiple assays)
Target: mixed
As for index test
Timing: as for index test
Interval: same samples used; index text seems to have been conducted after frozen storage
None reported
Index: samples +ve on only 1 target were both re‐tested on RT‐PCR only
Reference: as above
Wong 2020
Published
162 (119)
Single group;
samples submitted for routine testing from patients with suspected COVID‐19 infection
Sampling: not stated
Recruitment: both retrospective (n = 74) and prospective (n = 88)
Laboratory‐based (A&E, inpatient and outpatient); China
(Not stated)
Not stated
Median age 46 (IQR: 35 (28‐63); male = 69 (44%)
RT‐PCR (single assay)
Target: not stated
deep throat saliva or lower respiratory tract; as per index test
Timing: not stated
Interval: simultaneous (same samples)
None reported
Index: none reported
Reference: none reported
Zhen 2020 [A]
Accepted manuscript
108 (58)
Two ‐group;
Samples from symptomatic patients of all ages and gender
Recruitment: not stated; deliberate sampling to represent the TP rate at authors' institution (50%‐60%), and to span low and high viral loads
Laboratory‐based; USA
(March‐April 2020)
"Symptomatic"; no further details
Not stated (all ages and gender)
RT‐PCR (single assay)
Target: 2 regions of ORF1ab; either +ve
single RT‐PCR
As for index; NP swabs
Timing: not stated
Interval: not stated in exact terms
1 specimen with invalid result on ID Now was excluded from that dataset
Index: none reported; no re‐testing conducted
Reference: none reported; no re‐testing conducted
A&E: Accident and Emergency [Department]; CDC: National Health Commission of the People's Republic of China; Ct: cycle threshold; ED: Emergency Department; FN: false negative; FP: false positive; HCW: healthcare worker; ICU: intensive care unit; IQR: interquartile range; N/A: not applicable; NOP: naso‐oropharyngeal; NP: nasopharyngeal; NR: not reported; OP: oropharyngeal; PHE: Public Health England; RT‐PCR: reverse transcription polymerase chain reaction; TN: true negative; TP: true positive; UTM: universal transport media; VTM: viral transport medium