Skip to main content
Revista Panamericana de Salud Pública logoLink to Revista Panamericana de Salud Pública
. 2020 Dec 14;44:e149. doi: 10.26633/RPSP.2020.149

Evaluation of nine serological rapid tests for the detection of SARS-CoV-2

Evaluación de nueve pruebas serológicas rápidas para la detección del SARS-CoV-2

Marcela Mercado 1, Jeadran Malagón-Rojas 2,, Gabriela Delgado 3, Vivian Vanesa Rubio 1, Lida Muñoz Galindo 1, Eliana L Parra Barrera 1, Paula Gaviria 4, Gabriela Zabaleta 1, Zonia Alarcon 1, Adriana Arévalo 1, Helly Casallas Cifuentes 1, Kelly Estrada 5, Gloria Puerto 1, María T Herrera Sepúlveda 1, Helena Rodríguez 1, Marisol Galindo 1, Martha Lucía Ospina Ramírez 1
PMCID: PMC7734239

ABSTRACT

Objective.

To evaluate the operative capacity of nine serological rapid tests to detect the IgM/IgG antibodies response in serum from patients with SARS-CoV-2 in different clinical stages.

Methods.

A cross-sectional study of serological rapid tests was designed to compare the performance of the evaluated immunochromatographic tests for the diagnosis of SARS-CoV-2. A total of 293 samples was used, including negatives, asymptomatic, and symptomatic serum samples.

Results.

The sensitivity of the evaluated tests was low and moderate in the groups of asymptomatic serum samples and the group of serums coming from patients with less than 11 days since the onset of the symptoms. The specificity for the anti-SARS-CoV-2 antibodies tests ranged between 86.5%-99% for IgM and 86.5%-99.5% for IgG. The sensitivity and the likelihood ratio were different according to the study groups. The usefulness of these tests is restricted to symptomatic patients and their sensitivity is greater than 85% after 11 days from the appearance of symptoms.

Conclusions.

Serological tests are not an adequate strategy for the identification of asymptomatic and pre-symptomatic patients. Serological rapid tests for the detection of specific anti-SARS-CoV-2 antibodies can be used as a diagnostic aid, but diagnosis must be confirmed by RT-PCR. Rapid tests should be reserved for patients with symptoms lasting more than 11 days.

Keywords: Betacoronavirus, coronavirus infections, serologic tests, diagnostics, Colombia


Since the SARS-CoV-2 atypical pneumonia was reported in December 2019 in China (1), the world has focused on research toward a better understanding of the virus and the infection in humans, including the development of diagnostic tests for early detection, treatment, and reducing mortality associated with the virus (2). In the current context of the pandemic, one of the main challenges is the early detection of SARS-CoV-2 cases at the community level with some risk such as hospitals, nursing homes, penitentiary centers, and passenger transport in airports and terminals (3,4).

Serological rapid tests are particularly important for early detection; these tests are easy to operate and allow a rapid screening of SARS-CoV-2 antibodies within 10-15 minutes (5), helping to have a better understanding of the humoral response of infected patients (6). Because of their low cost and easy processing, in some scenarios these types of tests have been used as a screening tool for the general population. However, some manufacturers have stated that the serological rapid test requires the concomitant use of RT-PCR due to the false-negative rate that can result (7).

Serological rapid tests generally use a conjugate made up of a reagent (usually colloidal gold) that is activated in the presence of viral antigens or antibodies against human IgM/IgG. Activation is visible on the nitrocellulose plate in a colored band. Currently, a large number of serological tests are available, which present different operational capabilities for the detection of SARS-CoV-2 antibodies. However, this detection capacity has been questioned by the World Health Organization (8). The aim of this study was to evaluate the operative capacity of serological rapid tests to detect the IgM/IgG antibodies response in serum of patients with SARS-CoV-2 in different clinical stages.

METHODS

A cross-sectional study of the diagnostic tests was designed to compare the performance of nine immunochromatographic tests for the diagnosis of SARS-CoV-2. A minimum sample size of 293 was estimated according to the sensitivity parameter (9), and a margin error of 10%, with a confidence level of 95%. The available serum was distributed in four groups: i) patients with SARS-CoV-2 and positive RT-PCR who developed mild, moderate, and severe COVID-19; ii) asymptomatic patients with positive RT-PCR; iii) patients with negative RT-PCR tests; and iv) “historic negatives”, i.e., serum collected before the pandemic in 2017-2018 and stored in the Instituto Nacional de Salud biobank, which was used as a control for the tests since these should not have anti-SARS-CoV-2 antibodies (10).

Exclusion criteria

Serum samples from patients were excluded if they had a history of autoimmune disease such as rheumatoid arthritis, lupus erythematosus, and Sjögren syndrome, among others. Likewise, serum was excluded in those who received transfusions in the last month before taking the blood sample, pregnant women, and minors.

Reference test

As the gold standard technique real-time PCR test with reverse transcriptase (RT-PCR, Diagnostic detection of 2019-nCoV by real-time RT-PCR, Charité Virology, Berlin, Germany) was used. RT-PCR consists of a polymerase chain reaction that has previously had a reverse transcription (RT) phase. Using RT, cDNA was obtained from an RNA strand. Consequently, the RT-PCR technique performs the detection and amplification of a sequence from a strand of RNA. This presents a technical limit of detection (LOD) = 5.2 RNA copies/reaction, at a 95% hit rate; 95% CI: 3.7-9.6 copies of RNA/reaction, according to the protocol (11).

Type of tests used

The immunochromatographic assay was used for the qualitative detection of SARS-CoV-2 specific IgG/IgM antibodies. According to the manufacturing information, these tests can detect anti-SARS-CoV-2 antibodies in whole venous blood, whole blood by capillary puncture, serum, and plasma samples. According to the manufacturer’s instructions, the test is positive when a red band is generated, one for IgM, another for IgG, and one for control (Table 1).

TABLE 1. Characteristics of the evaluated tests.

Test

Type of cassette

Place of manufacturing

Type of test

Reading time (min)

n

Sensitivity IgM (%)

Specificity IgM (%)

Sensitivity IgG (%)

Specificity IgG (%)

Biosensor®

Duo

Republic of Korea

Colloidal gold

10-15

40

91.70

100

79.20

100

AMS International®

One

United Kingdom

Colloidal gold

10-15

360

95.70

97.30

91.80

96.40

Leccurate®

One

China

Colloidal gold

10-20

NR

90

100

NR

NR

HIGHTOP One Step rapid test®

One

China

Colloidal gold

10-20

1300

82

96

93

97.50

Cromatest COVID-19®

One

China

Colloidal gold

10-15

551

78.03

99.39

96.86

100

AMP Rapid Test®

One

Austria

Colloidal gold

10

NR

95.70

97.30

91.80

96.40

Egens®

One

China

Colloidal gold

10

NR

96.88

100

96.88

100

Cellex®

One

United States

Colloidal gold

15-20

378

93.75

96.40

93.75

96.40

Onesite Rapidtest®

One

United States

Colloidal gold

10-15

551

78.03

99.39

96.86

100

NR, not reported

Clinical data

The sociodemographic and clinical data were obtained from the epidemiological reports from the National Epidemiological System (SIVIGILA). It included age, sex, place of residence, type of infection (asymptomatic and symptomatic), date of onset of symptoms, severity of infection, etc.

Collection of serum samples

With the results of molecular tests taken from samples of nasopharyngeal swabs in different groups of individuals (symptomatic, asymptomatic, and negative), a cohort of positive patients was followed up on the 7th, 14th, and 21st day after the first nasopharyngeal swab. This was carried out to obtain blood samples to determine the presence of antibodies over 14 days post-infection.

Test procedure

Before measuring and verifying the humidity and temperature described on the inserts of each test, 10 μL or 5 μL of serum was served in the well. Subsequently, 2 or 3 drops of running buffer were added. The presence of movement in the nitrocellulose column was observed after the incubation time of 10 to 15 minutes, and the reading was then performed according to the manufacturer’s instructions.

Test evaluation

The cassettes results were interpreted and reported by two independent evaluators. The results of the readings were transcribed by each of the evaluators independently. Subsequently, a third researcher reviewed the database to check for transcription errors or inconsistencies.

Statistical analysis

Point and interval estimates of 95% of the operational characteristics of the tests concerning sensitivity, specificity, positive likelihood ratio, positive and negative predictive value (PPV and NPV respectively) were established (12,13). Also, the group of historical negatives was used to estimate the divergent criteria validity.

A pooled analysis was performed for sensitivity and specificity. Also, I2 was estimated. An I2 >50% was considered as moderate heterogeneity; an I2 ≥ 75% was considered high (14,15).

According to the observed heterogeneity (I2), subgroups were formed excluding tests involved in the high inconsistency. Forest plots with test-specific and overall point estimates and 95% confidence intervals (CI) were carried out. The analysis was performed with SPSS® V. 16.1 statistical program, licensed by the INS. Forest plots were made in Meta-DiSc® V. 1.4, free license (16).

Ethical considerations

The study was approved by the Ethics Committee of the INS in June of 2020.

RESULTS

A total of 293 serum samples were included in the study, including 100 historical negatives. In the 2020 group, most of the samples corresponded to male patients (65.8%, n=127), with an average age of 38 years (SD 12). 48.2% (n=93) out of the samples corresponded to positive serums (table 2).

TABLE 2. Sociodemographic characteristics of the population.

Group

Sex

% (n)

Mean age (years)

SD

Symptoms duration (days)

SD

Female

Male

Negative

20 (39)

31.6 (61)

38

12

-

-

Asymptomatic

6.2 (12)

12.4 (24)

45

9

-

-

Symptomatic

7.8 (15)

21.8 (42)

43.33

12

26

19

Total

34 (66)

65.8 (127)

 

 

 

 

Nine immunochromatographic assays were evaluated. Table 3 shows the performance results of each test in three groups of serum: asymptomatic patients, patients with ≤ 11 days of symptoms, and patients with ≥ 11 days of evolution.

TABLE 3. Performance of tests for three evaluation scenarios.

Test

Asymptomatic (n=38)

IgM

IgG

% Sensitivity

(CI 95%)

% Specificity

(CI 95%)

LR (+)

(CI 95%)

% Sensitivity

(CI 95%)

% Specificity

(CI 95%)

LR (+)

(CI 95%)

Biosensor®

25

(10.85 - 39.14)

95

(91.97 - 98.02)

5

(2.19 - 11.44)

16.66

(4.49 - 28.84)

99.5

(98.52 - 100)

15

(8.02 - 28.05)

AMS® International

30.55

(15.50 - 45.60)

98.5

(96.81 - 100)

20.37

(5.98 - 69.43)

16.66

(4.49 - 28.84)

98.5

(96.81 - 100)

40.28

(12.80 - 126.72

)

Leccurate®

47.22

(30.91 - 63.53)

86.5

(81.76 - 91.23)

3.50

(2.14 - 5.72)

41.66

(25.56 - 57.77)

86.5

(81.76 - 91.23)

6.94

(4.85 - 9.94)

HIGHTOP One Step®

18.42

(6.09 - 30.74)

99

(97.62 - 100)

18.42

(3.98 - 85.30)

15.79

(4.19 - 27.38)

97.50

(95.33 - 99.66)

45.83

(11.16 - 188.27)

Cromatest COVID-19®

39.47

(23.93 - 55.01)

95.50

(92.62 - 98.37)

8.77

(4.14 - 18.57)

15.79

(4.19 - 27.38)

96.50

(93.95 - 99.04)

16.67

(8.62 - 32.21)

AMP Rapid Test®

28.95

(14.52 - 43.36)

95.50

(92.62 - 98.37)

6.43

(2.86 - 14.46)

18.42

(6.09 - 30.74)

97

(94.63 - 99.36)

15.74

(8.11 - 30.57)

Egens®

5.26

0 - 12.36)

98

(96.05 - 99.94)

9.21

(4.15 - 20.43)

15.78

(4.19 - 27.38)

96

(93.28 - 98.71)

17.71

(8.77 - 35.76)

Cellex®

36.84

(21.50 - 52.17)

96

(93.28 - 98.71)

2.63

(0.50 - 13.86)

18.42

(6.09 - 30.74)

98.5

(96.81 - 100)

18.75

(6.65 - 52.87)

Onesite Rapidtest®

26.31

(12.31 - 40.31)

97

(94.63 - 99.36)

8.77

(3.38 - 22.70)

18.42

(6.09 - 30.74)

96.5

(93.95 - 99.04)

5.26

(1.95 - 14.14)

Test

Symptomatic 8-11 days (n=9)

IgM

IgG

% Sensitivity

(CI 95%)

% Specificity

(CI 95%)

LR (+)

(CI 95%)

% Sensitivity

(CI 95%)

% Specificity

(CI 95%)

LR (+)

(CI 95%)

Biosensor®

44.44

(11.98 - 76.90)

95

(91.97 - 98.02)

8.08

(3.4 - 22.93)

33.33

(2.53 - 64.13)

99.5

(98.52 - 100)

66.66

(7.66 - 579)

AMS® International

22.22

(-4.93 - 49.38)

98.5

(96.81 - 100)

14.81

(2.81 - 77.90)

22.22

(-4.93 - 49.38)

99

(97.62 - 100)

22.22

(3.51 - 140)

Leccurate®

55.56

(23.09 - 88.01)

86.5

(81.76 - 91.23)

4.62

(2.43 - 8.79)

22.22

(-4.93 - 49.38)

86.5

(81.76 - 91.23)

1.64

(0.46 - 5.87)

HIGHTOP One Step®

22.22

(-4.93 - 49.38)

99

(97.62 - 100)

22.22

(3.51 - 140)

11.11

(-9.42 - 31.64)

97.5

(95.33 - 99.66)

4.44

(0.57 - 34.19)

Cromatest COVID-19®

33.33

(2.53 - 64.13)

95.5

(92.62 - 98.37)

7.40

(2.40 - 22.77)

33.33

(2.53 - 64.13)

96.5

(93.95 - 99.04)

9.52

(2.93 - 30.87)

AMP Rapid Test®

33.33

(2.53 - 64.13)

95.5

(92.62 - 98.37)

7.40

(2.40 - 22.77)

22.22

(-4.93 - 49.38)

97

(94.63 - 99.36)

7.40

(1.73 - 31.71)

Egens®

0

98

(96.05 - 99.94)

Not calculated

14.28

(-4.04 -32.61)

96

(93.28 - 98.71)

3.57

(0.83 - 15.25)

Cellex®

64.28

(39.18 - 89.38)

96

(93.28 - 98.71)

16.07

(7.34 - 35.17)

35.71

(10.61 - 60.81)

98.5

(96.81 - 100)

23.80

(6.32 - 89.56)

Onesite Rapidtest®

22.22

(-4.93 - 49.38)

97

(94.63 - 99.36)

7.40

(1.73 - 31.71)

33.33

(2.53 - 64.13)

96.5

(93.95 - 99.04)

9.52

(2.93 - 30.87)

Test

Symptomatic >11 days (n=48)

IgM

IgG

% Sensitivity

(CI 95%)

% Specificity

(CI 95%)

LR (+)

(CI 95%)

% Sensitivity

(CI 95%)

% Specificity

(CI 95%)

LR (+)

(CI 95%)

Biosensor®

75

(62.75 -87.25)

94

(89.34 - 98.65)

15

(8.02 - 28. 05)

83.33

(72.79 - 93.87)

100

(100 -100)

166

(23.50 - 1182)

AMS® International

60.41

(46.58 - 74.25)

98.5

(96.81 - 100)

40.28

(12.80 - 126)

66.66

(53.33 - 80.0)

98.5

(96.81 - 100)

66.67

(16.55 - 268)

Leccurate®

93.75

(86.90 - 100)

86.5

(81.76 -91.23)

6.94

(4.85 - 9.94)

93.75

(86.90 - 100)

86.5

(81.76 -91.23)

6.94

(4.85 - 9.94)

HIGHTOP One Step®

45.83

(31.73 - 59.92)

99

(97.62 - 100)

45.83

(11.16 - 188)

60.41

(46.58 - 74.25)

97.50

(95.33 - 99.66)

24.17

(9.87 - 59.16)

Cromatest COVID-19®

75

(62.75 - 87.25)

95.50

(92.62 - 98.37)

16.67

(8.62 - 32.21)

70.83

(57.97 - 83.69)

96.50

(93.95 - 99.04)

20.24

(9.56 - 42.84)

AMP Rapid Test®

70.83

(57.97 - 83.69)

95.50

(92.62 - 98.37)

15.74

(8.11 - 30.57)

79.16

(67.67 - 90.65)

97

(94.63 - 99.36)

26.39

(11.84 - 58.81)

Egens®

37.5

(23.80 - 51.19)

98

(96.05 - 99.94)

17.71

(8.77 - 35.76)

87.5

(78.14 - 96.85)

96

(93.28 - 98.71)

55.56

(17.94 - 172)

Cellex®

70.83

(57.97 - 83.69)

96

(93.28 - 98.71)

18.75

(6.66 - 52.87)

83.33

(72.79 - 93.87)

98.5

(96.81 - 100)

21.88

(11 - 43.50)

Onesite Rapidtest®

66.66

(53.33 - 80)

97

(94.63 - 99.36)

8.77

(3.38 - 22.70)

72.91

(60.34 - 85.48)

96.5

(93.95 - 99.04)

5.26

(1.95 - 14.14)

LR (+), positive likelihood ratio

In general, the tests showed adequate specificity to rule out the presence of IgM and IgG antibodies when anti-SARS-CoV-2 immunoglobulins were not present. The specificity ranged between 86.5% and 99% for IgM, and 86.5% and 99.5% for IgG. However, the sensitivity and the likelihood ratio varied according to the study groups.

Regarding the measurement of the validity of the divergent criteria (VDC), when evaluated with the historical negative serums, VDC presented values greater than 95% for IgM and 96% for IgG in 8 of the 9 tests evaluated. In the Leccurate® test this value was 84% (95% CI 75.4 - 91.4) for IgM and 86% (95% CI 77.7 - 91.6) for IgG, which should be analyzed in light of the possibility of a large number of false positives that may be related to cross-reaction to other type of antibodies non-specific to SARS-CoV-2 (table 3).

Asymptomatic patients

In the nine tests evaluated, the sensitivity of the IgM and IgG in samples from asymptomatic patients was less than 50%. In contrast, specificity was greater than 85%. The likelihood ratio had values between 3.50 and 33.

Symptomatic patients between 8-11 days or less from the onset of symptoms

The sensitivity was low, between 0%-64.2% for IgM and between 11.11%-33.3% for IgG. The likelihood ratio did not exceed 22 for IgM and 66.66 for IgG.

Symptomatic patients with more than 11 days since the onset of symptoms

The sensitivity was low to high, between 37.5%-93.75% for IgM and between 70.83%-93.75% for IgG. Likewise, the positive likelihood ratio did not exceed 45.83 for IgM and 166 for IgG.

Pooled analysis

A pooled analysis was performed in the asymptomatic and symptomatic groups (less than 11 days and more than 11 days).

Asymptomatic patients. The pooled sensitivity of IgM was 0.286 (CI 95% 0.238 – 0.337); p=0.002; I2=67.9%. The pooled specificity was 0.95 (CI 95% 0.94 – 0.96), with a high heterogeneity (I2=81.8%). The pooled PPV was 0.55 (CI 95% 0.48 – 0.61) and NPV was 0.87 (CI 95% 0.87 – 0.88). The pooled sensitivity of IgG was 0.19 (CI 95% 0.15 – 0.24) p=0.18; I2=29.6%. The pooled specificity was 0.96, but showed a high heterogeneity (I2=84.7%). The pooled PPV and NPV were 0.50 (CI 95% 0.42 – 0.57) and 0.86 (CI 95% 0.85 – 0.86) respectively.

When the Leccurate essay was excluded from the analysis there was a reduction in the heterogeneity, and the pooled sensitivity for IgM was 0.26 (CI 95% 0.21 – 0.31); p=0.010; I2 =62.4%. The pooled specificity was 0.97 (CI 95% 0.96 – 0.98); p=0.10; I2=40.6% (Figure 1). Excluding the results from Leccurate, the pooled sensitivity for IgG was 0.17 (CI 95% 0.12 – 0.21) p=0.99; I2=0%; the pooled specificity was 0.97 (CI 95% 0.96 – 0.98); p=0.12; I2=38.6% (Figure 2).

FIGURE 1. Pooled sensitivity and specificity excluding Leccurate of IgM: (A) in asymptomatic group results; (B) in symptomatic group (< 11 days).

FIGURE 1.

FIGURE 2. Pooled sensitivity and specificity excluding Leccurate of IgG: (A) in asymptomatic group; (B) in symptomatic group (< 11 days); and (C) in symptomatic group (>11 days).

FIGURE 2.

Symptomatic patients between 8-11 days or less from the onset of symptoms. The pooled sensitivity for IgM in this group was 0.33 (CI 95% 0.23 – 0.43); p=0.007; I2=61.7%. The pooled specificity for IgM was 0.95 (CI 95% 0.94 – 0.96) with a high inconsistency (I2=81.8%). The PPV and NPP were 0.27 (CI 95% 0.21 – 0.35) and 0.96 (CI 95% 0.96 – 0.97) respectively. The pooled sensitivity for IgG was 0.25 (CI 95% 0.16 – 0.35); p=0.86; I2=0%. The pooled specificity was 0.96 (CI 95% 095 – 0.97) with a high inconsistency (I2=84.7%). The pooled PPV was 0.25 (CI 95% 0.18 – 0.34) and the pooled NPV was 0.96 (CI 95% 0.95 – 0.96).

When we ran the analysis excluding Leccurate, the pooled sensitivity for IgM was 0.30 (CI 95% 0.28 – 0.41); p=0.009; I2=62.6% (Figure 1). The pooled specificity was 0.97 (CI 95% 0.95 – 0.98); p=0.10; I2= 40.6%). The pooled specificity for IgG was 0.25 (CI 95% 0.16 – 0.36); p=0.79; I2= 0%. The grouped specificity was 0.97 (CI 95% 0.96 – 0.98); p=0.12; I2=38.6% (Figure 2).

Symptomatic patients with more than 11 days since the onset of symptoms. The pooled analysis for IgM in this group was 0.66 (CI 95% 0.61 – 0.70) with a high heterogeneity (I2=84.3%). The specificity was 0.95 (CI 95% 0.94 – 0.96), also with a high heterogeneity (I2=81.8%). The pooled PPV was 0.78 (CI 95% 0.74 – 0.82); the pooled NPV was 0.92 (CI 95% 0.91 – 0.93).

The pooled sensitivity for IgG was 0.77 (CI 95% 0.73 – 0.81); p=0.001; I2=69.6%. The specificity was 0.96 (CI 95% 0.95 – 0.97) with high inconsistency (I2=84.7%). The pooled PPV and NPV were 0.83 (CI 95% 0.79 – 0.86) and 0.94 (CI 95% 0.93 – 0.95).

The pooled sensitivity for IgM excluding the Leccurate test was 0.62 (CI 95% 0.57 – 0.67); however, the inconsistency remained high (I2=74.9%). The pooled specificity was 0.96 (CI 95% 0.95 – 0.97); p= 0.10; I2=40.6%. In the case of IgG, the pooled sensitivity was 0.75 (CI 95% 0.70 – 0.79); p=0.02; I2=56.4%. The pooled specificity was 0.97 (CI 95% 0.96 – 0.98); p=0.12; I2=38.6% (Figure 2).

DISCUSSION

In this study, we evaluated nine commercial immunochromatographic tests for the detection of anti-SARS-CoV-2 IgM and IgG antibodies. Our results showed that the best sensitivity performance of the tests occurred for IgG in the group of symptomatic patients with more than 11 days after the onset of symptoms. On the contrary, the worst performance occurred in the asymptomatic group (IgM and IgG), were the sensitivity was less than 40%.

These findings are similar to those reported in the literature. The study from Vidal-Anzardo et al (10) comparing serological rapid tests against molecular tests in a population of 143 patients from Peru reported that the sensitivity of the serological rapid test is high from the second week of symptoms. On the other hand, it has also been reported better performance of the test in patients who presented clinical symptoms longer than 12 days (17,18). Zhang et al reported that the utility of these serological tests is increased in patients with at least 8 days of clinical evolution (19). The author identified that the use of serological tests for the detection of specific anti-SARS-CoV-2 antibodies in febrile patients is useful to carry out differential diagnosis, but that it should be used in addition to molecular tests. Hoffman et al evaluated an essay for COVID-19 IgG/IgM serological rapid test cassette (17). The study included 29 PCR-confirmed COVID-19 cases from a Swedish hospital and 124 negative controls from a biobank. The authors reported a sensitivity of 69% and 93.1% for IgM and IgG, and suggested that the test is not suitable for massive screening. Cassaniti et al reported the results of a diagnostic essay carried out to evaluate the performance of VivaDiag COVID-19 IgM/IgG serological rapid test in an emergency service in Italy (20). The study involved 110 subjects (30 positive for COVID-19). The authors reported a sensitivity of 18.4% and a specificity of 91.7%. A German study aimed to evaluate the diagnostic capability of a rapid point-of-care test for SARS-CoV-2 in a community screening (21). The study included 49 individuals (11 positive for SARS-CoV-2 confirmed by RT-PCR). The authors reported a sensitivity of 36.4% and a specificity of 88.9%). Ong et al compared the diagnostic accuracy of serological rapid tests in patients with suspected coronavirus disease 2019 (22). The study evaluated five commercial rapid tests (Boson Biotech Rapid 2019-nCoV IgG/IgM Combo Test Card; Cellex qSARS-CoV-2 IgG/IgM Cassette Rapid Test; Dynamiker Biotechnology 2019-nCOV IgG/IgM Rapid Test; Orient Gene Biotech COVID-19 IgG/IgM Rapid Test Cassette; and Prometheus Bio 2019-nCOV IgG/IgM Rapid) (22). It involved 228 samples from positive inpatients admitted in a hospital in the Netherlands. Authors reported heterogeneous sensitivities ranging from 10% (95% CI 0% – 23%) to 55% (95% CI 33% – 77%). The test with the best performance was the Orient Gene Biotech COVID-19 IgG/IgM Rapid Test (OGBRT) (22).

Consistent with the reported literature, our findings showed a lower performance for sensitivity in all the study groups. These results differ from the reported sensitivity and specificity values from commercial manufactures, which may occur for many different reasons. First, most of the experiments in the clinical reports from the manufactures did not report the origin (country) used to evaluate the operative capability of the assays. The results may change from one country to other, or may be affected by conditions such as ethnicity and the time of the onset of symptoms. Second, some of the information leaflets reported several samples used to estimate the sensitivity and specificity, but all of them fail to report the clinical stage of the patients. Besides, none of the tests reported the inclusion of serum from asymptomatic patients. This may result in an overestimation of the sensitivity of the test. Third, it should be considered that most of the clinical reports from commercial manufacturers are not published in peer-reviewed journals, were independent readers may evaluate the experiment conditions. Lastly, it should be taken into account the diversity of the SARS-CoV-2 strains circulating in Colombia. Recent reports from the phylogenetic analysis of SARS-CoV-2 in Colombia have shown that the lineages B.1.1, B.1.5 of SARS-CoV-2 are the most common in the country (23,24). These lineages have been reported in studies from Europe, the United States and Australia (25). The described lineages may be linked with low performance of rapid diagnostic tests, as reported in Italian, German, and Dutch studies (2022).

We should mention the case of the Leccurate test, which performance highly differs from the other 8 tests. Even when we carried out a subgroup analysis considering the manufacturing place (Asia vs Europe; Asia vs United States; China vs Europe; China vs United States) the results of the pooled analysis increased the inconsistency. We did not find a reason to explain the heterogeneity shown by the above mentioned test.

Also, we have found that the best performance of the test occurred in the group of patients with 11 or more days of evolution. We calculated a pooled sensitivity of 76% (CI 71 – 80) and a pooled specificity of 98% (CI 97 – 98) for IgG. These results differ slightly from the reported by Castro et al in a metanalysis to estimate the pooled sensitivity and specificity in a group of 16 COVID-19 serological rapid tests available in Brazil (26). The authors reported a sensitivity of 82% (CI 76 – 87) and a specificity of 97% (CI 96 – 98) for IgM, and a sensitivity of 97% (CI 90 – 99) and specificity of 98% (CI 97 – 99) for IgG. Nevertheless, the authors highlighted the high rate of false negative results of these tests in the acute phase of the infection, which may range between 10 – 44%. Also, they urged for a validation study using Brazilian samples (26).

In this sense, our study using samples from Colombian serums found that serological rapid tests should be limited to patients with more than 11 days of symptoms. Besides, the serological tests are not an adequate strategy for the identification of asymptomatic and pre-symptomatic patients. The recommendations from the World Health Organization should be taken into account; they should be avoided as a diagnostic test and they must be accompanied by RT-PCR (8).

This study has some limitations. First, in the absence of a gold standard test, RT-PCR was used. Nucleic acid detection by the Berlin protocol, although standardized and validated by the US National Institutes of Health, may have some false negatives, especially during the first days of the clinical picture. On the other hand, the pooled sensitivity analyses for IgM and IgG in the asymptomatic and symptomatic groups showed moderate heterogeneities, which could invalidate the pooled sensitivity data.

All in all, serological tests are essential to analyze the immune response against infectious diseases to carry out their epidemiological characterization, natural resistance or susceptibility, and the study of potential vaccines. In cases such as the SARS-CoV-2 pandemic, the secondary validation of the available tests is essential to establish their usefulness as well as their limitations. Our study showed that the usefulness of immunochromatographic serological tests for COVID-19 is limited and its use as a diagnostic tool has led to a large proportion of false negatives promoting the contagion. Immunochromatographic tests may be used in seroprevalence studies once more sensible antigens are incorporated in the technique, making them suitable tests for screening the infectious population.

Funding.

This study was supported by the Instituto Nacional de Salud within the framework of the resources provided for the COVID-19 pandemic.

Disclaimer.

Authors hold sole responsibility for the views expressed in the manuscript, which may not necessarily reflect the opinion or policy of the RPSP/PAJPH and/or PAHO.

Acknowledgments

The authors thank Professor Owen Harrison for the revision of the manuscript; to Dr. Sofía Duque who kindly reviewed the last version of the manuscript and provided valuable suggestions and comments.

Footnotes

Conflict of interests.

None declared.

Authors´ contributions.

All authors have participated in the design, analysis of results, writing and revision of the document, and final approval of the manuscript.

References


Articles from Revista Panamericana de Salud Pública are provided here courtesy of Pan American Health Organization

RESOURCES