Abstract
Objectives
To evaluate nine rapid syphilis tests at eight geographically diverse laboratory sites for their performance and operational characteristics.
Methods
Tests were compared “head to head” using locally assembled panels of 100 archived (50 positive and 50 negative) sera at each site using as reference standards the Treponema pallidum haemagglutination or the T pallidum particle agglutination test. In addition inter‐site variation, result stability, test reproducibility and test operational characteristics were assessed.
Results
All nine tests gave good performance relative to the reference standard with sensitivities ranging from 84.5–97.7% and specificities from 84.5–98%. Result stability was variable if result reading was delayed past the recommended period. All the tests were found to be easy to use, especially the lateral flow tests.
Conclusions
All the tests evaluated have acceptable performance characteristics and could make an impact on the control of syphilis. Tests that can use whole blood and do not require refrigeration were selected for further evaluation in field settings.
Keywords: rapid tests, syphilis
The World Health Organization (WHO) estimates that approximately 12 million new cases of venereal syphilis occur worldwide each year, most of which are in developing countries where access to sexually transmitted diseases (STD) laboratory services are limited.1 Nonetheless, the disease remains a global health priority. The recent re‐emergence of syphilis in the developed world, as seen in Russia and eastern Europe, has been associated with social upheaval and is potentially a contributor to burgeoning HIV epidemics.2 In North America and Western Europe, resurgent syphilis has been associated mainly with men who have sex with men or illicit drug users.3
In most countries where prenatal screening for syphilis is available, the rapid plasma reagin (RPR) test is used. To prevent stillbirth and other adverse outcomes of pregnancy, women who test positive at peripheral clinics are treated without recourse to a confirmatory treponemal test. Given the importance of early treatment, and the efficacy and safety of intramuscular benzathine penicillin, this has proved to be a sound strategy, even though it may lead to unnecessary treatment in some cases. Screening and treatment of pregnant women for syphilis remains cost‐effective even when the prevalence is low.4 However, it is estimated that less than 30% of pregnant women are screened for the disease in sub‐Saharan Africa,5 while a study in Bolivia showed that, although 76% of the study population received antenatal care, only 17% were screened for syphilis during pregnancy.6 Among the many reasons for low rates of screening, one major barrier is that current screening using a non‐treponemal test requires a laboratory with trained personnel and a source of electricity to run a refrigerator to store the RPR reagent, a centrifuge to separate serum from whole blood, and a shaker to perform the serology. Since such facilities are generally not available in primary health care settings, blood or serum samples have to be transported to regional or central facilities for testing. Often results are only available days or weeks after testing. Studies have shown that only a small proportion of infected women receive treatment when RPR testing is performed off‐site, because women do not return for their results or specimens or results are lost in transit.7 Even when testing is available at clinical sites, there are technical difficulties associated with maintaining trained personnel and assuring quality standards and supplies of tests and treatment.8
A number of simple, rapid treponemal tests have recently become commercially available. Most are “lateral flow” tests in which antibodies are transported by capillary flow over antigen immobilised on a nitrocellulose membrane strip (also termed immunochromatographic strips). Antibodies in the specimen become bound at the antigen site on the strip and are revealed with dye bound to an anti‐immunoglobulin. These tests are simple, robust, affordable and can be stored and transported without need for refrigeration. Initial evaluations suggested that their performance was comparable with the best laboratory‐based diagnostics.9,10,11,12,13,14,15,16,17 Used alone, they would be unable to distinguish active from cured disease but they can facilitate a crucial intervention—the screening of pregnant women to reduce the occurrence of stillbirth and congenital syphilis where access to laboratory services is a problem18,19 The WHO/Sexually Transmitted Diseases Diagnostics Initiative (SDI) is conducting an ongoing comprehensive evaluation of these rapid tests with panels of well‐characterised archived serum specimens from geographically diverse settings. The results of these evaluations are used to select a number of the most promising tests for further evaluation in field settings. This paper reports the first results.
METHODS
The initial phase of the work involved the recruitment of laboratories to undertake the evaluation and two reference laboratories to provide a measure of quality assurance. A request for applications was posted on the WHO/SDI website and laboratories on the SDI mailing list were contacted. Responding laboratories were sent a questionnaire to establish their access to patients, sera and a suitably constituted ethics committee, their general experience of evaluations and, importantly, their access to field sites for subsequent testing. In addition, the principal investigators were asked to submit 20 sera to the reference laboratories together with details of their results of both treponemal (Treponema pallidum particle agglutination assay (TPPA) or T pallidum haemagglutination assay (TPHA)) and non‐treponemal (RPR) antibody tests. This was to establish that they were proficient in performing the reference tests used in the evaluation. The eight laboratories selected by this process are shown in table 1.
Table 1 Sexually Transmitted Diseases Diagnostics Initiative (SDI) sites for laboratory‐based evaluations of rapid syphilis diagnostics.
| Site location | Institution | Principal investigators |
|---|---|---|
| Africa | ||
| South Africa, Durban | University of Natal | AW Sturm |
| The Gambia, Fajara* | MRC Laboratories | B West, RA Adegbola |
| Tanzania, Mwanza* | National Institute for Medical Research | J Changalucha |
| Asia | ||
| China, Nanjing* | National Center for STD and Leprosy Control | YP Yin |
| Sri Lanka, Colombo | National STD/AIDS Control Programme | S Mananwatte |
| Americas | ||
| Haiti, Port au Prince* | Les Centres GHESKIO (Groupe Haitien d'Etudedu Sarcome de Kaposi et des Infections Opportunistes) | JW Pape, DW Fitzgerald |
| USA, Birmingham Alabama* | University of Alabama | E Hook III |
| Europe | ||
| Russian Federation, Moscow* | Central Institute for Skin and Venereal Diseases | A Kubanova, E Filatova |
*These laboratories undertook both rounds of the evaluation.
Tests for evaluation
An ad hoc SDI expert working group for laboratory‐based evaluations decided that the tests to be included should have the following characteristics:
rapid‐test result is available in less than 30 minutes
simple test can be performed in a few steps, requiring minimal training and minimal extra equipment
easy‐to‐interpret card or strip format with visual readout.
In the initial round of evaluation, 13 manufacturers with tests that conform to the above characteristics were invited to participate, of whom six manufacturers submitted tests for evaluation at eight SDI sites on four continents. In the second round of evaluations, three more tests were evaluated in six of the SDI sites. One of the tests evaluated in the second round was an improved version of the test submitted in the first round (SyphiCheck made by the Tulip Group in India). Details of the tests are given in table 2 and their major features are listed in table 3. The serum panels used in round 2 were not identical to those used in round 1.
Table 2 Syphilis tests evaluated and their manufacturers.
| Test | Company |
|---|---|
| Round 1 | |
| Determine Syphilis | Abbott Laboratories, Chicago, USA; www.abbottdiagnostics.com |
| Syphilis Fast | DIESSE Diagnostica, Senese SpA, Milan, Italy; www.diesse.it |
| Espline TP | Fujirebio Inc, Tokyo, Japan; www.fujirebio.co.jp |
| Syphicheck‐WB | Qualpro Diagnostics, Goa, India; www.tulipgroup.com |
| SD Bioline Syphilis 3.0 | Standard Diagnostics, Inc, Kyunggi‐do, Korea; www.standardia.com |
| Visitect Syphilis | Omega Diagnostics Ltd, Scotland, UK; www.omegadiagnostics.co.uk |
| Round 2 | |
| Syphicheck‐WB (new version) | Qualpro Diagnostics, Goa, India; www.tulipgroup.co |
| Bioline Syphilis 3.0 (new manufacturer) | Pacific Biotech Co, Ltd, Petchaboon, Thailand |
| Syphilisonsite Rapid Screening Test | CTK Biotech, Inc, San Diego, USA |
Table 3 The major features of the evaluated tests.
| Test | Design | Cassette mounted | Specimen utilised | Time to result (min) | Extra supplies* | Shelf life/storage temp | ||
|---|---|---|---|---|---|---|---|---|
| Blood | Plasma | Serum | ||||||
| Determine Syphilis | Lateral flow | No | Yes | Yes | Yes | 5–20 | Yes | 24 months/2–30°C |
| Syphilis Fast | Latex agglutination | Not applicable | No | No | Yes | 8 | Yes | 18 months/reagents; 6 months after reconstitution |
| Espline TP | Lateral flow | Yes | No | Yes | Yes | 15 | Yes | 9 months/2–10°C |
| Syphicheck‐WB | Lateral flow | Yes | Yes | Yes | Yes | 15 | No | 18 months/4–30°C |
| SD Bioline Syphilis 3.0 | Lateral flow | Yes | Yes | Yes | Yes | 5–20 | Yes | 18 months/room temp |
| Visitect Syphilis | Lateral flow | Yes | Yes | Yes | Yes | 15 | No | 24 months/4–30°C |
| Syphicheck‐WB (new version) | Lateral flow | Yes | Yes | Yes | Yes | 15 | No | 18 months/4–30°C |
| Bioline Syphilis 3.0 (new manufacturer) | Lateral flow | Yes | Yes | Yes | Yes | 5–20 | No | Unknown/4–30°C |
| Syphilisonsite Rapid Screening Test | Lateral flow | No | No | Yes | Yes | 5–10 | No | Unknown/4–30°C |
*In all cases, where additional equipment was required it consisted of handheld micropipettes and micropipette tips.
Several parameters of the tests were evaluated including sensitivity and specificity relative to a “gold” or reference standard laboratory test together with inter‐reader variability, result stability, reproducibility, ease of use and between‐site variability. These laboratory comparisons represent the first part of a full evaluation of these tests, the final and definitive phase being the field evaluation.
Development of the standard protocol and performance of the evaluation
All participating laboratories collaborated in the development of a standard protocol for the evaluation which was then reviewed and approved by the WHO and the local site ethical committees. Before beginning the evaluation, the study protocol was piloted with one positive and one negative serum.
Each laboratory assembled an evaluation panel from archived specimens containing 50 TPHA/TPPA positive sera (40 RPR+, 10 RPR−) and 50 TPHA/TPPA negative sera (40 RPR−, 10 RPR+). Haemolysed sera were avoided and, if a precipitate was visible, the serum was clarified at 12 000 g for five minutes. All patient identifiers were unlinked from specimens before the evaluations.
The reference test was either the TPPA (Serodia, Fujirebio Inc, Tokyo) or the TPHA.
The standard operating procedures (SOP) for the assays were the manufacturer's product inserts. In addition, SOPs were produced to ensure that the testers were blinded to reference standard results and that, in the inter‐observer variability trial, both testers were truly independent.
Each kit was tested with all 100 sera in batches of 25 sera before evaluating another test kit to avoid comparison of results between kits. Indeterminate results were recorded as such and any repeat testing was only performed after all 100 sera had been tested. To allow result stability to be assessed, each result was read at the recommended time and after one hour. At each site, each test was read by two project technicians to allow inter‐operator variability to be estimated.
Each test was assessed for its operational characteristics by the same technicians. Tests were scored for clarity of kit instructions, technical complexity or ease of use and ease of interpretation of results. Each of these characteristics was allotted marks out of 3 and an additional score of 1 was given to tests not requiring additional equipment, giving a maximum of 10. This was not done in the second round as it was felt that this would be better evaluated by field staff than highly trained laboratory technicians.
Test reproducibility was investigated in the reference laboratories. Lot‐to‐lot reproducibility was tested using 25 sera and two lots of each rapid test. Operator reproducibility was compared by two technicians who ran each test with the same 20 sera. Run‐to‐run reproducibility was investigated using nine sera that were tested on five successive days for each test.
Quality control measures were included in the data management instructions in the protocol. Results were recorded in the laboratory notebooks of each technician which was signed off by the supervisor at the end of each day. Data were then entered into a laboratory data collection spreadsheet provided by SDI. The spreadsheet was then double‐checked against the notebooks of both technicians.
Data analysis
Sensitivities and specificities were calculated relative to the reference standard TPPA or TPHA results obtained for each serum specimen at each site and validated by the reference centres. Sample size calculations showed that the use of 600–800 sera, of which 50% are positive, would allow estimation of the sensitivity and specificity of the test with a 95% confidence interval of ±5%. No discrepant analyses were undertaken. The Breslow‐Day test for homogeneity was used for determining site to site variation and κ values were calculated for each test as a summation of the overall performance (combined correlation of test sensitivity and specificity) of each test against the reference standard for all sites. A κ value of ⩾0.75 is considered excellent.
Interobserver variability was calculated as the number of tests for which different results are obtained by two independent different readers, divided by the number of specimens tested.
RESULTS
Round 1
Owing to insufficient quantities of characterised sera at some sites, the final results were available for 789 sera, 399 of which were TPHA or TPPA positive. (The requirement for biological false positive sera (TPPA−, RPR +) was a particular problem for some sites.) The sensitivity and specificity of each test for each site is shown in table 4. The overall sensitivity and specificity for the combined results with 95% confidence intervals are also shown.
Table 4 Performance of rapid diagnostic tests for syphilis in round 1.
| Sites | Determine Syphilis TP Abbott Labs | Syphilis Fast Diesse Diagnostica | Espline TP Fujirebio Inc | Syphicheck‐WB Qualpro Diagnostics | SD Bioline Syphilis 3.0 Standard Diagnostics | Visitect Syphilis Omega Diagnostics | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Sens (%) | Spec (%) | Sens (%) | Spec (%) | Sens (%) | Spec (%) | Sens (%) | Spec (%) | Sens (%) | Spec (%) | Sens (%) | Spec (%) | |
| Moscow, Russian Fed. | 100 | 100 | 72 | 98 | 100 | 83 | 80 | 100 | 92 | 98 | 76 | 100 |
| Birmingham, USA | 88 | 92 | 57 | 92 | 98 | 88 | 82 | 94 | 94 | 90 | 80 | 94 |
| Port au Prince, Haiti | 100 | 98 | 100 | 92 | 98 | 100 | 90 | 98 | 100 | 100 | 90 | 100 |
| Nanjing, China | 98 | 93 | 79 | 89 | 94 | 93 | 77 | 95 | 89 | 96 | 81 | 93 |
| Mwanza, Tanzania | 96 | 94 | 94 | 90 | 98 | 100 | 80 | 100 | 94 | 94 | 82 | 100 |
| Colombo, Sri Lanka | 100 | 98 | 96 | 100 | 98 | 96 | 88 | 100 | 96 | 100 | 92 | 100 |
| Durban, South Africa | 96 | 90 | 94 | 96 | 96 | 94 | 82 | 100 | 94 | 98 | 86 | 100 |
| Fajara, The Gambia | 100 | 88 | 94 | 86 | 100 | 92 | 96 | 94 | 100 | 84 | 92 | 96 |
| Overall results | 97.2 | 94.1 | 86 | 92.8 | 97.7 | 93.4 | 84.5 | 97.7 | 95 | 94.9 | 85 | 98 |
| 95% CIs | 95.6 to 98.8 | 91.8 to 96.4 | 82.5 to 89.4 | 90.3 to 95.4 | 96.3 to 99.2 | 90.9 to 95.8 | 80.9 to 88.0 | 96.2 to 99.2 | 92.8 to 97.1 | 92.7 to 97.1 | 81.4 to 88.5 | 96.5 to 99.4 |
| Homogeneity* p values | 0.0086 | 0.0002 | 0.2529 | 0.1427 | 0.1132 | 0.03 | ||||||
| κ† (95% CI) | 0.95 (0.93 to 0.97) | 0.87 (0.84 to 0.90) | 0.95 (0.93 to 0.97) | 0.84 (0.80 to 0.87) | 0.9 (0.87 to 0.94) | 0.85 (0.82 to 0.89) | ||||||
*The Breslow‐Day test for homogeneity of odds ratios was calculated to determine the extent of site‐to‐site variation of test performance.
†The κ value for each test is a summation of the overall performance of each test against the reference standard for all sites. A value of 0.75 or greater is considered excellent.
CI, confidence interval; Sens, sensitivity; Spec, specificity.
The Fujirebio Espline, Abbott Determine, and Standard Bioline tests showed the highest sensitivity (97.7%, 97.2% and 95%, respectively; table 4). The sensitivities of these three tests were not significantly different from each other but were significantly different from those of the Diesse, Omega and Qualpro tests (p<0.03).
The Omega Visitect and the Qualpro Syphicheck tests showed the highest specificity (98% and 97.7%, respectively; table 4). These are not significantly different from each other but were significantly higher than the other four tests.
For estimation of overall test performance, the κ value was used. This determined the combined correlation of test sensitivity and specificity for all the sites against the reference standard. A κ value of 0.75 is considered excellent. Thus all the rapid tests had excellent correlation with the reference standard tests at each site, with κ values for the initial six tests ranging from 0.84–0.95.
Site‐to‐site variation for each test was measured using the Breslow‐Day test for homogeneity of odds ratios. The three tests that gave the most variation were the Omega Visitect, the Abbott Determine, and the Diesse Syphilis Fast tests, with p values of 0.03, 0.0086 and 0.0002, respectively. There was no significant difference between malaria endemic and malaria‐free sites with respect to test specificity.
Test results were stable after one hour for the Abbott Determine, Fujirebio, Qualpro Syphicheck and Omega Visitect tests with five or less results different from the original results. The Standard Bioline had 12 results different from the original with most of these becoming false‐positive after one hour. The Diesse Syphilis Fast was affected by drying, making reading difficult after an hour. By the second reading, 22 results were different from the original test result, turning from negative to false‐positive.
The scores for operational characteristics are summarised in table 5. The Abbott test obtained the best score (7.5 out of 10) with the Omega Visitect, Qualpro Syphicheck, Fujirebio Espline and Standard Bioline all less than 10% different from each other (6.5–7.1 out of 10). The Diesse Syphilis Fast test scored lowest (4.3 out of 10) on technical complexity and ease of interpretation.
Table 5 Operational characteristics of rapid diagnostic tests for syphilis.
| Operational characteristic | Determine Syphilis TP Abbott Labs | Syphilis Fast Diesse Diagnostica | Espline TP Fujirebio Inc | Syphicheck‐WB Qualpro Diagnostics | SD Bioline Syphilis 3.0 Standard Diagnostics | Visitect Syphilis Omega Diagnostics |
|---|---|---|---|---|---|---|
| Mean score | Mean score | Mean score | Mean score | Mean score | Mean score | |
| Clarity of kit instructions | 2.625 | 1.875 | 1.875 | 2.125 | 2.125 | 2.5 |
| Technical complexity | 2.875 | 1.125 | 2.625 | 1.875 | 2.375 | 2 |
| Ease of interpretation of results | 2 | 1.25 | 2.125 | 1.875 | 2 | 1.625 |
| Equipment required but not provided | 0 | 0 | 0 | 1 | 0 | 1 |
| Total score | 7.5/10 | 4.3/10 | 6.6/10 | 6.9/10 | 6.5/10 | 7.1/10 |
The technicians were asked to give, for each test, a score out of 3 for each of the first three characteristics, with 3 being the best, and then a score of 1 if the test does not require any additional equipment.
The results for test reproducibility are summarised in table 6. Overall, the variability was low. The maximum observed was 10% for the Omega test for operator‐to‐operator variation in the reference laboratories. However, this test performed well for this parameter at the evaluation sites. Results of the first round of evaluations have been posted on the SDI website.
Table 6 Test reproducibility.
| Determine Syphilis TP Abbott Labs | Syphilis Fast Diesse Diagnostica | Espline TP Fujirebio Inc | Syphicheck‐WB Qualpro Diagnostics | SD Bioline Syphilis 3.0 Standard Diagnostics | Visitect Syphilis Omega Diagnostics | |
|---|---|---|---|---|---|---|
| Lot‐to‐lot variation* | 1/50 | 4/50 | 3/50 | 0/50 | 3/50 | 1/50 |
| Day‐to‐day variation† | 0/45 | 3/45 | 1/45 | 1/45 | 0/45 | 3/45 |
| Operator‐to‐operator at reference labs‡ | 1/40 | 0/40 | 0/40 | 3/40 | 1/40 | 4/40 |
| Operator‐to‐operator at sites | 4/789 | 20/789 | 0/789 | 6/789 | 0/789 | 5/789 |
Values given as number of discordant results/total number of tests performed.
*Two lots of rapid tests performed using the same 25 sera.
†Nine sera tested on 5 days.
‡Ten sera run by 2 operators at each of 2 reference laboratories.
Round 2
A total of 600 sera from the six laboratory sites were used to evaluate a further three rapid syphilis tests; 299 were reference standard positives and 301 were reference standard negatives. The serum panels were not identical to those used in round 1. The performance data for these tests is summarised in table 7.
Table 7 Performance of rapid diagnostic tests for syphilis in round 2.
| Site | Syphicheck WB Qualpro Diagnostics | Bioline Syphilis Anti‐TP Pacific Biotech Co Ltd | Syphilis On Site Rapid CTK BioTech Inc | |||
|---|---|---|---|---|---|---|
| Sens (%) | Spec (%) | Sens (%) | Spec (%) | Sens (%) | Spec (%) | |
| Moscow, Russia | 92 | 98 | 92 | 100 | 96 | 98 |
| Birmingham, USA | 90 | 100 | 92 | 100 | 92 | 100 |
| Port au Prince, Haiti | 96 | 90 | 94 | 94 | 92 | 94 |
| Nanjing, China | 100 | 92 | 86 | 98 | 98 | 94 |
| Mwanza, Tanzania | 94 | 94 | 100 | 96 | 90 | 100 |
| Fajara, Gambia | 100 | 88 | 100 | 90 | 100 | 86 |
| Overall values | 95.3 | 93.7 | 92.2 | 97 | 96.3 | 94.6 |
| 95% CIs | 92.5 to 99.9 | 91.3 to 99.9 | 88.9 to 95.1 | 95.1 to 98.9 | 93.8 to 99.9 | 92.5 to 99.9 |
| Homogeneity (p value) | 0.4451 | 0.3552 | 0.2911 | |||
| κ (95% CI) | 0.89 (0.86 to 0.93) | 0.9 (0.86 to 0.93) | 0.92 (0.89 to 0.95) | |||
The CTK Syphilis On Site Rapid Q and the Qualpro Syphicheck WB tests showed the highest sensitivities (96.3% and 95.3%, respectively). These values were not significantly different from each other but there were significant differences between the sensitivities of the Bioline Syphilis anti‐TP and CTK Syphilis On Site Rapid. The Bioline Syphilis Anti‐TP test showed the highest specificity (97%). The only marginally significant difference was between the Qualpro Syphicheck WB and the Bioline Syphilis anti‐TP. All other performance comparisons were not significantly different. The κ values for the three tests ranged from 0.89–0.92. Similarly, all three tests gave excellent values for the Breslow‐Day test for site to site variation.
In round 2, the reproducibility testing was restricted to measuring lot‐to‐lot variations for two different lots using 20 serum samples. There was one discrepant result with the Qualpro Syphicheck‐WB, two with the Bioline Syphilis anti‐TP test and five with CTK's Syphilis Rapid Screening Test.
In result stability testing after one hour the Qualpro test showed seven changes in result; five negative tests became false positive. The Bioline and the CTK tests were less stable with 12 and 14 changes, respectively. (In the Bioline test, nine became false positives and in the CTK test 10 became positive.)
Since all the lateral flow tests in round 1 were found to be simple in operation and the three tests in round 2 were essentially identical, the site technicians were not asked to score the operational characteristics of the tests in round 2. Given that these rapid tests are intended to be used in field settings, it was decided that the ease of operations would be better assessed in field settings.
DISCUSSION
Most of these rapid tests utilise one or more similar recombinant treponemal antigens, and it is likely that small differences in antigen concentration, detection system and the volume of serum used account for the small variations observed in performance. The nine rapid tests evaluated all showed good performance in terms of sensitivity and specificity relative to the reference standard TPHA or TPPA tests using archived serum specimens. As has often been noted in such trials of diagnostic tests, there was a trend towards an inverse relationship between sensitivity and specificity. Thus, for a diagnosis such as syphilis that can carry a risk of stigma for the patient, there may be an advantage in using a high specificity test to confirm diagnosis with a high sensitivity assay. There would also be an advantage for interpretation of disease status if the tests could be combined with a non‐treponemal antibody assay. Although the RPR is simple enough to be performed under field conditions, it requires some laboratory equipment and refrigeration. In addition, there are problems with reading in differentiating between weak positive and negative reactions. Therefore, an anti‐cardiolipin antibody test in a lateral flow format would be a substantial advance.
The multicentre design of this trial also allowed inter‐site variation to be assessed. This also showed that the tests performed well in geographically distinct areas with differing patient populations, despite inevitable variations in the sera selected for each panel, test performance and reading, and the subjective nature of result interpretation.
These studies were able to detect significant variations in the stability of the results after one hour. This measurement was made to anticipate the use of these tests in a busy clinic setting where staff may not be able to read the tests at the manufacturers designated time. The Syphilis Fast latex agglutination assay particularly should be read after the recommended 8 minutes but, given its speed, this was not perceived as a problem. Similarly, all the lateral flow tests were perceived as very easy to use. The Syphilis Fast latex agglutination test was found to be marginally more difficult to do as sometimes the stick for stirring the reaction broke and it is also more difficult to interpret, especially when the reaction dried before the designated reading time. None of the tests were technically complex to perform and all tests were considered suitable for field use. The true evaluation of the operational characteristics of the tests will emerge from the subsequent field evaluations.
The SDI ad hoc expert working group considered which tests should be further evaluated in field settings after round 1 and felt that it was difficult to select one or two tests based on test performance characteristics alone. The final consensus was that the four rapid tests in round 1 that can use whole blood and do not require refrigeration should be taken forward to SDI field trials (see Mabey et al in this supplement). The three tests evaluated in round 2 also warrant field testing.
Given the simplicity and low cost of these rapid tests, it is hoped that they may prove to be effective tools in the control of syphilis and for screening pregnant women to prevent congenital syphilis in primary health care settings.
ACKNOWLEDGEMENTS
The authors wish to acknowledge the excellent technical assistance of all the laboratory staff who contributed to this evaluation. In particular, we thank K Eastick, L Stephenson and S Wu from the UK PHLS, Ramu Sarge‐Njie from the Gambia site, Fazana Karim from the South Africa site, WH Wei and MQ Shi from the China site, Dean Mngara and Julius Mngara from the Tanzania site, and Grace Daniels and Paula B Dixon from the Alabama site, and the staff of the reference laboratories at the US Centers for Disease Control and Prevention and UK Public Health Laboratory Services in validating the qualification panels, repackaging and sending out the tests to all the sites, and performing the reproducibility testing.
SDI is indebted to members of the SDI ad hoc Laboratory Evaluation Expert Working Group (Ron Ballard, Carlos Conde, Alan J Herring, Edward W Hook, Robert Johnson, Laurie Markowitz, Milton R Tam) for their invaluable contribution towards the development of the SDI diagnostic evaluation scheme. The expert assistance of Mary Cheang and Jean Joly in data analyses, and of Izabela Suder‐Dayao in coordinating this work and preparation of the laboratory reports, is much appreciated. This work is made possible with funding to the STD Diagnostics Initiative (SDI) from USAID and the Bill & Melinda Gates Foundation.
Abbreviations
SDI - Sexually Transmitted Diseases Diagnostics Initiative
STD - sexually transmitted diseases
RPR - rapid plasma reagin
SOP - standard operating procedures
TPHA - Treponema pallidum haemagglutination assay
TPPA - Treponema pallidum particle agglutination assay
WHO - World Health Organization
Footnotes
Competing interests: none declared
References
- 1.World Health Organization Global prevalence and incidence of selected curable sexually transmitted infections: overview and estimates. Geneva: WHO, WHO/HIV_AIDS/2001, 02
- 2.Tichonova L, Borisenko K, Ward H.et al Epidemics of syphilis in the Russian Federation: trends, origins, and priorities for control. Lancet 1997350210–213. [DOI] [PubMed] [Google Scholar]
- 3.Golden M R, Marra C M, Holmes K K. Update on syphilis: resurgence of an old problem. JAMA 20032901510–1514. [DOI] [PubMed] [Google Scholar]
- 4.Connor N, Roberts J, Nicoll A. Strategic option for antenatal screening for syphilis in the United Kingdom: a cost effectiveness analysis. Journal of Medical Screening 200077–13. [DOI] [PubMed] [Google Scholar]
- 5.Schmid G. Economic and programmatic aspect of congenital syphilis prevention. Bull World Health Organ 200482402–409. [PMC free article] [PubMed] [Google Scholar]
- 6.Southwick K L, Blanco S, Santander A.et al Maternal and congenital syphilis in Bolivia, 1996: prevalence and risk factors. Bull World Health Organ 20017933–42. [PMC free article] [PubMed] [Google Scholar]
- 7.Fonn S. A blood‐result turn‐around time survey to improve congenital syphilis prevention in rural area. South African Medical Journal 1996167–71. [PubMed] [Google Scholar]
- 8.West B, Walraven G, Morison L.et al Performance of the rapid plasma reagin and the rapid syphilis screening tests in the diagnosis of syphilis in field conditions in rural Africa. Sex Transm Dis 200278282–285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Young H, Moyes A, de SC I.et al A new recombinant antigen latex agglutination test (Syphilis Fast) for the rapid serological diagnosis of syphilis. Int J STD AIDS 19989(4)196–200. [DOI] [PubMed] [Google Scholar]
- 10.Fears M B, Pope V. Syphilis fast latex agglutination test, a rapid confirmatory test. Clin Diagn Lab Immunol 20018841–842. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Zarakolu P, Buchanan I, Tam M.et al Preliminary evaluation of an immunochromatographic strip test for specific Treponema pallidum antibodies. J Clin Microbiol 2002403064–3065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.West B, Walraven G, Morison L.et al Performance of the rapid plasma reagin and the rapid syphilis screening tests in the diagnosis of syphilis in field conditions in rural Africa. Sex Transm Infect 200278282–285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Sato N S, de Melo C S, Zerbini L C.et al Assessment of the rapid test based on an immunochromatography technique for detecting anti‐Treponema pallidum antibodies. Rev Inst Med Trop Sao Paulo 200345319–322. [DOI] [PubMed] [Google Scholar]
- 14.Diaz T, Almeida M G, Georg I.et al Evaluation of the Determine Rapid Syphilis TP assay using sera. Clin Diagn Lab Immunol 20041198–101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Siedner M, Zapitz V, Ishida M.et al Performance of rapid syphilis tests in venous and fingerstick whole blood specimens. Sex Transm Dis 200431557–560. [DOI] [PubMed] [Google Scholar]
- 16.Goel N, Sharma M, Gupta N.et al Rapid immunochromatographic test for syphilis. Indian J Med Microbiol 200523142–143. [DOI] [PubMed] [Google Scholar]
- 17.WHO/TDR Laboratory‐based evaluation of rapid syphilis diagnostics. Diagnostics Evaluation Series; 2003. http://www.who.int/std_diagnostics/publications/meetings/SDI_Report.pdf
- 18.Peeling R W, Ye H. Diagnostic tools for preventing and managing maternal and congenital syphilis: an overview. Bull World Health Organ 200482439–446. [PMC free article] [PubMed] [Google Scholar]
- 19.Montoya P J, Lukehart S A, Brentlinger P E.et al Comparison of the diagnostic accuracy of a rapid immunochromatographic test and the rapid plasma reagin test for antenatal syphilis screening in Mozambique. Bull World Health Organ 20068497–104. [DOI] [PMC free article] [PubMed] [Google Scholar]