Abstract
Background
We assessed if histidine-rich-protein-2 (HRP2) based rapid diagnostic test (RDT) remains an efficient tool for Plasmodium falciparum case detection among fever patients in Zanzibar and if primary health care workers continue to adhere to RDT results in the new epidemiological context of low malaria transmission. Further, we evaluated the performance of RDT within the newly adopted integrated management of childhood illness (IMCI) algorithm in Zanzibar.
Methods and Findings
We enrolled 3890 patients aged ≥2 months with uncomplicated febrile illness in this health facility based observational study conducted in 12 primary health care facilities in Zanzibar, between May-July 2010. One patient had an inconclusive RDT result. Overall 121/3889 (3.1%) patients were RDT positive. The highest RDT positivity rate, 32/528 (6.1%), was found in children aged 5–14 years. RDT sensitivity and specificity against PCR was 76.5% (95% CI 69.0–83.9%) and 99.9% (95% CI 99.7–100%), and against blood smear microscopy 78.6% (95% CI 70.8–85.1%) and 99.7% (95% CI 99.6–99.9%), respectively. All RDT positive, but only 3/3768 RDT negative patients received anti-malarial treatment. Adherence to RDT results was thus 3887/3889 (99.9%). RDT performed well in the IMCI algorithm with equally high adherence among children <5 years as compared with other age groups.
Conclusions
The sensitivity of HRP-2 based RDT in the hands of health care workers compared with both PCR and microscopy for P. falciparum case detection was relatively low, whereas adherence to test results with anti-malarial treatment was excellent. Moreover, the results provide evidence that RDT can be reliably integrated in IMCI as a tool for improved childhood fever management. However, the relatively low RDT sensitivity highlights the need for improved quality control of RDT use in primary health care facilities, but also for more sensitive point-of-care malaria diagnostic tools in the new epidemiological context of low malaria transmission in Zanzibar.
Trial registration
ClinicalTrials.gov NCT01002066
Introduction
Zanzibar has recently undergone a rapid transition from high to low transmission of Plasmodium falciparum malaria following wide scale, high coverage implementation of combined malaria control interventions [1]. In this new epidemiological context, efficient malaria case detection and targeted malaria treatment with artemisinin-based combination therapy (ACT) to fever patients with parasitologically confirmed malaria infection is critical. Therefore, Zanzibar introduced P. falciparum specific rapid diagnostic testing (RDT), based on antigen detection of histidine-rich protein 2 (HRP2), for confirmatory malaria diagnosis of fever patients in all public health care facilities previously not equipped with microscopy service [2]. Importantly, malaria RDT has also been recently incorporated in the local version of the integrated management of childhood illness (IMCI) guidelines of 2009 [3], [4]. These guidelines are used for management of illness in children aged 2–59 months in low and middle-income countries. The performance of RDT as an integrated tool in IMCI for improved childhood fever management in Africa and Zanzibar in particular has previously not been evaluated.
There are concerns regarding the usefulness of RDT, both with regards to case detection with differences in test performances in various epidemiological settings and to adherence to negative test results among health care workers [5], [6], [7], [8], [9]. However, we have previously shown that HRP2 based RDT aided diagnosis of fever patients in primary health care facilities in Zanzibar was efficient for P. falciparum detection when compared with blood smear (BS) microscopy with a sensitivity of 92% and a specificity of 88%; moreover, RDTs resulted in improved adequate treatment and health outcomes [10]. Importantly, the previous study was conducted when P. falciparum malaria was responsible for approximately 30% of febrile illness in primary health care facilities in Zanzibar [10], [11]. This is in marked contrast to the present situation, when overall <3% of fever patients have confirmed P. falciparum infection [12].
Based on the above, three critical scientific questions can be identified: Firstly, does HRP2 based RDT remain an efficient tool for P. falciparum detection in the new epidemiological context in Zanzibar? This should be evaluated not only against conventional BS microscopy but also against highly sensitive PCR as gold standard, considering that the relative importance of parasitemias below the detection limit of RDT/microscopy may increase in low transmission settings [13], [14], [15]. Secondly, is malaria RDT, as an integrated part of the recently adopted local version of the IMCI algorithm, a reliable tool to both identify and rule out malaria infection in children below five years of age? Thirdly, and importantly, do primary health care workers continue to adhere to RDT results when over 95% of the tests are negative and alternative diagnostic tools for fever management are scarce?
The aim of this study was therefore to evaluate the usefulness of HRP2 based RDT in the hands of primary health care workers, including its performance within the local version of the IMCI algorithm, for P. falciparum case detection, and adherence to test results among fever patients in the new epidemiological context of low malaria transmission in Zanzibar.
Methods
Study Design, Area and Sites
This work was a health facility based observational study conducted in twelve primary health care facilities, six each in North A (Unguja Island) and Micheweni (Pemba Island) districts of Zanzibar, between May and July 2010. None of these health facilities were part of our previous RDT study from Zanzibar [10]. The two study districts are mainly rural with approximately 100,000 inhabitants each. P. falciparum is the predominant malaria species and Anopheles gambiae complex the main vector. Malaria transmission has historically been stable with peaks related to the seasonal rainfalls in March to May and October to December. Following a successful malaria control programme the BS/RDT positivity rate among fever patients has markedly declined during the last decade in Zanzibar to reach 0.6% and 2.2%, respectively, in North A and Micheweni districts in 2009 [12].
Public health care in the study area is delivered through twelve primary health care units (PHCU) and one primary health care centre (PHCC) per district. The PHCUs provide basic out-patient care including malaria RDT for fever management, whereas the PHCCs in addition to basic out-patient care also have facilities for in-patient care and laboratory services, e.g. routine use of microscopy for confirmatory malaria diagnosis.
The twelve study sites were purposely selected, i.e. one PHCC and five PHCU from each district. This was done to ensure an adequate manpower capacity, with at least two health workers available per study site during the conduct of the trial, and to provide a balanced geographical distribution of the study sites in the respective districts.
Study Staff and Pre-study Training
A total of 33 nurses and clinical officers with formal prescription rights from Zanzibar Ministry of Health were responsible for the outpatient care in the twelve study sites. All study staff members were previously trained in malaria case management by the Zanzibar Malaria Control Programme (ZMCP). Based on previous IMCI training, the health workers received either a six-day refresher course or an eleven-day full course on the recently adopted IMCI guidelines in Zanzibar in which malaria RDT has been integrated in the algorithm [3]. In addition to the IMCI training and prior to the study start, all study staff members also received a one-week study specific training including good clinical practice, ethical considerations and provision of informed consent, data recording in case record forms (CRF), blood sampling for BS and filter papers as well as performance and interpretation of RDT (Paracheck Pf®) according to the manufacturer’s instructions. During the pre-study training the study staff members were encouraged to adhere to the IMCI guidelines for management of children below five years of age and the national malaria guidelines, which recommend anti-malarial medicines to be prescribed based on laboratory confirmation of malaria [2]. However, they were free to manage patients according to their own clinical judgement during the conduct of the trial. Prior to the first enrolment a pilot study with “dummy runs” was conducted in all participating study sites.
All health workers received a fixed monthly salary as top ups for their study participation according to standard practice in Zanzibar, whereas study participants did not receive any incentives.
Patient Enrolment and Management
Patients were eligible if aged ≥2 months and presenting at the study sites with fever, i.e. measured axillary temperature of ≥37.5°C or a history of fever during the preceding 24 hours, and willing to provide written informed consent (proxy consent from parents/guardians for children) to participate in the study. Patients were excluded and referred in case of any symptoms of severe disease or danger signs. Patients were recruited Monday to Friday between eight am to four pm by the study health worker on duty in the respective study sites. Children aged 2–59 months, hereafter referred to as “<5 years”, were managed according to the local IMCI guidelines. The study included a single visit for each participant.
Upon enrolment a sealed envelope was opened containing a study reference number and information on whether the individual had been randomly selected for additional blood sampling (see below). This was followed by a capillary finger prick for performance of RDT. All RDT positive patients and a pre-defined computer generated random sample (www.randomization.com) of 20% of all study participants were subjected to additional capillary blood sampling for malaria microscopy (thick BS) and PCR (approximately100 µL spotted on a Whatmann 3 MM filter paper).
Basic demographical data, axillary temperature (measured with a digital thermometer), history of fever in the preceding 24 hours, other symptoms, previous anti-malarial treatment (in case of pregnancy use of intermittent presumptive treatment (IPTp)), whether the patient slept under an insecticide treated nets/long lasting insecticidal nets (ITN/LLIN) the night before study enrolment and travel history (defined as having spent at least one night outside the home Shehia, i.e. the smallest administrative unit in Zanzibar, in the last 28 days) were recorded in a CRF together with information on RDT-result and clinical management.
The RDT results were provided directly to the patients by the study staff. Anti-malarial medicines according to national guidelines, i.e. artesunate-amodiaquine (first-line) or oral quinine (second-line), antibiotics (cotrimoxazole, ampicillin, amoxicillin or erythromycin) and antipyretics (e.g. paracetamol) were available free of charge to all study participants. Patients and guardians were encouraged to return if the clinical condition deteriorated or if the fever persisted.
In case malaria parasitemia was first detected by first BS microscopy reading and missed by RDT diagnostic (see below), the result was reported to the health facility and the patient was traced and offered treatment if he/she did not receive anti-malarial medicines at the time of the study visit.
All CRFs were collected by trained health staff at the end of each day and stored centrally in Zanzibar. During the conduct of the study, no results were disclosed to the health workers. However, after study completion, preliminary results were disseminated to all health workers in both districts.
Laboratory Methods
RDT
We used Paracheck Pf (Orchid Biomedical Systems, Goa, India) detecting P. falciparum specific HRP2 antigen, which by the time of trial was the RDT device deployed by ZMCP. The tests were performed and interpreted according to the manufacturer’s instructions. Very faint bands at the test line position were to be assessed as a positive test result. Band intensity was not recorded.
Blood smear microscopy
BS were prepared on site, stored in slide boxes and transported daily to the district central level, where all slides were stained with 5% Giemsa for 30 minutes and examined under oil immersion (×100 magnification) by two independent and experienced microscopists blinded to both the RDT and each other’s microscopy result [16]. Asexual parasite densities were calculated against 200 white blood cells (WBC), assuming 8,000 WBC per microliter of blood. BS were defined negative if no parasites were found after examining 100 high power microscopy fields. BS with discordant results between the two readers, i.e. positive versus negative, difference in species diagnosis or a difference of >50% in parasite density, were re-examined by a third expert microscopist at Karolinska Institutet, Stockholm, Sweden. The mean of the two most concordant parasite counts were used for calculating the final parasite density [17]. Moreover, all BS from patients with discrepancies between RDT and PCR results, RDT and BS results or PCR and BS results were subjected to a third decisive microscopy reading at Karolinska Institutet.
Filter paper
The blood samples (approximately 100 µL) collected on filter papers (Whatmann 3 MM) were dried thoroughly, put in individual zipped plastic bags containing desiccant and stored in room temperature (<25°C) in Zanzibar until completion of the study and then transported to Karolinska Institutet for molecular analyses.
DNA extraction
DNA was extracted from three filter paper punches (Ø 3 mm) using a modified version of the ABI 6100 Nucleic Acid Prep Station protocol (Applied Biosystems, Fresno, CA) [18]. In samples with discrepancies between RDT and PCR results, DNA was re-extracted from the filter papers using Chelex-100 [19].
DNA extraction quality control
The presence of human DNA was analysed by real-time PCR in case of PCR-negative results in RDT positive samples [20].
Parasite detection by PCR
For the purpose of an ongoing genotyping project all RDT positive samples were analysed with three previously described P. falciparum specific nested PCR methods targeting the four antimalarial drug resistance markers P. falciparum multidrug resistance gene 1 (pfmdr1) N86Y, Y184F, D1246Y and P. falciparum chloroquine resistance transporter gene (pfcrt) K76T [21], [22]. The RDT negative samples were screened in duplicate for human plasmodial infection with an 18s real-time PCR [23] Samples with a cycle threshold (Ct) value <42 were selected for species identification. Samples with discrepant RDT and PCR results were re-extracted and subjected to a confirmatory nested PCR analysis targeting Plasmodium cytochrome b [19]. PCR positivity was defined as a positive PCR result that could be validated by at least one other PCR method or by parasite detection by microscopy.
Analysis of P. falciparum HRP2 deletion
All samples with a negative RDT but a positive microscopy and/or PCR result were subjected to PCR analysis of HRP2 deletion according to a previously described protocol [24].
Adherence to RDT Results
Assessment of adherence to RDT results was done based on a comparison between the reported RDT outcome and prescription of anti-malarial drugs. Adherence was defined as prescription and absence of prescription of anti-malarial drug (first or second line) in RDT positive and negative patients, respectively.
Sample Size Calculation, Study Endpoints, Data Management and Statistical Analysis
The sample size calculation was based on the primary endpoint, i.e. adherence to malaria RDT results, with the assumption that approximately 10% of the RDT negative patients are prescribed ACT in Zanzibar [10]. The minimal sample size for independent observations would be 864 patients when requiring a maximum length of +/−2% for a 95% confidence interval (CI). Considering a potential clustering effect on health facility level we calculated that a sample of minimum 3054 patients would allow for an intra-cluster coefficient of slightly over 0.01 and still fulfil the given level of precision.
Secondary endpoints included sensitivity, specificity, positive and negative predictive values of HRP2 based RDT for P. falciparum detection compared with both PCR and BS microscopy; performance of malaria RDT as an integrated part of the local IMCI algorithm in Zanzibar (assessed as a sub-group analysis of sensitivity, specificity, positive and negative predictive values in children aged <5 years compared with other age groups); and antibiotic and antipyretic treatment across age-groups, i.e. <5, 5–14 and >14 years, among RDT positive and negative patients.
Data were double entered in CSPro, validated using Microsoft Excel and subsequently exported to STATA 12 software where all statistical analyses were performed. All frequencies, proportions and odds ratios (ORs) were calculated with 95% CIs and corresponding p-values, as appropriate. Adjustments for clustering on health facility level were done using mixed effect models.
To account for the fact that blood sampling for BS microscopy and PCR among RDT negative patients only included a random sample of 20%, we multiplied the absolute number of observations in these groups with a factors of 5.14 and 5.01 in all calculations of RDT sensitivity and specificity against PCR and microscopy, respectively. The corresponding confidence intervals were, however, based on the true sample size. Statistical significances were stated at the 5% level.
Ethical Considerations
The study was conducted in accordance with the principles stated in the latest version of the Declaration of Helsinki and Good Clinical Practice [25]. It was approved by the Zanzibar Medical Research Ethics Committee (ZAMREC) and the Regional Ethics Committee, Stockholm, Sweden. The study is registered on ClinicalTrials.gov with study identifier “NCT01002066”.
Results
The flow of patients through the trial is outlined in Figure 1 and baseline characteristics of the RDT positive and negative groups are presented in Table 1. Among the 3890 patients enrolled one was excluded due to an inconclusive RDT result. Overall 121/3889 (3.1%) patients were RDT positive. The highest RDT positivity rate, i.e. 32/528 (6.1%), was found in children aged 5–14 years. There was an uneven distribution of RDT positivity rates between the two districts, i.e. North A 42/2225 (1.9%) and Micheweni 79/1665 (4.7%), and also between their respective study sites with 53 (67.1%) of all RDT positive patients in Micheweni district reported from Tumbe PHCU only. RDT positivity was statistically significantly associated with absence of ITN/LLIN use [OR 4.78 (95% CI 3.24–7.02)] and history of travel within the last 28 days [OR 3.27 (95% CI 2.05–5.07)] (Table 1).
Figure 1. Study flow chart.
(BS = blood smear, FP = filter paper, PCR = polymerase chain reaction.).
Table 1. Baseline characteristics.
| RDT + | RDT − | Total (N) | ||
| District | North A | 42 (34.7%) | 2182 (57.9%) | 2224 |
| Micheweni | 79 (65.3%) | 1586 (42.1%) | 1665 | |
| Age | 5 y | 36 (29.8%) | 1786 (47.4%) | 1822 |
| 5–14 y | 32 (26.4%) | 496 (13.2%) | 528 | |
| >14 y | 53 (43.8%) | 1472 (39.1%) | 1525 | |
| Data missing | 0 | 14 (0.3%) | 14 | |
| Sex | Male | 65 (53.7%) | 1611 (42.8%) | 1676 |
| Female | 56 (46.3%) | 2156 (57.2%) | 2212 | |
| Data missing | 0 | 2 (100%) | 2 | |
| Pregnancy | 3 (2.5%) | 87 (2.3%) | 90 | |
| RDT + | RDT − | P-value | ||
| Mean axillary temp.°C | 38.3 | 37.4 | <0.001 | |
| Proportion withaxillary temp. ≥37.5°C | 74 (66.7%) | 1465 (41.5%) | <0.001 | |
| Data missing | 10 (8.3%) | 240 (6.4%) | 0.350 | |
| ITN/LLIN use | 65 (53.7%) | 3193 (84.7%) | <0.001 | |
| Travel history | ≤28 days | 30 (24.8%) | 356 (9.5%) | <0.001 |
| Domestic | 21 (17.4%) | 325 (8.6%) | 0.003 | |
| Abroad | 9 (7.4%) | 31 (0.8%) | <0.001 |
Domestic = History of travel within Zanzibar.
Abroad = History of travel outside Zanzibar.
ITN = Insecticide-treated nets.
LLIN = long-lasting insecticidal nets.
The distribution of positive RDT, PCR and BS results as well as microscopy determined parasite densities across age groups are shown in Table 2.
Table 2. Distribution of P. falciparum positive rapid diagnostic test (RDT), polymerase chain reaction (PCR) and blood smear (BS) microscopy results as well as microscopy determined parasite density across age groups.
| Age groups | Total | |||
| <5 y n = 1822 | 5–14 y n = 528* | >14 y n = 1525* | ||
| RDT + | 36 (2.0%) | 32 (6.1%) | 53 (3.5%) | 121 |
| PCR + | 34 (1.9%) | 34 (6.4%) | 56 (3.7%) | 124 |
| BS + | 31 (1.7%) | 33 (6.3%) | 52 (3.4%) | 116 |
| Geometric mean parasite density/µL (range) | 13815 (50–597,500) | 14172 (12–782,400) | 3739 (6–184,500) | |
Data on specific age categories (5–14 y and >14 y) were missing from14 patients.
The RDT sensitivity, specificity, positive and negative predictive values against PCR and BS microscopy are presented in Table 3. There was no significant difference in RDT performance in children aged <5 years, i.e. tested and managed within the IMCI algorithm, and other age groups (data not shown).
Table 3. Rapid diagnostic test (RDT) sensitivity, specificity, positive and negative predictive value against polymerase chain reaction (PCR) and blood smear (BS) microscopy.
| PCR + | PCR – | Total | BS+ | BS− | Total | |
| RDT + | 117 | 4 | 121 | 110 | 11 | 121 |
| RDT – | 7* | 726* | 733 | 6** | 733** | 739 |
| Total | 124 | 730 | 854 | 116 | 744 | 860 |
| Sensitivity | 76.5% (95% CI 69.0– 83.9%) | 78.6% (95% CI 70.8–85.1) | ||||
| Specificity | 99.9% (95% CI 99.7– 100%) | 99.7% (95% CI 99.5–99.9%) | ||||
| Positive predictive value | 96.7% (95% CI 91.8– 99.1%) | 91.7% (95% CI 84.3–95.4%) | ||||
| Negative predictive value | 99.0% (95% CI 98.0– 99.6%) | 99.2% (95% CI 98.8–99.5%) | ||||
For calculations of sensitivity and specificity the absolute numbers in the RDT negative group were multiplied with a factor of 5.14 to account for that only a sub-sample, i.e. 733 of 3768, in this group were subjected to blood sampling on filter paper for PCR.
For calculations of sensitivity and specificity the absolute numbers in the RDT negative group were multiplied with a factor of 5.01 to account for that only a sub-sample, i.e. 739 of 3768, in this group were subjected to blood sampling for BS microscopy.
There were four and eleven RDT positive patients with negative PCR and BS results, respectively. Importantly seven patients had both positive RDT and PCR verified P. falciparum infection, but BS microscopy could not detect parasitemia. Some, 6/739 (0.8%) RDT negative patients had detectable parasitemia by BS microscopy; all but one aged ≥5 years, of whom three were from Tumbe PHCU (Micheweni). Four of these six patients had high parasite densities, i.e. 3573, 14420, 25779, 50190 parasites/µL, respectively, whereas the remaining two had low parasite counts of ten and 50 parasites/µL each. All six were also positive by PCR, five for P. falciparum and one for P. malariae. The P. malariae PCR positive sample had a low parasite density of ten parasites/µL, as determined by BS microscopy, i.e. insufficient to allow accurate species identification. Further PCR analysis could not detect P. falciparum HRP2 deletions in any of these samples. Four of the RDT negative patients had a positive first BS microscopy reading. They were all successfully traced at home and received treatment with artesunate-amodiaquine. None had developed symptoms/signs of severe malaria between day of study visit and time of active follow-up.
Prescription of anti-malarial medicines, antibiotics and antipyretics by RDT result and age group are shown in Table 4. All 121 RDT positive, but only 3/3768 (0.1%) of RDT negative patients, all aged >14 years, were prescribed anti-malarial medicines. Overall adherence to RDT results was thus 3886/3889 (99.9%). Among the 124 patients that were prescribed anti-malarial medicines, 119 (96.0%) received artesunate-amodiaquine, four (3.2%) quinine and the remaining one (0.8%) a combination of artesunate-amodiaquine and quinine.
Table 4. Prescription of anti-malarial medicines, antibiotics and antipyretics by rapid diagnostic test (RDT) result and age group.
| Prescription | Age | RDT + | RDT − | P-value |
| Anti-malarial medicines | <5 y | 36/36 (100%) | 0/1786 (0%) | <0.001 |
| 5–14 y | 32/32 (100%) | 0/496* (0%) | <0.001 | |
| >14 y | 53/53 (100%) | 3/1472* (0.2%) | <0.001 | |
| Antibiotics | <5 y | 20/36 (55.6%) | 1032/1786 (57.8%) | >0.999 |
| 5–14 y | 8/32 (25.0%) | 341/496* (68.8%) | <0.001 | |
| >14 y | 6/53 (11.3%) | 804/1472* (54.6%) | <0.001 | |
| Antipyretics | <5 y | 14/36 (38.9%) | 437/1786 (24.5%) | 0.053 |
| 5–14 y | 19/32 (59.4%) | 278/496* (56.0%) | 0.855 | |
| >14 y | 34/53 (64.2%) | 894/1472* (60.7%) | 0.669 |
Data on specific age categories (5–14 y and >14 y) were missing from14 patients.
Antibiotics were prescribed to a total of 2218/3889 (57.0%) patients, of whom 24 (1.1%) received prescription of more than one antibiotic. Some 1338 (60.3%) received cotrimoxazole, 573 (25.8%) ampicillin/amoxicillin, 288 (13.0%) penicillin, 33 (1.5%) erythromycin, 29 (1.3%) metronidazole and 18 (0.8%) ciprofloxacin, respectively. RDT negative patients were overall statistically significantly more likely to receive antibiotics than RDT positive [OR 3.25 (95% CI 2.15–5.01)]. However, among children <5 years of age the rate of antibiotic prescription was similar between the groups, i.e. 57% and 58% in the RDT negative and RDT positive group, respectively. Among RDT positive patients, no statistically significant difference between children<5 years and patients aged ≥5 years was observed [OR 1.36 (95% CI 0.77–2.30)].”
Antipyretics were prescribed to 1689/3889 (43.4%) patients of whom 1558 (92.2%) received paracetamol and the remaining 122 (7.2%) non-steroidal anti-inflammatory drugs including acetylsalicylic acid. There was a balanced distribution of antipyretic prescription between the RDT positive and RDT negative group. However, children <5 years were overall statistically significantly less likely to receive antipyretics than patients aged ≥5 years [OR 0.22 (95% CI 0.19–0.26)].
Discussion
The rapid transition from high to low malaria transmission recently observed in various areas of sub-Saharan Africa, including Zanzibar, constitutes a major challenge to ensure sustained high parasite-based P. falciparum diagnostic accuracy with malaria RDT among fever patients and high adherence to RDT results among health care workers. This is critical for safe and rational fever case management, including targeted ACT treatment to patients with confirmed malaria infection. The present study was therefore undertaken to assess if HRP2 based RDT remains an efficient tool for P. falciparum case detection among fever patients in Zanzibar, not only against BS microscopy but also against highly sensitive PCR, and if primary health care workers continue to adhere to RDT results in the new epidemiological context of low malaria transmission. Further, we scientifically evaluated, for the first time in Africa, the performance of RDT as an integrated part of the newly adopted IMCI algorithm in Zanzibar.
The observed diagnostic accuracy of HRP2 based RDT (Paracheck-Pf) for P. falciparum detection in this study indicates a relatively low sensitivity but a high specificity when compared with both BS microscopy and PCR. Since our previous report from Zanzibar [10], conducted when P. falciparum malaria was responsible for approximately 30% of fever episodes, the sensitivity of RDT against BS microscopy declined from 92% to 79%, whereas the corresponding specificity increased from 88% to 99%. The latter may reflect an overall reduced risk of repetitive malaria infections and remaining antigenemia from a previous malaria episode in the new low transmission context in Zanzibar. However, the relatively low sensitivity of Paracheck-Pf, i.e. below the reported sensitivity for P. falciparum detection for this RDT device in the most recent WHO/FIND evaluation [26], is a concern especially since the fact that similar observations have been documented in other low transmission areas [14]. Even lower RDT sensitivities than we observed have been reported from other studies i.e. 65% against BS microscopy in Rufiji district of Tanzania [27] and 69% against PCR in two Tanzanian hospitals [8].
The relatively low sensitivity may be at least partly due to sub-optimal RDT performance of individual health care workers, considering that approximately half of all RDT negative but BS positive cases were reported from the same health facility. This calls for improved systems for RDT supervision and quality control in primary health care facilities, but also for more sensitive point-of-care malaria diagnostic tools. Other factors, unrelated to health care workers performance, such as presence of P. falciparum HRP2 deletions and sequence variation as well as the so called “prozone effect”, need to be considered as a potential cause of the relatively low RDT sensitivity, particularly since the HRP2 based RDT failed to detect four cases of relatively high P. falciparum density, i.e. 3573, 14420, 25779 and 50190 parasites/µL, respectively [24], [28], [29]. Importantly, we did not detect any case of P. falciparum HRP2 deletions in these samples, which is in contrast to observation from Mali in West Africa [30]. However, HRP2 sequence variation was not analysed, since previous studies have not been able to link RDT sensitivity with sequence variation in clinical malaria infections with parasite densities ≥200 parasites/µL. Whether a prozone effect, defined as a false-negative result in an immunological reaction due to an excess of either antigens or antibodies, occurred in any of our samples could not be assessed retrospectively since blood was not available for serial dilution. Of note is though that the prozone phenomenon has previously been described primarily in patients with P. falciparum hyperparasitemia (≥250,000 parasites/µL) [31].
This study confirms our previous observations from Zanzibar of an excellent adherence to RDT results among primary health workers [10]. It is indeed reassuring that health care workers in Zanzibar continue to rely on RDT results in a context where overall 97 out of 100 tests are negative and scarce tests facilities for diagnosing alternative causes of fever causes are available. With our results in mind and considering the contradictory reports of adherence to RDT results from various levels of health care and epidemiological settings in sub-Saharan Africa [5], [6], [8], [32], we have conducted a qualitative pilot study to explore context specific determinants of RDT perception among health care workers in Zanzibar in order to improve the understanding of factors influencing adherence to RDTs [33]. However, it should be acknowledged that the health care workers enrolled in our study all received a relatively extensive pre-study training. Moreover, they are all working in an area where other malaria research activities have been conducted in recent years. These factors may have contributed to the high adherence to RDT results, which may not necessarily be representative for the general primary health care worker in Zanzibar.
The incorporation of malaria RDT in IMCI provides an opportunity for improved childhood fever case management in Africa. This study is, to our knowledge, the first scientific evidence from sub-Saharan Africa that RDT can be reliably integrated in IMCI. There was neither any difference in RDT performance nor in adherence to RDT test results in children <5 years of age compared with other age groups. The ability of HRP2 based RDT to reliably rule out malaria infection in a low transmission setting is critical. However, to ensure a sustainable adherence to particularly RDT negative results, health care workers need to be trained and equipped with tools for improved management of non-malarial fevers. A prerequisite for such improved non-malarial fever management is to study the etiology of acute uncomplicated fevers in rural settings of Zanzibar. Such studies, which are ongoing, will in addition provide data on antibiotic requiring bacterial infections among fever patients in Zanzibar. This is critical, since the observed antibiotic prescription rate of 55–65% among RDT negative patients in all age groups as well as RDT positive children <5 years of age (in the form of dual treatment with ACT) probably represents a substantial overuse, which may fuel development and spread of antibiotic resistance.
Our observation of low P. falciparum parasite prevalence among fever patients in Zanzibar is coherent with official programmatic data [12]. Interestingly, the highest RDT positivity rate was found in children aged 5–14 years, not in children <5 years. Furthermore, there was an apparent uneven spatial distribution of RDT positivity rate both within and between the study districts. These changing malaria epidemiological patterns, together with the association between the risk of RDT positivity and absence of ITN/LLIN use as well as travel history, need to be considered in future malaria control activities in Zanzibar.
In summary, the sensitivity of HRP-2 based RDT in the hands of primary health care workers compared with both PCR and microscopy for P. falciparum case detection was relatively low, whereas adherence to test results with anti-malarial treatment was excellent. Moreover, the results provide evidence that RDT can be reliably integrated in IMCI as a tool for improved childhood fever management. However, the overall relatively low RDT sensitivity highlights the need for improved quality control of RDT use in primary health care facilities, but also for more sensitive point-of-care malaria diagnostic tools in the new epidemiological context of low malaria transmission in Zanzibar.
Acknowledgments
We thank all participants and guardians of children as well as the health facility workers in North A and Micheweni district, Zanzibar, for their dedicated participation in this study. We also like to thank Louise Jörnhagen for assisting with PCR analyses. Parts of this manuscript, including preliminary results, were presented as posters at the 7th European Congress on Tropical Medicine and International Health, Barcelona, Spain, and at the American Society of Tropical Medicine and Hygiene 61st Annual meeting in Atlanta, USA.
Funding Statement
This study was funded by the ACT Consortium through an award from the Bill and Melinda Gates Foundation to the London School of Hygiene and Tropical Medicine, and by the Swedish International Development Cooperation Agency (Sida), Swedish Civil Contingencies Agency (MSB) and Goljes Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Bhattarai A, Ali AS, Kachur SP, Martensson A, Abbas AK, et al. (2007) Impact of artemisinin-based combination therapy and insecticide-treated nets on malaria burden in Zanzibar. PLoS medicine 4: e309. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.ZMCP (2009) National Guidelines for Malaria Diagnosis and Treatment in Zanzibar.
- 3.WHO and United Nations Children Fund (2008) Integrated Management of Childhood Illnesses. Available: http://whqlibdoc.who.int/publications/2008/9789241597289_eng.pdf. Accessed 2013 Jul 24.
- 4.Zanzibar Ministry of Health Z (2010) Annual Health Information Bulletin. Available: http://41.73.201.42/documents/bulletin2010_final.pdf. Accessed 2013 Jul 24.
- 5. Abeku TA, Kristan M, Jones C, Beard J, Mueller DH, et al. (2008) Determinants of the accuracy of rapid diagnostic tests in malaria case management: evidence from low and moderate transmission settings in the East African highlands. Malaria journal 7: 202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Bisoffi Z, Sirima BS, Angheben A, Lodesani C, Gobbi F, et al. (2009) Rapid malaria diagnostic tests vs. clinical management of malaria in rural Burkina Faso: safety and effect on clinical decisions. A randomized trial. Tropical medicine & international health : TM & IH 14: 491–498. [DOI] [PubMed] [Google Scholar]
- 7. Chinkhumba J, Skarbinski J, Chilima B, Campbell C, Ewing V, et al. (2010) Comparative field performance and adherence to test results of four malaria rapid diagnostic tests among febrile patients more than five years of age in Blantyre, Malawi. Malaria journal 9: 209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Nicastri E, Bevilacqua N, Sane Schepisi M, Paglia MG, Meschi S, et al. (2009) Accuracy of malaria diagnosis by microscopy, rapid diagnostic test, and PCR methods and evidence of antimalarial overprescription in non-severe febrile patients in two Tanzanian hospitals. The American journal of tropical medicine and hygiene 80: 712–717. [PubMed] [Google Scholar]
- 9. Thiam S, Thior M, Faye B, Ndiop M, Diouf ML, et al. (2011) Major reduction in anti-malarial drug consumption in Senegal after nation-wide introduction of malaria rapid diagnostic tests. PloS one 6: e18419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Msellem MI, Martensson A, Rotllant G, Bhattarai A, Stromberg J, et al. (2009) Influence of rapid malaria diagnostic tests on treatment and health outcome in fever patients, Zanzibar: a crossover validation study. PLoS medicine 6: e1000070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Martensson A, Stromberg J, Sisowath C, Msellem MI, Gil JP, et al. (2005) Efficacy of artesunate plus amodiaquine versus that of artemether-lumefantrine for the treatment of uncomplicated childhood Plasmodium falciparum malaria in Zanzibar, Tanzania. Clinical infectious diseases : an official publication of the Infectious Diseases Society of America 41: 1079–1086. [DOI] [PubMed] [Google Scholar]
- 12.ZMCP (2010) Early epidemic detection system. Biannual report, year-end 2009 Vol.1, no.2. Zanzibar. Available: http://zmcp.go.tz/docs/surveillance-report2_14apr1.pdf. Accessed 2013 Jul 24.
- 13. Manjurano A, Okell L, Lukindo T, Reyburn H, Olomi R, et al. (2011) Association of sub-microscopic malaria parasite carriage with transmission intensity in north-eastern Tanzania. Malaria journal 10: 370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. McMorrow ML, Aidoo M, Kachur SP (2011) Malaria rapid diagnostic tests in elimination settings–can they find the last parasite? Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases 17: 1624–1631. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Okell LC, Bousema T, Griffin JT, Ouedraogo AL, Ghani AC, et al. (2012) Factors determining the occurrence of submicroscopic malaria infections and their relevance for control. Nature communications 3: 1237. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.WHO (1991) Basic Malaria Microscopy (part I and II). Geneva. Available: http://helid.digicollection.org/en/d/Jwho02e/. Accessed 2013 Jul 24.
- 17.WHO (2003) Assessment and monitoring of anti-malarial drug efficiacy for the treatment of uncomplicated falciparum malaria. Available: http://whqlibdoc.who.int/hq/2003/WHO_HTM_RBM_2003.50.pdf. Accessed 2013 Jul 24.
- 18. Dahlstrom S, Veiga MI, Ferreira P, Martensson A, Kaneko A, et al. (2008) Diversity of the sarco/endoplasmic reticulum Ca(2+)-ATPase orthologue of Plasmodium falciparum (PfATP6). Infection, genetics and evolution : journal of molecular epidemiology and evolutionary genetics in infectious diseases 8: 340–345. [DOI] [PubMed] [Google Scholar]
- 19. Hsiang MS, Lin M, Dokomajilar C, Kemere J, Pilcher CD, et al. (2010) PCR-based pooling of dried blood spots for detection of malaria parasites: optimization and application to a cohort of Ugandan children. Journal of clinical microbiology 48: 3539–3543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Beshir KB, Hallett RL, Eziefula AC, Bailey R, Watson J, et al. (2010) Measuring the efficacy of anti-malarial drugs in vivo: quantitative PCR measurement of parasite clearance. Malaria journal 9: 312. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Holmgren G, Hamrin J, Svard J, Martensson A, Gil JP, et al. (2007) Selection of pfmdr1 mutations after amodiaquine monotherapy and amodiaquine plus artemisinin combination therapy in East Africa. Infection, genetics and evolution : journal of molecular epidemiology and evolutionary genetics in infectious diseases 7: 562–569. [DOI] [PubMed] [Google Scholar]
- 22. Veiga MI, Ferreira PE, Bjorkman A, Gil JP (2006) Multiplex PCR-RFLP methods for pfcrt, pfmdr1 and pfdhfr mutations in Plasmodium falciparum. Molecular and cellular probes 20: 100–104. [DOI] [PubMed] [Google Scholar]
- 23. Shokoples SE, Ndao M, Kowalewska-Grochowska K, Yanow SK (2009) Multiplexed real-time PCR assay for discrimination of Plasmodium species with improved sensitivity for mixed infections. Journal of clinical microbiology 47: 975–980. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Baker J, McCarthy J, Gatton M, Kyle DE, Belizario V, et al. (2005) Genetic diversity of Plasmodium falciparum histidine-rich protein 2 (PfHRP2) and its effect on the performance of PfHRP2-based rapid diagnostic tests. The Journal of infectious diseases 192: 870–877. [DOI] [PubMed] [Google Scholar]
- 25.Helsinki WMADo (2008; ICH-GCP, 1996) Ethical Principles for Medical Research Involving Human Subjects.
- 26.WHO-FIND (2012) Malaria Rapid Diagnostic Test Performance. Summary results of WHO product testing of malaria RDT:s Round 4 (2012). Available: http://www.finddiagnostics.org/export/sites/default/resource-centre/reports_brochures/docs/RDTMalariaRd4_Web3.pdf. Accessed 2013 Jul 24.
- 27. McMorrow ML, Masanja MI, Abdulla SM, Kahigwa E, Kachur SP (2008) Challenges in routine implementation and quality control of rapid diagnostic tests for malaria–Rufiji District, Tanzania. The American journal of tropical medicine and hygiene 79: 385–390. [PMC free article] [PubMed] [Google Scholar]
- 28. Gillet P, Mori M, Van Esbroeck M, Van den Ende J, Jacobs J (2009) Assessment of the prozone effect in malaria rapid diagnostic tests. Malaria journal 8: 271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Gillet P, Scheirlinck A, Stokx J, De Weggheleire A, Chauque HS, et al. (2011) Prozone in malaria rapid diagnostics tests: how many cases are missed? Malaria journal 10: 166. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Koita OA, Doumbo OK, Ouattara A, Tall LK, Konare A, et al. (2012) False-negative rapid diagnostic tests for malaria and deletion of the histidine-rich repeat region of the hrp2 gene. The American journal of tropical medicine and hygiene 86: 194–198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Baker J, Ho MF, Pelecanos A, Gatton M, Chen N, et al. (2010) Global sequence variation in the histidine-rich proteins 2 and 3 of Plasmodium falciparum: implications for the performance of malaria rapid diagnostic tests. Malaria journal 9: 129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Reyburn H, Mbakilwa H, Mwangi R, Mwerinde O, Olomi R, et al. (2007) Rapid diagnostic tests compared with malaria microscopy for guiding outpatient treatment of febrile illness in Tanzania: randomised trial. BMJ 334: 403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Baltzell K, Elfving K, Shakely D, Ali AS, Msellem M, et al. (2013) Febrile illness management in children under five years of age: a qualitative pilot study on primary health care workers’ practices in Zanzibar. Malaria journal 12: 37. [DOI] [PMC free article] [PubMed] [Google Scholar]