Significance
Vector interventions are needed for Aedes-borne viral (ABV) disease prevention (dengue, Zika, chikungunya, and yellow fever), but their application is hindered by the lack of evidence proving they prevent infection or disease. We report conclusive statistical evidence from a pre-planned, prospective cluster-randomized, controlled clinical trial (cRCT) of protective efficacy (34.1% hazard estimate) against human ABV infection by a spatial repellent; a chemical-based intervention category currently under World Health Organization review. Results from our ABV study will help guide public health authorities responsible for operational management and worldwide ABV disease control and incentivize new strategies for disease prevention.
Keywords: vector control, Aedes aegypti, spatial repellent, arbovirus vector, clinical trial
Abstract
Over half the world’s population is at risk for viruses transmitted by Aedes mosquitoes, such as dengue and Zika. The primary vector, Aedes aegypti, thrives in urban environments. Despite decades of effort, cases and geographic range of Aedes-borne viruses (ABVs) continue to expand. Rigorously proven vector control interventions that measure protective efficacy against ABV diseases are limited to Wolbachia in a single trial in Indonesia and do not include any chemical intervention. Spatial repellents, a new option for efficient deployment, are designed to decrease human exposure to ABVs by releasing active ingredients into the air that disrupt mosquito–human contact. A parallel, cluster-randomized controlled trial was conducted in Iquitos, Peru, to quantify the impact of a transfluthrin-based spatial repellent on human ABV infection. From 2,907 households across 26 clusters (13 per arm), 1,578 participants were assessed for seroconversion (primary endpoint) by survival analysis. Incidence of acute disease was calculated among 16,683 participants (secondary endpoint). Adult mosquito collections were conducted to compare Ae. aegypti abundance, blood-fed rate, and parity status through mixed-effect difference-in-difference analyses. The spatial repellent significantly reduced ABV infection by 34.1% (one-sided 95% CI lower limit, 6.9%; one-sided P value = 0.0236, z = 1.98). Aedes aegypti abundance and blood-fed rates were significantly reduced by 28.6 (95% CI 24.1%, ∞); z = −9.11) and 12.4% (95% CI 4.2%, ∞); z = −2.43), respectively. Our trial provides conclusive statistical evidence from an appropriately powered, preplanned cluster-randomized controlled clinical trial of the impact of a chemical intervention, in this case a spatial repellent, to reduce the risk of ABV transmission compared to a placebo.
Aedes-borne viral diseases (ABVDs) [e.g., dengue (DENV), chikungunya, Zika (ZIKV), and yellow fever] are devastating, expanding global public health threats that disproportionally affect low- and middle-income countries. DENV, one of the most rapidly increasing vector-borne infectious diseases, results in ∼400 million infections each year (1, 2), with 4 billion people at risk for infection annually (3). Currently, the primary means for ABVD prevention is controlling the primary mosquito vector, Aedes aegypti. Existing vector control interventions, however, have failed to prevent ABV transmission and epidemics (4–6).
There is an urgent need to develop evidence-based guidance for the use of new and existing ABV vector control tools. The evidence base for vector control against ABVs is weak, despite considerable government investments in World Health Organization (WHO)-recommended control of larval habitats (larviciding, container removal) and ultra-low-volume insecticide spraying (4, 5, 7–9). These strategies continue to be implemented despite the lack of rigorously generated data from controlled clinical trials demonstrating they reduce ABV infection or disease (6). The only ABV intervention with a proven epidemiological impact in a cluster-randomized control trial (cRCT) assessed community mobilization to reduce mosquito larval habitats (10). A recent test-negative trial with Wolbachia-infected mosquitoes reported a significant reduction of DENV illness in Indonesia (11).
Spatial repellents (SRs) are devices that contain volatile active ingredients that disperse in air. The active ingredients can repel mosquitoes from entering a treated space, inhibit attraction to human host cues, or disrupt mosquito biting and blood-feeding behavior and, thus, interfere with mosquito–human contact (12–14). Any of these outcomes reduce the probability of pathogen transmission. Pyrethroid-based SRs have shown efficacy in reducing malaria infections in China (15) and Indonesia (16). There have, however, been no clinical trials evaluating the protective efficacy (PE) of SRs against ABV infection or disease.
To generate evidence for public health consideration, we conducted a double-blinded, parallel cRCT to demonstrate and quantify the PE of a transfluthrin-based SR to reduce ABV infection incidence over 2 y in a human cohort in Iquitos, Peru.
Results
We report results from the intervention phase of a cRCT, conducted in 26 clusters (13 per arm; see Methods and SI Appendix, section 1.2.1 for randomization scheme) and each with ∼140 households (60 qualifying participants), between Aug. 2016 and Mar. 2019 (Figs. 1 and 2 and SI Appendix, section 1.1).
The primary endpoint was ABV seroconversion, as measured by DENV- or ZIKV-specific neutralizing antibodies, in blood from children ≥2 to ≤18 y, collected just prior to the deployment of the SR intervention, and ∼1 and 2 y later. The SR intervention was a transfluthrin passive emanator placed in participating households according to manufacturer’s instructions: one product per 9 m2 and replaced at 15-d intervals (SI Appendix, Fig. S1 and section 1.3.2) during the 2-y (two-transmission seasons) study period. Secondary endpoints were clinically apparent laboratory-confirmed ABVD and indoor female Ae. aegypti abundance, blood-fed status (proxy for human-biting rates), and parity status (proxy for age structure). Participants followed for seroconversion were the “longitudinal cohort,” and those followed for disease were the “febrile surveillance cohort.”
Study Population.
A total of 2,215 persons were enrolled in the longitudinal cohort. Of these, 1,578 qualifying participants (individuals who were seronegative or had a monotypic DENV antibody response when they entered the trial) were included in the intent-to-treat (ITT) analysis for seroconversion (Fig. 3).
Samples were tested by microneutralization enzyme immunoassay (MNT) for seroconversion to each DENV serotype and ZIKV (SI Appendix, sections 1.3.3.1 and 1.3.4.1). Only participants who provided at least two blood samples were included in final analyses. We observed a total of 196 ABV infections from 754 (1,090 paired samples) qualifying participants in the SR arm and 294 ABV infections from 824 (1,237 paired samples) qualifying participants in the placebo arm. Baseline covariates were balanced at both the cluster and individual levels (Table 1).
Table 1.
Individual level | ||
---|---|---|
Variable | SR | Placebo |
(n = 898) | (n = 952) | |
Age in years (mean ± SD) | 10.88 ± 4.62 | 10.19 ± 4.39 |
(min, max) | (2, 47) | (2, 22) |
Sex (% male) | 51.6% | 55.0% |
Duration in years between samples (mean ± SD) | 1.15 ± 0.42 | 1.16 ± 0.43 |
(min, max) | (0.02, 2.29) | (0.01, 2.35) |
No. qualifying participant observations | 1,090 | 1,237 |
No. arbovirus seroconversions | 196 | 294 |
Cluster level | ||
---|---|---|
Variable | SR | Placebo |
(n = 13) | (n = 13) | |
Cluster population (mean ± SD) | 58.2 ± 30.4 | 73.5 ± 35.3 |
(min, max) | (21, 124) | (12, 132) |
Baseline susceptibility (mean ± SD) | 81.0 ± 12.8% | 84.9 ± 6.3% |
(min, max) | (54.7, 98.1%) | (73.3, 92.5%) |
Qualifying participants were defined as individuals in a participating house that were seronegative or had a monotypic DENV antibody response when they entered the trial.
A total of 16,707 participants were followed for clinical disease in the febrile surveillance cohort through ∼3 wellness visits per week, of which 16,683 were included in the ITT analysis (SI Appendix, Fig. S2). Suspected acute ABV cases that provided consent provided acute and convalescent blood samples and were monitored clinically daily. Acute serum samples were tested for viral RNA by PCR (DENV and ZIKV; SI Appendix, sections 1.3.3.2–1.3.3.4) and by enzyme-linked immunosorbant assay (ELISA) for DENV immunoglobulin M (IgM) (SI Appendix, sections 1.3.3.5 and 1.3.4.2) to quantify the secondary endpoint of clinically apparent laboratory confirmation cases of ABVD. Baseline covariates from the febrile surveillance cohort were balanced at both the cluster and individual levels (SI Appendix, Table S4).
Intervention Coverage.
The household participation rate (intervention deployed at some point during the study period) per cluster (SR and placebo) was 56.6% (SD = 10.5%), with slightly more participation in SR than in placebo clusters (58.8 vs 54.5%, P value = 0.336). In households consenting to receive intervention (SR or placebo), the mean percentage of days covered by an intervention at the cluster level was 81.6% (SD = 3.9), with slightly higher coverage in households assigned to SR intervention (82.9%) compared to households in the placebo arm (80.3%), albeit insignificant (P value = 0.153; SI Appendix, Table S2 and Fig. S3). For all enrolled households, the mean percentage of days with an adequate intervention application rate (one product per 9 m2) was 73.6% (SD = 9.1), with similar rates between SR and placebo clusters (72.7 vs 74.5%, P value > 0.999; SI Appendix, Table S2).
SR Efficacy.
We used survival analysis with proportional hazards model with an exponential distribution assumption for baseline hazard to estimate a PE (SI Appendix, section 1.5.2.1). The estimated PE of the SR intervention was 34.1% (one-sided 95% CI lower limit, 6.9%) (Table 2). Reduction in the arbovirus infection hazard rate was significant at the 5% significance level (test statistic: z = 1.98, one-sided P value = 0.02). Baseline covariates included in the statistical model on the hazard of arbovirus infection in qualifying participants were age—which had statistically significant effects on the hazard of arbovirus infection in qualifying participants—and sex, which did not. Reported age- and sex-specific hazard rate changes are conditional. Hazard rate increases by 4.6% for every 1-y increase in age. Hazard rate decreases by 4.4% in males relative to females (Table 2). The originally proposed ITT mixed-effects logistic regression analysis (SI Appendix, section 1.5.2.2), which ignores differential participation duration across qualifying participants, produced a result consistent with those presented here (i.e., PE >30% and statistical significance at the 5% level; Table 2).
Table 2.
ITT analysis | HR ratio | PE (%) | One-sided | Covariate | Odds ratio | Two-sided |
---|---|---|---|---|---|---|
(95% CI) | (95% CI) | P value | (95% CI) | P value | ||
Survival analysis | 0.659 | 34.1 | 0.024 | |||
(−∞, 0.931) | (6.9, ∞) | |||||
Age | 1.046 | 6.8 x 10−6 | ||||
(1.029 to 1.063) | ||||||
Male | 0.956 | 0.62 | ||||
(0.821 to 1.112) |
ITT analysis | Odds ratio | PE (%) | One-sided | Covariate | Odds ratio | Two-sided |
---|---|---|---|---|---|---|
(95% CI) | (95% CI) | P value | (95% CI) | P value | ||
Odds reduction | 0.547 | 45.3 | 0.019 | |||
(−∞, 0.883) | (11.7, ∞) | |||||
Age | 1.071 | 6.9 x 10−7 | ||||
(1.042 to 1.100) | ||||||
Male | 0.950 | 0.64 | ||||
(0.767 to 1.177) | ||||||
Odds reduction on including 9- to 15-mo sampling intervals | 0.577 | 42.3 | 0.016 | |||
(−∞, 0.879) | (12.1, ∞) | |||||
Age | 1.065 | 0.0005 | ||||
(1.028 to 1.103) | ||||||
Male | 0.970 | 0.779 | ||||
(0.767 to 1.299) |
The Kaplan-Meier curves of arbovirus infection for qualifying participants by cluster show considerable between-cluster variation (SR and placebo clusters), as evidenced by the wide spread of survival curves (Fig. 4).
For example, there were no arbovirus infections in qualifying participants in placebo cluster 7.2, which had only 18 qualifying participants. Conversely, of the 11 qualifying participants who had a duration of at least 15 mo between tests in cluster 8.2, a total of 5 subjects became infected since their last test. The duration between tests varied by participant and across clusters (SI Appendix, Fig. S4), resulting in some Kaplan-Meier curves being estimated beyond 2 y. In many of those clusters, the only participants that went over 2 y between blood sampling were universally found to have had an arboviral infection.
A Poisson generalized linear regression was used to assess intervention impact on clinical disease, with an offset for the number of participant days each participant spent in each cluster. No covariates were used, and due to the small sample size, no random effects were incorporated (SI Appendix, section 1.5.3). No statistical difference between incidence in the SR and placebo arms was detected. Baseline characteristics of covariates included in the analysis of PCR/ELISA confirmed DENV and ZIKV cases were balanced between SR and placebo arms (SI Appendix, Table S5). Results from an ITT fixed-effect Poisson generalized linear model indicate the rate ratio is 1.144, with an upper bound on the one-sided 95% CI of 1.601. This translates into a 14.4% increase in the rate of PCR/ELISA-confirmed arbovirus infections by SR intervention compared with placebo, with the lower bound of the one-sided 95% CI of –60.1%. This apparent increase in the intervention area was not statistically significant at the 5% level (test statistic: ), in part because only 96 disease cases were detected—51 in the SR arm and 45 in the placebo arm—during 10,793,792 participant days that appeared balanced between SR and placebo clusters (SI Appendix, Table S4 and section 2.5.2.1).
The estimated reduction in adult female Ae. aegypti abundance in clusters receiving SR intervention was 28.6% (one-sided 95% CI lower limit: 24.1%, test statistic: z = −9.11) using mixed-effects difference-in-difference (DID) Poisson regression with factor-level covariates (Table 3 and SI Appendix, section 1.5.4). Baseline mosquito abundance was balanced between treatment arms (SI Appendix, Table S5) with postbaseline quantities estimated based on 47,518 and 43,417 household collections in SR and placebo arms, respectively. Baseline abundance averaged 0.277 (SD 0.153) and 0.279 (SD 0.122) per house survey in SR and placebo arms, respectively, whereas postbaseline abundance averaged 0.276 (SD 0.091) and 0.391 (SD 0.142) in the SR and placebo arms, respectively (Table 3). There was strong indication of seasonality, with estimated z-scores of 6 or greater when comparing each month to the reference month of January (SI Appendix, Table S7). Overall, abundance trended lower in the SR clusters compared to the placebo clusters, after intervention deployment for the duration of the trial from 2017 to 2019 (Fig. 5).
Table 3.
Indicator | Statistics | 2016 baseline* | Cluster-specific baseline† | ||
---|---|---|---|---|---|
ITT | PP | ITT | PP | ||
Indoor adult female Ae. aegypti abundance | Rate ratio | 0.714 | 0.737 | 0·599 | 0.607 |
(95% one-sided CI) | (−∞, 0.759) | (−∞, 0.784) | (−∞, 0.633) | (−∞, 0.641) | |
Rate reduction (%) | 28.6 | 26.3 | 40.1 | 39.3 | |
(95% one-sided CI) | (24.1, ∞) | (16.2, ∞) | (36.7, ∞) | (35.9, ∞) | |
Blood-fed female Ae. aegypti abundance | Rate ratio | 0.876 | 0.876 | 0.908 | 0.929 |
(95% one-sided CI) | (−∞, 0.958) | (−∞, 0.958) | (−∞, 0.985) | (−∞, 1.06) | |
Rate reduction (%) | 12.4 | 12.4 | 9.20 | 7.10 | |
(95% one-sided CI) | (4.2, ∞) | (4.2, ∞) | (1.49, ∞) | (−6, ∞) | |
Ae. aegypti parity rate | Rate ratio | 0.922 | 0.921 | 0.928 | 0.909 |
(95% one-sided CI) | (−∞, 1.057) | (−∞, 1.056) | (−∞, 1.058) | (−∞, 0.986) | |
Rate reduction (%) | 7.75 | 7.87 | 7.24 | 9.10 | |
(95% one-sided CI) | (−5.70, ∞) | (−5.60, ∞) | (−5.80, ∞) | (−1.2, ∞) |
No correction for multiple testing was performed for secondary endpoint analyses, and, as such, in accordance with CONSORT guidelines, P values are not presented.
*ITT (primary analysis) and per protocol (PP, secondary analysis) mixed-effects DID Poisson regression specifying measurements made throughout 2016 as “baseline,” with post-2016 measurements as “postbaseline.” PP analysis only considering houses with SR application rates meeting manufactures specifications ≥75% of the days between sequential blood sampling (designated PP-1).
†ITT and PP mixed-effects DID Poisson regression specifying measurements made in 2016 up to the first date of intervention deployed in each cluster as “baseline,” with all measurements following that date as “postbaseline” for that cluster, even for houses that did not enroll until 2017 or later. PP analysis only considering houses with SR application rates meeting manufacturer’s specifications ≥75% of the days between sequential blood sampling (designated PP-1).
Postintervention entomological surveys indicate that this difference disappeared after removal of the intervention (SI Appendix, Fig. S8B).
The estimated reduction in the rate of blood-fed Ae. aegypti collected inside houses was 12.4% (one-sided 95% CI lower limit: 4.2%, test statistic: z = −2.430), also using mixed-effects DID Poisson regression (Table 3). Baseline abundance of engorged Ae. aegypti was balanced across treatment arms (SI Appendix, Table S5), with postbaseline quantities estimated based on 9,257 and 11,496 mosquitoes assessed for blood-fed status in SR and placebo arms, respectively. Baseline abundance of blood-fed mosquitoes averaged 0.593 (SD 0.440) and 0.536 (SD 0.451) per collection in SR and placebo arms, respectively. Postbaseline rates averaged 0.606 (SD 0.460) and 0.634 (SD 0.447) in SR and placebo arms, respectively. There was no strong indication of seasonality (SI Appendix, Table S8).
There was no observed intervention effect (Table 3) or indication of seasonality (SI Appendix, Table S9) based on the parity rate of Ae. aegypti females.
AEs and SAEs.
In total, 29 adverse events (AEs) were reported during the trial (SI Appendix, section 2.8). Of these, three were associated with blood draw (vasovagal response: two from SR and one from placebo clusters). The remaining 26 AEs reflected symptoms consistent with pyrethroid/transfluthrin exposure. Reporting of these AEs was higher in the SR clusters (22 of 8,235 subjects: 0.267%) than the placebo clusters (4 of 8,448 subjects: 0.047%). The relative risk of experiencing a mild AE due to the SR product was 5.6 (95% CI: 1.9 to 16, P = 0.0015). The 26 affected individuals (26 of 16,707 subjects; 0.155%) came from 18 households, often reporting different combinations of the following symptoms: allergic response with itching and skin irritations (n = 19; 15 from SR, 4 from placebo clusters); dry mouth/bad taste (n = 5, from SR clusters only); breathing issues (n = 7, from SR clusters only), including exacerbation of chronic bronchitis or asthma (n = 2); and headaches (n = 4, from SR clusters only). The total number of AEs reported from longitudinal subject cohort households during the trial was similarly low (18 of 2,907 households; 0.619%). No reported serious AEs (SAEs) (deaths) were deemed associated with the SR intervention.
Discussion
ABVs have expanding regions of transmission, cause increasingly frequent epidemics, and are transmitted by one of the most anthropophilic mosquitoes. There is, therefore, a growing unmet need for effective ABVD prevention (9). Our cRCT provides conclusive statistical evidence from a preplanned, prospective cRCT of significant PE (34.1% hazard estimate) against human ABV infection by a chemical-based vector control intervention, in this case, a SR. The uniqueness of our trial in the realm of Aedes vector control is that it is a preplanned cRCT with 1) a predefined effect size on the primary endpoint of human infection that 2) was appropriately powered to prospectively quantify and statistically test for a difference in the impact of a chemical intervention against ABV human infection incidence compared to a placebo. Current adult Aedes chemical control strategies are not supported by such evidence. Reduced human infection caused by a reduction in mosquito biting supports development of 1) improved repellent formulations and 2) enhanced methodologies for broad-scale application.
PE was detected despite assumed dilution and contamination effects due to participant movement in and out of study clusters. Unlike a vaccine, SR protected study participants in their own homes or another protected home within their neighborhood (i.e., study cluster) but did not provide continuous protection after they left treated houses. Our cohort, tested for ABV seroconversion, comprised principally children ≤17 y of age, most of whom attended schools that have been shown in Iquitos to be of lower risk of Ae. aegypti infestation than residential sites (17). Our outcome was demonstrated in an operational context, reflecting complex interactions among ongoing Ministry of Health interventions across the study area, imperfect coverage at the household level (rooms closed to intervention, homeowner removal, and/or loss of intervention), <100% household participation within clusters, and the suggestion of pyrethroid resistance in the local Ae. aegypti population (18) (SI Appendix, section 2.7). Reduced risk of ABV infection was associated with a significant reduction in indoor female Ae. aegypti abundance and blood feeding. Although entomological outcomes were modest, detected effects are consistent with the expected mode of SR action (i.e., deterrence from house entry and/or interfering with human biting) (12, 19), and the impact waned after the intervention was removed at the end of the trial.
Our results support SRs as a flexible class of vector control products with positive public health impact not limited to ABV diseases. Transfluthrin- (15) and metofluthrin-based (20) mosquito coils have been shown to reduce malaria, and the same SR device used in our Iquitos trial reduced malaria infections in an Indonesia cRCT (16). The SR product we tested was generally well tolerated even though it produced mild skin and respiratory irritation, a well-known side effect of pyrethroids. Our trial quantifies these types of AEs for a chemical intervention in a double-blinded trial. Our results, therefore, support the potential for SRs to reduce a variety of vector-borne diseases, augment existing public health efforts, and support SRs as an effective component in vector control intervention strategies. To facilitate implementation and programmatic scale-up, additional assessments, which have already begun (21–24), are needed.
Our Peru cRCT is one of two trials recommended by the WHO for assessing public health value and developing global health policy for the SR intervention class (25). Our study was powered to detect a 30% reduction in ABV infection risk, not acute ABVD or virus infection rates in mosquitos. During the trial period, DENV prevalence was lower than in previous years, and a ZIKV epidemic occurred in 2016 (26). This epidemiological uncertainty is typical of ABV transmission, making powering ABV cRCTs challenging, and helps explain why cRCTs with epidemiological outcomes for ABVs are rare (27). We used seroconversion as our primary endpoint of PE to address this challenge. At our Iquitos study site, powering a trial based on clinically apparent ABVD would not be logistically feasible.
Fully integrating vector control into ABVD prevention programs will require quantitative guidance based on quantitative measures of the impact from each intervention component. Ministries of Health, local to national governments and nongovernmental organizations, can use our trial results as an evidence base for informed application of SRs. Considering the growing ABV public health threat, difficulties of developing vaccines against multiple viruses, and past poorly informed vector control failures (6), enhanced ABVD prevention will benefit greatly from interventions with proven public health value.
Materials and Methods
This trial is registered with ClinicalTrials.gov, number NCT03553277.
Ethical Statement.
Our study protocol (#NAMRU6.2014.0021; SI Appendix) was approved by the US Naval Medical Research Unit No. 6 (NAMRU-6) Institutional Review Board (IRB), which includes Peruvian representation and complies with US Federal and Peruvian regulations governing the protections of human subjects, and the Regional Health Authority (DIRESA), the local branch of the Peruvian Ministry of Health. IRB authorization agreements were established among the NAMRU-6; the University of Notre Dame (sponsor); the University of California, Davis; and the University of Washington.
Trial Design.
Detailed study methods are provided in SI Appendix.
Our trial was conducted from Jun. 2015 through Mar. 2019 in the Iquitos and Punchana Districts of Iquitos, Peru (Fig. 1 and SI Appendix, section 1.1). Clusters were selected in Jan. 2015. Enrollment began Jun. 2015. Participation included 1) a house census, 2) disease surveillance, 3) annual blood draws, 4) bimonthly entomological surveys, and 5) intervention application in the house. Epidemiological monitoring and entomological surveillance lasted from Feb. 2016 through Mar. 2019 (Fig. 2).
Our main objective was to demonstrate and quantify the PE of an SR in reducing ABV infection incidence in a human cohort. Qualifying participants were individuals in a participating house who were seronegative or had a monotypic DENV antibody response when they entered the trial. Assuming the probability of seroconversion for seronegative or monotypic individuals was 10% with a coefficient of variation of 0.25 and an alpha of 5%, we estimated we would need 26 clusters (13 per arm) with ∼60 qualifying individuals to achieve a power of 80% to detect a reduction in the odds of 30%.
The primary endpoint was ABV seroconversion, as measured by DENV- or ZIKV-specific neutralizing antibodies, in blood from children ≥2 to ≤18 y. To increase the pool of baseline seronegative participants, we expanded screening to ≥18 y. Secondary endpoints were clinically apparent, laboratory-confirmed ABVD and indoor female Ae. aegypti 1) abundance, 2) blood-fed status (proxy for human-biting rates), and 3) parity status (proxy for age structure). Participants followed for seroconversion were the “longitudinal cohort,” and those followed for disease were the “febrile surveillance cohort.”
Randomization and Intervention.
A total of 26 clusters (13 per arm), each with ∼140 households (60 qualifying participants), were randomly allocated in Aug. 2016 to receive SR or placebo intervention by the external statistician serving on the Data Safety Monitoring Board (DSMB) using a random number generator (https://www.random.org) (SI Appendix, section 1.2.1). Investigators, research staff, and study participants were blinded to cluster allocation. Our intervention was a transfluthrin passive emanator designed and produced by SC Johnson (Racine, WI), replaced at 2-wk intervals, as described previously (SI Appendix, Fig. S1 and section 1.3.2) (16). Our trial was specifically designed to evaluate the PE of the first in-class SR product prototype to enable WHO assessment for public health value of the SR product class. SR products are not yet recommended by WHO for inclusion into programmatic vector control strategies. We selected the SC Johnson–manufactured, transfluthrin-based passive emanator because it represents the first in-class prototype of a SR under WHO public health value assessment (28). The SR intervention used in our study is the same intervention evaluated against malaria infections in Sumba, Indonesia (16). SR and placebo intervention had identical packaging and were deployed in houses by study personnel using a blinded coding scheme. The placement of the intervention followed manufacturer specifications for indoor use conditions.
Seroconversion and Disease Surveillance.
Recruitment for the longitudinal cohort focused on children because they were more likely to be antibody test negative or monotypic at baseline than adults, which would facilitate interpretation of laboratory assays, and less mobile than adults (29), thus spending more time in their houses or their assigned cluster. Baseline blood samples were obtained within 2 wk before or after initial intervention deployment. As new families moved into the study area, they were recruited to participate, resulting in longitudinal participant enrollment throughout the interval among baseline (B), first (F), and second/final (S) longitudinal blood draws (Fig. 3). Samples were tested by MNT for seroconversion to each DENV serotype and ZIKV (SI Appendix, sections 1.3.3.1 and 1.3.4.1). Only participants who provided at least two blood samples were included in final analyses.
The febrile surveillance cohort was recruited by nurse technicians during door-to-door wellness checks starting with the first week of intervention deployment. Suspected cases exhibited axillary temperature of ≥37.5 °C or, for suspected ZIKV infection, absence of fever but presence of rash, arthralgia, arthritis, or nonpurulent conjunctivitis for ≤5 days. Participants meeting these criteria provided acute and convalescent (14 to 21 d later) serum samples and were monitored clinically daily. Acute serum samples were tested for viral RNA by PCR (DENV and ZIKV; SI Appendix, sections 1.3.3.2–1.3.3.4) and by ELISA for DENV IgM (SI Appendix, sections 1.3.3.5 and 1.3.4.2).
Entomological Endpoints.
Indoor Prokopack aspirations (30) were conducted in all consented homes at time of first intervention deployment and subsequent intervention replacement (i.e., 2-wk intervals). Adult mosquitoes were transported to the NAMRU-6 Iquitos laboratory, sedated at 4 °C, identified to species and sex, and counted by date and house. Up to 30 female Ae. aegypti per household per collection were examined for bloodmeal status and scored as unfed, blood-fed (fully engorged, half-engorged, or trace amounts), or gravid (31). These female mosquitoes were then dissected to determine their parity status (parous, nulliparous, or gravid) (SI Appendix, section 1.3.5.1). Standard insecticide resistance assays were used to assess vector susceptibility to transfluthrin 1 y into the trial (SI Appendix, section 1.3.5.2).
Safety Monitoring.
AEs and SAEs were actively collected throughout the trial during surveillance follow-up and entomological surveys (SI Appendix, section 1.3.6). Reported AEs were investigated by study staff, and appropriate care was recommended by a study physician within 24 h. Safety reporting to the NAMRU-6 IRB was managed by UC Davis in accordance with the approved protocol. Quarterly reports summarizing reported AEs and SAEs were reviewed by the DSMB for trial safety assessment.
Statistical Analysis.
Details of our analytical approach are provided in the statistical analysis plan (SAP) and SI Appendix, section 1.5. All analyses were conducted by Robert C. Reiner Jr. using R 3.6.1 (R Core Team) (32) and the Ime4 (33) and survival (34) packages. No correction for multiple testing was performed for secondary endpoint analyses, and, as such, in accordance with the Consolidated Standards of Reporting Trials (CONSORT) guidelines, in those cases we do not present P values.
The choice of the investigators to select and report a one-sided P value and corresponding one-sided CI is based on the underlying assumption associated with the intervention (i.e., the SR will not increase risk/harm [disease] over the standard of care). The statistical translation is that we are testing to see if 1) the intervention is no better than the standard of care or 2) the intervention is better than the standard of care (superior). As this is a one-sided test of superiority, we present one-sided test results. We also provide the null and alternative hypotheses, test statistic, and its assumed distribution to provide readers information to interpret the P value and confidence interval.
The primary analysis was an ITT assessment of ABV seroconversion for all qualifying participants per treatment assignment who were >2 to <18 y of age. Due to the rolling nature of enrollment, we used a survival analysis with a proportional hazards model and exponential distribution assumption for the baseline hazard (i.e., constant baseline hazard through time) and a frailty component to account for correlation within clusters. If is the hazard rate of the individual in the cluster with covariate values , then this individual’s hazard rate of an arbovirus infection can be written as
where is the random effect of the cluster. Covariates included age, sex, and treatment status (SR or placebo). PE was estimated as , where is the estimated regression coefficient for the intervention group, and is the estimated hazard ratio (HR) between SR and placebo. The null hypothesis of PE = 0% is equivalent to , which is tested by Wald’s test , where is the estimated SE of , at the one-sided significance level of 5%.
A Poisson generalized linear regression was used to assess intervention impact on clinical disease, with an offset for the number of participant days each participant spent in each cluster. No covariates were used, and due to the small sample size, no random effects were incorporated.
Indoor adult female Ae. aegypti abundance, blood-fed rates, and parity were tested through DID Poisson generalized linear mixed models. Collections conducted in 2016 were defined as “baseline,” and collections conducted in 2017 and 2018 were estimated as “postbaseline.” Each analysis accounted for month of year and year as fixed effects and contained a random effect by cluster. Model formulation details are presented in SI Appendix, sections 1.5.4–1.5.6.
The primary analysis conducted differs from that in the original SAP (SI SAP). Procedures called for yearly blood draws from children. To increase the number of qualifying participants, we expanded the age range of the longitudinal cohort to all ages ≥2 y. The rolling enrollment resulted in substantial variation in time intervals between blood draws. Simple logistic regression, therefore, was inadequate. The decision to alter the primary analysis was discussed and agreed upon by the study statistician and the external DSMB statistician before outputs were unblinded to the DSMB statistician.
Supplementary Material
Acknowledgments
We extend sincere appreciation to DSMB members Dennis Shanks, Chris Drakeley, and Neal Alexander for assurances on data integrity and safety assessments. We thank the WHO Vector Control Advisory Group for their comments during project assessments. We are grateful for the efforts of Marianne Kent, Program Coordinator at the University of Notre Dame, for her administrative and logistical support of the program, as well as Brett Fox of the University of Notre Dame Center for Research Computing for assisting with central database development for data verification. We thank Kristina Davis and Matthew Sisk of the University of Notre Dame Center for Research Computing and Hesburgh Libraries, respectively, for their assistance in graphic development. We acknowledge Audrey Lenhart of the Centers for Disease Control and Prevention in Atlanta, GA, and J. Kevin Baird of the Eijkman-Oxford Clinical Research Unit, Jakarta, Indonesia, and Nuffield Department of Medicine, Centre for Tropical Medicine, University of Oxford, Oxford, United Kingdom, for their roles on the Scientific Advisory Committee.
We are grateful to SC Johnson for providing integral industry and product expertise, including the independent funding of the development, manufacturing, delivery, and shipment of the SR and placebo products used in the study. SC Johnson provided expertise in ensuring intervention quality, storage, application, and disposal assurances throughout the trial.
We thank the residents of Iquitos for their support and participation in this study and willingness to allow this study to be conducted in their homes and community. We greatly appreciate the support of the Loreto Regional Health Department, including Drs. Hugo Rodriguez-Ferruci, Christian Carey, Carlos Alvarez, and Lic. Wilma Casanova Rojas, who facilitated our work in Iquitos. We thank the NAMRU-6 Virology and Emerging Infections Department (VEID) leadership, who provided institutional support, IRB guidance, and support supervising field staff. We appreciate the commentary and advice provided by the NAMRU-6 IRB and Research Administration Program for the duration of this study. We thank the NAMRU-6 VEID field team, which provided daily support through the duration of the project and without whom the recruitment of acute DENV cases would not have been possible. We thank Cecilia Gonzales, Gloria Talledo, and Gabriela Vasquez de la Torre for their administrative support of the project.
This study was funded by the Bill and Melinda Gates Foundation to the University of Notre Dame (grant OPP1081737). Further support was provided by the Defense Threat Reduction Agency, Military Infectious Disease Research Program (S0520_15_LI and S0572_17_LI), and the US National Institute of Allergy and Infectious Diseases (NIH/NIAID) award number P01 AI098670. SC Johnson used internal company financial resources for the development, manufacturing, delivery, and shipment of the intervention (SR and placebo) used in the study.
S.A.J., W.R.C., E.J.A., and R.D.H. are military service members, and A.C.M., H.A., C.G., I.B., C.S., G.M.V., K.E.-V., C.F.-M., A.A.H., and M.E.S. are employees of the US Government. This work was prepared as part of their official duties. Title 17 U.S.C. §105 provides that “Copyright protection under this Title is not available for any work of the United States Government.” Title 17 U.S.C. §101 defines a US Government work as a work prepared by a military service member or employee of the US Government as part of that person’s official duties.
The views expressed in this article are those of the author and do not necessarily reflect the official policy or position of the Department of the Navy, the Department of Defense, or the US Government.
This article received approval for public distribution.
Footnotes
The authors declare no competing interest.
This article is a PNAS Direct Submission.
This article contains supporting information online at https://www.pnas.org/lookup/suppl/doi:10.1073/pnas.2118283119/-/DCSupplemental.
Data Availability
All analytical data sets have been deposited in CurateND (https://doi.org/10.7274/xk81jh37s8g). Data include anonymized sr_febrile_cases.csv, sr_location_ent.csv, sr_longitudinal.csv, sr_questionanaire.csv, and the folders: SAE data as submitted in final DSMB report and preintervention_entomology.
Analytical codes are provided in the SI Appendix (SAP) as well as in the data repository.
References
- 1.Murray C. J. L., et al. ; GBD 2013 DALYs and HALE Collaborators, Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990-2013: Quantifying the epidemiological transition. Lancet 386, 2145–2191 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Stanaway J. D., et al. , The global burden of dengue: An analysis from the Global Burden of Disease Study 2013. Lancet Infect. Dis. 16, 712–723 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Bhatt S., et al. , The global distribution and burden of dengue. Nature 496, 504–507 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Bowman L. R., Donegan S., McCall P. J., Is dengue vector control deficient in effectiveness or evidence?: Systematic review and meta-analysis. PLoS Negl. Trop. Dis. 10, e0004551 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Horstick O., Runge-Ranzinger S., Nathan M. B., Kroeger A., Dengue vector-control services: How do they work? A systematic literature review and country case studies. Trans. R. Soc. Trop. Med. Hyg. 104, 379–386 (2010). [DOI] [PubMed] [Google Scholar]
- 6.Achee N. L., et al. , A critical assessment of vector control for dengue prevention. PLoS Negl. Trop. Dis. 9, e0003655 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Parks W., Lloyd L., Planning Social Mobilizaiton and Communication for Dengue Fever Prevention and Control (WHO, Geneva, 2004). [Google Scholar]
- 8.Esu E., Lenhart A., Smith L., Horstick O., Effectiveness of peridomestic space spraying with insecticide on dengue transmission; systematic review. Trop. Med. Int. Health 15, 619–631 (2010). [DOI] [PubMed] [Google Scholar]
- 9.Morrison A. C., Zielinski-Gutierrez E., Scott T. W., Rosenberg R., Defining challenges and proposing solutions for control of the virus vector Aedes aegypti. PLoS Med. 5, e68 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Andersson N., et al. , Evidence based community mobilization for dengue prevention in Nicaragua and Mexico (Camino Verde, the Green Way): Cluster randomized controlled trial. BMJ 351, h3267 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Utarini A., et al. ; AWED Study Group, Efficacy of Wolbachia-infected mosquito deployments for the control of dengue. N. Engl. J. Med. 384, 2177–2186 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Achee N. L., et al. , Spatial repellents: From discovery and development to evidence-based validation. Malar. J. 11, 164 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.World Health Organization, WHO Pesticide Evaluation Scheme, Guidelines for Efficacy Testing of Spatial Repellents (World Health Organization, Genève, Switzerland, 2013). [Google Scholar]
- 14.WHO, Vector Control Advisory Group. https://www.who.int/groups/vector-control-advisory-group. Accessed 26 November 2020.
- 15.Hill N., et al. , A household randomized, controlled trial of the efficacy of 0.03% transfluthrin coils alone and in combination with long-lasting insecticidal nets on the incidence of Plasmodium falciparum and Plasmodium vivax malaria in Western Yunnan Province, China. Malar. J. 13, 208 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Syafruddin D., et al. , Efficacy of a spatial repellent for control of malaria in Indonesia: A cluster-randomized controlled trial. Am. J. Trop. Med. Hyg. 103, 344–358 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Morrison A. C., et al. , Aedes aegypti (Diptera: Culicidae) production from non-residential sites in the Amazonian city of Iquitos, Peru. Ann. Trop. Med. Parasitol. 100 (suppl. 1), S73–S86 (2006). [DOI] [PubMed] [Google Scholar]
- 18.Palomino-Salcedo M., Estado de susceptibilidad de la población natural de Aedes aegypti a los insecticidas en Punchana-Iquitos, Región Loreto (Novimbre 2014) (Instituto Nacional de Salud, Peru, 2014). [Google Scholar]
- 19.Norris E. J., Coats J. R., Current and future repellent technologies: The potential of spatial repellents and their place in mosquito-borne disease control. Int. J. Environ. Res. Public Health 14, 124 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Syafruddin D., et al. , Impact of a spatial repellent on malaria incidence in two villages in Sumba, Indonesia. Am. J. Trop. Med. Hyg. 91, 1079–1087 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Liverani M., Charlwood J. D., Lawford H., Yeung S., Field assessment of a novel spatial repellent for malaria control: A feasibility and acceptability study in Mondulkiri, Cambodia. Malar. J. 16, 412 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Masalu J. P., et al. , Efficacy and user acceptability of transfluthrin-treated sisal and hessian decorations for protecting against mosquito bites in outdoor bars. Parasit. Vectors 10, 197 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Paz-Soldan V. A., et al. , Initial assessment of the acceptability of a Push-Pull Aedes aegypti control strategy in Iquitos, Peru and Kanchanaburi, Thailand. Am. J. Trop. Med. Hyg. 84, 208–217 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Jumbam D. T., et al. , Knowledge, attitudes and practices assessment of malaria interventions in rural Zambia. BMC Public Health 20, 216 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.World Health Organization, The Evaluation Process for Vector Control Products (Rep. No. WHO/HTM/GMP/2017.13, World Health Organization, 2017). https://apps.who.int/iris/handle/10665/255644.
- 26.Pan American Health Organization/World Health Organization, Zika: Epidemiological Report Peru (PAHO/WHO, Washington, DC, 2017). https://www.paho.org/hq/dmdocuments/2017/2017-phe-zika-situation-report-per.pdf.
- 27.Anders K. L., et al. , Cluster-randomized test-negative design trials: A novel and efficient method to assess the efficacy of community-level dengue interventions. Am. J. Epidemiol. 187, 2021–2028 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Vector Control Advisory Group/World Health Organization, Overview of intervention classes and prototype/products under Vector Control Advisory Group (VCAG) review for assessment of public health value 1 (WHO, 2020). https://apps.who.int/iris/bitstream/handle/10665/274451/WHO-CDS-VCAG-2018.03-eng.pdf.
- 29.Vazquez-Prokopec G. M., et al. , Using GPS technology to quantify human mobility, dynamic contacts and infectious disease dynamics in a resource-poor urban environment. PLoS One 8, e58802 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Vazquez-Prokopec G. M., Galvin W. A., Kelly R., Kitron U., A new, cost-effective, battery-powered aspirator for adult mosquito collections. J. Med. Entomol. 46, 1256–1259 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Gunning C. E., et al. , Efficacy of Aedes aegypti control by indoor Ultra Low Volume (ULV) insecticide spraying in Iquitos, Peru. PLoS Negl. Trop. Dis. 12, e0006378 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.R Core Team, R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, Vienna, Austria, 2019). www.R-project.org/. [Google Scholar]
- 33.Bates D., Mächler M., Bolker B., Walker S., Fitting Linear Mixed-Effects Models using lme4. arXiv [Preprint] (2014). https://arxiv.org/abs/1406.5823. Accessed 19 January 2021.
- 34.Therneau T. M., A Package for Survival Analysis in S. version 2.38. (Comprehensive R Archive Network [CRAN], 2015). https://cran.r-project.org/web/packages/survival/index.html. Accessed 19 January 2021.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All analytical data sets have been deposited in CurateND (https://doi.org/10.7274/xk81jh37s8g). Data include anonymized sr_febrile_cases.csv, sr_location_ent.csv, sr_longitudinal.csv, sr_questionanaire.csv, and the folders: SAE data as submitted in final DSMB report and preintervention_entomology.
Analytical codes are provided in the SI Appendix (SAP) as well as in the data repository.