Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2018 Dec 3;2:22. Originally published 2017 Mar 30. [Version 4] doi: 10.12688/wellcomeopenres.11073.4

Variation in the effectiveness of insecticide treated nets against malaria and outdoor biting by vectors in Kilifi, Kenya

Alice Kamau 1,a, Joseph M Mwangangi 1,2,3, Martin K Rono 1,3, Polycarp Mogeni 1, Irene Omedo 1, Janet Midega 1,4, J Anthony G Scott 1,5, Philip Bejon 1,6
PMCID: PMC6281023  PMID: 30542660

Version Changes

Revised. Amendments from Version 3

In response to the reviewer’s comments, we have updated the manuscript accordingly. We have adjusted figure 8 with the correct values i.e. absolute rate of exposure rather than the proportion of exposure and included separate panels for the different Anopheles taxa. We adjusted figure 7 with similar taxonomic breakdown by merging An. arabiensis and An. gambiae s.s. into a single panel for An. gambiae s.l.. as figure 8. We have moved supplementary figure 1 to the main manuscript as a second panel in figure 3 i.e. Figure 3B and added Figure 3C that shows a scatter plot of the odds ratio of insecticide treated net (ITN) effect and 95% confidence interval of malaria positivity against overall mosquito densities and for the 3 separate taxa.  We have added a graph that shows ITN effectiveness against the proportion of A nopheles caught outside of sleeping hours i.e. Figure 5B and a graph that shows ITN effectiveness against the estimated mean exposure π s. i.e. Figure 5C. We have add Supplementary Figure 2 which is a plots of prevalence of malaria vs mosquito densities of each taxon.

Abstract

Background: Insecticide treated nets (ITNs) protect humans against bites from the Anopheles mosquito vectors that transmit malaria, thereby reducing malaria morbidity and mortality. It has been noted that ITN use leads to a switch from indoor to outdoor feeding among these vectors. It might be expected that outdoor feeding would undermine the effectiveness of ITNs that target indoors vectors, but data are limited.

Methods: We linked homestead level geospatial data to clinical surveillance data at a primary healthcare facility in Kilifi County in order to map geographical heterogeneity in ITN effectiveness and observed vector feeding behaviour using landing catches and CDC light traps in six selected areas of varying ITN effectiveness. We quantified the interaction between mosquitoes and humans to evaluate whether outdoor vector biting is a potential explanation for the variation in ITN effectiveness.

Results: We observed 37% and 46% visits associated with positive malaria slides among ITN users and non-ITN-users, respectively; ITN use was associated with 32% protection from malaria (crude OR = 0.68, 95% CI: 0.64, 0.73). We obtained modification of ITN effectiveness by geographical area (p=0.016), and identified 6 hotspots using the spatial scan statistic. Majority of mosquitoes were caught outdoor (60%) and were of the An. funestus group (75%). The overall propensity to feed at times when most people were asleep was high; the vast majority of the Anopheles mosquitoes were caught at times when most people are indoors asleep. Estimates for the proportion of human-mosquito contact between the first and last hour when most humans were asleep was consistently high across all locations, ranging from 0.83 to 1.00.

Conclusion: Our data do not provide evidence of an epidemiological association between microgeographical variations in ITN effectiveness and variations in the microgeographical distribution of outdoor biting.

Keywords: ITNs, outdoor, Anopheles mosquito, effectiveness, Kilifi, Kenya, KHDSS

Introduction

Despite the recent scale-up effort to achieve control, malaria continues to cause morbidity and mortality, especially in sub-Saharan Africa. There are uncertainties in global estimates 13; however in 2015, the World Health Organization estimated global deaths due to malaria to be 438,000 (range: 236,000–635,000) and the burden of febrile illness at 214 million cases (range: 149–303 million) 4. Estimates from model-based predictions suggest that approximately 1.4 billion of the global population live at risk of stable malaria and ~1.1 billion at risk of unstable malaria 5.

The frontline tools for malaria control in sub-Saharan Africa, insecticide treated nets (ITNs) and indoor residual spray, are most effective if baseline transmission occurs indoors 6. The major vectors of human malaria mostly feed indoors, and transmission can therefore be substantially reduced by these tools 6. The proportion of the at risk population who have access to ITNs was modeled to have increased from 4% to 67% between 2004 and 2015 7. ITNs operate in three ways: deterrence, excito-repellence and killing, thereby reducing the density, feeding frequency, feeding success, and survival of Anopheles mosquito vectors 6. By reducing vector densities and vector survival, ITNs not only directly protect the individual ITN user, but also reduce the overall transmission intensity and protect the whole community when a particular threshold of bed net coverage is reached 810. The evidence base supports ITN use over a range of transmission intensities 11 and protective efficacy has been demonstrated against infection, clinical disease and mortality 1216. However, residual malaria transmission is well described even after optimal ITN use, which could be associated with outdoor biting behaviour of the mosquito vector that allows them to evade fatal contact with these frontline tools of intervention 17, 18. The most obvious behavioural change is the mosquito vector exhibiting exophagic tendencies –i.e. the vector feeds outdoors.

Among malaria vectors in Africa, the two principal taxa are: Anopheles gambiae sensu lato (s.l.) and Anopheles funestus group. Both species complexes feed primarily indoors; however, both have exhibited outdoor biting or feeding in the early part of the evening in some areas where ITNs have been deployed 6, 1922. This behavioral change might have resulted from one of three processes: (i) selection, either for species that more readily engages in outdoor feeding, for instance in favour of An. arabiensis rather than An. gambiae sensu strictu (s.s.); (ii) by selecting for evolutionary change within a species; or (iii) a response to inability to feed during the night in the absence of genetic variation 23, 24. In Western Kenya and South-eastern Tanzania there have been reports of a reduction in indoor feeding by An. gambiae sensu stricto ( s.s.) and an increase in the relative abundance of An. arabiensis. The latter has a broader range of feeding times and biting behavior, including: feeding at dusk or dawn on humans outdoors; readily feeding on animals when available; or repeatedly foraging inside houses until an unprotected non-ITN user is found 8, 17, 23, 25, 26. In southern Tanzania, where ITNs have been used for several years, the mosquitoes are biting more frequently during the hours of the early evening and early morning when people are more likely to be awake and vulnerable outside of their nets 6, 27. The potential for ITNs to result in species switches was appreciated in earlier controlled trials 23, 26, 28, and is now reported more widely as ITN use is scaled up in Western Kenya and on the East African coast 23, 26.

In Kilifi, Kenya, a switch in the most common vector, from An. gambiae sensu stricto (s.s.) to An. arabiensis, occurred during the period of ITN scale-up 22. The increased ability of An. arabiensis to feed outdoors might be expected to result in a decrease in ITN effectiveness. However, there is little data to support this contention, and some data and models that are available suggest that ITNs continue to be effective despite outdoor feeding 29, 30. The objectives of this study were (i) to examine whether there has been a shift in vector biting patterns and/or vector behaviour, during the period of intense ITN use along the Kenyan coast; (ii) to test for geographical heterogeneity in ITN effectiveness within the surveillance area of a primary healthcare facility in Kilifi County; and (iii) to assess whether outdoor vector biting is a potential explanation for the variation in ITN effectiveness.

Methods

Study area

The clinical surveillance study was conducted between January 2009 and December 2016 within a 6km radius of Pingilikani dispensary in Kilifi County on the Kenyan Coast ( Figure 1): within the Kilifi Health and Demographic Surveillance System (KHDSS). All children under 13 years presenting for medical assessment to Pingilikani dispensary (except those with trauma as their only concern) were assessed by research staff and had finger-prick blood samples examined for malaria parasites. Thick and thin blood smears were stained with 10% Giemsa and examined at 1000X magnification for asexual Plasmodium falciparum parasites. Before slides could be considered negative, 100 fields were examined. Children with malaria positive slides were treated with co-artemether.

Figure 1. Situation of Kilifi County in Kenya and the map of Kilifi County showing the boundaries of the KHDSS.

Figure 1.

The map of KHDSS shows the locations and the situation of homesteads and Pingilikani dispensary where the study was conducted. The brown plotted point on the KHDSS map represents homesteads.

Transmission of malaria peaks after the long rains from April to June and the short rains from October to November each year, although transmission has been declining 3134. The surveillance area was divided into 2.5×2.5 km regular polygons resulting in 21 geographical areas ( Figure 2). As part of KHDSS, four-monthly enumeration rounds were conducted to identify births, deaths and migration events. Each inhabitant was described by their family relationships and their homestead of residence, with geospatial coordinates, and assigned a unique personal identifier 35. These details were used to link children visiting Pingilikani dispensary to geospatial coordinates for the homestead of residence. Data on ITN use was collected once yearly during cross-sectional surveys integrated into the regular KHDSS enumeration since 2008. Questionnaires were used to collect household data on ITN ownership and use on the night prior to enumeration 36. Six geographical areas were selected for mosquito sampling out of 21 areas for which clinical effectiveness estimates were determined ( Figure 2). The basis of selecting the six areas was (i) geographical areas with >60 homesteads available for randomization; (ii) areas representing varying ITN effectiveness.

Figure 2. Map of the 2.5×2.5 km geographical areas (grids in light gray), the geographical areas where mosquito sampling was conducted (grids in dark gray) and the homesteads where mosquito sampling was done.

Figure 2.

Each plotted point represents an individual homestead, where color shading indicates ITN effectiveness, with red shading indicating low effectiveness and blue shading indicating high effectiveness.

Mosquito sampling

Indoor and outdoor biting profiles of An. gambiae s.l. and the An. funestus group were estimated using human landing catches (HLC) and CDC-light traps (CDC-LT) by visiting randomly selected houses (random selection done by stratified sampling) between July and August 2016. For both indoor and outdoor mosquito collection, HLC was conducted by two pairs of trained male volunteers (one pair was located indoors and the other pair outdoors, but at the same homestead), who sat with their legs exposed and caught mosquitoes that attempted to bite them using an aspirator. HLC was conducted between 18:00hours and 06:00hours for 45 minutes each hour, allowing 15 minutes break for rest. The catches for each hourly interval were stored in separate collection cups. CDC-light traps were also set indoor and outdoor between 18:00hours and 06:00hours. The HLC and the CDC-LT collections took place in different houses. In each geographical area, sampling was conducted for at least 3 days in at least 16 houses; 8 houses for HLC and 8 houses for CDC-LT. In total, 26 days of sampling were conducted across 115 houses in the six selected geographical areas within the surveillance area.

Mosquito processing

The mosquito samples were morphologically separated for sex and identified for species 6, 27. The female Anopheles mosquitoes were tested for falciparum infection using a sandwich circumsporozoite protein (CSP) enzyme linked immunosorbent assay (ELISA) 37 (anti-CSP capture: Pf2A10-28 and conjugate : Pf2A10-CDC antibodies; KPL, Gaithersburg, MD, USA). Individual mosquitoes were stored at -20°C in micro-centrifuge tubes containing a small amount of desiccant (silica gel) separated from the mosquito by a thin layer of cotton prior to ELISA and molecular analysis for sibling species by polymerase chain reaction 38, 39.

Human behaviour

To determine the human-mosquito contact, we administered questionnaires to 304 randomly selected households in the six geographical areas between September and October 2016. We asked the household head time when each household member went to sleep and the time they woke up. Data on human behaviour was used to make adjustments to the indoor and outdoor biting rate.

Statistical analysis

Geographical variations in ITN effectiveness

Statistical analyses were performed using STATA v13.1 (StataCorp, College Station, TX, USA). To assess for geographical heterogeneity, we used the logistic regression model to analyze data on over 20,000 visits from children attending Pingilikani dispensary. The outcome of interest was presence of malaria by microscopy on presentation to the dispensary. The potential risk factors included: ITN use, age of the child, year of presentation to the dispensary, season (the wet season comprised of April, May, June, October and November) and the geographical area, as defined by the 2.5×2.5 km regular polygons. We assessed whether the effect of ITN use on malaria was altered by geographical area by including an interaction term between geographical area and ITN use. We also assessed whether the effect of ITN use was altered by the age of the child and whether geographical areas altered the effect of age. To assess the nonlinear effect of age in the regression models, multiple fractional polynomial transformation was used 40. A list of fractional polynomial (FP) powers (–2, –1, –0.5, 0, 0.5, 1, 2, 3) were investigated for inclusion in the model using an algorithm that combines a backward elimination procedure with a search for an FP function that best predicts the outcome variable as previously described 41. Given that the hospital malaria episodes were clustered within patients, we allowed for clustering by using a logistic regression model with robust standard errors 42. The robust standard errors were used to account for the clustering effect in the estimation of the standard errors. The ratio of malaria in the non-ITN users to that in the ITN users was expressed as an odds ratio (OR) as determined by logistic regression. ITN effectiveness was calculated as (1 – OR) × 100. Model fit was assessed by examining residuals against covariates. ITN effectiveness was also computed for each individual homestead aggregated at a 2.5 km smoothing and without smoothing. Spearman’s rank correlation was used to assess the association between ITN effectiveness and prevalence of malaria. SaTScan software (version 9.4; https://www.satscan.org/), a spatial scan statistic developed by Kulldorf 43, was used to detect potential spatial variations of ITN effectiveness (without smoothing) by identifying statistically significant geographical clustering of ITN effectiveness using the normal model. The space-time parameter of the spatial scan statistic places a cylindrical window on the coordinates grid for the locations studied and moves the center of the cylinder base over the grid so that the sets of geographic units covered by the window are constantly changing. Whenever the cylindrical window includes a new event, SaTScan calculates a likelihood function to test for elevated risk within the cylinder as compared with outside the cylinder. The observed test statistic is obtained by calculating the likelihood ratio maximized over the collection of zones in the alternative hypothesis. The p value for the detection of clusters is calculated by using the Monte Carlo hypothesis testing (where a number of random replications of the dataset under the appropriate null hypothesis are generated, their test statistics computed and then compared with the observed test statistic to obtain the p-value). The null hypothesis is that the risk of malaria inside and outside the scanning window is the same 43.

Vector abundance

In order to compare counts of female Anopheles captured, we determined the relative proportion of each mosquito species in each geographical area and ITN effectiveness levels (ITN effectiveness was divided into 2 levels based on the estimates obtained from the logistic regression above –i.e. high and low ITN effectiveness). Three areas (6, 15 & 16) with high ITN effectiveness and three areas (5, 19 & 20) with low ITN effectiveness were selected based on the findings of the scan statistic. We compared the proportion of vectors biting outdoors and those caught outside of sleeping hours in each geographical area. We estimated the confidence intervals of these proportions using the binomial distributions, and tested for an association between biting preference and ITN effectiveness (at the level of geographical area) using the Spearman’s rank correlation.

Human behaviour

Questionnaire data about the time household members went to sleep and at what time they woke up were combined with human landing catches measurements of hourly rates for indoor and outdoor biting. The proportion of people indoor and outdoor at each hour of the night was calculated. We estimated the proportion of human exposure to mosquito bites occurring indoors (π s) by taking into consideration the movement pattern of people using the following method 44: by weighting the mean indoor and outdoor biting rates throughout the night by the proportion of humans reporting to have gone to sleep at each hour of the night, as an indicator of the upper limit of personal protection that indoor vector control measures can provide, as follows;

πs=t=112(Bi,tSt)/t=112(Bi,tSt+Bo,t(1St))

Where:

π s = an estimate of human exposure to bites which occurs when residents are both indoors and sleeping

S t = the proportion of humans indoors reporting to have gone to sleep at each hour of the night (t)

B i, t = mean indoor biting rate at each hour of the night (t)

B o, t = mean outdoor biting rates at each hour of the night (t)

(1-S t) = proportion of humans not yet asleep at each hour of the night

Results

Geographical variations in ITN effectiveness

Between 2009 and 2016, there were 29,187 visits to Pingilikani dispensary made by 5,800 children aged between 3 months to 12 years ( Table 1). Of these visits, 11,505 (39.4%) were classified as episodes of malaria, with a median number of 9 (IQR: 5, 15) episodes per child during this time period. The number of children, cases of malaria and ITN use in the 21 geographical areas examined is summarized in detail in Table 1. ITN use was consistently >50% in all geographical areas and the prevalence of ITN use in non-malaria cases was 74.2% (95% CI: 73.5, 74.8).

Table 1. Description of insecticide treated net (ITN) use and cases of malaria in the 2.5×2.5 km geographical areas.

Areas Children Visits Malaria visits-
ITN user n (%)
Non-malaria visits
ITN user n (%)
Malaria visit
non-user n (%)
Non-malaria visits
non-user n (%)
Malaria
prevalence (%)
ITN use
(%)
1 13 15 5 (0.07) 6 (0.05) 3 (0.08) 1 (0.02) 53.3 73.3
2 17 25 11 (0.14) 12 (0.09) 0(0) 2 (0.04) 44 92
3 4 6 1 (0.01) 5 (0.04) 0(0) 0 (0) 16.7 100
4 5 10 5 (0.07) 3 (0.02) 1 (0.03) 1 (0.02) 60 80
5 275 1232 484 (6.35) 481 (3.67) 122 (3.14) 150 (3.13) 49.2 78.3
6 690 4335 1264 (16.59) 1909 (14.55) 587 (15.10) 612 (12.78) 42.7 73.2
7 6 6 0(0) 5 (0.04) 0(0) 1 (0.02) 0 83.3
8 173 348 62 (0.81) 148 (1.13) 52 (1.34) 88 (1.84) 32.8 60.3
9 42 201 48 (0.63) 78 (0.59) 32 (0.82) 54 (1.13) 39.8 62.7
10 1343 9639 2910 (38.20) 4467 (34.05) 1055 (27.14) 1277 (26.67) 41.1 76.5
11 308 1284 453 (5.95) 502 (3.83) 205 (5.27) 130 (2.72) 51.3 74.4
12 19 40 6 (0.08) 18 (0.14) 4 (0.10) 12 (0.25) 25 60
13 497 1109 148 (1.94) 617 (4.70) 99 (2.55) 245 (5.12) 22.3 68.9
14 212 1136 219 (2.87) 384 (2.93) 256 (6.59) 303 (6.33) 41.8 53.1
15 605 3704 682 (8.95) 1672 (12.74) 602 (15.49) 770 (16.08) 34.7 63.6
16 567 2881 623 (8.18) 1125 (8.57) 551 (14.18) 602 (12.57) 40.8 60.7
17 29 40 5 (0.07) 26 (0.20) 3 (0.08) 6 (0.13) 20 77.5
18 49 206 67 (0.88) 80 (0.61) 32 (0.82) 29 (0.61) 48.1 71.4
19 520 1911 418 (5.49) 1047 (7.98) 160 (4.12) 295 (6.16) 30.3 76.7
20 423 1055 206 (2.70) 535 (4.08) 122 (3.14) 208 (4.34) 31.1 70.2
21 3 4 1 (0.01) 0(0) 1 (0.03) 2 (0.04) 50 25
Total 5800 29187 7618 (36.73) 13120 (63.27) 3887 (46.01) 4562 (53.99) 39.4 71.1

Data includes the number of children observed, number of visits made to Pingilikani dispensary, the number and proportion of malaria among ITN use or non-ITN-users in the 21 geographical areas

Among children who were ITN users, 37% (7618/20738) of the visits were associated with positive malaria slides, whereas among non-ITN-users 46% (3887/8449) of the visits were associated with positive malaria slides. ITN use was associated with a 32% protection from malaria; crude OR = 0.68, 95% CI: 0.64, 0.73 (p<0.001). When geographical area was added to the model as an interaction term with ITN use, we obtained a variation in ITN effectiveness between the geographical areas (p=0.0055). Geographical variation in ITN effectiveness remained robust (p=0.016) even after adjusting for the year of visitation to the dispensary, season and the interactions between ITN use and nonlinear age ( Supplementary Table 1). The stratum specific adjusted OR for the association of ITN use on malaria in the geographical areas was calculated and shown in the order of decreasing effectiveness ( Figure 3A). Previous data have shown that ITN effectiveness is lower in areas of high malaria transmission 11, 45. This did not appear to be the explanation for variation in effectiveness in this data ( Figure 3B); the Spearman rho coefficient value for the association of ITN effectiveness and prevalence of malaria was 0.1868, p=0.541.

Figure 3.

Figure 3.

Panel A shows a scatter plot of stratum specific adjusted Odds Ratio of insecticide treated net (ITN) effect in 13 geographical areas in order of decreasing effectiveness. Panel B shows a scatter plot of the log odds ratio of ITN effect against malaria prevalence in 13 geographical areas. Panel C shows a scatter plot of the log odds ratio of ITN effect against overall mosquito densities and for the 3 separate taxa.

Hotspots

Using the logistic regression model, we estimated ITN effectiveness for each individual homestead where there was sufficient data to calculate a point estimate (i.e. >30 observations from homestead aggregated at a 2.5 km smoothing). Using SaTScan software, we identified 6 hotspots of low ITN effectiveness: p=0.001 for the 6 hotspots ( Figure 4). We concluded that spatial variation in ITN effectiveness was not due to random noise based on the 95% confidence intervals obtained from the logistic regression analysis for geographical areas and the existence of hotspots by SaTScan, and selected six geographical areas for further entomological studies to represent a range of ITN effectiveness estimates.

Figure 4. Scatter plot of estimated insecticide treated net (ITN) effectiveness for individual homesteads aggregated at a 2.5km smoothing.

Figure 4.

Each plotted point represents an individual homestead, where color shading indicates ITN effectiveness, with red shading indicating low effectiveness and blue shading indicating high effectiveness. The large black circles indicate the significant hotspots (analyzed without smoothing).

Vector abundance

Over 26 nights, 415 female Anopheles mosquitoes were collected by both methods (i.e. 272 by HLC and 143 by CDC-LT), representing a mean of 16 mosquitoes per night. 66% of mosquitoes were collected using HLC. Of the 415 mosquitoes, 311 (75%) were An. funestus group, 84 (20%) were An. gambiae s.l. and 20 (5%) were other Anopheles i.e. An. pretoriensis, An. coustani, An. moucheti and An. squamosus ( Table 2). The An. funestus group was caught more than An. gambiae s.l (p<0.001). Of the 84 amplified samples of An. gambiae s.l., 68 (81%) were An. Arabiensis and 16 (19%) were An. gambiae s.s. The proportion of Anopheles mosquitoes caught outdoors (60%; 95% CI: 55%, 65%) was greater than the proportion caught indoors (p<0.001). There were more Anopheles mosquitoes collected outdoors in all geographical areas except area 6, where most of the mosquitoes were collected indoors ( Table 2). The frequencies of vectors collected in each geographical area are summarized in Supplementary Table 2. An. funestus group was the most prevalent vector in all areas. However, we did not find an association between ITN effectiveness and vector density, Spearman rho coefficient was -0.2, p=0.8 ( Figure 3C). Of the 272 mosquitoes collected by HLC, 3.3% (9/272) tested positive for P. falciparum sporozoites. The most detected sporozoite infectious mosquitoes captured were from the An. funestus group (7/9). The rate of indoor and outdoor biting estimated by HLC was 19.8 and 25.5 bites per person per night, respectively.

Table 2. Proportion of Anopheles mosquitoes collected indoors and outdoors by either HLC or CDC-LT.

Number collected n (%) Indoor n (%) Outdoor ITN effectiveness (CI)
All 415 165 (39.8%) 250 (60.2%)
Vectors
Anopheles arabiensis 68 7 (10.3%) 61 (89.7%)
Anopheles coustani 6 0 6 (100%)
Anopheles funestus group 311 152 (48.9%) 159 (51.1%)
Anopheles gambiae s.s. 16 6 (37.5%) 10 (62.5%)
Anopheles moucheti 1 0 1 (100%)
Anopheles pretoriensis 12 0 12 (100%)
Anopheles squamosus 1 0 1 (100%)
Geographical area
5 192 89 (46.4%) 103 (53.6%) -16.9 [-6.3, 16.1]
19 105 12 (11.4%) 93 (88.6%) 19.1 [-0.4, 36.8]
20 47 12 (25.5%) 35 (74.5%) 24.2 [-0.4, 44.9]
6 60 50 (83.3%) 10 (16.7%) 25.8 [1.1, 38.4]
15 5 1 (20.0%) 4 (80.0%) 35.5 [2.3, 46.2]
16 6 1 (16.7%) 5 (83.3%) 41.3 [3.0, 51.1]

area 5, 19 and 20 were regarded as low effectiveness area; area 6, 15 and 16 were regarded as high effectiveness area; CI: Confidence Interval; %: Proportion per 100

The frequency and proportion of Anopheles mosquitoes collected in the six areas of high vs. low ITN effectiveness are summarised in Table 3 and Supplementary Figure 1. Overall, the proportion of mosquitoes caught outdoor was higher in the low ITN effectiveness areas (67% vs. 27%, p <0.001), but this apparent significance was due to a single area (labelled area 6), which was an outlier for mosquitoes caught indoor ( Figure 5A). When we excluded area 6, the proportion of mosquitoes caught outdoor in the low vs. high ITN effectiveness areas was non-significant (67% vs. 82% p=0.306). Moreover, when we analysed the proportion of mosquitoes caught outside of sleeping hours, <23:00hrs and > 5:00hrs, by individual geographical area there was not a visually obvious trend with decreasing ITN effectiveness in the six geographical areas ( Figure 5B), although this association could have been limited by the power of the study, as evidenced by the confidence intervals. The Spearman rho coefficient value for the association of ITN effectiveness and proportion of mosquitoes collected outdoors was 0.1429, p=0.79.

Table 3. Composition of the Anopheles mosquito vector in areas of high and low ITN effectiveness.

Trap type Vectors Low ITN effectiveness areas High ITN effectiveness area
Total (N) Outdoor (n) Outdoor (%) Total (N) Outdoor (n) Outdoor (%)
HLC Anopheles arabiensis 48 42 87.5 5 4 80.0
Anopheles coustani 6 6 100.0 0 0 0.0
Anopheles funestus group 163 70 42.9 23 10 43.5
Anopheles gambiae s.s. 13 7 53.8 0 0 0.0
Anopheles moucheti 1 1 100.0 0 0 0.0
Anopheles pretoriensis 12 12 100.0 0 0 0.0
Anopheles squamosus 1 1 100.0 0 0 0.0
CDC-LT Anopheles arabiensis 15 15 100.0 0 0 0.0
Anopheles coustani 0 0 0.0 0 0 0.0
Anopheles funestus group 82 74 90.2 43 5 11.6
Anopheles gambiae s.s. 3 3 100.0 0 0 0.0
Anopheles moucheti 0 0 0.0 0 0 0.0
Anopheles pretoriensis 0 0 0.0 0 0 0.0
Anopheles squamosus 0 0 0.0 0 0 0.0

*HLC: Human landing catches; CDC-LT: CDC light trap, %: Proportion per 100, N & n: number of mosquitoes collected.

Figure 5.

Figure 5.

Panel A shows a scatter plot of estimated insecticide treated net (ITN) effectiveness and the proportion of Anopheles mosquitoes collected outdoors. Panel B shows a scatter plot of ITN effectiveness against the proportion of Anopheles mosquitoes caught outside of sleeping hours (i.e. < 23:00hrs and > 5:00hrs). Panel C shows a scatter plot of ITN effectiveness against the estimated mean exposure π s.

Human behaviour

Seventy three percent of children <5 years were reported to be asleep between 6 pm and 9 pm, these rose monotonically over the course of the night reaching 100% by 10 pm ( Table 4 & Figure 6). A similar trend was observed in areas of high and low ITN effectiveness ( Supplementary Table 3 & Supplementary Table 4). Children aged between 6–14 years spent more time awake, only 45% were asleep before 9 pm ( Figure 6 & Supplementary Table 5). The timing of human activity and sleeping behaviour in particular modulates the effect of human-mosquito contact and the effectiveness of ITN. We quantified the interaction between mosquitoes and humans to evaluate whether outdoor vector biting is a potential explanation for the variation in ITN effectiveness. The peak biting activity for each mosquito vector is illustrated in Figure 7. Clearly higher indoor biting activity was observed among the An. funestus group. The overall propensity to feed at times when most people were asleep was high in the An. funestus group and An. gambiae s.l., except for other Anopheles ( Figure 8): the vast majority of the Anopheles mosquitoes were caught at times when most people are indoors asleep ( Figure 7). Estimates for the proportion of human-mosquito contact between the first and last hour when most humans were asleep was consistently high across all locations, ranging from 0.83 to 1.00 ( Figure 5C). The estimated proportion of exposure to Anopheles mosquito bites that occurred indoor was high.

Table 4. Estimated fraction of human exposure to mosquito bites occurring indoor and outdoor among children <5 years using Equation 1 overall.

Time of the
night
Proportion of
children
<5 years
asleep
Mosquitoes
caught
indoors
Mosquitoes
caught
outdoors
Weighted mean
indoor biting rates
by the proportion
of children
<5 years reporting
to be asleep
Weighted
mean outdoor
biting rates by
the proportion
of children
<5 years not
yet asleep
Estimation of
the fraction of
human exposure
which LLIN can
realistically confer
direct personal
protection
Estimation of
the fraction
of human
exposure
which occurs
outdoors
6pm–7pm 0.06 2 6 0.12 5.64 0.02 0.98
7pm–8pm 0.31 3 6 0.93 4.14 0.18 0.82
8pm–9pm 0.73 3 7 2.19 1.89 0.54 0.46
9pm–10pm 0.97 5 9 4.85 0.27 0.95 0.05
10pm–11pm 1.00 4 12 4.00 0.00 1.00 0.00
11pm–12am 1.00 8 20 8.00 0.00 1.00 0.00
12am–1am 1.00 9 15 9.00 0.00 1.00 0.00
1am–2am 1.00 8 20 8.00 0.00 1.00 0.00
2am–3am 1.00 11 12 11.00 0.00 1.00 0.00
3am–4am 1.00 22 18 22.00 0.00 1.00 0.00
4am–5am 1.00 29 14 29.00 0.00 1.00 0.00
5am–6am 0.93 14 11 13.02 0.77 0.94 0.06
Total (π s) 118 150 112.11 12.71 0.90 0.10

Assuming sleeping time = time indoor (this gives the lower bound fraction human exposure that can be reduced by LLINs)

Figure 6. Proportion of children asleep at each hour of the night.

Figure 6.

Figure 7. Hourly biting pattern of Anopheles mosquitoes occurring both indoors (solid lines) and outdoors (dashed lines) for the 3 separate taxa and overall.

Figure 7.

The grey area represents the proportion of the children < 5 years asleep at each hour of the night.

Figure 8. Estimated mean exposure indoor and outdoor for 3 separate taxa and for all Anopheles in the six geographical areas among children <5 years.

Figure 8.

Discussion

Malaria transmission has reduced dramatically over the last 15 years in Kilifi, evidenced by falling rates of clinical malaria cases in hospital 31, 32, in the community 46 and falling community prevalence of asymptomatic infection 47. A recent resurgence has been noted with increasing cases among older children, and increasing prevalence of infection more widely around the coast 31, 34. The reductions have been temporally associated with marked reductions in the prevalence of the abundance of vectors 22 and with a pronounced shift away from Anopheles gambiae s.s, which was previously the dominant vector, and towards Anopheles arabiensis in terms of relative abundance. In addition, many countries, including Kenya, have attempted to reduce this burden by increasing ITN ownership and usage 48, 49. However, previous reports have shown that prolonged ITN use leads to behavioral shifts in the mosquito vector from indoor to outdoor biting or feeding in the early part of the evening 6, 22, 27, 50. This shift in mosquito feeding behavior might be expected to limit the effectiveness of ITNs. We identified geographical variation in the effectiveness of ITN and identified areas where ITN effectiveness was found to be consistent with the 50% estimate reported in the literature 11, 51, 52, and other areas where ITNs were less effective ( Figure 3A). This variation could conceivably have arisen as a result of variations in quality of ITNs, the physical integrity of ITNs, patterns of use, host resistance, insecticide resistance, bioefficacy of the insecticidal compounds or other factors, including random variation. We sought to investigate whether variations in outdoor vector biting was a potential explanation.

We found that An. funestus group was more prevalent than An. gambiae s.l. species complex, consistent with previous report 22. Among An. gambiae s.l. species complex, An. arabiensis was more prevalent, which is known to be capable of feeding extensively on humans early in the evenings, before humans go indoors 17, 53. This shift in sibling species composition has previously been reported 6, 22. We observed small-scale spatial variability in vector abundance ( Table 2), which is consistent with previous reports on the Kenyan Coast 20, 54. We also observed a higher proportion of mosquito vectors collected outside of sleeping hours, in areas of both high and low ITN effectiveness ( Figure 5B). On first principles one would expect that outdoor exposure would limit ITNs effectiveness. However, despite seeing more mosquitoes caught outside of sleeping hours throughout the study area this did not appear to be associated with an overall reduction in ITN effectiveness. The trend towards outdoor exposure was of modest epidemiological significance and is within the normal range of variation for these vectors 55. The captured microheterogeneity of the estimated mean exposure or mosquitoes caught outside of sleeping hours does not clearly explain the microheterogeneity in ITN effectiveness ( Figure 5A–C). We may have observed an apparently statistically significant increase in the abundance of mosquitoes caught outdoor in areas of low ITN effectiveness. However, this was due to a single outlying geographical area and there was no variation in abundance of mosquitoes caught outdoor after this area was excluded. This suggests the statistical significance of the initial comparison may have been due to ecological confounding, where a geographical area with high ITN effectiveness happened to have more indoor mosquitoes, but this relationship was not confirmed in other areas ( Figure 5A). We also did not find a clear role of either vector in driving the heterogeneity observed ( Figure 3C & Supplementary Figure 2).

It is possible that the higher proportion of mosquitoes caught outdoors/outside of sleeping hours represents a behavioral response to unsuccessful feeding attempts made indoors during the night, and therefore it may simply be a marker of successful ITN use. This avoidance behavior may exert a cost on the vector, and so ITNs may in fact still be protective in areas where outdoor exposure is observed, as has been suggested previously 30. Furthermore, outdoor exposure and the probability of successful feeding outside of sleeping hours cannot be directly inferred from the human landing catches, since the landing catches are not in themselves sufficient to survey pattern of normal human exposure to mosquito bite. Once adjusted for human behaviour, most human-vector interaction in this study occurred indoors ( Figure 8). Outdoor exposure is currently not a major factor influencing residual malaria transmission since 95% of the population are indoors at the peak biting period for malaria vector mosquitoes. Human behaviour is the primary driver of when and where exposure occurs and is far more variable than the mosquito behaviour that matter within a single vector species 55.

Spatial heterogeneity in malaria exposure has been described at micro-epidemiological level at varying transmission settings 56 and is responsible for variations in disease risk within small geographical areas and is evidenced by local clustering of malaria infections. The observed geographical variation in ITN effectiveness therefore remains unexplained. Possibilities include insecticide resistance, or geographical variations in human behaviour in terms of ITN use. While it is also possible that non-linearity in the relationship between transmission intensity and clinical episodes could explain the variations in ITN effectiveness, we did not identify a consistent relationship between ITN effectiveness and transmission intensity ( Figure 3B). Furthermore we identified statistical evidence of effect modification between geographical location and ITN effectiveness (p=0.016), suggesting that lack of power in selected geographical locations is unlikely to be the explanation for variation.

Our study has some limitations. Data on ITN use may have been incorrectly reported, as we did not require each resident to be present during the survey. We attempted to minimize this by instructing data collecting teams to interview only residents of the same homestead regarding ITN ownership and usage. There may have been some misclassification as we did not ascertain ITN use during hospital presentation but instead used the yearly ITN data collected by the annual survey. The results may also be biased and confounded by other unmeasured factors (e.g., variation in the quality and type of ITN, urbanization, socio-economic status and mother’s education). It is likely that we underestimated the protection afforded by the use of high-quality ITN because we included all ITNs, regardless of quality, physical integrity or bioefficacy of the insecticidal compounds. The vast majority of ITNs in the area are long-lasting insecticidal nets, hence we do not expect substantial variation in insecticidal efficacy. The accuracy of the mosquito survey is limited by the practical challenges of maintaining consistently sensitive human landing catches throughout the night. Lack of explicit molecular data for distinguishing sibling species and molecular forms within the An. funestus group introduces ambiguity into the interpretation of the results of the study. In addition boiling and retesting CSP could be done to increase specificity of the ELISA results. In this study, we examined variations in the personal protection afforded by ITNs and did not examine variation in community level effect. The size of our study limits power: with a sample size of 415, and the proportion of mosquitoes biting outdoors at 67% in low ITN effectiveness areas we therefore had >90% power to detect a reduction to 27% or lower in high ITN effectiveness areas. Our study was therefore powered to detect only a large difference in the proportion of vectors caught outdoors. However, we reasoned that reductions of ITN effectiveness to less than half of the previously documented efficacy of 50% would require a doubling of the proportion of mosquitoes feeding outdoors. Hence our study was powered to detect large variations in the frequency of outdoor exposure. In addition, the accuracy of mosquito sampling data is limited as only one month of sampling was conducted in this study, we recommend sampling for a longer duration of time.

In summary, our data do not provide evidence of an epidemiological association between microgeographical variations in ITN effectiveness and variations in the microgeographical distribution of outdoor exposure. The outdoor exposure observed may therefore have been the result of high levels of ITN use leading to unsuccessful attempts at indoor feeding. However, it remains possible that continued selection pressures might lead to the emergence of populations of mosquitoes that are better adapted to outdoor feeding in the future. Outdoor feeding is becoming more common in parts of Africa 57 and may represent evolutionary change in some areas, with a potential to undermine ITN effectiveness. With outdoor fractions of transmission being so low, and individual human behavior being so heterogenous, it may be expected to be epidemiologically detectable only once indoor transmission has been more effectively tackled and individual-level estimates of exposure distributions are measured 19, 58. Therefore, malaria control programs require monitoring to assess the impact of ITNs on vector populations and vector behavioral change as well as monitoring ITN effectiveness as vectors evolve 6, 23, 2628. Continuous monitoring of vector bionomics, and malaria transmission dynamics are essential for predicting disease outbreaks and guiding vector control in the region. Furthermore, capacity needs to be built in interpreting and applying these data to malaria control policy.

Ethical approval

This study was approved by the Kenya Medical Research Institute Scientific Ethics Review Unit (KEMRI/SERU/CGMR-C/024/3148). Written informed consent was obtained from the parents/guardians of the children attending the dispensary.

Data availability

Data that support the findings of this study (hospital surveillance, ITN community surveys and mosquito collection) are available from the KEMRI Institutional Data Access/Ethics Committee, for researchers who meet the criteria for access to confidential data. Details of the criteria can be found in the KEMRI-Wellcome data sharing guidelines. The data includes homestead level coordinates as an essential component and these are personally identifiable data. Access to data is provided via the KEMRI-Wellcome Data Governance Committee: Data_Governance_Committee@kemriwellcome.org; Tel, +254708 587 210; Contact person, Marianne Munene (Secretary; Tel, +254709 983 436).

Acknowledgements

We are grateful to the entomology field workers, Festus Yaa, Gabriel Nzae and David Shida, who helped with the fieldwork implementation of the study.

This paper is published with the permission of the Director of KEMRI.

Funding Statement

This work was supported by the Wellcome Trust [104015] and WHO-TDR [B40442].

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 4; referees: 1 approved, 3 approved with reservations]

Supplementary material

Supplementary Table 1: The odds ratio and 95% CI of the univariate and multivariate logistic regression with robust standard errors. Data includes the stratum specific adjusted Odds Ratio (aOR) and the Confidence Interval (95% CI); ‡ areas with fewer than 35 observations were excluded from the logistic regression due to perfect prediction and/or collinearity.

Supplementary Table 2: Composition of the mosquito species in six geographical areas. Data includes number of Anopheles mosquitoes collected by human landing catches (HLC) and CDC light trap (CDC-LT) indoor or outdoor in the six geographical areas, and the overall proportion.

Supplementary Table 3: Estimated fraction of human exposure to mosquito bites occurring indoor and outdoor among children <5 years using Equation 1 in the high ITN effectiveness areas.
Supplementary Table 4: Estimated fraction of human exposure to mosquito bites occurring indoor and outdoor among children <5 years using Equation 1 in the low ITN effectiveness areas.
Supplementary Table 5: Estimated fraction of human exposure to mosquito bites occurring indoor and outdoor among children 6–14 years using Equation 1 overall.
Supplementary Figure 1: Bar graph of the proportion of Anopheles mosquito species collected in areas of low and high insecticide treated net (ITN) effectiveness.
Supplementary Figure 2: A scatter plot of malaria prevalence and the densities of each taxon.

References

  • 1. Cibulskis RE, Aregawi M, Williams R, et al. : Worldwide incidence of malaria in 2009: estimates, time trends, and a critique of methods. PLoS Med. 2011;8(12):e1001142. 10.1371/journal.pmed.1001142 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Nkumama IN, O'Meara WP, Osier FH: Changes in Malaria Epidemiology in Africa and New Challenges for Elimination. Trends Parasitol. 2017;33(2):128–140. 10.1016/j.pt.2016.11.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Snow RW, Guerra CA, Noor AM, et al. : The global distribution of clinical episodes of Plasmodium falciparum malaria. Nature. 2005;434(7030):214–217. 10.1038/nature03342 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. WHO: World malaria report. World Health Organization. 2015. Reference Source [Google Scholar]
  • 5. Gething PW, Patil AP, Smith DL, et al. : A new world malaria map: Plasmodium falciparum endemicity in 2010. Malar J. 2011;10:378. 10.1186/1475-2875-10-378 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Russell TL, Govella NJ, Azizi S, et al. : Increased proportions of outdoor feeding among residual malaria vector populations following increased use of insecticide-treated nets in rural Tanzania. Malar J. 2011;10:80. 10.1186/1475-2875-10-80 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Walker PG, Griffin JT, Ferguson NM, et al. : Estimating the most efficient allocation of interventions to achieve reductions in Plasmodium falciparum malaria burden and transmission in Africa: a modelling study. Lancet Glob Health. 2016;4(7):e474–484. 10.1016/S2214-109X(16)30073-0 [DOI] [PubMed] [Google Scholar]
  • 8. Gimnig JE, Vulule JM, Lo TQ, et al. : Impact of permethrin-treated bed nets on entomologic indices in an area of intense year-round malaria transmission. Am J Trop Med Hyg. 2003;68(4 Suppl):16–22. 10.4269/ajtmh.2003.68.16 [DOI] [PubMed] [Google Scholar]
  • 9. Howard SC, Omumbo J, Nevill C, et al. : Evidence for a mass community effect of insecticide-treated bednets on the incidence of malaria on the Kenyan coast. Trans R Soc Trop Med Hyg. 2000;94(4):357–360. 10.1016/S0035-9203(00)90103-2 [DOI] [PubMed] [Google Scholar]
  • 10. Lindblade KA, Eisele TP, Gimnig JE, et al. : Sustainability of reductions in malaria transmission and infant mortality in western Kenya with use of insecticide-treated bednets: 4 to 6 years of follow-up. JAMA. 2004;291(21):2571–2580. 10.1001/jama.291.21.2571 [DOI] [PubMed] [Google Scholar]
  • 11. Lengeler C: Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database Syst Rev. 2004; (2):CD000363. 10.1002/14651858.CD000363.pub2 [DOI] [PubMed] [Google Scholar]
  • 12. Binka FN, Hodgson A, Adjuik M, et al. : Mortality in a seven-and-a-half-year follow-up of a trial of insecticide-treated mosquito nets in Ghana. Trans R Soc Trop Med Hyg. 2002;96(6):597–599. 10.1016/S0035-9203(02)90321-4 [DOI] [PubMed] [Google Scholar]
  • 13. Noor AM, Moloney G, Borle M, et al. : The use of mosquito nets and the prevalence of Plasmodium falciparum infection in rural South Central Somalia. PLoS One. 2008;3(5):e2081. 10.1371/journal.pone.0002081 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Phillips-Howard PA, Nahlen BL, Kolczak MS, et al. : Efficacy of permethrin-treated bed nets in the prevention of mortality in young children in an area of high perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2003;68(4 Suppl):23–29. 10.4269/ajtmh.2003.68.23 [DOI] [PubMed] [Google Scholar]
  • 15. Snow RW, Rowan KM, Greenwood BM: A trial of permethrin-treated bed nets in the prevention of malaria in Gambian children. Trans R Soc Trop Med Hyg. 1987;81(4):563–567. 10.1016/0035-9203(87)90408-1 [DOI] [PubMed] [Google Scholar]
  • 16. ter Kuile FO, Terlouw DJ, Kariuki SK, et al. : Impact of permethrin-treated bed nets on malaria, anemia, and growth in infants in an area of intense perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2003;68(4 Suppl):68–77. 10.4269/ajtmh.2003.68.68 [DOI] [PubMed] [Google Scholar]
  • 17. Killeen GF, Govella NJ, Lwetoijera DW, et al. : Most outdoor malaria transmission by behaviourally-resistant Anopheles arabiensis is mediated by mosquitoes that have previously been inside houses. Malar J. 2016;15:225. 10.1186/s12936-016-1280-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Govella NJ, Chaki PP, Killeen GF: Entomological surveillance of behavioural resilience and resistance in residual malaria vector populations. Malar J. 2013;12:124. 10.1186/1475-2875-12-124 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Bradley J, Lines J, Fuseini G, et al. : Outdoor biting by Anopheles mosquitoes on Bioko Island does not currently impact on malaria control. Malar J. 2015;14:170. 10.1186/s12936-015-0679-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Mbogo CN, Baya NM, Ofulla AV, et al. : The impact of permethrin-impregnated bednets on malaria vectors of the Kenyan coast. Med Vet Entomol. 1996;10(3):251–259. 10.1111/j.1365-2915.1996.tb00739.x [DOI] [PubMed] [Google Scholar]
  • 21. Moiroux N, Damien GB, Egrot M, et al. : Human exposure to early morning Anopheles funestus biting behavior and personal protection provided by long-lasting insecticidal nets. PLoS One. 2014;9(8):e104967. 10.1371/journal.pone.0104967 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Mwangangi JM, Mbogo CM, Orindi BO, et al. : Shifts in malaria vector species composition and transmission dynamics along the Kenyan coast over the past 20 years. Malar J. 2013;12:13. 10.1186/1475-2875-12-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Bayoh MN, Mathias DK, Odiere MR, et al. : Anopheles gambiae: historical population decline associated with regional distribution of insecticide-treated bed nets in western Nyanza Province, Kenya. Malar J. 2010;9:62. 10.1186/1475-2875-9-62 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Killeen GF, Marshall JM, Kiware SS, et al. : Measuring, manipulating and exploiting behaviours of adult mosquitoes to optimise malaria vector control impact. BMJ Glob Health. 2017;2(2):e000212. 10.1136/bmjgh-2016-000212 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Lindblade KA, Gimnig JE, Kamau L, et al. : Impact of sustained use of insecticide-treated bednets on malaria vector species distribution and culicine mosquitoes. J Med Entomol. 2006;43(2):428–432. 10.1093/jmedent/43.2.428 [DOI] [PubMed] [Google Scholar]
  • 26. Mutuku FM, King CH, Mungai P, et al. : Impact of insecticide-treated bed nets on malaria transmission indices on the south coast of Kenya. Malar J. 2011;10:356. 10.1186/1475-2875-10-356 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Killeen GF, Kihonda J, Lyimo E, et al. : Quantifying behavioural interactions between humans and mosquitoes: evaluating the protective efficacy of insecticidal nets against malaria transmission in rural Tanzania. BMC Infect Dis. 2006;6:161. 10.1186/1471-2334-6-161 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Gimnig JE, Kolczak MS, Hightower AW, et al. : Effect of permethrin-treated bed nets on the spatial distribution of malaria vectors in western Kenya. Am J Trop Med Hyg. 2003;68(4 Suppl):115–120. 10.4269/ajtmh.2003.68.115 [DOI] [PubMed] [Google Scholar]
  • 29. Charlwood JD, Alcantara J, Pinto J, et al. : Do bednets reduce malaria transmission by exophagic mosquitoes? Trans R Soc Trop Med Hyg. 2005;99(12):901–904. 10.1016/j.trstmh.2005.05.011 [DOI] [PubMed] [Google Scholar]
  • 30. Govella NJ, Okumu FO, Killeen GF: Insecticide-treated nets can reduce malaria transmission by mosquitoes which feed outdoors. Am J Trop Med Hyg. 2010;82(3):415–419. 10.4269/ajtmh.2010.09-0579 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Mogeni P, Williams TN, Fegan G, et al. : Age, Spatial, and Temporal Variations in Hospital Admissions with Malaria in Kilifi County, Kenya: A 25-Year Longitudinal Observational Study. PLoS Med. 2016;13(6):e1002047. 10.1371/journal.pmed.1002047 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. O'Meara WP, Bejon P, Mwangi TW, et al. : Effect of a fall in malaria transmission on morbidity and mortality in Kilifi, Kenya. Lancet. 2008;372(9649):1555–1562. 10.1016/S0140-6736(08)61655-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Okiro EA, Alegana VA, Noor AM, et al. : Malaria paediatric hospitalization between 1999 and 2008 across Kenya. BMC Med. 2009;7:75. 10.1186/1741-7015-7-75 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Snow RW, Kibuchi E, Karuri SW, et al. : Changing Malaria Prevalence on the Kenyan Coast since 1974: Climate, Drugs and Vector Control. PLoS One. 2015;10(6):e0128792. 10.1371/journal.pone.0128792 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Scott JA, Bauni E, Moisi JC, et al. : Profile: The Kilifi Health and Demographic Surveillance System (KHDSS). Int J Epidemiol. 2012;41(3):650–657. 10.1093/ije/dys062 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Kamau A, Nyaga V, Bauni E, et al. : Trends in bednet ownership and usage, and the effect of bednets on malaria hospitalization in the Kilifi Health and Demographic Surveillance System (KHDSS): 2008–2015. BMC Infect Dis. 2017;17(1):720. 10.1186/s12879-017-2822-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Wirtz RA, Zavala F, Charoenvit Y, et al. : Comparative testing of monoclonal antibodies against Plasmodium falciparum sporozoites for ELISA development. Bull World Health Organ. 1987;65(1):39–45. [PMC free article] [PubMed] [Google Scholar]
  • 38. Koekemoer LL, Kamau L, Hunt RH, et al. : A cocktail polymerase chain reaction assay to identify members of the Anopheles funestus (Diptera: Culicidae) group. Am J Trop Med Hyg. 2002;66(6):804–811. 10.4269/ajtmh.2002.66.804 [DOI] [PubMed] [Google Scholar]
  • 39. Scott JA, Brogdon WG, Collins FH: Identification of single specimens of the Anopheles gambiae complex by the polymerase chain reaction. Am J Trop Med Hyg. 1993;49(4):520–529. 10.4269/ajtmh.1993.49.520 [DOI] [PubMed] [Google Scholar]
  • 40. Royston P, Sauerbrei W: Building multivariable regression models with continuous covariates in clinical epidemiology--with an emphasis on fractional polynomials. Methods Inf Med. 2005;44(4):561–571. 10.1055/s-0038-1634008 [DOI] [PubMed] [Google Scholar]
  • 41. Sauerbrei W, Meier-Hirmer C, Benner A, et al. : Multivariable regression model building by using fractional polynomials: description of SAS, STATA and R programs. Comput Stat Data An. 2006;50(12):3464–3485. 10.1016/j.csda.2005.07.015 [DOI] [Google Scholar]
  • 42. Kezdi G: Robust Standard Error Estimation in Fixed-Effects Panel Models. Commun Statist Theory Meth. 2003. 10.2139/ssrn.596988 [DOI] [Google Scholar]
  • 43. Kulldorff M: A spatial scan statistic. Commun Stat Theory Methods. 1997;26(6):1481–1496. 10.1080/03610929708831995 [DOI] [Google Scholar]
  • 44. Seyoum A, Sikaala CH, Chanda J, et al. : Human exposure to anopheline mosquitoes occurs primarily indoors, even for users of insecticide-treated nets in Luangwa Valley, South-east Zambia. Parasit Vectors. 2012;5:101. 10.1186/1756-3305-5-101 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45. Bermejo A, Veeken H: Insecticide-impregnated bed nets for malaria control: a review of the field trials. Bull World Health Organ. 1992;70(3):293–296. [PMC free article] [PubMed] [Google Scholar]
  • 46. Mwangi TW, Ross A, Snow RW, et al. : Case definitions of clinical malaria under different transmission conditions in Kilifi District, Kenya. J Infect Dis. 2005;191(11):1932–1939. 10.1086/430006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47. Mogeni P, Williams TN, Omedo I, et al. : Detecting Malaria Hotspots: A Comparison of Rapid Diagnostic Test, Microscopy, and Polymerase Chain Reaction. J Infect Dis. 2017;216(9):1091–1098. 10.1093/infdis/jix321 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Fegan GW, Noor AM, Akhwale WS, et al. : Effect of expanded insecticide-treated bednet coverage on child survival in rural Kenya: a longitudinal study. Lancet. 2007;370(9592):1035–1039. 10.1016/S0140-6736(07)61477-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Noor AM, Mutheu JJ, Tatem AJ, et al. : Insecticide-treated net coverage in Africa: mapping progress in 2000–07. Lancet. 2009;373(9657):58–67. 10.1016/S0140-6736(08)61596-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50. Moiroux N, Gomez MB, Pennetier C, et al. : Changes in Anopheles funestus biting behavior following universal coverage of long-lasting insecticidal nets in Benin. J Infect Dis. 2012;206(10):1622–1629. 10.1093/infdis/jis565 [DOI] [PubMed] [Google Scholar]
  • 51. Nevill CG, Some ES, Mung'ala VO, et al. : Insecticide-treated bednets reduce mortality and severe morbidity from malaria among children on the Kenyan coast. Trop Med Int Health. 1996;1(2):139–146. 10.1111/j.1365-3156.1996.tb00019.x [DOI] [PubMed] [Google Scholar]
  • 52. Phillips-Howard PA, Nahlen BL, Alaii JA, et al. : The efficacy of permethrin-treated bed nets on child mortality and morbidity in western Kenya I. Development of infrastructure and description of study site. Am J Trop Med Hyg. 2003;68(4 Suppl):3–9. 10.4269/ajtmh.2003.68.3 [DOI] [PubMed] [Google Scholar]
  • 53. Yohannes M, Boelee E: Early biting rhythm in the Afro-tropical vector of malaria, Anopheles arabiensis, and challenges for its control in Ethiopia. Med Vet Entomol. 2012;26(1):103–105. 10.1111/j.1365-2915.2011.00955.x [DOI] [PubMed] [Google Scholar]
  • 54. Mbogo CM, Mwangangi JM, Nzovu J, et al. : Spatial and temporal heterogeneity of Anopheles mosquitoes and Plasmodium falciparum transmission along the Kenyan coast. Am J Trop Med Hyg. 2003;68(6):734–742. 10.4269/ajtmh.2003.68.734 [DOI] [PubMed] [Google Scholar]
  • 55. Huho B, Briet O, Seyoum A, et al. : Consistently high estimates for the proportion of human exposure to malaria vector populations occurring indoors in rural Africa. Int J Epidemiol. 2013;42(1):235–247. 10.1093/ije/dys214 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56. Kreuels B, Kobbe R, Adjei S, et al. : Spatial variation of malaria incidence in young children from a geographically homogeneous area with high endemicity. J Infect Dis. 2008;197(1):85–93. 10.1086/524066 [DOI] [PubMed] [Google Scholar]
  • 57. Githeko AK, Adungo NI, Karanja DM, et al. : Some observations on the biting behavior of Anopheles gambiae s.s., Anopheles arabiensis, and Anopheles funestus and their implications for malaria control. Exp Parasitol. 1996;82(3):306–315. 10.1006/expr.1996.0038 [DOI] [PubMed] [Google Scholar]
  • 58. Msellemu D, Namango HI, Mwakalinga VM, et al. : The epidemiology of residual Plasmodium falciparum malaria transmission and infection burden in an African city with high coverage of multiple vector control measures. Malar J. 2016;15(1):288. 10.1186/s12936-016-1340-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2018 Dec 4. doi: 10.21956/wellcomeopenres.16305.r34367

Referee response for version 4

Gerry F Killeen 1

While I might be tempted to mention the potential role of vector taxonomic heterogeneity (eg varying composition of the An. funestus group) as a possible determinant of effectiveness heterogeneities, this is otherwise this is a very fine piece of work and very balanced in terms of interpretation. The authors are to be congratulated for their rigour, commitment and persistence.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2018 Nov 14. doi: 10.21956/wellcomeopenres.16269.r34232

Referee response for version 3

Gerry F Killeen 1

OVERALL

This revision is a vast improvement, reflecting an impressive commitment by the authors to getting the science right and making the most of this important study. Still some important opportunities for improvement, however, so I provide some substantive but hopefully final comments. I know this has been a long, tough road for the authors on a very detailed manuscript, but I’d encourage them to give this one last solid revision.

MAJOR COMMENTS

While the Y axis label of figure 8 looks correct, the numbers plotted look like the proportion of exposure for each hour rather than the absolute rate of exposure. The latter is what is needed (columns 5 and 6 from table 4) and will make this figure not only more accurate, but also far more appealing and easy to digest. The current version, based on columns 3 and 4 of table 2 is misleading and over-represents the significance of the outdoor biting in the early evening because they are lower, so the relative size of the areas under these two stacked lines don’t match the estimate for π s at the top of the graph which is correct. Just use columns 5 and 6, and this will look very nice and match well to both the numerical estimates of proportional exposure in table 4 and similar graphs and estimates from elsewhere in Africa.

Like figure 7, figure 8 should include separate panels for different Anopheles taxa. Given that there’s so few PCR-identified gambiae and no clear difference in behaviour obvious in the figure 7 graphs, I would tend to merge An. arabiensis and An. gambiae ss into a single panel for An. gambiae complex. I would also retain the An funestus group panel and other Anopheles panel, but add All Anopheles as the fourth panel. The taxonomic breakdown of the 4 panels in figures 7 and 8 should be the same, so that the two figures are consistent and readily comparable. With columns 5 and 6 of table 4 (or equivalent for that particular taxon) being used for all the plots in figure 8, it will also be easier to get exposure rates to the 4 different vector taxa into clearer perspective as the biting rates are in the current figure 7. I think supplementary figure 3 probably contains the required content (albeit in need of correction for exposure rate rather than proportion), but I couldn’t open this EPS format and suggest this kind of material belongs in the main manuscript.

For similar reasons, I would like to also see numbers for An. gambiae sl in table 2. Incidentally, I would find table 2 easier to read if the percentages came before n, or were presented with one decimal place of precision and/or a % sign.

What you’ve calculated is indeed π s rather than π i , and that was the right choice in this case, so you should be consistent in how you describe it in words throughout the narrative: “..while asleep..” rather than “.. while indoors..” as per the abstract, and perhaps we more specific about the assumptions underlying the interpretation elsewhere in the text: “..while asleep, presumably indoors..”?

I like supplementary figure 1 and would suggest including in the main manuscript. In fact, wouldn’t it render the current figure 3 redundant, or make a nice second panel in that figure? I’d also like to see additional panels (and associated statistical tests) in this figure with An. funestus sl density, An gambiae sl density, Other Anopheles, and All Anopheles as the X-axes.  

An additional figure with plots of prevalence versus densities of each taxon would also be valuable, and can be put in the supplementary material if nothing interesting is obvious. While it’s nice to look at behaviours, perhaps the simplest explanation that has been observed elsewhere is variations in vector density.

Figure 5 and associated text is very useful, but the proportion of mosquitoes caught outdoors (exophagy) is not usually the driver of unpreventable human exposure, but rather the proportion caught outside of sleeping hours (crepuscularity)-See Huho 2013. So I’d recommend adding a panel to this figure with this perhaps more relevant metric on the x-axis, as well as a third for overall π i capturing the combined outcome of both parameters in each location. On that theme, the narrative “The statistical trend towards outdoor biting was of modest epidemiological significance…” is accurate but needs clearer explanation for the average reader.

This interpretational misalignment is also reflected in the discussion, a few lines from the end of page 13: “..Our study was therefore powered to detect only a large difference in the proportion of vectors caught outdoors.”. Please digest Huho et al 2013 carefully and then rephrase to give the proportions caught during/outside of sleeping hours at least as much emphasis. Similarly, the opening sentence of page 14 “outdoor biting” might be better rephrased as “outdoor exposure”, and similar phrases throughout that closing paragraph also carefully adjusted for accuracy and clarity?

Final paragraph of background: Be aware of the fact that An. arabiensis (not “arabienses”) exhibits at least three behaviours that can enable residual transmission: In addition to feeding outdoors (usually achieved by biting early), it can also survive by attacking animals or through repeated, cautious foraging inside houses until an unprotected non-user is found. See the background section of Malaria Journal 15: 255 for a brief overview.

While I know I suggested that “It is also possible that nonlinearity in the relationship between transmission intensity and clinical episodes explains the variations in ITN effectiveness.”, I think supplementary figure 1 rules out that explanation, so you should say so and this is just one more reason to move this into the main text as an extra panel in figure 3.

In the closing paragraph of the discussion, I’d suggest the following additional words: “WITH outdoor fractions of transmission BEING SO LOW, AND INDIVIDUAL HUMAN BEHAVIOUR BEING SO HETEROGENOUS, it MAY be expected to be epidemiologically detectable ONLY once indoor transmission has been MORE EFFECTIVELY tackled AND INDIVIDUAL-LEVEL ESTIMATES OF EXPOSURE DISTRIBUTIONS ARE MEASURED.” For the last point, cite Msellemu 2016 and Bradley 2015.

SUNDRY MINOR CORRECTIONS AND SUGGESTIONS

Closing sentence of the results, suggest “was consistently high ACROSS ALL LOCATIONS…”.

Third sentence, first paragraph of discussion: Looks like a simple editing mistake. Also best to avoid suggesting and increase in absolute rather than just relative abundance of An. arabiensis. I suggest: “…a pronounced shift away from Anopheles gambiae s.s, which was previously the dominant vector, and TOWARDS Anopheles arabiensis IN TERMS OF RELATIVE ABUNDANCE.”

End of first paragraph on page 10, a minor grammatical error: “….sought to investigate whether…” rather than “…sought to investigateD whether..”

The terms “significant”, “significantly different” etc are rather over-used redundantly. In scientific writing, one doesn’t state any difference unless it’s statistically significant so the statement that one thing is greater or lesser than another or that there’s a trend infers significance unless stated otherwise, and the P value provided in brackets, table etc adds the evidence to support such a statement of difference or trend.

When talking about absolute mosquito densities per se, I think the terms “abundant”/”abundance” and more appropriate than “prevalence”/”prevalent”, which suggests a proportion. Suggest correcting throughout.

Without boiling and retesting for CSP, the ELISA results are a little questionable 1, especially for any zoophagic non-vectors or secondary vectors, and this study limitation should be acknowledged.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. Durnez L, Van Bortel W, Denis L, Roelants P, Veracx A, Trung HD, Sochantha T, Coosemans M: False positive circumsporozoite protein ELISA: a challenge for the estimation of the entomological inoculation rate of malaria and for vector incrimination. Malar J.2011;10: 10.1186/1475-2875-10-195 195 10.1186/1475-2875-10-195 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2018 Nov 27.
Alice Kamau 1

Dear Dr. Gerry F. Killeen,

We are very grateful to Prof. Killen for reviewing our manuscript, “Variation in the effectiveness of insecticide treated nets against malaria and outdoor biting by vectors in Kilifi, Kenya” and providing insightful and useful comments this far. We respond below to the points raised, indicating the reviewer’s points with “Q” and our responses by “A” in bold.

Reviews /comments:

Specific Questions

Q1) While the Y axis label of figure 8 looks correct, the numbers plotted look like the proportion of exposure for each hour rather than the absolute rate of exposure. The latter is what is needed (columns 5 and 6 from table 4) and will make this figure not only more accurate, but also far more appealing and easy to digest. The current version, based on columns 3 and 4 of table 2 is misleading and over-represents the significance of the outdoor biting in the early evening because they are lower, so the relative size of the areas under these two stacked lines don’t match the estimate for π at the top of the graph which is correct. Just use columns 5 and 6, and this will look very nice and match well to both the numerical estimates of proportional exposure in table 4 and similar graphs and estimates from elsewhere in Africa.

A1: We have adjusted the figure accordingly, see New Figure 8.

Q2) Like figure 7, figure 8 should include separate panels for different Anopheles taxa. Given that there’s so few PCR-identified gambiae and no clear difference in behaviour obvious in the figure 7 graphs, I would tend to merge An. arabiensis and An. gambiae ss into a single panel for An. gambiae complex. I would also retain the An funestus group panel and other Anopheles panel, but add All Anopheles as the fourth panel. The taxonomic breakdown of the 4 panels in figures 7 and 8 should be the same, so that the two figures are consistent and readily comparable. With columns 5 and 6 of table 4 (or equivalent for that particular taxon) being used for all the plots in figure 8, it will also be easier to get exposure rates to the 4 different vector taxa into clearer perspective as the biting rates are in the current figure 7. I think supplementary figure 3 probably contains the required content (albeit in need of correction for exposure rate rather than proportion), but I couldn’t open this EPS format and suggest this kind of material belongs

in the main manuscript.

A2: We have adjusted the figures accordingly, see New Figure 7 and New Figure 8.

Q3) For similar reasons, I would like to also see numbers for An. gambiae sl in table 2. Incidentally, I would find table 2 easier to read if the percentages came before n, or were presented with one decimal place of precision and/or a % sign.

A3: We have added the % sign and presented the % to one decimal place. Table 2 contains data obtained from the ELISA-CSP and molecular analysis with the mosquitoes differentiated to species except for An. funestusgroup which we do not have molecular data on.

Q4) What you’ve calculated is indeed π rather than π , and that was the right choice in this case, so you should be consistent in how you describe it in words throughout the narrative: “..while asleep..” rather than “.. while indoors..” as per the abstract, and perhaps we more specific about the assumptions underlying the interpretation elsewhere in the text: “..while asleep, presumably indoors..”?

A4: We have made revision as shown below:

Abstract section

The overall propensity to feed at times when most people were asleep was high; the vast majority of the Anopheles mosquitoes were caught at times when most people are indoors asleep. Estimates for the proportion of human-mosquito contact between the first and last hour when most humans were asleep was consistently high across all locations, ranging from 0.83 to 1.00.

Result section

The overall propensity to feed at times when most people were asleep was high in the An. funestus group and An. gambiae s.l., except for other Anopheles (Figure 8): the vast majority of the Anopheles mosquitoes were caught at times when most people are indoors asleep (Figure 7). Estimates for the proportion of human-mosquito contact between the first and last hour when most humans were asleep was consistently high across all locations, ranging from 0.83 to 1.00 (Figure 5C).  The estimated proportion of exposure to Anopheles mosquito bites that occurred indoor was high.

Q5) I like supplementary figure 1 and would suggest including in the main manuscript. In fact, wouldn’t it render the current figure 3 redundant, or make a nice second panel in that figure? I’d also like to see additional panels (and associated statistical tests) in this figure with An. funestus sl density, An gambiae sl density, Other Anopheles, and All Anopheles as the X-axes.

A5: We have made revision as shown below:

We have moved supplementary figure 1 to the main manuscript as a second panel in figure 3 i.e. Figure 3B and added Figure 3C that shows a scatter plot of the odds ratio of insecticide treated net (ITN) effect and 95% confidence interval of malaria positivity against overall mosquito densities and for the 3 separate taxa.

Result section

An. funestus group was the most prevalent vector in all areas. However, we did not find an association between ITN effectiveness and vector density, Spearman rho coefficient was -0.2, p=0.8 (Figure 3C).

Discussion section

We also did not find a clear role of either vector in driving the heterogeneity observed (Figure 3C & Supplementary Figure 2).

Q6) An additional figure with plots of prevalence versus densities of each taxon would also be valuable, and can be put in the supplementary material if nothing interesting is obvious. While it’s nice to look at behaviours, perhaps the simplest explanation that has been observed elsewhere is variations in vector density.

A6: We have made revision as shown below:

An additional figure with plots of prevalence vs densities of each taxon has been added as Supplementary Figure 2.

Discussion section

We also did not find a clear role of either vector driving the heterogeneity observed (Supplementary Figure 2).

Q7) Figure 5 and associated text is very useful, but the proportion of mosquitoes caught outdoors (exophagy) is not usually the driver of unpreventable human exposure, but rather the proportion caught outside of sleeping hours (crepuscularity)-See Huho 2013. So I’d recommend adding a panel to this figure with this perhaps more relevant metric on the x-axis, as well as a third for overall π capturing the combined outcome of both parameters in each location. On that theme, the narrative “The statistical trend towards outdoor biting was of modest epidemiological significance…” is accurate but needs clearer explanation for the average reader.

A7: We have addressed the above comment as follows:

We have added a graph that shows ITN effectiveness against the proportion of anopheles caught outside of sleeping hours i.e. Figure 5B.

We have also added a graph that shows ITN effectiveness against the estimated mean exposure π s. i.e. Figure 5C.

Result section

Moreover, when we analysed the proportion of mosquitoes caught outside of sleeping hours, <23:00hrs and > 5:00hrs, by individual geographical area there was not a visually obvious trend with decreasing ITN effectiveness in the six geographical areas (Figure 5B), although this association could have been limited by the power of the study, as evidenced by the confidence intervals. The Spearman rho coefficient value for the association of ITN effectiveness and proportion of mosquitoes collected outdoors was 0.1429, p=0.79.

Discussion section

However, despite seeing more mosquitoes caught outdoor throughout the study area this did not appear to be associated with an overall reduction in ITN effectiveness. The trend towards outdoor exposure was of modest epidemiological significance and is within the normal range of variation for these vectors [55]. The captured microheterogeneity of the estimated mean exposure or mosquitoes caught does not clearly explain the microheterogeneity in ITN effectiveness (Figure 5A-C). We may have observed an apparently statistically significant increase in the abundance of mosquitoes caught outdoor in areas of low ITN effectiveness. However, this was due to a single outlying geographical area and there was no variation in abundance of mosquitoes caught outdoor after this area was excluded. This suggests the statistical significance of the initial comparison may have been due to ecological confounding, where a geographical area with high ITN effectiveness happened to have more indoor mosquitoes, but this relationship was not confirmed in other areas (Figure 5A & B). We also did not find a clear role of either vector in driving the heterogeneity observed (Figure 3C & Supplementary Figure 2).

Q8) This interpretational misalignment is also reflected in the discussion, a few lines from the end of page 13: “..Our study was therefore powered to detect only a large difference in the proportion of vectors caught outdoors.”. Please digest Huho et al 2013 carefully and then rephrase to give the proportions caught during/outside of sleeping hours at least as much emphasis. Similarly, the opening sentence of page 14 “outdoor biting” might be better rephrased as “outdoor exposure”, and similar phrases throughout that losing paragraph also carefully adjusted for accuracy and clarity?

A8:  We have rephrased as follows:

We also observed a higher proportion of mosquito vectors collected outside of sleeping hours, in areas of both high and low ITN effectiveness (Figure 5B). On first principles one would expect that outdoor exposure would limit ITNs effectiveness. However, despite seeing more mosquitoes caught outside of sleeping hours throughout the study area this did not appear to be associated with an overall reduction in ITN effectiveness. The trend towards outdoor exposure was of modest epidemiological significance and is within the normal range of variation for these vectors [55]. The captured microheterogeneity of the estimated mean exposure or mosquitoes caught outside of sleeping hours does not clearly explain the microheterogeneity in ITN effectiveness (Figure 5A-C).

It is possible that the higher proportion of mosquitoes caught outdoors/outside of sleeping hours represents a behavioral response to unsuccessful feeding attempts made indoors during the night, and therefore it may simply be a marker of successful ITN use. This avoidance behavior may exert a cost on the vector, and so ITNs may in fact still be protective in areas where outdoor exposure is observed, as has been suggested previously [30]. Furthermore, outdoor exposure and the probability of successful feeding outside of sleeping hours cannot be directly inferred from the human landing catches, since the landing catches are not in themselves sufficient to survey pattern of normal human exposure to mosquito bite. Once adjusted for human behaviour, most human-vector interaction in this study occurred indoors (Figure 8).

In summary, our data do not provide evidence of an epidemiological association between microgeographical variations in ITN effectiveness and variations in the microgeographical distribution of outdoor exposure. The outdoor exposure observed may therefore have been the result of high levels of ITN use leading to unsuccessful attempts at indoor feeding.

Q9) Final paragraph of background: Be aware of the fact that An. arabiensis (not “arabienses”) exhibits at least three behaviours that can enable residual transmission: In addition to feeding outdoors (usually achieved by biting early), it can also survive by attacking animals or through repeated, cautious foraging inside houses until an unprotected non-user is found. See the background section of Malaria Journal 15: 255 for a brief overview.

A9: We have made revision in the background section shown below:

In Western Kenya and South-eastern Tanzania there have been reports of a reduction in indoor feeding by An. gambiae sensu stricto ( s.s.) and an increase in the relative abundance of An. arabiensis. The latter has a broader range of feeding times and biting behavior, including: feeding at dusk or dawn on humans outdoors; readily feeding on animals when available; or repeatedly foraging inside houses until an unprotected non-ITN user is found [8, 17, 23, 25, 26].

Q10) While I know I suggested that “It is also possible that nonlinearity in the relationship between transmission intensity and clinical episodes explains the variations in ITN effectiveness.”, I think supplementary figure 1 rules out that explanation, so you should say so and this is just one more reason to move this into the main text as an extra panel in figure 3.

A10: We have made revisions accordingly in the discussion as shown below:

While it is also possible that non-linearity in the relationship between transmission i ntensity and clinical episodes could explain the variations in ITN effectiveness, we did not identify a consistent relationship between ITN effectiveness and transmission intensity (Figure 3B).

Q11) In the closing paragraph of the discussion, I’d suggest the following additional words: “WITH outdoor fractions of transmission BEING SO LOW, AND INDIVIDUAL HUMAN BEHAVIOUR BEING SO HETEROGENOUS, it MAY be expected to be epidemiologically detectable ONLY once indoor transmission has been MORE EFFECTIVELY tackled AND INDIVIDUAL-LEVEL ESTIMATES OF EXPOSURE DISTRIBUTIONS ARE MEASURED.” For the last point, cite Msellemu 2016 and Bradley 2015.

A11: We have made the revision accordingly.

Q12) Closing sentence of the results, suggest “was consistently high ACROSS ALL LOCATIONS…”.

A12:  We have made the revision accordingly.

Q13) Third sentence, first paragraph of discussion: Looks like a simple editing mistake. Also best to avoid suggesting and increase in absolute rather than just relative abundance of An. arabiensis. I suggest: “…a pronounced shift away from Anopheles gambiae s.s, which was previously the dominant vector, and TOWARDS Anopheles arabiensis IN TERMS OF RELATIVE ABUNDANCE.”

A13:  We have made revisions accordingly.

Q14) End of first paragraph on page 10, a minor grammatical error: “….sought to investigate whether…” rather than “…sought to investigateD whether..”

A14: We have made the revision accordingly.

Q15) The terms “significant”, “significantly different” etc are rather over-used redundantly. In scientific writing, one doesn’t state any difference unless it’s statistically significant so the statement that one thing is greater or lesser than another or that there’s a trend infers significance unless stated otherwise, and the P value provided in brackets, table etc adds the evidence to support such a statement of difference or trend.

A15: We have made revisions accordingly.

Q16) When talking about absolute mosquito densities per se, I think the terms “abundant”/”abundance” and more appropriate than “prevalence”/”prevalent”, which suggests a proportion. Suggest correcting throughout.

A16: We have made revisions accordingly.

Q17) Without boiling and retesting for CSP, the ELISA results are a little questionable , especially for any zoophagic non-vectors or secondary vectors, and this study limitation should be acknowledged.

A17: We have included this under the limitation as follows:

In addition boiling and retesting CSP could be done to increase specificity of the ELISA results.

Wellcome Open Res. 2018 Jan 29. doi: 10.21956/wellcomeopenres.14871.r29812

Referee response for version 2

Gerry F Killeen 1

OVERALL

This version of the manuscript reflects a lot of hard and meticulous work by the authors, and is vastly improved with additional, highly relevant data brought to bear, plus much more appropriate analysis. However, some aspects of the analysis, and even more so the interpretation, still need some substantive work. As it stands, there are substantial limitations to what the data and analysis can tell us, and the lack of any detectable association between measures of outdoor exposure and measures of impact are presented far too conclusively as evidence of lack of underlying association.

MAJOR COMMENTS

My most important reservations about the results and especially the discussion section are best captured in the conclusions section of the abstract, which is unjustified when stated as follows:

“Our data therefore do not support the hypothesis that outdoor biting limits the effectiveness of ITNs in our study area.”

Actually, the entomological and human behaviour data do. For a start, the mean of about 10% of transmission occurring outdoors is consistent with studies from all across Africa [1], but that estimate assumes no protection from a bed net. Adjusting for the protective effects of bed nets, that means about 50% of remaining exposure to residual transmission occurs outdoors for bed net users [2, 3]. So these results are very consistent with the persistence of malaria transmission, even amongst bed net users, and the contribution of outdoor transmission to that situation.

Indeed, the epidemiological data do not provide evidence of an epidemiological association between malaria prevalence and variations in the distribution of human exposure occurring outdoors. However, there are a number of potential explanations for this other than lack of an underlying relationship:

  1. The most obvious biological factor that could explain variations in ITN effectiveness is baseline transmission. Malaria burden responds non-linearly to transmission exposure with areas experiencing higher reinfection rates being less responsive to transmission control because the human population becomes saturated with infection. Immunity also plays its part in dampening the relationship, by easing off as control is more effective. However, I don’t think this is the explanation in this case because…

  2. The most obvious statistical reason for such variations in ITN effectiveness lie in detectability, and therefore run in exactly the opposite direction. Stronger effects could be seen in areas with more malaria cases, where effect sizes may be easier to quantify. It is noticeable that the largest confidence intervals in Figure 3 are consistently associated with the lowest estimates of protection. Unlikely to be a coincidence. Also, in Table 3, the most obvious difference between the putative high and low ITN effectiveness areas is that the latter have very few mosquitoes, so probably much less transmission and burden to begin with. ITNs cannot protect people against malaria they are not be exposed to.

  3. The non-random pattern in Figure 4 looks consistent with either possibility too. I would therefore like to see Figure 3 ordered by overall prevalence/incidence rather than by OR, and an analysis to test that relationship carried out.

  4. Figure 5 confirms by best guess that the biggest limitation to reliably proving any such association lies in measurement error.

  5. There are many other potential confounders, the most important of which is probably composition of the Anopheles funestus group. Let’s remember that Anopheles parensis was first discovered as a species on the Kenyan coast where it was found biting outdoors in the early evening but did not transmit appreciable levels of malaria. I note that the Anopheles funestus group was not identified to species level, so all these variations in mosquito behaviour and human exposure patters could be explained by variations in the abundance of much weaker vectors within the group that feed more outdoors at dawn and dusk. Reference 38 only covers PCR methods for the An. gambiae complex and reference 6 is inappropriate, indirect and doesn’t cover the specific methodology required.

I conclude that final sentence of the abstract is too stark and over-represents the significance of the lack of any evidence for an association, which is not the same thing as evidence of a lack of association.

Figure 8 over-represents the importance of outdoor biting species that are less effective vectors than indoor biting vectors by pooling them into a single figure, resulting in the kind of double-peak that is typical of these graphs where two or more species are undifferentiated-we discussed this a weakness of our own An. funestus group data in our Africa-wide review [1]. Please provide 4 separate panels for the 4 separate taxa. Please be explicit about what is really species specific, and what reflects potentially two or more species from a complex or group. Just to be transparent, use the term “An. funestus group” throughout.

In many places, the existing evidence base is misrepresented and the wording needs to be edited to be more precise and avoid exaggerating the case being made. In addition to all the following specific comments, please read and digest more carefully the previously provided references.

For example, in the middle of the second paragraph of the Introductions on page 3: “..which could be caused by changes in the behaviour of the…” suggests these behaviours are new phenomena. It is a common mistake to represent such phenomena as something new, rather than something we previously ignored but are now becoming more conscious of. While heritable changes in mosquito behaviour do appear to be occurring in some well-studied locations, the overwhelmingly point of all our previous review work has been that outdoor feeding has always occurred but wasn’t recognized as a problem, because we hadn’t done a good enough a job of killing mosquitoes indoors. We therefore hadn’t reached the stage we are at now, where that outdoor transmission is now an important component of our much smaller remaining transmission problem. While reference 22 is a reasonably convincing example where a potentially heritable behaviour change within a single species appears to be happening, this is the exception and all the other studies cited are equivocal because there are several alternative explanations [2, 3, 7].

MINOR COMMENTS

The phraseology is also a little loose later in the Introduction where the term “shift” in the relative abundance of species is used to hint at species replacement, imply potential for in a “decrease in ITN effectiveness” rather than merely a limitation of ITN effectiveness. Actually, this probably reflects differential partial success rather than any literal undermining of impact [7].

In the results section, the statistical trend towards outdoor biting is of modest epidemiological significance and its within the normal range of variation for these vectors [1].

At the end of the second paragraph of the introduction, the definition of exophagy is over-extended: “…., ie the vector feeds outdoors on humans” implies exophagy combined with anthropophagy, rather than just exophagy.

Opening sentence of third paragraph of the introduction: The Anopheles funestus group is a group, not a complex so the word “taxa” should be used instead of “species complex” at the start of the sentence.

Third sentence, first paragraph of introduction: Is the at-risk population referred to global or African? Please be specific. Also say estimated, rather than modelled, as lots of real data were used and the latter term can turn off non-specialists.

In the third paragraph of the introduction, references 6 and 27 are from southern Tanzania, not northern Tanzania.

In the results section, towards the end of the vector abundance subsection, the term “rate” is used rather loosely: “Higher sporozoite rate was observed among the An. funestus group (7/9).” I think what your are trying to say is that most detected sporozoite inoculations/infectious mosquitoes captured were from the An. funestus group.

Looks like a typo or endnote error at the end of the first sentence of the second paragraph in the discussion.

A little overwritten in places, for example:

Replace “optimally effective” with “most effective” at the start of the second paragraph of the Introduction section.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. Huho B, Briët O, Seyoum A, Sikaala C, Bayoh N, Gimnig J, Okumu F, Diallo D, Abdulla S, Smith T, Killeen G: Consistently high estimates for the proportion of human exposure to malaria vector populations occurring indoors in rural Africa. Int J Epidemiol.2013;42(1) : 10.1093/ije/dys214 235-47 10.1093/ije/dys214 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Killeen GF: A second chance to tackle African malaria vector mosquitoes that avoid houses and don't take drugs. Am J Trop Med Hyg.2013;88(5) : 10.4269/ajtmh.13-0065 809-16 10.4269/ajtmh.13-0065 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Killeen GF: Characterizing, controlling and eliminating residual malaria transmission. Malar J.2014;13: 10.1186/1475-2875-13-330 330 10.1186/1475-2875-13-330 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Smith DL, Dushoff J, Snow RW, Hay SI: The entomological inoculation rate and Plasmodium falciparum infection in African children. Nature.2005;438(7067) : 10.1038/nature04024 492-5 10.1038/nature04024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Beier JC, Killeen GF, Githure JI: Short report: entomologic inoculation rates and Plasmodium falciparum malaria prevalence in Africa. Am J Trop Med Hyg.1999;61(1) :109-13 [DOI] [PubMed] [Google Scholar]
  • 6. Gillies M.T, Furlong M: An investigation into the behaviour of Anopheles parensis Gillies at Malindi on the Kenya coast. Bulletin of Entomological Research.1964;55(1) :1-16 10.1017/S0007485300049221 [DOI] [Google Scholar]
  • 7. Govella NJ, Chaki PP, Killeen GF: Entomological surveillance of behavioural resilience and resistance in residual malaria vector populations. Malar J.2013;12: 10.1186/1475-2875-12-124 124 10.1186/1475-2875-12-124 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2018 Nov 5.
Alice Kamau 1

Dear Dr. Gerry F. Killeen,

Thank you for reviews of our manuscript, “Variation in the effectiveness of insecticide treated nets against malaria and outdoor biting by vectors in Kilifi, Kenya”. We respond below to the points raised, indicating the reviewer’s points with “Q” and our responses by “A” in bold.

Reviews /comments:

Specific Questions

Q1) Indeed, the epidemiological data do not provide evidence of an epidemiological association between malaria prevalence and variations in the distribution of human exposure occurring outdoors. However, there are a number of potential explanations for this other than lack of an underlying relationship: The most obvious biological factor that could explain variations in ITN effectiveness is baseline transmission. Malaria burden responds non-linearly to transmission exposure with areas experiencing higher reinfection rates being less responsive to transmission control because the human population becomes saturated with infection. Immunity also plays its part in dampening the relationship, by easing off as control is more effective. However, I don’t think this is the explanation in this case because…

A1: We have included this potential explanation in the discussion as follows:

It is possible that non-linearity in the relationship between transmission intensity and clinical episodes explains the variations in ITN effectiveness.  However we did not identify a consistent relationship between ITN effectiveness and transmission intensity (Supplementary figure 1).

Q2) The most obvious statistical reason for such variations in ITN effectiveness lie in detectability, and therefore run in exactly the opposite direction. Stronger effects could be seen in areas with more malaria cases, where effect sizes may be easier to quantify. It is noticeable that the largest confidence intervals in Figure 3 are consistently associated with the lowest estimates of protection. Unlikely to be a coincidence. Also, in Table 3, the most obvious difference between the putative high and low ITN effectiveness areas is that the latter have very few mosquitoes, so probably much less transmission and burden to begin with. ITNs cannot protect people against malaria they are not be exposed to.

A2: Supplementary Figure 1 shows no consistent variation.  We have references this in the text:

Furthermore we identified statistical evidence of effect modification between geographical location and ITN effectiveness (p=0.016), suggesting that lack of power in selected geographical locations is unlikely to be the explanation for variation.

Q3) The non-random pattern in Figure 4 looks consistent with either possibility too. I would therefore like to see Figure 3 ordered by overall prevalence/incidence rather than by OR, and an analysis to test that relationship carried out.

A3: The log odds ratio in Supplementary Figure 1 were ordered by malaria prevalence and the Spearman rho coefficient value for the association of ITN effectiveness and prevalence of malaria was 0.1868, p=0.541 as shown below. We had included this in the result section as shown below:

Previous data have shown that ITN effectiveness is lower in areas of high malaria transmission [11, 45]. This did not appear to be the explanation for variation in effectiveness in this data. (Supplementary Figure 1); the Spearman rho coefficient value for the association of ITN effectiveness and prevalence of malaria was 0.1868, p=0.541.

Q4) Figure 5 confirms by best guess that the biggest limitation to reliably proving any such association lies in measurement error.

A4: We have made revision in the results section as shown below:

Moreover, when analysed by individual geographical area there was not a visually obvious trend associating mosquitoes caught outdoor biting with decreasing ITN effectiveness in the six geographical areas ( Figure 5), although this association could have been limited by the power of the study, as evidenced by the confidence intervals shown in Figure 5.

Q5) There are many other potential confounders, the most important of which is probably composition of the Anopheles funestus group. Let’s remember that Anopheles parensis was first discovered as a species on the Kenyan coast where it was found biting outdoors in the early evening but did not transmit appreciable levels of malaria. I note that the Anopheles funestus group was not identified to species level, so all these variations in mosquito behaviour and human exposure patters could be explained by variations in the abundance of much weaker vectors within the group that feed more outdoors at dawn and dusk. Reference 38 only covers PCR methods for the An. gambiae complex and reference 6 is inappropriate, indirect and doesn’t cover the specific methodology required.

A5: We have included appropriate reference and delete reference 6 from the methodology as shown below:

 Koekemoer LL, Kamau L, Hunt RH, Coetzee M: A cocktail polymerase chain reaction assay to identify members of the Anopheles funestus (Diptera: Culicidae) group. Am J Trop Med Hyg 2002, 66:804-811.

We do not have molecular data for the An. funestus group. We had included this as a limitation in the discussion section as shown below

Discussion section

Lack of explicit molecular data for distinguishing sibling species and molecular forms within the An. funestus group introduces ambiguity into the interpretation of the results of the study

Q6) I conclude that final sentence of the abstract is too stark and over-represents the significance of the lack of any evidence for an association, which is not the same thing as evidence of a lack of association.

A6: We have made revision of the final sentence of the abstract as follows:

Our data do not provide evidence of an epidemiological association between microgeographical variations in ITN effectiveness and variations in the microgeographical distribution of outdoor biting.

Q7) Figure 8 over-represents the importance of outdoor biting species that are less effective vectors than indoor biting vectors by pooling them into a single figure, resulting in the kind of double-peak that is typical of these graphs where two or more species are undifferentiated-we discussed this a weakness of our own An. funestus group data in our Africa-wide review. Please provide 4 separate panels for the 4 separate taxa. Please be explicit about what is really species specific, and what reflects potentially two or more species from a complex or group. Just to be transparent, use the term “ An. funestus group” throughout.

A7: We have addressed the above comment as follows:

We have added Supplementary Figure 3 which provides the estimated mean exposure indoor and outdoor in four separate panels for the 4 separate taxa

We have revised the result section as shown below:

The overall propensity to feed at times when most people are indoor was high overall (Figure 8) and in the An. funestus group and An. gambiae s.l., except for An. Arabiensis and other Anopheles (Supplementary Figure 3): the vast majority of the Anopheles mosquitoes were caught at times when most people are indoor (Figure 7).

Q8) For example, in the middle of the second paragraph of the Introductions on page 3: “..which could be caused by changes in the behaviour of the…” suggests these behaviours are new phenomena. It is a common mistake to represent such phenomena as something new, rather than something we previously ignored but are now becoming more conscious of. While heritable changes in mosquito behavior do appear to be occurring in some well-studied locations, the overwhelmingly point of all our previous review work has been that outdoor feeding has always occurred but wasn’t recognized as a problem, because we hadn’t done a good enough a job of killing mosquitoes indoors. We therefore hadn’t reached the stage we are at now, where that outdoor transmission is now an important component of our much smaller remaining transmission problem. While reference 22 is a reasonably convincing example where a potentially heritable behaviour change within a single species appears to be happening, this is the exception and all the other studies cited are equivocal because there are several alternative explanations.

A8:  We have rephrased as follows:

However, residual malaria transmission is well described even after optimal ITN use, which could be associated with outdoor biting behaviour of the mosquito vector that allows them to evade fatal contact with these frontline tools of intervention [17, 18].

Q9) The phraseology is also a little loose later in the Introduction where the term “shift” in the relative abundance of species is used to hint at species replacement, imply potential for in a “decrease in ITN effectiveness” rather than merely a limitation of ITN effectiveness. Actually, this probably reflects differential partial success rather than any literal undermining of impact [7].

A9: We have made the revision accordingly.

Both species complexes feed primarily indoors; however, both have exhibited outdoor biting or feeding in the early part of the evening in some areas where ITNs have been deployed [6, 19-22].

Q10) In the results section, the statistical trend towards outdoor biting is of modest epidemiological significance and is within the normal range of variation for these vectors [1].

A10: We have made revisions accordingly in the discussion.

We also observed a higher proportion of mosquito vectors collected outdoors than indoors, in areas of both high and low ITN effectiveness ( Figure 5). On first principles one would expect that outdoor biting would lead to ITNs becoming ineffective. However, despite seeing more mosquitoes caught outdoor throughout the study area this did not appear to be associated with an overall reduction in ITN effectiveness. We may have observed an apparently statistically significant increase in the prevalence of mosquitoes caught outdoor in areas of low ITN effectiveness. However, this was due to a single outlying geographical area and there was no variation in prevalence of mosquitoes caught outdoor after this area was excluded. This suggests the statistical significance of the initial comparison may have been due to ecological confounding, where a geographical area with high ITN effectiveness happened to have more indoor mosquitoes, but this relationship was not confirmed in other areas ( Figure 5). The statistical trend towards outdoor biting is of modest epidemiological significance and it is within the normal range of variation for these vectors [55].

Q11) At the end of the second paragraph of the introduction, the definition of exophagy is over-extended: “…., ie the vector feeds outdoors on humans” implies exophagy combined with anthropophagy, rather than just exophagy.

A11: We have made the revision accordingly.

The most obvious behavioural change is the mosquito vector exhibiting exophagic tendencies –i.e. the vector feeds outdoors.

Q12) Opening sentence of third paragraph of the introduction: The Anopheles funestus group is a group, not a complex so the word “taxa” should be used instead of “species complex” at the start of the sentence.

A12:  We have made the revision accordingly.

Among malaria vectors in Africa, the two principal taxa are: Anopheles gambiaesensu lato (s.l.) and Anopheles funestus group.

Q13) Third sentence, first paragraph of introduction: Is the at-risk population referred to global or African? Please be specific. Also say estimated, rather than modelled, as lots of real data were used and the latter term can turn off non-specialists.

A13:  We have made revisions accordingly.

Estimates from model-based predictions suggest that approximately 1.4 billion of the global population live at risk of stable malaria and ~1.1 billion at risk of unstable malaria.

Q14) In the third paragraph of the introduction, references 6 and 27 are from southern Tanzania, not northern Tanzania.

A14: We have made the revision accordingly.

In southern Tanzania, where ITNs have been used for several years, the mosquitoes are biting more frequently during the hours of the early evening and early morning when people are more likely to be awake and vulnerable outside of their nets [6,27].

Q15) In the results section, towards the end of the vector abundance subsection, the term “rate” is used rather loosely: “Higher sporozoite rate was observed among the An. funestus group (7/9).” I think what your are trying to say is that most detected sporozoite inoculations/infectious mosquitoes captured were from the An. funestus group.

A15: We have made revisions accordingly.

The most detected sporozoite infectious mosquitoes captured were from the An. funestus group (7/9).

Q16) Looks like a typo or endnote error at the end of the first sentence of the second paragraph in the discussion.

A16: It was a typo and we have revised accordingly.

Q17) A little overwritten in places, for example: Replace “optimally effective” with “most effective” at the start of the second paragraph of the Introduction section.

A17: We have made revision in the introduction as suggested.

The frontline tools for malaria control in sub-Saharan Africa, insecticide treated nets (ITNs) and indoor residual spray, are most effective if baseline transmission occurs indoors

Wellcome Open Res. 2017 Jun 2. doi: 10.21956/wellcomeopenres.11943.r23190

Referee response for version 1

Sarah J Moore 1,2

The authors have conducted a study addressing the hypothesis that outdoor feeding of mosquitoes undermines the effectiveness of ITNs.

The entomology presented in the paper is inadequate to answer the hypothesis presented for the following reasons:

  1. 5 years of clinical data are presented (2009-2014) but only one month of mosquito sampling is conducted in 2016, two years after the last piece of clinical data was collected.

  2. No PCR speciation was reported. In this area there are a number of cryptic species that look the same but differ in both their behaviour and their ability to transmit malaria. No molecular techniques were used to test the mosquito species. So you could have a switch from An. gambiae s.s. that bites indoors and has high vectorial competence to An. arabiensis that bites outdoors and has lower vectorial competence. The same is true in the An. funestus complex that is comprised of a number of outdoor biting species like An. leesoni or An. rivulorum.

  3. The authors reported that PCR (polymerase chain reaction) was done on the mosquitoes yet I cannot find data in the paper reporting the outcome of the PCR. All data reports An. gambiae s.l. and An. funestus group.

The paper explores changing mosquito behaviour with lowered effectiveness of nets but only used one month of vector collections two years after the clinical data was collected to test this link and the actual species present are not reported. I therefore find this a big stretch of the data. Vector density, composition and behaviour varies throughout the year and these collections were made for a short time. I therefore don’t think the data are sufficient to accept or reject the hypothesis. 

That being said the rest of the data is very useful and nicely presented. The data do demonstrate that there is substantial outdoor biting in June/July, and I should like to see the species composition in the area seeing as the authors report that the PCR was done. Outdoor biting may not increase malaria if the vectors doing the outdoor biting are not very competent for malaria.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2018 Jan 6.
Alice Kamau 1

We are grateful for this review and the helpful comments and suggestions that have been made. We have included a point-by-point response (in bold) to the issues raised.

Q1) 5 years of clinical data are presented (2009-2014) but only one month of mosquito sampling is conducted in 2016, two years after the last piece of clinical data was collected.

A1: We have updated the clinical surveillance data to December 2016 and updated the manuscript accordingly.

Q2) No PCR speciation was reported. In this area there are a number of cryptic species that look the same but differ in both their behaviour and their ability to transmit malaria. No molecular techniques were used to test the mosquito species. So you could have a switch from An. gambiae s.s. that bites indoors and has high vectorial competence to An. arabiensis that bites outdoors and has lower vectorial competence. The same is true in the An. funestus complex that is comprised of a number of outdoor biting species like An. leesoni or An. rivulorum.

A2: We have included data obtained from the ELISA-CSP and molecular analysis in the results section. The mosquitoes were differentiated to species as shown under the result section. However, we do not have molecular data for the An. funestus group. We have included this as a limitation in the discussion section as shown below

Result section

“Over 26 nights, 415 female Anopheles mosquitoes were collected by both methods (i.e. 272 by HLC and 143 by CDC-LT), representing a mean of 16 mosquitoes per night. 66% of mosquitoes were collected using HLC. Of the 415 mosquitoes morphologically identified, 311 (75%) were An. funestus group, 84 (20%) were An. gambiae s.l. and 20 (5%) were other Anopheles i.e. An. protoriensis, An. coustani, An. moucheti and An. squamosus (Table 2). The An. funestus group was significantly greater than An. gambiae s.l (p<0.001). Out of the 84 amplified samples of An. gambiae s.l., 68 (81%) were An. Arabiensis and 16 (19%) were An. gambiae s.s. The proportion of Anopheles mosquitoes caught outdoors (60%; 95% CI: 55%, 65%) was significantly greater than the proportion caught indoors (p<0.001). There were more Anopheles mosquitoes collected outdoors in all geographical areas except area 6, where most of the mosquitoes were collected indoor (Table 2). The frequencies of vectors collected in each geographical area are summarized in Supplementary Table 2. An. funestus group was the most prevalent vector in all areas. Of the 272 mosquitoes collected by HLC, 3.3% (9/272) tested positive for P. falciparum sporozoites. Higher sporozoite rate was observed among the An. funestus group (7/9). The rate of indoor and outdoor biting estimated by HLC was 19.8 and 25.5 bites per person per night, respectively.”

Discussion section

“Lack of explicit molecular data for distinguishing sibling species and molecular forms within the An. funestusgroup introduces ambiguity into the interpretation of the results of the study.”

Q3) The authors reported that PCR (polymerase chain reaction) was done on the mosquitoes yet I cannot find data in the paper reporting the outcome of the PCR. All data reports  An. gambiae s.l. and  An. funestus group.

A3: We have addressed this comment as shown above.

Q4) The paper explores changing mosquito behaviour with lowered effectiveness of nets but only used one month of vector collections two years after the clinical data was collected to test this link and the actual species present are not reported. I therefore find this a big stretch of the data. Vector density, composition and behaviour varies throughout the year and these collections were made for a short time. I therefore don’t think the data are sufficient to accept or reject the hypothesis. 

A4: We have updated the clinical surveillance data to December 2016 and updated the manuscript accordingly. We have included the limitation of the one month vector collection in the discussion section as shown below.

Discussion section

“The size of our study limits power: with a sample size of 415, and the proportion of mosquitoes biting outdoors at 67% in low ITN effectiveness areas we therefore had >90% power to detect a reduction to 27% or lower in high ITN effectiveness areas. Our study was therefore powered to detect only a large difference in the proportion of vectors caught outdoors. However, we reasoned that reductions of ITN effectiveness to less than half of the previously documented efficacy of 50% would require a doubling of the proportion of mosquitoes feeding outdoors. Hence our study was powered to detect large variations in the frequency of outdoor biting. In addition, the accuracy of mosquito sampling data is limited as only one month of sampling was conducted in this study, we recommend sampling for a longer duration of time.”

Q5) That being said the rest of the data is very useful and nicely presented. The data do demonstrate that there is substantial outdoor biting in June/July, and I should like to see the species composition in the area seeing as the authors report that the PCR was done. Outdoor biting may not increase malaria if the vectors doing the outdoor biting are not very competent for malaria.

A5: We have addressed this comment as shown above.

Wellcome Open Res. 2017 May 18. doi: 10.21956/wellcomeopenres.11943.r22171

Referee response for version 1

Gerry F Killeen 1

Apart from some unfortunately important exceptions, the data for this study are meticulously collected and analysed. However, many of the most important results are either over-interpreted or misinterpreted so these exceptions are substantive. In fact, the correct interpretation may well be almost the exact opposite of that presented here: That LLINs are consistently effective across a landscape where transmission is dominated by a vector that primarily attacks people indoors at night while they are asleep.

  1. The biggest single problem with this paper is that the indoor and outdoor biting rate estimates come from stationary, fully exposed human volunteers exhibiting artificial experimental behaviours, without adjusting them for normal human behaviours that mean most of us are indoors asleep during the peak biting hours of nocturnal African malaria vector mosquitoes. This is an understandable and common mistake, but a very important one. Like Anopheles funestus in most locations across Africa, the 55-45 distribution of biting location preference for this population is essentially indiscriminate, so it is the behaviour of humans that determines where exposure actually occurs. So unless everyone in coastal Kenya sleeps half indoors and half outdoors throughout the night, simply comparing indoor versus outdoor HLCs is misrepresentative and greatly exaggerates the contribution of outdoor biting to transmission by this species. Once adjusted for human behaviour patterns, >90% of human biting exposure to this key vector species is consistently estimated to occur indoors in the absence of some protective measures at locations scattered all across Africa [1]. Unless human behaviour on the coast of Kenya is far more exophilic (everyone sleeps outdoors?) than all the other human populations we have data for, there is nothing in the data presented that is unusual or that convince me this vector population behaves differently from Anopheles funestus elsewhere. The logical conclusion of this paper (albeit with some additional data and analyses to support it) is that, unsurprisingly, there is little difference in the effectiveness of nets across landscapes dominated by the same vector that primarily encounters people indoors at night while they are asleep and can use a net.

  2. The most important data clearly missing from the characterization of the study scenario are (a) spoorozoite rates (mentioned in the methods but not the results) and EIR estimates, to confirm that Anopheles funestus group mosquitoes are the most important vectors of malaria in this area, (b) quantitative estimates of where and when humans are exposed to these two major vector taxa (not species unless PCR data are added) that weight the biting estimates by surveys of human behaviour [2-5]. These are increasingly common calculations applied to data from all over the tropics [6-13], and vitally important to conduct before making any quantitative statements about proportional contributions of outdoor biting exposure.

  3. There is no evidence of any “shift” in behaviours over time presented here, so the term “undermines” is unjustified and seems to create an argument that hasn’t been made. Most behaviours that enable residual malaria transmission despite LLIN use are pre-existing, although plastic, and often it’s just the vector population composition that shifts 14, so the term “limits” is more appropriate.

  4. While indeed there is no evidence here that outdoor transmission contributes to ongoing transmission, there is also no evidence that it does not. Such outdoor fractions of transmission can only be expected to become epidemiologically detectable once larger quantities of indoor transmission (which I’m convinced is the case here as explained above) have been tackled. So the phraseology of conclusions needs to be tempered using words like “yet”, and explain how these currently minor fractions of transmission may emerge as important contributors to sustained endemicity once further progress has been made with indoor control [14,15].

  5. In any case, LLINs clearly fall a long way short of being 100% efficacious with 22% personal protection estimated here, so there clearly are considerable limitations to this technology that need explanation. To get a better handle on whether outdoor exposure does contribute to residual transmission, in our experience it’s necessary to test as a function of individual human behavioural profiles weighted by activity patterns for the most dominant local vectors [13]. Indeed human behaviour is the primary driver of where and when exposure occurs [1] and is far more variable than the mosquito behaviours that matter within a single vector species [15].

  6. In any case, for many of the surveyed locations, very few mosquitoes were caught (Supplementary Table 2) and CDC light traps catches indoors and outdoors are not comparable, so reporting these data as indicators of the degree of exophagy or endophagy is going too far and overstretching very little entomological data.

  7. The fact that these are not differentiated to species (again, though this is mentioned in the methods but no results are presented) also means that areas with apparently different mosquito behaviours are probably areas that simply have different relative abundances of primary vector, secondary vector and non-vector species within the Anopheles funestus group and within the Anopheles gambiae complex. For example, greater outdoor feeding at dawn and dusk is a known characteristic of Anopheles rivulorum and Anopheles parensis, originally discovered in this region on the basis of their distinctive behaviours and much weaker vectorial capacities.

  8. The term “species” is used very loosely and interchangeably with other taxonomic classification levels, resulting in some misleading over-interpretation. While Anopheles gambiae sensu lato is indeed a complex, Anopheles funestus sensu lato is a group (not a complex, as stated in the introduction) and neither can be described as a species, unless one is talking about unambiguously identified individual specimens of the nominate species, which are by far the most efficient species within each taxon.

  9. All of these most important limitations seem to be missing from the paragraph opening with the sentence “Our study has some limitations”.

  10. What is called “effectiveness” here refers only to the relatively minor personal protection effect of bednets, and does not capture any variations in community-level impact. All fine but please explain this study limitation clearly.

  11. Correspondingly, doesn’t capture how big a change this transmission picture is relative to the same setting 10 to 15 years ago when nominate Anopheles gambiae were still quite abundant. The explanations about the relative abundance of vector taxa (not species) is accurate but rather static and lacking in long term context, demonstrating the much bigger overall impact on vector populations and endemicity. This is a pity when this contemporary study has been conducted in an area with so much historical entomological literature, so please enrich the narrative.

  12. While I agree with the closing statement about enhancing entomological surveillance, in my experience many groups are under-interpreting or misinterpreting the data they already have, so perhaps that capacity limitation merits some emphasis as a priority.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. Huho B, Briët O, Seyoum A, Sikaala C, Bayoh N, Gimnig J, Okumu F, Diallo D, Abdulla S, Smith T, Killeen G: Consistently high estimates for the proportion of human exposure to malaria vector populations occurring indoors in rural Africa. Int J Epidemiol.2013;42(1) : 10.1093/ije/dys214 235-47 10.1093/ije/dys214 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Killeen GF, Kihonda J, Lyimo E, Oketch FR, Kotas ME, Mathenge E, Schellenberg JA, Lengeler C, Smith TA, Drakeley CJ: Quantifying behavioural interactions between humans and mosquitoes: evaluating the protective efficacy of insecticidal nets against malaria transmission in rural Tanzania. BMC Infect Dis.2006;6: 10.1186/1471-2334-6-161 161 10.1186/1471-2334-6-161 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Seyoum A, Sikaala CH, Chanda J, Chinula D, Ntamatungiro AJ, Hawela M, Miller JM, Russell TL, Briët OJ, Killeen GF: Human exposure to anopheline mosquitoes occurs primarily indoors, even for users of insecticide-treated nets in Luangwa Valley, South-east Zambia. Parasit Vectors.2012;5: 10.1186/1756-3305-5-101 101 10.1186/1756-3305-5-101 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Killeen GF: A second chance to tackle African malaria vector mosquitoes that avoid houses and don't take drugs. Am J Trop Med Hyg.2013;88(5) : 10.4269/ajtmh.13-0065 809-16 10.4269/ajtmh.13-0065 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Killeen GF: Characterizing, controlling and eliminating residual malaria transmission. Malar J.2014;13: 10.1186/1475-2875-13-330 330 10.1186/1475-2875-13-330 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Bradley J, Lines J, Fuseini G, Schwabe C, Monti F, Slotman M, Vargas D, Garcia G, Hergott D, Kleinschmidt I: Outdoor biting by Anopheles mosquitoes on Bioko Island does not currently impact on malaria control. Malar J.2015;14: 10.1186/s12936-015-0679-2 170 10.1186/s12936-015-0679-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Moiroux N, Damien GB, Egrot M, Djenontin A, Chandre F, Corbel V, Killeen GF, Pennetier C: Human exposure to early morning Anopheles funestus biting behavior and personal protection provided by long-lasting insecticidal nets. PLoS One.2014;9(8) : 10.1371/journal.pone.0104967 e104967 10.1371/journal.pone.0104967 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Geissbühler Y, Chaki P, Emidi B, Govella NJ, Shirima R, Mayagaya V, Mtasiwa D, Mshinda H, Fillinger U, Lindsay SW, Kannady K, de Castro MC, Tanner M, Killeen GF: Interdependence of domestic malaria prevention measures and mosquito-human interactions in urban Dar es Salaam, Tanzania. Malar J.2007;6: 10.1186/1475-2875-6-126 126 10.1186/1475-2875-6-126 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Govella NJ, Okumu FO, Killeen GF: Insecticide-treated nets can reduce malaria transmission by mosquitoes which feed outdoors. Am J Trop Med Hyg.2010;82(3) : 10.4269/ajtmh.2010.09-0579 415-9 10.4269/ajtmh.2010.09-0579 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Bugoro H, Cooper RD, Butafa C, Iro'ofa C, Mackenzie DO, Chen CC, Russell TL: Bionomics of the malaria vector Anopheles farauti in Temotu Province, Solomon Islands: issues for malaria elimination. Malar J.2011;10: 10.1186/1475-2875-10-133 133 10.1186/1475-2875-10-133 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Russell TL, Govella NJ, Azizi S, Drakeley CJ, Kachur SP, Killeen GF: Increased proportions of outdoor feeding among residual malaria vector populations following increased use of insecticide-treated nets in rural Tanzania. Malar J.2011;10: 10.1186/1475-2875-10-80 80 10.1186/1475-2875-10-80 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Russell TL, Beebe NW, Bugoro H, Apairamo A, Chow WK, Cooper RD, Collins FH, Lobo NF, Burkot TR: Frequent blood feeding enables insecticide-treated nets to reduce transmission by mosquitoes that bite predominately outdoors. Malar J.2016;15: 10.1186/s12936-016-1195-8 156 10.1186/s12936-016-1195-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Msellemu D, Namango HI, Mwakalinga VM, Ntamatungiro AJ, Mlacha Y, Mtema ZJ, Kiware S, Lobo NF, Majambere S, Dongus S, Drakeley CJ, Govella NJ, Chaki PP, Killeen GF: The epidemiology of residual Plasmodium falciparum malaria transmission and infection burden in an African city with high coverage of multiple vector control measures. Malar J.2016;15(1) : 10.1186/s12936-016-1340-4 288 10.1186/s12936-016-1340-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Govella NJ, Chaki PP, Killeen GF: Entomological surveillance of behavioural resilience and resistance in residual malaria vector populations. Malar J.2013;12: 10.1186/1475-2875-12-124 124 10.1186/1475-2875-12-124 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Killeen GF, Marshall JM, Kiware SS, South AB, Tusting LS, Chaki PP, Govella NJ: Measuring, manipulating and exploiting behaviours of adult mosquitoes to optimise malaria vector control impact. BMJ Global Health.2017;2(2) :p.e000212 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2018 Jan 9.
Alice Kamau 1

We are grateful for this review and the helpful comments and suggestions that have been made. We have included a point-by-point response (in bold) to the issues raised.

Q1) The biggest single problem with this paper is that the indoor and outdoor biting rate estimates come from stationary, fully exposed human volunteers exhibiting artificial experimental behaviours, without adjusting them for normal human behaviours that mean most of us are indoors asleep during the peak biting hours of nocturnal African malaria vector mosquitoes. This is an understandable and common mistake, but a very important one. Like Anopheles funestus in most locations across Africa, the 55-45 distribution of biting location preference for this population is essentially indiscriminate, so it is the behaviour of humans that determines where exposure actually occurs. So unless everyone in coastal Kenya sleeps half indoors and half outdoors throughout the night, simply comparing indoor versus outdoor HLCs is misrepresentative and greatly exaggerates the contribution of outdoor biting to transmission by this species. Once adjusted for human behaviour patterns, >90% of human biting exposure to this key vector species is consistently estimated to occur indoors in the absence of some protective measures at locations scattered all across Africa [1]. Unless human behaviour on the coast of Kenya is far more exophilic (everyone sleeps outdoors?) than all the other human populations we have data for, there is nothing in the data presented that is unusual or that convince me this vector population behaves differently from Anopheles funestus elsewhere. The logical conclusion of this paper (albeit with some additional data and analyses to support it) is that, unsurprisingly, there is little difference in the effectiveness of nets across landscapes dominated by the same vector that primarily encounters people indoors at night while they are asleep and can use a net.

A1:  We have made adjustments to the indoor and outdoor biting rate by human behavior as follows in the following sections:

Methods section

“To determine the human-mosquito contact, we administered questionnaires to 304 randomly selected households in the six selected areas between September and October 2016. We asked the household head time when each household member went to sleep and the time they woke up. Data on human behaviour was used to make adjustments to the indoor and outdoor biting rate.”

Statistical analysis section

“Questionnaire data about the time household members went to sleep and at what time they woke up were combined with human landing catches measurements of hourly rates for indoor and outdoor biting. We estimated the proportion of human exposure to mosquito bites occurring indoors (π s) by taking into consideration the movement pattern of people using the following method [1]: by weighting the mean indoor and outdoor biting rates throughout the night by the proportion of humans reporting to have gone to sleep at each hour of the night as follows; 

                    π = Σ ( B i,t S ) / Σ ( B i,t S t  + B o,t ( 1 - S ))

                                                                                                                        (1)

Where:

= an estimate of human exposure to bites which occurs when residents are both indoors and sleeping

S t = the proportion of humans indoors reporting to have gone to sleep at each hour of the night (t)

B i,t = mean indoor biting rate at each hour of the night (t)

B o,t = mean outdoor biting rates at each hour of the night (t)

(1-S t) = proportion of humans not yet asleep at each hour of the night.”

Result section

“Seventy three percent of children <5 years were reported to be asleep between 6 pm and 9 pm, these rose monotonically over the course of the night reaching 100% by 10 pm (Table 4 & Figure 6). Children aged between 6-14 years spent more time awake, only 45% were asleep before 9 pm (Figure 6 & Supplementary Table 3). Human landing catches are not sufficient in themselves to survey normal human exposure to mosquito bite. The timing of human activity and sleeping behaviour in particular modulates the effect of human-mosquito contact and the effectiveness of ITN. We quantified the interaction between mosquitoes and humans to evaluate whether outdoor vector biting is a potential explanation for the variation in ITN effectiveness. The peak biting activity for each mosquito vector is illustrated in Figure 7. Clearly higher indoor biting activity was observed for the An. funestus group. The overall propensity to feed at times when most people are indoor was high (Figure 8): the vast majority of the Anopheles mosquitoes were caught at times when most people are indoors (Figure 7). Estimates for the proportion of human-mosquito contact between the first and last hour when most humans were indoors was consistently high, ranging from 0.83 to 1.00. Therefore, the estimated proportion of exposure to Anopheles mosquito bites that occurred indoor was high.”

Discussion section

It is possible that a higher proportion of mosquitoes caught outdoors represents a behavioral response to unsuccessful feeding attempts made indoors during the night, and therefore it may simply be a marker of successful ITN use. This avoidance behavior may exert a cost on the vector, and so ITNs may in fact still be protective in areas where outdoor biting is observed, as has been suggested previously [2]. Furthermore, outdoor biting exposure and the probability of successful feeding outdoors cannot be directly inferred from the human landing catches, since the landing catches are not in themselves sufficient to survey pattern of normal human exposure to mosquito bite. Once adjusted for human behaviour, most human-vector interaction in this study occurred indoors (Figure 8 & Supplementary Table 3). Outdoor biting is currently not a major factor influencing residual malaria transmission since 95% of the population are indoors at the peak biting period for malaria vector mosquitoes. Human behaviour is the primary driver of when and where exposure occurs and is far more variable than the mosquito behaviour that matter within a single vector species [3].

Q2) The most important data clearly missing from the characterization of the study scenario are (a) spoorozoite rates (mentioned in the methods but not the results) and EIR estimates, to confirm that Anopheles funestus group mosquitoes are the most important vectors of malaria in this area, (b) quantitative estimates of where and when humans are exposed to these two major vector taxa (not species unless PCR data are added) that weight the biting estimates by surveys of human behaviour [2-5]. These are increasingly common calculations applied to data from all over the tropics [6-13], and vitally important to conduct before making any quantitative statements about proportional contributions of outdoor biting exposure.

A2: We have included data obtained from the ELISA-CSP and molecular analysis. We have also added data on sporozoite rate as shown below in the result section.

Result section

“Over 26 nights, 415 female Anopheles mosquitoes were collected by both methods (i.e. 272 by HLC and 143 by CDC-LT), representing a mean of 16 mosquitoes per night. 66% of mosquitoes were collected using HLC. Of the 415 mosquitoes morphologically identified, 311 (75%) were An. funestus group, 84 (20%) were An. gambiae s.l. and 20 (5%) were other Anopheles i.e. An. protoriensis, An. coustani, An. moucheti and An. squamosus (Table 2). The An. funestus group was significantly greater than An. gambiae s.l (p<0.001). Out of the 84 amplified samples of An. gambiae s.l., 68 (81%) were An. Arabiensis and 16 (19%) were An. gambiae s.s. The proportion of Anopheles mosquitoes caught outdoors (60%; 95% CI: 55%, 65%) was significantly greater than the proportion caught indoors (p<0.001). There were more Anopheles mosquitoes collected outdoors in all geographical areas except area 6, where most of the mosquitoes were collected indoor (Table 2). The frequencies of vectors collected in each geographical area are summarized in Supplementary Table 2. An. funestus group was the most prevalent vector in all areas. Of the 272 mosquitoes collected by HLC, 3.3% (9/272) tested positive for P. falciparum sporozoites. Higher sporozoite rate was observed among the An. funestus group (7/9). The rate of indoor and outdoor biting estimated by HLC was 19.8 and 25.5 bites per person per night, respectively.”

Q3) There is no evidence of any “shift” in behaviours over time presented here, so the term “undermines” is unjustified and seems to create an argument that hasn’t been made. Most behaviours that enable residual malaria transmission despite LLIN use are pre-existing, although plastic, and often it’s just the vector population composition that shifts 14, so the term “limits” is more appropriate.

A3: We have revised as proposed above in the abstract section.

Conclusion

“Our data therefore do not support the hypothesis that outdoor biting limits the effectiveness of ITNs in our study area.”

Q4) While indeed there is no evidence here that outdoor transmission contributes to ongoing transmission, there is also no evidence that it does not. Such outdoor fractions of transmission can only be expected to become epidemiologically detectable once larger quantities of indoor transmission (which I’m convinced is the case here as explained above) have been tackled. So the phraseology of conclusions needs to be tempered using words like “yet”, and explain how these currently minor fractions of transmission may emerge as important contributors to sustained endemicity once further progress has been made with indoor control [14,15].

A4: We have revised as proposed above in the discussion section.

Discussion section

“In summary, our data do not support the hypothesis that outdoor biting limits the effectiveness of ITNs in our study area. The outdoor biting observed may therefore have been the result of high levels of ITN use leading to unsuccessful attempts at indoor feeding. However, it remains possible that continued selection pressures might lead to the emergence of populations of mosquitoes that are better adapted to outdoor feeding in the future. Outdoor feeding is becoming more common in parts of Africa [4] and may represent evolutionary change in some areas, with a potential to undermine ITN effectiveness. The outdoor fractions of transmission can be expected to be epidemiologically detectable once indoor transmission has been tackled. Therefore, malaria control programs require monitoring to assess the impact of ITNs on vector populations and vector behavioral change as well as monitoring ITN effectiveness as vectors evolve [5-9]. Continuous monitoring of vector bionomics, and malaria transmission dynamics are essential for predicting disease outbreaks and guiding vector control in the region. Furthermore, capacity needs to be built in interpreting and applying these data to malaria control policy.”

Q5) In any case, LLINs clearly fall a long way short of being 100% efficacious with 22% personal protection estimated here, so there clearly are considerable limitations to this technology that need explanation. To get a better handle on whether outdoor exposure does contribute to residual transmission, in our experience it’s necessary to test as a function of individual human behavioural profiles weighted by activity patterns for the most dominant local vectors [13]. Indeed human behaviour is the primary driver of where and when exposure occurs [1] and is far more variable than the mosquito behaviours that matter within a single vector species [15].

A5:  We have made adjustments to the indoor and outdoor biting rate by human behavior as shown above, and accordingly revised the discussion as above.

Q6) In any case, for many of the surveyed locations, very few mosquitoes were caught (Supplementary Table 2) and CDC light traps catches indoors and outdoors are not comparable, so reporting these data as indicators of the degree of exophagy or endophagy is going too far and overstretching very little entomological data.

A6: We have made revision in the result and discussion section as shown above.

Q7) The fact that these are not differentiated to species (again, though this is mentioned in the methods but no results are presented) also means that areas with apparently different mosquito behaviours are probably areas that simply have different relative abundances of primary vector, secondary vector and non-vector species within the Anopheles funestus group and within the Anopheles gambiae complex. For example, greater outdoor feeding at dawn and dusk is a known characteristic of Anopheles rivulorum and Anopheles parensis, originally discovered in this region on the basis of their distinctive behaviours and much weaker vectorial capacities.

A7: We have addressed the above comment as follows:

We have included Figure 7 which illustrates hourly biting pattern of Anopheles mosquitoes occurring both indoors (solid lines) and outdoors (dashed lines). The grey area represents the proportion of the children <5 years asleep at each hour of the night.

We do not have molecular data for the An. funestus group. We have included this as a limitation in the discussion section as shown below.

Discussion section

“Lack of explicit molecular data for distinguishing sibling species and molecular forms within the An. funestus group introduces ambiguity into the interpretation of the results of the study.”

Q8) The term “species” is used very loosely and interchangeably with other taxonomic classification levels, resulting in some misleading over-interpretation. While Anopheles gambiae sensu lato is indeed a complex, Anopheles funestus sensu lato is a group (not a complex, as stated in the introduction) and neither can be described as a species, unless one is talking about unambiguously identified individual specimens of the nominate species, which are by far the most efficient species within each taxon.

A8: We have made revisions accordingly.

Q9) All of these most important limitations seem to be missing from the paragraph opening with the sentence “Our study has some limitations”.

A9: We have updated the manuscript with the adjustments to the indoor and outdoor biting rate by human behaviour as shown above. We have also updated the limitations of our study as shown under the discussion section.

Discussion section

“Our study has a number of limitations. Data on ITN use may have been incorrectly reported, as we did not require each resident to be present during the survey. We attempted to minimize this by instructing data collecting teams to interview only residents of the same homestead regarding ITN ownership and usage. There may have been some misclassification as we did not ascertain ITN use during hospital presentation but instead used the yearly ITN data collected by the annual survey. The results may also be confounded by other unmeasured factors (e.g., variation in the quality and type of ITN, urbanization, socio-economic status and mother’s education). It is likely that we underestimated the protection afforded by the use of high-quality ITN because we included all ITNs, regardless of quality, physical integrity or bioefficacy of the insecticidal compounds. The vast majority of ITNs in the area are long-lasting insecticidal nets, hence we do not expect substantial variation in insecticidal efficacy. The accuracy of the mosquito survey is limited by the practical challenges of maintaining consistently sensitive human landing catches throughout the night. Lack of explicit molecular data for distinguishing sibling species and molecular forms within the An. funestus group introduces ambiguity into the interpretation of the results of the study. In this study, we examined variations in the personal protection afforded by ITNs and did not examine variation in community level effect. The size of our study limits power: with a sample size of 415, and the proportion of mosquitoes biting outdoors at 67% in low ITN effectiveness areas we therefore had >90% power to detect a reduction to 27% or lower in high ITN effectiveness areas. Our study was therefore powered to detect only a large difference in the proportion of vectors caught outdoors. However, we reasoned that reductions of ITN effectiveness to less than half of the previously documented efficacy of 50% would require a doubling of the proportion of mosquitoes feeding outdoors.  Hence our study was powered to detect large variations in the frequency of outdoor biting. In addition, the accuracy of mosquito sampling data is limited as only one month of sampling was conducted in this study, we recommend sampling for a longer duration of time.” 

Q10) What is called “effectiveness” here refers only to the relatively minor personal protection effect of bednets, and does not capture any variations in community-level impact. All fine but please explain this study limitation clearly.

A10: We have made revision in the discussion section indicating this limitation as follows.

Discussion section

In this study, we examined variations in the personal protection afforded by ITNs and did not examine variation in community level effect.

Q11) Correspondingly, doesn’t capture how big a change this transmission picture is relative to the same setting 10 to 15 years ago when nominate Anopheles gambiae were still quite abundant. The explanations about the relative abundance of vector taxa (not species) is accurate but rather static and lacking in long term context, demonstrating the much bigger overall impact on vector populations and endemicity. This is a pity when this contemporary study has been conducted in an area with so much historical entomological literature, so please enrich the narrative.

A11: We have added points as follows in the discussion section;

“Malaria transmission has reduced dramatically over the last 15 years in Kilifi, evidenced by falling rates of clinical malaria cases in hospital [10, 11] in the community [12] and falling community prevalence of asymptomatic infection [13]. A recent resurgence has been noted with increasing cases among older children, and increasing prevalence of infection more widely around the coast [14]. The reductions have been temporally associated with marked reductions in the prevalence of the abundance of vectors [15] and with a pronounced shift away from Anopheles gambiae s.s, which was previously the dominant vector, and a shift away from Anopheles arabiensis.”

Q12) While I agree with the closing statement about enhancing entomological surveillance, in my experience many groups are under-interpreting or misinterpreting the data they already have, so perhaps that capacity limitation merits some emphasis as a priority.

A12: We have added a statement in the summary section as shown below.

“Furthermore, capacity needs to be built in interpreting and applying these data to malaria control policy.”

References

1.              Seyoum A, Sikaala CH, Chanda J, Chinula D, Ntamatungiro AJ, Hawela M, Miller JM, Russell TL, Briet OJ, Killeen GF: Human exposure to anopheline mosquitoes occurs primarily indoors, even for users of insecticide-treated nets in Luangwa Valley, South-east Zambia. Parasit Vectors 2012, 5:101.

2.              Govella NJ, Okumu FO, Killeen GF: Insecticide-treated nets can reduce malaria transmission by mosquitoes which feed outdoors. Am J Trop Med Hyg 2010, 82:415-419.

3.              Huho B, Briet O, Seyoum A, Sikaala C, Bayoh N, Gimnig J, Okumu F, Diallo D, Abdulla S, Smith T, Killeen G: Consistently high estimates for the proportion of human exposure to malaria vector populations occurring indoors in rural Africa. Int J Epidemiol 2013, 42:235-247.

4.              Githeko AK, Adungo NI, Karanja DM, Hawley WA, Vulule JM, Seroney IK, Ofulla AV, Atieli FK, Ondijo SO, Genga IO, et al: Some observations on the biting behavior of Anopheles gambiae s.s., Anopheles arabiensis, and Anopheles funestus and their implications for malaria control. Exp Parasitol 1996, 82:306-315.

5.              Mutuku FM, King CH, Mungai P, Mbogo C, Mwangangi J, Muchiri EM, Walker ED, Kitron U: Impact of insecticide-treated bed nets on malaria transmission indices on the south coast of Kenya. Malar J 2011, 10:356.

6.              Bayoh MN, Mathias DK, Odiere MR, Mutuku FM, Kamau L, Gimnig JE, Vulule JM, Hawley WA, Hamel MJ, Walker ED: Anopheles gambiae: historical population decline associated with regional distribution of insecticide-treated bed nets in western Nyanza Province, Kenya. Malar J 2010, 9:62.

7.              Gimnig JE, Kolczak MS, Hightower AW, Vulule JM, Schoute E, Kamau L, Phillips-Howard PA, ter Kuile FO, Nahlen BL, Hawley WA: Effect of permethrin-treated bed nets on the spatial distribution of malaria vectors in western Kenya. Am J Trop Med Hyg 2003, 68:115-120.

8.              Russell TL, Govella NJ, Azizi S, Drakeley CJ, Kachur SP, Killeen GF: Increased proportions of outdoor feeding among residual malaria vector populations following increased use of insecticide-treated nets in rural Tanzania. Malar J 2011, 10:80.

9.              Killeen GF, Kihonda J, Lyimo E, Oketch FR, Kotas ME, Mathenge E, Schellenberg JA, Lengeler C, Smith TA, Drakeley CJ: Quantifying behavioural interactions between humans and mosquitoes: evaluating the protective efficacy of insecticidal nets against malaria transmission in rural Tanzania. BMC Infect Dis 2006, 6:161.

10.           Mogeni P, Williams TN, Fegan G, Nyundo C, Bauni E, Mwai K, Omedo I, Njuguna P, Newton CR, Osier F, et al: Age, Spatial, and Temporal Variations in Hospital Admissions with Malaria in Kilifi County, Kenya: A 25-Year Longitudinal Observational Study. PLoS Med 2016, 13:e1002047.

11.           O'Meara WP, Bejon P, Mwangi TW, Okiro EA, Peshu N, Snow RW, Newton CR, Marsh K: Effect of a fall in malaria transmission on morbidity and mortality in Kilifi, Kenya. Lancet 2008, 372:1555-1562.

12.           Mwangi TW, Ross A, Snow RW, Marsh K: Case definitions of clinical malaria under different transmission conditions in Kilifi District, Kenya. J Infect Dis 2005, 191:1932-1939.

13.           Mogeni P, Williams TN, Omedo I, Kimani D, Ngoi JM, Mwacharo J, Morter R, Nyundo C, Wambua J, Nyangweso G: Detecting Malaria Hotspots: a comparison between RDT, Microscopy and Polymerase Chain Reaction. The Journal of Infectious Diseases 2017.

14.           Snow RW, Kibuchi E, Karuri SW, Sang G, Gitonga CW, Mwandawiro C, Bejon P, Noor AM: Changing Malaria Prevalence on the Kenyan Coast since 1974: Climate, Drugs and Vector Control. PLoS One 2015, 10:e0128792.

15.           Mwangangi JM, Mbogo CM, Orindi BO, Muturi EJ, Midega JT, Nzovu J, Gatakaa H, Githure J, Borgemeister C, Keating J, Beier JC: Shifts in malaria vector species composition and transmission dynamics along the Kenyan coast over the past 20 years. Malar J 2013, 12:13.

Wellcome Open Res. 2017 May 2. doi: 10.21956/wellcomeopenres.11943.r22390

Referee response for version 1

Seynabou Sougoufara 1,2

The authors present here the study on the variation of the effectiveness of insecticide-treated bed nets against malaria and the outdoor biting by vectors in Kilifi, Kenya.

The manuscript reported the geographical heterogeneity of malaria prevalence according several parameters mainly including the ITN effectiveness and the feeding behaviour of Anopheles vectors. The design and method of the study are well presented in the section “Methods” as well as the statistical analysis. Clinical surveillance was analyzed in the study between January 2009 and December 2014 that covers a long period. Thus it will be interesting if authors add in their explanatory factors the dry and wet season. It will be also important to explain the discrepancy between the date of clinical surveillance data collection (January 2009 and December 2014) and the mosquito collection (July and August 2016). We have any informations if the level of ITN use varied or is the same during both periods.

Additionally the main part of the subject underlines the effectiveness of the ITNs. However, authors should describe at first that the effectiveness of ITNs is monitoring taking into account the physical integrity of nets, bioefficacity and the insecticidal compounds even though they focused more their study on feeding place and malaria prevalence. It will be also more appropriate if authors interpreted their result according to level of ITNs use according to areas and discuss though their outcomes the effectiveness of ITN. For instance in the abstract the expression of “ high and low effectiveness” in the part of method is a hasty affirmation.

In the section of “Results” I think that the Supplementary Table 1 has to be presented in the main manuscript as it present malaria prevalence according to area and the level of ITNs use. Moreover the presentation of results must be more detailed and the effect of each risk factors cited in the part of “Statistical analysis” must be presented. I don’t understand why authors said “ ITN use was consistently >50% in all geographical areas”, meaning that here we have no information about the difference of level use between areas. The authors have summarized too much the description of the results in this part.

Authors presented in the part “Mosquito processing”  laboratory works such ELISA-CSP and molecular analysis, however the results of these analysis have not been presented in this study.

Regarding the result on vector abundance, authors have to present the results according to absolute densities and less on the proportion of species in the place of mosquito collection.

The relevance of the study will be more remarkable if authors greatly discuss in deep their outcomes by comparing with other studies. Additionally, the review of the literature has to be strengthened, “33 off the 43 references are more than 5 years old and some newer papers are missing.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2018 Jan 6.
Alice Kamau 1

We are grateful for this review and the helpful comments and suggestions that have been made. We have included a point-by-point response (in bold) to the issues raised.

Q1) The manuscript reported the geographical heterogeneity of malaria prevalence according several parameters mainly including the ITN effectiveness and the feeding behaviour of Anopheles vectors. The design and method of the study are well presented in the section “Methods” as well as the statistical analysis. Clinical surveillance was analyzed in the study between January 2009 and December 2014 that covers a long period. Thus it will be interesting if authors add in their explanatory factors the dry and wet season. It will be also important to explain the discrepancy between the date of clinical surveillance data collection (January 2009 and December 2014) and the mosquito collection (July and August 2016). We have any information if the level of ITN use varied or is the same during both periods.

A1: We have made revision to address all the questions above as follows:

We have updated the clinical surveillance data to December 2016 and updated the manuscript accordingly. We have also included season as a covariate in both univariable and multivariable analysis, Supplementary Table 1.

Changes are as follows;

Method section

“The clinical surveillance study was conducted between January 2009 and December 2016 within a 6km radius of Pingilikani dispensary in Kilifi County on the Kenyan Coast (Figure 1): within the Kilifi Health and Demographic Surveillance System (KHDSS).”

Statistical analysis section

“The outcome of interest was presence of malaria by microscopy on presentation to the dispensary. The potential risk factors included: ITN use, age of the child, year of presentation to the dispensary, season (the wet season comprised of April, May, June, October and November) and the geographical area, as defined by the 2.5x2.5 km regular polygons.”

Q2) Additionally the main part of the subject underlines the effectiveness of the ITNs. However, authors should describe at first that the effectiveness of ITNs is monitoring taking into account the physical integrity of nets, bioefficacity and the insecticidal compounds even though they focused more their study on feeding place and malaria prevalence. It will be also more appropriate if authors interpreted their result according to level of ITNs use according to areas and discuss though their outcomes the effectiveness of ITN. For instance, in the abstract the expression of “high and low effectiveness” in the part of method is a hasty affirmation.

A2: We have included the above comment as a limitation to our study as we did not have data on the physical integrity of nets or the bioefficacy of the insecticidal compounds. We’ve also revised the abstract session. We’ve revised the abstract session to indicate “varying ITN effectiveness” rather than “high and low ITN effectiveness”

Abstract section

“We linked homestead level geospatial data to clinical surveillance data at a primary healthcare facility in Kilifi County in order to map geographical heterogeneity in ITN effectiveness and observed vector feeding behaviour using landing catches and CDC light traps in six selected areas of varying ITN effectiveness.”

Discussion section

“It is likely that we underestimated the protection afforded by the use of high-quality ITN because we included all ITNs, regardless of quality, physical integrity or bioefficacy of the insecticidal compounds.”

Q3) In the section of “Results” I think that the Supplementary Table 1 has to be presented in the main manuscript as it present malaria prevalence according to area and the level of ITNs use. Moreover, the presentation of results must be more detailed and the effect of each risk factors cited in the part of “Statistical analysis” must be presented. I don’t understand why authors said “ITN use was consistently >50% in all geographical areas”, meaning that here we have no information about the difference of level use between areas. The authors have summarized too much the description of the results in this part. Authors presented in the part “Mosquito processing” laboratory works such ELISA-CSP and molecular analysis, however the results of these analysis have not been presented in this study. Regarding the result on vector abundance, authors have to present the results according to absolute densities and less on the proportion of species in the place of mosquito collection.

A3: We have made revision to address all the questions above as follows:

We have included two tables: (i) a descriptive table in the main text that indicates the prevalence of malaria and ITN use; and (ii) a table showing the full result of the univariable and multivariable analysis. We have included data obtained from the ELISA-CSP and molecular analysis. We’ve made revisions as shown below.

Result section

We’ve have included a descriptive table in the main text that indicates the prevalence of malaria and ITN use i.e. Table 1.

The full result of the univariable and multivariable analysis are shown in the Supplementary Table 1.

“Over 26 nights, 415 female Anopheles mosquitoes were collected by both methods (i.e. 272 by HLC and 143 by CDC-LT), representing a mean of 16 mosquitoes per night. 66% of mosquitoes were collected using HLC. Of the 415 mosquitoes morphologically identified, 311 (75%) were An. funestus group, 84 (20%) were An. gambiae s.l. and 20 (5%) were other Anopheles i.e. An. protoriensis, An. coustani, An. moucheti and An. squamosus (Table 2). The An. funestus group was significantly greater than An. gambiae s.l (p<0.001). Out of the 84 amplified samples of An. gambiae s.l., 68 (81%) were An. Arabiensis and 16 (19%) were An. gambiae s.s. The proportion of Anopheles mosquitoes caught outdoors (60%; 95% CI: 55%, 65%) was significantly greater than the proportion caught indoors (p<0.001). There were more Anopheles mosquitoes collected outdoors in all geographical areas except area 6, where most of the mosquitoes were collected indoor (Table 2). The frequencies of vectors collected in each geographical area are summarized in Supplementary Table 2. An. funestus group was the most prevalent vector in all areas. Of the 272 mosquitoes collected by HLC, 3.3% (9/272) tested positive for P. falciparum sporozoites. Higher sporozoite rate was observed among the An. funestus group (7/9). The rate of indoor and outdoor biting estimated by HLC was 19.8 and 25.5 bites per person per night, respectively.”

Q4) The relevance of the study will be more remarkable if authors greatly discuss in deep their outcomes by comparing with other studies. Additionally, the review of the literature has to be strengthened, “33 off the 43 references are more than 5 years old and some newer papers are missing.

A4: We have added 10 more recent reference as shown under the reference section. We have discussed our outcomes by comparing with other studies under the discussion section

Reference section

  1. Bradley J, Lines J, Fuseini G, Schwabe C, Monti F, Slotman M, Vargas D, Garcia G, Hergott D, Kleinschmidt I: Outdoor biting by Anopheles mosquitoes on Bioko Island does not currently impact on malaria control. Malar J 2015, 14:170.

  2. Moiroux N, Damien GB, Egrot M, Djenontin A, Chandre F, Corbel V, Killeen GF, Pennetier C: Human exposure to early morning Anopheles funestus biting behavior and personal protection provided by long-lasting insecticidal nets. PLoS One 2014, 9:e104967.

  3. Killeen GF, Marshall JM, Kiware SS, South AB, Tusting LS, Chaki PP, Govella NJ: Measuring, manipulating and exploiting behaviours of adult mosquitoes to optimise malaria vector control impact. BMJ Glob Health 2017, 2:e000212. 

  4. Kamau A, Nyaga V, Bauni E, Tsofa B, Noor AM, Bejon P, Scott JAG, Hammitt LL: Trends in bednet ownership and usage, and the effect of bednets on malaria hospitalization in the Kilifi Health and Demographic Surveillance System (KHDSS): 2008-2015. BMC Infect Dis 2017, 17:720.

  5. Royston P, Sauerbrei W: Building multivariable regression models with continuous covariates in clinical epidemiology--with an emphasis on fractional polynomials. Methods Inf Med 2005, 44:561-571.

  6. Sauerbrei W, Meier-Hirmer C, Benner A, Royston P: Multivariable regression model building by using fractional polynomials: description of SAS, STATA and R programs. Computational Statistics & Data Analysis 2006, 50:3464-3485.

  7. Kezdi G: Robust Standard Error Estimation in Fixed-Effects Panel Models. 2003.

  8. Seyoum A, Sikaala CH, Chanda J, Chinula D, Ntamatungiro AJ, Hawela M, Miller JM, Russell TL, Briet OJ, Killeen GF: Human exposure to anopheline mosquitoes occurs primarily indoors, even for users of insecticide-treated nets in Luangwa Valley, South-east Zambia. Parasit Vectors 2012, 5:101.

  9. Lengeler C: Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database Syst Rev 2004 :CD000363.

  10. Moiroux N, Gomez MB, Pennetier C, Elanga E, Djenontin A, Chandre F, Djegbe I, Guis H, Corbel V: Changes in Anopheles funestus biting behavior following universal coverage of long-lasting insecticidal nets in Benin. J Infect Dis 2012, 206:1622-1629.

  11. Mwangi TW, Ross A, Snow RW, Marsh K: Case definitions of clinical malaria under different transmission conditions in Kilifi District, Kenya. J Infect Dis 2005, 191:1932-1939.

  12. Mogeni P, Williams TN, Omedo I, Kimani D, Ngoi JM, Mwacharo J, Morter R, Nyundo C, Wambua J, Nyangweso G: Detecting Malaria Hotspots: a comparison between RDT, Microscopy and Polymerase Chain Reaction. The Journal of Infectious Diseases 2017.

  13. Kapesa A, Kweka EJ, Atieli H, Kamugisha E, Zhou G, Githeko AK, Yan G: Why some sites are responding better to anti-malarial interventions? A case study from western Kenya. Malar J 2017, 16:498.

  14. Yohannes M, Boelee E: Early biting rhythm in the Afro-tropical vector of malaria, Anopheles arabiensis, and challenges for its control in Ethiopia. Med Vet Entomol 2012, 26:103-105

  15. Huho B, Briet O, Seyoum A, Sikaala C, Bayoh N, Gimnig J, Okumu F, Diallo D, Abdulla S, Smith T, Killeen G: Consistently high estimates for the proportion of human exposure to malaria vector populations occurring indoors in rural Africa. Int J Epidemiol 2013, 42:235-247.

Wellcome Open Res. 2017 Apr 25. doi: 10.21956/wellcomeopenres.11943.r22156

Referee response for version 1

Heiko Becher 1

This report refers to statistical methods. Other relevant issues (“…  and does it cite the current literature?”) are not considered.

The authors investigate the relation between ITN use and malaria prevalence, and secondly spatial variation in the effectiveness of ITN.

Overall, the methods are too briefly described and make a thorough evaluation difficult. Some remarks may help to update the manuscript.

 

  • The authors collected data from 20827 visits of 4992 children, i.e. about 5 visits for each child on average, from 21 areas. For each visit, parasitemia was assessed. The probability of parasitemia was modeled with a logistic regression model with ITN use, age, year and area as covariables, plus interaction terms. To account for correlated observations, a robust estimate of the standard errors was employed, although the exact method used is not given (reference should be provided). I wonder why season (rainy / dry) was not considered. The full result of the model is not given, and I wonder whether the large number of interaction terms in the model gave in a meaningful result. The Supplementary Table 1 gives the ORs for ITN use by area which is difficult to follow since (i) the numbering of the areas does not give information on spatial distribution (ii) it is not easy to see from the table whether malaria prevalence and ITN use differs between areas (iii) the effect of the other covariables is unknown (is there some confounding? What is the effect of age? Was a full fractional polynomial procedure used?).

  • The Kulldorf statistic was used, if I understand correctly, to identify clusters of high or low ITN effectiveness without taking  malaria prevalence and ITN use into account. Is that true? This seems not correct to me but maybe I misunderstood the procedure.

  • The proportion of vectors biting outdoors was compared for the areas. This would mean ignoring the absolute biting frequency which differs largely between areas.

Overall, the authors have carefully interpreted the results.

I have read this submission. I believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2018 Jan 6.
Alice Kamau 1

We are grateful for this review and the helpful comments and suggestions that have been made. We have included a point-by-point response (in bold) to the issues raised.

Q1) The authors collected data from 20827 visits of 4992 children, i.e. about 5 visits for each child on average, from 21 areas. For each visit, parasitemia was assessed. The probability of parasitemia was modeled with a logistic regression model with ITN use, age, year and area as covariables, plus interaction terms. To account for correlated observations, a robust estimate of the standard errors was employed, although the exact method used is not given (reference should be provided). I wonder why season (rainy / dry) was not considered. The full result of the model is not given, and I wonder whether the large number of interaction terms in the model gave in a meaningful result. The Supplementary Table 1 gives the ORs for ITN use by area which is difficult to follow since (i) the numbering of the areas does not give information on spatial distribution (ii) it is not easy to see from the table whether malaria prevalence and ITN use differs between areas (iii) the effect of the other covariables is unknown (is there some confounding? What is the effect of age? Was a full fractional polynomial procedure used?).

A1: We have made revisions to address the questions raised above as follows:

Statistical analysis section

Wet vs. dry season was included as a covariate. We have included a reference for the multiple fractional polynomial transformation procedure [1,2]. We used the “mfp” command in STATA to assess the non-linear effect of age. We have also included a reference, which indicates what method was used for the robust standard error [3].

“The outcome of interest was presence of malaria by microscopy on presentation to the dispensary. The potential risk factors included: ITN use, age of the child, year of presentation to the dispensary, season (the wet season comprised of April, May, June, October and November) and the geographical area, as defined by the 2.5x2.5 km regular polygons.

To assess the non-linear effect of age in the regression models, multiple fractional polynomial transformation was used [1] . A list of fractional polynomial (FP) powers (–2, –1, –0.5, 0, 0.5, 1, 2, 3) were investigated for inclusion in the model using an algorithm that combines a backward elimination procedure with a search for an FP function that best predicts the outcome variable as previously described [2].

Given that the hospital malaria episodes were clustered within patients, we allowed for clustering by using a logistic regression model with robust standard errors [3].

Result section

We’ve have included a descriptive table in the main text indicating the prevalence of malaria and ITN use i.e. Table 1. We have included season as a covariate in both univariable and multivariable analysis, Supplementary Table 1. The full result of the univariable and multivariable analysis are shown in the Supplementary Table 1. We found the interaction terms to be significant and therefore retained them in the model. 

Q2) The Kulldorf statistic was used, if I understand correctly, to identify clusters of high or low ITN effectiveness without taking malaria prevalence and ITN use into account. Is that true? This seems not correct to me but maybe I misunderstood the procedure.

A2: To compute the ITN effectiveness [i.e. (1 – OR) x 100] for each individual homestead, the outcome of interest was presence of malaria and the predictor was ITN use. We have included a description of SaTScan in the statistical analysis section as shown below:

Statistical analysis section

“SaTScan software (version 9.4; https://www.satscan.org/), a spatial scan statistic developed by Kulldorf[4], was used to detect potential spatial variations of ITN effectiveness (without smoothing) by identifying statistically significant geographical clustering of ITN effectiveness using the normal model. The space-time parameter of the spatial scan statistic places a cylindrical window on the coordinates grid for the locations studied and moves the center of the cylinder base over the grid so that the sets of geographic units covered by the window are constantly changing. Whenever the cylindrical window includes a new event, SaTScan calculates a likelihood function to test for elevated risk within the cylinder as compared with outside the cylinder. The observed test statistic is obtained by calculating the likelihood ratio maximized over the collection of zones in the alternative hypothesis. The p value for the detection of clusters is calculated by using the Monte Carlo hypothesis testing (where a number of random replications of the dataset under the appropriate null hypothesis are generated, their test statistics computed and then compared with the observed test statistic to obtain the p-value). The null hypothesis is that the risk of malaria inside and outside the scanning window is the same.”

Q3) The proportion of vectors biting outdoors was compared for the areas. This would mean ignoring the absolute biting frequency which differs largely between areas.

A3: We have included the absolute biting frequencies for each area as shown in supplementary Table 2 below:

Result section

“There were more Anopheles mosquitoes collected outdoors in all geographical areas except area 6, where most of the mosquitoes were collected indoor (Table 2). The frequencies of vectors collected in each geographical area are summarized in Supplementary Table 2.”

References

  1. Royston P, Sauerbrei W: Building multivariable regression models with continuous covariates in clinical epidemiology--with an emphasis on fractional polynomials. Methods Inf Med 2005, 44:561-571.

  2. Sauerbrei W, Meier-Hirmer C, Benner A, Royston P: Multivariable regression model building by using fractional polynomials: description of SAS, STATA and R programs. Computational Statistics & Data Analysis 2006, 50:3464-3485.

  3. Kezdi G: Robust Standard Error Estimation in Fixed-Effects Panel Models. 2003.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Data Availability Statement

    Data that support the findings of this study (hospital surveillance, ITN community surveys and mosquito collection) are available from the KEMRI Institutional Data Access/Ethics Committee, for researchers who meet the criteria for access to confidential data. Details of the criteria can be found in the KEMRI-Wellcome data sharing guidelines. The data includes homestead level coordinates as an essential component and these are personally identifiable data. Access to data is provided via the KEMRI-Wellcome Data Governance Committee: Data_Governance_Committee@kemriwellcome.org; Tel, +254708 587 210; Contact person, Marianne Munene (Secretary; Tel, +254709 983 436).


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES