Abstract
Sample sizes in cluster surveys must be greater than those in surveys using simple random sampling in order to obtain similarly precise prevalence estimates, because results from subjects examined in the same cluster cannot be assumed to be independent. Therefore, a crucial aspect of cluster sampling is estimation of the intracluster correlation coefficient (ρ): the degree of relatedness of outcomes in a given cluster, defined as the proportion of total variance accounted for by between-cluster variation. In infectious disease epidemiology, this coefficient is related to transmission patterns and the natural history of infection; its value also depends on particulars of survey design. Estimation of ρ is often difficult due to the lack of comparable survey data with which to calculate summary estimates. Here we use a parametric bootstrap model to estimate ρ for the ocular clinical sign “trachomatous inflammation—follicular” (TF) among children aged 1–9 years within population-based trachoma prevalence surveys. We present results from a meta-regression analysis of data from 261 such surveys completed using standardized methods in Ethiopia, Mozambique, and Nigeria in 2012–2015. Consistent with the underlying theory, we found that ρ increased with increasing overall TF prevalence and smaller numbers of children examined per cluster. Estimates of ρ for TF were independently higher in Ethiopia than in the other countries.
Keywords: clustering, intracluster correlation coefficient, prevalence, surveys, trachoma, trachomatous inflammation—follicular
Abbreviations
- CI
confidence interval
- GPS
Global Positioning System
- GTMP
Global Trachoma Mapping Project
- MDA
mass drug administration
- PSU
primary sampling unit
- TF
trachomatous inflammation—follicular
Trachoma is a blinding disease caused by infection with the bacterium Chlamydia trachomatis. Ocular infection is mostly found in young children, with repeated infections leading to chronic keratoconjunctivitis (1, 2). Over a period of years, immunologically mediated scarring of the eyelid occurs, causing permanent changes in eyelid morphology and misdirection of the eyelashes so that they abrade the front surface of the eye, leading to permanent opacification of the cornea. Standardized clinical signs of trachoma, defined according to the World Health Organization’s simplified trachoma grading system (3), are used to provide reproducibility in surveys. In this system, “trachomatous inflammation—follicular” (TF) is defined as the presence of 5 or more follicles, each greater than or equal to 0.5 mm in diameter, in the central part of the tarsal conjunctiva of the upper eyelid. Estimates of the prevalence of TF in children aged 1–9 years are used to guide intervention planning and, in particular, to decide where and for how long to implement annual mass distribution of azithromycin, the antibiotic used to treat trachoma.
From 2012 to 2015, standardized baseline prevalence surveys took place throughout Ethiopia, Nigeria, and Mozambique as part of the Global Trachoma Mapping Project (GTMP), with the aim of identifying districts that needed interventions in a push toward global trachoma elimination. These surveys provided data that have been made available to further analysis, to augment existing knowledge of trachoma epidemiology, and to refine future survey protocols for greatest efficiency and accuracy.
Trachoma is found in isolated, socioeconomically deprived rural areas. Population-based prevalence surveys are the gold standard for evaluating its prevalence (4). Although ideally one would select individuals to be examined at random from the target population, so that all residents were equally likely to be selected (simple random sampling), survey costs can be reduced by instead selecting clusters of individuals within geographical locales (cluster sampling). This increases fieldwork efficiency at the expense of the statistical independence of each result. To compensate for the relatedness of individuals within a given cluster and the resulting increased variance in estimates produced as a result of the cluster-sampled design, sample sizes must be increased. The parameter used to describe the correlation of results from individuals within a given cluster is known as the intracluster correlation coefficient (ρ), defined as the proportion of total variance accounted for by between-cluster variation. In infectious disease epidemiology, this coefficient is associated with transmission patterns and the natural history of infection and may depend on the particulars of survey design. An accurate estimate of ρ is needed to design future surveys and, in particular, to determine an appropriate sample size.
In this paper, we use parametric bootstrapping to estimate ρ with 95% confidence intervals for each of 261 trachoma prevalence surveys from Ethiopia, Nigeria, and Mozambique. These estimates are then used to conduct a meta-regression analysis with survey-level covariates to explore variation across surveys and to investigate the influence of key factors on ρ.
METHODS
Sampling design
All surveys were carried out using standardized methodology as part of the GTMP (5). A planned sample size of 1,019 children aged 1–9 years was used to estimate an expected TF prevalence of 10% with a precision of ±3% at the 95% confidence level, using a design effect (the ratio of the clustered sampling variance to simple random sampling variance) of 2.65, the latter being derived from surveys carried out prior to the GTMP.
At the first stage of sampling, primary sampling units (PSUs) were identified in each district. The number of households sampled per PSU (h) was set as that which a single survey team could anticipate being able to sample in 1 working day: 25 in Nigeria, 30 in Ethiopia, and 32 in Mozambique. The number of PSUs in each survey was then dependent on the mean number of children aged 1–9 years that were expected to be found in each household, 
, with the number of PSUs equal to 1,019/(h × 
). This meant that 24–26 PSUs were planned per survey. Typically, existing census data were used to define the sampling frame for PSUs, the resolution being limited by the population size of the lowest administrative census units in the country. PSUs were villages, groups of villages, or other administrative areas. PSUs were sampled with a probability-proportional-to-size methodology, giving more weight to larger (more populous) PSUs. This provided self-weighting of samples so that, despite the clustered design, each individual in the evaluation unit had (as far as was practically possible) an equal likelihood of being sampled.
At the second stage of sampling, within the PSU, compact segment sampling (Ethiopia and Mozambique) or random-walk sampling (Nigeria) was used to select households for inclusion. In Ethiopia and Mozambique, each PSU was divided into segments of 30 and 32 contiguous households, respectively, so that each household in the PSU belonged to a segment. One segment was then chosen at random by drawing lots. All individuals resident in the households of the chosen segment were visited by the survey team. In Nigeria, using random-walk sampling, a starting point in the center of the PSU was agreed upon and a pen was spun on the ground at that point to identify, in quasirandom fashion, a heading for the survey team to transect. A total of 25 households in that direction were enrolled.
In sampled households, all residents aged ≥1 year were eligible for inclusion, and all consenting individuals were examined for signs of trachoma using the World Health Organization’s simplified trachoma grading system (3). For children under age 18 years, consent was obtained from the parent or guardian, and the children themselves gave assent where possible. Data were collected electronically on Android smartphones (Google, Inc., Mountain View, California) (5).
Ethical clearance
The overall GTMP protocol was approved by the ethics committee of the London School of Hygiene & Tropical Medicine. In Ethiopia, the protocol was approved by the ethics committee of each participating regional state. In Mozambique, the protocol was approved by the National Committee on Bio-Ethics and the Provincial Directorate of Health in each province. In Nigeria, the protocol was approved by the National Health Research Ethics Committee. The secondary analyses of anonymized data that underlie this paper were considered by the Ethics Review Committee of the World Health Organization to be exempt from full formal review.
Ethiopia
Between December 2012 and May 2015, a total of 168 standardized surveys were carried out in 7 regions—Afar; Benishangul-Gumuz; Gambella; Oromia; Somali; Southern Nations, Nationalities, and Peoples’ Region; and Tigray. Survey environments ranged from deserts in the Somali region to the highlands of Tigray and tropical rainforests in Gambella. Results of these surveys have been published elsewhere (6–10).
Nigeria
Between February 2013 and February 2014, 121 standardized surveys were carried out in Katsina, Kano, Bauchi, and Kaduna states. The results of these surveys have been published elsewhere (11–14).
Mozambique
Between December 2011 and June 2015, 91 standardized surveys were carried out in Cabo Delgado, Gaza, Inhambane, Manica, Maputo, Nampula, Niassa, Sofala, Tete, and Zambezia provinces. The results of these surveys have been published elsewhere (15).
Estimating
The standard equation for the variance of a proportion achieved through simple random sampling (SRS) of N individuals is given by 
, where p is the sample proportion of the outcome, π is the true proportion of the outcome in the whole population, and N is the total number of individuals examined. In cluster sampling, the increased variance arising from the clustered design is represented by the design effect (DE),
 |
(1) |
so that
 |
where
 |
Here n is the number of clusters in the survey and m is the average number of individuals examined per cluster. Hence, nm = N, the total number of individuals examined.
Therefore,
 |
where 
is approximated as 
. We therefore need to estimate 
to calculate 
for a given survey.
Estimating the between-cluster variance in p
We used parametric resampling with replacement (parametric bootstrapping) to estimate 
. Parametric resampling makes no assumptions about the underlying distribution of the data (16), but the resampling process should mirror, where possible, the sampling strategy that gave rise to the data (17, 18).
The data can be represented as a vector of N independent observations, 
. We wish to estimate the variance of the parameter 
by replicating the highest-level sampling strategy used in the surveys. In this secondary analysis of deidentified data sets, the underlying populations of selected clusters were not known, so equal weighting (rather than weighting proportional to size) was used.
For each 
estimate, the following algorithm was used:
Determine the number of unique clusters in the survey, n, and sample n clusters randomly with replacement. All children aged 1–9 years examined in these clusters comprise the bootstrap data set
. Let i = 1, 2, … n.Calculate the cluster-level TF proportion of
as the sum of all cluster TF cases divided by the number of children examined in the cluster.Calculate the bootstrap prevalence estimate
as 
(the mean of all n cluster-level proportions).Repeat steps 1–4 a total of 4,096 times to generate an estimate of the bootstrap distribution of Y*.
is estimated as the variance of this bootstrap distribution.For each survey,
is then estimated as 
.The variance of
is estimated by replicating steps 1–6 a total of 4,096 times.
In our analysis, bootstrap distributions approximated normal distributions, so 95% confidence intervals were calculated as the 2.5th and 97.5th percentiles of all ordered estimates for a given survey. The overall estimate for each survey was the mean value of these estimates. Bootstrap estimates were resampled 4,096 (212) times to obtain appropriate precision. A total of 4,0962 replications were carried out for each 
estimate. Estimation was carried out in RStudio (RStudio, Inc., Boston, Massachusetts).
Meta-analysis
Next, we conducted a meta-analysis to obtain pooled estimates of ρ across surveys. Pooled estimates were derived using a random-effects model, with survey weights obtained from the intrasurvey variance of each estimate (19, 20). Natural log-transformed estimates were used to limit the effects of heteroscedasticity. Heterogeneity across survey estimates was investigated using the Q statistic, subgroup analysis, and meta-regression analyses (21). Random-effects meta-regression models were fitted to estimates using the “metareg” command in STATA 14 (StataCorp LLC, College Station, Texas). The standard error of each estimate was calculated as the difference between the 97.5th and 2.5th centile estimates divided by 3.92, assuming a normal distribution of bootstrap estimates. Estimates of ρ are reported on the original scale by exponentiating the pooled estimates from the model. Design effect estimates at given covariate values were estimated from pooled ρ estimates as 
, with m set as 30 children per cluster. Forest plots were produced in STATA 14.
Analysis plan
We excluded surveys in which the TF prevalence estimate was less than 2%, in the belief that below this level the data would be too sparse to reliably estimate ρ. We used univariate and multivariable meta-regression techniques to investigate possible sources of heterogeneity between estimates, using the following covariates: TF prevalence, country, mean distance between clusters, mean number of children examined per household, and mean number of children examined per cluster. Covariates were defined using data collected at the time of the survey. For each survey, the average distance between clusters was estimated as the difference between the respective Global Positioning System (GPS) coordinates of each cluster and the centroid GPS coordinates over all clusters, with estimates adjusted for latitude to convert decimal degrees to kilometers. We included this covariate to test the hypothesis that survey areas that covered larger distances were more likely to show a greater variance in TF estimates. We then conducted secondary analyses using ρ estimates stratified by associated covariates.
At the time of data collection, recorders entering data into smartphones were required to submit a unique identity code. This allowed the total number of data recorders to be defined for each survey. Because recorders were paired with graders performing clinical trachoma grading, we included this variable to investigate trachoma grader precision or consistency between graders in a given survey.
RESULTS
A total of 380 surveys from Ethiopia, Nigeria, and Mozambique were made available by the respective health ministries. We excluded 111 surveys because their TF prevalence was below the 2% threshold. We further excluded another 8 surveys because they had an estimated ρ value less than 0.0. Thus, 261 surveys were included in the analysis: 162 from Ethiopia, 44 from Mozambique, and 55 from Nigeria (see Web Table 1, available at https://academic.oup.com/aje). All included surveys used a 2-stage cluster sample survey design. All survey data were baseline trachoma prevalence estimates, with none of the surveyed populations having received previous mass azithromycin administration or other specific interventions deployed to reduce active trachoma prevalence by national elimination programs.
The TF prevalence in children aged 1–9 years was reported in the surveys as the mean of all cluster-level proportions. The median TF prevalence in children aged 1–9 years over all surveys was 16.5% (interquartile range, 4.5–27.5; range, 2.0–50.6). The breakdown of survey-level prevalence by country is shown in Web Table 2.
Number of children examined per cluster
The mean number of children aged 1–9 years examined per cluster was 36.6 in Ethiopia, 39.6 in Mozambique, and 69.1 in Nigeria. Full details of the breakdown of cluster sizes by country are shown in Web Table 3.
Number of children examined per household
The number of children examined per household was considered in the analysis because larger households may have an effect on trachoma transmission either through proximity and interpersonal interaction as a direct risk factor or through common exposures, such as the effect of poor community-level access to sanitation (22). The mean number of children aged 1–9 years examined per household was 2.0 in Ethiopia, 2.0 in Mozambique, and 3.1 in Nigeria (Web Table 4).
Initial meta-analysis
The meta-analysis included 261 estimates of ρ for the clinical sign TF in children aged 1–9 years. The region-level estimates across all surveys are shown in Figure 1. Estimates ranged from 0.0002 (95% confidence interval (CI): 0.0000, 0.0008) in a survey in Kano State, Nigeria, to 0.368 (95% CI: 0.348, 0.388) in a survey in the Southern Nations, Nationalities, and People’s Region of Ethiopia. The overall pooled estimate for all surveys was 0.051 (95% CI: 0.047, 0.056), although there was a great deal of heterogeneity in ρ between surveys (heterogeneity χ2 = 120,000; P < 0.0001).
Figure 1.
Region-level summary forest plot of bootstrap estimates of the intracluster correlation coefficient for 261 standardized population-based trachoma prevalence surveys carried out in Ethiopia, Mozambique, and Nigeria, Global Trachoma Mapping Project, 2012–2015. Bars, 95% confidence intervals (CIs). SNNPR, Southern Nations, Nationalities, and People’s Region.
The largest and least precise estimates were generally from Ethiopia. The pooled ρ estimate was 0.100 (95% CI: 0.093, 0.108) in Ethiopia, 0.033 (95% CI: 0.027, 0.039) in Mozambique, and 0.009 (95% CI: 0.007, 0.012) in Nigeria. When stratified by TF prevalence (within groupings used for making intervention decisions according to World Health Organization recommendations (23)), the pooled estimates were 0.015 (95% CI: 0.012, 0.020), 0.033 (95% CI: 0.026, 0.042), 0.081 (95% CI: 0.071, 0.092), and 0.111 (95% CI: 0.101, 0.124) for TF prevalences of <5.0%, 5.0%–9.9%, 10.0%–29.9%, and ≥30.0%, respectively.
The heterogeneity across country-specific estimates remained even after stratification by TF prevalence. The respective pooled ρ estimates for TF prevalences of <5.0%, 5.0%–9.9%, 10.0%–29.9%, and ≥30.0% were 0.042 (95% CI: 0.029, 0.062), 0.103 (95% CI: 0.084, 0.127), 0.105 (95% CI: 0.093, 0.119), and 0.114 (95% CI: 0.104, 0.126) in Ethiopia and 0.007 (95% CI: 0.005, 0.009), 0.008 (95% CI: 0.005, 0.014), 0.025 (95% CI: 0.015, 0.040), and 0.022 (95% CI: 0.020, 0.024) in Nigeria. In Mozambique, the pooled estimates for TF prevalences of 5.0%, 5.0%–9.9%, and 10.0%–29.9% were 0.022 (95% CI: 0.015, 0.032), 0.033 (95% CI: 0.024, 0.044), and 0.055 (95% CI: 0.044, 0.070), respectively; no survey in Mozambique estimated a TF prevalence of ≥30.0%.
In the univariate meta-regression analyses, a large proportion of variability across all 261 ρ estimates could be explained by country, TF prevalence, mean distance between clusters, number of recorders used in the survey, number of children examined per household, and number of children examined per cluster (Table 1). A larger ρ estimate was associated with a higher TF prevalence, a larger distance between clusters, a larger number of recorders used in the survey, a smaller number of children examined per household, and a smaller number of children examined per cluster. Estimates were generally highest in Ethiopia and lowest in Nigeria.
Table 1.
Results From Meta-Regression of the Intracluster Correlation Coefficient for the Clinical Sign “Trachomatous Inflammation—Follicular” Among Children Aged 1–9 Years in 261 Population-Based Trachoma Prevalence Surveys, Ethiopia, Mozambique, and Nigeria, 2012–2015
| Covariate | No. of Surveys | Pooled ρ Estimate a | 95% CI | % of Variance Explained b | β c , d | 95% CI |
|---|---|---|---|---|---|---|
| Country | 58.2 | |||||
| Ethiopia | 162 | 0.100 | 0.077, 0.128 | 1.000 | Referent | |
| Mozambique | 44 | 0.032 | 0.023, 0.045 | 0.471 | 0.348, 0.638 | |
| Nigeria | 55 | 0.010 | 0.008, 0.012 | 0.789 | 0.273, 2.281 | |
| No. of children examined per cluster | 44.7 | |||||
| 15–29 | 36 | 0.097 | 0.071, 0.132 | 1.000 | Referent | |
| 30–49 | 172 | 0.071 | 0.050, 0.100 | 0.882 | 0.658, 1.181 | |
| 50–79 | 34 | 0.016 | 0.010, 0.024 | 0.518 | 0.332, 0.809 | |
| ≥80 | 19 | 0.005 | 0.003, 0.008 | 0.212 | 0.096, 0.470 | |
| TFe prevalence, % | 36.2 | |||||
| <5.0 | 56 | 0.015 | 0.011, 0.020 | 1.000 | Referent | |
| 5.0–9.9 | 56 | 0.033 | 0.023, 0.048 | 1.638 | 1.230, 2.181 | |
| 10.0–29.9 | 87 | 0.080 | 0.057, 0.114 | 2.392 | 1.816, 3.150 | |
| ≥30.0 | 62 | 0.111 | 0.077, 0.162 | 2.493 | 1.810, 3.432 | |
| No. of recordersf | 48.7 | |||||
| <5 | 53 | 0.009 | 0.007, 0.012 | 1.000 | Referent | |
| 5–9 | 43 | 0.057 | 0.039, 0.083 | 2.335 | 0.834, 6.534 | |
| 10–19 | 149 | 0.082 | 0.061, 0.109 | 2.740 | 0.945, 7.944 | |
| ≥20 | 16 | 0.106 | 0.063, 0.178 | 2.727 | 0.891, 8.343 | |
| No. of children examined per household | 30.1 | |||||
| 1.0–1.9 | 105 | 0.081 | 0.066, 0.099 | 1.000 | Referent | |
| 2.0–2.9 | 130 | 0.051 | 0.038, 0.067 | 0.786 | 0.627, 0.986 | |
| 3.0–3.9 | 19 | 0.006 | 0.003, 0.010 | 0.721 | 0.387, 1.339 | |
| ≥4.0 | 7 | 0.010 | 0.004, 0.023 | 1.710 | 0.677, 4.316 | |
| Quartile of distance between clustersg, km | 13.8 | |||||
| 1 | 65 | 0.023 | 0.017, 0.030 | 1.000 | Referent | |
| 2 | 66 | 0.051 | 0.034, 0.076 | 0.974 | 0.734, 1.289 | |
| 3 | 65 | 0.084 | 0.056, 0.127 | 1.059 | 0.785, 1.430 | |
| 4 | 65 | 0.065 | 0.043, 0.098 | 0.963 | 0.700, 1.324 |
Abbreviations: CI, confidence interval; GPS, Global Positioning System; ICC, intracluster correlation coefficient; TF, trachomatous inflammation—follicular.
aPooled estimate of the ICC.
bProportion of the variability between survey ICC estimates explained by each covariate on the natural logarithmic scale (P < 0.0001 for all variables).
cExponentiated meta-regression coefficient.
dFull meta-regression model adjusting for country, number of children examined per cluster, and prevalence of TF in children aged 1–9 years (P < 0.0001). 69.2% of the variance in the ICC was explained by the full model.
eTF in children aged 1–9 years, the primary clinical sign associated with ocular Chlamydia trachomatis infection used to guide intervention programs under current World Health Organization guidelines (23).
fEstimated as the number of unique recorder identification codes used in the survey.
gEstimated as the square root of the variance of the distance of survey clusters from the geometric center of the GPS coordinates of all survey clusters, converted to kilometers and accounting for latitude.
The multivariable meta-regression analyses aimed to explain the heterogeneity between surveys, accounting for survey-level differences in associated variables. The country covariate was included in the model a priori. When controlling for all variables in the model, only country, TF prevalence category, and cluster size were associated with ρ (P < 0.001), explaining 69.8% of the variability. Ethiopia was independently associated with higher estimates (β = 2.39 (95% CI: 1.85, 3.07); P < 0.001), with no meaningful difference between Mozambique and Nigeria (P = 0.934). The “number of children examined per household” covariate was not included in the final model because of collinearity with the “number of children examined per cluster” covariate. The “number of recorders used per survey” covariate was not included because of collinearity with the country covariate (the Ethiopia and Nigeria surveys were perfectly collinear with number of recorders <5 and number of recorders ≥20, respectively). The final multivariable model accounted for 69.2% of the variance in estimates (Table 1).
DISCUSSION
In general, the intracluster correlation coefficient or the design effect is poorly represented in the public health literature. Individual survey clustering estimates exist (24–27), but we have found only 1 other paper that covered clustering estimates derived from surveys carried out in multiple countries (28). We believe this to be the first time that estimates of ρ from standardized infectious disease surveys conducted internationally have been published together.
Surveys of a particular infectious disease are not always standardized, and as a result it has not previously been possible to amass large numbers of comparable pooled estimates of ρ in a single analysis. We have therefore had an opportunity to augment existing knowledge in a way that was not possible for trachoma prior to the implementation of the GTMP. We found marked heterogeneity in survey ρ estimates, and we explored possible sources of that heterogeneity which may be of use in planning future work.
In 1996, the World Health Organization targeted trachoma for elimination as a public health problem by the year 2020 (29). This was defined, in part, as an estimated TF prevalence in children aged 1–9 years of less than 5% in each formerly endemic district. An important aspect of validating that this goal has been reached is confidence in the method by which prevalence has been measured. Given the marked effect that the ρ estimate has on sample-size planning, it is crucial to have accurate estimates of its value. We have shown that ρ decreases sharply at low TF prevalences, and so with the same absolute precision, accurate estimates of TF can be made using smaller sample sizes as the anticipated elimination endpoint approaches. The converse of this statement is that for a given sample size, with increasing TF prevalence, the precision of a given estimate decreases. In trachoma elimination, the crucial TF thresholds are 5%, 10% and 30%: Where TF prevalence is less than 5.0%, azithromycin mass drug administration (MDA) is not indicated; where it is 5.0%–9.9%, a single round of MDA is recommended before resurvey; where it is 10.0%–29.9%, 3 annual rounds of MDA are recommended before resurvey; and where it is 30.0% or more, 5 annual rounds of MDA are recommended before resurvey. The required performance of a survey methodology for providing estimates around these thresholds depends on the implications of erroneous categorization to the population involved. Incorrect categorization may have significant implications around the 10% threshold, for example, where the cost difference between implementing 1 and 3 years of MDA and the political effect of delaying repeat surveys may each be substantial.
On univariate analysis, there was a suggestion that using fewer data recorders in a given survey was associated with greater concordance of cluster-level TF estimates, and so decreased ρ. However, this variable was not retained in the full multivariable model with the country variable included. It is possible that there was not enough variability in recorder numbers within countries to obtain accurate estimates independent of the overall country variable. From the data, it can be inferred that local logisticians used different field team deployment strategies for completing large numbers of surveys in a given area. One strategy was to use a single data recorder (and, generally, a single accompanying trachoma grader) for a whole survey, so that the individual worked in all clusters in the evaluation unit: If 26 clusters were required, the survey would take 26 team-days of fieldwork for that recorder and his or her trachoma grader. This strategy was used in the majority of surveys in Nigeria and Mozambique. The strategy at the other extreme would be to send 26 data recorders (and their accompanying graders) to 1 cluster each, so that the survey could in theory be completed in a single calendar day (still incorporating 26 team-days of fieldwork). The strategy used in Ethiopia was closer to this model. Intuitively, the trade-off between these strategies is the trade-off between accuracy and precision. One team might be inaccurate, but if so it might be reliably inaccurate and therefore give precision to estimates (and concordance between results). The mean of the cluster-level TF proportions might not necessarily be close to the true population estimate. On the other hand, multiple teams contributing to a single survey could all be inaccurate, but the mean of the cluster-level proportions derived from many hands might (or might not) be closer to the true population-level estimate of disease prevalence. Although the number of recorders was not included in the final model in this analysis, it is possible that this could be considered as a variable in future analyses.
A limitation of this analysis in guiding future surveys is that in the populations surveyed here, for districts in which the TF prevalence was at least 5%, interventions against active trachoma will have been deployed before impact surveys are conducted, and the degree to which the preintervention epidemiology of trachoma is representative of its postintervention epidemiology is unclear, as the varying interventions may have varying impacts on the epidemiology of the underlying disease. Equally uncertain is whether these data will be externally applicable in countries yet to complete baseline trachoma mapping of suspected trachoma-endemic districts.
Overall, we found large variation in ρ estimates between surveys, and so we recommend that ρ estimates used for planning future surveys be conservative. In other words, overestimating the assumed value of ρ would be epidemiologically prudent.
It is hoped that these data can be used to guide future trachoma programs to aid elimination efforts. However, for programmatic use, the design effect is a more commonly cited parameter than ρ, as it is more intuitively useful for program managers, being the factor by which a simple random-sampling sample size should be multiplied to provide equivalent precision in a cluster random sample. Using equation 1, our analyses suggest that when carrying out surveys with more than 30 children examined per cluster, a design effect greater than 2.6 should be used when a TF prevalence close to 5% is expected, a design effect greater than 3.6 should be used when a TF prevalence close to 10% is expected, and a design effect greater than 5.0 should be used when a TF prevalence close to 30% is expected.
ACKNOWLEDGMENTS
Author affiliations: Clinical Research Department, London School of Hygiene & Tropical Medicine, London, United Kingdom (Colin K. Macleod, Robin L. Bailey, and Anthony W. Solomon); Michael Dejene Public Health Consultancy Services, Addis Ababa, Ethiopia (Michael Dejene); Federal Ministry of Health, Addis Ababa, Ethiopia (Oumer Shafi, Biruck Kebede, Nebiyu Negussu); Department of Ophthalmology, Queen Mamohato Memorial Hospital, Maseru, Lesotho (Caleb Mpyet); Sightsavers, Kaduna, Nigeria (Caleb Mpyet); Kilimanjaro Centre for Community Ophthalmology International, Division of Ophthalmology, Groote Schuur Hospital, Cape Town, South Africa (Caleb Mpyet); National Trachoma Control Program, Department of Public Health, Federal Ministry of Health, Abuja, Nigeria (Nicholas Olobio); Department of Ophthalmology, Queen Mamohato Memorial Hospital, Maseru, Lesotho (Joel Alada); Ophthalmology Department, Ministry of Health, Maputo, Mozambique (Mariamo Abdala); Task Force for Global Health, Decatur, Georgia (Rebecca Willis); MRC Tropical Epidemiology Group, Department of Infectious Disease Epidemiology, London School of Hygiene & Tropical Medicine, London, United Kingdom (Richard Hayes); and Department of Control of Neglected Tropical Diseases, World Health Organization, Geneva, Switzerland (Anthony W. Solomon).
This work was supported by a grant for the Global Trachoma Mapping Project (GTMP) from the United Kingdom’s Department for International Development (ARIES: grant 203145) to Sightsavers (Haywards Heath, United Kingdom), which led a consortium of nongovernmental organizations and academic institutions to support ministries of health to complete baseline trachoma mapping worldwide. The GTMP was also funded by the US Agency for International Development through the ENVISION Project, implemented by RTI International (Research Triangle Park, North Carolina) under cooperative agreement AID-OAA-A-11-00048, and the End Neglected Tropical Diseases (END) in Asia Project, implemented by FHI360 (formerly Family Health International) under cooperative agreement OAA-A-10-00051. A committee established in March 2012 to examine issues surrounding completion of global trachoma mapping was initially funded by a grant from Pfizer, Inc. (New York, New York) to the International Trachoma Initiative (Decatur, Georgia). A.W.S. was a Wellcome Trust Intermediate Clinical Fellow (grant 098521) at the London School of Hygiene & Tropical Medicine and is now a staff member of the World Health Organization.
None of the funders played any role in project design or project implementation; in analysis or interpretation of data; in decisions on where, how, or when to publish in the peer-reviewed press; or in manuscript preparation. The authors alone are responsible for the views expressed in this article and they do not necessarily represent the views, decisions, or policies of the institutions with which they are affiliated.
Conflict of interest: none declared.
References
- 1. Grayston JT, Wang SP, Yeh LJ, et al. Importance of reinfection in the pathogenesis of trachoma. Rev Infect Dis. 1985;7(6):717–725. [DOI] [PubMed] [Google Scholar]
- 2. Gambhir M, Basáñez M-G, Burton MJ, et al. The development of an age-structured model for trachoma transmission dynamics. PLoS Negl Trop Dis. 2009;3(6):e462. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Thylefors B, Dawson CR, Jones BR, et al. A simple system for the assessment of trachoma and its complications. Bull World Health Organ. 1987;65(4):477–483. [PMC free article] [PubMed] [Google Scholar]
- 4. Smith JL, Sturrock HJW, Olives C, et al. Comparing the performance of cluster random sampling and integrated threshold mapping for targeting trachoma control, using computer simulation. PLoS Negl Trop Dis. 2013;7(8):e2389. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Solomon AW, Pavluck A, Courtright P, et al. The Global Trachoma Mapping Project: methodology of a 34-country population-based study. Ophthalmic Epidemiol. 2015;22(3):214–225. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Bero B, Macleod C, Alemayehu W, et al. Prevalence of and risk factors for trachoma in Oromia regional state of Ethiopia: results of 79 population-based prevalence surveys conducted with the Global Trachoma Mapping Project. Ophthalmic Epidemiol. 2016;23(6):392–405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Adera TH, Macleod C, Endriyas M, et al. Prevalence of and risk factors for trachoma in Southern Nations, Nationalities, and Peoples’ Region, Ethiopia: results of 40 population-based prevalence surveys carried out with the Global Trachoma Mapping Project. Ophthalmic Epidemiol. 2016;23(suppl 1):84–93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Abashawl A, Macleod C, Riang J, et al. Prevalence of trachoma in Gambella Region, Ethiopia: results of three population-based prevalence surveys conducted with the Global Trachoma Mapping Project. Ophthalmic Epidemiol. 2016;23(suppl 1):77–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Adamu Y, Macleod C, Adamu L, et al. Prevalence of trachoma in Benishangul Gumuz Region, Ethiopia: results of seven population-based surveys from the Global Trachoma Mapping Project. Ophthalmic Epidemiol. 2016;23(suppl 1):70–76. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Sherief ST, Macleod C, Gigar G, et al. The prevalence of trachoma in Tigray Region, northern Ethiopia: results of 11 population-based prevalence surveys completed as part of the Global Trachoma Mapping Project. Ophthalmic Epidemiol. 2016;23(suppl 1):94–99. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Mpyet C, Muhammad N, Adamu MD, et al. Prevalence of trachoma in Katsina State, Nigeria: results of 34 district-level surveys. Ophthalmic Epidemiol. 2016;23(suppl 1):55–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Mpyet C, Muhammad N, Adamu MD, et al. Prevalence of trachoma in Kano State, Nigeria: results of 44 local government area-level surveys. Ophthalmic Epidemiol. 2017;24(3):195–203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Mpyet C, Muhammad N, Adamu MD, et al. Prevalence of trachoma in Bauchi State, Nigeria: results of 20 local government area-level surveys. Ophthalmic Epidemiol. 2016;23(suppl 1):39–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Muhammad N, Mpyet C, Adamu MD, et al. Mapping trachoma in Kaduna State, Nigeria: results of 23 local government area-level, population-based prevalence surveys. Ophthalmic Epidemiol. 2016;23(suppl 1):46–54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Abdala M, Singano CC, Willis R, et al. The epidemiology of trachoma in Mozambique: results of 96 population-based prevalence surveys. Ophthalmic Epidemiol. 2018;25(suppl 1):201–210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Carpenter J, Bithell J. Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med. 2000;19(9):1141–1164. [DOI] [PubMed] [Google Scholar]
- 17. Davison A, Hinkley D. Bootstrap Methods and Their Application. Cambridge, United Kingdom: Cambridge University Press; 1997. [Google Scholar]
- 18. Efron B, Tibshirani R. An Introduction to the Bootstrap. London, United Kingdom: Chapman & Hall Ltd.; 1993. [Google Scholar]
- 19. Thompson SG, Higgins JPT. How should meta-regression analyses be undertaken and interpreted? Stat Med. 2002;21(11):1559–1573. [DOI] [PubMed] [Google Scholar]
- 20. Borenstein M, Hedges LV, JPT H, et al. Introduction to Meta-Analysis. Chichester, United Kingdom: John Wiley & Sons Ltd.; 2009. [Google Scholar]
- 21. Boily M-C, Baggaley RF, Wang L, et al. Heterosexual risk of HIV-1 infection per sexual act: systematic review and meta-analysis of observational studies. Lancet Infect Dis. 2009;9(2):118–129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Garn JV, Boisson S, Willis R, et al. Sanitation and water supply coverage thresholds associated with active trachoma: modeling cross-sectional data from 13 countries. PLoS Negl Trop Dis. 2018;12(1):e0006110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Solomon A, Zondervan M, Kuper H, et al. Trachoma Control: A Guide for Programme Managers. Geneva, Swizerland: World Health Organization; 2006. [Google Scholar]
- 24. Martin J, Girling A, Nirantharakumar K, et al. Intra-cluster and inter-period correlation coefficients for cross-sectional cluster randomised controlled trials for type-2 diabetes in UK primary care. Trials. 2016;17(1): Article 402. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Barnhart D, Hertzmark E, Liu E, et al. Intra-cluster correlation estimates for HIV-related outcomes from care and treatment clinics in Dar Es Salaam, Tanzania. Contemp Clin Trials Commun. 2016;4:161–169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Auplish A, Clarke AS, Van Zanten T, et al. Estimating the intra-cluster correlation coefficient for evaluating an educational intervention program to improve rabies awareness and dog bite prevention among children in Sikkim, India: a pilot study. Acta Trop. 2017;169:62–68. [DOI] [PubMed] [Google Scholar]
- 27. Szwarcwald CL, Souza Júnior PRB, Damacena GN, et al. Analysis of data collected by RDS among sex workers in 10 Brazilian cities, 2009: estimation of the prevalence of HIV, variance, and design effect. J Acquir Immune Defic Syndr. 2011;57(suppl 3):S129–S135. [DOI] [PubMed] [Google Scholar]
- 28. Masood M, Reidpath DD. Intraclass correlation and design effect in BMI, physical activity and diet: a cross-sectional study of 56 countries. BMJ Open. 2016;6(1):e008173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. World Health Organization Future Approaches to Trachoma Control: Report of a Global Scientific Meeting. Geneva, 17–20 June, 1996. (WHO publication no. WHO/PBL/96.56) Geneva, Swizerland: World Health Organization; 1997. [Google Scholar]