Abstract
Background
Population-based health surveys are typically conducted using face-to-face household interviews in low- and middle-income countries (LMICs). However, telephone-based surveys are cheaper, faster, and can provide greater access to hard-to-reach or remote populations. The rapid growth in mobile phone ownership in LMICs provides a unique opportunity to implement novel data collection methods for population health surveys.
Objective
This study aims to describe the development and population representativeness of a mobile phone survey measuring live poultry exposure in urban Bangladesh.
Methods
A population-based, cross-sectional, mobile phone survey was conducted between September and November 2019 in North and South Dhaka City Corporations (DCC), Bangladesh, to measure live poultry exposure using a stratified probability sampling design. Data were collected using a computer-assisted telephone interview platform. The call operational data were summarized, and the participant data were weighted by age, sex, and education to the 2011 census. The demographic distribution of the weighted sample was compared with external sources to assess population representativeness.
Results
A total of 5486 unique mobile phone numbers were dialed, with 1047 respondents completing the survey. The survey had an overall response rate of 52.2% (1047/2006) and a co-operation rate of 89.0% (1047/1176). Initial results comparing the sociodemographic profile of the survey sample to the census population showed that mobile phone sampling slightly underrepresented older individuals and overrepresented those with higher secondary education. After weighting, the demographic profile of the sample population matched well with the latest DCC census population profile.
Conclusions
Probability-based mobile phone survey sampling and data collection methods produced a population-representative sample with minimal adjustment in DCC, Bangladesh. Mobile phone–based surveys can offer an efficient, economic, and robust way to conduct surveillance for population health outcomes, which has important implications for improving population health surveillance in LMICs.
Keywords: mobile telephone survey, health surveillance, survey methodology, Bangladesh
Introduction
Background
Representative population-based surveys are important for measuring health outcomes and behavioral risk factors at the national and subnational levels [1]. These surveys can be used to provide key population health estimates, and if conducted at regular intervals, health trends can be monitored over time [1-3]. In low- and middle-income countries (LMICs), population health surveys are typically conducted using face-to-face household interviews due to methodological challenges, including a lack of representative individual sampling frames [4]. However, because of their high implementation costs and the time required, representative household surveys tend to be conducted only periodically [5]. In contrast, higher income countries (HICs) have developed and used annual telephone-based surveys, such as those for monitoring behavioral risk factor trends [6,7].
Telephone-based surveys are cheaper, faster, and can provide greater access to hard-to-reach or remote populations, particularly in the era of COVID-19, and hence are an appealing method for supplementing or replacing in-person household surveys in LMICs [8,9]. While sampling frames for probability-based telephone surveys have traditionally been limited to landlines in HICs, the growth of mobile phone ownership and the increasing number of mobile phone–only households has led to the development of dual-frame sampling designs [10,11]. However, in LMICs, the growth in mobile phone subscriptions has been exponential, with 22.9 subscriptions per 100 people in 2005 to 99.3 per 100 in 2020 [12]. This rapid increase has led to cellular networks leapfrogging landline infrastructure and mobile phones becoming the primary mode of communication [13].
High levels of phone ownership in LMICs provide a unique opportunity to implement novel data collection methods for population health surveys using mobile phones as a primary sampling unit [13]. However, there remain important methodological concerns regarding the use of mobile phone surveys in producing population-representative samples owing to sampling bias, coverage error, and low response rates [14]. For example, the sociodemographic profiles of mobile phone respondents have been shown to differ from those of face-to-face household survey respondents [15,16]. Recent systematic reviews identified only a few studies that were published using probability-based mobile phone survey methods in LMICs and reported a lack of consensus on the best implementation approaches and analytic methods to overcome methodological challenges in these populations [17,18].
In Bangladesh, where the mobile phone penetration rate is over 87% [19], phone-based surveys have been increasingly used for behavioral risk factor surveillance [20]. In urban areas, where the mobile phone penetration rate is even higher [21], these surveys have the potential to be especially useful for measuring population health outcomes. However, the population representativeness of these surveys has not been systematically evaluated and analytic methods such as poststratification adjustments have not been applied [20]. Therefore, the potential impact of sampling bias and coverage error on study findings and population estimates remains unknown.
Objectives
This study aims to address these critical methodological gaps to support the use of probability-based mobile phone survey methods for routine population health surveillance in LMICs. Here we describe the development of a mobile phone survey for measuring live poultry exposure in urban Bangladesh. Human-animal contact is a significant risk factor for the emergence of novel infectious diseases [22] and is, therefore, a key measure to capture in behavioral risk factor surveillance. Specifically, we provide an in-depth discussion of the methods covering sample design, questionnaire development, data collection, and poststratification analytic methods, as well as call outcome results, including response rates and population representativeness.
Methods
Study Design and Sampling
We conducted a population-based cross-sectional mobile phone survey between September and November 2019 to recruit a representative sample of adult males and females in North and South Dhaka City Corporations (collectively known as Dhaka City Corporation; DCC), in Dhaka, the capital of Bangladesh. The sampling frame was a list of mobile phone numbers from each of Bangladesh’s 4 mobile phone operators (ie, Grameenphone, Robi Axia, Banglalink, and Teletalk). We restricted the phone numbers to those active in DCC, or if they could not be restricted to DCC, to those active in Dhaka district. Over 75% of the population of Dhaka district resides in DCC [23]. The phone numbers were provided by each mobile phone operator with permission from the Bangladesh Telecommunication Regulatory Commission.
We used a single-stage stratified probability sampling design to select participants. Before selection, the phone numbers were stratified by mobile operator and sampled in accordance with each operator’s proportionate market share to maximize the precision of the sample and to ensure a representative distribution (Multimedia Appendix 1, Table S1) [24]. Within each operator list, simple random sampling was used to select phone numbers. At the time of contact, we screened each selected mobile phone respondent for eligibility, and we recruited an equal number of male and female respondents to allow for robust sex-specific analyses. Individuals were eligible for inclusion if they were at least 18 years of age, were current DCC residents, and had been residing in DCC for the past 1 year.
Questionnaire Development
The questionnaire was based on previous poultry exposure surveys conducted in urban China [25-28] but modified to the Bangladeshi context through discussions with a 12-member advisory panel consisting of local experts in survey design, mobile phone surveys, and infectious diseases. Using a structured approach, the panel reviewed each survey question to assess the face and content validity of the items, as well as to identify areas for potential adaptation or modification and item reduction or addition. We conducted 2 rounds of review, and any items that did not achieve group consensus (defined as 60% agreement) were modified and re-examined until consensus was reached. Key revisions in this step centered on prioritizing and selecting items that were deemed feasible and reliable to ask participants during a phone interview. The questionnaire was translated into Bangla and independently reviewed by 2 native speakers familiar with the content to ensure comprehension and clarity; any translation disagreements were reviewed and further updated by the study team.
The final survey instrument comprised 5 sections and captured information on individual and household exposure to live poultry when purchasing at live bird markets (LBMs) and preparing food, prevention practices, influenza-like illness, and sociodemographics. LBMs were defined as a collection of stalls or vendors where the public could purchase live chickens, ducks, geese, or any by-products of these in an unprocessed form [29]. Specifically, the questions covered the following topics: frequency of LBM visits and the associated behaviors in markets, poultry processing practices during food preparation, uptake and adherence to hygiene practices, use of personal protective equipment (ie, gloves, facemask, and apron) during and after poultry exposure, self-reported influenza-like illness using a standard case definition [30], and household and individual-level sociodemographics. To minimize respondent burden when obtaining detailed information, where appropriate, the survey used a significant amount of branching logic. The questionnaire was thoroughly reviewed, and modifications were made as needed based on feedback from a pretesting phase (n=7) and a small-scale pilot (n=41). The final updated survey took approximately 10 to 15 minutes to complete.
Data Collection and Calling Procedure
We programmed both English and Bangla versions of the questionnaire into a customized computer-assisted telephone interview (CATI) platform developed by the Institute of Epidemiology, Disease Control and Research (IEDCR) in Dhaka, Bangladesh. This platform managed both the sampling and data collection processes, including complex form structure, automated repeat call attempts and interview rescheduling, automated strata monitoring of key variables (ie, mobile phone operator and sex of respondent) across interviewers, and pairing with a mobile phone app to facilitate automated dialing of each selected phone number. A team of 4 female data collectors was recruited to conduct the phone interviews, and data were entered into the CATI platform in real time. The data collectors received 4 days of training on the survey methods and questionnaire topics before the start of the pilot and data collection phases.
We conducted the survey between September and November 2019. In advance, we placed a Bangla-language newspaper advertisement in DCC’s 2 most circulated newspapers to inform the public that they might receive a call from IEDCR regarding a health survey, that the phone numbers were randomly selected with the permission of the Bangladesh Telecommunication Regulatory Commission, and that participation was important for improving population health. Phone calls were made every day of the week between 8 AM and 8 PM (local time), except on Friday afternoons because of local religious observances, to limit the potential sampling bias that could result from recruiting only during weekdays and working hours.
Our team attempted calling each phone number up to 4 times to establish contact and conduct an interview with the respondent. Each unanswered call was automatically rescheduled for a different time of the day on a different day of the week over the following 7-day period. If the respondent was not reached after the maximum number of 4 call attempts, with at least one daytime and one evening call attempt, the phone number was classified as no contact and discontinued. At the first successful contact, we explained to the respondent the purpose of the study, the survey length, that participation was voluntary, and that all the information they provided would be kept confidential. Eligibility was confirmed and consent for survey participation was obtained at the time of the interview. When respondents were unable to complete the interview at the time of recruitment, we rescheduled the phone interview to a convenient time within the next 7 days. Once an interview was completed, or if a respondent declined, refused, or was ineligible, we discontinued the phone number from the call bank. In line with the IEDCR phone-based disease surveillance practices, no compensation was provided for participation. An overview of the recruitment process is provided in Multimedia Appendix 1, Figure S1.
Sample Size
A total of 1040 complete interviews (520 males and 520 females) were required to detect an 8% to 9% difference (65% vs 56% [26]) in live poultry exposure between strata, with 95% confidence and 80% power. The reason for explicitly stratifying by sex was to have sufficient statistical power to permit detailed exploration and identify notable differences in high-risk behaviors between males and females. This was important for ensuring appropriate and targeted risk-based implementation strategies.
Ethics Approval
This study received ethical approval from the committees of each of the participating research institutions: University of Toronto (protocol no. 37657), the Institute of Epidemiology, Disease Control and Research (IRB/2019/11), and the London School of Hygiene and Tropical Medicine (ref 17661). All the participants provided oral informed consent via phone.
Data Analysis: Response, Weighting, and Representativeness
The operational data for each phone number dialed and the corresponding details for call outcome status were summarized. We calculated the overall and mobile operator–specific response rates according to the American Association for Public Opinion Research (AAPOR) Response Rate-3 definition, which included those who were eligible and those estimated to be eligible in the denominator [31]. The number of persons estimated to be eligible was derived by assuming that the proportion of eligible individuals among those contacted was the same as for those who could not be contacted or who declined before their eligibility was determined.
The demographic data for completed interviews were summarized, and the sample distributions were compared with the Dhaka City Corporation demographic profile of the 2011 census [23]. To adjust for nonresponse and disproportionate stratified sampling by sex (ie, oversampling of females compared with the reference population), poststratification weights were calculated by age, sex, and education to align with the 2011 census. Weights were calculated using the census population fractionijk/study population fractionijk, where i was the age category, j was sex, and k was the highest completed education level. No extreme values were identified upon inspection. Participants with an invalid response to the weighting variables (ie, age, sex, and education) could not be assigned a weight and were, therefore, not included in the weighted analyses (n=16). The demographic distribution of the weighted data was summarized and compared with external data sources to assess the representativeness of the sample population for other key demographic variables, including marital status and region. All analyses were conducted in Stata 16.1 (StataCorp).
Results
Call Outcomes and Response Rates
Between September and November 2019, 5486 unique phone numbers were dialed. An overview of participant recruitment and outcome classifications is shown in Figure 1. Of the 5486 phone numbers dialed, 2051 (37.4%) were screened and determined to be ineligible. This included 288 (5.2%) phone numbers that were not in service, 49 (0.9%) respondents who were not in the eligible age range, 234 (4.3%) respondents who were not living in DCC, and 40 (0.7%) who had been living in DCC for less than 1 year. In addition, 1440 (26.2%) respondents were excluded because their sex-specific strata were complete; no information was obtained from 2259 (41.2%) phone numbers, including 1713 (31.2%) with no contact and 546 (10.0%) where the respondent declined to participate. Assuming that the mobile operator-weighted proportion of eligible individuals among those contacted and screened for eligibility was the same as for those who could not be contacted or who declined, 830 (36.7%) of these 2259 phone numbers were estimated to be eligible. Interviews were completed with 1047 (52.2%) respondents out of the 2006 eligible (known and estimated) phone numbers. The overall cooperation rate was 89.0%, based on the number of known eligible respondents contacted. Table 1 presents the call outcomes and response rates overall and by mobile phone operator.
Figure 1.
Profile of participant recruitment and call outcome classification for the live poultry exposure mobile phone survey, Dhaka City Corporation, Bangladesh. DCC: Dhaka City Corporation.
Table 1.
Call outcome classification and response rates overall and by mobile phone operator for the live poultry exposure mobile phone survey, Dhaka City Corporation, Bangladesh.
| Call outcome status | All, n (%) | Grameenphone, n (%) | Robi Axia, n (%) | Banglalink, n (%) | Teletalk, n (%) | ||||||||
| Call outcomes | |||||||||||||
|
|
Phone numbers dialed | 5486 (100) | 1901 (100) | 2100 (100) | 1346 (100) | 139 (100) | |||||||
|
|
Total ineligible | 2051 (37.4) | 697 (36.7) | 932 (44.4) | 367 (27.3) | 55 (39.6) | |||||||
|
|
|
Not in service | 288 (5.2) | 42 (2.2) | 115 (5.5) | 126 (9.4) | 5 (3.6) | ||||||
|
|
|
<18 years of age | 49 (0.9) | 15 (0.8) | 13 (0.6) | 18 (1.3) | 3 (2.2) | ||||||
|
|
|
Does not live in DCCa | 234 (4.3) | 89 (4.7) | 31 (1.5) | 113 (8.4) | 1 (0.7) | ||||||
|
|
|
Less than 1 year in DCC | 40 (0.7) | 20 (1.1) | 5 (0.2) | 13 (1.0) | 2 (1.4) | ||||||
|
|
|
Not eligible sex (strata complete) | 1440 (26.2) | 531 (27.9) | 768 (36.6) | 97 (7.2) | 44 (31.7) | ||||||
|
|
Total unknown eligibility | 2259 (41.2) | 663 (34.9) | 817 (38.9) | 723 (53.7) | 56 (40.3) | |||||||
|
|
|
No contact | 1713 (31.2) | 441 (23.2) | 643 (30.6) | 590 (43.8) | 39 (28.1) | ||||||
|
|
|
Declined (no eligibility screening) | 546 (10.0) | 222 (11.7) | 174 (8.3) | 133 (9.9) | 17 (12.2) | ||||||
| Response rates | |||||||||||||
|
|
Total eligible (known + estimated) | 2006 (100) | 831 (100) | 575 (100) | 553 (100) | 47 (100) | |||||||
|
|
|
No interview | |||||||||||
|
|
|
|
Refusal | 8 (0.4) | 0 (0) | 2 (0.3) | 6 (1.1) | 0 (0) | |||||
|
|
|
|
Incomplete or terminated | 121 (6.0) | 54 (6.5) | 39 (6.8) | 26 (4.7) | 2 (4.3) | |||||
|
|
|
No information (estimated eligible)b | 830 (41.4) | 290 (34.9) | 224 (38.9) | 297 (53.7) | 19 (40.3) | ||||||
|
|
Complete interviews (response rate) | 1047 (52.2) | 487 (58.6) | 310 (54.0) | 224 (40.5) | 26 (55.4) | |||||||
aDCC: Dhaka City Corporation.
bEstimated eligible number calculated using American Association for Public Opinion Research (AAPOR) guidelines [31], assuming that the proportion of eligible individuals among those who were contacted and screened is the same as for those who were unable to be contacted or declined.
Sample Characteristics and Representativeness
Compared with the DCC demographic profile from the 2011 census, the unweighted mobile phone survey sample overrepresented males aged 25 to 34 years as well as males and females with higher secondary education, while it underrepresented males and females aged 55 to 74 years and those with primary or lower than primary education. Given the stratified sampling design aimed at achieving equal representation of males and females, the overall unweighted sample overrepresented females and underrepresented males. After poststratification weighting on these key variables, the sample closely matched the population in terms of age, sex, and education (Table 2).
Table 2.
Comparison of unweighted and weighted survey sample with 2011 census population benchmarks for the live poultry exposure mobile phone survey, Dhaka City Corporation, Bangladesh.
| Characteristics | Unweighted sample | Weighted samplea | Census benchmarksb | |||||||||
|
|
Male (%) | Female (%) | All (%) | Male (%) | Female (%) | All (%) | Male (%) | Female (%) | All (%) | |||
| Age group (years) | ||||||||||||
|
|
18-24 | 25.4 | 26.4 | 25.9 | 25.4 | 29.3 | 27.1 | 25.4 | 29.3 | 27.1 | ||
|
|
25-34 | 40.6 | 31.0 | 35.8 | 32.7 | 32.3 | 32.5 | 32.7 | 32.3 | 32.5 | ||
|
|
35-44 | 19.0 | 23.8 | 21.4 | 20.9 | 19.7 | 20.4 | 20.9 | 19.7 | 20.4 | ||
|
|
45-54 | 9.2 | 12.8 | 11.0 | 12.1 | 11.0 | 11.6 | 12.1 | 11.0 | 11.6 | ||
|
|
55-74 | 5.8 | 5.9 | 5.9 | 8.9 | 7.7 | 8.4 | 8.9 | 7.7 | 8.4 | ||
| Sex | ||||||||||||
|
|
Male | N/Ac | N/A | 50.0 | N/A | N/A | 57.5 | N/A | N/A | 57.5 | ||
|
|
Female | N/A | N/A | 50.0 | N/A | N/A | 42.5 | N/A | N/A | 42.5 | ||
| Education (highest completed) | ||||||||||||
|
|
<Primaryd | 10.0 | 10.1 | 10.1 | 20.8 | 28.1 | 23.9 | 20.8 | 28.1 | 23.9 | ||
|
|
Primary | 28.8 | 24.6 | 26.7 | 30.9 | 31.4 | 31.1 | 30.9 | 31.4 | 31.1 | ||
|
|
Secondarye | 11.2 | 14.7 | 13.0 | 12.5 | 13.3 | 12.8 | 12.5 | 13.3 | 12.8 | ||
|
|
≥Higher secondaryf | 50.0 | 50.7 | 50.3 | 35.8 | 27.2 | 32.2 | 35.8 | 27.2 | 32.2 | ||
aSample weighted by age, sex, and education to the Dhaka City Corporation demographic profile of the 2011 census.
bCensus data for the 2011 Dhaka City Corporation demographic profile [23].
cN/A: not applicable.
dPrimary indicates year 5 of school.
eSecondary indicates year 10 of school.
fHigher secondary indicates year 12 of school.
The weighted survey sample is representative of other demographic factors that were not used in the construction of the weights (Table 3). The overall sample shows a close match to the 2011 census figures for DCC by region, with slight discrepancies within the sex-specific strata. In terms of marital status, the survey slightly underrepresented single males and married females.
Table 3.
Sample distribution compared with 2011 census population benchmarks for the live poultry exposure phone survey, Dhaka City Corporation, Bangladesh.
| Characteristic | Weighted samplea | Census benchmarksb | |||||||||||
|
|
Male (%) | Female (%) | All (%) | Male (%) | Female (%) | All (%) | |||||||
| Marital status | |||||||||||||
|
|
Single, never married | 27.0 | 12.1 | 20.6 | 29.7 | 11.6 | 22.1 | ||||||
|
|
Married | 71.2 | 78.7 | 74.4 | 69.8 | 80.9 | 74.5 | ||||||
|
|
Otherc | 1.8 | 9.2 | 4.9 | 0.6 | 7.4 | 3.4 | ||||||
| Region | |||||||||||||
|
|
DCCd North | 50.3 | 60.5 | 54.6 | 53.3 | 55.6 | 54.3 | ||||||
|
|
DCC South | 49.7 | 39.5 | 45.4 | 46.7 | 44.4 | 45.7 | ||||||
aSample weighted by age, sex, and education to the DCC demographic profile of the 2011 census.
bCensus data for the 2011 DCC population, aged 20 to 74 years for marital status and all ages for region.
cOther includes widows or widowers and divorced individuals.
dDCC: Dhaka City Corporation.
Discussion
Principal Findings
This study provides empirical evidence that probability-based mobile phone surveys can achieve population-representative samples with relatively high response rates (1047/2006, 52.2%) in urban Bangladesh. Although the unweighted sociodemographic profile of the survey showed that mobile phone sampling slightly underrepresented older individuals and overrepresented those with higher secondary education compared with the census population, poststratification weighting on a key set of demographic variables (age, sex, and education) was sufficient to correct for these differences. Therefore, these findings support the use of mobile phone–based survey sampling and data collection methods for producing population-representative samples with minimal adjustment in urban areas that have high mobile phone penetration. This has important implications for improving population surveillance in LMICs.
A response rate of approximately 50% is lower than that of previous phone-based surveys conducted in Bangladesh [20,32] but is in line with the response rates achieved in surveys conducted through similar methods in other LMICs and is in fact higher than those typically achieved in HICs [16,33]. Several factors might have contributed to this lower rate compared with previous work, including changes in the methods of calculating response rates over time to provide more conservative estimates and general declines in response rates of population health studies over the past 30 years [31,34,35]. The use of airtime incentives has been found to improve response rates in interactive voice response surveys in Bangladesh [36] and could also be explored as a method to increase the rates in CATIs. The response rates were generally similar across mobile phone operators, except for Banglalink, which was considerably lower. This could be owing to differences in the geographic sampling frames between each operator, with Banglalink not restricted to DCC and instead sampling from phone numbers listed in Dhaka district. Overall, this supports the use of stratified sampling designs by mobile phone operators to appropriately capture subpopulation heterogeneity when conducting population-based surveys [37].
The unweighted demographic profile of our sample differed most from the census population by educational attainment. Overrepresentation of respondents with higher education is consistent across survey research methods, including those conducted in LMICs and HICs [14,16,38]. The impact of these differences on population-level estimates would be greatest in surveys where education is strongly associated with the outcome of interest [39]. However, the magnitude of this impact becomes negligible once weighted to the distribution of the reference population [15,39]. Previous research in LMICs has found that minimal adjustment of demographic factors is sufficient to reduce nonresponse and coverage error when conducting robust probability-based sampling [15]. In addition, comparisons with the census population showed that our weighted survey achieved a good representation of other characteristics, including region and marital status. The remaining differences between the census and the survey population distributions could be because our survey sample included only participants aged 18 to 74 years, whereas the published census figures include all ages for region and only ages 20 to 74 years for marital status. By conducting sex-stratified sampling, our study was sufficiently powered to explore sex-based subgroup analyses without generating extreme survey weights. Researchers intending to conduct similar mobile phone–based surveys with poststratification weights should determine subgroup analyses a priori to ensure that adequate stratified sampling is implemented.
Limitations
Although we demonstrated that population-based probability sampling using mobile phones can produce representative samples with minimal adjustment, this method had some limitations, as evidenced in this study. First, although comparisons to the census population can be used to evaluate the representativeness of the sample population, it does not preclude the potential for sampling bias due to coverage error. For instance, individuals who do not have mobile phones are likely different from those who do, based on factors such as socioeconomic status [40,41]. However, in DCC the mobile penetration rate was very high at over 87% [19], which suggests that impacts on population estimates due to coverage error were likely minimal in this urban area. Further work could examine this question in populations with lower mobile phone coverage or in nonurban settings where mobile phones may be shared within and between households, which would necessitate additional strategies to achieve a representative sample (eg, to randomly select an individual in a household using the same phone). The opposite is also of concern—potential bias introduced because of some individuals in the population having multiple mobile phone numbers. Recent studies quantifying this effect on the probability of selection have found that although the theoretical probability of inclusion for those with multiple phone numbers is greater than those with only one number, the likelihood of contacting any individual is extremely small in practice [13]. Although out of the scope of our analysis, this could be examined in future work by capturing information on mobile phone ownership and applying selection weights. The collection of additional household-based asset data to enable weighting by socioeconomic indicators, such as wealth index, could also be examined. In this survey, we only included education, which, while strongly correlated with relative wealth quintile, does not explicitly capture wealth [42]. However, examining the impact of increasing the survey length to capture household-based assets data on response rates is warranted. Finally, poststratification survey weighting should be conducted using recent reference population estimates. However, for DCC, the most recent census available is from 2011 [23]; therefore, any significant changes in the underlying population distribution during this time would not be reflected in the weights and could impact weighted population estimates.
Conclusions
In many LMICs, such as Bangladesh, the coverage of mobile phones is very high and includes a range of population subgroups. Mobile phone–based surveys can, therefore, offer an efficient, economic, and robust way to conduct surveillance for population health outcomes. We found that a mobile phone survey using a stratified probability sampling design produced a population-representative sample with minimal adjustment in urban Bangladesh. These results have important implications for improving population health surveillance methods in LMICs.
Acknowledgments
The authors would like to thank Dr Khaleda Islam for feedback on the methodological implementation of this study. The authors also thank the study participants and the field teams, including the data collectors at the Institute of Epidemiology, Disease Control and Research for their contributions to the study.
IB received funding for this work through a doctoral research award from the International Development Research Center and Vanier Canada Graduate Scholarship and also received funding for this work through an early career grant from the National Geographic Society. The funders played no role in the study design, conduct, or writing of the report.
Abbreviations
- CATI
computer-assisted phone interview
- DCC
Dhaka City Corporation
- HIC
higher income country
- IEDCR
Institute of Epidemiology, Disease Control and Research
- LBM
live bird market
- LMIC
low- and middle-income country
Additional information on mobile phone operators’ proportionate market share and phone calling procedures.
Footnotes
Conflicts of Interest: None declared.
References
- 1.Corsi DJ, Neuman M, Finlay JE, Subramanian SV. Demographic and health surveys: a profile. Int J Epidemiol. 2012 Dec;41(6):1602–13. doi: 10.1093/ije/dys184.dys184 [DOI] [PubMed] [Google Scholar]
- 2.Luhar S, Mallinson PA, Clarke L, Kinra S. Trends in the socioeconomic patterning of overweight/obesity in India: a repeated cross-sectional study using nationally representative data. BMJ Open. 2018 Oct 21;8(10):e023935. doi: 10.1136/bmjopen-2018-023935. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=30344181 .bmjopen-2018-023935 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Jones-Smith JC, Gordon-Larsen P, Siddiqi A, Popkin BM. Cross-national comparisons of time trends in overweight inequality by socioeconomic status among women using repeated cross-sectional surveys from 37 developing countries, 1989-2007. Am J Epidemiol. 2011 Mar 15;173(6):667–75. doi: 10.1093/aje/kwq428. http://europepmc.org/abstract/MED/21300855 .kwq428 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Lupu N, Michelitch K. Advances in survey methods for the developing world. Annu Rev Polit Sci. 2018 May 11;21(1):195–214. doi: 10.1146/annurev-polisci-052115-021432. [DOI] [Google Scholar]
- 5.Dialsingh I. Face-to-face interviewing. In: Lavrakas PJ, editor. Encyclopedia of Survey Research Methods. Thousand Oaks, Califronia: Sage Publications; 2008. [Google Scholar]
- 6.Kilmer G, Roberts H, Hughes E, Li Y, Valluru B, Fan A, Giles W, Mokdad A, Jiles R, Centers for Disease ControlPrevention (CDC) Surveillance of certain health behaviors and conditions among states and selected local areas--Behavioral Risk Factor Surveillance System (BRFSS), United States, 2006. MMWR Surveill Summ. 2008 Aug 15;57(7):1–188. https://www.cdc.gov/mmwr/preview/mmwrhtml/ss5707a1.htm .ss5707a1 [PubMed] [Google Scholar]
- 7.Iachan R, Pierannunzi C, Healey K, Greenlund KJ, Town M. National weighting of data from the Behavioral Risk Factor Surveillance System (BRFSS) BMC Med Res Methodol. 2016 Nov 15;16(1):155. doi: 10.1186/s12874-016-0255-7. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-016-0255-7 .10.1186/s12874-016-0255-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Pariyo GW, Wosu AC, Gibson DG, Labrique AB, Ali J, Hyder AA. Moving the agenda on noncommunicable diseases: policy implications of mobile phone surveys in low and middle-income countries. J Med Internet Res. 2017 May 05;19(5):e115. doi: 10.2196/jmir.7302. https://www.jmir.org/2017/5/e115/ v19i5e115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Lepkowski J. Telephone sampling: frames and selection techniques. In: Lovric M, editor. International Encyclopedia of Statistical Science. Berlin, Heidelberg: Springer; 2011. pp. 1585–6. [Google Scholar]
- 10.Hu SS, Balluz L, Battaglia MP, Frankel MR. Improving public health surveillance using a dual-frame survey of landline and cell phone numbers. Am J Epidemiol. 2011 Mar 15;173(6):703–11. doi: 10.1093/aje/kwq442.kwq442 [DOI] [PubMed] [Google Scholar]
- 11.Richard J, Andler R, Gautier A, Guignard R, Leon C, Beck F. Effects of using an overlapping dual-frame design on estimates of health behaviors: a French general population telephone survey. J Surv Stat Methodol. 2016 Nov 17;5(2):254–74. doi: 10.1093/jssam/smw028. [DOI] [Google Scholar]
- 12.Measuring digital development: facts and figures. ITU Publications. 2020. [2021-03-03]. https://www.itu.int/en/ITU-D/Statistics/Pages/facts/default.aspx .
- 13.Labrique A, Blynn E, Ahmed S, Gibson D, Pariyo G, Hyder AA. Health surveys using mobile phones in developing countries: automated active strata monitoring and other statistical considerations for improving precision and reducing biases. J Med Internet Res. 2017 May 05;19(5):e121. doi: 10.2196/jmir.7329. https://www.jmir.org/2017/5/e121/ v19i5e121 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hu SS, Balluz L, Battaglia MP, Frankel MR. The impact of cell phones on public health surveillance. Bull World Health Organ. 2010 Nov 01;88(11):799. doi: 10.2471/BLT.10.082669. http://europepmc.org/abstract/MED/21076555 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Sibai AM, Ghandour LA, Chaaban R, Mokdad AH. Potential use of telephone surveys for non-communicable disease surveillance in developing countries: evidence from a national household survey in Lebanon. BMC Med Res Methodol. 2016 May 31;16:64. doi: 10.1186/s12874-016-0160-0. https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-016-0160-0 .10.1186/s12874-016-0160-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.L'Engle K, Sefa E, Adimazoya EA, Yartey E, Lenzi R, Tarpo C, Heward-Mills NL, Lew K, Ampeh Y. Survey research with a random digit dial national mobile phone sample in Ghana: methods and sample quality. PLoS One. 2018 Jan 19;13(1):e0190902. doi: 10.1371/journal.pone.0190902. https://dx.plos.org/10.1371/journal.pone.0190902 .PONE-D-17-19642 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Gibson DG, Pereira A, Farrenkopf BA, Labrique AB, Pariyo GW, Hyder AA. Mobile phone surveys for collecting population-level estimates in low- and middle-income countries: a literature review. J Med Internet Res. 2017 May 05;19(5):e139. doi: 10.2196/jmir.7428. https://www.jmir.org/2017/5/e139/ v19i5e139 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Brinkel J, Krämer A, Krumkamp R, May J, Fobil J. Mobile phone-based mHealth approaches for public health surveillance in sub-Saharan Africa: a systematic review. Int J Environ Res Public Health. 2014 Nov 12;11(11):11559–82. doi: 10.3390/ijerph111111559. https://www.mdpi.com/resolver?pii=ijerph111111559 .ijerph111111559 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Bangladesh: mobile industry driving growth and enabling digital inclusion. GSMA Intelligence. 2018. [2021-03-03]. https://www.gsma.com/mobilefordevelopment/resources/bangladesh-mobile-industry-driving-growth-and-enabling-digital-inclusion/
- 20.Islam K, Rahman M, Sharif A, Kawsar A, Alam Z, Rahman M. Introducing mobile phone for interview in surveillance system in Bangladesh: validation of the method. Proceedings of the 62nd ASTMH Annual Meeting; Proceedings of the 62nd ASTMH Annual Meeting; Nov 13-17, 2013; Washington DC. 2013. https://www.astmh.org/ASTMH/media/Documents/AbstractBook2013Final.pdf . [DOI] [Google Scholar]
- 21.Country Report: Bangladesh. GSMA Intelligence. 2014. [2021-03-03]. https://www.gsma.com/mobilefordevelopment/resources/country-report-bangladesh/
- 22.Fournié G, Høg E, Barnett T, Pfeiffer DU, Mangtani P. A systematic review and meta-analysis of practices exposing humans to avian influenza viruses, their prevalence, and rationale. Am J Trop Med Hyg. 2017 Aug;97(2):376–88. doi: 10.4269/ajtmh.17-0014. http://europepmc.org/abstract/MED/28749769 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.National volume-3: urban area report. Population & Housing Census-2011. 2014. [2021-03-03]. http://www.bbs.gov.bd/site/page/47856ad0-7e1c-4aab-bd78-892733bc06eb/Population-and-Housing-Census .
- 24.The total number of Mobile Phone subscribers has reached 161.772 Million at the end of June, 2019. Bangladesh Telecommunication Regulatory Commission. 2019. [2021-03-03]. http://www.btrc.gov.bd/content/mobile-phone-subscribers-bangladesh-june-2019 .
- 25.Liao Q, Lam WT, Leung GM, Jiang C, Fielding R. Live poultry exposure, Guangzhou, China, 2006. Epidemics. 2009 Dec;1(4):207–12. doi: 10.1016/j.epidem.2009.09.002. https://linkinghub.elsevier.com/retrieve/pii/S1755-4365(09)00042-5 .S1755-4365(09)00042-5 [DOI] [PubMed] [Google Scholar]
- 26.Liao Q, Yuan J, Lau EH, Chen GY, Yang ZC, Ma XW, Chen JD, Liu YH, Wang C, Tang XP, Liu YF, Zhuo L, Leung GM, Zhang W, Cowling BJ, Wang M, Fielding R. Live bird exposure among the general public, Guangzhou, China, May 2013. PLoS One. 2015;10(12):e0143582. doi: 10.1371/journal.pone.0143582. https://dx.plos.org/10.1371/journal.pone.0143582 .PONE-D-15-24802 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Wang L, Cowling BJ, Wu P, Yu J, Li F, Zeng L, Wu JT, Li Z, Leung GM, Yu H. Human exposure to live poultry and psychological and behavioral responses to influenza A(H7N9), China. Emerg Infect Dis. 2014 Aug;20(8):1296–305. doi: 10.3201/eid2008.131821. doi: 10.3201/eid2008.131821. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Peng Z, Wu P, Ge L, Fielding R, Cheng X, Su W, Ye M, Shi Y, Liao Q, Zhou H, Zhou L, Li L, Wu J, Zhang S, Yu Z, Wu X, Ma H, Lu J, Cowling BJ, Yu H. Rural villagers and urban residents exposure to poultry in China. PLoS One. 2014;9(4):e95430. doi: 10.1371/journal.pone.0095430. https://dx.plos.org/10.1371/journal.pone.0095430 .PONE-D-13-36863 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Public health interventions for prevention and control of avian influenza. WHO Regional Office for South-East Asia. 2006. [2021-03-03]. https://apps.who.int/iris/handle/10665/205700 .
- 30.Fitzner J, Qasmieh S, Mounts AW, Alexander B, Besselaar T, Briand S, Brown C, Clark S, Dueger E, Gross D, Hauge S, Hirve S, Jorgensen P, Katz MA, Mafi A, Malik M, McCarron M, Meerhoff T, Mori Y, Mott J, Olivera MT, Ortiz JR, Palekar R, Rebelo-de-Andrade H, Soetens L, Yahaya AA, Zhang W, Vandemaele K. Revision of clinical case definitions: influenza-like illness and severe acute respiratory infection. Bull World Health Organ. 2018 Feb 01;96(2):122–8. doi: 10.2471/BLT.17.194514. http://europepmc.org/abstract/MED/29403115 .BLT.17.194514 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Standard definitions: final dispositions of case codes and outcome rates for surveys. The American Association for Public Opinion Research. 2016. [2021-03-03]. https://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf .
- 32.Pariyo GW, Greenleaf AR, Gibson DG, Ali J, Selig H, Labrique AB, Al Kibria GM, Khan IA, Masanja H, Flora MS, Ahmed S, Hyder AA. Does mobile phone survey method matter? Reliability of computer-assisted telephone interviews and interactive voice response non-communicable diseases risk factor surveys in low and middle income countries. PLoS One. 2019;14(4):e0214450. doi: 10.1371/journal.pone.0214450. https://dx.plos.org/10.1371/journal.pone.0214450 .PONE-D-18-32667 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Behavioral risk factor surveillance system. Centers for Disease Control and Prevention. 2019. [2021-03-03]. https://www.cdc.gov/brfss/annual_data/2018/pdf/2018-sdqr-508.pdf .
- 34.Background paper declining response rates in federal surveys: trends and implications. Office of the Assistant Secretary for Planning and Evaluation. 2017. [2021-03-03]. https://aspe.hhs.gov/reports/final-report-volume-i-background-paper-declining-response-rates-federal-surveys-trends-implications .
- 35.Curtin R, Presser S, Singer E. Changes in telephone survey nonresponse over the past quarter century. Pub Opinion Q. 2005 Feb 28;69(1):87–98. doi: 10.1093/poq/nfi002. [DOI] [Google Scholar]
- 36.Gibson DG, Wosu AC, Pariyo GW, Ahmed S, Ali J, Labrique AB, Khan IA, Rutebemberwa E, Flora MS, Hyder AA. Effect of airtime incentives on response and cooperation rates in non-communicable disease interactive voice response surveys: randomised controlled trials in Bangladesh and Uganda. BMJ Glob Health. 2019 Sep 6;4(5):e001604. doi: 10.1136/bmjgh-2019-001604. https://gh.bmj.com/lookup/pmidlookup?view=long&pmid=31565406 .bmjgh-2019-001604 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Buskirk T, Callegaro M. Cell phone sampling. In: Lavrakas PJ, editor. Encyclopedia of Survey Research Methods. Thousand Oaks, California: Sage Publications; 2008. pp. 85–9. [Google Scholar]
- 38.Søgaard AJ, Selmer R, Bjertness E, Thelle D. The Oslo Health Study: the impact of self-selection in a large, population-based survey. Int J Equity Health. 2004 May 06;3(1):3. doi: 10.1186/1475-9276-3-3. https://equityhealthj.biomedcentral.com/articles/10.1186/1475-9276-3-3 .1475-9276-3-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Van der Heyden J, De Bacquer D, Gisle L, Demarest S, Charafeddine R, Drieskens S, Tafforeau J, Van Oyen H, Van Herck K. Additional weighting for education affects estimates from a National Health Interview Survey. Eur J Public Health. 2017 Oct 01;27(5):892–7. doi: 10.1093/eurpub/ckx005.2996311 [DOI] [PubMed] [Google Scholar]
- 40.Wesolowski A, Eagle N, Noor AM, Snow RW, Buckee CO. Heterogeneous mobile phone ownership and usage patterns in Kenya. PLoS One. 2012;7(4):e35319. doi: 10.1371/journal.pone.0035319. https://dx.plos.org/10.1371/journal.pone.0035319 .PONE-D-11-19306 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Ahmed T, Rizvi SJ, Rasheed S, Iqbal M, Bhuiya A, Standing H, Bloom G, Waldman L. Digital health and inequalities in access to health services in Bangladesh: mixed methods study. JMIR Mhealth Uhealth. 2020 Jul 21;8(7):e16473. doi: 10.2196/16473. https://mhealth.jmir.org/2020/7/e16473/ v8i7e16473 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Córdova A. Methodological note: measuring relative wealth using household asset indicators. AmericasBarometer Insights. 2008. [2021-03-03]. https://www.vanderbilt.edu/lapop/insights/I0806en.pdf .
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional information on mobile phone operators’ proportionate market share and phone calling procedures.