Abstract
Background:
The recent global climate agreement in Paris aims to mitigate greenhouse gas emissions while fostering sustainable development and establishes an international trading mechanism to meet this goal. Currently, carbon offset program implementers are allowed to collect their own monitoring data to determine the number of carbon credits to be awarded.
Objectives:
We summarize reasons for mandating independent monitoring of greenhouse gas emission reduction projects. In support of our policy recommendations, we describe a case study of a program designed to earn carbon credits by distributing almost one million drinking water filters in rural Kenya to avert the use of fuel for boiling water. We compare results from an assessment conducted by our research team in the program area among households with pregnant women or caregivers in rural villages with low piped water access with the reported program monitoring data and discuss the implications.
Discussion:
Our assessment in Kenya found lower levels of household water filter usage than the internal program monitoring reported estimates used to determine carbon credits; we found 19% (n = 4,041) of households reported filter usage 2–3 years after filter distribution compared to the program stated usage rate of 81% (n = 14,988) 2.7 years after filter distribution. Although carbon financing could be a financially sustainable approach to scale up water treatment and improve health in low-income settings, these results suggest program effectiveness will remain uncertain in the absence of requiring monitoring data be collected by third-party organizations.
Conclusion:
Independent monitoring should be a key requirement for carbon credit verification in future international carbon trading mechanisms to ensure programs achieve benefits in line with sustainable development goals.
Citation:
Pickering AJ, Arnold BF, Dentz HN, Colford JM Jr., Null C. 2017. Climate and health co-benefits in low-income countries: a case study of carbon financed water filters in Kenya and a call for independent monitoring. Environ Health Perspect 125:278–283; http://dx.doi.org/10.1289/EHP342
Introduction
The recent Paris Agreement, which was signed by nearly 200 nations, aims to prevent global warming from exceeding 2°C above pre-industrial levels (UNFCCC 2015). The agreement acknowledges global disparities in present and historic energy consumption by including goals of sustainable development and poverty eradication alongside its primary goal of mitigating global greenhouse gas emissions. To enable countries to cost effectively meet their nationally determined emission reduction goals, the Paris Agreement also allows parties (e.g., countries) to transfer mitigation outcomes that help them achieve these goals and establishes an international mechanism to promote mitigation and support sustainable development (Article 6) (UNFCCC 2015). Predating the Paris Agreement, the clean development mechanism (CDM) created by the 1997 Kyoto Protocol (United Nations 1998) facilitated carbon offset projects in lower-income countries. The CDM was designed to reduce carbon emissions more cost effectively by allowing developed countries with emission reduction targets to purchase carbon credits from developing countries where projects cost less to implement. Similar to the Paris Agreement, a second explicitly stated goal of the CDM was to assist developing countries achieve sustainable development (United Nations 1998). A voluntary carbon market also exists outside of the United Nations Framework Convention on Climate Change and its legal instruments, in which corporations, organizations, and individuals typically purchase carbon credits to offset their emissions. Designated Operational Entities (DOE) serve as third-party auditors to validate CDM project proposals and certify carbon emission reductions (UNFCCC 2014). However, in both compliance and voluntary markets, carbon offset program implementers are allowed to collect their own monitoring data to submit to third-party certification agencies to determine the number of carbon credits awarded (UNFCCC 2014; http://www.goldstandard.org). Implementers have financial incentives to report high offsets in order to claim more credits, which could lead to biased results. In this commentary, we argue for the need to independently monitor emissions reduction programs, and we present a case study of a carbon offset project designed to provide safe drinking water in rural Kenya.
Carbon Credits, Water Treatment, and Suppressed Demand
Carbon finance could be a financially sustainable approach to scale up water treatment and improve health in low-income settings, and in doing so would reduce greenhouse gas emissions while contributing to sustainable development (Hodge and Clasen 2014). Almost half (42%) of the global population does not have access to piped water into the home (WHO-UNICEF 2015), and it is estimated that 1.8 billion people drink from a water source with fecal contamination (Bain et al. 2014). Diarrhea is a leading cause of child mortality, causing 700,000 child deaths annually (Walker et al. 2013). Disinfection of drinking water supplies can prevent the transmission of common diarrheal pathogens (Prüss et al. 2002) and historically led to dramatic reductions in mortality associated with waterborne illness in the United States and Europe (Cutler and Miller 2005; Sedgwick and MacNutt 1910).
A number of programs to reduce greenhouse gas emissions are implementing zero-emission household water treatment technologies with carbon credit financing. Carbon credits (awarded for the avoidance, sequestration, or reduction of 1 ton of carbon dioxide equivalent) are generated by calculating the quantity of greenhouse gas emissions avoided by treating water with a zero-emission technology (e.g., water filter) against an estimated baseline of emissions if households had boiled the water using fossil fuel or nonrenewable biomass (Hodge and Clasen 2014). Greenhouse gas emissions resulting from the manufacturing, distribution, and behavior promotion of such water treatment technologies are also accounted for in carbon credit calculations. Baseline emissions can adjust upwards to account for “suppressed demand,” based on the concept that current emissions are constrained by limited resources in developing economies. For example, the baseline would include the carbon emissions theoretically emitted from households that would boil their drinking water if they had access to sufficient fuel and the resources to obtain it (independent of whether households actually boil their water). In addition to baseline emission estimates, a key parameter for awarding carbon credits under this system is the percentage of households that regularly use the water treatment units, determined by internal monitoring by the program implementer. Proponents emphasize the primary benefit of such programs is to improve water quality for high need populations; however, critics note greenhouse gas emissions are not actually reduced because most households would not boil their water in the absence of the programs (Yeo 2013).
Carbon for Water in Western Kenya
During April and May of 2011, Vestergaard Frandsen reported that they distributed 877,505 LifeStraw® Family water filters free of charge to > 4.5 million people in Kenya’s Western Province (Vestergaard Frandsen 2012). The program is registered to earn carbon credits certified by a third-party organization, the Gold Standard Foundation (http://www.goldstandard.org), for use in the voluntary carbon market with a crediting period of 10 years. In this “Carbon for Water” program, all households received a LifeStraw® Family water filter [model 1.0; Vestergaard, http://www.vestergaard.com/lifestraw-family-1-0), a point-of-use water treatment product that does not require electricity to operate and is classified as “Highly Protective” by World Health Organization testing guidelines (WHO 2011). The Carbon for Water program implemented three household health education campaigns (July–August 2011, April–May 2012, and October 2012), employing almost 2,000 community health workers to personally visit households that had received a filter, and broadcasted messages about the program over the radio. The health messaging included training on proper filter use, as well as promotion of safe water storage to prevent recontamination, and handwashing with soap and filtered water. The program also established 32 complementary maintenance, repair, and education facilities in Western Province (Vestergaard Frandsen 2012). Vestergaard Frandsen hired staff to collect their own monitoring data (sampling between approximately 15,000 and 20,000 households each round), as well as contracted a local Kenyan firm to conduct audits (100–300 households each round). The program reported that it distributed filters to 91% of all households in Kenya’s Western Province and that water filter usage rates over time since distribution were 91% (0–6 months), 75% (7–18 months), and 81% (19–32 months) (Vestergaard Frandsen 2012, 2013, 2014a). The program assumed that 79.6% of households would boil their water if they had access to adequate resources in monitoring period 1 (0–6 months) and monitoring period 2 (7–18 months); this assumption was lowered to 52.8% of households for monitoring period 3 (19–32 months). The usage rates combined with the baseline emissions estimated using suppressed demand earned a total of 4,476,205 carbon credits during the period 1 June 2011–31 January 2014 (32 months) (Vestergaard Frandsen 2014a). Due to fluctuations in the price of carbon credits and unreleased implementation costs, actual program profits (or losses) to date are unknown.
Methods
The Kenya Carbon for Water program happened to overlap a large randomized controlled trial run by our research team evaluating the health effects of water, sanitation, hygiene, and nutritional interventions among newborns in rural villages in Kakamega, Bungoma, and Vihiga counties in Western Province (WASH Benefits study). As part of the WASH Benefits study, we collected household survey data to pilot test interventions and characterize baseline water management practices and drinking water quality in the WASH Benefits study population (Arnold et al. 2013; Christensen et al. 2015). The coincidental temporal and geographic overlap of WASH Benefits with the Carbon for Water program allowed us to measure household filter usage and microbial water quality over a 3-year period that included the first 32 months of program monitoring. Because of the potential importance of filter usage rates in interpreting the primary outcomes of the WASH Benefits trial, we added measures of filter ownership to existing household surveys that took place approximately 6, 18, and 24–36 months after the filter distribution by Vestergaard Frandsen during April and May in 2011. We sampled a different study population during each time period (Table 1). All surveys contained a standardized module to assess household water management practices, use of the LifeStraw® Family filter, and reasons for nonuse. Figure 1 is a map of household survey locations within the program area.
Table 1.
Indicator | Population A 6 months | Population B 18 months | Population C 24–36 months |
---|---|---|---|
All households | |||
otal number | 499 | 531 | 7,691 |
Received filter, n (%) | 453 (90.8) | 374 (70.4) | 4,041 (52.5) |
Stored water not currently available, n (%) | 46 (10.8) | 59 (11.1) | 1,485 (19.3) |
Filtered currently stored water, n (%) | 119 (26.7) | 95 (20.1) | 252 (4.1) |
Uses filter as water treatment method, n (%) | 281 (56.3) | 201 (37.9) | 792 (10.3) |
Households that received filter | |||
otal number | 453 | 374 | 4,041 |
Stored water not currently available, n (%) | 45 (9.9) | 30 (8.0) | 658 (16.3) |
Filtered currently stored water, n (%) | 118 (28.9) | 93 (27.0) | 236 (7.0) |
Uses filter as water treatment method, n (%) | 278 (61.4) | 195 (52.1) | 752 (18.6) |
Could produce filter for observation, n (%) | 421 (92.9) | 354 (96.7) | 3,616 (93.6) |
Promotion visit by program in past 6 months | N/A | 356 (95.2) | 2,204 (54.6) |
Missing | 0 | 3 | |
Households that produced filter | |||
otal number | 421 | 354 | 3,616 |
Filter not working | 20 (4.8) | 77 (21.8) | 1,839 (51.0) |
Don’t know | 0 | 0 | 8 |
Filter hanging on walla | 393 (93.4) | 340 (96.9) | 3,360 (93.8) |
Observation not possible | 0 | 3 | 33 |
Moisture in filter reservoira | 136 (32.3) | 89 (25.2) | 438 (12.2) |
Observation not possible | 0 | 1 | 18 |
Filter has signs of nonuse (e.g., dust)a | 299 (71.0) | 228 (64.8) | 2,963 (82.3) |
Observation not possible | 0 | 2 | 17 |
Note: Population A included households with pregnant women and caregivers of young children surveyed in November 2011, approximately 6 months after LifeStraw® filters were distributed. Population B included households with pregnant women surveyed in November 2012, approximately 18 months after LifeStraw® filters were distributed. Population C included households with pregnant women surveyed June 2013–May 2014, approximately 24–36 months after LifeStraw® filters were distributed. aDirect observation by field staff. |
The 6-month survey (1–29 November 2011) draws on data collected during the baseline assessment for two pilot randomized controlled trials conducted as part of WASH Benefits, simultaneously implemented in 72 rural villages in Western Kenya; the trials evaluated the adoption of household water, sanitation, and hand hygiene interventions [see Christensen et al. (2015) for further details]. These trials enrolled households with caregivers of 4- to 16-month-old children in Kakamega (367 households in the Shianda Location), and pregnant women and caregivers with children < 3 months near the town of Bungoma (132 households in the Kibingei Location). The 18-month survey (27 November–19 December 2012) and the 24–36 month survey (19 June 2013–21 May 2014) data were obtained from the baseline assessment and enrollment survey of the full-scale WASH Benefits study (Arnold et al. 2013). The WASH Benefits study enrolled pregnant mothers in their second or third trimester in rural villages with low levels of piped water access (< 20% of households) in Kakamega, Bungoma, and Vihiga counties. All respondents provided written informed consent; those not comfortable signing their name provided a thumb print. Human subjects institutional review boards (IRBs) at the University of California, Berkeley, Stanford University, and the Kenya Medical Research Institute (KEMRI) approved the study protocols.
Field staff asked respondents to fetch a cup of water the way they normally would for a young child, then observed from where the respondent obtained the water and how it was stored and extracted. Field staff inquired if anyone in the household “had done anything to make the water less cloudy or safer to drink,” and if so, what method was used (without prompting on specific water treatment methods). If the respondent did not report a water treatment method, the field staff asked if the respondent ever treats drinking water and to list all methods used. Field staff questioned if the household had received a LifeStraw® Family filter. If the household reported receiving a filter, we observed if the filter was present, hanging on the wall, looked unused (e.g., visible dust), and contained water or moisture. Field staff asked if the filter was working and if there were any issues that prevented use. Finally, respondents reported if and when a representative from the Carbon for Water program had most recently visited their home to promote the LifeStraw® filter.
We also collected a sample of stored drinking water to assess levels of Escherichia coli contamination during the 18-month and 24–36 month surveys, which allowed us to compare water that respondents indicated was filtered with a LifeStraw® filter to water reported by the respondent to be unfiltered. Respondents were asked to pour the fetched cup of stored water into a sterile 100 mL Whirl-Pak® bag (product no. B01040WA; Nasco, https://www.enasco.com/page/contact). The samples were placed on ice, transported to a field lab, and processed by membrane filtration within 8 hr. A volume of 100 mL was vacuum filtered, plated on MI agar, then incubated at 35°C for 24 hr. E. coli were enumerated following the U.S. Environmental Protection Agency (EPA) method 1604 (U.S. EPA 2002).
Results
We completed 499 household surveys 6 months after filter distribution (study population “A” in Table 1), 531 household surveys 18 months after filter distribution (study population “B”), and 7,691 household surveys 24–26 months after filter distribution (study population “C”) as part of our on-going enrollment into the WASH Benefits pilot study and main study. Our measurements indicate that the Carbon for Water program coverage was impressively high; the percentage of households that remembered ever receiving a filter was 91% 6 months after filter distribution. However, this number fell to 70% at 18 months and 53% at 24–36 months (Table 1). Among households that reported filter ownership, 95% said the Carbon for Water program had visited their home to promote the LifeStraw® at the 18-month survey and 55% at 24–36 months (Table 1, this question was not asked at the 6-month visit). Although we did not measure the same households at each time point, we documented a progressive decline in reported filtering of currently stored drinking water among households that had received a filter: 29% at 6 months (118 out of 408 in study population A), 27% at 18 months (93 out of 344 in study population B) and 7% at 24–36 months (236 out of 3,383 in study population C) (Figure 2, Table 1). Similarly, the percentage of households that reported using the filter as a drinking water treatment method was lowest among study population C, and highest among study population A (Figure 2, Table 1). The percentage of filters with observed moisture or water (one indicator of recent use) also declined with time since distribution (32% at 6-months, 25% at 12-months, and 12% at 24–36 months). Half (51%) of households reported filters were not working after 24–36 months. When asked about issues preventing use of the LifeStraw® filter, 35% of households that received a filter said the filter was too slow or took too much time, 17% said the filter was blocked or not working, 8% said the filter had a bad smell or taste, and 7% thought the filter was bad for their health (data combined from all study populations, n = 4,868).
Among our full study population (all households in study populations A, B, and C), for drinking water most households access protected springs (52%, n = 7,170) or unprotected (16%) springs, 16% access shallow wells, with the remainder accessing borewells, surface water, or collecting rainwater; 71% (n = 7,170) of households access improved water sources according to the WHO/UNICEF Joint Monitoring Program definition (WHO-UNICEF 2016). The percentage of households accessing improved water sources is similar to the 68% reported in the Carbon for Water program’s third monitoring report (Vestergaard Frandsen 2014a), as well as the 67% reported by the 2014 Demographic and Health Survey (DHS Program 2015). Among our full study population, filtering of stored drinking water was not significantly different between households accessing improved water sources versus those accessing unimproved water sources (6.6% vs. 6.4%; p = 0.786). Among all households in our study with available stored water, field staff observed the majority (78%, n = 7,041) of stored drinking water containers to be covered. When asked to retrieve a glass of water, 61% (n = 7,069) of respondents extracted water by dipping a cup into the storage container.
Microbial water quality was improved in filtered stored drinking water we collected from our study populations B and C (measured 18 months and 24–26 months after filter distribution), but typically still reflected contamination with the fecal indicator bacteria Escherichia coli. The geometric mean in filtered water was 20.6 E. coli per 100 mL (n = 296), compared to 27.5 E. coli (n = 5,492) in unfiltered water (p = 0.012). Over half (52%) of respondents reported storing filtered water for 2 or more days, indicating the potential for recontamination during storage. Water treatment methods other than filter usage cited by respondents included adding chlorine (5%, n = 7,122) and boiling (1%, n = 7,122) (data from all three study populations). Stored water reported by households to be treated with locally available chlorine had a geometric mean < 10 E. coli per 100 mL (n = 311 samples from study populations B and C).
Discussion
Our measurements show lower usage of LifeStraw® Family filters compared with the program’s own monitoring data (Figure 2). We document 19% usage of the filters as a drinking water treatment method 2–3 years after filter distribution (among households with pregnant women) compared to the 81% usage reported by the program approximately 2.7 years after filter distribution (Vestergaard Frandsen 2014a). In addition, while data reported by the Carbon for Water program indicated consistent high use over time, our data suggest that use decreased over time. These findings suggest that providing water treatment technologies like the Lifestraw® Family filter do not automatically translate into improved water quality at the point of use (and by extension improved health). This result is consistent with other studies showing poor long-term adoption and inconsistent use of household water treatment products provided programmatically (Arnold et al. 2009; Luby et al. 2008; Rosa et al. 2016). A large systematic review found no evidence that household water treatment interventions reduce child diarrhea after 12 or more months of implementation, possibly because product usage is not sustained (Clasen et al. 2015). Considering the equivocal success of previous household water treatment programs at achieving sustained access to safe water, future greenhouse gas reduction programs may want to consider implementing emission-free water treatment technologies that automatically treat drinking water at the community level instead of relying on users to consistently treat their own water (Amin et al. 2016; Pickering et al. 2015).
Providing access to safe water in Kenya is a stated goal of the Vestergaard Frandsen Carbon for Water program (Vestergaard Frandsen 2014b). The immense scale of such programs presents enormous opportunity to improve water quality for millions living in poverty. We believe greenhouse gas emissions reduction programs claiming to provide safe water to low-income people should be required to demonstrate that improvements in drinking water quality are actually achieved and sustained though regular independent monitoring of microbial water quality. We found low prevalence of boiling (1%) to treat drinking water by households with and without a LifeStraw® Family filter, indicating the Carbon for Water program in Kenya has achieved minimal reductions in actual greenhouse gas emissions (in contrast with the projected reductions from hypothetical baseline emission levels estimated using suppressed demand). When suppressed demand is employed to calculate baseline scenarios, the potential absence of actual greenhouse gas emissions reductions places additional onus on programs to improve sustainable development outcomes, such as drinking water quality.
Conclusion
The 2015 Paris Agreement provides a timely opportunity to create a new or updated international trading mechanism that could improve the environmental, health, and economic benefits of future emissions reduction programs by mandating independent monitoring for carbon credit verification. Furthermore, carbon offset programs will only contribute to the Paris Agreement’s goals of greenhouse gas emissions reduction, sustainable development, and poverty alleviation if they are implemented successfully. Without independent evaluation, it is difficult to confirm that monitoring results are accurate. Evaluations of international development programs are widely acknowledged to be stronger if conducted independently from the implementing organizations because of the inherent conflict of interest—financial and otherwise—that implementers have in the success of their own programs (Gertler et al. 2011; Purcell 2003; Savedoff et al. 2006; USAID 2016). Similar to monitoring guidelines for clinical research studies and finances of publicly traded companies, we propose that carbon credit program monitoring standards be revised to ensure that monitoring activities are free from real or perceived conflicts of interest.
One strategy for achieving independent cost-effective monitoring would be to transfer funds that program implementers already spend on their own internal monitoring to the third-party credit certification organizations, which in turn would contract independent evaluations. This would expand the scope of credit certification organizations, but would help prevent conflicts of interest arising in the evaluation process. The monitoring process would also ideally include pre-specified indicators used to evaluate non-emissions related benefits (Miguel et al. 2014), such as microbial water quality for water treatment projects (Hodge and Clasen 2014). In addition, a reporting schedule tied to publicly available results would facilitate prompt feedback to program implementers to improve program effectiveness, improve transparency to the global community, and improve data reliability.
Acknowledgments
We thank G. Nyambane, C. Stewart, T. Bourdier, M. Wolfe, T. Wolfe, M. Harris, and M. Kremer for their help in making this work possible. We thank A. Kleysteuber for helpful comments on the manuscript.
Footnotes
The data collection for this paper was supported by a grant from the Bill and Melinda Gates Foundation to the University of California, Berkeley to conduct the WASH Benefits study in Kenya (#OPPGD759).
The funder had no role in data collection or analysis. The nonprofit organization Innovations for Poverty Action (IPA) in Kenya collected the data under the oversight of the authors. At the time of data collection, IPA was also involved in a project implementing community chlorine dispensers in Kenya and was exploring accessing carbon financing to operate the dispensers. None of the authors were involved in IPA’s chlorine dispenser implementation project. At the time of data collection, H.N.D. was employed by Innovations for Poverty Action, Kenya. C.N. is currently employed by Innovations for Poverty Action, Kenya, and Mathematica Policy Research, Washington, DC.
The authors declare they have no actual or potential competing financial interests.
References
- Amin N, Crider YS, Unicomb L, Das KK, Gope PS, Mahmud ZH, et al. 2016. Field trial of an automated batch chlorinator system at shared water points in an urban community of Dhaka, Bangladesh. Journal of Water, Sanitation and Hygiene for Development 6 1 32 41, doi: 10.2166/washdev.2016.027 [DOI] [Google Scholar]
- Arnold B, Arana B, Mäusezahl D, Hubbard A, Colford JM., Jr Evaluation of a pre-existing, 3-year household water treatment and handwashing intervention in rural Guatemala. Int J Epidemiol. 2009;38:1651–1661. doi: 10.1093/ije/dyp241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arnold BF, Null C, Luby SP, Unicomb L, Stewart CP, Dewey KG, et al. 2013. Cluster-randomised controlled trials of individual and combined water, sanitation, hygiene and nutritional interventions in rural Bangladesh and Kenya: the WASH Benefits study design and rationale. BMJ Open 3 e003476, doi: 10.1136/bmjopen-2013-003476 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bain R, Cronk R, Hossain R, Bonjour S, Onda K, Wright J, et al. 2014. Global assessment of exposure to faecal contamination through drinking water based on a systematic review. Trop Med Int Health 19 917 927, doi: 10.1111/tmi.12334 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Christensen G, Dentz HN, Pickering AJ, Bourdier T, Arnold BF, Colford JM, Jr, et al. 2015. Pilot cluster randomized controlled trials to evaluate adoption of water, sanitation, and hygiene interventions and their combination in rural western Kenya. Am J Trop Med Hyg 92 437 447, doi: 10.4269/ajtmh.14-0138 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clasen T, Alexander KT, Sinclair D, Boisson S, Peletz RL, Chang HH, et al. 2015. Interventions to improve water quality for preventing diarrhoea. Cochrane Database Syst Rev 10 CD004794, doi: 10.1002/14651858.CD004794.pub3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cutler DM, Miller G. The role of public health improvements in health advances: the twentieth-century United States. Demography. 2005;42:1–22. doi: 10.1353/dem.2005.0002. [DOI] [PubMed] [Google Scholar]
- DHS Program. Rockville, MD: ICF International, DHS Program; 2015. Kenya Demographic and Health Survey 2014. Final report. https://dhsprogram.com/pubs/pdf/FR308/FR308.pdf [accessed 14 July 2015] [Google Scholar]
- Gertler PJ, Martinez S, Premand P, Rawlings LB, Vermeersch CMJ. Washington, DC: World Bank; 2011. Impact Evaluation in Practice. [Google Scholar]
- Hodge JM, Clasen TF. 2014. Carbon financing of household water treatment: background, operation and recommendations to improve potential for health gains. Environ Sci Technol 48 12509 12515, doi: 10.1021/es503155m [DOI] [PubMed] [Google Scholar]
- Luby SP, Mendoza C, Keswick BH, Chiller TM, Hoekstra RM. Difficulties in bringing point-of-use water treatment to scale in rural Guatemala. Am J Trop Med Hyg. 2008;78:382–387. [PubMed] [Google Scholar]
- Miguel E, Camerer C, Casey K, Cohen J, Esterling KM, Gerber A, et al. 2014. Promoting transparency in social science research. Science 343 30 31, doi: 10.1126/science.1245317 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pickering AJ, Crider Y, Amin N, Bauza V, Unicomb L, Davis J, et al. 2015. Differences in field effectiveness and adoption between a novel automated chlorination system and household manual chlorination of drinking water in Dhaka, Bangladesh: a randomized controlled trial. PLoS One 10 e0118397, doi: 10.1371/journal.pone.0118397 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prüss A, Kay D, Fewtrell L, Bartram J. Estimating the burden of disease from water, sanitation, and hygiene at a global level. Environ Health Perspect. 2002;110:537–542. doi: 10.1289/ehp.110-1240845. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Purcell R. Independent Evaluation: Principles, Guidelines And Good Practice: The World Bank Development Grant Facility (DGF) Technical Note. 2003 http://siteresources.worldbank.org/INTDGF/Resources/Evaluation&LearningNote.pdf [accessed 3 August 2016]
- Rosa G, Kelly P, Clasen T. 2016. Consistency of use and effectiveness of household water treatment practices among urban and rural populations claiming to treat their drinking water at home: a case study in Zambia. Am J Trop Med Hyg 94 2 445 455, doi: 10.4269/ajtmh.15-0563 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Savedoff WD, Levine R, Birdsall N. Washington, DC: Center for Global Development; 2006. When Will We Ever Learn? Improving Lives through Impact Evaluation. Report of the Evaluation Gap Working Group. http://www.cgdev.org/sites/default/files/7973_file_WillWeEverLearn.pdf [accessed 3 August 2016] [Google Scholar]
- Sedgwick WT, MacNutt JS. On the Mills-Reincke Phenomenon and Hazen’s theorem concerning the decrease in mortality from diseases other than typhoid fever following the purification of public water supplies. J Infect Dis. 1910;7:489–564. [Google Scholar]
- U.S. EPA (U.S. Environmental Protection Agency) Washington, DC: U.S. EPA; 2002. Method 1604: Total Coliforms and Escherichia coli in Water by Membrane Filtration Using a Simultaneous Detection Technique (MI Medium). EPA-821-R-02-024. [Google Scholar]
- UNFCCC (United Nations Framework Convention on Climate Change) CDM Project Cycle. 2014 https://cdm.unfccc.int/Projects/diagram.html [accessed 3 August 2016]
- UNFCCC. Adoption of the Paris Agreement. Proposal by the President. 2015 http://unfccc.int/files/essential_background/convention/application/pdf/english_paris_agreement.pdf [accessed 3 August 2016]
- United Nations. Kyoto Protocol to the United Nations Framework Convention on Climate Change. 1998 https://unfccc.int/resource/docs/convkp/kpeng.pdf [accessed 3 August 2016]
- USAID (U.S. Agency for International Development) Strengthening Evidence-Based Development: Five Years of Better Evaluation Practice at USAID, 2011–2016. 2016 https://www.usaid.gov/sites/default/files/documents/1870/Strengthening%20Evidence-Based%20Development%20-%20Five%20Years%20of%20Better%20Evaluation%20Practice%20at%20USAID.pdf [accessed 3 August 2016]
- Vestergaard Frandsen. GS0086 Sustainable Deployment of the LifeStraw Family in Rural Kenya Verification Report – Verification 1 – June 1, 2011 to November 30, 2011. 2012 https://mer.markit.com/br-reg/services/processDocument/downloadDocumentById/103000000010551 [accessed 14 July 2015]
- Vestergaard Frandsen. GS886 Sustainable Deployment of the LifeStraw Family in Rural Kenya Verification Report–Verification 2–December 1, 2011 to October 31, 2012. 2013 https://mer.markit.com/br-reg/services/processDocument/downloadDocumentById/103000000031855 [accessed 14 July 2015]
- Vestergaard Frandsen. GS886 Sustainable Deployment of the LifeStraw Family in Rural Kenya Monitoring Report – Verification 3 – November 1, 2012 to January 31, 2014. 2014a https://mer.markit.com/br-reg/services/processDocument/downloadDocumentById/103000000037580 [accessed 14 July 2015]
- Vestergaard Frandsen. Lifestraw® Carbon for Water. 2014b http://www.vestergaard.com/our-products/lifestraw-carbon-for-water [accessed 3 August 2016]
- Walker CLF, Rudan I, Liu L, Nair H, Theodoratou E, Bhutta ZA, et al. 2013. Global burden of childhood pneumonia and diarrhoea. Lancet 381 1405 1416, doi: 10.1016/S0140-6736(13)60222-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- WHO (World Health Organization) Evaluating Household Water Treatment Options: Health-Based Targets and Microbiological Performance Specifications. 2011 http://www.who.int/water_sanitation_health/publications/2011/evaluating_water_treatment.pdf [accessed 5 July 2015]
- WHO-UNICEF (World Health Organization-United Nations International) Progress on Sanitation and Drinking Water: 2015 Update and MDG Assessment. 2015 http://apps.who.int/iris/bitstream/10665/177752/1/9789241509145_eng.pdf?ua=1 [accessed 3 August 2016]
- WHO-UNICEF. The JMP Method – Deriving Progress Estimates. 2016 http://www.wssinfo.org/definitions-methods/method/ [accessed 3 August 2016]
- Yeo D. 2013. Towards more responsible carbon finance for water. Waterlines 32 308 314, doi: 10.3362/1756-3488.2013.032 [DOI] [Google Scholar]