Kandpal 2016.
| Study characteristics | ||
| Methods |
Study design: cRCT Study grouping: parallel group How were missing data handled? authors reported that ITT analysis was performed; however, what they defined as ITT analysis was NR Randomisation ratio: 1:1 Recruitment method: sample selected in 3 stages (Figure 1). First, provinces in which the programme had not been introduced as of October 2008 were enumerated. Of the 11 provinces available, 3 were excluded because of security concerns. From the remaining 8 provinces, 4 provinces were chosen to span all 3 macro areas of the country (North, Visayas and Mindanao). Next, in each of these 4 provinces, 2 municipalities were randomly chosen to represent the mean poverty level of areas covered by the programme. Within each selected municipality, 130 villages were randomly assigned to treatment and control groups of 65 villages each. Data for the HH assessment form to run the PMT for beneficiary selection were fielded in the 8 RCT municipalities between October 2008 and January 2009. This was followed by the implementation of Pantawid in treated villages, with the first payment of cash grants commencing in April 2009. Data used in this analysis were collected in a follow‐up survey from the 130 villages in October and November 2011, allowing for a programme exposure period of 30–31 months. Sample size justification and outcome used: because this evaluation was a cRCT with treatment assignment at the village level, a power analysis (Supplemental Table 1) was conducted using the 3 main outcomes of interest: monthly per capita HH consumption, school participation by children aged 6–14 years, and health facility visits by children aged 0–5 years. In keeping with the programme's stated objective of improving child health and nutrition, the central research question of the impact evaluation was to estimate the programme effect on child health and education. However, at the time of the power calculations, data on child anthropometric measurements were N/A for the Philippinesat, a decentralised level; as a result, these outcomes were omitted from the power calculations despite their being a central concern of the impact evaluation. The 2007 Family Income and Expenditure Survey and the 2003 National Demographic Health Survey data sets were used as proxies for outcome mean and variance in the comparison population. A modest hypothesised impact ensured an adequately powered study. The power analysis used a 10% increase in HH per capita expenditures, a 7 pp increase in school enrolments in children aged 6–14 years, and a 7 pp increase in health facility visit rate in children aged 0–5 years. Intracluster correlation coefficients were 0.12–0.25, depending on the outcome of interest. These factors combined to suggest an RCT size of 3900 HHs randomly selected from 134 enumeration clusters. Sampling method: eligible poor HHs were identified by the survey conducted by the National Household Targeting System for Poverty Reduction (NHTS‐PR) that used a PMT, which estimated per capita HH income on the basis of observable and easily provided information, including HH size and physical dwelling conditions. HHs with estimated per capita income below the poverty line were classified as poor. From this subset of poor HHs, Pantawid identified eligible HHs as being those with children aged 0–14 years or a pregnant woman at the time of the assessment, or both. Poor and eligible HHs received a combination of health grants and education grants every 2 months of PHP 500–1400 (USD 11–32), depending on number of eligible children in HH. Study aim or objective: to assess the impact of the Pantawid Pamilyang Pilipino Program (or Pantawid Pamilya) on HAZ and stunting of young children aged 6–36 months at the time of follow‐up survey. Study period: baseline data collected October 2008 to January 2009; follow‐up data collected October–November 2011 Unit of allocation or exposure: villages were allocated as clusters |
|
| Participants |
Baseline characteristics Intervention or exposure
Control
Overall
Inclusion criteria: category 1 HH: 1418 poor HHs, i.e. HHs whose estimated per capita income fell below the poverty line, and that also had children aged 0–14 years or a pregnant mother (or both) at time of assessment. Exclusion criteria: 3 provinces were excluded because of security concerns Pretreatment: baseline data showed that HH characteristics were not significantly different between the 1418 category 1 treatment and control HHs. Attrition per relevant group: survey data included complete HAZ data on 194/241 treated children aged 36 months and 178/244 control children aged 36 months. Complete weight‐for‐age data collected for 204/241 treated children aged 36 months, and 189/244 control children aged 36 months. Anthropometric z‐scores were calculated on the basis of the WHO growth standard. Scores > 6 SDs above or below the reference mean were dropped from the sample. This trimming resulted in the dropping 10/194 treated children and 11/178 control children from the HAZ regressions, and the dropping of 2/204 treated children and 1/189 control children from the weight‐for‐age regressions. 15% of those eligible in the treatment villages reported that they did not participate; NR for control villages. Description of subgroups measured and reported: N/A Total number completed and analysed per relevant group: intervention group (children aged 6–36 months): 194 had height‐for‐age data, and 204 had weight‐for‐age data; control group (children aged 6–36 months): 178 had height‐for‐age data and 188 had weight‐for‐age data Total number enrolled per relevant group: intervention group: 241 children aged 6–36 months were part of HHs that underwent survey; control group: 244 children aged 6–36 months were part of HHs that underwent survey. Total number randomised per relevant group: sample of 1418 HHs was randomly assigned to 714 treated HHs and 704 control HHs for the impact evaluation. At time of the data collection in 2011, in these 714 treated HHs there were 241 children aged 3 years who could have been exposed to the programme in the first 1000 days of their lives, and 244 children in the same age range from poor HHs in control areas. |
|
| Interventions |
Intervention characteristics Intervention or exposure
Control: no intervention |
|
| Outcomes | Diet diversity: child consumption of eggs/dairy/meat/fish in the past week Anthropometry: WAZ, underweight, severely underweight, HAZ, stunted, severely stunted Morbidity: fever, cough, or diarrhoeal disease in past 2 weeks |
|
| Identification |
Sponsorship source: Consultative Group on International Agricultural Research (CGIAR) Research Program on Policies, Institutions, and Markets Country: Philippines Setting: poor HHs across all 3 macro areas of the country (North, Visayas and Mindanao) Author's name: Eeshani Kandpal Email: ekandpal@worldbank.org Declarations of interest: yes; no conflicts of interest. Study or programme name and acronym: Pantawid Pamilyang Pilipino Program (CCT programme) Type of record: journal article |
|
| Notes | ||
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (Selection bias) | Unclear risk | Method of randomisation NR. |
| Allocation concealment (Selection bias) | Unclear risk | Allocation concealment NR. |
| Baseline characteristics similar (Selection bias) | Low risk | Reported baseline characteristics were similar across intervention and control groups. |
| Baseline outcome measurements similar (Selection bias) | Unclear risk | Baseline data for nutritional outcomes NR. |
| Blinding of participants and personnel (Performance bias) | Low risk | Participants not blinded, but this was unlikely to have influenced participant behaviour. |
| Blinding of outcome assessment (Detection bias) | High risk | Unclear whether data collectors were blinded towards the group allocations, which may or may not have influenced the measurement of outcomes across groups, as some outcomes were self‐reported. |
| Protection against contamination (Performance bias) | High risk | 7% of the control group participated in the intervention (ITT analysis performed), which may or may not have biased the estimated effects of the intervention towards 0. |
| Incomplete outcome data (Attrition bias) | High risk | Missing outcome data excluded from analyses and differed across groups, and reasons for LTFU were NR. For the outcome height‐for‐age, attrition was 47/241 (19.5%) in intervention group and 66/244 (27%) in control group. For the outcome weight‐for‐age, attrition was 37/241 (15.4%) in intervention group and 55/244 (22.5%) in control group. |
| Selective outcome reporting (Reporting bias) | Unclear risk | No protocol or trial registration number NR. While height‐for‐age and weight‐for‐age anthropometrical measurements in children aged 6–36 months were reported; weight‐for‐height (important to indicate wasting) was not. Results for the following outcomes were NR: monthly per capita HH consumption and health facility visits by children aged 0–5 years. |
| Other bias | Unclear risk | Misclassification bias: unlikely. Measurement bias: low risk. Quote: "Several rounds of training were conducted before data collection to ensure data quality, particularly of the anthropometric and dietary intake modules." However, the method for collecting dietary data (e.g. 24‐hour recall, or food frequency questionnaire) was NR. Incorrect analysis: low risk. Quote: "In order to take into consideration regional factors, including province‐specific eligibility cutoffs, and the clustered nature of the sample …, municipality fixed‐effects regressions were included. In addition, all SEs were clustered at the village level." |