Skoufias 2013.
Study characteristics | ||
Methods |
Study design: cRCT Study grouping: parallel How were missing data handled? Missing data were excluded from analysis. Sample of HHs used for the analysis of consumption was what remained after dropping HHs with food consumption < 1 percentile and > 99 percentile of the food distribution in the sample. An additional 802 HHs were excluded from the analysis because of missing or incomplete data (Leroy 2010). Analyses provide an estimate of ITT effect of in‐kind and cash transfers. Randomisation ratio: 1:1:1:1 Recruitment method: NR Sample size justification and outcome used: sample size was calculated so that statistical tests had the power to detect statistically significant and biologically relevant differences in several nutritional and economic variables. Specifically, the calculations of the sample size prior to the baseline survey were based on 60 communities per treatment group, a power of 80%, and a minimum detectable difference in food per capita consumption between each treatment and control group of 17.8%. The final sample consisted of 33 HHs per community and around 52 communities per treatment group (ICC 0.220) (Skoufias 2013). Sampling method: 2‐stage random sampling. A random sample of 208 rural communities was drawn from a pool of communities within 8 of the poorest states in the Southeast region. Within each community, 33 HHs were selected using systematic random sampling. After baseline data collection, the 208 selected communities (6687 HHs) were randomly assigned to 1 of 4 study groups: food basket without education (52 communities, 1657 HHs), food basket with education (52 communities, 1680 HHs), cash transfer with education (53 communities, 1687 communities) or control (51 communities, 1663 HHs). Due to partial contamination of the original evaluation design the analysis pools both in‐kind/food basket groups. Study aim or objective: to examine the impacts of cash and in‐kind transfers on HH welfare as measured by food and total consumption, poverty and labour supply (Skoufias 2008; 2013). To estimate the programme's impact on HH energy and macro‐ and micronutrient consumption and to evaluate whether the cash and in‐kind transfers had a differential effect on these outcomes (LeRoy 2010). Study period: delivery of the PAL benefits began in June 2004 and the mean time of exposure to the availability of the programme transfers was 14 months. Unit of allocation or exposure: communities |
|
Participants |
Baseline characteristics Intervention (cash transfer)
Control
Overall
Inclusion criteria: HHs eligible for PAL (localities had to meet some requirements such as having a population of < 2500, having a high or very high marginality and being accessible (not > 2.5 km from a road), and close enough (not > 2.5 km) to a DICONSA store (Mexican Government's agency that distributes the supply of food). Exclusion criteria: NR Pretreatment: the occasional significance of some variables indicated that the random assignment did not manage to balance totally the sample across the treatment and control groups, especially with respect to HH consumption (Table A.1). However, DID analysis accounted for this imbalance. In Leroy 2010, baseline nutrient intakes in cash transfer and control groups were similar. Attrition per relevant group: intervention group (cash transfers with education): 195/1687 (11.6%); control group: 279/1663 (16.8%). Total attrition: 864/6687 (13%) HHs. Reasons for attrition not provided, except for 1 cluster (33 HHs) in the control group and another in food basket without education group, that refused to participate in the follow‐up survey. Description of subgroups measured and reported: NR Total number completed and analysed per relevant group: full data were thus available for 5823 HHs (food basket without education: 51 communities, 1447 HHs; food basket with education: 52 communities, 1500 HHs; cash transfer with education: 53 communities, 1492 HHs; control: 50 communities, 1384 HHs) (Leroy 2010). Total number enrolled per relevant group: the data use were based on a longitudinal sample of 5851 HHs in 206 poor rural localities from 6 southern Mexican states (Chiapas, Guerrero, Oaxaca, Quintana Roo, Tabasco and Veracruz). Numbers per group NR. Total number randomised per relevant group: after baseline data collection, the 208 selected communities (6687 HHs) were randomly assigned to 1 of 4 study groups: food basket without education (52 communities, 1657 HHs), food basket with education (52 communities, 1680 HHs), cash transfer with education (53 communities, 1687 HHs) or control (51 communities, 1663 HHs) (Leroy 2010). |
|
Interventions |
Intervention characteristics Intervention (cash transfer)
Control: no intervention |
|
Outcomes | Dietary diversity: proportion of children with MDD (consumed foods from ≥ 3–6 food groups) Diet intake: consumption of iron‐rich or iron‐fortified foods Anthropometry: BMI |
|
Identification |
Sponsorship source: Mexican government Country: Mexico Setting: poor rural HHs in Southern states of Mexico Author's name: Emmanuel Skoufias Email: eskoufias@worldbank.org Declarations of interest: no conflicts of interest (Leroy 2010). Study or programme name and acronym: Programa de Apoyo Alimentario (PAL) (food support programme) Type of record: journal article |
|
Notes | ||
Risk of bias | ||
Bias | Authors' judgement | Support for judgement |
Random sequence generation (Selection bias) | Low risk | Quote: "Localities were randomised into four groups using a simple randomisation algorithm" (Cunha 2014). |
Allocation concealment (Selection bias) | Low risk | Allocation was at location level (clusters), carried out by the Ministry of Social Development after baseline data collection. |
Baseline characteristics similar (Selection bias) | Low risk | Although there were some differences between characteristics at baseline, the DID analysis adjusted for these. |
Baseline outcome measurements similar (Selection bias) | Low risk | Baseline nutrient intakes in both groups were similar (Leroy 2010). Although HH food expenditure was less in the intervention group at baseline (P < 0.1) (Addendum A, Skoufias 2013), the data were analysed with DID methods which adjusts for pre‐existing baseline differences. |
Blinding of participants and personnel (Performance bias) | Low risk | Blinding was not possible due to the nature of the intervention. This was unlikely to influence behaviour of participants and personnel. |
Blinding of outcome assessment (Detection bias) | Low risk | Quote: "To avoid potential interviewer bias, field workers were, to the extent possible, unaware of the group assignment." |
Protection against contamination (Performance bias) | Unclear risk | Allocation was done at the community level; however, there was no information about whether communities in control group received either intervention. Cunha 2014 reported that 1 control HH reported receiving aid. |
Incomplete outcome data (Attrition bias) | High risk | 11.6% attrition in the intervention group and 16.8% in the control group. 1 cluster lost as 1 community in the control group refused to participate in the follow‐up survey (33 HHs). The study authors reported that HHs excluded from the analyses tended to live in smaller houses than those included (2.48 vs 2.77 rooms; P < 0.05). Nutrient consumption at baseline was higher in excluded HHs, but no details were reported. |
Selective outcome reporting (Reporting bias) | Unclear risk | No study protocol available. |
Other bias | Unclear risk | Misclassification bias: unclear risk. Receipt of cash transfers were self‐reported in 1 paper (Cunha 2014), but NR as such in other papers. Measurement bias: low risk. Trained field workers interviewed the homemaker at baseline and follow‐up (semi‐quantitative FFQ questionnaire of 61 food items consumed at home in the 7 days prior). Incorrect analysis: unclear risk. SEs were corrected for clustering of individuals at the village level in Skoufias 2013, but adjusting for clustering NR in Leroy 2010. Recruitment bias: low risk. Participants were recruited after allocation of locations (clusters), but were randomly sampled in each location. Seasonality bias: low risk. The month of data collection was included to adjust for the possible effect of seasonality on consumption. |