Leroy 2008 (PROGRESA).
Study characteristics | ||
Methods |
Study design: PCS How were missing data handled? children LTFU or with missing data were excluded from the analysis. Randomisation ratio: N/A Recruitment method: mass media advertised the programme and invited families to solicit a socioeconomic screening questionnaire at the enrolment centres. Assessment utilised HH assets, housing quality, years of education and HH composition. Programme staff visited all HHs that appeared eligible to validate the results of the screening questionnaire. Eligible applicants subsequently had to return to the programme office to register. HH enrolment in urban areas started in 2002 and was staged over 2 years. Sample size justification and outcome used: NR Sampling method: For the evaluation sample, 149 manzanas (the smallest administrative unit within an urban area) in 17 of Mexico's 31 states were selected through probabilistic stratified sampling from the pool of localities where Oportunidades would be implemented in 2002. The localities were selected based on density of low‐income HHs. The survey included eligible HH that enrolled and eligible HHs that did not enrol in the programme. Study aim or objective: to evaluate the impact of Mexico's CCT programme, Oportunidades, on the growth of children aged 24 months living in urban areas. Study period: 2 years (baseline: 2002; follow‐up: 2004) Unit of allocation or exposure: HHs |
|
Participants |
Baseline characteristics Intervention or exposure
Control
Overall
Inclusion criteria: poorest HHs in an urban block in urban centres (based on a cut‐off of the national HH Income and Expenditure Survey). None other reported. Exclusion criteria: NR Pretreatment: baseline characteristics did not differ between treatment and comparison HHs. However, the propensity score was substantially higher in intervention HHs (P < 0.05). The score was based on SE variables and likelihood of enrolment. Attrition per relevant group: total: 301/733 (41.1%) children (263 LTFU and 38 with missing data); intervention: 230/574 (40.1%) children (202 LTFU and 28 with missing data); control: 71/159 (44.7%) children (61 LTFU and 10 with missing data). Description of subgroups measured and reported: age of child at baseline: 0–6 months; 6–12 months and 12–24 months. Socioeconomic tertile at baseline: tertile 1, 2 and 3. Total number completed and analysed per relevant group: intervention group (HHs who enrolled in the programme): 344 children; control group (HHs who did not enrol in the programme): 88 children Total number enrolled per relevant group: total: 733 HHs; intervention: 574 children; control: 159 children Total number randomised per relevant group: N/A |
|
Interventions |
Intervention characteristics Intervention or exposure
Control: no intervention |
|
Outcomes | Anthropometry: height; weight; HAZ, WHZ | |
Identification |
Sponsorship source: National Coordination of the Oportunidades programme of the Mexican secretary of Social Development Country: Mexico Setting: urban poor HHs participating in a national anti‐poverty programme Authors' names: Lynnette M Neufeld; first author: Jef L Leroy Email: neufeld@insp.mx Declarations of interest: no conflicts of interest Study or programme name and acronym: PROGRESA/Oportunidades Type of record: journal article |
|
Notes | ||
Risk of bias | ||
Bias | Authors' judgement | Support for judgement |
Random sequence generation (Selection bias) | High risk | CBA; no randomisation done. |
Allocation concealment (Selection bias) | High risk | CBA; no randomisation done. By excluding 26% of all HHs surveyed, this could have introduced other forms of bias in their sample. Study authors did not compare these HHs to included HHs. |
Baseline characteristics similar (Selection bias) | Low risk | Although intervention HHs had a higher baseline mean propensity score (probability of enrolment in the Oportunidades programme) than those in the control group, the study authors used PSM to compare changes in HHs in both groups during their analysis. |
Baseline outcome measurements similar (Selection bias) | Low risk | The anthropometric parameters of the children at baseline did not differ. The study authors also adjusted for baseline child anthropometric measurements and maternal height in their analyses. |
Blinding of participants and personnel (Performance bias) | Low risk | Blinding not possible but lack of blinding unlikely to influence participant or personnel behaviour. |
Blinding of outcome assessment (Detection bias) | Low risk | Blinding of outcome assessors NR. However, outcomes of interest (anthropometric measures) were objective and unlikely to have been influenced by lack of blinding. |
Protection against contamination (Performance bias) | Low risk | Eligible HHs were enrolled in the programme and control HHs were eligible HHs that did not enrol in the programme. Therefore, it was not possible for control HHs to receive any programme benefits. |
Incomplete outcome data (Attrition bias) | High risk | High levels of missing data overall (41%) and in intervention (40.1%) and control (44.7%) groups. Although for most HHs reasons for LTFU were because of moving to another area, this information was only available for some of these HHs (91/263). Furthermore, by excluding 26% of all HHs surveyed this could have introduced other forms of bias in their sample. The study authors did not compare these HHs to included HHs. |
Selective outcome reporting (Reporting bias) | Unclear risk | No protocol available. |
Other bias | Low risk | Misclassification bias: low risk. The study authors only used data from included HHs that were consistently classified as either intervention or control HHs. Measurement bias: low risk. Incorrect analysis: N/A. Seasonality bias: unknown risk (time of year not stated). |