Doocy 2017.
| Study characteristics | ||
| Methods |
Study design: PCS Study grouping: N/A How were missing data handled? With exception of imputation procedures for child anthropometric data, analysis did not consider interim measures of each indicator because after exploratory analysis, it became clear that inclusion of interim data points did not change results and conclusions, and thus eliminating analysis of interim measures would facilitate the interpretation of findings. Used a multiple imputation approach for anthropometric outcomes, where missing values were replaced by values sampled from a distribution defined by the fit of a linear regression model at a given follow‐up as a function of previous outcomes, as well as of child age and sex. Missing values for maternal age was assigned the mean and education the mode of those variables, so they could be included in the analysis. Randomisation ratio: N/A Recruitment method: at enrolment, a full description of study was read to prospective participants and they had the opportunity to ask questions about participation; those who agreed to participate gave oral consent due to high levels of illiteracy. At each subsequent survey, the respondent was read an abbreviated consent statement and asked to re‐affirm their willingness to participate prior to the interview (Doocy 2018). Study enrolment occurred between August and October 2012 following identification of beneficiaries for each intervention. 1820 beneficiaries and their HHs were enrolled and followed over 3.5 years during February/March 2016; study HHs were followed for the entire period, regardless of whether they graduated or dropped out of intervention. Sample size justification and outcome used: primary outcome measure was reduction in HH food insecurity, and authors conducted calculations for varying levels of reduction, assuming 80% power and a significance level of 0.05. With a minimum sample size of 325 HHs per group (or 1625 HHs in total for the parent study), study was powered to detect a 10% or greater reduction in prevalence of food insecurity indicators within each comparison group compared to baseline levels. Sampling method: The Jenga Jamaa II parent study used a quasi‐experimental matched design in which communities planned to receive 1 intervention (vs multiple interventions) selected for participation so that the effect of individual interventions could be assessed. Authors analysed 2 of the 5 comparison groups recruited for the parent study of Jenga Jamaa II: the FFS intervention group (388 participants) and the control group (324 participants). Participating communities within each territory (Fizi and Uvira) were matched by livelihood zone (mountains, plains or lakeside) and proximity into sets of villages with each type of intervention. The final sample had 13 sets of 3 villages; within each set of villages, 1 village received agricultural interventions, 1 received PM2A, and 1 received WEGs. In each set of villages, intervention groups were formed (i.e. 1 intervention per village) and all beneficiaries in the group were enrolled in the study. In agricultural intervention villages, the entire FFS group of approximately 30 beneficiaries was enrolled in the study. Controls were selected from WEG villages, where each beneficiary was matched with a female neighbour not participating in Jenga Jamaa II interventions, and that woman's HH was enrolled as a control. Villages were assigned to an intervention based on agreement with local leaders and availability programme resources; intervention participants were identified based on programme targeting criteria and community selection processes. Once intervention groups were formed, all group members were invited to participate in the research. In agriculture villages, 1 FFS with approximately 30 participants was enrolled; 1 of 3 farmer‐to‐farmer trainees of each FFS participant was randomly selected to comprise the F2F group. In WEG villages, 1 WEG group of 25 participants was selected. Members of the control group were also selected from WEG villages because the WEG intervention had lower coverage than FFS/farmer‐to‐farmer and PM2A interventions (i.e. there was only 1 WEG group per village compared to multiple PM2A and agricultural intervention groups), which lessened the likelihood of spillover effects on control HHs. Study aim or objective: to examine the changes in agricultural production practices, HH food security and child nutritional status that are associated with participation in FFS programmes. Study derived from a subset of data from the parent study of Jenga Jamaa II which sought to address HH food insecurity and child undernutrition through 1. increasing incomes among farming HHs through FFS and farmer‐to‐farmer training interventions, 2. improving the health and nutritional status of children aged < 5 years through the PM2A, and 3. empowering women via WEGs. Study period: HHs were followed for 3.5 years, from enrolment in autumn of 2012 (baseline) to February or March 2016 (endline). Unit of allocation or exposure: villages |
|
| Participants |
Baseline characteristics FFSs
Control
WEGs
Overall (all intervention groups; including those irrelevant to the review)
Inclusion criteria: intervention participants identified based on programme targeting criteria and community selection processes. For the control group, enrolled primary carer of children, and 100% were women. No other details. Exclusion criteria: NR Pretreatment: more women in control group (as control group selected was women only – from the village where women empowerment intervention was implemented, whereas the interventions included all FFS beneficiaries (men and women). Intervention group participants were significantly older; control group participants had higher proportion completing any formal education control; group had higher mean number of younger children (aged 0–4 years); higher proportion of farmers in intervention group; mean HH size differed significantly between the groups; smaller for FFS groups and larger for WEG groups; number of income sources (highest in FFS group and lowest in control group). Attrition per relevant group: results included only 82% of participants who were present for both baseline and endline surveys (both conducted in February/March). Village of Kibirizi, which included 1 FFS group, was not included in endline survey (and thus was excluded from the final evaluation) due to security concerns. 1820 HHs were enrolled in study and 1481 (81%) participated in the endline survey; follow‐up ranged from 74% to 90% in different intervention groups and was lowest among the control group: FFS baseline 390; endline participation rate 81%; WEG baseline 325; endline participation rate 90%; control baseline 325; endline participation rate 78%. Description of subgroups measured and reported: NR Total number completed and analysed per relevant group: for food security outcomes: intervention group: 317 FFS beneficiaries; control group: 254 non‐FFS participants. For child anthropometric outcomes: intervention group: 265 children of FFS beneficiaries; control group: 206 children of non‐FFS participants. Total number enrolled per relevant group: FFS programme: study enrolled 388 FFS beneficiaries and their HHs in the intervention group and 324 non‐FFS adults and their HHs in the control group. WEG group: 390 HHs. Total number randomised per relevant group: N/A |
|
| Interventions |
Intervention characteristics FFSs
Control
WEGs
|
|
| Outcomes | Food security: HFIAS; proportion of HHs improving in a HFIAS category from baseline to endline; proportion of HHs food secure and mildly/moderately/severely food insecure Dietary diversity: HDDS; HHs achieving target dietary diversity Anthropometry: stunting, underweight |
|
| Identification |
Sponsorship source: USAID Office of Food for Peace Cooperative Agreement (AID‐FFP‐A‐11‐00006). Country: Democratic Republic of the Congo Setting: 2 farming villages in South Kivu province in the Congo Author's name: Shannon Doocy Email: doocy1@jhu.edu Declarations of interest: none declared. Study or programme name and acronym: Farmer Field Schools programme, subset of interventions implemented as part of the Jenga Jamaa II project Type of record: journal article |
|
| Notes | ||
| Risk of bias | ||
| Bias | Authors' judgement | Support for judgement |
| Random sequence generation (Selection bias) | High risk | PCS |
| Allocation concealment (Selection bias) | High risk | PCS; therefore, no allocation concealment carried out. |
| Baseline characteristics similar (Selection bias) | Low risk | Some imbalances in gender, age, number of younger children, proportion who were farmers between the intervention and control groups. These characteristics were adjusted for in the analysis and authors also carried out PSM. |
| Baseline outcome measurements similar (Selection bias) | Unclear risk | Study authors reported differences in food security outcomes at baseline, although the statistical analysis of these outcome variables was not provided. Analyses regarding food security outcomes was adjusted for baseline HDDS values. However, for child anthropometric outcomes, there were no baseline values reported, thus it is unclear whether there were imbalances or not. |
| Blinding of participants and personnel (Performance bias) | Low risk | No blinding of participants and personnel was done. However, in this type of intervention, it is unlikely that lack of blinding would have affected experience or treatment of participants. |
| Blinding of outcome assessment (Detection bias) | High risk | Although blinding was not possible, interviews were carried out by staff that did not regularly interact with the participants. However, outcomes such as dietary diversity and food insecurity, that are based on respondents recall, may be susceptible to lack of blinding. |
| Protection against contamination (Performance bias) | High risk | Control HHs were sampled from villages that received 1 of the intervention types (WEG), thus the risk for contamination was high. Authors also reported that, "It is also possible that spillover from the intervention areas affected the control areas." |
| Incomplete outcome data (Attrition bias) | High risk | Differential attrition observed between groups: 10% for WEGs, 19% for FFS and 22% for control group. Reasons for missing/excluded data not provided. 1 entire village (Kibirizi) was excluded from the analyses (due to conflicts in the country). For child anthropometric data, missing values were inputted using a multiple imputation approach, where missing values were replaced by values sampled from a distribution defined by the fit of a linear regression model at a given follow‐up as a function of previous outcomes, as well as of child age and sex. |
| Selective outcome reporting (Reporting bias) | Unclear risk | Study protocol N/A; however, the primary outcome, namely HH food security (as prespecified in the Methods section of the citation by Doocy 2017), was reported in the text. |
| Other bias | Low risk | Misclassification bias of exposure: low risk. Measurement bias: low risk; scales used were validated and widely used, as was anthropometric measurement; and staff were trained in data collection. Seasonality: low risk; study collected data over different seasons over 3.5 years. Random sequence generation (selection bias). |