Skip to main content
. 2023 Jun 12;2023(6):CD013862. doi: 10.1002/14651858.CD013862.pub2

Stookey 2017.

Study characteristics
Methods Study design: cluster‐RCT
Length of follow‐up from baseline: 1 year
Unit of allocation: centre
Unit of analysis: child
Participants Service type: centre‐based
Operation: not reported
Country (region): USA (San Francisco)
Country income classification: high
Low‐SES sample: yes
Population description: ECEC centres that primarily serve low‐income children in San Francisco and do not have federal, state or school district funding.
Inclusion criteria: all ECEC centres that participated in Child Care Health Program (CCHP) nutrition screenings in 2011–2012 were eligible.
Exclusion criteria: ECEC centres that were closed in Autumn 2012 or declined Child Care Health Program (CCHP) services for 2012–2013 before the randomisation were ineligible for the Healthy Apple Program (HAP) pilot. Child‐care centres with funding from Head Start, the San Francisco Unified School District, or Community College District were ineligible to receive CCHP screenings, and excluded from the HAP pilot. ECEC centres that declined one or both BMI screenings in any given year were excluded from evaluation analyses for that year, because of missing data regarding the primary outcome of interest, annual change in BMI between the Autumn and Spring screenings. Children who declined 1 or both screenings or were absent on the date(s) of screening in any given year were excluded from evaluation analyses for that year.
Number of services randomised: 43 (19 intervention, 24 control)
Number of children randomised: 902 (522 intervention, 380 control)
Characteristics
Children
Age:
Intervention: 2 years: 5%; 3 years: 40%; 4 years: 54%; 5 years: 1%
Control: 2 years: 14%; 3 years: 40%; 4 years: 45%; 5 years: 0%
Gender (% female): not reported
Ethnicity: not reported
Parents
Age (years): not reported
Gender (% female): not reported
Ethnicity: not reported
Parent/family SES: not reported
Method of recruitment: the programme was offered to those centres that completed the Child Care Health Program. A USD 25 gift card was offered to 1 representative/child‐care centre for participation in the Healthy Apple Program pilot.
Missing data/dropout: 6/43 centres had missing data at follow‐up (2 intervention, 4 control).
Reasons for dropout: 3 ineligible for CCHP BMI screenings (1 intervention, 2 control) and 3 declined 1 or both CCHP BMI screenings for the year (1 intervention, 2 control)
Characteristics of dropouts: not reported
Interventions Programme name: Healthy Apple Program (HAP)
Number of conditions: 1 intervention, 1 control
Intervention duration: 6 months
Intervention setting: ECEC
Intervention strategies:
Health curriculum
Children
Education: children received nutrition education (circle time for children).
Ethos and environment
ECEC staff 
Training: public health nurses or health workers introduced the HAP resources and process, in‐person, to child‐care centre staff and spent up to 16 h per ECEC centre, providing one‐on‐one support to each ECEC provider about the programme.
Workshops: 2 x optional, tailored workshops (1 on nutrition, 1 on physical activity) to address participant needs
Service
Resources: Healthy Apple Program (HAP) resources included an invitation packet, which included information about the HAP, a self‐assessment for ECEC providers, and information about the gift card incentive for completing the self‐assessment. The HAP resources also included a goal‐setting worksheet, hard copy Tip Sheets and online technical assistance materials.
Incentive: a USD 25 gift card was offered to 1 representative/ECEC centre for participation in the study.
Partnerships
Healthcare
Health checks: bi‐annual BMI screenings offered by public health nurses or health workers at ECEC centres.
Community
Co‐ordination: citywide co‐ordination of quality improvement processes for ECEC providers.
Intensity of intervention: up to 16 h staff training; 2 x optional workshops
Intervention delivered by: ECEC staff, healthcare staff
Modality: face‐to‐face, online, written
Theoretical basis: not reported
Description of control: delayed intervention control, plus included bi‐annual BMI screening; health education; dental and nutrition screening
Outcomes Outcomes relating to child dietary intake: not reported
Outcomes relating to child physical measures:
Annual change in BMI percentile, annual change in BMI z‐score
Number of participants analysed: unclear
Data collection measure: objectively measured (CDC)
Data collector: health workers
Validity of measures used: not reported
Outcome relating to child language and cognitive performance: not reported
Outcome relating to child social/emotional measures: not reported
Outcome relating to child quality of life: not reported
Outcome relating to cost:
Total operation cost, time
Number of participants analysed: not reported
Data collection measure: not reported
Data collector: not reported
Validity of measures used: not reported
Outcome relating to adverse consequences: not reported
Notes Funding source: CDC Community Transformation Grant. Funding for the HAP pilot evaluation was provided by the Feeling Good Project, funded by USDA SNAP‐Ed.
Risk of bias
Bias Authors' judgement Support for judgement
Random sequence generation (selection bias) Low risk For each health worker, eligible ECEC centres were listed in alphabetical order. A list of the same length, of random, unique, unsorted numbers was generated using randomizer.org. For each health worker, ECEC centres had an equal chance of being assigned to 1 of 2 intervention groups.
Allocation concealment (selection bias) Low risk Baseline data collected before cluster randomisation
Blinding of participants and personnel (performance bias)
Physical outcomes Low risk The programme health workers and ECEC providers were not blinded to treatment allocation. However, the outcome is not likely to be influenced by lack of blinding.
Blinding of participants and personnel (performance bias)
Cost Unclear risk The programme health workers and ECEC providers were not blinded to treatment allocation. It is unclear whether the outcome is likely to be influenced by lack of blinding.
Blinding of outcome assessment (detection bias)
Physical outcomes Low risk No blinding of outcome assessors, however children's height and weight were measured using a standardised protocol and calibrated instruments, and are unlikely to be influenced by lack of blinding.
Blinding of outcome assessment (detection bias)
Cost Unclear risk No blinding of outcome assessors. It is unclear whether the outcome is likely to be influenced by lack of blinding.
Incomplete outcome data (attrition bias)
Physical outcomes High risk The number of ECEC centres and children included in the HAP evaluation analysis varied each year, depending on the availability of BMI change data (primary outcome). Study authors stated that "Due to lack of unique child identifiers across child care centres, the analysis did not track the BMI changes of the same children across years." As a result, the risk of bias was assessed as high.
Incomplete outcome data (attrition bias)
Cost Low risk The outcome was collected as an average cost per service.
Selective reporting (reporting bias) Unclear risk No prospective trial protocol or trial registration so it was unclear whether there was selective outcome reporting.
Recruitment bias Unclear risk It is unclear whether individuals were recruited to the study before or after randomisation of clusters.
Baseline imbalance Unclear risk Children's income, race, ethnicity, and social determinants of health were unknown and not controlled for in the research design or analysis.
Loss of clusters High risk 9 of the 19 centres in the intervention group did not receive the allocated intervention. 7 of the 24 centres in the control group did not receive the allocated intervention. Loss of 6 clusters in Year 1 and 9 clusters in Year 2
Incorrect analysis Low risk Study authors stated that "The Child Care Health Program + HAP vs. Child Care Health Program + HAP Delayed groups were compared in intention‐to‐treat analyses, which accounted for clustered data. Year‐specific hierarchical linear models used child‐level data to test for a main effect of time between the Autumn to Spring screenings."
Contamination Unclear risk No evidence to make assessment
Other bias High risk Study authors stated that "Many potentially confounding and/or effect modifying factors, including local, statewide, and National initiatives, were operating in the background during the HAP pilot evaluation period." (Detailed explanation in study.) Authors also stated that "Randomization may not have eliminated bias related to treatment assignment, due to the relatively small number of child care centres and uneven demographic distribution across child care centres. Randomisation would not have controlled for time‐varying factors that happened to correlate with HAP exposure, and independently predict changes in child BMI."