Highlights
-
•
Assesses how school fruit & vegetable distribution interventions are implemented.
-
•
Child fruit & vegetable intake is influenced by how intervention is implemented.
-
•
Recommendations for implementing fruit & vegetable interventions in schools.
-
•
Studies should also consider sustainability, cost-effectiveness and implementation.
Keywords: Healthy eating, Implementation science, Evaluation research, Schools, Health promotion, Child health, Snacks, Fruit and vegetables
Abstract
Despite the importance of process evaluation in program evaluations, research has focused primarily on the effectiveness of fruit and vegetables (FVs) distribution interventions on children’s consumption, with little attention given to how these interventions achieve their outcomes. Five bibliographic databases (Embase, PubMed, ProQuest, Scopus, and Web of Science Core Collection) were searched in June 2019 for studies of interventions where the main focus was the implementation of distributed FVs to school-aged children as a snack. The Critical Appraisal Skills Programme (CASP) tool was used to appraise the risk of bias within included studies. Data were extracted based on study characteristics and findings. Results identified 24 studies reporting on 11 interventions and 1 policy. The findings of this systematic review indicate that the majority of the studies included limited references to implementation research. Recurring limitations include an absence of an evaluation theoretical framework and the data collection methods used. Also, several factors were identified as informing the success of snack-based FVs distribution programs, including participation of the school community, school characteristics, background knowledge, and parental engagement. Lack of timely FVs delivery, limited funding, inadequate awareness about the program, insufficient teachers’ time, and food waste were identified as challenges to successful programming. Findings indicate that distributing FVs to school-aged children as a snack can increase their consumption, but only with proper implementation. Further evaluative research is required to better inform future implementation of snack-based FV distribution interventions in school settings.
1. Introduction
Fruit and vegetables (FVs) are important components of a healthy diet and sufficient daily consumption can help prevent the majority of non-communicable chronic diseases (World Health Organization [WHO], 2003), however children consume less FVs than recommended (Dennison et al., 1998, Garriguet, 2007, Minaker and Hammond, 2016, Colapinto et al., 2018, Polsky and Garriguet, 2020). To combat this problem, a number of intervention strategies have been developed to increase school-aged children’s intake of healthy foods, particularly FVs (Triador et al., 2015, DeCosta et al., 2017, Libman, 2007, Margolin et al., 2018). Increasing the availability and accessibility of FVs by distributing FVs to school-aged within the school environment has been consistently identified as positive predictors of children’s consumption of FVs (Blanchette and Brug, 2005, de Sa and Lock, 2008, Rasmussen et al., 2006, Knai et al., 2006, Van Cauwenberghe et al., 2010). Availability is defined as the presence of FVs at home or in school, while accessibility is defined as FVs that are prepared, presented, and/or maintained in a form that enables or encourages children to consume them (e.g., cutting up FVs or designating time to eat FVs) (Blanchette and Brug, 2005). While a recent systematic review and meta-analysis examined the effectiveness of distributing FVs as a snack during break-time to school-aged children (Blinded for Review), these studies rarely inform us of how interventions were executed and the importance of implementation for program effectiveness.
Process evaluation studies serve an important role in health promotion research by providing information about how interventions are implemented, the predictors of conditions under which interventions are likely to be most effective (i.e., mechanism of impact), and how the contextual environment affects the outcome (Oakley et al., 2006). Evidence from process evaluation is important to determine whether a lack of an effect is due to inadequate (i.e., poorly implemented) or ineffective (i.e., poorly designed) interventions, thereby qualifying the understanding of any effect of an intervention (Durlak and DuPre, 2008). Various theoretical frameworks (Baranowski and Stables, 2000, Linnan and Steckler, 2002, Saunders et al., 2005, Glasgow et al., 1999, Fleuren et al., 2004, Rogers, 2003) have been used to address process evaluation of public health interventions. Yet, despite heterogeneity, they are all intended to determine aspects that are not working in the program and that need to be further improved.
To our knowledge, this constitutes the first systematic review of the literature on snack-based FV distribution interventions in school settings to examine: 1) features of process evaluations of snack-based FV distribution intervention studies that have been conducted in this field of study; and 2) the benefits and impacts of these programs, successes of and challenges to the implementation, and potential recommendations into future implementation of these programs. The study primarily focuses on the implementation practices and processes of providing children with readily accessible and available FVs during school hours as snacks (outside of breakfast or lunch time). This is because these programs are considered feasible to implement, compared to breakfast or lunch meals, within the school environment due to the rudimentary resources needed (e.g., basic servery/kitchenette, preparation areas, storage infrastructure and volunteer/staff capacity). Knowledge gained from this review will not only guide future planning of process evaluations in this field, but also identify conditions and resources needed under which snack-based FV distribution interventions are likely to be most effective and sustainable.
2. Materials and methods
The authors followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines during all stages of design, implementation, and reporting (Moher et al., 2009).
2.1. Search strategy
Embase, ProQuest, PubMed, Scopus, and Web of Science Core Collection were searched in June 2019. No date limit, language or geographic location restrictions were applied. In consultation with an experienced librarian and informed by previously published literature, searches were carried out combining five different search arms: (school* OR “school-based”) AND (intervention* OR program* OR scheme* OR campaign* OR initiative*OR project*) AND (“program evaluation” OR “process evaluation” OR implementation OR evaluation) AND (fruit* OR vegetable*) AND (provision OR subsidized OR distribution OR free OR availability OR exposure OR accessibility). This method was adapted when Medical Subject Headings (MeSH) terms were not available. One reviewer screened the titles of the studies and imported all relevant titles into a citation manger (Mendeley v1.17.10). Duplicates were then removed and from the remaining studies, an abstract screening was completed independently by two reviewers. For any potentially relevant studies, full texts were assessed for eligibility independently by two reviewers. Once eligible studies were identified, a manual search of the reference lists of the included studies was conducted to identify any missed relevant studies. Discrepancies were discussed, elucidated, and resolved with a third reviewer.
2.2. Study selection
Studies needed to meet the following inclusion criteria: Population: stakeholders (e.g., school staff, volunteers, children); Intervention: distributed FVs as snacks in school-based setting solely or combined with another intervention approach (e.g., nutrition education, parental involvement); Comparator: not applicable; and Outcome: provided information on the functioning of the intervention (i.e., implementation, mechanisms of impact, and/or contextual factors). Studies were excluded if they were not reported in English, reviews, conference proceedings/abstracts, design protocols, process evaluation of approaches used to increase children’s FVs consumption, but without providing children with FVs at schools (e.g., nutrition education, parental involvement) or studies that only reported on outcome evaluation with no information on process evaluation.
2.3. Data extraction and abstraction
Information from each study was extracted based on the following: 1) basic information about the study (authors, publication year, program name, and country); 2) process evaluation participants; 3) measurement methods; 4) and findings. The Critical Appraisal Skills Programme (CASP) was used to provide descriptive information on the quality of the included studies rather than as a basis for inclusion. Each study was rated independently by two reviewers. The tool consists of 10 questions, all of which can be answered with either “Yes”, “No”, or “Unclear” and are designed around three broad sections: 1) Are the results of the study valid? 2) What are the results? and 3) Will the results help locally? (Critical Appraisal Skills Programme [CASP], 2018).
2.4. Data synthesis
A qualitative synthesis was presented detailing: 1) features of process evaluations of snack-based FV distribution intervention studies that have been conducted in this field of study; and 2) process evaluation findings of stated implementation of the planned intervention. Data were analyzed using an inductive content analysis approach (Braun and Clarke, 2006, Auerbach and Silverstein, 2003). As a team, we developed a preliminary coding template, tested its implementation, and discussed any issues that arose during preliminary data analysis until a common theme template was developed. Studies were independently coded by a second reviewer (non-author) to establish inter-rater reliability. The coders achieved an initial agreement level of 87.5% before discussing individual differences in interpretation. This measure of agreement was determined by comparing codes each reviewer assigned and calculating the percentage of agreement (Nili et al., 2017). Any initial coding disagreements were discussed, elucidated, and resolved with a third author until a common theme template was developed.
Several strategies were employed to enhance trustworthiness of the data. The coding and interpretation of results were continuously discussed with co-authors and discrepancies were amended following discussion to clarify coding and emergent themes using a team analysis approach (also known as investigator triangulation) (Merriam, 2009). An IRR of 80% agreement between coders on 95% of the codes is considered sufficient agreement when multiple researchers involved in the coding process (McAlister et al., 2017). The primary author re-visited the studies after the development of the final common theme template to verify that findings were rooted in the data. Data coding was checked using the specification in the NVivo software program (Version 12, QSR International Pty Ltd, Melbourne, Australia). A reflective diary of data collection and analysis provided data immersion, validity, and minimized researcher bias (Green et al., 2007).
3. Results
3.1. Literature search
Of the 1669 titles retrieved, 166 studies remained after title screening and removal of duplicates. Abstract screening left 93 studies, as 73 did not meet the pre-specified eligibility criteria. Full-text screening left 18 studies, as 75 did not meet the eligibility criteria. An additional six studies were added from a manual search of reference lists of the included studies. In total, this search strategy identified 24 separate studies, reporting on 11 interventions and 1 policy, published between 2006 and 2019 (Fig. 1).
Fig. 1.
Flow diagram of search strategy and review process based on PRISMA statement. PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
3.2. General characteristics of the studies
A descriptive summary of the characteristics of the included studies (n = 24) is presented in Supplementary Table A. Most studies were based in Canada (n = 6), USA (n = 5), and Denmark (n = 4), and included a variety of participants (e.g., children, teachers). All interventions distributed free FVs as a snack during break-time within school hours, with the exception of one study (Bere et al., 2006a) in which FVs were distributed at parental costs (subsidized). In addition to distributing FVs, some intervention studies incorporated other supplementary components such as nutrition education (Bere et al., 2006a, Bouck et al., 2011, Wind et al., 2008, Aarestrup et al., 2014, Gates et al., 2011) peer modelling and rewards, (Clarke et al., 2009, Muellmann et al., 2017, Hayes et al., 2019) and parental involvement (Bere et al., 2006a, Wind et al., 2008, Jorgensen et al., 2016).
3.3. Quality of evidence
The results of the quality assessment of the included studies (n = 24) are presented in Supplementary Table B. A broad approach was used to avoid excluding studies based on quality assessment and to leave room for conducting exploratory research on the evidence base in this field. As there is no consensus on the relative weight that should be ascribed to any individual study, the presentation of a simple summed score of the tool’s items would risk being more misleading than informative.
For the intervention studies, we did note a valuable contribution, but considerable heterogeneity in adequately describing the implementation practices and processes of these interventions. All studies provided an adequately clear statement of the aims (Item 1) and findings (Item 9). None of the studies raised any significant ethical concerns; however, two studies (Reinaerts et al., 2007a, White, 2006) did not report the appropriate ethical permission (Item 7). This may be partly due to the age of the studies and changing reporting requirements regarding ethical approval over time. Although all studies were assumed to offer some potential value through “novel findings or perspectives”, a number of studies reported minimal details concerning qualitative methods, reflecting the fact that this was supplemental to quantitative survey data. This was noted with respect to inadequacy and/or lack of participant identifier accompanying data, and lack of quotes accompanying data, which hampered assessment of the extent to which the authors had taken into consideration all available data (Bere et al., 2006a, Wind et al., 2008, Jorgensen et al., 2016, Reinaerts et al., 2007a, Aarestrup et al., 2015, Jamelske and Bica, 2014, Bai et al., 2011, Lin and Fly, 2016, Coyle et al., 2009, Skinner et al., 2012, Gates et al., 2012, Gates et al., 2016, Yeo and Edwards, 2006)
3.4. Features of process evaluation of Snack-based FV distribution intervention studies
3.4.1. Terminology
17 studies used the term “process evaluation”, “program evaluation” or “implementation”, which could be found anywhere in the paper (e.g., title, abstract, introduction, methods) (Gates et al., 2012, Gates et al., 2016, Gates et al., 2011, Bere et al., 2006a, Bouck et al., 2011, Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Muellmann et al., 2017, Hayes et al., 2019, Jorgensen et al., 2016, Jorgensen et al., 2014, Reinaerts et al., 2007a, Jamelske and Bica, 2014, Bai et al., 2011, Potter et al., 2011, Hector et al., 2017).
3.4.2. Aim, theoretical framework, research strategy and timing
17 studies identified aims and research questions specific to process evaluation (Bouck et al., 2011, Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Muellmann et al., 2017, Hayes et al., 2019, Jorgensen et al., 2016, Jorgensen et al., 2014, Reinaerts et al., 2007a, Jamelske and Bica, 2014, Bai et al., 2011, Yeo and Edwards, 2006, Potter et al., 2011, Hector et al., 2017), while the remaining provided a very broad description of these objectives. Only 9 studies reported the use of a theoretical framework to inform the design of the process evaluation (Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Gates et al., 2016, Hayes et al., 2019, Jorgensen et al., 2016, Reinaerts et al., 2007a). The most frequently cited theoretical frameworks were Baranowski and Stables, 2000, Linnan and Steckler, 2002, Saunders et al., 2005, Glasgow et al., 1999), Diffusion of Innovation Theory (Rogers, 2003), and the Utilization-focused participatory approach (Rossi et al., 2004). Several research strategies including qualitative methods, such as interviews and focus group discussion (Muellmann et al., 2017, Hayes et al., 2019, Jorgensen et al., 2014, He et al., 2012), quantitative methods, such as pre-coded questionnaires and surveys (Bere et al., 2006a, Wind et al., 2008, Clarke et al., 2009, Jorgensen et al., 2016, Reinaerts et al., 2007a, Aarestrup et al., 2015, Yeo and Edwards, 2006), or both (Bouck et al., 2011, Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Jamelske and Bica, 2014, Bai et al., 2011, Potter et al., 2011) were included in the implementation process. Most studies collected their findings at the end of the intervention (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Lin and Fly, 2016, Hayes et al., 2019, Jorgensen et al., 2016, Jorgensen et al., 2014, Reinaerts et al., 2007a, Skinner et al., 2012, Yeo and Edwards, 2006), with some studies collecting their findings during the intervention (Wind et al., 2008, Aarestrup et al., 2014, Potter et al., 2011, Jamelske and Bica, 2014, Bai et al., 2011).
3.4.3. Addressing context
18 studies explored the contextual factors (e.g., policy, socioeconomic status, school size) surrounding the implementation of the program (Bouck et al., 2011, Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Clarke et al., 2009, Muellmann et al., 2017, Hayes et al., 2019, Jorgensen et al., 2016, Jorgensen et al., 2014, Jamelske and Bica, 2014, Bai et al., 2011, Skinner et al., 2012, Yeo and Edwards, 2006, Potter et al., 2011, Hector et al., 2017).
3.4.4. Describing those in charge of delivering the intervention
15 studies investigated the challenges, successes and experiences of intervention providers (Muellmann et al., 2017, Hayes et al., 2019, Reinaerts et al., 2007a, Bouck et al., 2011, Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Jamelske and Bica, 2014, Bai et al., 2011, Yeo and Edwards, 2006, Jorgensen et al., 2014, Potter et al., 2011).
3.4.5. Investigating recipients of the intervention
9 studies reported the experiences, motivations and opinions of those exposed to the intervention (Aarestrup et al., 2014, Aarestrup et al., 2015, Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Lin and Fly, 2016, Potter et al., 2011).
3.4.6. Linking intervention outcomes to process evaluation findings
16 studies used the findings from the process evaluation to build explanations/reasoning about intervention outcomes (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Clarke et al., 2009, Jorgensen et al., 2016, Reinaerts et al., 2007a, Jamelske and Bica, 2014, Hector et al., 2017, Bouck et al., 2011, Wind et al., 2008, Lin and Fly, 2016, Coyle et al., 2009, Skinner et al., 2012, Yeo and Edwards, 2006).
3.5. Implementation of Snack-based FV Distribution Interventions
Five overarching themes emerged, including: benefits of snack-based FV distribution interventions; successes of, and challenges to the implementation; impact of, and implications for future programming.
3.5.1. Benefits of snack-based FV distribution interventions
All studies highlighted the value of FV distribution interventions as these programs provided children with free, equitable reach to healthy dietary choices (Aarestrup et al., 2014, Aarestrup et al., 2015, Gates et al., 2011, Reinaerts et al., 2007a, Potter et al., 2011, Hector et al., 2017). In particular, studies highlighted the benefits of program activities (e.g., kinesthetic lessons) (Wind et al., 2008, Gates et al., 2011), FV aesthetics (e.g., appearance) (Aarestrup et al., 2014, Aarestrup et al., 2015), and quality, quantity and variety of served FVs (Bouck et al., 2011, Potter et al., 2011), which were all positively associated with children’s degree of liking/enjoyment, and ultimately, their consumption of FVs. This was especially important in studies with limited exposure to FVs due to economic challenges, lack of nutrition knowledge (Bouck et al., 2011, White, 2006, Bai et al., 2011, Potter et al., 2011, Hector et al., 2017) or remoteness (Bouck et al., 2011, Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Skinner et al., 2012).
3.5.2. Successes of FV snack-based FV distribution interventions
Many aspects contributed to the success of FV distribution interventions including: participation of the school community; school characteristics; background knowledge; and parental engagement.
Participation of the school community, including principals and school staff, particularly teachers’ role modeling and positive attitudes was identified as being crucial to children’s readiness to adopt and sustain consuming FVs (Bere et al., 2006a, Bouck et al., 2011, Gates et al., 2011, Gates et al., 2016, Hayes et al., 2019, Reinaerts et al., 2007a, White, 2006, Bai et al., 2011, Potter et al., 2011, Yeo and Edwards, 2006). Identified strategies included teachers facilitating discussions of the served FVs, tasting FVs with children, and encouragement (Clarke et al., 2009, Reinaerts et al., 2007a, Bai et al., 2011).
School characteristics including size, pre-existing food policies or programs, and socio-demographic characteristics affected the implementation of the program. Schools with small size (i.e., fewer than 300 participants) (Jamelske and Bica, 2014), pre-existing food policies (Muellmann et al., 2017, Yeo and Edwards, 2006), programs (Hayes et al., 2019, Yeo and Edwards, 2006), and low percentage of children with special needs (Muellmann et al., 2017, Hayes et al., 2019) facilitated the implementation of the program.
Background knowledge was reported as a valuable resource in facilitating the implementation of the program. Previous experience in food service operation facilitated implementation in terms of ease of understanding of program procedures (Jamelske and Bica, 2014). Also, providing detailed and time savings guidelines on the implementation of the program (Wind et al., 2008, Jamelske and Bica, 2014, Jorgensen et al., 2014), and/or conducting a training workshop communicating the purpose and objectives of the program (Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Jorgensen et al., 2014) enabled the adoption, and consequently, the implementation of the program.
Parental engagement in the program facilitated the implementation of the program through ensuring the availability and accessibility of FVs at home. This, in turn, was associated with enhanced children’s consumption of FVs and the program’s overall success (Gates et al., 2011, Clarke et al., 2009, Hayes et al., 2019, Aarestrup et al., 2015, Bai et al., 2011, Hector et al., 2017). Identified strategies included teaching children about nutrition and health, food preparation demonstrations, serving as a role model, setting rules, providing rewards (Bai et al., 2011), and participating in program-guided child-parent activities (Wind et al., 2008, Jorgensen et al., 2016).
3.5.3. Challenges to snack-based FVs distribution interventions
Although all of the included studies were generally positive about FV distribution interventions, some key challenges were identified, including: lack of timely FV delivery from suppliers; limited funding; inadequate awareness about the program; insufficient teachers’ time; and food waste.
Lack of timely FV delivery from suppliers was a key barrier to implementation, despite suppliers’ prospect to support a good cause (i.e., timely supply, storage and delivery of discounted FVs to schools) (Aarestrup et al., 2014, Muellmann et al., 2017, Hayes et al., 2019, Hector et al., 2017). Factors such as lack of communication (Bouck et al., 2011, Aarestrup et al., 2014), low priority on the delivery company schedule (Bouck et al., 2011), remoteness, (Bouck et al., 2011, Aarestrup et al., 2014, Gates et al., 2012) seasonality, and/or business size (Aarestrup et al., 2014) contributed to FV lateness. Further, unforeseen weather circumstances often meant that FVs would be unavailable or of unacceptable quality (Bouck et al., 2011, Gates et al., 2012). In addition, delivery size was not perceived as convenient because of suppliers’ business size (Aarestrup et al., 2014). Identified strategies included serving dried, instead of fresh fruit (Potter et al., 2011), serving less desirable healthy choices (Bouck et al., 2011, Gates et al., 2012), adequate communication (Aarestrup et al., 2014, Aarestrup et al., 2015) or changing the distribution company (Bouck et al., 2011).
Limited funding had a negative impact on food type, program staff and planning, and acquisition of resources needed for implementation. For example, schools in remote locations are typically constrained by high costs of FVs and the inability to stretch limited funds by purchasing fresh FVs in bulk or at bulk prices, which ultimately impacts the quantity and quality of FVs offered (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Skinner et al., 2012). In such situations, dried fruit or fruit juice was most frequently served because of long shelf-life and ease of transportation (Bouck et al., 2011, Skinner et al., 2012). Limited funding was also linked to factors such as inadequate facilities for storage (i.e., refrigerator), limited space for preparation (i.e., sinks) (Gates et al., 2012, Gates et al., 2016), and/or lack of staff capacity (Bouck et al., 2011, Gates et al., 2012, Gates et al., 2016, Potter et al., 2011). The extra time needed for FV preparation not only led to an increased workload, but also affected other school duties. For example, the extra time in washing and cutting FVs (Bouck et al., 2011), and/or lack of school staff/volunteer capacity to coordinate the program (e.g., ordering, purchasing, preparing and delivering the snack) (Gates et al., 2012, Potter et al., 2011) led to serving whole fruit (e.g., bananas) rather than fruit requiring more preparation (e.g., pineapples), further limiting children’s exposure to a variety of FVs (Jamelske and Bica, 2014, Bai et al., 2011, Hector et al., 2017). Identified strategies included transferring FVs to nearby schools with extra cooler space, assistance from additional staff and children, and/or ordering prepackaged FVs (Potter et al., 2011).
Inadequate awareness about the program was recognized as a challenge to program implementation (Jamelske and Bica, 2014, Bai et al., 2011) despite “school ethos and environment” (e.g., policies or activities that promote healthy nutrition values and attitudes within school). This is because promotional activities (e.g., posters, announcements, events) were designed to increase awareness and create excitement about the program but were not required.
Insufficient teachers’ time was a barrier to the implementation of the program. In some cases, the amount of time teachers spent on the daily distribution of FVs was large (Aarestrup et al., 2014, Aarestrup et al., 2015, Reinaerts et al., 2007b). This included cutting up FVs, allocating time to eat at the “FV break”, and restoring order after children consumed FVs. This, in turn, led to disruption in teaching time, especially in classes of young children (Clarke et al., 2009). In addition to the daily distribution of FV workload, program curricular activities (e.g., lesson plans) (Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Jorgensen et al., 2014) and duration (e.g., 1-year) (Jorgensen et al., 2014) further limit the implementation of the program.
Food waste was another key barrier to the implementation of the program. The amount of waste was dependent on the popularity of FVs served. The less popular the FVs served, the more that was leftover. Therefore, fruit was purchased more frequently than vegetables (Jamelske and Bica, 2014, Bai et al., 2011, Hector et al., 2017) to avoid waste and maintain children’s interest in the program (Jamelske and Bica, 2014, Coyle et al., 2009, Yeo and Edwards, 2006, Potter et al., 2011). Other contributing factors to food waste were poor food quality because of remoteness, handling, and delivery issues (Bouck et al., 2011, Gates et al., 2011, Gates et al., 2012, Skinner et al., 2012) or receiving too much FVs (Bouck et al., 2011, He et al., 2012). Children sometimes felt that they did not receive enough FVs (Aarestrup et al., 2014, Aarestrup et al., 2015) yet others felt there was too much leftovers and discussed ways to reduce waste (e.g., sending extras home) (He et al., 2012). Additionally, food aesthetics (e.g., appearance) contributed to food waste. For instance, children were not allowed to eat the “cut up” FVs because teachers control the time of the FV break. This, in turn, caused enzymatic browning of the FVs (e.g., apple slices turning brown), and therefore children perceived the provided FVs as unappetizing to consume (Aarestrup et al., 2014). Identified strategies included coating FVs with lemon juice (Aarestrup et al., 2014), serving vegetables with dips (Bouck et al., 2011, Lin and Fly, 2016, Coyle et al., 2009), stop purchasing vegetables that were rejected by children (Coyle et al., 2009), sending extra FVs home with children/teachers (Bouck et al., 2011, Reinaerts et al., 2007a), serving leftover FVs another day (Bouck et al., 2011), donating FVs to food banks (Bouck et al., 2011), serving more than one FV snack a day (Potter et al., 2011), or cooking vegetables (Lin and Fly, 2016, Coyle et al., 2009).
3.5.4. Impact of the snack-based FV distribution interventions
All studies reported the beneficial effects of FV distribution interventions on children, and parents’ FV consumption and/or related behaviors. These include improved child focus on schoolwork (Gates et al., 2011, Hector et al., 2017), bringing fresh FVs from home (Hector et al., 2017), increased knowledge, awareness, preference for, and consumption of a variety of FVs (Gates et al., 2011, Clarke et al., 2009, White, 2006, Potter et al., 2011, Hector et al., 2017), and stimulating social interactions (Aarestrup et al., 2014, Aarestrup et al., 2015, He et al., 2012). Also, some studies reported the beneficial impacts of these programs on children’s physical and cognitive benefits, feeling full, and the care that school staff demonstrated (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Lin and Fly, 2016, Potter et al., 2011). Furthermore, improved children’s FV related-eating behaviors, such as asking parents to buy FVs (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Coyle et al., 2009, He et al., 2012) or coordinators to incorporate FV snack items into school meals (Jamelske and Bica, 2014) were also cited. Moreover, some studies reported that these programs extended their benefits to parents via potentially improving FV consumption (Clarke et al., 2009), influencing dietary purchasing practices (i.e., buying a variety of FVs) (Jamelske and Bica, 2014, Coyle et al., 2009), and reinforcing healthy dietary messages at home (Clarke et al., 2009) and schools (White, 2006).
3.5.5. Implications for future snack-based FV distribution interventions
Nearly all studies used process evaluation findings to generate suggestions and to develop recommendations regarding aspects of the intervention that could be adapted or modified to increase the chances of success of future programming (Supplementary Table C).
4. Discussion
The findings of this review contribute to the growing body of evidence of how best to inform the implementation design of intervention programs to promote children’s consumption of FVs. The results highlight the factors that are particularly important to the success of an intervention in this setting. These include participation of the whole school community, school staff training, involving parents within the school and home environment, and adapting the program to meet school needs and resources. Barriers to the implementation of school-based interventions include limited funding and insufficient teachers’ time due to other school priorities (i.e., crowded curriculum). Additionally, some programs could be perceived as too demanding or may gain insufficient support due to poor awareness, coordination, and communication between key stakeholders (teachers, school staff, suppliers, etc.).
All studies highlighted the benefits of FV distribution interventions in providing children with free, universal access to a variety of high-quality, FVs. For example, free distribution interventions were associated with children’s consumption of FVs because these programs provided all children, particularly economically disadvantaged children, with universal access to FVs (Bere et al., 2007). Research shows that food items most influenced by income are FVs (Ricciuto et al., 2006). Therefore, introduction of healthy foods in the context of a universal school food program has the potential to increase children’s intake of FVs, independent of family income (Riediger et al., 2007). Universal access was also seen to lower the risk of stigmatization and increased reach, which has been previously demonstrated with similar programs (Hector et al., 2017, Russell et al., 2008). However, when a subsidized version of the same program was implemented, the program was not associated with children’s consumption because FVs were provided at a cost to parents, which increased the accessibility but not the availability, indicating the role of availability and accessibility of FVs in promoting children’s consumption (Bere et al., 2006a).
Increasing the availability and accessibility to a variety FVs are known positive environmental mediators to consider when evaluating the impacts of these programs. Changing children’s FV consumption (Yeo and Edwards, 2006, Bere et al., 2006b), parent consumption (Clarke et al., 2009) and related behaviors (e.g., increasing children’s preferences, awareness, and attitudes (Hector et al., 2017), social norms and role modelling (Aarestrup et al., 2014), increasing independent academic work (Potter et al., 2011), and changing parent dietary practices (Coyle et al., 2009) are all beneficial effects that have been reported previously in similar school food programming interventions (Reinaerts et al., 2007b, Reinaerts et al., 2008, Bere et al., 2007, Bere et al., 2006b, Wells and Nelson, 2005, Easwaramoorthy, 2012, Te Velde et al., 2008, Roccaldo et al., 2017, Story et al., 2000, Bere and Klepp, 2005, Addessi et al., 2005). Health-promoting activities in school settings have the potential not only to enhance the health and well-being of children (Baxter et al., 1997, Veugelers and Fitzgerald, 2005) but also to reach a large number of parents, siblings and extended families, regardless of their ethnicity, socioeconomic background, and/or nutritional status, thus reducing social inequalities (Knai et al., 2006).
Children’s dietary practices are a function of varied environments (e.g., familial influences, school, community, and policy involvement) (Davison and Birch, 2001, Krolner et al., 2011). This is consistent with most frequently applied theoretical frameworks for behavior change: the socio-ecological model (Davison and Birch, 2001) and social cognitive theory (SCT) (Bandura, 2004). These two theories postulate that dietary behavior is a function of environmental factors (e.g., barriers, facilitators) and personal factors (e.g., preference) that affect each other in constant reciprocal relationships (Davison and Birch, 2001).
At the home-level, children’s consumption was positively associated with their parents’ consumption (Rasmussen et al., 2006, Ovrum and Bere, 2014) because parents’ food preference and knowledge affect the availability and accessibility of FVs at home (Patrick and Nicklas, 2005). Although several studies attempted to engage parents (Bere et al., 2006a, Jorgensen et al., 2016, Te Velde et al., 2008), there was likely a proportion of children in disadvantaged areas whose parents would not provide FVs because of lack of awareness, high cost, limited access or resources (Gates et al., 2011, Gates et al., 2012, Jorgensen et al., 2016, Skinner et al., 2012, Hector et al., 2017), social-cultural beliefs (Muellmann et al., 2017, Hayes et al., 2019), socio-economic status (Wind et al., 2008, Jorgensen et al., 2016), and lack of time (Jorgensen et al., 2016). As parental influence is regarded as essential for children’s dietary behavior, future interventions should explore potential avenues of incorporating parental components into the existing school structure and systems by identifying effective mechanisms to reach parents (e.g., family tasting events).
At the school level, the greater the school support, the better the implementation and outcomes achieved. Teachers were receptive to the intervention because there was a need; otherwise they would regard it as an additional workload (Jorgensen et al., 2014, Hector et al., 2017). Perceiving the relative advantage of the intervention likely allowed for better adoption, supported buy-in, and facilitated implementation (Durlak and DuPre, 2008, Rogers, 2003). However, lack of and/or insufficient teachers’ time was identified as a key barrier to the delivery of the program in classrooms (Gates et al., 2011, Clarke et al., 2009, Reinaerts et al., 2007a, Aarestrup et al., 2015, Jorgensen et al., 2014). For instance, lack of curricular activity implementation in both the Netherlands and Spain is the result of the workload placed on teachers implementing the program (Wind et al., 2008). In addition, teachers’ implementation was also challenged by intervention duration (e.g., 1-year) (Jorgensen et al., 2014). Deterioration in implementation over time was a noted challenge demonstrated previously in similar interventions (Wind et al., 2008, Aarestrup et al., 2014, Aarestrup et al., 2015, Jorgensen et al., 2014) despite evidence that longer interventions (i.e., adequate time and duration) are more effective at promoting health and dietary behavior change than those with only one or a few sessions (Wang and Stewart, 2013, Ciliska et al., 2000, Hoelscher et al., 2002).
Health promoters often encounter the problem of motivating schools to participate in such programs because of time constraints. Therefore, school-based interventions that require minimal classroom or teacher time, such as FV distribution, are considered viable (Yeo and Edwards, 2006, Reinaerts et al., 2007b). For example, Reinaerts and colleagues found that teachers perceived distribution of FVs as less social pressure and that did not require effort to implement (Reinaerts et al., 2007a). This is consistent with Diffusion of Innovation Theory (DOI), where initiatives that are perceived as simple (easy to use and understand) and can be conducted on a limited-basis are often more readily adopted (Rogers, 2003).
On the other hand, Aarestrup and colleagues reported that teachers are already overwhelmed with a demanding academic curriculum and the added responsibility of delivering a school food program could prove to be challenging. The authors found that teachers’ incapability to deliver the program as intended during the school day contributed to low FVs aesthetics/appearance (e.g., brown apples) and ultimately food waste as children considered FVs as unappetizing to eat (Aarestrup et al., 2014). This indicates the difficulty in designing interventions that are applicable to all schools since each school is context-specific. However, several studies suggested a number of recommendations. First, using trained research staff to implement programs has been proposed as an alternative; however, it has been considered an unrealistic option because of limited resources (Gates et al., 2011, Reinaerts et al., 2007a). A second option, integrating the program into the school curriculum (Aarestrup et al., 2014), will not only ensure children can learn about and consume FVs, but also alleviates teacher burden, as it would become part of their duties and not compete with other curriculum opportunities. Third, providing detailed guidelines on program implementation (Aarestrup et al., 2014, Jorgensen et al., 2014) will improve the efficiency and effectiveness of the program and also motivate program staff to implement the intervention with high fidelity.
The importance of training for teachers’ level of implementation is unclear (Sy and Glanz, 2008). Research has shown inconsistent results, with some studies (Jorgensen et al., 2014, Datnow and Castellano, 2000) indicating that teachers value autonomy in the implementation of the program, while other studies demonstrate the importance of training to fidelity of implementation, particularly when curricular innovation is involved (Roccaldo et al., 2017, Story et al., 2000). Therefore, future studies could benefit from involving teachers in the decision of intervention participation as a feeling of ownership among intervention providers is vital for implementation (Durlak and DuPre, 2008). In addition to teachers’ training, the importance of prior experience and/or background knowledge in food service operation was also highlighted. Studies have recognized the skills and knowledge needed in the handling, management, and coordination of a food service operation (e.g., purchasing, financial management and human resources) when implementing these types of programs (Jamelske and Bica, 2014, Tsui et al., 2013). This is because these logistic supports would provide school staff with the necessary tools and knowledge to ensure that expectations are managed effectively (Durlak and DuPre, 2008, Carroll et al., 2007).
Furthermore, a allowing school staff (e.g., teachers) discretion to tailor the intervention to deal with circumstances as they best fit in with school context (e.g., timetables (Muellmann et al., 2017, Hayes et al., 2019, Jorgensen et al., 2014), children with special needs (Muellmann et al., 2017, Hayes et al., 2019)) will maximize the fidelity of the intervention and support its continuation (Datnow and Castellano, 2000). This is because innovations are seldom implemented exactly as the developers of the interventions intended them to be (Datnow and Castellano, 2000). This is consistent with Implementation Theory (Corbett and Lennan, 2003), which postulates that an on-going customization to the program may contribute to the success of the implementation and that some adaptation regularly occurs and should be evaluated and modified to meet the changing environment/context (Durlak and DuPre, 2008, Corbett and Lennan, 2003, Chambers et al., 2013).
Increasing the awareness about the program was positively correlated with children’s interests to participate in the program (Jamelske and Bica, 2014, Potter et al., 2011). Studies have shown that labeling and signage on school premises affect not only children’s food choices at schools, but also food purchase requests at home (e.g., asking parents to buy FVs) (Hastings, 2004). However, these promotional activities were typically inadequate because of staff time and/or resources needed to mount sufficiently intensive efforts to influence children’s consumption of FVs (Bai et al., 2011). Therefore, effective promotional campaigns that have been utilized by grocery stores (i.e., advertisements, displays) (Bennett, 1998) are needed to affirm positive messages and to create an environment in which FV consumption is a norm in both school and home environments.
At the community level, children reported being motivated to eat healthier; however, the nutrition environment in remote, isolated, northern communities was not conducive to behavior change (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Skinner et al., 2012). For example, the distribution of FVs within the school environment may have provided children with an opportunity to consume FVs, but this does not change the fact that availability and accessibility of food at the community-level makes it extremely challenging, if not impossible to make healthy dietary choices (Gates et al., 2012). This emphasizes the need for community-based interventions (e.g., community gardens, group purchasing) to improve access to affordable, healthy food choices in remote locations.
The prospect of food providers to make connections with the school community acted as a facilitator to delivering FVs to schools (Aarestrup et al., 2014, Aarestrup et al., 2015). Previous farm-to-school programs have found that the primary motivation for farmers to participate in these programs included enhancing economic incentives (e.g., diversifying their marketing strategies) (Izumi et al., 2010b, Joshi et al., 2008), increased market demand (Webb et al., 2013), fostering healthy eating habits among children, supporting the local economy (Izumi et al., 2010b, Izumi et al., 2010a, Joshi et al., 2008), and solidifying good public relations (Gregoire and Strohbehn, 2002, Izumi et al., 2006, Marshall et al., 2012). Furthermore, schools benefit from associated savings of purchasing FVs (Webb et al., 2013) and the ultimate beneficiary is the child, whose increased consumption will contribute to better long-term health. However, lack of timely FV delivery was identified as a barrier to the delivery of FVs to schools because of concerns related to limited capacity for supplying, predictability of FV crops, communication and ordering (Aarestrup et al., 2014, Aarestrup et al., 2015), and remoteness (Bouck et al., 2011). Therefore, one promising marketing mechanism is dealing with “major or large scale” value chain (VC) suppliers than traditional supply chains (Webb et al., 2013, Marshall et al., 2012), which include partnerships that contribute to the value of all participants involved, procuring the volume and type of food required for large schools (Conner et al., 2011), and achieving economies of scale in food safety documentation and food costs (Powell and Wittman, 2017, McNicholl et al., 2018). This, however, would require policy changes resulting in significant resources in terms of funding, infrastructure, and staff.
Sustained support for school food programs at the policy-level is a key to successful and sustainable school food programming. Free FV distribution interventions have proven to be effective at increasing children’s consumption of FVs (Bouck et al., 2011, Gates et al., 2011, Gates et al., 2012, Reinaerts et al., 2007b, Wells and Nelson, 2005, Skinner et al., 2012) but most studies have identified continuous funding as a necessity to maintain them at the level required to be effective (Hayes et al., 2019, Reinaerts et al., 2007a, Bai et al., 2011, Potter et al., 2011). Specifically, studies have found limited funding to address food costs, inadequate facilities (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016), labouring (Gates et al., 2011, Gates et al., 2012, Gates et al., 2016, Potter et al., 2011), costs associated with serving FVs (Potter et al., 2011), and type of FVs served (Skinner et al., 2012, Gates et al., 2012). For instance, apples, bananas and oranges were most frequently served because they are affordable. Also, “whole” instead of “chopped” fruit was served to reduce waste, increase shelf-life, and reduce costs associated with chopping FVs. Thus, if steps are taken to improve the variety and presentation of FVs, their labor and food costs would be beyond what the program is currently providing, and additional financial resources would be required to make school facilities adequate to store, prepare and serve FVs in a safe and appealing manner.
For example, the “School Fruit Scheme” was passed as a law/policy and was implemented in all Norwegian schools because the political party supporting the program was in power. However, when the political power shifted in parliament, funding for the program was ended and the law was abolished (Muellmann et al., 2017). This is because government funding often falls short on funding initiatives related to school food programming due to competing priorities (Martorell, 2017). Therefore, adequate policies to introduce mandated standards to make the “healthier choice” easier for children should be the focus of future initiatives, as a positive association exists between policies aimed at improving the food environment in schools and outcomes such as decreased consumption of unhealthful snacks (Asada et al., 2016). This is consistent with Evans and colleagues who found that increasing the availability and accessibility of FVs through stricter nutritional guidelines/policies within the school environment can be effective at changing children’s food choices (Evans et al., 2012). This illustrates the necessity of provision of continuous funds for programs to be effective and sustainable.
This systematic review has several key strengths. First, we utilized a rigorous and comprehensive search strategy of a wide range of bibliographic databases. Second, the use of a broadly defined process evaluation served the exploratory goal of this review, in which we aimed at inclusion rather than exclusion. Third, this is the first systematic review to examine the implementation practices and processes of snack-based FV distribution interventions. This review also has limitations. First, there is a possibility that some studies were missed because the term “process evaluation” was not a MeSH term; however, this is unlikely to happen as both keywords and subject-heading databases were searched. Second, gray literature was not included because the primary focus was on studies with rigorous study designs; a thorough search of gray literature might have provided additional evidence.
5. Conclusions
This review sought to obtain an in-depth understanding of the benefits and impacts of snack-based FV distribution interventions, successes of and challenges to the implementation, and possible solutions for the implementation practices and processes of future programming. While studies have identified many challenges that must be considered to maintain the reach, fidelity, and feasibility of the program, they also identified many opportunities to maximize the program’s potential of creating an enabling environment within which positive impacts on children’s food literacy and dietary habits can be promoted.
Evidence from process evaluations can help us understand whether changes in FV consumption are due to the interventions, or the ways in which the interventions are implemented. Future research should not only examine intervention effectiveness, but should consider factors such as sustainability, cost-effectiveness, and the implementation practices and processes of these program. From a research perspective, accounting for the socio-ecological contexts, providing a description of those in charge of delivering and receiving the intervention, in addition to the use of a theoretical framework and employment of rigorous qualitative methods, will generate a comprehensive understanding of the different aspects of the implementation process. In other words, process evaluation should be a piece of research in its own right. From a practical perspective, incorporating the program into the school curriculum and policy, utilizing a “whole-of- school” approach, in addition to recognizing the skills and knowledge needed, will optimize the fidelity of the program. This review offers researchers, child educators, and policymakers valuable recommendations on how to implement snack-based FV distribution interventions in schools for improving children’s overall health and well-being.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgements
The authors would like to thank Bahar Entezari and Karen Stewart-Kirk for their dedicated work in screening the abstracts and full-texts of the studies, and assessing the quality of the included studies, respectively. Special thanks also goes to Karen Stewart-Kirk for her assistance in coding the studies. We would also like to thank librarian Roxanne Isard for advising on the search strategy. This research did not receive any grant from funding agencies in the public, commercial, or not-for-profit sectors. There are no conflicts of interests to declare. Ethical approval was not required as this study did not collect original data.
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.pmedr.2020.101281.
Appendix A. Supplementary data
The following are the Supplementary data to this article:
References
- Aarestrup A., Krolner R., Suldrup-Jorgensen T., Evans A., Due P., Tjornhoj-Thomsen T. Implementing a free school-based fruit and vegetable programme: barriers and facilitators experienced by pupils, teachers and produce suppliers in the Boost study. BMC Public Health. 2014;14(146):1–15. doi: 10.1186/1471-2458-14-146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aarestrup A., Suldrup Jorgensen T., Jorgensen S.E., Hoelscher D.M., Due P., Krolner R. Implementation of strategies to increase adolescents' access to fruit and vegetables at school: Process evaluation findings from the Boost study. BMC Public Health. 2015;15(86) doi: 10.1186/s12889-015-1399-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Addessi E., Galloway A.T., Visalberghi E., Birch L. Specific social influences on the acceptance of novel foods in 2-5-year-old children. Appetite. 2005;45(3):264–271. doi: 10.1016/j.appet.2005.07.007. [DOI] [PubMed] [Google Scholar]
- Asada Y., Chriqui J., Chavez N., Odoms-Young A., Handler A. USDA snack policy implementation: Best practices from the front lines, United States, 2013–2014. Prev. Chronic Dis. 2016;13:E79. doi: 10.5888/pcd13.160023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Auerbach C., Silverstein L. NewYork University Press; New York: 2003. Qualitative Data: An Introduction to Coding and Analysis. [Google Scholar]
- Bai Y., Feldman C., Wunderlich S.M., Aletras S. Process evaluation of the Fresh Fruit and Vegetable Program implmentation in a NewJersey elementary school. J. Child Nutr. Manag. 2011;35(2):1–10. [Google Scholar]
- Bandura A. Health promotion by social cognitive means. Health Educ. Behav. 2004;31:143–164. doi: 10.1177/1090198104263660. [DOI] [PubMed] [Google Scholar]
- Baranowski T., Stables G. Process evaluations of the 5-a-Day projects. Health Edu. Behav. 2000;27(2):157–166. doi: 10.1177/109019810002700202. [DOI] [PubMed] [Google Scholar]
- Baxter A.P., Milner P.C., Hawkins S., Leaf M., Simpson C., Wilson K.V. The impact of heart health promotion on coronary heart disease lifestyle risk factors in schoolchildren. Public Health. 1997;111(4):231–237. doi: 10.1038/sj.ph.1900358. [DOI] [PubMed] [Google Scholar]
- Bennett R. Customer recall of promotional displays at supermarket checkouts: arousal, memory and waiting in queues. Int. Rev. Retail Distribut. Consum. Res. 1998;8(4):383–398. doi: 10.1080/095939698342724. [DOI] [Google Scholar]
- Bere E., Klepp K. Changes in accessibility and preferences predict children’s future fruit and vegetable intake. Int. J. Behav. Nutr Phys. Act. 2005;2(15):1–8. doi: 10.1186/1479-5868-2-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bere E., Veierod M.B., Bjelland M., Klepp K.I. Free school fruit-sustained effect 1 year later. Health Educ. Res. 2006;21(2):268–275. doi: 10.1093/her/cyh063. [DOI] [PubMed] [Google Scholar]
- Bere E., Veierod M.B., Bjelland M., Klepp K.I. Outcome and process evaluation of a Norwegian school-randomized fruit and vegetable intervention: Fruits and Vegetables Make the Marks (FVMM) Health Educ. Res. 2006;21(2):258–267. doi: 10.1093/her/cyh062. [DOI] [PubMed] [Google Scholar]
- Bere E., Veierod M., Skare Q., Klepp K. Free school fruit-sustained effect three years later. Int. J. Behav. Nutr. Phys. Act. 2007;4(5):1–6. doi: 10.1186/1479. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blanchette L., Brug J. Determinants of fruit and vegetable consumption among 6–12-year-old children and effective interventions to increase consumption. J. Hum. Nutr. Diet. 2005;18(6):431–443. doi: 10.1111/j.1365-277x.2005.00648.x. [DOI] [PubMed] [Google Scholar]
- Bouck, M.S., St Onge, R., He, M., Beynon, C., Lemieux, S., Khoshaba, L., et al. Northern Fruit and Vegetable Pilot Program: a process evaluation. Can J Diet Pract Res. Revue Canadienne de la Pratique et de la Recherche en Dietetique 2011;72(1):14–22. 10.3148/72.1.2011.14. [DOI] [PubMed]
- Braun V., Clarke V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006;3:77–101. [Google Scholar]
- Carroll C., Patterson M., Wood S., Booth A., Rick J., Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40) doi: 10.1186/1748-5908-2-40. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chambers D., Glasgow R., Stange K. The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implment Sci. 2013;8(117):1–11. doi: 10.1186/1748-5908-8-117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ciliska D., Miles E., O’Brien M., Turl C., Hale Tomasik H., D’onovan U, Effectiveness of community-based interventions to increase fruit and vegetable consumption. J. Nutr. Educ. 2000;32:341–352. [Google Scholar]
- Clarke A.M., Ruxton C.H.S., Hetherington L., O'Neil S., McMillan B. School intervention to improve preferences for fruit and vegetables. Nutr. Food Sci. 2009;39(2):118–127. doi: 10.1108/00346650910943226. [DOI] [Google Scholar]
- Colapinto C., Graham J., St-Pierre S. Trends and correlates of frequency of fruit and vegetable consumption, 2007–2014. Health Rep. 2018;29(1):9–14. [PubMed] [Google Scholar]
- Conner D., Nowak A., Berkenkamp J., Feenstra G., Van Soelen Kim J, Liquori T. Value Chains for Sustainable Procurement in Large School Districts: Fostering Partnerships. J. Agri. Food Sys. Comm. Dev. 2011;1(4):1–14. doi: 10.5304/jafscd.2011.014.005. [DOI] [Google Scholar]
- Corbett T., Lennan M. The Urban Institute Press; Washington, DC: 2003. Implmentation Studies: from Policy to Action. [Google Scholar]
- Coyle K., Potter S., Schneider D., May G., Robin L., Seymour J. Distributing free fresh fruit and vegetables at school: Results of a pilot outcome evaluation. Public Health Rep. 2009;124(5):660–669. doi: 10.1177/003335490912400508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Datnow A., Castellano M. Teachers’ responses to success for all: How beliefs, experiences, and adaptations shape implmentation. Am. Educ. Res. J. 2000;37(3):775–799. [Google Scholar]
- Davison K., Birch L. Childhood overweight: A contextual model and recommendations for future research. Obesity Rev. 2001;2(3):159–171. doi: 10.1046/j.1467-789x.2001.00036.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- de Sa J., Lock K. Will European agricultural policy for school fruit and vegetables improve public health? A review of school fruit and vegetable programmes. Euro. J. Public Health. 2008;18(6):558–568. doi: 10.1093/eurpub/ckn061. [DOI] [PubMed] [Google Scholar]
- DeCosta P., Moller P., Frost M.B., Olsen A. Changing children's eating behaviour - A review of experimental research. Appetite. 2017;113:327–357. doi: 10.1016/j.appet.2017.03.004. [DOI] [PubMed] [Google Scholar]
- Dennison B., Rockwell H., Baker S. Fruit and vegetable intake in young children. J. Am. Coll. Nutr. 1998;17(4):371–378. doi: 10.1080/07315724.1998.10718778. [DOI] [PubMed] [Google Scholar]
- Durlak J.A., DuPre E.P. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am. J. Commun. Psychol. 2008;41(3–4):327–350. doi: 10.1007/s10464-008-9165-0. [DOI] [PubMed] [Google Scholar]
- Easwaramoorthy, M. Feeding our Future: The first-and second-year evaluation; 2012.
- Evans C.E., Christian M.S., Cleghorn C.L., Greenwood D.C., Cade J.E. Systematic review and meta-analysis of school-based interventions to improve daily fruit and vegetable intake in children aged 5 to 12 y. Am. J. Clin. Nutr. 2012;96(4):889–901. doi: 10.3945/ajcn.111.030270. [DOI] [PubMed] [Google Scholar]
- Fleuren M., Wiefferink K., Paulussen T. Determinants of innovation within health care organizations: Literature review and Delphi study. Int. J. Qual. Health Care. 2004;16(2):107–123. doi: 10.1093/intqhc/mzh030. [DOI] [PubMed] [Google Scholar]
- Garriguet D. Canadian’s eating habits. Health Rep. 2007;18(2):17–32. [PubMed] [Google Scholar]
- Gates, A., Hanning, R.M., Gates, M., McCarthy, D., Tsuji, L.J.S. 2012. Inadequate nutrient intakes in youth of a remote first nation community: challenges and the need for sustainable changes in program and policy. ISRN Public Health 2012;2012:1–5. 10.5402/2012/504168. [DOI]
- Gates A., Hanning R.M., Gates M., Isogai A.D., Metatawabin J., Tsuji L.J.S. A School nutrition program improves vegetable and fruit knowledge, preferences, and exposure in First Nation youth. Open Nutr. J. 2011;5:1–6. [Google Scholar]
- Gates A., Hanning R.M., Gates M., Stephen J., Tsuji L.J.S. Four-year evaluation of a healthy school snack program in a remote first nations community. Health Behav. Pol. Rev. 2016;3(3):226–237. doi: 10.14485/hbpr.3.3.4. [DOI] [Google Scholar]
- Glasgow R., Vogt T., Boles S. Evaluating the public health impact of health promotion interventions: The RE-AIM framework. Am. J. Public Health. 1999;89(9):1322–1327. doi: 10.2105/ajph.89.9.1322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green J., Willis K., Hughes E., Small R., Welch N., Gibbs L. Generating best evidence from qualitative research: the role of data analysis. Aust. N. Z. J. Public Health. 2007;31(6):545–550. doi: 10.1111/j.1753-6405.2007.00141.x. [DOI] [PubMed] [Google Scholar]
- Gregoire M., Strohbehn C. Benefits and obstacles to purchasing food from local growers and producers. J. Child Nutr. Manag. 2002;26(2):1–10. [Google Scholar]
- Hastings G. Does Food Promotion Influence Children? A Systematic Review of the Evidence: London, UK; 2004.
- Hayes C.B., O'Shea M.P., Foley-Nolan C., McCarthy M., Harrington J.M. Barriers and facilitators to adoption, implementation and sustainment of obesity prevention interventions in schoolchildren- A DEDIPAC case study. BMC Public Health. 2019;19(1):198. doi: 10.1186/s12889-018-6368-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- He M., Beynon C.E., Gritke J.L., Henderson M.L., Kurtz J.M., Sangster Bouck M. Children's perceptions of the Northern Fruit and Vegetable Program in Ontario, Canada. J. Nutr. Edu. Behav. 2012;44(6):592–596. doi: 10.1016/j.jneb.2010.09.014. [DOI] [PubMed] [Google Scholar]
- Hector D., Edwards S., Gale J., Ryan H. Achieving equity in Crunch&Sip((R)): A pilot intervention of supplementary free fruit and vegetables in NSW classrooms. Health Promot. J. Austr. 2017;28(3):238–242. doi: 10.1071/HE16095. [DOI] [PubMed] [Google Scholar]
- Hoelscher D., Evans A., Parcel G., Kelder S. Designing effective nutrition interventions for adolescents. J. Am. Diet Assoc. 2002;102:S52–S63. doi: 10.1016/s0002-8223(02)90422-0. [DOI] [PubMed] [Google Scholar]
- Izumi B.T., Rostant O.S., Moss M.J., Hamm M.W. Results from the 2004 Michigan farm-to-school survey. J. Sch. Health. 2006;76(5):169–174. doi: 10.1111/j.1746-1561.2006.00090.x. [DOI] [PubMed] [Google Scholar]
- Izumi B.T., Alaimo K., Hamm M.W. Farm-to-school programs: perspectives of school food service professionals. J. Nutr. Educ. Behav. 2010;42(2):83–91. doi: 10.1016/j.jneb.2008.09.003. [DOI] [PubMed] [Google Scholar]
- Izumi B.T., Wynne Wright D., Hamm M.W. Market diversification and social benefits: Motivations of farmers participating in farm to school programs. J. Rural Stud. 2010;26(4):374–382. doi: 10.1016/j.jrurstud.2010.02.002. [DOI] [Google Scholar]
- Jamelske E., Bica L. The USDA Fresh Fruit and Vegetable Program: A case study of implementation and consumption in Wisconsin. J. Child Nutr. Manag. 2014;38(2):1–8. [Google Scholar]
- Jorgensen S., Jorgensen T., Aarestrup A., Due P., Krolner R. Parental involvement and association with adolescents' fruit and vegetable intake at follow-up: Process evaluation results from the multi-component school-based Boost intervention. Int. J. Behav. Nutr. Phys. Act. 2016;13(112):1–16. doi: 10.1186/s12966-016-0435-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jorgensen T., Krolner R., Aarestrup A., Tjornhoj-Thomsen T., Due P., Rasmussen M. Barriers and facilitators for teachers' implementation of the curricular component of the Boost intervention targeting adolescents' fruit and vegetable intake. J. Nutr. Educ. Behav. 2014;46(5):e1–e8. doi: 10.1016/j.jneb.2014.06.003. [DOI] [PubMed] [Google Scholar]
- Joshi A., Azuma A.M., Feenstra G. Do farm-to-school programs make a difference? Findings and future research needs. J. Hunger Env. Nutr. 2008;3(2–3):229–246. doi: 10.1080/19320240802244025. [DOI] [Google Scholar]
- Knai C., Pomerleau J., Lock K., McKee M. Getting children to eat more fruit and vegetables: A systematic review. Prev. Med. 2006;42(2):85–95. doi: 10.1016/j.ypmed.2005.11.012. [DOI] [PubMed] [Google Scholar]
- Krolner P., Rasmussen M., Brug J., Klepp K., Wind M., Due P. Determinants of fruit and vegetable consumption among children and adolesecents: a review of the literature. Part II: Qualitative studies. Int. J. Behav. Nutr. Phys. Act. 2011;8(112):1–38. doi: 10.1186/1479-5868-8-112. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Libman K. Growing youth growing food: how vegetable gardening influences young people's food consciousness and eating habits. Appl. Environ. Educ. Comm. 2007;6(1):87–95. doi: 10.1080/15330150701319388. [DOI] [Google Scholar]
- Lin Y-C, Fly AD. Student feedback to improve the United States Department of Agriculture Fresh Fruit and Vegetable Program. Nutr Res Pract 2016;10(3).10.4162/nrp.2016.10.3.321. [DOI] [PMC free article] [PubMed]
- Linnan L., Steckler A. Jossey-Boss; San Fransisco: 2002. Process evaluation for public health intervention and research: An overview. [Google Scholar]
- Margolin A., Goto K., Wolff C., Bianco S. Let’s talk food: Elementary school students’ perceptions of school and home food environment and the impact of the Harvest of the Month Program on their dietary attitudes and behaviors. Int. J. Child Youth Fam. Stud. 2018;8(3/4):154–167. doi: 10.18357/ijcyfs83/4201718075. [DOI] [Google Scholar]
- Marshall C., Feenstra G., Zajfen V. Increasing access to fresh, local produce: Building values-based supply chains in San Diego Unified School District. Childhood Obes. 2012;8(4):388–391. doi: 10.1089/chi.2012.0032. [DOI] [PubMed] [Google Scholar]
- Martorell, H. 2017. Canadian policy interventions supporting healthy eating in schools. Food: Locally Embedded Globally Engaged (FLEdGE) and Food Secure Canada. 1–14.
- McAlister A., Lee D., Ehlert K., Kajfez R., Faber C., Kennedy M. Qualitative coding: An approach to assess inter-rater reliability. Am. Soc. Eng. Educ. 2017:1–9. [Google Scholar]
- McNicholl S., Wittman H., Kirk S., Engler-Stringer R., Hernandez K. The case for a Canadian national school food program. Can. Food Stud. / La Revue canadienne des études sur l'alimentation. 2018;5(3):208–229. doi: 10.15353/cfs-rcea.v5i3.260. [DOI] [Google Scholar]
- Merriam, S.B. 2009. Qualitative research: A guide to design and implmentation San Fransisco: Jossey-Bass.
- Minaker L., Hammond D. Low frequency of fruit and vegetable consumption among Canadian youth: Findings from the 2012/2013 Youth Smoking Survey. J. Sch. Health. 2016;86(2):135–142. doi: 10.1111/josh.12359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moher, D., Liberati, A., Tetzlaff, J., Altman, D., Group TP. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLos Med 2009;6(7).10.1371/. [DOI] [PMC free article] [PubMed]
- Muellmann S., Steenbock B., De Cocker K., De Craemer M., Hayes C., O'Shea M.P. Views of policy makers and health promotion professionals on factors facilitating implementation and maintenance of interventions and policies promoting physical activity and healthy eating: results of the DEDIPAC project. BMC Public Health. 2017;17(1):932. doi: 10.1186/s12889-017-4929-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nili A., Tate M., Barros A. A critical analysis of inter-coder reliability methods in information systems research. Aust. Conf. Inf. Sys. 2017:1–11. [Google Scholar]
- Oakley A., Strange V., Bonell C., Allen E., Stephenson Team RS J. Process evaluation in randomized controlled trials of complex interventions. Br. Med. J. 2006;332:413–416. doi: 10.1136/bmj.332.7538.413. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ovrum A., Bere E. Evaluating free school fruit: results from a natural experiment in Norway with representative data. Public Health Nutr. 2014;17(6):1224–1231. doi: 10.1017/S1368980013002504. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patrick H., Nicklas T. A review of family and social determinants of children’s eating patterns and diet quality. J. Am. Coll. Nutr. 2005;24(2):83–92. doi: 10.1080/07315724.2005.10719448. [DOI] [PubMed] [Google Scholar]
- Polsky J., Garriguet D. Changes in vegetable and fruit consumption in Canada between 2004 and 2015. Health Rep. 2020;31(4):3–12. doi: 10.25318/82-003-x202000400001-eng. [DOI] [PubMed] [Google Scholar]
- Potter S., Schneider D., Coyle K., May G., Robin L., Seymour J. What works? Process evaluation of a school-based fruit and vegetable distribution program In Mississippi. J. Sch. Health. 2011;81(4):202–211. doi: 10.1111/j.1746-1561.2010.00580.x. [DOI] [PubMed] [Google Scholar]
- Powell L.J., Wittman H. Farm to school in British Columbia: Mobilizing food literacy for food sovereignty. Agric. Human Values. 2017;35(1):193–206. doi: 10.1007/s10460-017-9815-7. [DOI] [Google Scholar]
- Critical Appraisal Skills Programme (CASP). Qualitative Checklist 2018.https://casp-uk.net/wp-content/uploads/2018/01/CASP-Qualitative-Checklist-2018.pdf.
- Rasmussen M., Krolner R., Klepp K.I., Lytle L., Brug J., Bere E. Determinants of fruit and vegetable consumption among children and adolescents: a review of the literature. Part I: Quantitative studies. Int. J. Behav. Nutr. Phys. Act. 2006;3(22):1–19. doi: 10.1186/1479-5868-3-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reinaerts E., De Nooijer J., De Vries N. Fruit and vegetable distribution program versus a multicomponent program to increase fruit and vegetable consumption: which should be recommended for implmentation? J. Sch. Health. 2007;77(10):679–686. doi: 10.1111/j.1746-1561.2007.00251.x. [DOI] [PubMed] [Google Scholar]
- Reinaerts E., de Nooijer J., Candel M., de Vries N. Increasing children's fruit and vegetable consumption: distribution or a multicomponent programme? Public Health Nutr. 2007;10(9):939–947. doi: 10.1017/S1368980007665495. [DOI] [PubMed] [Google Scholar]
- Reinaerts E., Crutzen R., Candel M., De Vries N.K., De Nooijer J. Increasing fruit and vegetable intake among children: Comparing long-term effects of a free distribution and a multicomponent program. Health Educ. Res. 2008;23(6):987–996. doi: 10.1093/her/cyn027. [DOI] [PubMed] [Google Scholar]
- Ricciuto L., Tarasuk V., Yatchew A. Socio-demographic influences on food purchasing among Canadian households. Eur. J. Clin. Nutr. 2006;60(6):778–790. doi: 10.1038/sj.ejcn.1602382. [DOI] [PubMed] [Google Scholar]
- Riediger N.D., Shooshtari S., Moghadasian M.H. The influence of sociodemographic factors on patterns of fruit and vegetable consumption in Canadian adolescents. J. Am. Diet Assoc. 2007;107(9):1511–1518. doi: 10.1016/j.jada.2007.06.015. [DOI] [PubMed] [Google Scholar]
- Roccaldo R., Censi L., D'Addezio L., Berni Canani S., Gennaro L. A teachers' training program accompanying the “School Fruit Scheme” fruit distribution improves children's adherence to the Mediterranean diet: an Italian trial. Int. J. Food Sci. Nutr. 2017;68(7):887–900. doi: 10.1080/09637486.2017.1303826. [DOI] [PubMed] [Google Scholar]
- Rogers E.M. NewYork Free Press; NewYork: 2003. Diffusion of innovation. [Google Scholar]
- Rossi P., Lipsey M., Freeman H. 7th edition ed. Sage Publications; Thousands Oaks, CA: 2004. Evaluation: A Systematic Approach. [Google Scholar]
- Russell J.A., Evers S., Dwyer J.M., Uetrecht C., Macaskill L. Best practices among child nutrition programs in Ontario: Evaluation findings. J. Hunger Environ. Nutr. 2008;2(2–3):111–127. doi: 10.1080/19320240801891511. [DOI] [Google Scholar]
- Saunders R.P., Evans M.H., Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: A how-to guide. Health Promot. Pract. 2005;6(2):134–147. doi: 10.1177/1524839904273387. [DOI] [PubMed] [Google Scholar]
- Skinner K., Hanning R.M., Metatawabin J., Martin I.D., Tsuji L.J.S. Impact of a school snack program on the dietary intake of grade six to ten First Nation students living in a remote community in northern Ontario. Can. Rural Rem. Health. 2012;12(2122):1–17. [PubMed] [Google Scholar]
- Story M., Warren Mays R., Bishop D., Perry C., Taylor G., Smyth M. 5-a-day power plus: Process evaluation of a multicomponent elementary school program to increase fruit and vegetable consumption. Health Educ. Behav. 2000;27(2):187–200. doi: 10.1177/109019810002700205. [DOI] [PubMed] [Google Scholar]
- Sy A., Glanz K. Factors influencing teachers' implementation of an innovative tobacco prevention curriculum for multiethnic youth: Project SPLASH. J. Sch. Health. 2008;78(5):264–273. doi: 10.1111/j.1746-1561.2008.00299.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Te Velde S.J., Brug J., Wind M., Hildonen C., Bjelland M., Perez-Rodrigo C. Effects of a comprehensive fruit- and vegetable-promoting school-based intervention in three European countries: The Pro Children Study. Br. J. Nutr. 2008;99(4):893–903. doi: 10.1017/S000711450782513X. [DOI] [PubMed] [Google Scholar]
- Triador L., Farmer A., Maximova K., Willows N., Kootenay J. A school gardening and healthy snack program increased Aboriginal First Nations children's preferences toward vegetables and fruit. J. Nutr. Edu. Behav. 2015;47(2):176–180. doi: 10.1016/j.jneb.2014.09.002. [DOI] [PubMed] [Google Scholar]
- Tsui E.K., Deutsch J., Patinella S., Freudenberg N. Missed opportunities for improving nutrition through institutional food: The case for food worker training. Am. J. Public Health. 2013;103(9):e14–e20. doi: 10.2105/AJPH.2013.301293. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Cauwenberghe E., Maes L., Spittaels H., van Lenthe F.J., Brug J., Oppert J.M. Effectiveness of school-based interventions in Europe to promote healthy nutrition in children and adolescents: systematic review of published and 'grey' literature. Br. J. Nutr. 2010;103(6):781–797. doi: 10.1017/S0007114509993370. [DOI] [PubMed] [Google Scholar]
- Veugelers P., Fitzgerald A. Effectiveness of school programs in preventing childhood obesity: a multilevel comparison. Am. J. Public Health. 2005;95(3):432–435. doi: 10.2105/AJPH.2004.045898. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang D., Stewart D. The implementation and effectiveness of school-based nutrition promotion programmes using a health-promoting schools approach: a systematic review. Public Health Nutr. 2013;16(6):1082–1100. doi: 10.1017/S1368980012003497. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Webb K.L., Gosliner W., Woodward-Lopez G., Crawford P.B. Lessons of Fresh Start can guide schools seeking to boost student fruit consumption. Calif. Agri. 2013;67(1):21–29. doi: 10.3733/ca.v067n01p21. [DOI] [Google Scholar]
- Wells L., Nelson M. The National School Fruit Scheme produces short-term but not longer-term increases in fruit consumption in primary school children. Br. J. Nutr. 2005;93(04) doi: 10.1079/bjn20051393. [DOI] [PubMed] [Google Scholar]
- White G. Evaluation of the school fruit and vegetable pilot scheme. Educ. Health. 2006;24(4):62–64. [Google Scholar]
- Wind M., Bjelland M., Perez-Rodrigo C., te Velde S.J., Hildonen C., Bere E. Appreciation and implementation of a school-based intervention are associated with changes in fruit and vegetable intake in 10- to 13-year old schoolchildren-the Pro Children study. Health Educ. Res. 2008;23(6):997–1007. doi: 10.1093/her/cym078. [DOI] [PubMed] [Google Scholar]
- World Health Organization [WHO]. Fruit and vegetable promotion initiative/ A meeting report/25-27/08/03 – Geneva, Switzerland. 2003.
- Yeo S.T., Edwards R.T. Encouraging fruit consumption in primary schoolchildren: a pilot study in North Wales. J. Hum. Nutr. Diet. 2006;19:299–302. doi: 10.1111/j.1365-277X.2006.00706.x. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

