Abstract
Despite growing evidence that warning labels reduce purchases of sugary drinks, less is known about warnings’ impact on purchases of sugary snacks. This paper aimed to experimentally test whether a front-of-package label warning about high sugar content (“sugar warning label”) would reduce parents’ likelihood of selecting a labeled snack versus a non-labeled snack for their child in a food store setting. Participants (n=2,219 parents of at least one child aged 1-5y) were recruited via an online panel and asked to complete a shopping task in a virtual convenience store. Participants were randomized to one of three labeling conditions: barcode control, text-only sugar warning label, or pictorial sugar warning label. Participants viewed two granola snacks, one labeled and one unlabeled, and selected one for purchase. A post-shopping survey measured secondary outcomes. Predictions and analyses were preregistered on www.clinicaltrials.gov (NCT #04381481). Participants exposed to the text or pictorial sugar warning labels were less likely to select the labeled snack than those in the barcode control group (21%, 18%, and 34% respectively; p<0.001 for both comparisons of warning to control). Relative to the barcode control label, the text and pictorial sugar warning labels resulted in greater attention, anticipated social interactions, negative affect, cognitive elaboration, and perceived message effectiveness, as well as lower perceptions of healthfulness, appeal, and intentions to purchase or consume the product (p<0.001 for all comparisons of warnings to control). There were no differences in outcomes between text and pictorial sugar warning labels. In conclusion, text and pictorial sugar warning labels reduced parents’ likelihood of selecting a labeled granola snack for their children. These results contribute to a growing body of evidence showing that warning labels influence food purchasing behaviors.
Keywords: Childhood Obesity, Randomized Controlled Trial, Front-of-Package Labels, Food Policy, Marketing, Added Sugar
1. Introduction
Children’s consumption of foods with added sugar is a pressing public health concern worldwide. In the US, Australia, and Europe, average intake of added or free sugar among children remains above the international recommendations of 5% (Azais-Braesco et al., 2017; Lei et al., 2016; Russo et al., 2020; WHO, 2015). Data on added sugar intake in other regions is sparser due to lack of mandatory labeling requirements and national dietary intake data, but available studies indicate that pediatric added sugar intake is already high in some low- and middle- income settings (Maunder et al., 2015; Pries et al., 2019), and that overall sales of foods and drinks high in added sugar are rapidly increasing across the globe (Popkin & Hawkes, 2016).
In children, excess sugar intake is linked to increased weight gain and increased cardiometabolic risk (Vos et al., 2017). Public policies are an important strategy to reduce sugar intake because of their ability to change the food environment to support healthier choices rather than focusing on individual behavior (Chriqui, 2013). Policies that require warning labels about sugar on the front of products are a promising strategy to help inform consumers of high-sugar products and aid in reducing consumption of added sugar.
Indeed, labels warning of sugar content (“sugar warning labels”) applied to the front of product packaging are increasingly being implemented across the globe. These warning labels typically include a text statement that the product is “high in sugar,” with some variability in shape, size, and color. In 2016, Chile was the first country to implement a mandatory system of warning labels on the front of packages indicating high sugar content as well as other nutrients of concern (Corvalán et al., 2019), followed by Peru, Israel, Mexico, and Uruguay. Brazil and Colombia are currently in the process of implementation (Resolución Número 0000810, 2021; World Cancer Research Fund International, 2017). Although in Chile the introduction of warning labels was accompanied by other interventions (e.g., advertisement restrictions), initial results from evaluation studies suggest that warning labels reduced intake of added sugar, with one study finding a 24% relative decline in purchases of sugar-sweetened beverages after implementation (L.S. Taillie et al., 2020).
In addition, a growing body of experimental evidence demonstrates that nutrient warning labels are easy for consumers to understand, help them identify products high in nutrients of concern, and discourage purchasing of such products (Grummon & Hall, 2020; L. Taillie et al., 2020). However, most previous relevant experimental studies have tested labels warning of multiple nutrients rather than just sugar (e.g., calories, sodium, saturated fat), so the effect of sugar warnings labels specifically is less clear. Studies that have focused on sugar warning labels have focused predominantly on sugar-sweetened beverages (Clarke et al., 2020), finding that sugar warning labels are perceived to be effective at making consumers concerned with the health effects of drinking sugary drinks, making sugary drinks seem unpleasant, discouraging sugary drink consumption (Hall et al., 2021), and reducing parents’ selection of sugary drinks (Mantzari et al., 2018).
Although these findings suggest that warning labels hold promise, it is important to understand the impact of sugar warning labels on consumers’ perceptions and decisions to purchase not only beverages, but foods as well. Added sugar from foods accounts for a large and growing proportion of added sugar in children’s diets (Bailey et al., 2018). In addition, most current literature on nutrient warning labels focuses on text statements only. However, evidence suggests that the use of icons or images can enhance the effectiveness of labels (Donnelly et al., 2018; Hall et al., 2020; Rosenblatt et al., 2019). Finally, most existing studies of food labeling have relied on self-reported data or exposure to warnings outside the context of a retail environment. A more realistic point-of-purchase setting is needed to test the causal impact of nutrient warning labels on parents’ decisions to purchase labeled snacks for their children.
The objective of this study was to experimentally test whether a sugar warning label (“high in added sugar”) would reduce the likelihood of parents selecting a labeled versus a non-labeled snack to purchase for their children in a virtual convenience store. A secondary objective was to test whether a sugar warning label that included an icon (e.g., a pictorial warning) would have a bigger impact on selection of a labeled snack than a sugar warning comprised of text only. This study also assessed parents’ perceptions of healthfulness of the snack, snack appeal, and intentions to purchase and consume the snack. Finally, parents’ reactions to the labels and perceptions of the labeled product were also examined.
The primary hypothesis was that sugar warning labels would reduce parents’ likelihood of selecting a labeled snack for purchase compared to a control label. The secondary hypothesis was that pictorial warning labels would result in reduced selection of labeled snacks compared to text-only warning labels.
2. Methods
The Institutional Review Boards at the University of North Carolina approved the study. The study was preregistered on ClinicalTrials.gov prior to beginning data collection (NCT04381481).
2.1. Participants
Participants (n=2,219) were recruited via online convenience sample through two panel research companies, Kantar (www.kantar.com) and CloudResearch (www.cloudresearch.com). Study criteria included: current US resident; age ≥18 years old; and being a parent (or guardian) of at least one child between ages 1-5 years. This experiment was conducted as an ancillary study of a trial focused on assessing parents’ decisions to select a fruit drink for their child. Because of this, an additional criterion was that the child of interest for the survey (i.e., the child with the most recent birthday) must have consumed at least one fruit drink within the past week.
2.2. Stimuli Development
2.2.1. Products
Individual-sized bags of granola bites were chosen as the product on which warning labels would appear, because they represent a snack category that would be appealing to children. A visual communication expert created two mock brands of granola bites to control for established brand preferences (Lazard et al., 2018). The brands were designed to look similar in terms of size, color scheme, and other front-of-package elements (e.g., information about net weight of contents). The specific mock brands used in this study were selected based on a pre-test experiment showing that participants rated each brand similarly in terms of perceptions of healthfulness and product appeal (n=1,002 US adults recruited through Amazon Mechanical Turk). Nutrition facts label information, including ingredients and nutrients, was based on similar real-life products and developed by a registered dietitian. Both mock brands had the same nutritional information. Both products would be considered high-in sugar using criteria from the warning label policy of Chile, the first country to require warning labels on high-sugar products (e.g., contains added sugar and has >10 grams total sugar per 100 grams of product). In this case, the snacks contained 7 grams of total sugar per serving (24 grams in product). The key difference between the two products was that one product contained a front-of-package label (text warning, pictorial warning, or barcode control label, depending on study arm) and the other product had no front-of-package label.
2.2.2. Labels
Figure 1 presents images of the labeled and non-labeled granola snack products used in the virtual convenience store. Depending on study arm, the labeled granola snack product displayed one of three types of labels: a text sugar warning, a pictorial sugar warning, and a barcode control label. Both warning labels consisted of a black square with text indicating “WARNING: High in added sugar” (Grummon, Hall, et al., 2019). The pictorial warning also included an image of a glass full of sugar cubes with a red background. A pre-test experiment of added sugar images (e.g., glass of sugar, pile of sugar with a spoon, cubes of sugar, scoop of sugar, and cubes of sugar with exclamation points) indicated that a glass full of sugar cubes was the image most likely to discourage purchasing a snack high in added sugar. Similar to previous studies (Grummon et al., 2019a), a barcode was used as a control label to control for the effect of having a label on the front of the package and also allows all participants to respond to questions about a label.
Figure 1. Images of labeled and non-labeled granola bites products created for virtual convenience store shopping experiment.
Panel A) Granola bites with labels, depending on study arm: A) text-only warning label (black box with text: “WARNING: High in added sugar.”; B) pictorial warning label (red box with text: “WARNING: High in added sugar.”); and C) barcode control label.
Panel B) Non-labeled granola bites.
2.2.3. Virtual convenience store
This experiment was implemented through iShoppe, a 3-D virtual convenience store developed by a team of researchers and graphic designers at RTI International. The store was designed to resemble a real-world convenience store and has previously been used in experiments on point-of-purchase interventions for tobacco products (Guillory et al., 2020; Kim et al., 2014) and nutrition labeling (Blitstein et al., 2020). The store included shelves with snacks, a fountain drink section, coolers, restrooms, and a check-out counter with a clerk. The products in the store were 3-D, and participants were able to view all sides of the granola products and read the nutrition information on the back of the package (e.g., the nutrition facts panel and ingredients list). The granola snacks in this experiment were located on a small wire rack on top of the check-out counter (Supplemental Figure 1).
2.3. Procedures
Participants provided electronic informed consent before completing an online shopping task in the virtual convenience store.
The study was a randomized experiment with a between-subjects design. Participants were randomized using a 1:1:1 allocation ratio to assign them to view one of three labels on one of the two granola snacks: a barcode control label, a text sugar warning, or a pictorial sugar warning. The other granola snack did not have a label in any condition. Accordingly, in each condition, participants had a choice between a labeled and a non-labeled granola snack.
Upon entering iShoppe, participants were instructed on how to move through the store and directed to complete the shopping task. First, participants had to select two beverages for their child from the beverage coolers as part of an experiment of fruit drink marketing claims. Then, as they proceeded to the checkout counter, they were instructed to select a granola snack for their child before checking out. At the checkout counter, they viewed the two granola bite snacks side by side (one labeled, one non-labeled). The participants had to compare the products side by side and select one granola snack for their child. Participants were required to choose one snack for purchase to complete the shopping task. After the shopping task, participants completed an online survey programmed in Qualtrics. First, to assess secondary outcomes that could not be measured in the store, participants saw an image of the labeled snack per their assigned condition and answered questions related to the snack as we have done in prior studies (Grummon, Taillie, et al., 2019; Hall et al., 2022). Then, they saw an image of the two snacks (labeled and non-labeled) and answered questions about which snack they would choose, to assess comparability in selection in the context of a survey versus in the store. Finally, they saw an image of the label in isolation (i.e., not on the snack) and were asked to assess the label itself. During the survey, participants were also asked to respond to questions relating to fruit drinks and other products. For their participation, participants received previously agreed upon incentives from the panel companies.
2.4. Measures
Participant characteristics included the parent’s self-identified age, gender, race and ethnicity, sexual orientation, educational attainment, household income, participation in the Supplemental Nutrition Assistance Program (SNAP), participation in the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC), body mass index; and the age, gender, and race/ethnicity of the child for whom the parent shopped.
The primary outcome was the percent of participants who selected the labeled granola snack compared to the non-labeled granola snack during the shopping task. The secondary outcome was the percent of participants who selected the labeled granola snack compared to the non-labeled granola snack as the snack they would most want to buy for their child in the post-shopping task survey. We also recorded whether the participant viewed the product’s nutrition facts label during the shopping visit.
Additional outcomes from the post-shopping survey included constructs predictive of behavior change according to our conceptual framework for warning labels (L. Taillie et al., 2020) (Supplemental Figure 2). These included intentions to purchase the labeled snack (“How likely would you be to buy this snack in the next week, if it were available?”; range 1-5, not at all likely to very likely), perceived healthfulness (“How healthy would it be for your child to eat this snack every day?”; range 1-5, very unhealthy to very healthy), and perceived product appeal (“How appealing would your child find this snack?”; range 1-5, very unappealing to very appealing). The survey also assessed participants’ intentions to give the labeled snack to their child and consume the snack themselves (range 1-5, not at all likely to extremely likely, for each item).
Finally, participants assessed the label itself (i.e., reactions to the label). Outcomes included perceived message effectiveness (PME) using a validated measure shown to predict behavior change in the context of tobacco (Baig et al., 2018; Baig et al., 2021) (“How much does this label…” “…make you concerned about the health effects of consuming this product?;” “make consuming this product seem unpleasant to you?;” and “discourage you from wanting to consume this product?”; range 1-5, not at all likely to extremely likely). Additional label reactions included learning something new (“Did you learn something new from the label?”; range 0-1, no/yes) as well as anticipated social interactions (“How likely are you to talk about this label with others in the next week?”; range 1-5, not at all likely to extremely likely), grabbing attention (“How much does this label grab your attention?”; range 1-5, not at all to a great deal); negative affect (“How much does this label make you feel scared?”; range 1- 5, not at all to a great deal); and cognitive elaboration (“How much does this label make you think about the health problems caused by eating this snack?”; range 1-5, not at all to a great deal) (L. Taillie et al., 2020).
Although we pre-registered additional items from the shopping experiment (e.g., participants’ assessment of which product contained more added sugar and which product was healthier), we opted not analyze these data because there was not one correct answer (the nutrition facts panels of both products were the same).
2.5. Analysis
First, demographic characteristics were compared between label conditions using chi-square tests for categorical variables and t-tests for continuous variables.
For the main outcome, likelihood of selecting the labeled snack in the virtual store, and for all other dichotomous outcomes, logistic regression models were used where the independent variable was warning condition. Linear regression models were used for predictions with Likert-style outcomes and scales, one for each outcome. Although the Shapiro-Wilk test for normality showed that data were not normally distributed, ordinal logistic regression models revealed a similar pattern of results (i.e., same direction, same pattern of statistical significance), so the linear regression models were retained for ease of interpretation. For each model, the margins command in Stata was used for significance testing of control vs. each warning message separately, as well as each warning message compared to each other. Bonferroni corrections accounted for multiple tests within each model (e.g., comparing each warning arm to the control label and each warning arm to each other). A critical alpha of 0.05 was used for all models to determine statistical significance. Cohen’s d was calculated for the main outcome of selecting the labeled snack, to facilitate comparisons of effect size to other experimental studies of warning labels (Cohen, 1988).
A series of logistic regressions which included an interaction term between label condition and participant characteristic explored whether participant characteristics modified the effect of warning labels on snack choice. Although not pre-registered, because the main effects of each warning type (text and pictorial) were similar in magnitude, both warning label conditions were combined for moderation analyses to improve statistical power. Participant characteristics included race/ethnicity of parent (White non-Hispanic vs. Black non-Hispanic vs. Hispanic); educational attainment (≤high school or >high school), household income ($<75,000 or ≥$75,000/year), and whether the participant viewed the product’s nutrition facts label during the shopping visit. For each model, Wald chi-square tests were used to test the statistical significance of the interaction term. All analyses were Bonferroni-corrected for multiple comparisons.
Finally, our pre-registration stated that the main prediction was that the label would reduce the likelihood of selecting the “higher sugar” granola snack. However, in the actual experiment, the amount of sugar listed in the nutrition facts panel was the same for labeled and non-labeled granola snacks. Thus, the tested hypothesis was that the warning label would decrease selection of the labeled snack. To understand whether label condition affected viewing the nutrition facts panel, we analyzed an additional outcome: viewing of the nutrition facts panel by study arm.
Because this experiment was an ancillary study, no a priori sample size calculation was conducted.
3. Results
Socio-demographic characteristics of the sample are presented in Table 1. There were no significant differences in means or proportions of characteristics by study arm. Participants’ mean age was 34.8 years (+/− 7.6), most (63%) identified as women, 17% identified as non-Hispanic Black or African American, and 33% identified as Hispanic. With regard to socio-economic characteristics, 34% had a high school diploma or less, while 32% had a household income less than $50,000. Twenty percent reported using SNAP in the past year, while 13% reported using WIC. About half (54%) reported reading the nutrition facts label often or all the time. Only 12% of participants viewed the back of package nutritional information. Unadjusted descriptive results can be found in Supplemental Table 1.
Table 1.
Characteristics of study participants in a virtual convenience store shopping experiment (n=2,219).
| n | % | |
|---|---|---|
| Study arm | ||
| Barcode Control Label | 741 | 33% |
| Text Warning Label | 740 | 33% |
| Pictorial Warning Label | 738 | 33% |
| Characteristic of the parent | ||
| Age | ||
| Mean in years (SD) | 34.8 | 7.6 |
| Gender | ||
| Man | 768 | 35% |
| Woman | 1402 | 63% |
| Transgender or other gender identity | 1 | 0% |
| No response | 48 | 2% |
| Sexual orientation | ||
| Straight or heterosexual | 1997 | 90% |
| Gay, lesbian, bisexual, or another | 173 | 8% |
| No response | 49 | 2% |
| Race and Ethnicity | ||
| Non-Hispanic White | 1095 | 49% |
| Non-Hispanic Black | 389 | 17% |
| Hispanic | 735 | 33% |
| Education | ||
| High school diploma or less | 743 | 34% |
| College graduate | 1428 | 64% |
| No response | 48 | 2% |
| Household income, annual | ||
| $0-$24,999 | 254 | 11% |
| $25,000-$49,999 | 459 | 21% |
| $50,000-$74,999 | 460 | 21% |
| $75,000+ | 990 | 45% |
| No response | 56 | 2% |
| Used SNAP in the last year | 445 | 20% |
| Used WIC in the last year | 293 | 13% |
| Body mass index (BMI, kg/m2)1 | ||
| Underweight (<18.5) | 100 | 4% |
| Healthy Weight (18.5-24.9) | 894 | 40% |
| Overweight (25.0-29.9) | 576 | 26% |
| Obese (>29.9) | 565 | 26% |
| No response | 84 | 4% |
| Mean BMI (SD) | 27.2 | 7.5 |
| Viewed nutrition fact panel label during study | 256 | 12% |
| Characteristics of the child the parent shopped for during experiment 2 | ||
| Child Age | ||
| Mean in years (SD) | 3.5 | 1.3 |
| Child Gender | ||
| Boy | 1201 | 54% |
| Girl | 996 | 45% |
| Other gender identity | 1 | 0% |
| No response | 21 | 1% |
| Child Race and Ethnicity | ||
| Non-Hispanic White | 1051 | 48% |
| Non-Hispanic Black | 357 | 16% |
| Hispanic | 713 | 32% |
| Non-Hispanic other | 75 | 3% |
| No response | 23 | 1% |
Self-reported
Asked about child ages 1-5 years with the most recent birthday.
SD = Standard Deviation; SNAP = Supplemental Nutrition Assistance Program; WIC = Special Supplemental Nutrition Program for Women, Infants, and Children.
Characteristics did not differ by between-subjects experimental labeling conditions.
In the virtual shopping experiment, when presented with a choice of a labeled vs. non-labeled granola snack, participants in the text and pictorial warning label groups were less likely to select the labeled snack for purchase than those in the barcode control group (21%, 18%, and 34% respectively; p<0.001 for both comparisons of warning to control; Figure 2). The Cohen’s d was .31 for text warnings and .37 for pictorial warnings. There were no statistically significant differences in snack selection between the text and pictorial warning label groups (p=0.743). In the post-experiment survey, when presented again with the images of the labeled and non-labeled granola snacks, participants exposed to text and pictorial warnings were less likely to select the labeled snack as the snack they would most prefer to purchase for their child, compared to the barcode control (12%, 13%, and 38%, respectively; p<0.001 for both comparisons of warning to control). There were no statistically significant differences in outcomes between the text and pictorial warning label groups (p=1.000). Full regression results for all models are reported in Supplemental Table 2.
Figure 2. Percent of participants in a virtual convenience store shopping experiment selecting to select a labeled granola snack product for their child over a non-labeled granola snack product, by study arm (n=2,219).
***p<0.0001 compared to barcode control. The comparison between the text warning and pictorial warning was not statistically significant (p=0.743).
There was no statistically significant difference in the percent of participants who viewed the NFP information by condition type (13% in the control, 10% in the text warning, 11% in the pictorial warning group, p=0.518 for control vs text; p=1.000 for other comparisons) (Table 2).
Table 2.
Participant reactions to sugar warning labels by study arm (n=2,219).
| Post-shopping survey question | Barcode Control Label |
Text Warning Label | Pictorial Warning Label | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Outcomes, % | n | % | n | % | n | p-value, compared to control |
% | n | p-value, compared to control |
p-value, compared to Text Warning Label |
| Viewed NFP informationa | 2219 | 13% | 95 | 11% | 78 | 0.518 | 11% | 83 | 1.000 | 1.000 |
| Learned something new from label | 2183 | 24% | 172 | 75% | 542 | <0.001 | 77% | 558 | <0.001 | 1.000 |
| Outcomes, means | ||||||||||
| Mean | SD | Mean | SD | Mean | SD | |||||
| Anticipated social interactions | 2186 | 2.2 | 1.4 | 3.1 | 1.4 | <0.001 | 3.1 | 1.4 | <0.001 | 1.000 |
| Label grabs attention | 2184 | 2.5 | 1.4 | 4.4 | .9 | <0.001 | 4.4 | 0.9 | <0.001 | 1.000 |
| Label makes participants feel scared | 2182 | 1.9 | 1.3 | 3.3 | 1.3 | <0.001 | 3.4 | 1.3 | <0.001 | 1.000 |
| Thinking about health effects of labeled snack | 2184 | 2.1 | 1.4 | 4.1 | 1.0 | <0.001 | 4.1 | 1.0 | <0.001 | 1.000 |
| Product appeal | 2184 | 3.7 | 1.1 | 3.5 | 1.3 | <0.001 | 3.5 | 1.3 | <0.001 | 1.000 |
| Perceived healthfulness | 2186 | 3.9 | 0.9 | 2.6 | 1.5 | <0.001 | 2.5 | 1.4 | <0.001 | 0.199 |
| Intentions to give labeled snack to child | 2184 | 3.6 | 1.1 | 2.6 | 1.4 | <0.001 | 2.5 | 1.4 | <0.001 | 0.237 |
| Intentions to purchase labeled snack | 2186 | 3.4 | 1.2 | 2.5 | 1.4 | <0.001 | 2.4 | 1.4 | <0.001 | 0.627 |
| Intentions to consume labeled snack | 2185 | 3.5 | 1.2 | 2.7 | 1.4 | <0.001 | 2.6 | 1.4 | <0.001 | 0.677 |
| Perceived message effectiveness | 2181 | 2.3 | 1.3 | 4.2 | 0.9 | <0.001 | 4.3 | 0.8 | <0.001 | 1.000 |
All p-values are Bonferroni corrected for multiple comparisons.
NFP=Nutrition Facts Panel. This outcome is from the in-store shopping experiment. All other outcomes reported are from the post-shopping survey.
Participant reactions to the labels also varied by label type (Table 2). Compared to the barcode control label, participants who saw text and pictorial warnings reported that they were more likely to learn something new from the label (75% and 77%, respectively, compared to 24% in the control label, p<0.001 for both comparisons). Participants who saw text and pictorial warnings also reported higher anticipated social interactions, greater attention to the label, higher negative affect, and higher cognitive elaboration compared to the barcode control group (p<0.001 for all comparisons). Participants who saw text and pictorial warnings perceived the labeled snack as less healthy and less appealing and had lower intentions to buy or consume the product, than did participants in the barcode control group (p<0.001 for all comparisons). Finally, text and pictorial warnings elicited higher perceived message effectiveness (4.2 ± 0.9 and 4.3 ± 0.8) compared to the barcode control label (2.30 ± 1.3; p<0.001 for both comparisons). There were no statistically significant differences between the pictorial and text warning arms for label reactions.
When examining moderators, there were no statistically significant interactions by child characteristics (gender, age), parent characteristics (gender, education, race/ethnicity), or whether the parent viewed the nutrition facts panel during the shopping experiment (Table 3). Full regression results for interaction models are reported in Supplemental Table 3.
Table 3.
Percent of participants who selected labeled granola snack product during virtual convenience store shopping experiment, by study arm (n=2,219).
| Barcode Control Label |
Text/Pictorial Warning Labelsa |
||||
|---|---|---|---|---|---|
| % | SE | % | SE | p-value for interactionb |
|
| Participant Characteristic | |||||
| Income | 1.000 | ||||
| Less than $75,000 | 34 | 2 | 18 | 1 | |
| Greater than or equal to $75,000 | 34 | 3 | 21 | 2 | |
| Parental Education | 0.364 | ||||
| Less than or equal to high school diploma | 35 | 3 | 16 | 2 | |
| More than a high school diploma | 34 | 2 | 21 | 1 | |
| Gender | 0.238 | ||||
| Man | 33 | 3 | 23 | 2 | |
| Woman | 35 | 2 | 17 | 1 | |
| Race and ethnicity | 1.000 | ||||
| Non-Hispanic White | 32 | 2 | 17 | 1 | |
| Non-Hispanic Black | 34 | 4 | 22 | 2 | |
| Hispanic, any race | 38 | 3 | 22 | 2 | |
| Viewed NFP c | 1.000 | ||||
| No | 34 | 2 | 20 | 1 | |
| Yes | 40 | 5 | 18 | 3 | |
| Child Characteristic d | |||||
| Age of child | 1.000 | ||||
| 1 year old | 33 | 6 | 19 | 3 | |
| 5 years old | 35 | 3 | 18 | 2 | |
| Gender of child | 1.000 | ||||
| Boy | 34 | 2 | 20 | 1 | |
| Girl | 35 | 2 | 19 | 2 | |
Text and pictorial warning label groups combined.
p-value is for the difference in the effect of warning labels between groups. All p-values are Bonferroni corrected for multiple comparisons.
Participant viewed nutrition facts panel (NFP) during experiment.
Child ages 1-5 with the most recent birthday for which participant was shopping for during experiment.
SE = Standard Error.
4. Discussion
The main result of this randomized trial of parents in a virtual convenience store was that both text-based and pictorial sugar warning labels led to fewer parents selecting a labeled sugary snack to purchase for their children, compared to parents who saw a barcode control label.
The findings that sugar warning labels reduced parents’ likelihood of selecting labeled products by 13% to 16% in a food store environment are in line with previous research. For example, Grummon et al found that among a general adult population, health warning labels on sugary drinks led to a 13 percentage point decrease in selection of sugary drinks to purchase (Grummon et al., 2019b). Another recent study in a naturalistic food store environment found that, among a population of parents ages 2 to 12y, graphic health warning labels led to a 17 percentage point decrease in parents’ purchases of sugary drinks for their children (Hall et al., 2022).
In the post-experiment survey, we found a similar pattern of results, with the warning labels leading to reduced selection of the labeled snack relative to the control. Interestingly, the size of the effect of warning labels was larger in the post-experiment survey, potentially due to differences in the format of exposure to stimuli or because the survey represented a second exposure to the stimuli. Whereas in the shopping task, the text-only warning and pictorial warning labels led to decreases in selection of 13% and 16% relative to the control, in the post-experiment survey, the text-only and pictorial warning labels led to decreases of 26% and 25%, respectively, relative to the control. Given that many experiments on food labeling rely on simplistic choice experiments rather than shopping tasks in food retail environments, further research is warranted to understand whether the use of simplistic choice experiments consistently results in larger effects. Still, it was encouraging that the pattern of results was consistent between the two methodologies.
The text and pictorial sugar warning labels also led to decreases in intention to purchase and consume the labeled snack, and they were perceived as more effective at discouraging consumption of high sugar snacks, relative to the barcode control label. Studies of labeling from other fields such as tobacco have found that perceived message effectiveness is a predictor of longer-term behavioral change (Noar et al., 2020). Change in intentions is an important step on the pathway between label exposure and behavioral change (L. Taillie et al., 2020). Taken together with the results of the shopping experiment showing decreased selection of the labeled snack in the warning label conditions, this pattern of results suggests that exposure to sugar warning labels on snacks could lead to decreased purchases of labeled snacks for young children. However, we acknowledge that future studies should evaluate the effects of these warnings in real-world settings as well as in the context of a wider variety of snack options to choose from.
Snack choice and product perceptions did not differ between the text and pictorial sugar warning labels. Contrary to health behavior and communications theory (Petty & Cacioppo, 1986; Witte, 1992) and evidence from tobacco control literature, these results are unexpected in that pictorial warnings were projected to have a much larger effect than text warnings due to their ability to elicit greater attention, increase negative affect, and reduce purchasing intentions (Brewer et al., 2019; Hammond, 2011; Noar et al., 2017). For example, a recent study of health warnings by Hall et al found that pictorial warnings had a greater impact on perceived message effectiveness (e.g., discouraging consumers from wanting to consume sugary drinks) than did text-only warnings (Hall et al., 2020). One possibility is that the type of pictorial warning used in this study (i.e., an image of sugar content) may be less effective relative to other types of pictorial warnings, such as images related to the health consequences of consuming excess added sugar. Indeed, one recent study of parents in the UK found that while pictorial warnings reduced sugary drink selection compared to no label or calorie information, a warning that contained a disease-related image lowered selection more than a warning that contained an image related to sugar content (Mantzari et al., 2018).
This study found that socio-demographic characteristics did not moderate the impact of warning labels on parents’ decision to select the labeled snack. It was of particular interest to understand whether the sugar warning labels would have a larger impact among lower-educated parents (that is, those with a high school education or less) compared to those with higher education (those with greater than a high school education). Lower-educated households tend to purchase more sugary drinks and junk foods than higher-educated populations due to a variety of factors (Lacko et al., 2021) and thus have more to gain from labels that reduce purchases of these products. On the other hand, some evidence suggests that lower educated populations are less likely to use nutrition facts labels (Blitstein & Evans, 2006; Christoph et al., 2018). Our results that there was no moderation of warning label impact by education are consistent with previous studies (Acton et al., 2021; Grummon, Taillie, et al., 2019; Roberto et al., 2016; L. Taillie et al., 2020; L.S. Taillie et al., 2020). These results suggest that a real-world application of warning labels would work well across groups.
This study has several limitations. First, while the 3D virtual convenience store was designed to look like a real-life convenience store, there are several differences between the experimental setting and a real-life convenience store. For example, there were fewer products available for purchase, no prices listed, no advertisements, promotions, or other marketing elements, and parents did not spend actual money or receive the product. In addition, a recent meta-analysis of health warning labels found that studies conducted in online settings reported larger effects than those conducted in laboratories using physical products (Clarke et al., 2020). Thus, there is a clear and pressing need for the observed effects to be replicated in field studies with a more naturalistic setting.
In addition, although the labeled snack would have been considered as high-in sugar by several international nutrition profile models based on relative contributions of sugar to total energy, the actual sugar content was relatively low and did not differ between the labeled and non-labeled products. The effect of the label may have been even greater for higher-sugar products or if there was variability in sugar between labeled and non-labeled snacks. However, only 12% of participants viewed the information about sugar content on the back of the package. Moreover, the effect of the warning labels did not vary for those who viewed the nutrition facts panel vs. those who did not. It would be useful to replicate this study in a real store environment with real products, as well as with an array of products ranging in sugar content, with high-sugar products that contain warnings and low-sugar products that do not. This will be important to ensure that sugar warning labels shift consumers from high-sugar options to lower-sugar alternatives. A final limitation is that in the analysis, intrinsically ordinal-scale Likert data were assumed to be on an interval scale.
5. Conclusions
This study found that compared to a barcode control label, text and pictorial sugar warning labels reduced parents’ likelihood of selecting a labeled granola snack to purchase for their child, with text and pictorial warning labels performing similarly. Overall, these results contribute to the growing body of evidence that warning labels reduce purchases of products carrying the label.
Supplementary Material
Figure 3. Percent of participants in the post-shopping survey selecting a labeled granola snack product for their child over a non-labeled granola snack product, by study arm (n=2,180).
***p<0.0001 compared to barcode control. The comparison between the text warning and pictorial warning was not statistically significant (p=1.00).
Acknowledgments
We thank Edward “Chip” Hill and John Holloway at RTI International for programming of the iShoppe technology and Carmen Prestemon for her efforts in helping prepare this manuscript for submission and overall coordination. We also thank Maxime Bercholz for his guidance on the statistical analysis plan. We would like to thank the participants for their time and making this project possible.
Funding
The survey data used in this study were supported by a grant from Healthy Eating Research, a national program of the Robert Wood Johnson Foundation. The views expressed here do not necessarily reflect the views of the foundation. General support was provided by NIH grants to the Carolina Population Center, grant numbers P2C HD050924. K01HL147713 from the National Heart, Lung, and Blood Institute of the NIH supported M.G.H.’s time writing the paper. Additional support was provided by Bloomberg Philanthropies.
Abbreviations:
- SNAP
Supplemental Nutrition Assistance Program
- WIC
Special Supplemental Nutrition Program for Women, Infant, and Children program
- PME
Perceived Message Effectiveness
- NFP
Nutrition Facts Panel
References
- Acton RB, Kirkpatrick SI, & Hammond D (2021, Aug). Exploring the main and moderating effects of individual-level characteristics on consumer responses to sugar taxes and front-of-pack nutrition labels in an experimental marketplace. Can J Public Health, 112(4), 647–662. 10.17269/s41997-021-00475-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Azais-Braesco V, Sluik D, Maillot M, Kok F, & Moreno LA (2017, Jan 21). A review of total & added sugar intakes and dietary sources in Europe. Nutr J, 16(1), 6. 10.1186/s12937-016-0225-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baig SA, Noar SM, Gottfredson NC, Boynton MH, Ribisl KM, & Brewer NT (2018, Oct 15). UNC Perceived Message Effectiveness: Validation of a brief scale. Ann Behav Med. 10.1093/abm/kay080 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Baig SA, Noar SM, Gottfredson NC, Lazard AJ, Ribisl KM, & Brewer NT (2021). Incremental criterion validity of message perceptions and effects perceptions in the context of anti-smoking messages. Journal of Behavioral Medicine, 44, 74–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bailey RL, Fulgoni VL, Cowan AE, & Gaine PC (2018). Sources of added sugars in young children, adolescents, and adults with low and high intakes of added sugars. Nutrients, 10(1), 102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Blitstein JL, & Evans WD (2006). Use of nutrition facts panels among adults who make household food purchasing decisions. Journal of Nutrition Education and Behavior, 38(6), 360–364. [DOI] [PubMed] [Google Scholar]
- Blitstein JL, Guthrie JF, & Rains C (2020). Low-income parents’ use of front-of-package nutrition labels in a virtual supermarket. Journal of Nutrition Education and Behavior, 52(9), 850–858. [DOI] [PubMed] [Google Scholar]
- Brewer NT, Parada H, Hall MG, Boynton MH, Noar SM, & Ribisl KM (2019, Mar 1). Understanding Why Pictorial Cigarette Pack Warnings Increase Quit Attempts. Ann Behav Med, 53(3), 232–243. 10.1093/abm/kay032 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chriqui JF (2013). Obesity prevention policies in US states and localities: Lessons from the field. Curr Obes Rep, 2(3), 200–210. 10.1007/s13679-013-0063-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Christoph MJ, Larson N, Laska MN, & Neumark-Sztainer D (2018). Nutrition facts panels: who uses them, what do they use, and how does use relate to dietary intake? Journal of the Academy of Nutrition and Dietetics, 118(2), 217–228. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clarke N, Pechey E, Kosīte D, König LM, Mantzari E, Blackwell AKM, Marteau TM, & Hollands GJ (2020, Jul 2). Impact of health warning labels on selection and consumption of food and alcohol products: systematic review with meta-analysis. Health Psychol Rev, 1–24. 10.1080/17437199.2020.1780147 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cohen J (1988). Statistical Power Analysis for the Behavioral Sciences (2 ed.). Routledge Academic. 10.4324/9780203771587 [DOI] [Google Scholar]
- Corvalán C, Reyes M, Garmendia ML, & Uauy R (2019). Structural responses to the obesity and non-communicable diseases epidemic: Update on the Chilean law of food labelling and advertising. Obesity reviews, 20(3), 367–374. [DOI] [PubMed] [Google Scholar]
- Donnelly GE, Zatz LY, Svirsky D, & John LK (2018). The effect of graphic warnings on sugary-drink purchasing. Psychological Science, 29(8), 1321–1333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grummon AH, & Hall MG (2020, May). Sugary drink warnings: A meta-analysis of experimental studies. PLoS Med, 17(5), e1003120. 10.1371/journal.pmed.1003120 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grummon AH, Hall MG, Taillie LS, & Brewer NT (2019, Apr). How should sugar-sweetened beverage health warnings be designed? A randomized experiment. Prev Med, 121, 158–166. 10.1016/j.ypmed.2019.02.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grummon AH, Taillie LS, Golden SD, Hall MG, Ranney LM, & Brewer NT (2019, Nov). Sugar-Sweetened Beverage Health Warnings and Purchases: A Randomized Controlled Trial. Am J Prev Med, 57(5), 601–610. 10.1016/j.amepre.2019.06.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grummon AH, Taillie LS, Golden SD, Hall MG, Ranney LM, & Brewer NT (2019a). Sugar-sweetened beverage health warnings and purchases: a randomized controlled trial. American Journal of Preventive Medicine. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Grummon AH, Taillie LS, Golden SD, Hall MG, Ranney LM, & Brewer NT (2019b). Sugar-sweetened beverage health warnings and purchases: a randomized controlled trial. Am J Prev Med. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guillory J, Kim AE, Nonnemaker JM, Bradfield B, Taylor NH, Dutra L, & Feld A (2020). Effect of menthol cigarette and other menthol tobacco product bans on tobacco purchases in the RTI iShoppe virtual convenience store. Tobacco control, 29(4), 452–459. [DOI] [PubMed] [Google Scholar]
- Hall MG, Grummon AH, Higgins ICA, Lazard AJ, Prestemon CE, Avendano-Galdamez MI, & Taillie LS (2022, Feb). The impact of pictorial health warnings on purchases of sugary drinks for children: A randomized controlled trial. PLoS Med, 19(2), e1003885. 10.1371/journal.pmed.1003885 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hall MG, Grummon AH, Lazard AJ, Maynard OM, & Taillie LS (2020, Aug). Reactions to graphic and text health warnings for cigarettes, sugar-sweetened beverages, and alcohol: An online randomized experiment of US adults. Prev Med, 137, 106120. 10.1016/j.ypmed.2020.106120 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hall MG, Lazard AJ, Grummon AH, Higgins ICA, Bercholz M, Richter APC, & Taillie LS (2021, Jul). Designing warnings for sugary drinks: A randomized experiment with Latino parents and non-Latino parents. Prev Med, 148, 106562. 10.1016/j.ypmed.2021.106562 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hammond D (2011, Sep). Health warning messages on tobacco products: a review. Tob Control, 20(5), 327–337. 10.1136/tc.2010.037630 [DOI] [PubMed] [Google Scholar]
- Kim AE, Nonnemaker JM, Loomis BR, Shafer PR, Shaikh A, Hill E, Holloway JW, & Farrelly MC (2014). Influence of point-of-sale tobacco displays and graphic health warning signs on adults: evidence from a virtual store experimental study. American journal of public health, 104(5), 888–895. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lacko AM, Maselko J, Popkin B, & Ng SW (2021). Socio-economic and racial/ethnic disparities in the nutritional quality of packaged food purchases in the USA, 2008–2018. Public Health Nutrition, 1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lazard AJ, Mackert MS, Bock MA, Love B, Dudo A, & Atkinson L (2018). Visual assertions: Effects of photo manipulation and dual processing for food advertisements. Visual Communication Quarterly, 25(1), 16–30. [Google Scholar]
- Lei L, Rangan A, Flood VM, & Louie JC (2016, Mar 14). Dietary intake and food sources of added sugar in the Australian population. Br J Nutr, 115(5), 868–877. 10.1017/S0007114515005255 [DOI] [PubMed] [Google Scholar]
- Mantzari E, Vasiljevic M, Turney I, Pilling M, & Marteau T (2018, Dec). Impact of warning labels on sugar-sweetened beverages on parental selection: An online experimental study. Prev Med Rep, 12, 259–267. 10.1016/j.pmedr.2018.10.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maunder EM, Nel JH, Steyn NP, Kruger HS, & Labadarios D (2015). Added Sugar, Macro- and Micronutrient Intakes and Anthropometry of Children in a Developing World Context. PLoS One, 10(11), e0142059. 10.1371/journal.pone.0142059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Noar SM, Barker J, Bell T, & Yzer M (2020, Feb). Does Perceived Message Effectiveness Predict the Actual Effectiveness of Tobacco Education Messages? A Systematic Review and Meta-Analysis. Health Commun, 35(2), 148–157. 10.1080/10410236.2018.1547675 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Noar SM, Francis DB, Bridges C, Sontag JM, Brewer NT, & Ribisl KM (2017, Jun 1). Effects of Strengthening Cigarette Pack Warnings on Attention and Message Processing: A Systematic Review. Journal Mass Commun Q, 94(2), 416–442. 10.1177/1077699016674188 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petty R, & Cacioppo J (1986). The Elaboration Likelihood Model of Persuasion. Advances in experimental social psychology, 19, 123–205. 10.1016/S0065-2601(08)60214-2 [DOI] [Google Scholar]
- Popkin BM, & Hawkes C (2016, Feb). Sweetening of the global diet, particularly beverages: patterns, trends, and policy responses. Lancet Diabetes Endocrinol, 4(2), 174–186. 10.1016/S2213-8587(15)00419-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pries AM, Filteau S, & Ferguson EL (2019, Jun). Snack food and beverage consumption and young child nutrition in low- and middle-income countries: A systematic review. Matern Child Nutr, 15 Suppl 4, e12729. 10.1111/mcn.12729 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Resolución Número 0000810. (2021). Ministerio de Salud y Protección Social. [Google Scholar]
- Roberto CA, Wong D, Musicus A, & Hammond D (2016, Feb). The Influence of Sugar-Sweetened Beverage Health Warning Labels on Parents' Choices. Pediatrics, 137(2), e20153185. 10.1542/peds.2015-3185 [DOI] [PubMed] [Google Scholar]
- Rosenblatt DH, Dixon H, Wakefield M, & Bode S (2019). Evaluating the influence of message framing and graphic imagery on perceptions of food product health warnings. Food Quality and Preference, 77, 32–42. [Google Scholar]
- Russo RG, Peters BA, Salcedo V, Wang VH, Kwon SC, Wu B, & Yi S (2020, Nov 5). Disparities in Sources of Added Sugars and High Glycemic Index Foods in Diets of US Children, 2011-2016. Prev Chronic Dis, 17, E139. 10.5888/pcd17.200091 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taillie L, Hall M, Popkin B, Ng S, & Murukutla N (2020). Experimental Studies of Front-of-Package Nutrient Warning Labels on Sugar-Sweetened Beverages and Ultra-Processed Foods: A Scoping Review. Nutrients, 12(2), 569. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taillie LS, Hall MG, Gomez LF, Higgins ICA, Bercholz M, Murukutla N, & Mora-Plazas M (2020, Oct 13). Designing an Effective Front-of-Package Warning Label for Food and Drinks High in Added Sugar, Sodium, or Saturated Fat in Colombia: An Online Experiment. Nutrients, 12(10). 10.3390/nu12103124 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taillie LS, Reyes M, Colchero MA, Popkin BM, & Corvalán C (2020). An evaluation of Chile’s Law of Food Labeling and Advertising on sugar-sweetened beverage purchases from 2015 to 2017: A before-and-after study. PLoS medicine, 17(2), e1003015. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7012389/pdf/pmed.1003015.pdf [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vos MB, Kaar JL, Welsh JA, Van Horn LV, Feig DI, Anderson CA, Patel MJ, Cruz Munos J, Krebs NF, & Xanthakos SA (2017). Added sugars and cardiovascular disease risk in children: a scientific statement from the American Heart Association. Circulation, 135(19), e1017–e1034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- WHO. (2015). Guideline: sugars intake for adults and children (9241549025). [PubMed]
- Witte K (1992, 1992/December/01). Putting the fear back into fear appeals: The extended parallel process model. Communication Monographs, 59(4), 329–349. 10.1080/03637759209376276 [DOI] [Google Scholar]
- World Cancer Research Fund International. (2017). NOURISHING Framework. http://www.wcrf.org/int/policy/nourishing-framework
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.



