Skip to main content
PLOS One logoLink to PLOS One
. 2022 Oct 21;17(10):e0276168. doi: 10.1371/journal.pone.0276168

The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9–13 years of age: Results of a two-armed cluster randomized controlled trial

Emilie L M Ruiter 1,*, Gerard R M Molleman 1, Marloes Kleinjan 2, Jannis T Kraiss 3, Peter M ten Klooster 3, Koos van der Velden 1, Rutger C M E Engels 4, Gerdine A J Fransen 1
Editor: Lee Van Horn5
PMCID: PMC9586369  PMID: 36269738

Abstract

Introduction

Although parental support is an important component in programs designed to prevent overweight in children, current programs pay remarkably little attention to the role of parenting. We therefore developed a web-based parenting program entitled “Making a healthy deal with your child”. This e-learning program can be incorporated into existing overweight prevention programs. The aim of this study was to determine the effectiveness of this e-learning program.

Materials and methods

The effectiveness was examined in a two-armed cluster randomized controlled trial. The participants were 475 parent-child dyads of children 9–13 years of age in the Netherlands who participated in an existing schoolclass-based overweight prevention program. At the school grade level, parents were randomly assigned to either the intervention or the control condition. Measurements were taken from both parents and children at baseline, and 5 and 12 months after baseline. Primary outcomes included the child’s dietary and sedentary behavior, and level of physical activity. Secondary outcomes included general parenting style, specific parenting practices, and parental self-efficacy. Linear mixed effects models and generalized linear mixed effects models were conducted in R.

Results

Intention-to-treat analyses and completers only revealed no significant effects between the intervention and control condition on energy balance-related behaviors of the child and parenting skills after correction for multiple testing. The parents’ mean satisfaction with the e-learning program (on a 10-point scale) was 7.0±1.1.

Conclusions

Although parents were generally satisfied with the parenting program, following this program had no significant beneficial effects regarding the children’s energy balance-related behaviors or the parenting skills compared to the control condition. This program may be more beneficial if used by high-risk groups (e.g. parents of children with unhealthy energy balance-related behaviors and/or with overweight) compared to the general population, warranting further study.

Introduction

The growing number of children with overweight and obesity is a major health concern in industrialized countries [13]. In addition, in the Netherlands families with low socio-economic status (SES) and families of Turkish and Moroccan descent have a particularly high prevalence of children with overweight [48]. According to the Dutch Central Agency for Statistics, 16.4% of children 9–18 years of age were classified as overweight in 2020, a nearly three-fold increase in prevalence from 1980 in addition, 2.4% of children were considered obese [9]. The overall prevalence of overweight and obesity among Turkish and Moroccan children is 2–4 times higher than among Dutch children [7,10]. Moreover, preventing the development of overweight in children is important due to the high complexity of treating overweight [11], the increased likelihood of being overweight or obese in adulthood [12], and the detrimental health and social consequences associated with being overweight.

Parents play a key role in facilitating, supporting, and modeling their child’s healthy—or unhealthy—energy balance-related behaviors (EBRBs), and in dealing with numerous environmental obesogenic factors [13,14]. In the long run, engaging in unhealthy EBRBs causes a chronic positive net energy balance in the child, which can result in the child becoming overweight. Reviews have increasingly emphasized the role of parenting in the development of childhood overweight and obesity [1519]. Both a higher degree of parental involvement and helping parents encourage their children to engage in healthy EBRBs are considered effective techniques for preventing and/or treating childhood obesity and overweight [2023]. In addition, to promote healthy EBRBs in interventions designed to prevent overweight in children, parenting styles and parenting practices are key components in achieving these changes in behavior and could make the interventions themselves more effective [15,16,19,21,24]. Thus, to ensure their children achieve a healthy weight, parents should apply i) adequate general parenting skills, and ii) specific parenting skills that encourage healthy EBRBs. Therefore, parents should be educated with respect to which EBRBs are healthy for their child [21]. In other words, an effective intervention should provide parents with information regarding what the children need (i.e., what is healthy for the child), as well as information regarding how to offer this as a parent [21]. General parenting includes the emotional climate in which a family functions [25], parents raise their child, and parents communicate with their child. Thus, support and control are the principal dimensions of general parenting skills [26,27]. Examples of specific parenting skills that encourage EBRBs can include monitoring their child’s EBRBs, modeling healthy EBRBs, and setting rules for their child regarding EBRBs.

Despite the clear role of parenting, most Dutch and international obesity-prevention programs developed to date pay only limited attention to parenting aspects [21,2833]. In addition, the few interventions that included parenting are family-and-home-based (FHB) interventions [3436], which were offered primarily face-to-face in the form of either group meetings or one-on-one meetings with a healthcare professional. Thus, these FHB interventions are limited due to their time-intensive nature (and the resulting relatively low parental response) [37], as well as a reduced ability to provide the intervention at times that best suit the parents’ needs.

Offering parents an online intervention can help increase parental participation [38]. Moreover, systematic reviews have shown that family-based eHealth interventions may be promising as part of a primary prevention-based strategy designed to improve children’s health [39,40]. In addition, online programs have the potential to: i) engage high-risk parents; ii) maximize reach by overcoming barriers such as a limited availability of trained professionals, geographic restrictions, logistics, social stigma, and distrust; and iii) reduce delivery costs [41]. In the Netherlands, no existing intervention is currently available for parents to follow in their own home at a time that suits them best. To close this gap, we developed a fully self-guided web-based parenting program entitled “Making a healthy deal with your child”, a brief, flexible program that is simple to use, appealing to parents from a variety of demographic backgrounds, and can be incorporated easily into existing interventions for preventing overweight in children.

The purpose of this e-learning program is to improve upon existing interventions by: i) strengthening both the general parenting style and specific parenting practices, and ii) increasing the self-efficacy of parents of children 9–13 years of age [42]. Specifically, this e-learning program is designed to teach parents how to encourage and support their child’s decisions with respect to developing and maintaining healthy EBRBs, as well as how to handle situations in daily life that can jeopardize healthy EBRBs. The theory, content, and structure of this program were derived from the online course entitled “Talking with your child” [43] and are described in detail in our previously published study protocol [44]. In summary, the theory behind this e-learning program is based on the theoretical insights obtained from Parent Effectiveness Training and the Parent Management Training-Oregon Model [45,46]. Using a six-step model, our program shows parents how to improve their communication and problem-solving skills [44]. For the theoretical knowledge regarding dietary, sedentary, and physically active behaviors, we used the guidelines established by the Netherlands Nutrition Center [47] and the Dutch Norm for Healthy Physical Activity [48], which were also used by the Dutch Youth Health Care (YHC) system. The e-learning program’s content was based on the results of focus groups conducted with mothers who live in a low-SES neighborhood in the Netherlands [49]. We chose parents who live in a low-SES neighborhood because these parents are historically difficult to reach with an intervention [50], and childhood overweight is more prevalent in these neighborhoods [5]. In addition, we identified the following five difficult everyday life situations related to healthy EBRBs: i) children having insufficient time in the morning to eat breakfast; ii) the daily struggle at the dining table (children not wanting to eat their vegetables); iii) the child’s continuous desire to eat candy and unhealthy snacks; iv) children spending an excessive amount of time watching television; and v) children spending an excessive amount of time using the computer and not wanting to turn off their computer (e.g., when playing a computer game) when told to do so. We reasoned that if we use these situations and the underlying reasons why parents experience difficulties, many parents would recognize these situations and would be interested in learning parenting skills that would teach them how to deal with these difficult situations in daily life. Thus, we reasoned that many parents would feel more compelled to complete the e-learning program.

The aims of this study were to investigate the effects of this web-based parenting program on: i) dietary, sedentary, and physically active behaviors among children 9–13 years of age who were participating in the existing school-based overweight prevention program entitled “Scoring for Health”; and ii) the parenting styles, EBRB-specific parenting practices, and parental self-efficacy of the parents of these children.

Here, we tested the hypothesis that at 5 and 12 months, the children of parents who received the e-learning program would: i) have a healthier diet (e.g., they would eat more fruit and vegetables, eat breakfast more often, and drink fewer sugar-sweetened beverages); ii) be less sedentary (e.g., would engage in less screen-viewing time); and iii) have a higher level of physical activity compared to both their baseline values and the children whose parents did not receive the e-learning program (i.e., the control condition). The secondary objectives of the e-learning program include strengthening parenting styles, improving specific parenting practices (monitoring, modeling, and applying rules regarding EBRBs), and increasing parental self-efficacy.

Materials and methods

Design of the study

The effectiveness of this web-based parenting program was studied in a two-armed (intervention versus control) cluster randomized controlled trial (RCT).

The study was approved by the Medical Review Ethics Committee of the Arnhem-Nijmegen region in the Netherlands (registration number 2012495, NL4280309112) [44], and the trial is registered with the Dutch Trial Register (NTR3938). This trial is registered at the Dutch Trial Register (NTR3938). All authors confirm that all ongoing and related trials for this intervention are registered.

Participants and protocol

Recruitment and enrolment of participants began at the end of 2012. The baseline data were collected from January 2013 through December 2013. After the baseline data were collected the participants were randomized in February 2013 and September 2013. For each parent–child dyad, the follow-up measurements were collected at fixed time points, 5 and 12 months after the baseline measurements. All parents and children received written information regarding the study [44]. In addition, one researcher (author ER) was present at all classes to provide verbal information regarding the study and answer any questions raised by the children. For this study, we used passive parental consent, which was approved by our Medical Review Ethics Committee.

Inclusion criteria

We recruited parent-child dyads in the Nijmegen region in the Netherlands. To be eligible, the children had to be 9–13 years of age, in the fourth, fifth, or sixth grade of regular primary school, and participating in the existing school-based overweight prevention program entitled “Scoring for Health”. The parents and children were required to both speak and read Dutch. We selected children participating in the “Scoring for Health” program as an illustrative example, as this is a school-based intervention certified by the Center for Healthy Life (in Dutch, the Centrum voor Gezond Leven) in the Netherlands. Moreover, arrangements have been made to offer this intervention to a large group of children each year. Twice a year in the Nijmegen region, children 9–13 years of age are selected to participate in the “Scoring for Health” intervention program, yielding a total of 500 participating children a year.

The aim of the “Scoring for Health” program is to increase the awareness of primary school students (and their parents) regarding the importance of engaging in a healthy lifestyle. The program runs for 20 weeks and begins and ends with a sports clinic at a nearby professional soccer club.

Recruitment

Eleven primary schools in the Nijmegen region in the Netherlands participate in the intervention program “Scoring for Health”, and the principals of these 11 schools were asked to participate in our study. Specifically, we asked the principals’ permission to distribute information to the parents of children in the appropriate grades. The parent-child dyads who were assessed as eligible received a baseline questionnaire as reported previous [44].

Randomization

After the baseline measurements were collected, an independent researcher at the Behavioral Science Institute in the Netherlands randomly assigned all participating school classes to either the intervention condition or the control condition. Randomization was performed centrally at the school grade level class and within schools (to control for school characteristics) using a computerized random number generator with a blocked randomization scheme (block size was 2); the conditions were stratified by ethnicity. If more than one child living in the same household participated in the study, all participating children in that household were assigned to the same condition as the oldest participating child in order to avoid contamination between conditions.

Sample size

The sample size calculations for this study have been reported previously [44]. In brief, using a two-sided test with alpha = 0.05 and a power of 0.80, and taking into account the clustering of children within classes. We assume an average cluster size of 14 and an intraclass correlation coefficient (ICC) of 0.05, based on a study on ICCs for obesity indicators in primary schools in which the ICCs for most outcomes varied between 0.02 and 0.05 [51]. We calculated that we needed 161 parent-child dyads in each condition (i.e., 161 in the intervention condition and 161 in the control condition) in order to detect an increase of 20% in the number of children who meet Dutch standards with respect to dietary, sedentary, and/or physical activity behavior, given an initial compliance rate of 40% (i.e., an increase from 40% to 60%). The assumption of an increase of 20% is based on previous effectiveness studies and school-based programs in children 9–13 years of age [5255].

Program delivery

We sent parents in the intervention condition a personal login code for the e-learning program by email, and parents received a standard brochure from the Dutch Nutrition Center regarding healthy eating and physical activity [56]; this brochure is also distributed by the Dutch YHC organizations. The parents in the control condition received only the brochure. Over a course of ten weeks, the parents in the intervention condition were allowed to complete the e-learning program at their own pace. After finishing each module, the parents received an e-mail to thank them for finishing the module and to encourage them to complete the next module. In addition, we sent reminder e-mails 7 and 12 weeks after providing the log-in code, reminding parents to complete the e-learning program.

The intervention

The e-learning program “Making a healthy deal with your child” consists of five 30-minute modules that are based on five difficult situations encountered in daily life. Each module consists of video fragments in which “good” and “less good” examples of communicating with a child are shown, followed by the six-step problem-solving model, practical and theoretical assignments, and feedback. During the program, parents receive tools that they can use to encourage their child to develop a healthy diet, to be less sedentary, and to engage in regular physical activity during everyday situations. Importantly, the parents can follow the program in their own home, at a time that suits them best.

Measurements

Measurements were collected from the children and parents in both conditions at baseline and again 5 and 12 months after the baseline assessment, as reported previously [44]. The questionnaires were developed using existing validated Dutch questionnaires (or, if no validated questionnaire was available, questionnaires that were used in currently ongoing projects within the Netherlands) [44].

Socio-demographic and other characteristics of the children and parents

The following socio-demographic data were obtained at baseline: the child’s age, gender, and ethnicity, the participating parent’s age and ethnicity, and the highest level of education achieved by both parents, providing an indicator of the family’s SES [57]. Ethnic background was determined by asking the country of birth of the child and both parents. The parents were able to choose from the following six categories: “the Netherlands”, “Turkey”, “Morocco”, “Suriname”, “Netherlands Antilles”, or “other country”. The results were classified using standard procedures established by the Dutch Central Agency for Statistics [58]. The parents’ level of education was based on the highest level achieved of either parent and was classified as follows in accordance with international classification systems [59]: “low” (lower general secondary education, lower vocational training, or primary school), “middle” (intermediate vocational training, higher general secondary training, or pre-university education), and “high” (higher vocational training or university education). The parents’ perception of their child’s weight status was determined at baseline by asking the following question: “What do you think of your child’s weight? The parents were instructed to select the answer that they felt best suited their child’s weight status, and the answers were then classified as follows: “extremely low”, “low”, “normal”, “heavy”, or “extremely heavy”.

Energy balance-related behaviors (EBRBs)

The children’s dietary behavior was assessed by asking both the children and parents how often they consume the following items: i) breakfast, ii) snacks, iii) vegetables, iv) fruit, and v) sugar-sweetened beverages (SSBs). Eight responses were possible, including “never”, “1 day a week”, “2 days a week”, etc., and the amounts were measured in pieces (fruit), serving spoons (vegetables), and glasses (SSBs) per day.

The child’s sedentary behavior was assessed by asking both the children and parents how many days per week the child: i) watches television/videos/DVDs, etc.; and ii) uses the computer (including accessing the Internet and playing computer games). Eight answers were possible, including “never”, “1 day a week”, “2 days a week”, etc. In addition, the amount of time the child spends on these activities on an average day was measured, with the following possible answers: “less than half an hour a day”, “half an hour to 1 hour per day”, “1–2 hours per day”, “2–3 hours a day”, and “3 or more hours a day”.

The child’s physical activity was assessed by asking the both children and parents how many days per week the child: i) plays outside, ii) participates in a sport at a sports club, iii) has gym class at school, and iv) goes to school by walking or riding a bicycle. Eight answers were possible, including “never”, “1 day a week”, “2 days a week”, etc. In addition, the amount of time the child spends on these activities on an average day was measured, with the following possible answers: “less than half an hour a day”, “half an hour to 1 hour per day”, “1–2 hours per day”, “2–3 hours a day”, and “3 or more hours a day”.

All of the child’s EBRBs were then dichotomized as “meets” or “does not meet” the Dutch standard for healthy EBRBs. According to Dutch standards [47,48,56], healthy EBRBs in children include: i) eating breakfast daily; ii) eating at least two pieces of fruit daily; iii) eating at least three serving spoons of vegetables daily; iv) drinking less than two glasses of SSBs daily; v) less than two hours of screen time (watching television and/or using the computer) each day; vi) playing outside for at least one hour each day; and vii) engaging in an organized sport at least twice a week for ≥30 minutes each.

Parenting dimensions

A full description of the scales, scale properties, items, reliability, and examples of items in the parenting dimensions in our sample is provided in Additional File 1 (S1 Appendix). The internal consistency of the instrument ranged from acceptable to good, with Cronbach’s alpha values ranging from 0.62 to 0.80 for the different scales [60], with the exceptions of the parental scale for sedentary behavior role modeling (2-item scale) and physical activity role modeling (6 items), which had Cronbach’s alpha values of 0.41 (unacceptable) and 0.59 (poor), respectively. Total scores were calculated when at least 75% of the questions were answered. The general parenting style was measured using the validated Dutch translation of the Steinberg parenting style instrument [25,61]. This 15-item instrument assesses two parenting style dimensions: the parents’ involvement and general strictness. The following four parenting styles have been established based on these two parenting dimensions: authoritative (high involvement, high strictness), permissive/indulgent (high involvement, low strictness), authoritarian (low involvement, high strictness), and neglectful (low involvement, low strictness). In addition, we generated these four parenting styles by dichotomizing the sample on each dimension (median split) and examining the two dimensions simultaneously.

Parenting practices

The Parental Feeding Style questionnaire [62,63] was completed by both the children and their parents. This questionnaire consists of 27 items used to measure four distinct parental feeding styles: instrumental feeding (i.e., using food to regulate the child’s behavior), emotional feeding (i.e., providing food in response to emotional distress), encouragement to eat (encouraging food variety and interest in food), and control over eating (parental restrictions). Parental policies regarding physical activity (monitoring the child’s physical activity behavior) were assessed via the parental questionnaire, with five items derived from the Dutch translation of the validated Home Environment Survey (HES) [64]. Parental modeling of dietary, sedentary, and physical activity behavior) was assessed via the parental questionnaire, with 20 items derived from the Dutch translation of the HES [64]. Parental EBRB rules were assessed via the parental and child questionnaire. Seven items were derived from the Child Monitor Questionnaire, which is part of the "Local and National Health Monitor" in the Netherlands [57]. Children and parents were asked whether the parents had rules and/or agreements with their child regarding the following eight aspects: i) eating breakfast each morning, ii) consuming snacks, iii) eating vegetables, iv) eating fruit, v) drinking SSBs, vi) total hours per day spent watching television, DVDs, or other videos, vii) total hours per day spent using the computer (including accessing the Internet and/or playing computer games), and viii) total hours per day spent playing outside. The children and parents were instructed to answer each question with the following possible answers: or i) yes, and we stick to them (“strict rules”); ii) yes, but we are flexible with them (“indulgent rules”), or iii) no, we have no rules about it (“no rules”). Parental self-efficacy was assessed in the parental questionnaire, with 16 items derived from the Parenting Sense of Competence [65], and was used to measure two dimensions, namely efficacy and satisfaction.

Process evaluation

We monitored the parents’ willingness to follow the e-learning program and the parents’ satisfaction with the e-learning program. The parents’ login activity in the e-learning program was monitored during the intervention period. This allowed us to monitor which parents started the e-learning program (and which parents did not). This approach also provided information regarding the number of modules each parent completed (dose received) of the in total 5 modules delivered in the e-learning program (dose delivery). Parental satisfaction with the intervention was assessed in the questionnaire given at 5 months by asking “How would you rate the intervention on a scale from 0–10?”

Anthropometry

The children’s height and weight were measured at baseline (i.e., at the start of the “Scoring for Health” program) using a calibrated scale and measuring tape in accordance with established guidelines [66]. All measurements were performed by a YHC professional or trainee, as reported previously [44].

Statistical analysis

We used the Chi-square test and the independent Student’s t‐test in IBM SPSS Statistics 25 [67] to determine whether randomization resulted in a balanced distribution of demographic variables, weight-related characteristics, and baseline primary and/or secondary outcomes. Continuous variables are presented as the mean, and categorical data are presented as the percentage of respondents within each of the possible categories. The degree of agreement among the answers given by the children and parents—the inter-rater reliability—was calculated using the intraclass correlation coefficient (for continuous variables) or Cohen’s kappa (for categorical data). The value for inter-rater reliability ranges from 0 to 1 as follows: 0, no agreement; <0.2, none to slight agreement; 0.2 to <0.4, fair agreement; 0.4 to <0.6, moderate agreement; 0.6 to <0.8, substantial agreement; 0.8 to <1, almost perfect agreement; and 1, full agreement [68]. Moreover, the variables for which the distributions differed between the two conditions were entered as covariates in all models performed to test the effectiveness of the e-learning program. Further, we used the Chi-square test and the independent Student’s t‐test as well to determine whether there was a selective loss to follow-up regarding demographic variables, the weight status of the child and/or parent, and the children’s EBRBs and the parenting dimensions. The effects of the e-learning program on changes in the child’s dietary behavior, sedentary behavior, and physical activity, as well as the parenting style, parenting practices, and parental self-efficacy, were tested in accordance with the intention-to-treat principle (all participants are analyzed in the condition to which they were randomly assigned). Sensitivity analyses were performed using completers-only data (i.e., only the parent-child dyads who completed all three questionnaires). To determine the effectiveness of the intervention, we used linear mixed models in R [69], instead of the planned regression analyses in Mplus as described in the study protocol [44]. Linear mixed models were chosen for two reasons: i) because of the nested structure of the data (i.e., repeated measurements nested within participants, and participants nested within schools), and ii) because multi-level analyses do not delete participants listwise and can more appropriately handle data missing at random [70,71]. The multi-category variables for parental EBRB rules were dichotomized in order to compare between “no rules” and “indulgent/strict rules” and between “strict rules” and “no/indulgent rules”, providing better interpretation of the data. Linear mixed models for continuous outcomes and generalized linear mixed models with logit links for binary outcomes were used. The package lme4 was used for both LMMs and GLMMs [72]. All models included a random effect for students to account for repeated measurements within participants. For each outcome, it was also tested whether it is necessary to additionally account for nesting of students within schools. This additional random factor was only included if the intraclass correlation for the school-level was higher than .05, suggesting significant clustering of students within schools [73,74]. In addition, it was tested whether a random intercept and slope model significantly better fit the data than the more parsimonious random intercept model using log-likelihood ratio tests. If this was the case, the model with random slopes was used. If the more complex models including additional random factors and/or random slopes did not converge or were singular, we used a more parsimonious model, for example by only modelling random intercepts. Time, condition and their higher-order interactions were included as fixed effects in all models. An unstructured covariance structure was used for all models. Because there were two possible starting points of the study, namely i) February 2013, in which participants of 9 schools were randomized, and ii) September 2013, in which participants of another 2 schools were randomized, the variable ‘moment of randomization’ was included as covariate to correct for possible seasonal effects. To adjust for multiple testing, the p-values of the time x condition interaction effects were adjusted using Holm-Bonferroni sequential correction. All models were visually inspected for homogeneity and normal distribution of errors using residuals versus fitted value plots and Q-Q plots. If it was suspected that these assumptions might have been violated, or if a continuous outcome was strongly left or right skewed, we additionally fitted the models with beta-regression using the glmmTMB package [75]. The results from the beta-regression models were then compared with linear mixed models. Since the outcomes from the linear and beta models did not lead to substantially different conclusions, only linear mixed models results were reported for continuous outcomes. To determine treatment effects at each of the follow-up timepoints, pairwise post-hoc comparisons of estimated marginal means by time and condition were performed using the emmeans package. For pairwise comparisons, p-values were adjusted using the Tukey-method to account for multiple testing. An α of 0.05 was used to indicate statistical significance for all analyses. The results have been reported in accordance with CONSORT (Consolidated Standards of Reporting Trials) guidelines [76,77].

Results

Study participation

Of the 548 parent-child dyads who were assessed for eligibility, 475 (87%) completed the baseline questionnaire (T0), 360 of whom (76%) participated in either the intervention or control condition and completed the 5-month follow-up assessment (T1). Finally, 341 of the 475 participants (72%) completed the 12-month follow-up assessment (T2); see Fig 1.

Fig 1. CONSORT flow diagram depicting the enrolment, allocation, follow-up, and analysis for the indicated number of parent-child dyads*.

Fig 1

*In the completers-only framework, 164 and 177 parent-child dyads were analyzed in the intervention and control condition, respectively.

In the entire study population, we found no selective loss to follow-up with respect to the parent or child’s age, gender, ethnicity, or weight status, or the parent’s level of education. When we examined loss to follow-up in the two conditions, we found that the loss to follow-up was higher in the intervention condition than in the control condition (p = 0.001). We found no selective loss to follow-up in the intervention condition. In the control condition, however, we found that the loss to follow-up was higher among non-Caucasian children (p = 0.010 vs. Caucasian children) and children that were overweight (p = 0.024 vs. children that were not overweight).

Demographics and weight-related characteristics

The baseline demographic characteristics of all 475 parent-child dyads are summarized in Table 1. We found no difference between the intervention and control conditions; moreover, we found no difference between conditions of the completers-only as well (see S2 Appendix). Overall, approximately 7% of the participating children were non-Caucasian, a third of the parents had a low level of education, one-fifth of the children were overweight or obese, and nearly half of the parents were overweight or obese.

Table 1. Demographics and weight-related characteristics of the entire study population.

Intervention condition
N = 252
N (%)
Control condition
N = 223
N (%)
p-value
Child
Age, years (mean ± SD) 10.4 ± 1.1 10.4 ± 1.1 0.802a
Gender
 Male 136 (54.0) 117 (52.5)
 Female 116 (46.0) 106 (47.5) 0.743b
Ethnicity
 Caucasian 242 (96.1) 208 (93.3)
 Non-Caucasian 10 (3.9) 15 (6.7) 0.592b
Weight status based on BMI
 Not overweight 205 (81.7) 177 (79.4)
 Overweight 38 (15.1) 41 (18.4)
 Obese 8 (3.2) 5 (2.2) 0.546b
Parent
Age, years (mean ± SD) 42.4 ± 4.8 42.3 ± 4.8 0.828a
Ethnicity
 Caucasian 94.4% 92.8%
 Non-Caucasian 5.6% 7.2% 0.622b
Education level
 Low 79 (31.5) 72 (32.9)
 Middle 127 (50.6) 107 (48.9)
 High 45 (17.9) 40 (18.3) 0.928b
Weight status based on BMI
 Not overweight 129 (54.2) 121 (55.8)
 Overweight 75 (31.5) 60 (27.6)
 Obese 34 (14.3) 36 (16.6) 0.603b

Unless indicated otherwise, data are presented as N (%).

a Student’s t-test;

b Chi-square test.

Children’s EBRBs and parenting characteristics

The children’s EBRBs and the parenting characteristics at baseline are summarized in Table 2. We found no statistically significant difference between the intervention and control condition, with the exceptions of the child’s “SSB intake” according to the parents, and “sports”. Moreover, we found no difference in “SSB intake” in the completers-only (see S3 Appendix); therefore, we excluded the variable “sports” from further analyses. According to both the children and the parents, more than 80% of the children eat breakfast daily; however, less than 30% of the children eat vegetables daily, eat 2 or more portions of fruit daily, drink fewer than 2 glasses of SSBs daily, and/or play outside at least 1 hour each day.

Table 2. Baseline Characteristics of the children’s EBRBs and the parenting dimensions and inter-rater reliability (IRR) within n = 475 parent-child dyads.

According to the children According to the parents Agreement among answers parent-child
Intervention
N (%)
Control
N (%)
Intervention
N (%)
Control
N (%)
IRR
Dietary behavior (mean ± SD)
Days of having breakfast per week 6.6 ± 1.1 6.6 ± 1.2 6.7 ± 0.8 6.7 ± 0.8 0.38
Portions of fruit per week 15.6 ± 9.3 14.9 ± 9.1 11.1 ± 6.8 10.8 ± 7.4 0.45
Serving spoons of vegetables per week 12.6 ± 6.1 12.7 ± 6.3 10.1± 4.6 10.2 ± 4.7 0.25
Glasses of SSBs per week 31.9 ± 25.4 28.8 ± 23.9 23.3 ± 14.6) 22.4 ± 14.7 0.27
Dutch standards for dietary behavior
Daily breakfast 209 (82.9) 188 (84.3) 216 (86.1) 185 (84.1) 0.31
Daily vegetables 70 (27.8) 66 (29.6) 59 (23.7) 43 (19.5) 0.21
Daily 2 pieces of fruit 51 (20.2) 40 (17.9) 14 (5.6) 9 (4.1) 0.20
Daily <2 glasses of SSBs 53 (21.3) 55 (25.1) 54 (22.9) 64 (31.4)* 0.31
Sedentary behavior and physical activity (mean ± SD)
Minutes screen time per week 707.5 ± 615.8 777.7 ± 603.4 1003.9 ± 479.2 1023.7 ± 446.9 0.26
Minutes playing outside per week 600.1 ± 433.0 623.3 ± 462.6 479.8 ± 317.7 469.8 ± 318.2 0.44
Minutes physical active per week 1095.1 ± 616.2 1050.4 ± 579.5 941.5 ± 440.7 893.0 ± 394.4 0.44
Dutch standards for sedentary behavior and physical activity
Daily ≤120 minutes screen time 171 (68.1) 144 (65.2) 92 (36.9) 82 (37.3) 0.19
Dutch standard healthy Exercise 224 (89.2) 189 (84.8) 223 (89.2) 199 (90.5) 0.29
Play outside ≥1 hour daily 73 (29.2) 68 (30.8) 38 (19.0) 36 (18.7) 0.23
Playing sport 2 days a week 199 (79.0) 144 (64.9)^ 205 (81.7) 150 (67.9)^ 0.70
Playing sports 2 days a week ≥30 minutes 197 (78.5) 139 (62.9)^ 199 (79.6) 146 (66.4)^ 0.66
General parenting
Authoritative parenting style - - 82 (33.1) 65 (29.4) -
Authoritative parenting style (arbitrary) - - 234 (94.4) 204 (92.3) -
Monitoring (mean ± SD) Parental feeding style score
Control over eating 3.6 ± 0.63 3.6 ± 0.68 4.1 ± 0.49 4.1 ± 0.42 0.22
Emotional feeding 1.6 ± 0.66 1.5 ± 0.69 1.3 ± 0.45 1.3 ± 0.44 0.15
Encouragement to eat 2.8 ± 0.81 2.8 ± 0.81 3.7 ± 0.57 3.6 ± 0.58 0.17
Instrumental feeding 1.7 ± 0.72 1.7 ± 0.70 1.5 ± 0.57 1.5 ± 0.57 0.16
Physical activity score - - 3.6 ± 0.62 3.6 ± 0.56 -
Modeling (mean ± SD)
Intake of food score - - 3.9 ± 0.40 4.0 ± 0.40 -
Sedentary behavior score - - 2.7 ± 0.52 2.6 ± 0.59 -
Physical activity score - - 3.4 ± 0.45 3.4 ± 0.45 -
Setting of rules
Breakfast 0.13
No 40 (15.9) 37 (16.6) 27 (10.7) 23 (10.4)
Yes, indulgent 27 (10.8) 14 (6.3) 17 (6.7) 17 (7.7)
Yes, strict 184 (73.3) 172 (77.1) 208 (82.5) 181 (81.9)
Snacks 0.08
No 52 (20.6) 53 (23.8) 40 (16.0) 36 (16.4)
Yes, indulgent 80 (31.7) 70 (31.4) 108 (43.2) 89 (40.5)
Yes, strict 120 (47.6) 100 (44.8) 102 (40.8) 95 (43.2)
Vegetables 0.13
No 51 (20.5) 46 (20.6) 33 (13.1) 24 (10.9)
Yes, indulgent 50 (20.1) 38 (17.0) 69 (27.5) 63 (28.6)
Yes, strict 148 (59.4) 139 (62.3) 149 (59.4) 133 (60.5)
Fruit 0.14
No 95 (37.8) 97 (43.9) 60 (23.8) 66 (30.0)
Yes, indulgent 65 (25.9) 47 (21.3) 85 (33.7) 62 (28.2)
Yes, strict 91 (36.3) 77 (34.8) 107 (42.5) 92 (41.8)
SSBs 0.16
No 82 (32.7) 82 (36.9) 52 (20.8) 46 (20.9)
Yes, indulgent 84 (33.5) 54 (24.3) 76 (30.4) 67 (30.5)
Yes, strict 85 (33.9) 86 (38.7) 122 (48.8) 107 (48.6)
Watching television 0.18
No 111 (44.6) 107 (48.0) 85 (34.0) 79 (35.7)
Yes, indulgent 84 (33.7) 65 (29.1) 109 (43.6) 107 (48.4)
Yes, strict 54 (21.7) 51 (22.9) 56 (22.4) 35 (15.8)
Using the computer 0.17
No 99 (39.3) 77 (34.5) 70 (28.1) 58 (26.2)
Yes, indulgent 64 (25.4) 63 (28.3) 114 (45.8) 107 (48.4)
Yes, strict 89 (35.3) 83 (37.2) 65 (26.1) 56 (25.3)
Playing outside -0.02
No 193 (76.9) 163 (73.1) 158 (63.2) 141 (63.8)
Yes, indulgent 34 (13.5) 36 (16.1) 79 (31.6) 69 (31.2)
Yes, strict 24 (9.6) 24 (10.8) 13 (5.2) 11 (5.0)
Parental self-efficacy (mean ± SD)
Parenting Sense of Competence - - 76.8 ± 8.2 76.9 ± 8.8 -

Unless indicated otherwise, data are presented as N (%).

* p≤0.05;

# p≤0.01;

^ p≤.001.

Interestingly, the children indicated that their EBRBs are healthier compared to what their parents indicated. In addition, 68% of the children reported that engage in ≤120 minutes of screen time per day, compared to only 36% of parents who reported that their child engages in ≤120 minutes of screen time per day. Overall, the degree of the inter-rater reliability (IRR) among the children and parents as reported in Table 2 ranged from no agreement to fair agreement, except for the variables vegetables eaten per week, minutes playing outside per week, and minutes of physical active per week, which had moderate agreement; moreover, IRR indicated substantial agreement with respect to sports. Finally, >80% of parents reported that they have strict rules regarding their child eating breakfast, whereas approximately 30% of parents reported that they have no rules regarding watching television and >60% of parents reported that they have no rules regarding playing outside.

Effects of the e-learning program

The effects of the e-learning program on the children’s EBRBs and parenting dimensions according to the results of the intention-to-treat analysis are summarized in Tables 3 and 4, and the completers-only sensitivity analyses are shown in Additional file 4 (S4 Appendix).

Table 3. Estimated marginal means per condition and measurement point and time by condition interactions for continuous outcomes (Intention-to-treat).

According to children According to parents
T0 T1 T2 Time x condition T0 T1 T2 Time x condition
Condition M (SE) M (SE) M (SE) p-value Adj. p-value M (SE) M (SE) M (SE) p-value Adj. p-value
Dietary behavior (days/week)
Breakfast CON 6.54 (0.13) 6.66 (0.13) 6.55 (0.14) 0.875 1.000 6.54 (0.13) 6.66 (0.13) 6.55 (0.14) 0.545 1.000
INT 6.60 (0.12) 6.59 (0.12) 6.59 (0.13) 6.60 (0.12) 6.59 (0.12) 6.59 (0.13)
Vegetables CON 5.68 (0.09) 5.71 (0.09) 5.78 (0.09) 0.643 1.000 5.51 (0.08) 5.44 (0.08) 5.57 (0.08) 0.631 1.000
INT 5.59 (0.09) 5.68 (0.09) 5.64 (0.09) 5.61 (0.08) 5.71 (0.08) 5.70 (0.08)
Fruit CON 5.30 (0.20) 5.34 (0.20) 5.10 (0.21) 0.642 1.000 5.51 (0.08) 5.44 (0.08) 5.57 (0.08) 0.446 1.000
INT 5.20 (0.19) 5.28 (0.19) 4.92 (0.19) 5.61 (0.08) 5.71 (0.08) 5.70 (0.08)
Dietary behavior (amount/week)
Serving spoons of CON 12.6 (0.42) 11.7 (0.40) 11.7 (0.39) 0.856 1.000 10.0 (0.33) 10.1 (0.35) 10.5 (0.35) 0.509 1.000
vegetables INT 12.5 (0.40) 11.9 (0.38) 11.6 (0.37) 10.1 (0.32) 10.4 (0.35) 10.8 (0.34)
Fruit portions CON 15.3 (1.02) 15.6 (0.90) 14.2 (0.84) 0.479 1.000 11.3 (0.70) 14.7 (0.72) 14.1 (0.71) 0.138 1.000
INT 15.7 (0.96) 15.5 (0.84) 14.1 (0.77) 11.6 (0.64) 15.6 (0.68) 15.2 (0.67)
Glasses of SSBs CON 14.9 (0.66) 15.3 (0.62) 14.0 (0.61) 0.093 1.000 23.0 (1.05) 21.4 (1.02) 20.1 (0.96) 0.443 1.000
INT 15.6 (0.62) 15.4 (0.59) 14.0 (0.59) 23.8 (0.99) 20.0 (1.01) 22.0 (0.920
Sedentary behavior
Screen time CON 796 (63.8) 704 (58.8) 797 (62.9) 0.572 1.000 996 (41.8) 852 (43.4) 1001 (42.8) 0.768 1.000
(min/week) INT 707 (58.6) 701 (54.2) 741 (58.5) 975 (38.5) 904 (41.7) 965 (40.5)
Physical activity
Playing outside CON 630 (44.0) 654 (44.1) 443 (44.2) 0.145 1.000 489 (29.8) 576 (31.0) 395 (30.6) 0.646 1.000
(min/week) INT 609 (40.9) 682 (41.1) 483 (41.5) 497 (27.4) 611 (29.8) 385 (29.0)
Physical active CON 1024 (78.5) 1060 (71.5) 982 (69.7) 0.688 1.000 903 (33.2) 1026 (34.8) 914 (34.3) 0.041 0.820
(min/week) INT 1075 (74.6) 1161 (67.8) 1006 (65.8) 953 (30.6) 1064 (34.0) 875 (32.7)
General parenting
Involvement CON - - - - - 12.0 (0.23) 12.4 (0.25) 12.3 (0.24) 0.082 1.000
INT - - - - - 12.6 (0.22) 12.3 (0.25) 12.3 (0.24)
Strictness CON - - - - - 7.13 (0.27) 6.84 (0.29) 6.66 (0.28) 0.952 1.000
INT - - - - - 7.23 (0.26) 6.69 (0.29) 6.79 (0.28)
Parental feeding style
Control over eating CON 3.65 (0.05) 3.73 (0.05) 3.71 (0.05) 0.299 1.000 4.14 (0.03) 4.08 (0.04) 4.01 (0.04) 0.966 1.000
eating INT 3.64 (0.05) 3.64 (0.04) 3.63 (0.04) 4.12 (0.03) 4.07 (0.04) 3.99 (0.03)
Emotional feeding CON 1.55 (0.05) 1.49 (0.04) 1.42 (0.04) 0.016 0.224 1.35 (0.03) 1.37 (0.03) 1.31 (0.03) 0.299 1.000
INT 1.59 (0.04) 1.40 (0.04) 1.32 (0.04) 1.34 (0.03) 1.34 (0.03) 1.34 (0.03)
Encouragement CON 2.85 (0.06) 2.88 (0.06) 2.86 (0.06) 0.217 1.000 3.64 (0.04) 3.67 (0.04) 3.62 (0.05) 0.979 1.000
to eat INT 2.86 (0.06) 2.72 (0.06) 2.78 (0.06) 3.74 (0.04) 3.78 (0.04) 3.73 (0.05)
Instrumental CON 1.70 (0.05) 1.55 (0.04) 1.48 (0.04) 0.545 1.000 1.50 (0.04) 1.53 (0.04) 1.43 (0.04) 0.464 1.000
feeding INT 1.71 (0.05) 1.55 (0.04) 1.45 (0.04) 1.53 (0.04) 1.48 (0.04) 1.43 (0.04)
Monitoring CON 3.63 (0.07) 3.58 (0.08) 3.47 (0.08) 0.061 0.793 3.67 (0.04) 3.61 (0.04) 3.51 (0.04) 0.061 1.000
physical activity INT 3.60 (0.07) 3.66 (0.07) 3.53 (0.07) 3.62 (0.04) 3.68 (0.04) 3.55 (0.04)
Modeling
Intake of food CON - - - - - 3.96 (0.03) 3.93 (0.03) 3.95 (0.03) 0.098 1.000
INT - - - - - 3.92 (0.03) 3.91 (0.03) 3.97 (0.03)
Sedentary CON - - - - - 2.62 (0.04) 2.68 (0.04) 2.64 (0.04) 0.744 1.000
behavior INT - - - - - 2.66 (0.04) 2.69 (0.04) 2.70 (0.04)
Physical activity CON - - - - - 3.43 (0.03) 3.49 (0.03) 3.43 (0.03) 0.310 1.000
INT - - - 3.42 (0.03) 3.49 (0.03) 3.46 (0.03)
Parental self-efficacy
Parenting sense CON - - - - - 76.9 (0.62) 76.6 (0.64) 77.8 (0.63) 0.735 1.000
of competence INT - - - - - 76.8 (0.59) 76.5 (0.63) 77.4 (0.62)

CON = Control condition; INT = Intervention condition.

Table 4. Observed probabilities per condition and measurement point and time by condition interactions for dichotomized outcomes.

According to children According to parents
T0 T1 T2 Time x condition T0 T1 T2 Time x condition
Condition Prob (SD) Prob (SD) Prob (SD) p-value Adj. p-value Prob (SD) Prob (SD) Prob (SD) p-value Adj. p-value
Dietary behavior (daily)
Breakfast CON 0.84 (0.02) 0.89 (0.02) 0.85 (0.02) 0.733 1.000 0.84 (0.02) 0.86 (0.03) 0.88 (0.02) 0.780 1.000
INT 0.83 (0.02) 0.84 (0.02) 0.85 (0.02) 0.86 (0.02) 0.91 (0.02) 0.90 (0.02)
Vegetables CON 0.30 (0.03) 0.30 (0.03) 0.33 (0.03) 0.653 1.000 0.20 (0.03) 0.20 (0.03) 0.26 (0.03) 0.839 1.000
INT 0.28 (0.03) 0.30 (0.03) 0.28 (0.03) 0.24 (0.03) 0.29 (0.04) 0.33 (0.03)
> 2 portions of CON 0.18 (0.03) 0.15 (0.02) 0.15 (0.02) 0.358 1.000 0.04 (0.01) 0.13 (0.03) 0.09 (0.02) 0.318 1.000
fruit INT 0.20 (0.03) 0.19 (0.03) 0.12 (0.02) 0.06 (0.01) 0.12 (0.02) 0.12 (0.02)
<2 glasses of SSBs CON 0.25 (0.03) 0.25 (0.03) 0.30 (0.03) 0.383 1.000 0.31 (0.03) 0.31 (0.03) 0.32 (0.03) 0.212 1.000
INT 0.21 (0.03) 0.24 (0.03) 0.30 (0.03) 0.23 (0.03) 0.31 (0.04) 0.29 (0.03)
Sedentary behavior
Daily ≤ 120 min CON 0.65 (0.03) 0.70 (0.03) 0.62 (0.03) 0.991 1.000 0.37 (0.03) 0.49 (0.04) 0.36 (0.03) 0.564 1.000
screen time INT 0.68 (0.03) 0.68 (0.03) 0.67 (0.03) 0.37 (0.03) 0.45 (0.04) 0.37 (0.03)
Physical activity
Dutch standard CON 0.63 (0.03) 0.69 (0.03) 0.60 (0.03) 0.587 1.000 0.66 (0.03) 0.72 (0.03) 0.69 (0.03) 0.024 0.528
exercise INT 0.78 (0.03) 0.82 (0.03) 0.75 (0.03) 0.80 (0.03) 0.83 (0.03) 0.77 (0.03)
Play outside >1 CON 0.31 (0.03) 0.36 (0.03) 0.16 (0.03) 0.511 1.000 0.23 (0.03) 0.33 (0.04) 0.19 (0.03) 0.979 1.000
hour daily INT 0.29 (0.03) 0.37 (0.03) 0.18 (0.03) 0.25 (0.03) 0.43 (0.04) 0.19 (0.03)
General parenting
Authoritative CON - - - - 0.29 (0.03) 0.31 (0.03) 0.31 (0.03) 0.677 1.000
parenting style INT - - - 0.33 (0.03) 0.29 (0.03) 0.33 (0.03)
Setting of rules
Breakfast
 No CON 0.17 (0.02) 0.19 (0.03) 0.14 (0.02) 0.187 1.000 0.10 (0.02) 0.07 (0.02) 0.10 (0.02) 0.973 1.000
INT 0.16 (0.02) 0.21 (0.03) 0.19 (0.03) 0.11 (0.02) 0.14 (0.03) 0.10 (0.02)
 Indulgent CON 0.06 (0.02) 0.08 (0.02 0.11 (0.02) 0.08 (0.02) 0.07 (0.02) 0.05 (0.02)
INT 0.11 (0.02) 0.13 (0.02) 0.12 (0.02) 0.07 (0.02) 0.05 (0.02) 0.07 (0.02)
 Strict CON 0.77 (0.03) 0.74 (0.03) 0.74 (0.03) 0.776 1.000 0.82 (0.03) 0.86 (0.03) 0.81 (0.03) 0.642 1.000
INT 0.73 (0.03) 0.66 (0.03) 0.69 (0.03) 0.83 (0.02) 0.81 (0.03) 0.84 (0.03)
Snacks
 No CON 0.24 (0.03) 0.19 (0.03) 0.22 (0.03) 0.161 1.000 0.16 (0.03) 0.11 (0.02) 0.14 (0.02) 0.753 1.000
INT 0.21 (0.03) 0.20 (0.03) 0.26 (0.03) 0.16 (0.03) 0.16 (0.03) 0.14 (0.02)
 Indulgent CON 0.31 (0.03) 0.40 (0.03) 0.35 (0.03) 0.40 (0.03) 0.43 (0.04) 0.44 (0.04)
INT 0.32 (0.03) 0.39 (0.03) 0.36 (0.03) 0.43 (0.03) 0.47 (0.04) 0.45(0.04)
 Strict CON 0.45 (0.03) 0.40 (0.03) 0.43 (0.03) 0.182 1.000 0.43 (0.03) 0.45 (0.04) 0.42 (0.04) 0.809 1.000
INT 0.48 (0.03) 0.41 (0.03) 0.38 (0.03) 0.41 (0.03) 0.37 (0.04) 0.41 (0.03)
Vegetables
 No CON 0.21 (0.03) 0.22 (0.03) 0.21 (0.03) 0.235 1.000 0.11 (0.02) 0.08 (0.02) 0.13 (0.02) 0.580 1.000
INT 0.20 (0.03) 0.29 (0.03) 0.27 (0.03) 0.13 (0.02) 0.15 (0.03) 0.11 (0.02)
 Indulgent CON 0.17 (0.03) 0.20 (0.03) 0.21 (0.03) 0.29 (0.03) 0.31 (0.03) 0.28 (0.03)
INT 0.20 (0.03) 0.24 (0.03) 0.24 (0.03) 0.27 (0.03) 0.28 (0.03) 0.23 (0.03)
 Strict CON 0.62 (0.03) 0.59 (0.03) 0.59 (0.03) 0.249 1.000 0.60 (0.03) 0.61 (0.04) 0.59 (0.04) 0.378 1.000
INT 0.59 (0.03) 0.48 (0.03) 0.49 (0.03) 0.59 (0.03) 0.57 (0.04) 0.66 (0.03)
Fruit
 No CON 0.44 (0.03) 0.43 (0.03) 0.45 (0.03) 0.046 1.000 0.30 (0.03) 0.22 (0.03) 0.28 (0.03) 0.863 1.000
INT 0.38 (0.03) 0.45 (0.03) 0.49 (0.03) 0.24 (0.03) 0.23 (0.03) 0.21 (0.03)
 Indulgent CON 0.21 (0.03) 0.24 (0.03) 0.22 (0.03) 0.28 (0.03) 0.37 (0.04) 0.33 (0.03)
INT 0.26 (0.03) 0.26 (0.03) 0.24 (0.03) 0.34 (0.03) 0.31 (0.04) 0.35 (0.03)
 Strict CON 0.35 (0.03) 0.33 (0.03) 0.32 (0.03) 0.194 1.000 0.42 (0.03) 0.41 (0.04) 0.39 (0.04) 0.534 1.000
INT 0.36 (0.03) 0.29 (0.03) 0.27 (0.03) 0.42 (0.03) 0.46 (0.04) 0.44 (0.03)
SSBs
 No CON 0.37 (0.03) 0.35 (0.03) 0.36 (0.03) 0.934 1.000 0.21 (0.03) 0.18 (0.03) 0.14 (0.03) 0.370 1.000
INT 0.33 (0.03) 0.29 (0.03) 0.32 (0.03) 0.21 (0.03) 0.19 (0.03) 0.18 (0.03)
 Indulgent CON 0.24(0.03) 0.22 (0.03) 0.31 (0.03) 0.30 (0.03) 0.30 (0.03) 0.41 (0.04)
INT 0.33 (0.03) 0.36 (0.03) 0.35 (0.03) 0.30 (0.03) 0.28 (0.03) 0.38 (0.03)
 Strict CON 0.39 (0.03) 0.44 (0.03) 0.33 (0.03) 0.495 1.000 0.49 (0.03) 0.51 (0.04) 0.45 (0.04) 0.780 1.000
INT 0.34(0.03) 0.35 (0.03) 0.32 (0.03) 0.49 (0.03) 0.53 (0.04) 0.44 (0.04)
Watching television
 No CON 0.48 (0.03) 0.49 (0.03) 0.48 (0.03) 0.866 1.000 0.36 (0.03) 0.30 (0.03) 0.35 (0.03) 0.056 1.000
INT 0.45 (0.03) 0.47 0.03) 0.43 (0.03) 0.34 (0.03) 0.23 (0.03) 0.25 (0.03)
 Indulgent CON 0.29 (0.03) 0.26 (0.03) 0.35 (0.03) 0.48 (0.03) 0.54 (0.04) 0.48 (0.04)
INT 0.34 (0.03) 0.28 (0.03) 0.35 (0.03) 0.44 (0.03) 0.53 (0.04) 0.50 (0.04)
 Strict CON 0.23 (0.03) 0.25 (0.03) 0.17 (0.03) 0.238 1.000 0.16 (0.02) 0.16 (0.03) 0.17 (0.03) 0.964 1.000
INT 0.22 (0.03) 0.25 (0.03) 0.22 (0.03) 0.22 (0.03) 0.23 (0.03) 0.24(0.03)
Using the computer
 No CON 0.35 (0.03) 0.34 (0.03) 0.41 (0.03) 0.190 1.000 0.26 (0.03) 0.24 (0.03) 0.26 (0.03) 0.021 0.483
INT 0.39 (0.03) 0.37 (0.03) 0.40 (0.03) 0.28 (0.03) 0.19 (0.03) 0.22 (0.03)
 Indulgent CON 0.28 (0.03) 0.36 (0.03) 0.32 (0.03) 0.48 (0.03) 0.50 (0.04) 0.50 (0.04)
INT 0.25 (0.03) 0.29 (0.03) 0.30 (0.03) 0.46 (0.03) 0.45 (0.04) 0.44 (0.04)
 Strict CON 0.37 (0.03) 0.30 (0.03) 0.27 (0.03) 0.209 1.000 0.25 (0.03) 0.26 (0.03) 0.24 (0.03) 0.094 1.000
INT 0.35 (0.03) 0.34 (0.03) 0.31 (0.03) 0.26 (0.03) 0.35 (0.04) 0.34 (0.03)
Playing outside
 No CON 0.73 (0.03) 0.75 (0.03) 0.77 (0.03) 0.817 1.000 0.64 (0.03) 0.54 (0.04) 0.63 (0.03) 0.211 1.000
INT 0.77 (0.03) 0.83 (0.03) 0.80 (0.03) 0.63 (0.03) 0.50 (0.04) 0.56 (0.04)
 Indulgent CON 0.16 (0.02) 0.14 (0.02) 0.14 (0.02) 0.31 (0.03) 0.42 (0.04) 0.32 (0.03)
INT 0.14 (0.02) 0.12(0.02) 0.14 (0.02) 0.32 (0.03) 0.39 (0.04) 0.36 (0.03)
 Strict CON 0.11 (0.02) 0.11 (0.02) 0.09 (0.02) 0.701 1.000 0.05(0.01) 0.04 (0.02) 0.05 (0.02) 0.045 0.945
INT 0.10 (0.02) 0.06 (0.02) 0.07 (0.02) 0.05 (0.01) 0.10 (0.02) 0.09 (0.02)

The multicategory variables for parental EBRB rules were dichotomized in order to compare between “no rules” and “indulgent/strict rules” and between “strict rules” and “no/indulgent rules”. Therefore 2 p-values for each parental EBRB rules are presented.

Based on both the children’s responses and the parents’ responses to the questionnaires, and after adjusting for multiple testing, we found no significant differences in the changes over time between the intervention and control condition with respect to the children’s diet, sedentary behavior or physical activity behavior. In addition, post-hoc pairwise comparisons showed no significant difference between conditions at any of the follow-up times.

Effects of the e-learning program on parenting dimensions

Based on both the children’s responses and the parents’ responses to the questionnaires, and after adjusting for multiple testing, we found no significant differences in the change over time between the intervention and control condition with respect to parenting dimensions, including general parenting, specific EBRB-guided parenting (e.g., monitoring, modeling, and establishing EBRB rules), or parental self-efficacy. In addition, post hoc pairwise comparisons showed no significant difference between conditions at any of the follow-up times.

Process evaluation

In the intention-to-treat approach, 171 of the 252 parent-child dyads (68%) in the intervention condition actually started the e-learning program; 109 of these 171 parents (64%) completed 2 or more modules, while 85 of these parents (50%) completed all 5 modules of the e-learning program (dose received). Of the 81 parent-child dyads in the intervention condition who did not start the e-learning program, 18 (22%) did not have access to the e-learning program due to an incorrect e-mail address (see Fig 2 and Table 5 in S5 Appendix). Failing to start using the e-learning program was more common among non-Caucasian parents compared to Caucasian parents (p = 0.009) and among parents with a low level of education compared to parents with a medium or high level of education (p = 0.029). In contrast, we found no significant differences between the parents who did not start the e-learning program and the parents who completed 2 or more modules with respect to other demographics or weight-related characteristics (see Table 6 in S5 Appendix). Moreover, the significant differences noted above were not found in the completers-only framework. Finally, the parents’ mean (±SD) satisfaction with the e-learning program (on a 10-point scale) was 7.0±1.1.

Discussion

The aim of this study was to determine the added value of including our e-learning parenting program entitled “Making a healthy deal with your child” in addition to the existing school-based overweight prevention program “Scoring for Health”. The intention-to-treat analyses and completers only sensitivity analyses revealed no significant differences in the changes over time between the intervention and the control condition with respect to the EBRBs of the child, or to parenting dimensions. We initially found that parents in the intervention condition used an emotional feeding style less often and more frequently set rules regarding using the computer; however, these effects were no longer significant after correcting for multiple testing. In addition, our evaluations of the program revealed that the e-learning program was well received by the parents, and parents were generally satisfied with it.

Our results are not in line with the results reported by Gerards et al., who studied the effectiveness of the parenting program “Lifestyle Triple P” [78] who found some positive effects with respect to EBRBs of children; however, it is important to note that Gerards et al. study included younger children (4–8 years of age) than our study (9–13 years of age), and all children in their study were overweight or obese, and their program included ten face-to-face group meetings and four individual telephone interviews.

Our results regarding the failure to find intervention effects on parenting skills are also not in line with the results reported by Leijten et al. [79], who examined the effectiveness of the parental program entitled “Talking with your child”, and of which we used the theory for the development of our e-learning “Making a healthy deal with your child”, and a meta-analysis by Nieuwboer et al. who found that knowledge can be increased, and attitudinal and behavioral aspects of parenting can be influenced by online programs, leading to the conclusion that the Internet is not only a source of information, but can also be an instrument for parental support and training [80].

Our finding that the e-learning program had no apparent effects can lead to different conclusions. In fact, using the optimal intervention requires combining the appropriate target/objectives for an intervention, matching the intervention with a well-chosen target group, and identifying the ideal intervention to use. This process is also known as selecting the ideal ‘target-target group-intervention combination’ [81]. This can have several practical implications. First, the target may need to be adjusted as the measurements are affected by so many variables and factors that, when combined with the general target group to which the intervention was tested, any effects may be averaged out. Second, the target group to which we offered the intervention may have been too general, and/or had insufficient urgency regarding the need to change their parenting skills. For example, Gerards et al. included only parents of children with overweight and/or obesity [78], while Leijten et al. included only parents who experienced parenting difficulties [79]. Because this was not the case in our intervention, it may be possible that our intervention should be offered more targeted parental groups, for example, parents of children with unhealthy EBRBs and/or with overweight. However, systematic reviews by both Bleich et al. and Wang et al. showed that the most promising interventions are delivered in school settings that include a home component [82,83]. In addition, based on their review, Tomayko et al.’s findings support including a parental component in school-based treatment and prevention programs designed to improve the child’s weight and/or weight status outcome [23]. Lastly, our findings indicate that the program has room for improvement, as the intervention was not used intensively enough. The intensity at which the parents in our study were exposed to the intervention also warrants discussion. We found that 64% of parents in the intervention condition who started the e-learning program completed 2 or more modules, with 50% of parents completing all 5 modules (the total delivery dose). However, if we consider all 252 parent-child dyads in the intervention condition (i.e., both the group of parents who started the program and the group of parents who never started the program), only 43% and 34% of all parents assigned to the intervention condition completed 2 or more modules or all 5 modules, respectively. Following 2 or more of the 5 modules is the minimum requirement to be considered sufficiently exposed to the e-learning program. Thus, in our study only 43% of the total intervention condition was sufficiently exposed to the intervention. Therefore, the relatively low percentage of parents who were sufficiently exposed to the intervention may explain why we found no apparent difference between the intervention and control conditions, making it difficult to determine whether the intervention was actually effective given the high percentage of parents (57%) who were not sufficiently exposed to the intervention. Nevertheless, the parents’ evaluations showed that the program was generally well received. For example parents were enthusiastic with respect to the simple use of the e-learning program and the fact that the program can be followed in their home at a time that suits them best. In addition, the theory, content, and structure of this program were derived from an online course entitled “Talking with your child”, which was based on other successful behavioral themes [43]. In addition, we used a relatively minimal engagement strategy. Our goal was to develop a self-guided web-based parenting program that can be added easily to existing overweight-prevention programs such as existing school-based/population-based interventions, thereby maximizing integration and minimizing costs. In one respect, this minimal-engagement strategy was successful, as 68% of parents started the intervention, with 64% of them completing at least 2 of the 5 modules, and 50% completing all 5 modules. Unfortunately, despite this relatively high level of involvement we found that the intervention had no apparent effects on either parenting skills or the children’s EBRBs. Using additional strategies to increase engagement in addition to sending two email reminders may have increased the percentage of parents who participated in the intervention, thus increasing the likelihood of revealing an intervention effect. In their supportive accountability model, Mohr et al. argue that human support increases adherence by increasing accountability to a coach who is seen as trustworthy, benevolent, and having expertise, moderated by motivational factors such as the communication media used (e.g., face-to-face, telephone, or email) [84]. However, we expect that parents of children in a high-risk group will be more willing to change their child’s EBRBs, feel a stronger sense of urgency to change their parenting skills, and would therefore be more motivated to use the e-learning program. We would therefore expect a higher percentage of parents to follow the e-learning program, thus revealing intervention effects. Moreover, we expect to find more room for improvement among the high-risk group with respect to improving parenting skills and their child’s EBRBs. On the other hand, if we target a high-risk group who are currently under the care of a health-care professional, it should be easier to increase engagement, as a trusted health-care professional is already involved and can provide the parents with face-to-face support, increasing their likelihood of starting—and ideally, completing—the e-learning program. This healthcare professional can also make follow-up appointments with the parents, and use this appointment also to discuss whether the e-learning program was completed successfully, or—if necessary—encourage them to complete the e-learning program. Due to the parents’ positive evaluations and enthusiasm regarding the program’s simplicity and flexibility, we believe that the next step is to first select a more appropriate (i.e. high-risk) target group and conduct further research in that context.

Strengths and limitations

The strengths of our study include its cluster RCT design, the relatively large sample size, and the fact that we collected data at baseline, 5 months, and 12 months, which enabled us to analyze the relatively short-term and long-term effects of the program. Furthermore, our insights into which parents began the e-learning program (taking into account the child’s socio-demographic characteristics and weight status), and which parents did not start the program, as well as how many modules the parents completed, provided valuable information regarding which parents are—and just as important, which parents are not—reached using this intervention, thus helping to maximize the scope of the e-learning program.

The e-learning program itself also has several strengths. First, the program is theory-driven and based on difficult situations experienced in daily life by most parents. Second, the program consists of multiple components, including video fragments, a six-step problem-solving model, assignments, and feedback, which is important given that reports have shown that multi-component programs can yield more effects than single-component programs [22,85]. Third, because the e-learning program is web-based, parents can follow it in the comfort of their own home, in their own time and at their own pace; moreover, the program is not complex or time-consuming. Finally, the children’s baseline EBRBs and the prevalence of overweight and obesity in our sample are consistent with children in the general Dutch population; therefore, we believe that our sample provided a reasonably good representation of parents and their children, and the results are not likely biased due to selective participation [86].

Despite its strengths, this study has some limitations that warrant discussion. First, we cannot rule out the possibility that the more highly motivated parents completed the e-learning program, which may limit our ability to generalize our results to all parents. Second, using a within-school design (as opposed to a between-school design) may have introduced contamination effects between the intervention and control conditions. To minimize this possibility, the same brochure was given to the parents in the intervention condition and the control condition, while only the parents in the intervention condition received a personal login code in order to start the e-learning program. Third, the information regarding the behaviors of the children and parents was obtained entirely using self-reporting questionnaires completed by the children and parents, which may have resulting in over-reporting and/or under-reporting due social desirability and/or recall bias and may contribute to unreliability of the reported data [87]. To minimize social desirability and optimize measurement validity, we stressed full confidentiality (i.e., anonymity) to our participants. To minimize recall bias, the interval between the events being recalled and the questionnaire was relatively short (participants were asked to recall events from the past month or week), which likely also increased the self-reporting reliability. To increase reliability it may have been better to use accelerometers to report physical activity; however, for determining whether the children meet or did not meet the Dutch standard for healthy exercise, a questionnaire may be appropriate [88]. Fourth, the amount of time parents needed to complete the program is relatively short, with 5 modules of approximately 30 minutes each; thus, program was not necessarily expected to have a robust effect.

Practical implications and conclusions

Despite the parent’s overall satisfaction regarding the e-learning program and the ease with which our e-learning program can be integrated into the “Scoring for health” program, we found no significant differences between the intervention and control condition. Nevertheless, our results provide new insights into the factors that both contribute to and foster intervention effects, thus leading to further improvements in our e-learning program and possibly other universally implemented programs for overweight prevention. Demonstrating effects of our e-learning program was potentially complicated by the fact that we studied the effects in children in a school-based setting, in which many children may already have engaged in healthy EBRBs. Thus, the e-learning program may have beneficial effects if added to an existing overweight-prevention program currently being offered to high-risk groups, for example in the Youth Health Care or in a hospital setting, in which we expect the parents will feel a stronger sense of urgency and therefore be more motivated to use the e-learning program. Future research should test the effectiveness of this e-learning program specifically in high risk groups, such as parents of children with unhealthy EBRBs, and/or with overweight, thus providing more information regarding the benefits of this program in this specific target population.

Supporting information

S1 Appendix. Overview of parenting scale.

(DOCX)

S2 Appendix. Demographic and weight-related characteristics of study population (Completers-only).

(DOCX)

S3 Appendix. Baseline characteristics of children’s EBRB and parenting dimensions (Completers only).

(DOCX)

S4 Appendix. Effects of the e-learning on the EBRBs of the child and parenting dimensions (Completers-only).

(DOCX)

S5 Appendix. Process evaluation.

(DOCX)

Acknowledgments

This study is part of the Dutch project CIAO (Consortium Integrated Approach Overweight) in which several studies are investigating elements of a coherent integrated multi-sector approach based on the principles of the French program Ensemble Prévenons l’Obésité Des Enfants (EPODE; in English, “Together Let’s Prevent Childhood Obesity”) [89]. We thank Hans Bör of the Radboud University Medical Center for help with the power calculation. In addition, we would like to thank all the interns who assisted in this research.

Abbreviations

SES

Socio-economic status

EBRBs

Energy balance-related behaviors (EBRBs)

FHB

Family-and-home-based

YHC

Youth Health Care

RCT

Randomized controlled trial

SSBs

Sugar-sweetened beverages

HES

Home Environment Survey

CONSORT

Consolidated Standards of Reporting Trials

IRR

Inter-rater reliability

Data Availability

The dataset used in this manuscript is available from the Radboudumc DANSEASY data repository at https://doi.org/10.17026/dans-22t-bgfz.

Funding Statement

This study was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMw; project number 505010296015, 200100001). This funder had no role in study design, data collection and analysis, interpretation of the data, decision to publish the results, or preparation of the manuscript.

References

  • 1.Wang Y. and Lobstein T., Worldwide trends in childhood overweight and obesity. Int J Pediatr Obes, 2006. 1(1): p. 11–25. doi: 10.1080/17477160600586747 [DOI] [PubMed] [Google Scholar]
  • 2.Daniels S.R., Complications of obesity in children and adolescents. Int J Obes (Lond), 2009. 33(1): p. S60–5. doi: 10.1038/ijo.2009.20 [DOI] [PubMed] [Google Scholar]
  • 3.Organization, W.H. Childhood overweight and obesity. [Word Wide Web] 2013; Available from: http://www.who.int/dietphysicalactivity/childhood/en/.
  • 4.Fredriks A.M., et al., Alarming prevalences of overweight and obesity for children of Turkish, Moroccan and Dutch origin in The Netherlands according to international standards. Acta Paediatr, 2005. 94(4): p. 496–8. doi: 10.1111/j.1651-2227.2005.tb01923.x [DOI] [PubMed] [Google Scholar]
  • 5.Wang Y. and Lim H., The global childhood obesity epidemic and the association between socio-economic status and childhood obesity. International Review of Psychiatry, 2012. 24(3): p. 176–188. doi: 10.3109/09540261.2012.688195 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Schonbeck Y., et al., Increase in prevalence of overweight in Dutch children and adolescents: a comparison of nationwide growth studies in 1980, 1997 and 2009. PLoS One, 2011. 6(11): p. e27608. doi: 10.1371/journal.pone.0027608 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Schönbeck, Y. and S. Buuren, van, Factsheet: Resultaten Vijfde Landelijke Groeistudie [Results of Fifth Dutch Growth Study]. 2010, TNO.
  • 8.Cislak A., et al., Family-related predictors of body weight and weight-related behaviours among children and adolescents: a systematic umbrella review. Child Care Health Dev, 2012. 38(3): p. 321–31. doi: 10.1111/j.1365-2214.2011.01285.x [DOI] [PubMed] [Google Scholar]
  • 9.statistiek, C.b.v.d. Statline Youth Monitor Lifestyle: overweight [Statline Jeugdmonitor Leefstijl: overgewicht]. 2020. Den Haag, the Netherlands.
  • 10.statistiek, C.B.v.d., Statline Youth Monitor Lifestyle: overweight [Statline Jeugdmonitor Leefstijl: overgewicht]. 2018, Centraal Bureau voor de statistiek: Den Haag.
  • 11.Zwiauer K.F., Prevention and treatment of overweight and obesity in children and adolescents. Eur J Pediatr, 2000. 159 Suppl 1: p. S56–68. doi: 10.1007/pl00014367 [DOI] [PubMed] [Google Scholar]
  • 12.Biro F.M. and Wien M., Childhood obesity and adult morbidities. Am J Clin Nutri, 2010. 91(5): p. 1499S–1505S. doi: 10.3945/ajcn.2010.28701B [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Kremers S.P., Theory and practice in the study of influences on energy balance-related behaviors. Patient education and counseling, 2010. 79(3): p. 291–298. doi: 10.1016/j.pec.2010.03.002 [DOI] [PubMed] [Google Scholar]
  • 14.Swinburn B., Egger G., and Raza F., Dissecting obesogenic environments: the development and application of a framework for identifying and prioritizing environmental interventions for obesity. Preventive medicine, 1999. 29(6): p. 563–570. doi: 10.1006/pmed.1999.0585 [DOI] [PubMed] [Google Scholar]
  • 15.Lindsay A.C., et al., The role of parents in preventing childhood obesity. Future Child, 2006. 16(1): p. 169–86. doi: 10.1353/foc.2006.0006 [DOI] [PubMed] [Google Scholar]
  • 16.Golan M. and Crow S., Parents are key players in the prevention and treatment of weight-related problems. Nutr Rev, 2004. 62(1): p. 39–50. doi: 10.1111/j.1753-4887.2004.tb00005.x [DOI] [PubMed] [Google Scholar]
  • 17.Pinard C.A., et al., Measures of the home environment related to childhood obesity: a systematic review. Public Health Nutr, 2012. 15(1): p. 97–109. doi: 10.1017/S1368980011002059 [DOI] [PubMed] [Google Scholar]
  • 18.Faith M.S., et al., Evaluating parents and adult caregivers as "agents of change" for treating obese children: evidence for parent behavior change strategies and research gaps: a scientific statement from the American Heart Association. Circulation, 2012. 125(9): p. 1186–207. doi: 10.1161/CIR.0b013e31824607ee [DOI] [PubMed] [Google Scholar]
  • 19.St. George S.M., et al., A developmental cascade perspective of paediatric obesity: A systematic review of preventive interventions from infancy through late adolescence. Obesity reviews, 2020. 21(2): p. e12939. doi: 10.1111/obr.12939 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.van der Kruk J.J., et al., Obesity: a systematic review on parental involvement in long-term European childhood weight control interventions with a nutritional focus. Obes Rev, 2013. doi: 10.1111/obr.12046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Snoek, H.M., et al., Parental involvement in intervention on chilhood obesity. 2010, GGD Regio Nijmegen (report CIAO phase 1): Wageningen/Nijmegen, the Netherlands.
  • 22.Waters E., et al., Interventions for preventing obesity in children. Cochrane Database Syst Rev, 2011(12): p. CD001871. doi: 10.1002/14651858.CD001871.pub3 [DOI] [PubMed] [Google Scholar]
  • 23.Tomayko E.J., et al., Parent involvement in diet or physical activity interventions to treat or prevent childhood obesity: An umbrella review. Nutrients, 2021. 13(9): p. 3227. doi: 10.3390/nu13093227 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Gerards S.M., et al., Interventions addressing general parenting to prevent or treat childhood obesity. Int J Pediatr Obes, 2011. 6(2–2): p. e28–45. doi: 10.3109/17477166.2011.575147 [DOI] [PubMed] [Google Scholar]
  • 25.Darling N. and Steinberg L., Parenting style as context: An integrative model. Psychological Bulletin, 1993. 113(3): p. 487–496. [Google Scholar]
  • 26.Baumrind D., Child Care Practices Anteceding Three Patterns of Preschool Behavior. Genetic Psychology Monographs, 1967. 75(1): p. 43–88. [PubMed] [Google Scholar]
  • 27.Maccoby E.E. and Martin J.A., Socialization in the context of the family: parent-child interaction. Handbook of child psychology 1983. 4: p. 1–101. [Google Scholar]
  • 28.Baranowski T., et al., School-based obesity prevention: a blueprint for taming the epidemic. American Journal of Health Behavior, 2002. 26(6): p. 486–493. doi: 10.5993/ajhb.26.6.9 [DOI] [PubMed] [Google Scholar]
  • 29.Sharma S., et al., Adherence to the food guide pyramid recommendations among African Americans and Latinos: results from the Multiethnic Cohort. Journal of the American Dietetic Association, 2004. 104(12): p. 1873–1877. doi: 10.1016/j.jada.2004.08.033 [DOI] [PubMed] [Google Scholar]
  • 30.Summerbell C.D., et al., Interventions for preventing obesity in children. Cochrane database of systematic reviews, 2005(3). doi: 10.1002/14651858.CD001871.pub2 [DOI] [PubMed] [Google Scholar]
  • 31.Thomas H., Obesity prevention programs for children and youth: why are their results so modest? Health education research, 2006. 21(6): p. 783–795. doi: 10.1093/her/cyl143 [DOI] [PubMed] [Google Scholar]
  • 32.Brown T. and Summerbell C., Systematic review of school‐based interventions that focus on changing dietary intake and physical activity levels to prevent childhood obesity: an update to the obesity guidance produced by the National Institute for Health and Clinical Excellence. Obesity reviews, 2009. 10(1): p. 110–141. doi: 10.1111/j.1467-789X.2008.00515.x [DOI] [PubMed] [Google Scholar]
  • 33.Shaya F.T., et al., School‐based obesity interventions: a literature review. Journal of School Health, 2008. 78(4): p. 189–196. doi: 10.1111/j.1746-1561.2008.00285.x [DOI] [PubMed] [Google Scholar]
  • 34.Ash T., et al., Family-based childhood obesity prevention interventions: a systematic review and quantitative content analysis. International Journal of Behavioral Nutrition and Physical Activity, 2017. 14(1): p. 113. doi: 10.1186/s12966-017-0571-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Golan M. and Crow S., Targeting parents exclusively in the treatment of childhood obesity: Long‐Term results. Obesity, 2004. 12(2): p. 357–361. doi: 10.1038/oby.2004.45 [DOI] [PubMed] [Google Scholar]
  • 36.Nowicka P. and FLODMARK C.E., Family in pediatric obesity management: a literature review. Pediatric Obesity, 2008. 3(S1): p. 44–50. doi: 10.1080/17477160801896994 [DOI] [PubMed] [Google Scholar]
  • 37.Warren J.M., et al., Randomised controlled trials in overweight children: practicalities and realities. Pediatric Obesity, 2007. 2(2): p. 73–85. doi: 10.1080/17477160601133671 [DOI] [PubMed] [Google Scholar]
  • 38.Knowlden A. and Sharma M., Systematic review of family and home‐based interventions targeting paediatric overweight and obesity. Obesity Reviews, 2012. 13(6): p. 499–508. doi: 10.1111/j.1467-789X.2011.00976.x [DOI] [PubMed] [Google Scholar]
  • 39.Kemp B.J., et al., Effectiveness of family-based eHealth interventions in cardiovascular disease risk reduction: A systematic review. Preventive Medicine, 2021. 149: p. 106608. doi: 10.1016/j.ypmed.2021.106608 [DOI] [PubMed] [Google Scholar]
  • 40.Hammersley M.L., Jones R.A., and Okely A.D., Parent-focused childhood and adolescent overweight and obesity eHealth interventions: a systematic review and meta-analysis. Journal of medical Internet research, 2016. 18(7): p. e5893. doi: 10.2196/jmir.5893 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Love S.M., et al., Social media and gamification: Engaging vulnerable parents in an online evidence-based parenting program. Child abuse & neglect, 2016. 53: p. 95–107. [DOI] [PubMed] [Google Scholar]
  • 42.Ruiter E.L.M., et al., The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9–13 years of age: study protocol for a two-armed cluster randomized controlled trial. Submitted, 2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Online cursus: Praten met uw kind [Online course: Talking with your child]. Available from: http://www.pratenmetuwkind.nl/.
  • 44.Ruiter E.L., et al., The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9–13 years of age: study protocol for a two-armed cluster randomized controlled trial. BMC public health, 2015. 15(1): p. 148. doi: 10.1186/s12889-015-1394-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Gordon T., Parent effectiveness training: a preventive program and its effects on families. 1980, New York: Wyden Books. [Google Scholar]
  • 46.Forgatch M.S., Patterson G.R., and DeGarmo D.S., Evaluating Fidelity: Predictive Validity for a Measure of Competent Adherence to the Oregon Model of Parent Management Training. Behavior Therapy, 2005. 36(1): p. 3–13. doi: 10.1016/s0005-7894(05)80049-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Voedingscentrum, Richtlijnen Voedselkeuze [Guidelines for food choices]. 2011: Den Haag.
  • 48.Kemper H.G.C., Ooijendijk W.T.M., and Stiggelbout M., Consensus over de Nederlandse Norm voor Gezond Bewegen [Consensus on the Dutch Standard for Healthy Physical Activity]. Tijdschrift voor gezondheidswetenschappen, 2000. 78(3): p. 180–183. [Google Scholar]
  • 49.Ruiter E.L., et al., Everyday life situations in which mothers experience difficulty stimulating healthy energy balance–related behavior in their school-age children: a focus group study. BMC public health, 2019. 19(1): p. 701. doi: 10.1186/s12889-019-6826-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Fransen G.A., Koster M., and Molleman G.R., Towards an integrated community approach of overweight prevention: the experiences of practitioners and policymakers. Fam Pract, 2012. 29 Suppl 1: p. i104–i109. doi: 10.1093/fampra/cmr123 [DOI] [PubMed] [Google Scholar]
  • 51.Gray H.L., et al., Intraclass correlation coefficients for obesity indicators and energy balance–related behaviors among New York City public elementary schools. Health Education & Behavior, 2016. 43(2): p. 172–181. doi: 10.1177/1090198115598987 [DOI] [PubMed] [Google Scholar]
  • 52.De Lijster-van Kampen, G.P.A., M. Gomez-Tromp, and P.L. Kocken, Evaluatie Door Dik en Dun: Resultaten van een pilotonderzoek naar de effecten van een behandelprogramma bij kinderen met overgewicht of obesitas in de leeftijd van 8–12 jaar [Results of a pilot study on the effects of a treatment program for overweight or obese children aged 8–12 years]. 2010, TNO Kwaliteit van Leven.
  • 53.Howerton M.W., et al., School-based nutrition programs produced a moderate increase in fruit and vegetable consumption: meta and pooling analyses from 7 studies. J Nutr Educ Behav, 2007. 39(4): p. 186–96. doi: 10.1016/j.jneb.2007.01.010 [DOI] [PubMed] [Google Scholar]
  • 54.Reynolds K.D., et al., Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project. Prev Med, 2000. 30(4): p. 309–19. doi: 10.1006/pmed.1999.0630 [DOI] [PubMed] [Google Scholar]
  • 55.Robinson T.N., Reducing children’s television viewing to prevent obesity: a randomized controlled trial. JAMA, 1999. 282(16): p. 1561–7. doi: 10.1001/jama.282.16.1561 [DOI] [PubMed] [Google Scholar]
  • 56.Voedingscentrum, Gezond eten en bewegen met kinderen van 9–13 jaar [Healthy eating and physical activity with children 9–13 years of age]. the Netherlands.
  • 57.Kindermonitor. Vragenlijst kindermonitor 4–12 jarigen 2009–2010 [Child monitor questionnaire for children 4–12 years of age]. 2009; Available from: http://www.ggdgelderlandzuid.nl/~/media/Files/ggd-gelderland/ggd-nijmegen/Onderzoeksrapporten/Kinderen%20regio%20Nijmegen/Kindermonitor%20regio%20Nijmegen%202009%202010/Vragenlijst%20Kindermonitor%204–12%20jarigen%202009-2010.ashx.
  • 58.Keij, I., Hoe doet het CBS dat nou? Standaarddefinitie allochtonen [How does Statistics Netherlands that? Standard Definition immigrants]. in Index no. 10. 2000, CBS [Statistics Netherlands].
  • 59.Eurostat, Task force on core social variables. Final report. 2007, European Communities: Luxembourg.
  • 60.Allen, P., K. Bennett, and B. Heritage, SPSS statistics version 22: A practical guide. 2014: Cengage Learning Australia.
  • 61.van Grieken A., et al., Population-based childhood overweight prevention: outcomes of the ‘Be active, eat right’study. PloS one, 2013. 8(5): p. e65376. doi: 10.1371/journal.pone.0065376 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Wardle J., et al., Parental feeding style and the inter-generational transmission of obesity risk. Obes Res, 2002. 10(6): p. 453–62. doi: 10.1038/oby.2002.63 [DOI] [PubMed] [Google Scholar]
  • 63.Sleddens E.F., et al., Relationship between parental feeding styles and eating behaviours of Dutch children aged 6–7. Appetite, 2010. 54(1): p. 30–6. doi: 10.1016/j.appet.2009.09.002 [DOI] [PubMed] [Google Scholar]
  • 64.Gattshall M.L., et al., Validation of a survey instrument to assess home environments for physical activity and healthy eating in overweight children. Int J Behav Nutr Phys Act, 2008. 5: p. 3. doi: 10.1186/1479-5868-5-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Johnston C. and Mash E.J., A measure of parenting satisfaction and efficacy. Journal of clinical child psychology, 1989. 18(2): p. 167–175. [Google Scholar]
  • 66.Frederiks, A.M., et al., Handleiding bij het meten en wegen van kinderen en invullen van groeidiagrammen [Manual measuring and weighing of children and completing growth charts]. 2002, Leiden: TNO/LUMC.
  • 67.IBMCorp Ibm, S., statistics for windows, version 25.0. Armonk, NY: IBM Corp, 2017. [Google Scholar]
  • 68.Landis J.R. and Koch G.G., The measurement of observer agreement for categorical data. biometrics, 1977: p. 159–174. [PubMed] [Google Scholar]
  • 69.Team, R.C., R: A language and environment for statistical computing. 2013.
  • 70.Singer J.D., Willett J.B., and Willett J.B., Applied longitudinal data analysis: Modeling change and event occurrence. 2003: Oxford university press. [Google Scholar]
  • 71.Gueorguieva R. and Krystal J.H., Move over anova: progress in analyzing repeated-measures data andits reflection in papers published in the archives of general psychiatry. Archives of general psychiatry, 2004. 61(3): p. 310–317. doi: 10.1001/archpsyc.61.3.310 [DOI] [PubMed] [Google Scholar]
  • 72.Bates D., et al., Package ‘lme4’. Version, 2018. 1(17): p. 437. [Google Scholar]
  • 73.Scott M.A., Simonoff J.S., and Marx B.D., The SAGE handbook of multilevel modeling. 2013: Sage. [Google Scholar]
  • 74.Theobald E., Students are rarely independent: When, why, and how to use random effects in discipline-based education research. CBE—Life Sciences Education, 2018. 17(3): p. rm2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Magnusson A., et al., Package ‘glmmTMB’. R Package Version 0.2. 0, 2017. [Google Scholar]
  • 76.Begg C., et al., Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA, 1996. 276(8): p. 637–9. doi: 10.1001/jama.276.8.637 [DOI] [PubMed] [Google Scholar]
  • 77.Moher D., et al., The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Clin Oral Investig, 2003. 7(1): p. 2–7. doi: 10.1007/s00784-002-0188-x [DOI] [PubMed] [Google Scholar]
  • 78.Gerards S.M., et al., The effectiveness of lifestyle triple P in the Netherlands: a randomized controlled trial. PLoS One, 2015. 10(4): p. e0122240. doi: 10.1371/journal.pone.0122240 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Leijten P., Overbeek G., and Janssens J.M., Effectiveness of a parent training program in (pre)adolescence: evidence from a randomized controlled trial. J Adolesc, 2012. 35(4): p. 833–42. doi: 10.1016/j.adolescence.2011.11.009 [DOI] [PubMed] [Google Scholar]
  • 80.Nieuwboer C.C., Fukkink R.G., and Hermanns J.M., Online programs as tools to improve parenting: A meta-analytic review. Children and Youth Services Review, 2013. 35(11): p. 1823–1829. [Google Scholar]
  • 81.Molleman G.R., et al., Project quality rating by experts and practitioners: experience with Preffi 2.0 as a quality assessment instrument. Health education research, 2006. 21(2): p. 219–229. doi: 10.1093/her/cyh058 [DOI] [PubMed] [Google Scholar]
  • 82.Bleich S.N., et al., Interventions to prevent global childhood overweight and obesity: a systematic review. The Lancet Diabetes & Endocrinology, 2018. 6(4): p. 332–346. [DOI] [PubMed] [Google Scholar]
  • 83.Wang Y., et al., What childhood obesity prevention programmes work? A systematic review and meta‐analysis. Obesity reviews, 2015. 16(7): p. 547–565. doi: 10.1111/obr.12277 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Mohr D., Cuijpers P., and Lehman K., Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. Journal of medical Internet research, 2011. 13(1): p. e1602. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Kropski J.A., Keckley P.H., and Jensen G.L., School-based obesity prevention programs: an evidence-based review. Obesity (Silver Spring), 2008. 16(5): p. 1009–18. doi: 10.1038/oby.2008.29 [DOI] [PubMed] [Google Scholar]
  • 86.Van der Star, M., Kindermonitor 2010: Gezondheidsonderzoek kinderen 0–12 jaar regio Nijmegen [Child Monitor 2010: Health research in children 0–12 years of age in the Nijmegen region, the Netherlands]. 2010, GGD Nijmegen: Nijmegen.
  • 87.Prince S.A., et al., A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review. International journal of behavioral nutrition and physical activity, 2008. 5(1): p. 1–24. doi: 10.1186/1479-5868-5-56 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Määttä S., et al., Validity of self-reported out-of-school physical activity among Finnish 11-year-old children. Archives of Public Health, 2016. 74(1): p. 1–5. doi: 10.1186/s13690-016-0123-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.van Koperen M.T., et al., Design of CIAO, a research program to support the development of an integrated approach to prevent overweight and obesity in the Netherlands. BMC Obesity, 2014. 1(1): p. 5. doi: 10.1186/2052-9538-1-5 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Lee Van Horn

21 Oct 2021

PONE-D-21-30893

The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9-13 years of age: results of a two-armed cluster randomized controlled trial

PLOS ONE

Dear Dr. Ruiter,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The decision for this paper is a difficult one. Let me start by saying that I believe it is important to publish this paper, its just a difficult situation. On the one hand you have taken the appropriate steps, registering the clinical trial, publishing a study protocol, and then for the most part following that protocol in this paper. On the other hand, I have many of the same concerns that are raised by the statistical reviewer as well as a few others. I think you should know where I’m coming from as an editor, while I’m trained as a social scientist, my primary role is as a methodologist, I’ve been the primary statistical methods person on multiple randomized and group randomized trials, some targeting physical activity and weight loss. I am also a reviewer for major clinical trials grants in the area. If I had reviewed either the grant application or the study protocol paper I would have had reservations about the statistical methods proposed (doing analyses in Mplus with TYPE = COMPLEX, failure to account for multiple testing, dichotomizing outcomes, treating T1 and T2 as separate outcomes, reporting both ITT and completers only analysis) and would have requested major revisions. So, now the question I’m facing is how to reconcile the desire to stay true to the published protocol paper versus moving forward with results that do not meet the standard I would expect from a clinical trial. My overall decision at this point is to request major revisions which try to address these issues. I’ll also note that I held off sending this paper out to content specific reviewers because I wanted to see if the statistics reviewer had the same concerns I did, and because the substantive reviews will likely be better if these other issues are fixed.

Several things seem straight forward to me: 1) the protocol paper did not include per-protocol analyses, I believe that these need to be dropped or if they are retained they need to be done using Complier Average Causal Effects analyses appropriate for cluster randomized trials (there is a paper out there on doing this by Booil Jo), but these are difficult analyses to do and I would want the code and output included so that they could be checked; 2) the protocol paper did not mention how multiple outcomes would be tested, this is really a major problem, you have 13 outcomes multiplied by two different reporters (parents and children) and two different time points, so 52 different analyses for 3 different types of analyses. The trial registration includes 7 primary outcomes, only a little bit better. This needs to be addressed and I’m not sure that you have many options at this point, but the end result is likely that there are no reliable differences between treatment and control groups; 3) Your actual statistical analyses need to be made clear. You simply report that you used Mplus with type=complex, this is not the statistical analysis, it is just the software used. As the statistical reviewer mentions, the models used need to be reported in careful detail with all predictors and outcomes specified, assumptions tested, and variance components reported; 4) the justification for the sample size calculations needs to be made in much more detail including both the ICC assumptions and the effect size assumptions along with references; 5) Missing data and imputation needs to be described in more detail.

Now the difficult things. First of all is your use of Mplus and type=complex to account for the clustering in the data. I’m going to start by nothing that you are wrong about this being multilevel analysis, when you use the type=complex option Mplus simply adjusts the standard errors of your effects for clustering using a sandwich estimator, but this is not a multilevel regression model. The first reason I don’t typically suggest Mplus for multilevel models is that users often don’t understand what is happening, the second is that many Mplus features are not well documented and it really isn’t clear what sandwich estimator is employed. In any case, this should be similar to more typical implementations of GEE. While GEE can be acceptable in GRTs for correcting for clustering, it isn’t very efficient and the approach recommended by the reviewer is clearly the standard. A recent paper by Turner et al (American J of Public Health) discusses some of these issues. If the protocol paper wasn’t published I would feel quite strongly (along with the stats reviewer) that the current analyses should be completely replaced with the conventional multilevel models recommended by the reviewer. However, given the existence of the protocol paper, my suggestion is that the ITT and completers analyses stays as is (with the full model including all covariates and variance parameter estimates described) but that the analyses suggested by the reviewer be included in an appendix and any discrepancies noted. There really shouldn’t be large discrepancies if everything was done right, and my reason for asking for this is that it will greatly increase my confidence that everything was done right.

Second, were covariates included in these analyses? Also, was the analyses the outcome at time T controlling for baseline or was it change scores? If covariates were not included, why not? I agree with the reviewer that baseline values for weight as other variables should have been included, the protocol paper is not clear about how or if this will be done.

Third, I’m not sure that all of your effect sizes are even in the correct direction for the few significant treatment effects. Looks like there were more sweetened beverages consumed in the treatment than control groups? Also, some of the significance tests in the completers only table seem to be off? Oh, the use of superscripts to indicate which effects are significant for which set of analyses doesn’t work at all. You should probably just report the full results of the ITT and then, separately, of the completers-only analyses (again, dropping the protocol analyses).

I’ve noted several other issues. One is that I doubt that substantive reviewers would be impressed with your outcomes for the dietary or physical activity measures. On the trials I’ve been on we have ignored self or parent reported PA and focused exclusively on accelerometer measured PA because of concerns about bias as well as unreliability.  Obviously you can’t change this now, but it needs to be a very important discussion point and the issues with the measures need to be made very clear.

Another issue which is really major is that I do not think you have interpreted these results correctly. You conclude that, “our web-based parenting program yields promising effects…” and when I look at your results the ITT analyses (these should be the gold standard) truly show no effects if you do any meaningful correction for multiple comparisons. Again, it looks to me like some of your results are in the wrong direction which also suggests no overall effects. The completers only analyses looks about the same to me. My best guess looking at these results is that this study has more evidence of no effects than of effects, the only place where you see something is the per-protocol analyses but those results are well known to be biased the way you did them.

My final note is that I disagree with the reviewer about dropping the tables with parameter estimates and standard errors, I would focus more rather than less on them.

Please submit your revised manuscript by Dec 05 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Lee Van Horn, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3.  Please provide the original, full-length study protocol, or project proposal, that you submitted to your ethics committee for review and approval prior to study commencement. This document should typically contain a background section, detailed description of the methods used (including information about dates of recruitment, participant characteristics, inclusion/exclusion criteria, detailed descriptions of the protocols/interventions utilized, plans for outcome assessment and data collection/analysis, and references). Please note that we require this to be submitted with your manuscript in both the original language version and a version translated into English.

4.  Thank you for submitting your clinical trial to PLOS ONE and for providing the name of the registry and the registration number. The information in the registry entry suggests that your trial was registered after patient recruitment began. PLOS ONE strongly encourages authors to register all trials before recruiting the first participant in a study.

As per the journal’s editorial policy, please include in the Methods section of your paper:

a) your reasons for your delay in registering this study (after enrolment of participants started);

b) confirmation that all related trials are registered by stating: “The authors confirm that all ongoing and related trials for this drug/intervention are registered

5. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

"This study was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMw; project number 505010296015), which played no role in the design of execution of this study, the analysis or interpretation of the data, or the decision to publish the results."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

"This study was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMw; project number 505010296015, 200100001). This funder had no role in study design, data collection and analysis, interpretation of the data,  decision to publish the results, or preparation of the manuscript."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

6. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Sample size: why the intra class correlation is set at a low level of 0.05?

Missing data: what method was used for imputation? There are discrepancies between ITT and per-protocol analysis. It is better to try different method of imputation and evaluate the consistency. Did you consider Race and overweight which are significantly correlated with loss to follow-up?

Data analysis:

Not sure what “multilevel multiple regression” is. It seems that it is better to use generalized linear mixed models (GLMM) for the clustered and repeated dichotomous measure. In the GLMM, the random cluster and time should be tested for significant. The time * intervention interaction should also be tested.

What baseline characteristics were adjusted in the model? How did you adjust for Race and overweight which are significantly correlated with loss to follow-up? This needs careful consideration and discussion.

If multiple children in the same family were recruited, was the correlation within the same family adjusted in your model?

For so many outcomes, p values need to be adjusted for multiple tests.

Results:

Table 1: separate overweight and obesity

Table 3 can be omitted. Add the p values to Table 4.

Similarly, for table 5 report OR, 95% CI and p values. Do not report regression coefficients.

Add p values to Table 6.

Needs more consideration and discussion about the discrepancies between ITT and per-protocol results.

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Oct 21;17(10):e0276168. doi: 10.1371/journal.pone.0276168.r002

Author response to Decision Letter 0


4 Feb 2022

Response to Editor and Statistical reviewer

PONE-D-21-30893

The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9-13 years of age: results of a two-armed cluster randomized controlled trial

Response to comments Academic Editor PLOS ONE: Lee Van Horn, PhD

Dear Dr. Ruiter,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The decision for this paper is a difficult one. Let me start by saying that I believe it is important to publish this paper, its just a difficult situation. On the one hand you have taken the appropriate steps, registering the clinical trial, publishing a study protocol, and then for the most part following that protocol in this paper. On the other hand, I have many of the same concerns that are raised by the statistical reviewer as well as a few others. I think you should know where I’m coming from as an editor, while I’m trained as a social scientist, my primary role is as a methodologist, I’ve been the primary statistical methods person on multiple randomized and group randomized trials, some targeting physical activity and weight loss. I am also a reviewer for major clinical trials grants in the area. If I had reviewed either the grant application or the study protocol paper I would have had reservations about the statistical methods proposed (doing analyses in Mplus with TYPE = COMPLEX, failure to account for multiple testing, dichotomizing outcomes, treating T1 and T2 as separate outcomes, reporting both ITT and completers only analysis) and would have requested major revisions. So, now the question I’m facing is how to reconcile the desire to stay true to the published protocol paper versus moving forward with results that do not meet the standard I would expect from a clinical trial. My overall decision at this point is to request major revisions which try to address these issues. I’ll also note that I held off sending this paper out to content specific reviewers because I wanted to see if the statistics reviewer had the same concerns I did, and because the substantive reviews will likely be better if these other issues are fixed.

Several things seem straight forward to me:

1) the protocol paper did not include per-protocol analyses, I believe that these need to be dropped or if they are retained they need to be done using Complier Average Causal Effects analyses appropriate for cluster randomized trials (there is a paper out there on doing this by Booil Jo), but these are difficult analyses to do and I would want the code and output included so that they could be checked;

- Thank you for your advice. For this reason we removed the per-protocol analyses. In the Method section in line 372-374 we removed the text “, and in a per-protocol framework (i.e., parent-child dyads who completed all three questionnaires and parents in the intervention group who completed at least two of the e-learning modules)”.

- In the result section in line 513-525 and in line 564-574 we removed the results of the per-protocol analyses.

- In the discussion section in line 618-619 we removed the text “and per protocol analyzes”.

- In the abstract in line 41-45 and the discussion section in line 621-625 we removed the text “Per protocol analyses also revealed additional positive effects with respect to the child’s consumption of fruits and vegetables, playing outside, being physical active, and the parents’ use of an authoritative general parenting style, parental control over eating, monitoring of the child’s physical activity, and higher satisfaction regarding parental self-efficacy”.

2) the protocol paper did not mention how multiple outcomes would be tested, this is really a major problem, you have 13 outcomes multiplied by two different reporters (parents and children) and two different time points, so 52 different analyses for 3 different types of analyses. The trial registration includes 7 primary outcomes, only a little bit better. This needs to be addressed and I’m not sure that you have many options at this point, but the end result is likely that there are no reliable differences between treatment and control groups;

- Thank you for this comment. We reduced our reported primary outcomes to 7, as mentioned in our protocol paper.

- The 13 outcomes we reported in our in our first submitted main manuscript were:

1. Breakfast (days/week), daily Breakfast

2. Vegetables (days and amount/week), Daily vegetables

3. Daily 3 serving spoons of vegetables

4. Fruit (days and amount/week), Daily Fruit

5. Daily 2 pieces of fruit

6. SSB (days and glasses/week), Daily <2 glasses SSBs

7. Television (days and minutes/week)

8. Computer (days and minutes/week)

9. Screentime (days and minutes/week), Daily ≤120 min screen time

10. Play outside (days and minutes/week), Daily Play outside

11. Daily Play outside > 1 hour

12. Physical active (days and minutes/week), Dutch standard healthy exercise (participating in an organized sport for ≥30 minutes at least twice a week)

13. Walk/cycle to school (days/week)

- In our revised manuscript we now reported the following 7 primary outcomes as mentioned in the protocol paper:

1. Breakfast (days/week), daily Breakfast

2. Vegetables (days and amount/week), Daily vegetables

3. Fruit (days and amount/week), Daily 2 pieces of fruit

4. SSB (days and glasses/week), Daily <2 glasses SSBs

5. Screentime (days and minutes/week), Daily ≤120 min screen time

6. Play outside (days and minutes/week), Daily Play outside > 1 hour

7. Physical active (days and minutes/week), Dutch standard healthy exercise (participating in an organized sport for ≥30 minutes at least twice a week)

- Furthermore we now corrected for multiple outcome. P-values of interaction effects were corrected using Holm-Bonferroni correction. The p-values for continuous outcomes reported by children are corrected for the number of p-values for continuous outcomes reported by children. The p-values for continuous outcomes reported by parents are corrected for the number of p-values for continuous outcomes reported by parents. We did the same for the dichotomous variables. Pairwise comparisons were adjusted using Tukey-method to adjust for multiple testing. Accordingly, in the abstract in line 38 we added the text “after correction for multiple testing”, in the method section in line 408-409 we added the text: “To adjust for multiple testing, the p-values of the time x condition interaction effects were adjusted using Holm-Bonferroni sequential correction.” In the method section in line 418-419 we added the text: “For pairwise comparison, p-values were adjusted using the Tukey-method to adjust for multiple testing.”

- In the result section in line 488 and in line 537 we added the test “, and after adjusting for multiple testing,”

- In the Discussion section in line 709-721 we deleted the text: “First, it is worth noting that we did not apply Bonferroni correction for multiple testing, as this was the first study to examine the effects of an e-learning program for parents. In this exploratory study, we examined the effects of all relevant variables for which we expected the e-learning program to have an effect. Moreover, we did not expect the program to have particularly large effects, and we did not want to prematurely conclude that the e-learning program did not have an effect. Furthermore, we anticipated wide variations with respect to the outcome measures, as the e-learning program could have had affected slightly different variables among the children and parents (for example, the consumption of SSBs but not fruit could have been affected in one child, while the amount of screen time could have been affected in another child). Thus, applying Bonferroni correction may have been overly strict, as this conservative method can obscure significant results unless the effects and/or sample sizes are extremely large. Furthermore, this approach can increase the likelihood of a type II error, rendering a bona fide difference non-significant [69].”

- In addition, the following secondary outcomes were measured and reported in the revised manuscript:

1. parental styles

2. parenting practices

3. parental self-efficacy

4. parents’ willingness to follow the e-learning program

5. parents’ satisfaction with the e-learning program

3) Your actual statistical analyses need to be made clear. You simply report that you used Mplus with type=complex, this is not the statistical analysis, it is just the software used. As the statistical reviewer mentions, the models used need to be reported in careful detail with all predictors and outcomes specified, assumptions tested, and variance components reported;

- Thank you for this comment. Based on your comments we decided to revise our strategy for analyses and to redo our analyses. We replaced the analyses in Mplus with linear mixed models in R. We now also more clearly describe how the analyses were conducted.

- The Statistical analyses section has been rewritten. In the method section in line 379-389 we deleted the text about the analysis in Mplus and replaced this text in line 374-379 by “To determine the effectiveness of the intervention, we used linear mixed models in R [66], instead of the planned regression analyses in Mplus as described in the study protocol [40]. Linear mixed models were chosen for two reasons: i) because of the nested data structure of the data (i.e., repeated measurements nested within participants, and participants nested in schools), and ii) because multi-level analyses do not delete participants listwise, and can more appropriately handle data missing at random [67, 68].”. And in line 389-419 “The multicategory variables for parental EBRB rules were dichotomized in order to compare between “no rules” and “indulgent/strict rules” and between “strict rules” and “no/indulgent rules”, providing better interpretation of data. Linear mixed models for continuous outcomes and generalized linear mixed models with logit links for binary outcomes were used. The package lme4 was used for both LMMs and GLMMs [69]. All models included a random effect for students to account for repeated measurements within participants. For each outcome, it was also tested whether it is necessary to additionally account for nesting of students within schools. This additional random factor was only included if the intraclass correlation for the school-level was higher than .05, suggesting significant clustering of students within schools [70, 71]. In addition, it was tested whether a random intercept and slope model significantly better fit the data than the more parsimonious random intercept model using log-likelihood ratio tests. If this was the case, the model with random slopes was used. If the more complex models including additional random factors and/or random slopes did not converge or were singular, we used a more parsimonious model, for example by only modelling random intercepts. Time, condition and their higher-order interactions were included as fixed effects in all models. An unstructured covariance structure was used for all models. Because there were two possible starting points of the study, namely i) February 2013, in which participants of 9 schools were randomized, and ii) September 2013, in which participants of another 2 schools were randomized, the variable ‘moment of randomization’ was included as covariate to correct for possible seasonal effects. To adjust for multiple testing, the p-values of the time x condition interaction effects were adjusted using Holm-Bonferroni sequential correction. All models were visually inspected for homogeneity and normal distribution of errors using residuals versus fitted value plots and Q-Q plots. If it was suspected that these assumptions might have been violated, or if a continuous outcome was strongly left or right skewed, we additionally fitted the models with beta-regression using the glmmTMB package [68]. The results from the beta-regression models were then compared with linear mixed models. Since the outcomes from the linear beta models did not lead to substantially different conclusions, only linear mixed models were reported for continuous outcomes. To determine treatment effects at each of the follow-up timepoints, pairwise post-hoc comparisons of estimated marginal means by time and condition were performed using the emmeans package. For paiwise comparison, p-values were adjusted using the Tukey-method to account for multiple testing. An α of 0.05 was used to indicate statistical significance for all analyses.”

4) the justification for the sample size calculations needs to be made in much more detail including both the ICC assumptions and the effect size assumptions along with references;

- Thank you for this comment. We assume an intraclass correlation coefficient (ICC) of 0.05. This estimate is based on a study on ICCs for obesity indicators in primary schools (Gray et al., 2016). The ICC’s for most outcomes varied between 0.02 and 0.05. Based on this study we decided to use an ICC of 0.05 for the power analysis.

- As for the effect size assumption: The assumption of an increase of 20% is based on previous effectiveness studies and school-based programs in children 9-13 years of age [48-51]”.

- 48. De Lijster-van Kampen GPA, Gomez-Tromp M, Kocken PL: Evaluatie Door Dik en Dun: Resultaten van een pilotonderzoek naar de effecten van een behandelprogramma bij kinderen met overgewicht of obesitas in de leeftijd van 8-12 jaar [Results of a pilot study on the effects of a treatment program for overweight or obese children aged 8-12 years]. In.: TNO Kwaliteit van Leven; 2010.

- 49. Howerton MW, Bell BS, Dodd KW, Berrigan D, Stolzenberg-Solomon R, Nebeling L: School-based nutrition programs produced a moderate increase in fruit and vegetable consumption: meta and pooling analyses from 7 studies. J Nutr Educ Behav 2007, 39(4):186-196.

- 50. Reynolds KD, Franklin FA, Binkley D, Raczynski JM, Harrington KF, Kirk KA, Person S: Increasing the fruit and vegetable consumption of fourth-graders: results from the high 5 project. Prev Med 2000, 30(4):309-319.

- 51. Robinson TN: Reducing children's television viewing to prevent obesity: a randomized controlled trial. Jama 1999, 282(16):1561-1567.

- We refer here to the text in our protocol paper: “Sample size was calculated based on the difference between the intervention group and the control group in terms of the following outcomes: improvement in healthy eating and a reduction in sedentary behavior in children in accordance with Dutch standards. Because the e-learning program has not been tested previously with respect to effectiveness, it is difficult to estimate an effect size. However, based on the outcomes of similar effectiveness studies and school-based programs in children 9-13 years of age [16-19], we expect a minimum difference of 20% between the control and intervention groups 12 months after baseline in the children’s dietary and/or sedentary behavior in accordance with the Dutch standards.”.

- In the method section in line 214-215 we deleted the text: “(with an estimated intraclass correlation coefficient of 0.05 and an average cluster size of 14).”. and in line 215-217 we added the text “We assume an average cluster size of 14 and an intraclass correlation coefficient (ICC) of 0.05 based on a study on ICCs for obesity indicators in primary schools in which the ICCs for most outcomes were between 0.02 and o.05 [47].”. And in line 221-223 we added the text “The assumption of an increase of 20% is based on previous effectiveness studies and school-based programs in children 9-13 years of age [48-51]”.

5) Missing data and imputation needs to be described in more detail.

- Thank you for this comment. We replaced our current analyses in Mplus with analyses with linear mixed models in R, that more appropriately handles missing data at random. We rewrote our Statistical analyses section to make this clearer. In the method section in line 379-389 we deleted the text about the analysis in Mplus and replaced this text in line 374-379 by “To determine the effectiveness of the intervention, we used linear mixed models in R [66], instead of the planned regression analyses in Mplus as described in the study protocol [40]. Linear mixed models were chosen for two reasons: i) because of the nested data structure of the data (i.e., repeated measurements nested within participants, and participants nested in schools), and ii) because multi-level analyses do not delete participants listwise, and can more appropriately handle data missing at random [67, 68].”

Now the difficult things. First of all is your use of Mplus and type=complex to account for the clustering in the data. I’m going to start by nothing that you are wrong about this being multilevel analysis, when you use the type=complex option Mplus simply adjusts the standard errors of your effects for clustering using a sandwich estimator, but this is not a multilevel regression model. The first reason I don’t typically suggest Mplus for multilevel models is that users often don’t understand what is happening, the second is that many Mplus features are not well documented and it really isn’t clear what sandwich estimator is employed. In any case, this should be similar to more typical implementations of GEE. While GEE can be acceptable in GRTs for correcting for clustering, it isn’t very efficient and the approach recommended by the reviewer is clearly the standard. A recent paper by Turner et al (American J of Public Health) discusses some of these issues. If the protocol paper wasn’t published I would feel quite strongly (along with the stats reviewer) that the current analyses should be completely replaced with the conventional multilevel models recommended by the reviewer. However, given the existence of the protocol paper, my suggestion is that the ITT and completers analyses stays as is (with the full model including all covariates and variance parameter estimates described) but that the analyses suggested by the reviewer be included in an appendix and any discrepancies noted. There really shouldn’t be large discrepancies if everything was done right, and my reason for asking for this is that it will greatly increase my confidence that everything was done right.

- Thank you for your comment and advice. Based on your comments we decided to revise our strategy for analyses and to use the multilevel models recommended by you and the statistical reviewer. As we reported as answer on you question 3, we have rewritten our Statistical analyses section, see in the Method section in line 374- 419 (see above), and we now report the results of these new analyses in the Results section in line 482-492 “The effects of the e-learning program on the children’s EBRBs and parenting dimensions according to the results of the intention-to-treat analysis are summarized in Tables 3 and 4, and the completers-only sensitivity analyses are shown in Additional file 4 (S4 Appendix) Effects of the e-learning program on the children’s EBRBs

- Based on both the children’s responses and the parents’ responses to the questionnaires, and after adjusting for multiple testing, we found no significant differences in the changes over time between the intervention and control condition with respect to the children’s diet, sedentary behavior or physical activity behavior. In addition, post-hoc pairwise comparisons showed no significant difference between conditions at any of the follow-up times.” and in line 533-541 “Effects of the e-learning program on parenting dimensions

- Based on both the children’s responses and the parents’ responses to the questionnaires, and after adjusting for multiple testing, we found no significant differences in the change over time between the intervention and control condition with respect to parenting dimensions, including general parenting, specific EBRB-guided parenting (e.g., monitoring, modeling, and establishing EBRB rules), or parental self-efficacy. In addition, post hoc pairwise comparisons showed no significant difference between conditions at any of the follow-up times.” and in line 577 Table 3 and Table 4 .

- We decided not to report our analyses in Mplus in an additional file. This decision was made because of the limitations of these analyses as pointed out by the reviewer and editor, and to make the manuscript more readable.

Second, were covariates included in these analyses? Also, was the analyses the outcome at time T controlling for baseline or was it change scores? If covariates were not included, why not? I agree with the reviewer that baseline values for weight as other variables should have been included, the protocol paper is not clear about how or if this will be done.

- In our Mplus analyses no covariates were included, because there were no differences at baseline between the variables.

- The analyses in Mplus measured the change scores.

- In the revised manuscript we replaced the analyses in Mplus with linear mixed models in R. Time, condition and their higher-order interactions were included as fixed effects in all models. An unstructured covariance structure was used for all models. Because there were two possible starting points of the study (i) participants of 9 schools who were randomized in February 2013, ii) and participant of another 2 schools who were randomized in September 2013), the variable ‘moment of randomization’ was included as covariate to correct for possible seasonal effects. And in the method section in line 403-408 we added the text: “Time, condition and their higher-order interactions were included as fixed effects in all models. An unstructured covariance structure was used for all models. Because there were two possible starting points of the study, namely i) February 2013, in which participants of 9 schools were randomized, and ii) September 2013, in which participants of another 2 schools were randomized, the variable ‘moment of randomization’ was included as covariate to correct for possible seasonal effects.”

Third, I’m not sure that all of your effect sizes are even in the correct direction for the few significant treatment effects. Looks like there were more sweetened beverages consumed in the treatment than control groups? Also, some of the significance tests in the completers only table seem to be off? Oh, the use of superscripts to indicate which effects are significant for which set of analyses doesn’t work at all. You should probably just report the full results of the ITT and then, separately, of the completers-only analyses (again, dropping the protocol analyses).

- Thank you for this comment. As mentioned above, based on your comments we decided to revise our strategy for analyses and we replace our analyses with linear mixed models that account for the multilevel structure of the data as recommended by you and the statistical reviewer.

- We replaced table 3-6 (with the original results of the M-plus analyses) with the results of our analyses in R. In our new tables (table 3 and 4) we show the results of our intention-to-treat analyses. In these tables we don’t use superscripts to indicate which effects were significant in the completers only analyses. The two tables with the results of our completers only analyses are placed in the additional file to make the manuscript easier to read.

- In the additional file S4 Appendix we report the full results of the completers-only analyses.

I’ve noted several other issues. One is that I doubt that substantive reviewers would be impressed with your outcomes for the dietary or physical activity measures. On the trials I’ve been on we have ignored self or parent reported PA and focused exclusively on accelerometer measured PA because of concerns about bias as well as unreliability. Obviously you can’t change this now, but it needs to be a very important discussion point and the issues with the measures need to be made very clear.

- Thank you for this comment and advice. In our main manuscript in the Discussion section in line 727-735 we mentioned this study limitation: “Fourth, the information regarding the behaviors of the children and parents was obtained entirely using self-reporting questionnaires completed by the children and parents, which may have resulting in over-reporting and/or under-reporting due social desirability and/or recall bias. To minimize social desirability and optimize measurement validity, we stressed full confidentiality (i.e., anonymity) to our participants. To minimize recall bias, the interval between the events being recalled and the questionnaire was relatively short (participants were asked to recall events from the past month or week), which likely also increased the self-reporting reliability.”

- Because of your advice in the Discussion section in line 730-731 we added the text “and may contribute to unreliability of the reported data [80].”, and in line 735-737 we added the text “ To increase reliability it may have been better to use accelerometers to report physical activity; however, for determining whether the children meet or did not meet the Dutch standard for healthy exercise, a questionnaire may be appropriate [85]. “

Another issue which is really major is that I do not think you have interpreted these results correctly. You conclude that, “our web-based parenting program yields promising effects…” and when I look at your results the ITT analyses (these should be the gold standard) truly show no effects if you do any meaningful correction for multiple comparisons. Again, it looks to me like some of your results are in the wrong direction which also suggests no overall effects. The completers only analyses looks about the same to me. My best guess looking at these results is that this study has more evidence of no effects than of effects, the only place where you see something is the per-protocol analyses but those results are well known to be biased the way you did them.

- Thank you for this comment and your advice. In the abstract section in line 48-52 we deleted the text “Our results show that the web-based parenting program has promising beneficial effects and can be easily incorporated into existing programs designed to prevent overweight in children.”. And in line 48-54 we added the our new conclusion “Although parents were generally satisfied with the parenting program, following this program had no significant beneficial effects regarding the children’s energy balance-related behaviors or the parenting skills compared to the control condition. This program may be more beneficial if used by high-risk groups (e.g. parents of children with unhealthy energy balance-related behaviors and/or overweight children) compared to the general population, warranting further study.”. And in the Discussion section in line 747-749 we added the text “Despite the parent’s overall satisfaction regarding the e-learning program and the ease with which our e-learning program can be integrated into the “Scoring for health” program, we found no significant differences between the intervention and control condition.”. In line 760-767 we changed the text into “Thus, the e-learning program may have beneficial effects if added to an existing overweight-prevention program currently being offered to high-risk groups, for example in the Youth Health Care or in a hospital setting, in which we expect the parents will feel a stronger sense of urgency and therefore be more motivated to use the e-learning program. Thus, future research should test the effectiveness of this e-learning program specifically in high risk groups, such as parents of children with unhealthy EBRBs, and/or overweight children, thus providing more information regarding the benefits of this program in this specific target population”.

My final note is that I disagree with the reviewer about dropping the tables with parameter estimates and standard errors, I would focus more rather than less on them.

- Thank you for this comment and your advice. We replaced table 3-6 because we completely rerun analyses in R. In our new tables (Table 3 and 4) for the continuous variables we presented the mean and standard deviation at T0, T1 and T2 and the p-values and adjusted p-values. For the dichotomous variables we presented the probabilities and standard deviation at T0, T1 and T2 and the p-values and adjusted p-values.

NOTE: In our text we mixed the terms “group” and “condition”, and the terms “modules” and “episodes”. To make te text better readable in lines 155, 208, 209, 218, 219, 232, and 245, and we replaced the terms “control group” and “intervention group” into “control condition” and “intervention condition”, and in lines 230 and 231 we replaced the term “episodes” into “modules”.

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

- We ensure that our manuscript meets PLOS ONE’s style requirements.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

- In our published protocol paper the following text included “We asked the principals’ permission to distribute envelopes to the parents of the children in the participating schools. The envelopes contained an invitation letter in which we asked parents to participate with their child in our study. In addition, the envelopes contained information regarding the study (including the purpose of the study, length of the study, frequency of measurements, eligibility criteria, confidentially of the data, etc.), a passive informed consent form for the parent, a passive informed consent form for the child, and an envelope for returning the forms. Two weeks after distributing the invitation letters, we visited all of the school classes.”.

- In the Method section in line 173-176 we added the text “All parents and children received written information about the study [40]. In addition, one researcher (author ER) was present at all classes to provide verbal information regarding the study and answer any questions raised by the children. For this study, we used passive parental consent, which was approved by the Medical Review Ethics Committee.”.

3. Please provide the original, full-length study protocol, or project proposal, that you submitted to your ethics committee for review and approval prior to study commencement. This document should typically contain a background section, detailed description of the methods used (including information about dates of recruitment, participant characteristics, inclusion/exclusion criteria, detailed descriptions of the protocols/interventions utilized, plans for outcome assessment and data collection/analysis, and references). Please note that we require this to be submitted with your manuscript in both the original language version and a version translated into English.

- We uploaded our original project proposal in the Dutch language, called “METC_ELVO C1 Onderzoeksprotocol” and the English translation can be found in our published protocol named “The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9–13 years of age: study protocol for a two-armed cluster randomized controlled trial”.

4. Thank you for submitting your clinical trial to PLOS ONE and for providing the name of the registry and the registration number. The information in the registry entry suggests that your trial was registered after patient recruitment began. PLOS ONE strongly encourages authors to register all trials before recruiting the first participant in a study.

As per the journal’s editorial policy, please include in the Methods section of your paper:

a) your reasons for your delay in registering this study (after enrolment of participants started);

- We sent the questionnaires to parents after registration in the trial register and after permission from the medical ethics committee, but we have already approached school directors and the program manager of the existing school-based overweight prevention program “Scoring for Health” for possible participation. So that we could start immediately after approval. It was necessary to have their cooperation before we could submit the study design.

b) confirmation that all related trials are registered by stating: “The authors confirm that all ongoing and related trials for this drug/intervention are registered

- In the Method section in line 165-166 we added the following text “The authors confirm that all ongoing and related trials for this intervention are registered.”

5. Thank you for stating the following in the Acknowledgments Section of your manuscript:

"This study was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMw; project number 505010296015), which played no role in the design of execution of this study, the analysis or interpretation of the data, or the decision to publish the results."

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

"This study was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMw; project number 505010296015, 200100001). This funder had no role in study design, data collection and analysis, interpretation of the data, decision to publish the results, or preparation of the manuscript."

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

- No amended statement is required in our online Funding Statement.

- In the Declaration section in line 784-788-we deleted the following text: “Funding This study was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMw; project number 505010296015, 200100001). This funder had no role in study design, data collection and analysis, interpretation of the data, decision to publish the results, or preparation of the manuscript.”

- In the Declaration section in line 791-794 we deleted the text: “This study was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMw; project number 505010296015), which played no role in the design of execution of this study, the analysis or interpretation of the data, or the decision to publish the results.”.

- “No amended statement is required in our Funding Statement.”

6. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

- There are no ethical or legal restrictions on sharing a de-identified data set.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

- There are no ethical or legal restrictions on sharing a de-identified data set. We uploaded the minimal anonymized data set necessary to replicate our study findings to a repository of the Radboud University in the Netherlands, see <URL>.

- As soon as we have received the URL link we will forward it.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

- Based on the comments of the statistical reviewer and Editor, we revised our strategy for analyses and redid our analyses in the statistical package R. We described our revised strategy for analyses in the Statistical analyses section in line 374-419 , see above the full revised text in the answer to question 3 of the Academic Editor.

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Sample size: why the intra class correlation is set at a low level of 0.05?

- Thank you for this comment. We assume an intraclass correlation coefficient (ICC) of 0.05. This estimate is based on a study on ICCs for obesity indicators in primary schools (Gray et al., 2016). The ICC’s for most outcomes varied between 0.02 and 0.05. Based on this study we decided to use an ICC of 0.05 for the power analysis.

- In the method section in line 214-215 we deleted the text: “(with an estimated intraclass correlation coefficient of 0.05 and an average cluster size of 14).”. and in line 215-217 we added the text “We assume an average cluster size of 14 and an intraclass correlation coefficient (ICC) of 0.05 based on a study on ICCs for obesity indicators in primary schools in which the ICCs for most outcomes were between 0.02 and o.05 [47].”.

Missing data: what method was used for imputation? There are discrepancies between ITT and per-protocol analysis. It is better to try different method of imputation and evaluate the consistency. Did you consider Race and overweight which are significantly correlated with loss to follow-up?

- Thank you for this question. We replaced our current analyses in Mplus with analyses with linear mixed models (as recommended by you and the Academic Editor) in R, that more appropriately handles missing data at random. We rewrote our Statistical analyses section to make this clearer. In the method section in line 379-389 we deleted the text about the analysis in Mplus and replaced this text in line 374-379 by “To determine the effectiveness of the intervention, we used linear mixed models in R [66], instead of the planned regression analyses in Mplus as described in the study protocol [40]. Linear mixed models were chosen for two reasons: i) because of the nested data structure of the data (i.e., repeated measurements nested within participants, and participants nested in schools), and ii) because multi-level analyses do not delete participants listwise, and can more appropriately handle data missing at random [67, 68].”

Data analysis:

Not sure what “multilevel multiple regression” is. It seems that it is better to use generalized linear mixed models (GLMM) for the clustered and repeated dichotomous measure. In the GLMM, the random cluster and time should be tested for significant. The time * intervention interaction should also be tested.

- Thank you for this comment. We replaced our current analyses in Mplus type=complex with the multilevel models recommended by you and the Academic Editor. For this reasons we rewrote our Statistical analyses section. In the method section in line 379-389 we deleted the text about the analysis in Mplus and replaced this text by: “Linear mixed models for continuous outcomes and generalized linear mixed models with logit links for binary outcomes were used. The package lme4 was used for both LMMs and GLMMs [69]. All models included a random effect for students to account for repeated measurements within participants. For each outcome, it was also tested whether it is necessary to additionally account for nesting of students within schools. This additional random factor was only included if the intraclass correlation for the school-level was higher than .05, suggesting significant clustering of students within schools [70, 71]. In addition, it was tested whether a random intercept and slope model significantly better fit the data than the more parsimonious random intercept model using log-likelihood ratio tests. If this was the case, the model with random slopes was used. If the more complex models including additional random factors and/or random slopes did not converge or were singular, we used a more parsimonious model, for example by only modelling random intercepts. Time, condition and their higher-order interactions were included as fixed effects in all models. An unstructured covariance structure was used for all models. Because there were two possible starting points of the study, namely i) February 2013, in which participants of 9 schools were randomized, and ii) September 2013, in which participants of another 2 schools were randomized, the variable ‘moment of randomization’ was included as covariate to correct for possible seasonal effects. To adjust for multiple testing, the p-values of the time x condition interaction effects were adjusted using Holm-Bonferroni sequential correction. All models were visually inspected for homogeneity and normal distribution of errors using residuals versus fitted value plots and Q-Q plots. If it was suspected that these assumptions might have been violated, or if a continuous outcome was strongly left or right skewed, we additionally fitted the models with beta-regression using the glmmTMB package [68]. The results from the beta-regression models were then compared with linear mixed models. Since the outcomes from the linear beta models did not lead to substantially different conclusions, only linear mixed models were reported for continuous outcomes. To determine treatment effects at each of the follow-up timepoints, pairwise post-hoc comparisons of estimated marginal means by time and condition were performed using the emmeans package. For paiwise comparison, p-values were adjusted using the Tukey-method to account for multiple testing. An α of 0.05 was used to indicate statistical significance for all analyses.”

What baseline characteristics were adjusted in the model? How did you adjust for Race and overweight which are significantly correlated with loss to follow-up? This needs careful consideration and discussion.

- Thank you for these questions. No baseline characteristics were adjusted in the model. We found no difference between the intervention and control conditions at baseline regarding Race (Ethnicity) and overweight. As reported in our protocol paper, for that reasons we didn’t adjust for these characteristics. However, if desired, we could also additionally check whether including these covariates substantially changes the conclusions drawn from the models.

If multiple children in the same family were recruited, was the correlation within the same family adjusted in your model?

- Thank you for this question. See in the method section in line 207-209: “If more than one child living in the same household participated in the study, all participating children in that household were assigned to the same condition as the oldest participating child in order to avoid contamination between conditions.”.

For so many outcomes, p values need to be adjusted for multiple tests.

- Thank you for this comment. Based on your comment and the same comment of the academic editor, we now corrected for multiple testing. P-values of interaction effects were corrected using Holm-Bonferroni correction. Post-hoc pairwise comparisons were adjusted using Tukey-method to adjust for multiple testing. Accordingly, in the method section in line 408-409 we added the text: “To adjust for multiple testing, the p-values of the time x condition interaction effects were adjusted using Holm-Bonferroni sequential correction.” In the method section in line 418-419 we added the text: “For pairwise comparison, p-values were adjusted using the Tukey-method to adjust for multiple testing.”

- In the Discussion section in line 709-721 we deleted the text: “First, it is worth noting that we did not apply Bonferroni correction for multiple testing, as this was the first study to examine the effects of an e-learning program for parents. In this exploratory study, we examined the effects of all relevant variables for which we expected the e-learning program to have an effect. Moreover, we did not expect the program to have particularly large effects, and we did not want to prematurely conclude that the e-learning program did not have an effect. Furthermore, we anticipated wide variations with respect to the outcome measures, as the e-learning program could have had affected slightly different variables among the children and parents (for example, the consumption of SSBs but not fruit could have been affected in one child, while the amount of screen time could have been affected in another child). Thus, applying Bonferroni correction may have been overly strict, as this conservative method can obscure significant results unless the effects and/or sample sizes are extremely large. Furthermore, this approach can increase the likelihood of a type II error, rendering a bona fide difference non-significant [69].”

Results:

Table 1: separate overweight and obesity

- Thank you for this suggestion. In the Result section in line 451 in table 1 we now separate overweight and obesity.

Table 3 can be omitted.

- Thank you for this suggestion. We omitted table 3 in the main manuscript. Because we replaced our current analyses in Mplus type=complex with linear mixed models recommended by you and the Academic Editor.

Add the p values to Table 4.

- Thank you for this suggestion. Since we reran all analyses we now report different statistics in Table 3 and 4. In our new tables (Table 3 and 4) we now present the p-values and adjusted p-values for interaction effects for the continuous variables as well as for the dichotomous variables.

Similarly, for table 5 report OR, 95% CI and p values. Do not report regression coefficients.

- Thank you for this suggestion. In our new tables (Table 3 and 4) for continuous variables we now present the means and standard errors at T0, T1 and T2 and the p-values and adjusted p-values for the interaction effects from linear mixed models. For the dichotomous variables we now present the observed probabilities and standard deviation at T0, T1 and T2 and the p-values and adjusted p-values for the interaction effects from generalized linear mixed models.

Add p values to Table 6.

- Thank you for this suggestion. As explained above, In our new tables (Table 3 and 4) we presented the p-values and adjusted p-values for the continuous variables as well as for the dichotomous variables.

Needs more consideration and discussion about the discrepancies between ITT and per-protocol results.

- Thank you for this comment. On advice of the Academic Editor we deleted the per-protocol results, because these were not described in our study protocol.

Attachment

Submitted filename: 20220204 Response to editor and reviewer.docx

Decision Letter 1

Lee Van Horn

9 Jun 2022

PONE-D-21-30893R1The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9-13 years of age: results of a two-armed cluster randomized controlled trialPLOS ONE

Dear Dr. Ruiter,

Thank you for resubmitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================I have now obtained a second review from the original stats reviewer, a new review from an expert in this content area, and have reviewed the manuscript again myself. The new reviewer has raised a number of issues which should be addressed. My impression is that these can be done fairly quickly and I will do my best to make a decision quickly in the next round based on your response to these reviews.

==============================

Please submit your revised manuscript by Jul 24 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Lee Van Horn, PhD

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: (No Response)

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: (No Response)

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Thank you for the opportunity to review a revised version of the manuscript, “The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9-13 years of age: results of a two-armed cluster randomized controlled trial.” This paper presents the results of a cluster-randomized trial conducted in the Netherlands of a web-based parenting program known as “Making a healthy deal with your child.” The intervention consisted of five 30-minute modules that walked parents through challenging parenting situations specific to youth’s healthy lifestyle behaviors (e.g., struggles with child consuming vegetables, having excess screen time). While involving parents in childhood obesity-related interventions is the gold standard for treatment, school-based approaches are more common for prevention, with parent involvement and participation generally being more variable in these interventions. In this study, authors ask an important research question in that they aim to assess the value of adding an online self-guided parenting component to an existing school-based intervention, “Scoring for Health.” From my perspective, the authors were quite responsive to the comments of the Editor and statistical reviewer; I defer to them on the need for authors to make further analysis-related revisions.

The authors report on a large clinical trial that was registered and for which a protocol paper has been previously published. Further, authors describe the theoretical underpinnings of the program as coming from strong evidence-based positive parenting programs – parent effectiveness training and the Parent Management Training – Oregon Model. The authors report that they developed the intervention with qualitative input from mothers who lived in low-SES neighborhoods. The study team collected data at three time points, and participant retention rates were good, with 72% completing the 12-month follow up assessment. Authors also reported process evaluation data related to parents’ use of the intervention (e.g., log-in activity, module completion). My concerns include the use of a within-school rather than between-school design due to contamination effects as well as the exclusive use of self-reported measures to assess study outcomes (though the authors do mention both of these in their limitations section). Overall, I think this manuscript will add to the ongoing conversation in the literature about ways to involve parents in obesity prevention efforts using digital approaches. My specific recommendations regarding each section of the paper are detailed below. I hope the authors find these comments useful as they continue to move this work forward.

Abstract:

• Minor - The abstract entered in the manuscript submission portal does not match the abstract in the revised version of the manuscript.

Introduction:

• I encourage the authors to use people-first language when referring to children with overweight or obesity in the introduction and throughout the manuscript. Information and examples of people-first language specific to obesity may be found here: https://www.obesityaction.org/action-through-advocacy/weight-bias/people-first-language/ For example, rather than using the term “obese children,” use “children with obesity.”

• Authors may want to cite some more up-to-date review papers when discussing the role of parents in obesity prevention and treatment more broadly:

o St. George et al. (2020). A developmental cascade perspective of paediatric obesity: A systematic review of preventive interventions from infancy through late adolescence. Obesity Reviews, 21(2), e12939.

o Tomayko et al. (2021). Parent involvement in diet or physical activity interventions to treat or prevent childhood obesity: An umbrella review. Nutrients, 13(9), 3227.

And importantly, include a bit more in the way of parent involvement in digital lifestyle interventions:

o Hammersley ML, Jones RA, Okely AD. Parent-focused childhood and adolescent overweight and obesity eHealth interventions: a systematic review and meta-analysis. Journal of Medical Internet Research. 2016;18(7):e5893.

o Kemp BJ, Thompson DR, Watson CJ, McGuigan K, Woodside JV, Ski CF. Effectiveness of family-based eHealth interventions in cardiovascular disease risk reduction: A systematic review. Preventive Medicine. 2021:106608.

• The authors do a nice job distinguising general positive parenting practices from domain-specific positive parenting practices and their relevance to childhood obesity (there is helpful discussion on the distinction between these in a paper by Power, Sleddens, and colleagues (2013) published in Childhood Obesity – Contemporary research on parenting: Conceptual, methodological, and translational issues). However, it is not clear from the hypotheses on page 7 what specific EBRB parenting practices they will examine as secondary outcomes. Please list them here.

Minor:

• Remove the word “becoming” from the first sentence of the paper. Overweight and obesity in children is a major health concern.

• Missing the word “time” in the following sentence on page 6: “v) children spending an excessive amount of [time] using the computer and not wanting …”

Methods and Results: These sections seem to have greatly benefitted from responding to the suggestions of the Editor and statistical reviewer. I have only a few questions/comments:

1. It appears as though parents assigned to the intervention condition received an email up front with their log-in code/access to the modules and then a congratulatory email following the completion of each module. I was less clear as to whether there were any automated reminder emails or any follow-up from study staff encouraging parents to complete the modules --- this information is included in the discussion but might be helpful to note in the methods section.

2. Authors currently present process data as parents who completed one module or 2 or more modules. How many parents completed 3, 4, and 5 modules? I was interested in more granular details regarding module completion as I believe this may have important implications for understanding study findings.

3. It’s interesting that measures of height were taken using a tape measure rather than a stadiometer. Why was this instrument selected to assess height (maybe ease of transporting)?

4. Where the response options for the parental EBRB rules measure (i.e., strict, indulgent, no rules) part of the original measure or did the authors develop these for the current study? I wondered why an option around the presence of rules that were reasonable (somewhere in between strict and indulgent) was not included.

Discussion:

• Authors note “our findings indicate that the program has room for improvement, as the intervention was not used intensively enough.” I think this point may be understated and that authors could discuss the issue of dose received in more detail earlier in the discussion rather than waiting until the strengths/limitations section. It is difficult to ascertain whether or not the intervention ‘worked’ when uptake was low.

• Related to my comment above, engagement in eHealth interventions is arguably one of the biggest challenges in the field. To what extent did authors include their target population in the process of developing their intervention modules? Did authors follow up with families to understand reasons they did or did not view the modules? They speculate that participants may not have been the appropriate targets and that a higher risk group may have been more appropriate, which is a fair point, but other strategies for increasing engagement beyond email reminders may have been helpful. For example, Mohr and colleagues have argued that supportive accountability via human contact may be required to get participants to engage with digital interventions. See: Mohr et al. (2011). Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. Journal of Medical Internet Research, 13(1), e30)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Oct 21;17(10):e0276168. doi: 10.1371/journal.pone.0276168.r004

Author response to Decision Letter 1


27 Jul 2022

Response to Reviewers

Response to Reviewer #1

Thank you very much for your comment that all comments in our previous revised version have been addressed.

Response to Reviewer #2

Review #2 Comments to the Author

Thank you for the opportunity to review a revised version of the manuscript, “The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9-13 years of age: results of a two-armed cluster randomized controlled trial.” This paper presents the results of a cluster-randomized trial conducted in the Netherlands of a web-based parenting program known as “Making a healthy deal with your child.” The intervention consisted of five 30-minute modules that walked parents through challenging parenting situations specific to youth’s healthy lifestyle behaviors (e.g., struggles with child consuming vegetables, having excess screen time). While involving parents in childhood obesity-related interventions is the gold standard for treatment, school-based approaches are more common for prevention, with parent involvement and participation generally being more variable in these interventions. In this study, authors ask an important research question in that they aim to assess the value of adding an online self-guided parenting component to an existing school-based intervention, “Scoring for Health.” From my perspective, the authors were quite responsive to the comments of the Editor and statistical reviewer; I defer to them on the need for authors to make further analysis-related revisions.

The authors report on a large clinical trial that was registered and for which a protocol paper has been previously published. Further, authors describe the theoretical underpinnings of the program as coming from strong evidence-based positive parenting programs – parent effectiveness training and the Parent Management Training – Oregon Model. The authors report that they developed the intervention with qualitative input from mothers who lived in low-SES neighborhoods. The study team collected data at three time points, and participant retention rates were good, with 72% completing the 12-month follow up assessment. Authors also reported process evaluation data related to parents’ use of the intervention (e.g., log-in activity, module completion). My concerns include the use of a within-school rather than between-school design due to contamination effects as well as the exclusive use of self-reported measures to assess study outcomes (though the authors do mention both of these in their limitations section). Overall, I think this manuscript will add to the ongoing conversation in the literature about ways to involve parents in obesity prevention efforts using digital approaches. My specific recommendations regarding each section of the paper are detailed below. I hope the authors find these comments useful as they continue to move this work forward.

Abstract:

• Minor - The abstract entered in the manuscript submission portal does not match the abstract in the revised version of the manuscript.

Thank you for your attentiveness. When submitting the revised version, I will ensure that the correct abstract text is stated.

Introduction:

• I encourage the authors to use people-first language when referring to children with overweight or obesity in the introduction and throughout the manuscript. Information and examples of people-first language specific to obesity may be found here: https://www.obesityaction.org/action-through-advocacy/weight-bias/people-first-language/ For example, rather than using the term “obese children,” use “children with obesity.”

Thank you very much for sharing this knowledge. We would like to contribute to the use of People-first language. For that reason, we have changed “overweight child” into “child with overweight” throughout the manuscript.

In the abstract section in line 46 we changed “overweight children” into “children with overweight”.

In the introduction section in line 58 we changed “overweight and obese children” into “children with overweight and obesity”. In line 59-61 we changed “In addition, families with low socio-economic status (SES) and families of Turkish and Moroccan descent have a particularly high prevalence of overweight children in the Netherlands” into “In addition, in the Netherlands families with low socio-economic status (SES) and families of Turkish and Moroccan descent have a particularly high prevalence of children with overweight”.

In the discussion section in line 547 we changed “overweight and/or obese children” into “children with overweight and/or obesity”. In line 550 and line 668 we changed “overweight children” into “children with overweight”.

• Authors may want to cite some more up-to-date review papers when discussing the role of parents in obesity prevention and treatment more broadly:

o St. George et al. (2020). A developmental cascade perspective of paediatric obesity: A systematic review of preventive interventions from infancy through late adolescence. Obesity Reviews, 21(2), e12939.

o Tomayko et al. (2021). Parent involvement in diet or physical activity interventions to treat or prevent childhood obesity: An umbrella review. Nutrients, 13(9), 3227.

And importantly, include a bit more in the way of parent involvement in digital lifestyle interventions:

o Hammersley ML, Jones RA, Okely AD. Parent-focused childhood and adolescent overweight and obesity eHealth interventions: a systematic review and meta-analysis. Journal of Medical Internet Research. 2016;18(7):e5893.

o Kemp BJ, Thompson DR, Watson CJ, McGuigan K, Woodside JV, Ski CF. Effectiveness of family-based eHealth interventions in cardiovascular disease risk reduction: A systematic review. Preventive Medicine. 2021:106608.

Thank you very much for the more up-to-date review papers, this really helps in discussing the role of parents in obesity prevention and treatment more broadly.

We inserted the reference of the review of St. George et al. (2020) in the introduction section in line 74 and 80, and the review of Tomayko et al. in line 77. In the discussion section in line 551-555 we added the text “However, systematic reviews by both Bleich et al. and Wang et al. showed that the most promising interventions are delivered in school settings that include a home component [82, 83]. In addition, based on their review, Tomayko et al.’s findings support including a parental component in school-based treatment and prevention programs designed to improve the child’s weight and/or weight status outcome [23].”.

23 Tomayko, E.J., et al., Parent involvement in diet or physical activity interventions to treat or prevent childhood obesity: An umbrella review. Nutrients, 2021. 13(9): p. 3227.

82. Bleich, S.N., et al., Interventions to prevent global childhood overweight and obesity: a systematic review. The Lancet Diabetes & Endocrinology, 2018. 6(4): p. 332-346.

83. Wang, Y., et al., What childhood obesity prevention programmes work? A systematic review and meta‐analysis. Obesity reviews, 2015. 16(7): p. 547-565.

We inserted the reference you suggest, namely the systematic review of Hammersley et al, and Kemp et al. in the introduction section in line 101. And in line 99-101 we added the text “Moreover, systematic reviews have shown that family-based eHealth interventions may be promising as part of a primary prevention-based strategy designed to improve children’s health [39, 40].”.

• The authors do a nice job distinguising general positive parenting practices from domain-specific positive parenting practices and their relevance to childhood obesity (there is helpful discussion on the distinction between these in a paper by Power, Sleddens, and colleagues (2013) published in Childhood Obesity – Contemporary research on parenting: Conceptual, methodological, and translational issues). However, it is not clear from the hypotheses on page 7 what specific EBRB parenting practices they will examine as secondary outcomes. Please list them here.

Thank you for your advice. To clarify the hypothesis, we have added what specific EBRB parenting practices we will examine as secondary outcomes. In the introduction section in line 151-152 we added the text “(monitoring, modeling, and applying rules regarding EBRBs)”. The text in line 150-152 now reads as “The secondary objectives of the e-learning program include strengthening parenting styles, improving specific parenting practices (monitoring, modeling, and applying rules regarding EBRBs), and increasing parental self-efficacy.”.

Minor:

• Remove the word “becoming” from the first sentence of the paper. Overweight and obesity in children is a major health concern.

Thank you for this comment. As you suggested in the introduction section in line 58 we removed the word “becoming”.

• Missing the word “time” in the following sentence on page 6: “v) children spending an excessive amount of [time] using the computer and not wanting …”

Thank you for your attentiveness. As you suggested in the introduction section in line 132 we added the word “time”.

Methods and Results: These sections seem to have greatly benefitted from responding to the suggestions of the Editor and statistical reviewer. I have only a few questions/comments:

1. It appears as though parents assigned to the intervention condition received an email up front with their log-in code/access to the modules and then a congratulatory email following the completion of each module. I was less clear as to whether there were any automated reminder emails or any follow-up from study staff encouraging parents to complete the modules --- this information is included in the discussion but might be helpful to note in the methods section.

Thank you for this comment. All parents who were allocated to the intervention condition received an email with their log-in code/access to the modules and then a congratulatory email following the completion of each module in this email the parents was also encouraged to complete the next module. In addition, the study staff send two reminder e-mails to the parents asking them to complete the e-learning program.

For clarification and to make the text more readable, in the methods section 228-229 we replaced the text “The parents in the control condition received only the brochure.” to line 222-223. Next, in line 224 we added the text “in the intervention condition”. Last, we have added the following text in line 226-228 “In addition, we sent reminder e-mails 7 and 12 weeks after providing the log-in code, reminding parents to complete the e-learning program.”.

2. Authors currently present process data as parents who completed one module or 2 or more modules. How many parents completed 3, 4, and 5 modules? I was interested in more granular details regarding module completion as I believe this may have important implications for understanding study findings.

Thank you for this question.

As mentioned in the result section in line 496-501: In the intention-to-treat framework, 171 (68%) of the 252 parent-child dyads in the intervention condition actually started the e-learning program; 109 (64%) of these parents completed 2 or more modules, and 85 parents (50 %) completed all 5 modules in the e-learning program (dose received). In addition, 81 (32%) parent-child dyads of the 252 parent-child dyads in the intervention condition did not start the e-learning program.

Below you can see how many parents completed 1, 2, 3, 4, and 5 modules of the total of 252 parent-child dyads in the intervention condition. The percentage of number of parents in the table below are the percentages of the total of 252 parent-child dyads in the intervention group.

It is important to know that the group of parent-child dyads which completed 0 episodes (n=122), consist of i) parents who did not start the e-learning (n=81), and ii) parents who start the e-learning but did not finish any episode (n=41).

Number of episodes completed

(N) Number of parents of the intervention group

(%)

0 episodes 122 (48.4)

1 episode or more 130 (51.6)

2 episodes or more 109 (43.3)

3 episodes ore more 92 (36.5)

4 episodes or more 88 (34.9)

5 episodes or more 85 (33.7)

In the result section in line 497 we replaced (68%) to line 496 to make the text more readable. Additionally, in line 496 we replaced “framework” into “approach”, in line 497 we added “109” and “171” and in line 498 we added “64%” and the text “and 85 parents (50%) completed all 5 modules”. The text in line 496-499 now reads as: “In the intention-to-treat approach, 171 of the 252 parent-child dyads (68%) in the intervention condition started the e-learning program; 109 of these 171 parents (64%) completed 2 or more modules, while 85 of these parents (50%) completed all 5 modules of the e-learning program.”

In Table 5 in S5 Appendix we added an extra column “completed all 5 modules”. The appendix is now named as “S5 Appendix_revised”.

3. It’s interesting that measures of height were taken using a tape measure rather than a stadiometer. Why was this instrument selected to assess height (maybe ease of transporting)?

A tape measure was used because this instrument was at that time used by the Youth health care department of the community health services, also because of the ease of transporting.

4. Where the response options for the parental EBRB rules measure (i.e., strict, indulgent, no rules) part of the original measure or did the authors develop these for the current study? I wondered why an option around the presence of rules that were reasonable (somewhere in between strict and indulgent) was not included.

Thank you for this question. The 3 response options for parental EBRB rules (strict, indulgent, no rules) were taken exactly from the original measure. The question about parental EBRB rules is derived from the Child Monitor questionnaire. This Child Monitor questionnaire is part of the "Local and National Health Monitor" in the Netherlands, which uses standard questions. The Child Monitor is part of a monitoring cycle and is required by the Dutch Public Health Act. Each four years a cross-sectional survey is conducted to gain insight into the population’s health, lifestyle and well-being of children age 6 months to 12 years [1] [2, 3]. The questions in the Child Monitor questionnaire about establishing EBRBs rules were only for parents of children 4-12 years of age.

1. Van der Star, M., Kindermonitor 2010: Gezondheidsonderzoek kinderen 0-12 jaar regio Nijmegen [Child Monitor 2010: Health research in children 0-12 years of age in the Nijmegen region, the Netherlands]. 2010, GGD Nijmegen: Nijmegen.

2. Van der Star, M., Regiorapport Kindermonitor 2009/2010: Gezondheid, welzijn en leefwijze van 0-12 jarigen in de regio Nijmegen. [Region report Child Monitor 2009/2010: Health, well-being and lifestyle of children 0 to 12 years of age in the Nijmegen region]. 2010, GGD Gelderland-Zuid: Nijmegen.

3. Ruiter, E., et al., Parents' underestimation of their child's weight status. Moderating factors and change over time: A cross-sectional study. PloS one, 2020. 15(1): p. e0227761.

To clarify, in the method section in line 321-324 we added the text “Parental EBRB rules were assessed via the parental and child questionnaire. Seven items were derived from the Child Monitor Questionnaire, which is part of the "Local and National Health Monitor" in the Netherlands [57]. Children and parents were asked…”. In line 330-332 we added text with the brief three definitions of the three categories. The text now reads as: “The children and parents were instructed to answer each question with the following possible answers: ‘i) yes, and we stick to them (“strict rules”); ii) yes, but we are flexible with them (“indulgent rules”), or iii) no, we have no rules about it (“no rules”).”.

Discussion:

• Authors note “our findings indicate that the program has room for improvement, as the intervention was not used intensively enough.” I think this point may be understated and that authors could discuss the issue of dose received in more detail earlier in the discussion rather than waiting until the strengths/limitations section. It is difficult to ascertain whether or not the intervention ‘worked’ when uptake was low.

Thank you for this comment and your advice. We discussed “our findings indicate that the program has room for improvement, as the intervention was not used intensively enough.” before the strengths and limitation section, namely in line number 555-556. However, we agree that we can discuss the issue of dose received in more detail as you advised. In the method section in line 341-342 we added the text “(dose received) of the in total 5 modules delivered in the e-learning program (dose delivery).”. The text in line 340-342 now reads as “This approach also provided information regarding the number of modules each parent completed (dose received) of the in total 5 modules delivered in the e-learning program (dose delivery).”. In the result section in line 499 we added the text “(dose received)”, the text in line 496-499 now reads as “In the intention-to-treat approach, 171 of the 252 parent-child dyads (68%) in the intervention condition actually started the e-learning program; 109 of these 171 parents (64%) completed 2 or more modules, and 85 of these parents (50 %) completed all 5 modules of the e-learning program (dose received).”. In the discussion section in line 556-557 we changed the text “The intensity of the program is also a serious point that warrant discussion.” into “The intensity at which the parents in our study were exposed to the intervention also warrants discussion.”. Next, in line 557-569 we added the text “We found that 64% of parents in the intervention condition who started the e-learning program completed 2 or more modules, with 50% of parents completing all 5 modules (the total delivery dose). However, if we consider all 252 parent-child dyads in the intervention condition (i.e., both the group of parents who started the program and the group of parents who never started the program), only 43% and 34% of all parents assigned to the intervention condition completed 2 or more modules or all 5 modules, respectively. Following 2 or more of the 5 modules is the minimum requirement to be considered sufficiently exposed to the e-learning program. Thus, in our study only 43 % of the total intervention condition was sufficiently exposed to the intervention. Therefore, the relatively low percentage of parents who were sufficiently exposed to the intervention may explain why we found no apparent difference between the intervention and control conditions, making it difficult to determine whether the intervention was actually effective given the high percentage of parents (57%) who were not sufficiently exposed to the intervention.”.

Last, in line 575 - 576 we deleted the text “For example, if parents do not feel a sense of urgency to focus on healthy EBRBs, it may not be self-evident to complete all modules.”, and we replaced the text “On the other hand, the amount of time parents needed to complete the program is relatively short, with 5 modules lasting approximately 30 minute each; thus, program was not necessarily expected to have a robust effect.” from line 576-578 to line 645-647.

• Related to my comment above, engagement in eHealth interventions is arguably one of the biggest challenges in the field.

To what extent did authors include their target population in the process of developing their intervention modules?

Thank you for this question. We include our target population in the process of developing our intervention modules by organizing focus group conversations. The aims of this focus group study were to i) explore and identify everyday life situations in which mothers experience difficulties stimulating healthy EBRBs in their school-age child, and ii) identify the reasons why mothers encounter these difficulties. The e-learning program’s content was based on the results of these focus groups [1]. Before testing the e-learning in an RCT, the e-learning was viewed by 5 mothers of different ethnic backgrounds who participated in the focus group study. The e-learning was optimized with the feedback obtained from these mothers.

1. Ruiter, E.L., et al., Everyday life situations in which mothers experience difficulty stimulating healthy energy balance–related behavior in their school-age children: a focus group study. BMC public health, 2019. 19(1): p. 701.

Did authors follow up with families to understand reasons they did or did not view the modules?

Unfortunately, it did not fit within our research project to follow up with families to understand reasons they did or did not view the modules. This would have been meaningful and could be a recommendation for further research.

They speculate that participants may not have been the appropriate targets and that a higher risk group may have been more appropriate, which is a fair point, but other strategies for increasing engagement beyond email reminders may have been helpful. For example, Mohr and colleagues have argued that supportive accountability via human contact may be required to get participants to engage with digital interventions. See: Mohr et al. (2011). Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. Journal of Medical Internet Research, 13(1), e30)

Thank you for this comment. In the discussion section in line 578-603 we added the text “In addition, we used a relatively minimal engagement strategy. Our goal was to develop a self-guided web-based parenting program that can be added easily to existing overweight-prevention programs such as existing school-based/population-based interventions, thereby maximizing integration and minimizing costs. In one respect, this minimal-engagement strategy was successful, as 68% of parents started the intervention, with 64% of them completing at least 2 of the 5 modules, and 50% completing all 5 modules. Unfortunately, despite this relatively high level of involvement we found that the intervention had no apparent effects on either parenting skills or the children’s EBRBs. Using additional strategies to increase engagement in addition to sending two email reminders may have increased the percentage of parents who participated in the intervention, thus increasing the likelihood of revealing an intervention effect. In their supportive accountability model, Mohr et al. argue that human support increases adherence by increasing accountability to a coach who is seen as trustworthy, benevolent, and having expertise, moderated by motivational factors such as the communication media used (e.g., face-to-face, telephone, or email) [84]. However, we expect that parents of children in a high-risk group will be more willing to change their child’s EBRBs, feel a stronger sense of urgency to change their parenting skills, and would therefore be more motivated to use the e-learning program. We would therefore expect a higher percentage of parents to follow the e-learning program, thus revealing intervention effects. Moreover, we expect to find more room for improvement among the high-risk group with respect to improving parenting skills and their child’s EBRBs. On the other hand, if we target a high-risk group who are currently under the care of a health-care professional, it should be easier to increase engagement, as a trusted health-care professional is already involved and can provide the parents with face-to-face support, increasing their likelihood of starting—and ideally, completing—the e-learning program. This healthcare professional can also make follow-up appointments with the parents, and use this appointment also to discuss whether the e-learning program was completed successfully, or —if necessary—encourage them to complete the e-learning program.”.

Attachment

Submitted filename: 20220722 Response to Reviewers.docx

Decision Letter 2

Lee Van Horn

2 Oct 2022

The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9-13 years of age: results of a two-armed cluster randomized controlled trial

PONE-D-21-30893R2

Dear Dr. Ruiter,

Thank you for the work you put into revising this paper. After carefully reading the revisions, your response, and the previous reviews I've decided that this version adequately addresses the concerns and am am pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Lee Van Horn, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Lee Van Horn

13 Oct 2022

PONE-D-21-30893R2

The effectiveness of a web-based Dutch parenting program to prevent overweight in children 9-13 years of age: results of a two-armed cluster randomized controlled trial

Dear Dr. Ruiter:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Lee Van Horn

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Overview of parenting scale.

    (DOCX)

    S2 Appendix. Demographic and weight-related characteristics of study population (Completers-only).

    (DOCX)

    S3 Appendix. Baseline characteristics of children’s EBRB and parenting dimensions (Completers only).

    (DOCX)

    S4 Appendix. Effects of the e-learning on the EBRBs of the child and parenting dimensions (Completers-only).

    (DOCX)

    S5 Appendix. Process evaluation.

    (DOCX)

    Attachment

    Submitted filename: 20220204 Response to editor and reviewer.docx

    Attachment

    Submitted filename: 20220722 Response to Reviewers.docx

    Data Availability Statement

    The dataset used in this manuscript is available from the Radboudumc DANSEASY data repository at https://doi.org/10.17026/dans-22t-bgfz.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES