Skip to main content
PLOS One logoLink to PLOS One
. 2020 Apr 10;15(4):e0231246. doi: 10.1371/journal.pone.0231246

Executive functions mediate the relationship between cardiorespiratory fitness and academic achievement in Spanish schoolchildren aged 8 to 11 years

María Eugenia Visier-Alfonso 1,¤a,#, Mairena Sánchez-López 2,3,¤b,‡,*, Vicente Martínez-Vizcaíno 2,4,, Estela Jiménez-López 1,2, Andrés Redondo-Tébar 2, Marta Nieto-López 5
Editor: Tarek K Rajji6
PMCID: PMC7147757  PMID: 32275676

Abstract

Objectives

Previous research has studied the influence of physical fitness on academic achievement through executive functions. However, the nature of this relationship remains unclear. This study aimed to analyze how cardiorespiratory fitness (CRF) and executive functions are associated with academic achievement and to examine whether the relationship between CRF and academic achievement is mediated by executive functions in schoolchildren.

Methods

This was a cross-sectional study including 570 schoolchildren, aged 8 to 11 years, from Cuenca, Spain. Data were collected from September to October 2017. Sociodemographic variables, family socioeconomic status, pubertal status, academic achievement, CRF (20-meter shuttle run test) and executive functions (inhibition, cognitive flexibility and working memory, NIH Toolbox battery in Spanish, v 1.8; iPad Pro, Apple, Inc.) were measured.

Results

Overall, ANCOVA models controlling for age, gender and mother educational level showed higher scores in language and mathematics in children in higher categories of CRF, inhibition, cognitive flexibility and working memory than in children in lower categories. The effect sizes were moderate (p < 0.05, partial eta squared: from 0.05 to 0.12). Moreover, the mediation analysis showed that inhibition partially mediated the relationship between CRF and language (c’ = 0.058; IC = [0.005; 0.028]) and mathematics (c’ = 0.064; IC = [0.005; 0.030]) grades. Similarly, cognitive flexibility mediated CRF’s relationship with language (c’ = 0.059; IC = [0.003; 0.028]) and with mathematics (c’ = 0.066; IC = [0.003; 0.029]); however, a significant relationship remained. For working memory, mediation analysis showed no significant results (c′ = 0.92; IC = [-0.002;0.025] P > 0.05 in language; c′ = 0.103; IC = [-0.002;0.029] P > 0.05 in mathematics). Mediation ranged from 13.38% to 36%.

Conclusions

Children in higher categories of both CRF and executive function showed higher grades in mathematics and language. The findings indicated that a significant proportion of the positive influence of CRF on academic achievement was mediated by improvements in inhibition and cognitive flexibility. Thus, this study supports the hypothesis that improvements in CRF may contribute to increasing academic achievement not only through a direct mechanism but also through improvements in executive functions.

Introduction

Academic achievement is defined as the extent to which a student has achieved their educational goals [1], and it is commonly measured by grade point average or standardized tests [2]. High academic achievement is considered a key aspect of later development, predicting occupational and social success across the life course, whereas low academic achievement is linked with leaving school and facing health problems [3]. Academic achievement is a multicausal concept determined by personal, social and institutional/school factors [2].

Among the personal factors that influence academic achievement, cognitive processes have been widely studied [46]. Cognitive processes are in charge of directing thoughts and actions, formulating decisions and guiding behavior toward specific goals [1]. Executive functions are a set of cognitive operations, three of the most studied are inhibition, working memory and cognitive flexibility [7]. Executive functions are considered necessary for learning and are positively associated with academic achievement in children and adolescents [8].

Physical fitness is positively associated with academic achievement [9,10]. Previous studies have shown that children with higher levels of fitness (particularly cardiorespiratory fitness, CRF) have better academic results than their unfit peers [1,9,11,12]. Similarly, higher levels of CRF are related to a positive effect on cognitive functioning in children [1,13]. However, the degree to which executive functions may modify, mediate, or confound the association between CRF and academic achievement in children is uncertain.

To our knowledge, only three studies have analyzed the mediating effect of executive functioning in the relationship between physical fitness and academic achievement in children [1416]. These studies have shown significant a positive relationship between physical fitness and academic achievement mediated by executive functions, suggesting that gains in physical fitness can improve cognitive processes. However, two of such studies [14,15] modeled their mediation analyses considering physical fitness as an umbrella term that includes muscular strength and CRF, although the evidence of the relationship between muscular strength and academic achievement is far from consistent [17]. Moreover, no study has reported mediation analyses distinguishing among the different domains of executive function in the association between CRF and academic achievement. Additionally, no study has provided results separately by gender, even though gender differences in the association between CRF and academic achievement have been reported [17]. Moreover, differential brain maturation and executive function development between boys and girls have been reported [18].

This study aimed to (i) analyze the association between CRF and the executive function domains with academic achievement (language and mathematics) and the association between the three executive function domains and academic achievement, controlling for potential confounders, and (ii) examine whether the association between CRF and academic achievement is mediated by executive functions in schoolchildren.

Methods

This was a cross-sectional analysis of the baseline data from a cluster-randomized controlled trial (NCT03236337), aimed at assessing the effectiveness of a physical activity program (MOVI-daFit!) to diminish cardiometabolic risk and to improve CRF, executive functioning and academic achievement in schoolchildren. The design, sampling procedures and methods for collecting the variable data have been described elsewhere [19].

Participants

This study included 570 schoolchildren, aged 8 to 11 years, belonging to 10 schools in Cuenca, Spain. In these schools, all fourth- and fifth-grade children were invited to participate, except for those who met any of the following exclusion criteria: the children had Spanish learning difficulties; teachers or parents reported that the children had serious physical or mental disorders that could impede their participation in the program activities, or pediatricians reported that the children had chronic disorders such as heart disease, diabetes, or asthma that could prevent their participation in the program activities. Finally, our analysis included 563 participants for whom data on all study variables were collected. This study was approved by the Clinical Research Ethics Committee of the Virgen de la Luz Hospital in Cuenca (REG: 2016/PI021) and by the Board of Governors of each school. After obtaining approval, we invited all of the children’s parents to a meeting in which we presented the objectives of the project and asked them to sign an informed consent form for their children´s participation. Parents were informed that they could revoke the participation agreement at any time. Every child was verbally asked to provide consent prior to the completion of each test.

The research was carried out by a multidisciplinary team composed of nurses, psychologists, teachers and physical activity experts. Each test of the study was carried out by the most appropriate team members (e.g., anthropometric tests were carried out by nurses, cognitive tests by psychologists, physical activity tests by sports science educators).

Variables

The measurement procedures used in this study have been extensively described elsewhere [19]. The study variables were measured from September-October 2017 in all schools by trained researchers following standard procedures. Data were collected during two sessions two weeks apart. On the first visit, physical tests were performed, and demographic information -age, gender, pubertal stage and mother educational level- was collected. On the second visit, participants underwent a cognitive evaluation.

Anthropometric measures, weight and height, were measured in standardized conditions. The mean of the two measurements of weight and height was used to calculate the body mass index as the weight in kilograms divided by the square of height in meters (Kg/m2).

Academic achievement was measured with data provided by the schools. These data consisted of children’s final grades in language and mathematics from the previous year (2016/17, 3rd and 4th grades). In Spain, academic achievement is measured on a 0 to 10 scale, with 10 being the maximum grade. Final grades represent the student´s work in an entire academic year, as assessed by the teacher in a continuous evaluation process.

CRF was assessed by using the 20-meter shuttle run test, a validated test to estimate aerobic capacity in children [20]. Participants ran 20 meters between two lines while keeping pace with audio signals emitted from a prerecorded CD. The speed was initially 8.5 km/h and then increased by 0.5 km/h for each stage (1 stage equals 1 minute). The last half stage completed by the child was considered an indicator of CRF. Maximal oxygen intake (VO2max) was estimated by applying the Leger formula [21].

Three executive functions were assessed by using the NIH Toolbox (NIH Toolbox in Spanish, v. 1.8) [22]. All measurements were performed individually in a quiet room using a tablet (iPad Pro, Apple, Inc.). The assessment tests included in the Toolbox for each cognitive domain are listed as follows.

Inhibition

Was assessed using an adaptation [23] of the Flanker test. Children were required to indicate the left-right orientation of a centrally presented stimulus while inhibiting their attention to the potentially incongruent stimuli surrounding it. In some trials, the orientation of the flanking stimuli was congruent with the orientation of the central stimulus (> > > > > or < < < < <,) and in other trials, this orientation was incongruent (> > < > > or < < > < <). The Toolbox included a practice block of trials, and if passed, a 20-trial block was presented. The trials consisted of a sequence of congruent and incongruent sets of arrows. Using a two-vector method that incorporated both accuracy and reaction time, a final score was calculated for participants who maintained a high level of accuracy (> 80%) as follows: (0.25 x number of correct responses) + 5 –LOG10 [(congruent reaction time + incongruent reaction time / 2)] [23]. For children scoring < 80%, a total score considering accuracy was calculated.

Cognitive flexibility

Was assessed using the Dimension Change Card Sort (DCCS) [23]. Children were shown two target cards and asked to sort a series of bivalent test cards, first according to one dimension and then according to the other dimension. After a four-trial practice, children were presented a 30-trial block with both “shape” and “color” requirements. With accuracy percentage and reaction time on preswitch and postswitch, a raw score was obtained [23]. Using a two-vector method that incorporated both accuracy and reaction time, a final score was calculated for participants who maintained a high level of accuracy (> 80%) was as follows: (0.167 x number of correct responses) + 5 –LOG10 [(congruent reaction time + incongruent reaction time / 2)] [23]. For children scoring < 80%, a total score considering accuracy was performed.

Working memory

Was assessed with the List Sorting Working Memory Test [24]. Participants were presented a series of pictures, and items were presented both visually and auditorily. Then, participants were required to repeat the names of the items observed in order of size, from smallest to largest. The number of items presented in each trial increased by one each series. This test was composed of two parts. In the first part, all items were from the same category (animals or food items). In the second part, items from both categories (food items and animals) were presented together. In this part, participants had to repeat the items by category and size. Final scores were based upon a sum of the total correct trials across the two lists, which comprised the List Sorting “Total Score” [24].

To asses socioeconomic status, we surveyed parents using the scale proposed by the Spanish Society of Epidemiology [25], with items related to employment and the highest level of education obtained by both the father and mother. Five SES categories were obtained: lower, lower middle, middle, upper middle and upper. Because most authors have reported that mother education level is a strong predictor of children’s academic achievement, we obtained this variable using items related to the highest level of education obtained by the mother from this questionnaire. We thus obtained a five-category index: no reading/no studies, elementary studies, secondary studies, high school and university studies.

Data analyses

Statistical analyses were performed using IBM SPSS Statistics v.24 0 (IBM Corp., Armonk, NY, USA), and the level of significance was set at p < 0.05. The correlation matrix plot was carried out in Python. The distribution of the continuous variables was checked for normality before the analysis. Then, partial correlation coefficients were estimated to examine the relationships between academic achievement, CRF and executive functions, controlling for age, by gender.

Because there are not universally accepted cut offs for categorizing low, middle and high CRF and executive performance, we used quartiles for this aim as follows: low (Q1), middle (Q1-Q2) and high (Q4). Using these categories, ANCOVA models were estimated to examine differences in academic achievement (language and mathematics) by cardiorespiratory fitness and executive function performance (inhibition, cognitive flexibility and working memory). These ANCOVA models were also used to examine the potential confounding or mediating role of executive functions in the relationship between CRF and academic achievement. In these models, language and mathematics grades were used as dependent variables and weight status, CRF, inhibition, cognitive flexibility and working memory categories as fixed factors. In these models, language and mathematics were used as dependent variables and CRF, inhibition, cognitive flexibility and working memory categories as fixed factors, controlling for age and mother educational level (Model 1). Further adjustment for the executive function index or CRF, depending on the fixed factor, was included in Model 2. Pairwise post hoc hypotheses were tested using the Bonferroni correction for multiple comparisons. Effect size partial eta2 for ANCOVA test was calculated. Indicates small effects values of 0.01, intermediate effects 0.06 and strong effects > 0.14 [26]. These ANCOVA models were estimated for the entire sample and stratified by gender. For the rest of the analyses, continuous variables were used.

Mediation analysis was conducted to assess whether executive function dimensions were mediators in the relationship between CRF and academic achievement. For these analyses, we used PROCESS SPSS Macro version 3.1, and 5.000 bias-corrected bootstrap samples [27]. For these analyses, we used PROCESS SPSS Macro version 3.1, selecting Model 4 and 5.000 bias-corrected bootstrap samples [27]. Mediation was assessed by the indirect effect of CRF (independent variable) on academic achievement variables (language and mathematics, individually entered as dependent variables) through executive functions (inhibition, cognitive flexibility and working memory, individually entered as mediators). The total (c path), direct (c′ path), and indirect effect (a*b paths) coefficients, as well as indirect effects (IE) with 95% confidence intervals, were presented, regardless of the significance of the total effect (CRF on academic achievement) and direct effect (the effect on academic achievement when CRF and executive functions are included as predictors) [27]. Simple mediation models were tested, by introducing independently the three different mediating variables. Then, a parallel serial mediation model was tested in which the three domains of executive function (inhibition, cognitive flexibility and working memory) sere simultaneously entered in the model in such a way that each mediator was controlled for the others. The percentage of mediation (P M) was calculated as (indirect effect/total effect) x 100 to estimate the percentage of the total effect explained by the mediation path, whenever the total effect was larger than the indirect effect and in the same direction [27].

All analyses were adjusted by age and mother educational level.

Results

Our study included 570 schoolchildren (mean age = 9.58 years, SD = 0.72), of whom 279 (51.7%) were girls. The descriptive characteristics of the sample are included in Table 1. There were several differences between gender in CRF, reaction time in inhibition, cognitive flexibility and language, were higher for girls (p < 0.05).

Table 1. Characteristics of the study sample, by gender.

Total (n = 570) Boys (n = 270) Girls (n = 293) p
Age (years, months) 9.58 (0.72) 9.55 (0.74) 9.62 (0.70) 0.252
Height (cm) 140.93 (7.33) 141.03 (7.09) 140.84 (7.56) 0.766
Weight (Kg) 36.64 (10.02) 36.82 (10.22) 36.48 (9.84) 0.692
BMI (Kg/m2) 18.26 (3.88) 18.33 (0.25) 18.19 (0.22) 0.672
Tanner Stage 1.64 (0.80) 1.58 (0.69) 1.68 (0.86) 0.288
CRF (20 m shuttle run; VO2max) * 45.96 (4.61) 47.64 (4.99) 44.66 (3.81) <0.001
 Low 40.71 (1.54) 41.08 (1.75) 40.45 (1.31)
 Middle 45.93 (2.37) 47.18 (2.46) 44.58 (1.30) <0.001
 High 51.82 (2.81) 54.13 (1.76) 49.87 (1.91)
CRF (20 m shuttle run; stages) f 3.77 (1.86) 4.32 (2.04) 3.27 (1.51) <0.001
Family SES (n; %): 103, 18.3% 51, 18.9% 52, 17.7% 0.696
 Lower / Lower middle 250, 44.4% 121, 44.8% 129, 44%
 Middle 130, 23.1% 56, 20.8% 74, 25.2%
 Upper middle / Upper
Mother educational level (n; %):
 No reading/No studies 9 (1.8%) 1 (0.4%) 8 (1.1%)
 Elementary 53 (10.6%) 27 (11.3%) 26 (9.9%)
 Secondary studies 221 (44.1%) 102 (42.9%) 119 (45.2%) 0.265
 High school 134 (26.7%) 66 (27.7%) 68 (25.9%)
 University studies 84 (16.8%) 42 (17.6%) 42 (16%)
Academic achievement:
 Language 7.18 (1.72) 7.03 (1.76) 7.32 (1.67) 0.046
 Mathematics 6.90 (1.87) 6.98 (1.82) 6.82 (1.91) 0.303
Executive function:
Inhibition (FT)
 ■ Total¥ 7.62 (1.07) 7.58 (1.16) 7.67 (0.98) 0.344
 ■ Accuracy$ 19.69 (1.58) 19.62 (1.36) 19.70 (1.33) 0.491
 ■ TR± congruent 0.84 (0.26) 0.85 (0.29) 0.82 (0.22) 0.245
 ■ TR± incongruent 1.02 (0.26) 1.05 (0.47) 1.00 (0.37) 0.145
Cognitive flexibility (DCST)
 ■ Total§ 7.01 (1.11) 6.95 (1.24) 7.16 (1.08) 0.270
 ■ Accuracy$ 28.17 (3.10) 27.88 (3.10) 28.44 (3.08) 0.036
 ■ TR± switch 0.99 (0.29) 1.02 (0.30) 0.95 (0.27) 0.003
 ■ TR± non-switch 0.91 (0.27) 0.94 (0.29) 0.88 (0.24) 0.009
Working memory (LSWM)Δ 14.26 (3.18) 14.47 (3.32) 14.06 (3.04) 0.136

Values are mean ± standard deviation (SD), except for family socioeconomic status (SES), which is shown as percentages (n: %).

Abbreviations: BMI = body mass index; CRF = cardiorespiratory fitness; FT = Flanker Task; RT = Reaction Time; DCST = Dimensional Change Card Sort Test; LSWM = List Shorting Working Memory.

Bold text indicates statistical significance of p < 0.05.

* Last one-half stage measured in 20-m shuttle run test (1 stage = 1 minute).

f According to Léger recommendations.

¥ Total score was calculated using a two-vector method that incorporates both accuracy and time reaction 23. Total score = (0.25 x number correct responses) + 5 –LOG10 [(time reaction congruent + time reaction incongruent / 2). Range 0–10.

§ Total score was calculated using a two-vector method that incorporates both accuracy and time reaction 23. Total score = (0.167 x number correct responses) + 5 –LOG10 [(time reaction congruent + time reaction incongruent / 2)]. Range 0–10.

Δ Total score: correct items across trials.

$ Accuracy is number of correct answers in each test.

± Reaction Time in milliseconds.

The partial correlation coefficients between academic achievement subjects, CRF and executive function domains are presented in Table 2. CRF was positively correlated with language, mathematics, inhibition and cognitive flexibility in both genders and was positively correlated with working memory in boys (p < 0.05), but the correlation coefficient between CRF and working memory was not significant in girls. In addition, positive correlations were found between academic achievement and all executive functions in both boys and girls (all p < 0.001). See also S1 Fig.

Table 2. Partial correlation coefficients among CRF, executive functions and academic achievement subjects controlling for age and mother educational level, by gender.

BMI CRF Language Mathematics Inhibition Cognitive flexibility
CRF Total -.472** -
Boys -.538**
Girls -.467**
Language Total -.043 .204** -
Boys -.055 .158*
Girls -.032 .338**
Mathematics Total -.051 .215** .830** -
Boys -.080 .146* .857**
Girls -.033 .276** .826**
Inhibition Total -.065 .141* .330** .335** -
Boys -.029 .102 .386** .439**
Girls -.102 .227* .268** .248**
Cognitive flexibility Total -.111* .129* .341** .332** .493** -
Boys -.086 .163* .324** .333** .566**
Girls -.133* .138* .361** .353** .442**
Working memory Total .023 .059 .283** .297** .315** .283**
Boys -.040 .056 .220* .283** .318** .271**
Girls .067 .011 .358** .298** .325** .305**

Abbreviations: CRF = cardiorespiratory fitness, VO2max.

P value =

* p < 0.05;

** p < 0.001

Mean differences in language and mathematics (by CRF) and executive functions (by gender), are shown in Figs 1 and 2 and S1 and S2 Tables in the supplementary material. The mean grades in both language and mathematics were significantly higher in children in the higher categories of CRF and executive function domains (p < 0.05), except for mean grades by CRF categories in boys and language by inhibition categories in girls, in which statistical significance was not achieved. Overall, differences in academic achievement maintained their statistical significance in Model 2, except for mean grades in mathematics and inhibition categories in girls (p = 0.194).

Fig 1. Mean differences in academic achievement (language and mathematics) by CRF, inhibition, cognitive flexibility and working memory categories.

Fig 1

Brackets indicate significant differences in mean statistical significance (p < 0.05) between categories in the Bonferroni multiple comparison post-hoc test. Abbreviations: CRF = cardiorespiratory fitness. CRF categories indicate quartiles: low (Q1), middle (Q2-Q3) and high (Q4).

Fig 2. Mean differences in academic achievement (language and mathematics) by CRF, inhibition, cognitive flexibility and working memory categories.

Fig 2

Brackets indicate significant differences in mean statistical significance (p < 0.05) between categories in the Bonferroni multiple comparison post-hoc test. Abbreviations: CRF = cardiorespiratory fitness. CRF categories indicate quartiles: low (Q1), middle (Q2-Q3) and high (Q4).

The mediation model scheme is displayed in Fig 3, and the results of the mediation analysis are shown in Table 3. Inhibition and cognitive flexibility mediated the association between CRF and academic achievement, controlling for age and mother educational level. In the first regression step (path a), CRF was positively related to the executive function domains (p < 0.05). In the second step (path c), the regression coefficients of CRF were positively associated with academic achievement in all mediation models (p < 0.001). In the last regression model (path b), the executive function domains were positively related to the dependent variable (p < 0.001), and the relationship between CRF and academic achievement became weaker (although significant) when the executive function domains were included in the model (path c’). Finally, the indirect effects were statistically significant in for inhibition and cognitive flexibility, confirming that executive function domains acted as a partial mediator in these models, except for working memory. The mediation analyses by gender showed that, after controlling for mother educational level, cognitive flexibility was not significant in girls and inhibition in boys. When parallel serial mediation was performed, the results were similar (S2 Fig).

Fig 3. Mediation model.

Fig 3

Cardiorespiratory fitness (independent variable) on academic achievement (dependent variable), through executive functions (mediator variable). Path a, association between independent variable and mediators; path b, association between mediator and dependent variables; path c, total effect between independent and dependent variables; path c´, direct effect of independent variable on dependent variable.

Table 3. Total, direct, and indirect effects, a and b pathways, of the simple mediation analyses investigating executive functions as a mediator between cardiorespiratory fitness and academic performance, controlled by age and mother educational level.

Y Mediator Total Effect (c) Direct Effect (c´) Path a Path b Indirect effect (ab) 95% CI PM (%)
Lower Upper
Total
Language Inhibition .074** .058** .035 ** .450 ** .015 .005 .028 20.27
Cognitive flexibility .074 ** .059 ** .032 * .471 ** .015 .003 .028 20.27
Working memory .073 ** .068 ** .042 .140 ** .006 -.005 .018
Mathematics Inhibition .081 ** .064 ** .035 ** .472 ** .016 .005 .030 19.75
Cognitive flexibility .081 ** .066 ** .032 * .473 ** .015 .003 .029 18.51
Working memory .080 ** .074 ** .042 .152 ** .006 -.005 .020
Boys
Language Inhibition .054 * .041 .025 .520 ** .013 -.003 .032 24.07
Cognitive flexibility .054 * .037 .033 * .523 ** .017 .003 .037 31.48
Working memory .054 * .050 * .036 .114 ** .004 -.004 .009
Mathematics Inhibition .050 * .035 .025 .583 ** .015 -.004 .036 30.00
Cognitive flexibility .050 * .032 .033 * .531 ** .018 .003 .038 36.00
Working memory .050 * .044 .036 .145 ** .005 -.010 .021
Girls
Language Inhibition .143 ** .124 ** .062 ** .313 * .019 .004 .041 13.38
Cognitive flexibility .143 ** .125 ** .044 * .425 ** .019 -.003 .040
Working memory .143 ** .141 ** .009 .176 ** .002 -.021 .029
Mathematics Inhibition .128 ** .108 ** .062 ** .327 ** .020 .005 .044 15.62
Cognitive flexibility .128 ** .108 ** .044 * .464 ** .021 -.004 .045
Working memory .127 ** .126 ** .009 .160 ** .002 -.018 .027

Results showed unstandardized coefficients (standard error) and BC 95% CI based on 5000 bootstraps. All analyses were adjusted for age and mother educational level.

CRF cardiorespiratory fitness; CI confidence interval.

* p < 0.05;

** p < 0.005.

Discussion

The results of this study reveal that children in higher CRF and executive function categories had better academic achievement than their peers in other categories. Furthermore, our study suggested that the association between CRF and academic achievement in mathematics and language was partially mediated by inhibition and cognitive flexibility, even after controlling for age and mother educational level. However, the association between CRF and academic achievement was not mediated by working memory.

Several studies support that executive functions underlie the selection, planning and monitoring of goal-directed processes [1], which are involved in more complex processes such as perception, attention or memory [8]. Thus, executive function provides neural substrates that underlie successful learning [28]. Studies have also reported that children with higher levels of physical fitness perform better cognitively [13], suggesting that motor and cognitive development may be interrelated [29]. Increasingly conclusive data support that physical fitness induces vascularization, neural growth and synaptic transmission in the regions of the brain underlying executive functions, especially the prefrontal cortex [1,30].

Our data, similar to those of previous studies [5,14,15], support this line of argumentation since they show a positive association between executive functions and academic achievement and between CRF and academic achievement. Moreover, our data suggest that the influence of CRF on academic achievement is mediated through some cognitive domains of executive function, such as inhibition and cognitive flexibility. These results are in line with those of other authors [1416] who tested indirect paths, suggesting that physical fitness is not an independent predictor of academic achievement but acts via executive functions.

The results of studies analyzing the potential mediator role of executive function in the relationship between fitness and academic achievement are not conclusive. Van der Niet et al. reported a significant indirect relationship through executive functions (measured as a latent variable composed of problem solving skills and cognitive flexibility) between a physical fitness index and overall academic achievement [14]. Similarly, Kvalo et al. reported a mediating role of executive functions in mathematics but not in reading or English [16]. The results of the study by De Bruijn et al., showed that the mediating role of executive function is not general but specific to the academic achievement domain such that verbal working memory acts as a mediator between physical fitness (measured using the EUROFIT battery) [31] and mathematics and spelling, whereas visuospatial working memory acts as a mediator only in mathematics [15]. The differences in the measurement methods of the three constructs could be the cause of these inconsistencies since, for example, most studies tested models in which physical fitness was measured as an index that included both CRF and strength, despite the evidence that supports different pathways for the influence of these fitness components on cognition.

Our study found a mediator role of cognitive flexibility and inhibition, but contrary to previous studies [15], the potential mediation effect of working memory in the relationship between CRF and academic achievement was not confirmed. Developmental variability in children’s executive function could be the cause of this contradictory finding: although executive functions develop from infancy to adulthood, the age at which each executive function is stabilized is still matter of debate [32]. Some studies have suggested that while inhibition stabilizes by the school years, working memory continues to develop until late adolescence, and cognitive flexibility is the latest maturing cognitive function [32]. Moreover, despite the apparent similarities of the different tasks used to measure each executive function, different conflict tasks show different ages of mastery, indicating different cognitive demands [32].

Our results indicated that the mediator effect of EF between CRF and academic achievement was approximately 15 to 36%. Several other fitness-related factors could influence academic achievement, such as motor skills. Two studies showed that motor skills, rather than aerobic fitness or physical activity, had the strongest association with executive functions and academic performance [33,34]. A review study [35] proposed that both CRF and motor skills were related to academic performance and that the influence of both could affect cognition and academic performance in different ways. Moreover, a mediation study showed that motor coordination—not cardiovascular endurance or muscular strength—was the only motor ability that accounted for a significant percentage of the variance in academic achievement [36]. Other variables that have been demonstrated to be related to academic achievement, possibly influencing the relationship between CRF and academic achievement, are physical activity and general health improved by cardiorespiratory fitness [18].

In this study, we reported slight differences between boys and girls in the relationship between CRF and academic achievement and in the mediator role of executive functions. We found higher values for girls in language and cognitive flexibility and a stronger association of fitness with academic achievement in girls compared to boys. Previous studies have reported differences in brain maturation and brain structures [18], which may explain the higher cognitive flexibility in girls because they reach a plateau before boys [18] in many executive functions, especially cognitive flexibility, which is the executive function that matures latest [32]. However, mediation analyses revealed a stronger mediating role of executive functions in the relationship between fitness and academic achievement in mathematics in boys than in girls after controlling by mother educational level. This might be due to the higher influence of mother educational level on girls than on boys.

Strengths and limitations

The strengths of this study include the large sample size and the fact that it analyzed the mediating effect of different domains of executive functions in the association between CRF and academic achievement. Mediation analysis has been proposed as a statistical procedure suitable for clarifying whether a third variable underlies the relationship between two variables. Thus, this procedure allows us to consider the significant proportion of the influence of the independent variable (CRF) on the dependent variable (academic achievement) takes place through executive functions (mediator) [37].

However, this study had some limitations. Cross-sectional studies utilizing statistical mediation provide a theoretical and mechanistic foundation about the relationships between cardiorespiratory fitness, brain, and cognition. Nevertheless, their correlational nature leaves open the possibility that the observed behavioral and structural fitness-related differences between high and low-fit groups are caused by some unmeasured factor. Furthermore, although previous studies support a directional relationship between physical activity and fitness to academic achievement, the cross-sectional nature of our analyses prevented us from making cause–effect inferences, since temporal ambiguity bias cannot be completely ruled out. For that all, randomized controlled trials are necessary to account for potential selection bias, as well as to establish a direct, causal relationship in humans between aerobic fitness, brain structure, and cognitive functioning. Second, the evaluation of a single fitness component in our study makes it difficult to perform comparisons with other studies, where fitness has been assessed with another test or with a global physical fitness index. Another limitation of the study was that both CRF and academic performance were not assessed simultaneously, and they were assessed using indirect procedures, i.e., the 20-meter shuttle run test and teacher evaluations. We should consider that academic achievement is the result of a long-term learning process, and the cross-sectional evaluation actually implies the final outcome of a 1-year learning follow up. Regarding the validity of the 20-meter shuttle run test to estimate CRF, this is the recommended test in the ALPHA battery, since the direct measurement of VO2max in population-based studies is unfeasible. Finally, another point to mention is the inherent difficulties in the measurement of executive functions, so-called task impurity [15,32]; many of the tasks used to measure an executive function also require involvement from the rest of the executive functions. For this reason, some authors recommend including several tasks for each executive function to obtain a more reliable measure of executive functioning [29]. Moreover, because some authors recommend the measurement of accuracy and reaction time as separate variables, the assessment of these cognitive abilities as a unique score could be seen as a limitation; however, the NIH Toolbox´s total score has been used and validated in several studies and allows the avoidance of a ceiling effect in accuracy, which is typically achieved by most participants of this age.

Conclusions

This study supports the positive associations between academic achievement and CRF and between academic achievement and executive functioning in schoolchildren. Additionally, this study shows that mental processes such as inhibition and cognitive flexibility mediate the relationship between CRF and academic achievement in language and mathematics. However, working memory does not mediate this association. The observations from these data highlight the importance of promoting CRF in children to improve academic achievement. The correlations between executive functions and academic achievement suggest that it may be beneficial to target them to facilitate adequate learning in schools. Thus, the design of physical activity programs aimed at increasing CRF and executive functions might be a practical strategy to improve academic achievement in schoolchildren.

Supporting information

S1 Fig

(TIFF)

S2 Fig

(TIF)

S1 Table. Mean differences (ANCOVA) in academic achievement in language and mathematics by CRF categories, controlling for age and mother educational level.

(DOCX)

S2 Table. Mean differences (ANCOVA) in academic achievement in language and mathematics by inhibition, cognitive flexibility and working memory categories, controlling for age and mother educational level.

(DOCX)

Acknowledgments

We thank the schoolchildren, teachers, schools and families for their collaboration and participation in the study.

Data Availability

Data are available from figshare: https://figshare.com/s/d032c7e016f2bf3dd4b4. Figure: 10.6084/m9.figshare.9746126.

Funding Statement

This study was funded by the Ministry of Economy and Competitiveness-Carlos III Health Institute and FEDER funds (FIS PI19/01919) to VMV. Additional funding was obtained from the Research Network on Preventative Activities and Health Promotion (RD12/0005/0009) to VMV. ART are supported by a grant from the University of Castilla-La Mancha (2018-CPUCLM-7813). The study sponsor has no role in study design, collection, analysis, interpretation of data, the writing of the report or the decision to submit the manuscript for publication. http://www.isciii.es/ISCIII/es/contenidos/fd-investigacion/financiacion.shtml

References

  • 1.Donnelly J. E. et al. Physical Activity, Fitness, Cognitive Function, and Academic Achievement in Children: A Systematic Review. Med Sci Sports Exerc 48, 1197–1222 (2016). 10.1249/MSS.0000000000000901 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Steinmayr, R., Meibner, A., Wirthwein, L. Academic Achievement. Oxford Bibliographies. Online Datasets.
  • 3.Freudenberg N. & Ruglis J. Reframing school dropout as a public health issue. Prev Chronic Dis 4, A107 (2007). [PMC free article] [PubMed] [Google Scholar]
  • 4.Rohde T. E. & Thompson L. A. Predicting academic achievement with cognitive ability. Intelligence 35, 83–92 (2007). [Google Scholar]
  • 5.Tomporowski P. D., Davis C. L., Miller P. H. & Naglieri J. A. Exercise and Children’s Intelligence, Cognition, and Academic Achievement. Educ Psychol Rev 20, 111–131 (2008). 10.1007/s10648-007-9057-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Scott S. P., DE Souza M. J., Koehler K., Petkus D. L. & Murray-Kolb L. E. Cardiorespiratory Fitness Is Associated with Better Executive Function in Young Women. Med Sci Sports Exerc 48, 1994–2002 (2016). 10.1249/MSS.0000000000000974 [DOI] [PubMed] [Google Scholar]
  • 7.Diamond A. Executive Functions. Annual Review of Psychology 64, 135–168 (2013). 10.1146/annurev-psych-113011-143750 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Best J. R., Miller P. H. & Naglieri J. A. Relations between Executive Function and Academic Achievement from Ages 5 to 17 in a Large, Representative National Sample. Learning and Individual Differences 21, 327–336 (2011). 10.1016/j.lindif.2011.01.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Chomitz V. R. et al. Is there a relationship between physical fitness and academic achievement? Positive results from public school children in the northeastern United States. The Journal of School Health 79, 30–37 (2009). 10.1111/j.1746-1561.2008.00371.x [DOI] [PubMed] [Google Scholar]
  • 10.Van Dusen D. P., Kelder S. H., Kohl H. W., Ranjit N. & Perry C. L. Associations of physical fitness and academic performance among schoolchildren. J Sch Health 81, 733–740 (2011). 10.1111/j.1746-1561.2011.00652.x [DOI] [PubMed] [Google Scholar]
  • 11.Castelli D. M., Hillman C. H., Buck S. M. & Erwin H. E. Physical Fitness and Academic Achievement in Third- and Fifth-Grade Students. Journal of Sport and Exercise Psychology 29, 239–252 (2007). 10.1123/jsep.29.2.239 [DOI] [PubMed] [Google Scholar]
  • 12.Scott S. P., De Souza M. J., Koehler K. & Murray-Kolb L. E. Combined Iron Deficiency and Low Aerobic Fitness Doubly Burden Academic Performance among Women Attending University. J. Nutr. 147, 104–109 (2017). 10.3945/jn.116.240192 [DOI] [PubMed] [Google Scholar]
  • 13.Chaddock L., Pontifex M. B., Hillman C. H. & Kramer A. F. A Review of the Relation of Aerobic Fitness and Physical Activity to Brain Structure and Function in Children. Journal of the International Neuropsychological Society 17, 975–985 (2011). 10.1017/S1355617711000567 [DOI] [PubMed] [Google Scholar]
  • 14.van der Niet A. G., Hartman E., Smith J. & Visscher C. Modeling relationships between physical fitness, executive functioning, and academic achievement in primary school children. Psychology of Sport and Exercise 15, 319–325 (2014). [Google Scholar]
  • 15.de Bruijn A. G. M., Hartman E., Kostons D., Visscher C. & Bosker R. J. Exploring the relations among physical fitness, executive functioning, and low academic achievement. Journal of Experimental Child Psychology 167, 204–221 (2018). 10.1016/j.jecp.2017.10.010 [DOI] [PubMed] [Google Scholar]
  • 16.Kvalø S. E., Dyrstad S. M., Bru E. & Brønnick K. Relationship between aerobic fitness and academic performance: the mediational role of executive function. J Sports Med Phys Fitness (2019) 10.23736/S0022-4707.18.08971-5 [DOI] [PubMed] [Google Scholar]
  • 17.Santana C. C. A. et al. Physical fitness and academic performance in youth: A systematic review. Scandinavian Journal of Medicine & Science in Sports 27, 579–603 (2017). [DOI] [PubMed] [Google Scholar]
  • 18.Koolschijn P. C. M. P. & Crone E. A. Sex differences and structural brain maturation from childhood to early adulthood. Developmental Cognitive Neuroscience 5, 106–118 (2013). 10.1016/j.dcn.2013.02.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Martínez-Vizcaíno V. et al. MOVI-daFIT! Intervention: Rationale and design of a cluster randomized controlled trial testing the effects on improving adiposity, cognition, and subclinical atherosclerosis by increasing cardiorespiratory fitness in children. Medicine (Baltimore) 98, e14737 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Ruiz J. R. et al. [ALPHA-fitness test battery: health-related field-based fitness tests assessment in children and adolescents]. Nutr Hosp 26, 1210–1214 (2011). [DOI] [PubMed] [Google Scholar]
  • 21.Léger L. A., Mercier D., Gadoury C. & Lambert J. The multistage 20 metre shuttle run test for aerobic fitness. Journal of Sports Sciences 6, 93–101 (1988). 10.1080/02640418808729800 [DOI] [PubMed] [Google Scholar]
  • 22.Weintraub S. et al. I. NIH toolbox cognition battery (cb): introduction and pediatric data: NIH toolbox cognition battery (CB). Monographs of the Society for Research in Child Development 78, 1–15 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Zelazo P. D. et al. II. NIH toolbox cognition battery (cb): measuring executive function and attention: NIH toolbox cognition battery (CB). Monographs of the Society for Research in Child Development 78, 16–33 (2013). 10.1111/mono.12032 [DOI] [PubMed] [Google Scholar]
  • 24.Tulsky D. S. et al. NIH Toolbox Cognitive Function Battery (NIHTB-CFB): Measuring Working Memory. Monogr Soc Res Child Dev 78, 70–87 (2013). 10.1111/mono.12035 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Grupo de trabajo de la Sociedad Española de Epidemiología y de la Sociedad Española de Medicina de Familia y Comunitaria. Una propuesta de medida de la clase social. Aten primaria 25, 5 70–78 (2013). [PubMed] [Google Scholar]
  • 26.Cohen, G. The effects of aging on autobiographical memory. in Autobiographical memory: Theoretical and applied perspectives 105–123 (Lawrence Erlbaum Associates Publishers, 1998).
  • 27.Hayes, Andrew F. (2013). Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression‐Based Approach. New York, NY: The Guilford Press—Bolin—2014—Journal of Educational Measurement—Wiley Online Library. https://onlinelibrary.wiley.com/doi/abs/10.1111/jedm.12050.
  • 28.Khan N. A. & Hillman C. H. The Relation of Childhood Physical Activity and Aerobic Fitness to Brain Function and Cognition: A Review. Pediatric Exercise Science 26, 138–146 (2014). 10.1123/pes.2013-0125 [DOI] [PubMed] [Google Scholar]
  • 29.Diamond A. Close interrelation of motor development and cognitive development and of the cerebellum and prefrontal cortex. Child Dev 71, 44–56 (2000). 10.1111/1467-8624.00117 [DOI] [PubMed] [Google Scholar]
  • 30.Kopp B. A simple hypothesis of executive function. Front Hum Neurosci 6, 159 (2012). 10.3389/fnhum.2012.00159 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.CoEoS, R. EUROFIT: Handbook for the EUROFIT tests of physical fitness. (Committee of Experts on Sports Research, Strasbourg, 1993).
  • 32.Best J. R. & Miller P. H. A Developmental Perspective on Executive Function. Child Development 81, 1641–1660 (2010). 10.1111/j.1467-8624.2010.01499.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Aadland K. N. et al. Relationships between physical activity, sedentary time, aerobic fitness, motor skills and executive function and academic performance in children. Mental Health and Physical Activity 12, 10–18 (2017). [Google Scholar]
  • 34.Haapala E. A. et al. Associations of Motor and Cardiovascular Performance with Academic Skills in Children: Medicine & Science in Sports & Exercise 46, 1016–1024 (2014). [DOI] [PubMed] [Google Scholar]
  • 35.Haapala E. A. Cardiorespiratory Fitness and Motor Skills in Relation to Cognition and Academic Performance in Children–A Review. Journal of Human Kinetics 36, 55–68 (2013). 10.2478/hukin-2013-0006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Marques A., Santos D. A., Hillman C. H. & Sardinha L. B. How does academic achievement relate to cardiorespiratory fitness, self-reported physical activity and objectively reported physical activity: a systematic review in children and adolescents aged 6–18 years. Br J Sports Med 52, 1039 (2018). 10.1136/bjsports-2016-097361 [DOI] [PubMed] [Google Scholar]
  • 37.Baron R. M. & Kenny D. A. The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations. search. Journal of Personality and Social Psychology 51 1173–1182 (1986). 10.1037//0022-3514.51.6.1173 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Iratxe Puebla

18 Jul 2019

PONE-D-19-14578

Att

Executive functions as a mediator in the relationship between cardiorespiratory fitness and academic achievement in schoolchildren.

PLOS ONE

Dear Mrs. SANCHEZ,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The manuscript has been assessed by three reviewers; their comments are available below.

The reviewers have raised some concerns which need attention in a revision. The reviewers note that further clarification and justification should be provided for methodological aspects of the study, including additional information on the sampling approach, inclusion and exclusion criteria and details on how each measurement was carried out. The reviewers also note that given the cross-sectional design, you should carefully review the language and ensure that any statement that make causal relationships are revised to only refer to associations.

Could you please carefully revise the manuscript to address the concerns raised by the reviewers?

We would appreciate receiving your revised manuscript by Aug 31 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Iratxe Puebla

Senior Managing Editor, PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

1. There is some discrepancy between your manuscript and the details registered at www.clinicaltrials.gov, please clarify whether schoolchildren included were aged 8 to 11 years or 9 to 11 years, and whether the number of children enrolled in the study was 570 or 563.

2. Please amend either the title on the online submission form (via Edit Submission) or the title in the manuscript so that they are identical.

3. We note that you have included the phrase “data not shown” in your manuscript. Unfortunately, this does not meet our data sharing requirements. PLOS does not permit references to inaccessible data. We require that authors provide all relevant data within the paper, Supporting Information files, or in an acceptable, public repository. Please add a citation to support this phrase or upload the data that corresponds with these findings to a stable repository (such as Figshare or Dryad) and provide and URLs, DOIs, or accession numbers that may be used to access these data. Or, if the data are not a core part of the research being presented in your study, we ask that you remove the phrase that refers to these data.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The investigators performed a cross-sectional analysis of the baseline data from a cluster-randomized controlled trial , aimed at assessing if the effectiveness of a physical activity program diminishes cardiometabolic risk and improves CRF, executive functioning and academic achievement in schoolchildren. Assuming the sample to have been adequately selected, the overall goal of examining physical fitness influences on academic achievement through executive functions appears to have been achieved. Although not a randomized comparison of low vs. high CRF, the descriptive nature of the study using correlational analysis, the ANCOVA with post hoc adjustment and the mediation analysis, is certainly interesting. The mediation model is well utilized and the results are well explained. There are some minor concerns.

1. The manuscript should be edited for typos. For example on line 26 of the abstract, the expression ,’ Cross-sectional study including 539 schoolchildren, aged 8 to 11 years, from Cuenca, Spain.’ Is not a full sentence. On Table 3, one assumes the word ‘Hight’ should be ‘High’.

2. On Table 1 the significant (p<0.05) p-values according to line 181 are in bold. Why are the p-values for the executive functions, TR congruent, incongruent and Total (0.245, 0.145 and 0.270, respectively) in bold type?

Reviewer #2: Dear editor,

The paper focus on an important and emergent research area. However, in my opinion, deep changes on the manuscript should be considered prior to acceptance.

Abstract:

The authors should present some statistical data related to the main results, not only a p value.

The abstract readability can be improved by a scientific language edition (e.g: line 30 -31 change from “…showed significantly higher mean scores…” to “… higher scores…”).

Line 34: What means partially mediated?

The last sentence from the abstract is merely speculative and it is not related to the study conclusions.

How was the sampling process conducted? Please provide the inclusion and exclusion criteria.

Do the authors have formal assent from the children?

What is the time gap between academic performance data and CRF and cognitive functions assessments?

Line 107 Please change VO2max to VO2max

Line 109: What app was used to assess executive functions? Please change from ipad to tablet. Describe model and manufacturer in parentheses.

It is mandatory to the authors to provide more information about the measurements of academic performance.

Mother educational level is one of the main predictor of children academic performance. The authors should used this data as a controlling variable instead of a SES index, otherwise, the authors must present a better rationally for using this index.

Why partial correlations were not adjusted for SES?

Why the authors opt for using quartiles?

Did the authors calculated a priori sample size? What is the statistical power of the analyses?

I am not an expert in statistical, but I am not confident the authors made the right choices.

The authors should consider to present the data with the level of accuracy from the instrument used to measure the outcomes (e.g: there is no decimal places for age in years).

I suggest the authors to avoid the VO2 calculation using equation; they can simple use the last complete stage on shuttle run test.

What is the criteria for SES categorization?

Would be of value if the authors should use some data related to body composition in the analyses (at least a BMI could be presented).

The results section is hard to flow. Firstly, I believe the authors should rethink their statistical procedures. I strongly suggest the authors to avoid categorization and use continuous data.

The correlations may be presented in figures.

If the authors accept my suggestion and change the statistical approach, the discussion should be rewritten in the light of the new results.

For me the main limitations are: indirect assessment of CRF and academic performance; If academic performance and CRF are not assess in the same time point (as I am assuming), it could also be a strong limitation of the present investigation.

Reviewer #3: Review PONE-D-19-13578

Excecutive functions as a mediator in the relationship between cardiorespiratory fitness and academic achievement in schoolchildren.

Comments

Title: can the title be changed to a declarative statement (e.g. Executive functions mediate the relationship between…) and better specify the study population (add country)?

Abstract:

“It has been hypothesized that” or previous researched have actually studied this relationship?

“the associations between cardiorespiratory fitness (CRF) and the executive function domains with academic achievement and…” is unclear. Associations between A and B with C? Do you mean interrelationships (e.g. A and B, A and C, B and C)?

Line 26 – Add “This” before cross-sectional.

Can you add a little more detail on the measurement of CRF and EF? Just add shuttle-run and NIH Toolbox.

Can you add effect sizes to the abstract?

Line 36 – this sentence errs on the causal side and; would reword to state that children in this study with higher CRF and EF had higher math and language scores. It’s just an association in this sample.

Line 38 – mediated (past tense); otherwise it sounds like a population inference

Introduction

You may also want to cite

• Scott et al. 2016, Med Sci Sport Exer – Cardiorespiratory fitness is associated with better executive function in young women

• Scott et al. 2016, Journal of Nutrition – Combined iron deficiency and low aerobic fitness doubly burden academic performance among women attending university (see fig 3 for mediation)

Line 73 – same problem as in abstract: Associations between A and B with C?

Methods

Line 98 – “in standardized conditions”? Do you mean “following standard procedures”? Was this done by nurses or the researchers?

20 trials on the flanker task does not seem sufficient. Were multiple blocks performed? If you used only 20 trials, can you cite other studies to support that this is acceptable?

Would it not be useful to treat accuracy and speed as separate variables? Were children with <80% accuracy dropped from the analysis?

Line 132 – what are aliments? Food items?

Please provide more information on the SES index. What were the education and employment categories and how were these used to construct the SES index? You say highest level of education in their family (all family members) and then either father or mother. Which was it? Too bad you didn’t ask about their income.

The model descriptions are unclear to me. All of your variables are continuous, so why not just use OLS regressions with multiple predictors? “We estimated ANCOVA models to test mean differences in language and mathematics by categories of CRF and executive function domain, controlling for age, pubertal status and SES (Model 1); further adjustment for the executive function index or CRF, depending on the fixed factor, was included in Model 2.”

Does adjusting for pubertal status (I think you mean stage; status implies a dummy variable, i.e. pre/post pubertal) really add much? You already adjust for age, which I would assume is colinear with pubertal status, though I could be wrong.

Results

Table 1

-add BMI

-add % falling into fitness categories based on CRF? VO2max of 46 seems fairly fit, but I don’t know what the ACSM cutoffs are in this age group. Need to get a sense of whether sample is fit or unfit.

-need units for EF indicators. I assume accuracy is % incorrect responses? This is typically expressed as proportion correct.

Table 3 is very hard to follow. I suggest moving this to supplement and creating a figure or figures for the main paper.

Discussion – can you comment on what may mediate the other 70-85% of the relationship between CRF and language/math that is not explained by executive function, age, pubertal satus, and SES?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Wagner Luiz do Prado

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: Prados review.docx

PLoS One. 2020 Apr 10;15(4):e0231246. doi: 10.1371/journal.pone.0231246.r002

Author response to Decision Letter 0


3 Sep 2019

Response to Reviewer 1 Comments

The investigators performed a cross-sectional analysis of the baseline data from a cluster-randomized controlled trial, aimed at assessing if the effectiveness of a physical activity program diminishes cardiometabolic risk and improves CRF, executive functioning and academic achievement in schoolchildren. Assuming the sample to have been adequately selected, the overall goal of examining physical fitness influences on academic achievement through executive functions appears to have been achieved. Although not a randomized comparison of low vs. high CRF, the descriptive nature of the study using correlational analysis, the ANCOVA with post hoc adjustment and the mediation analysis, is certainly interesting. The mediation model is well utilized, and the results are well explained. There are some minor concerns.

Authors’ response: Your comments and general involvement in the review process are highly appreciated. We have addressed all concerns, and we hope our revisions have improved the manuscript.

1. The manuscript should be edited for typos. For example, on line 26 of the abstract, the expression,’ Cross-sectional study including 539 schoolchildren, aged 8 to 11 years, from Cuenca, Spain.’ Is not a full sentence. On Table 3, one assumes the word ‘Hight’ should be ‘High’.

Authors’ response: Thank you for the comment. We apologize for the error. The paper has been sent again to a specialist service to correct mistakes and typos. The following changes have been made:

“This was a cross-sectional study that included 570 schoolchildren, aged 8 to 11 years, from Cuenca, Spain” (Page 2, lines 32).

Tables S1 and S2 (S1 and S2 Table Supplementary material).

2. On Table 1 the significant (p<0.05) p-values according to line 181 are in bold. Why are the p-values for the executive functions, TR congruent, incongruent and Total (0.245, 0.145 and 0.270, respectively) in bold type?

Authors’ response: Thank you for the comment. We apologize for the mistake, which has been corrected (Table 1, page 10).

Response to Reviewer 2 Comments

The paper focus on an important and emergent research area. However, in my opinion, deep changes on the manuscript should be considered prior to acceptance.

Authors’ response: Your comments and general involvement in the review process are highly appreciated. We have addressed all concerns, and our revisions have improved the manuscript.

Abstract:

The authors should present some statistical data related to the main results, not only a p value.

Authors’ response: We appreciate this comment. As suggested, we have included the following information in the abstract section:

“Overall, ANCOVA models controlling for age, gender and mother educational level showed higher scores in language and mathematics in children in higher categories of CRF, inhibition, cognitive flexibility and working memory than in children in lower categories. The effect sizes were moderate (p < 0.05, partial eta squared: from 0.05 to 0.12). Moreover, the mediation analysis showed that inhibition partially mediated the relationship between CRF and language (c’ = 0.058; IC = [0.005; 0.028]) and mathematics (c’ = 0.064; IC = [0.005; 0.030]) grades; similarly, cognitive flexibility mediated CRF’s relationship with language (c’ = 0.059; IC = [0.003; 0.028]) and with mathematics (c’ =0.066. ; IC = [0.003; 0.029]); however, a significant relationship remained. For working memory, mediation analysis showed no significant results (c′ = 0.92; IC= [-0.002;0.025] P > 0 .05 in language; c′ = 0.103; IC= [-0.002;0.029] P > 0.05 in mathematics). Mediation ranged from 13.38 % to 36 %” (Page 2, lines 43-50).

The abstract readability can be improved by a scientific language edition (e.g: line 30 -31 change from “…showed significantly higher mean scores…” to “… higher scores…”).

Authors’ response: Thank you for the comment. As suggested, we have rephrased that sentence in the abstract section to improve readability:

“ANCOVA models controlling for age, gender and mother educational level showed higher scores in language and mathematics in children (…)” (Page 3, lines 37-38).

Moreover, full abstract has been improved following the comments and suggestions.

Line 34: What means partially mediated?

Authors’ response: According to Andrew F. Hayes (Hayes AF. Introduction to mediation, moderation, and conditional process analysis: a regression-based approach.: Guildford Press; 2018), partial mediation implies that the mechanism through the mediator variables (executive functions) does not entirely account for the association observed between the independent variable (CRF) and the dependent variable (academic achievement in language and mathematics), whereas complete mediation means that the association between CRF and academic achievement is entirely accounted for by the indirect mechanism. Partial mediation is the case in which the path from the independent variable to the dependent variable is reduced in absolute size but is still different from zero when the mediator variable is introduced in the model, whereas complete mediation occurs when the relationship between the independent variable and the dependent disappears after entering the mediator in the model, making the path c´ = 0.

In order to clarify this concern to the readers, the following changes have been made in the abstract section:

“(..) the mediation analysis showed that inhibition partially mediated the relationship between CRF and language (…) and mathematics (…); similarly, cognitive flexibility mediated CRF’s relationship with language (…) and with mathematics (…); however, a significant relationship remained” (Page 2-3, lines 44-48).

The last sentence from the abstract is merely speculative and it is not related to the study conclusions.

Authors’ response: Thank you for the comment. We agree regarding the inappropriateness of the sentence. Thus, the sentence has been modified as follows:

“The findings indicated that a significant proportion of the positive influence of CRF on academic achievement was mediated by improvements in inhibition and cognitive flexibility. Thus, improvements in CRF may contribute to increasing academic achievement not only through a direct mechanism but also through improvements in executive functions” (Page 3 lines 52-55).

How was the sampling process conducted? Please provide the inclusion and exclusion criteria.

Authors’ response: Thank you for the thoughtful comment. As suggested, we have provided some detail on the sampling procedure as well as inclusion/exclusion criteria as follows:

Methods

This was a cross-sectional analysis of the baseline data from a cluster-randomized controlled trial (NCT03236337) aimed at assessing the effectiveness of a physical activity program (MOVI-daFit!) to diminish cardiometabolic risk and to improve CRF, executive functioning and academic achievement in schoolchildren. The design, sampling procedures and methods for collecting the variable data have been described elsewhere (Martinez Vizcaíno et al Medicine (Baltimore). 2019 Mar;98(9):e1473) (Page 5, lines 107-108).

Participants

This study included 570 schoolchildren, aged 8 to 11 years, attending 10 schools in Cuenca, Spain. In these schools, all fourth- and fifth-grade children were invited to participate, except for those who met any of the following exclusion criteria: the children had Spanish learning difficulties; teachers or parents reported that the children had serious physical or mental disorders that could impede their participation in the program activities, or pediatricians reported that the children had chronic disorders such as heart disease, diabetes, or asthma that could prevent their participation in the program activities. Finally, our analysis included 563 participants for whom data on all study variables were collected (Page 5, lines 111-116).

Do the authors have formal assent from the children?

Authors’ response: In this study, only the parents signed a written consent form for their children’s participation. However, every child was asked for their consent to participate before taking each test. Furthermore, children were informed of the characteristics of the study, and their opinion was considered in the design of the intervention. Before starting the MOVI intervention, the members of the research team visited the intervention school to facilitate a consensus among parents, teachers, and children on the types of games and modifications for the playground. During the study, through the data collection process, the children were asked to give us their consent to participate. We thought that this could increase compliance with the program.

We found this issue relevant. Thus, we have added the following sentence in the “Methods” section:

“Every child was verbally asked for consent prior to the completion of each test” (Page 6, lines 123-124).

What is the time gap between academic performance data and CRF and cognitive functions assessments?

Authors’ response: We thank you for your comment. To measure academic achievement, the final grades of the previous year were used. This was a measure that synthesizes students’ work for the whole year. In Spain, a final qualification is given to students as a result of a continuous evaluation for the entire academic year. This measure represents relatively stable behaviour or, in other words, students’ academic background. This grade is given in the month of June and represents students’ work for the whole year. We used that grade to assess academic achievement. We asked schools for this information during the months when the baseline study was performed, from September to October 2017. During these months, data were collected in two sessions two weeks apart. On the first visit, physical tests were performed, including CRF. On the second visit, participants completed a cognitive evaluation.

We agree that this measure of academic achievement could have several limitations. We discuss it below in another comment.

Line 107 Please change VO2max to VO2max

Authors’ response: Done. Thank you.

Line 109: What app was used to assess executive functions? Please change from Ipad to tablet. Describe model and manufacturer in parentheses.

Authors’ response: Thank you. As suggested, we have included a description of the app used for assessing executive functions and replaced Ipad with tablet in the methods section as follows:

“NIH Toolbox (NIH Toolbox in Spanish, v. 1.8)” (page 7, lines 151).

“All measurements were performed (…) using a tablet (iPad Pro, Apple, Inc.) (page 7, lines 152-153)”.

It is mandatory to the authors to provide more information about the measurements of academic performance.

Authors’ response: Thank you for the suggestion. We have modified the text as follows:

“Academic achievement was measured with data provided by the schools. These data consisted of children’s final grades in language and mathematics from the previous year (2016/17, 3rd and 4th grades). In Spain, academic achievement is measured on a 0 to 10 scale, with 10 being the maximum grade. Final grades represent the student´s work in an entire academic year, as assessed by the teacher in a continuous evaluation process” (Page 6-7, lines 139-143).

Mother educational level is one of the main predictor of children academic performance. The authors should used this data as a controlling variable instead of a SES index, otherwise, the authors must present a better rationally for using this index.

Authors’ response: We sincerely appreciate the good suggestion. We have repeated all analyses using mother educational level as a control variable.

Changes can be observed in the methods section (Page 8, 183-191; Page 10, 24’), Table 1 (Page 11); Table 2 (Page 13); Table S1 and S2 (S1 and S2 Table Supplementary material) and Table 3 (Page 18).

Why partial correlations were not adjusted for SES?

Authors’ response: This comment seems appropriate; thus, mother educational level has been included as a covariate in Table 2 (Page 13).

Why the authors opt for using quartiles?

Authors’ response: We appreciate the comment. Although it has been proposed to use cut offs for dichotomizing CRF levels (please see Ruiz JR et al Br J Sports Med. 2016;50:1451-1458), the aim of categorizing variables measured on an interval scale was to test differences between low, middle and high fitness levels. For this, several authors have used quartiles as a standard procedure (e.g., Álvarez-Bueno et al., 2019. Cardiorespiratory fitness as a mediator of the relationship between birth weight and cognition in school children. Psychology research and behaviour management, 12, 255), since there is no universally accepted procedure for this aim.

To clarify the aims of these ANCOVA procedures, which may be unclear, the following sentences were included in the methods section:

“Because there are no universally accepted cut offs for categorizing low, middle and high CRF and executive performance, we used quartiles for this aim as follows: low (Q1), middle (Q1-Q2) and high (Q4). Using these categories, ANCOVA models were estimated to examine differences in academic achievement (language and mathematics) by CRF and executive function performance (inhibition, cognitive flexibility and working memory). These ANCOVA models were also used to examine the potential confounding or mediating role of executive functions in the relationship between CRF and academic achievement” (Page 9, lines 203-209).

“In these models, language and mathematics grades were used as dependent variables and CRF, inhibition, cognitive flexibility and working memory categories as fixed factors” (Page 9, lines 209-211).

“For the rest of the analyses, continuous variables were used” (Page 9, lines 217-218).

Did the authors calculated a priori sample size? What is the statistical power of the analyses? I am not an expert in statistical, but I am not confident the authors made the right choices.

Authors’ response: The sample size was estimated not for mediation analyses but for a cluster randomized trial belonging to a representative sample from Cuenca, Spain. A new reference has been included in which the study protocol is described in more depth.

However, the precision of the confidence intervals, as well as the recommended sample size for the mediation analysis (Fritz MS, MacKinnon DP. Required sample size to detect the mediated effect. Psychol Sci. 2012; 18(3):233-239), indicate that the sample size is large enough for the analyses included in this manuscript.

The authors should consider to present the data with the level of accuracy from the instrument used to measure the outcomes (e.g: there is no decimal places for age in years).

Authors’ response: Thank you for the comment. As suggested, since age was obtained in months and the cut offs for classifying weight status in children are estimated for age in months (Cole TJ, Lobstein T. Extended international (IOTF) body mass index cut-offs for thinness, overweight and obesity. Pediatr Obes. 2012; 7(4): 284-94), we have included age in months in the tables and analyses (Table 1, Page 10).

I suggest the authors to avoid the VO2 calculation using equation; they can simple use the last complete stage on shuttle run test.

Authors’ response: Thank you for the comment. We assessed both variables before deciding to use VO2max. The main reason for choosing this variable was that VO2max is the most continuous variable, whereas stage is a variable that represents the stage reached. We found this kind of variable more adapted to the procedures we were planning to perform. Another reason to choose VO2max is that this is an indicator that considers weight (mL/kg/min). In a population with a considerable prevalence of overweight/obesity (28%), this is an important fact to consider. However, all analyses were performed with both variables with similar results. We also checked previous research in which this variable was used for analyses (e.g., Aadland et al., 2017; Castro-Piñero et al., 2017; Álvarez-Bueno et al., 2019; Scott et al. 2016).

What is the criteria for SES categorization?

Authors’ response: Following your suggestions, we used mother educational level instead of SES as a control variable in all analyses. The SES variable has been relegated to descriptive purposes in Table 1. For this aim, we used an index developed by the Spanish Society of Epidemiology and the Spanish Society of Family and Community Medicine following criteria proposed by Goldthorpe that are commonly used in UK (please see Domingo‐Salvany A et al. Proposal for a social class measure. Working Group of the Spanish Society of Epidemiology and the Spanish Society of Family and Community Medicine. Aten Primaria. 2000; 25: 350‐ 363). Thus, we have included this information in the manuscript as follows:

“To asses socioeconomic status, we surveyed parents using the scale proposed by the Spanish Society of Epidemiology [22], with items related to employment and the highest level of education obtained by both the father and mother. Five SES categories were obtained: lower, lower middle, middle, upper middle and upper. Because most authors have reported that mother education level is a strong predictor of children’s academic achievement, we obtained this variable using items related to the highest level of education obtained by the mother from this questionnaire. We thus obtained a five-category index: no reading/no studies, elementary studies, secondary studies, high school and university studies” (Page 8, lines 183-191).

Would be of value if the authors should use some data related to body composition in the analyses (at least a BMI could be presented).

Authors’ response: Thank you for the recommendation. We have included BMI in Table 1 (Page 11) and Table 2 (Pages 13). As the association between BMI and the dependent variables was not significant, we decided not to include this variable as a covariate in the subsequent analyses.

The results section is hard to flow. Firstly, I believe the authors should rethink their statistical procedures. I strongly suggest the authors to avoid categorization and use continuous data.

Authors’ response: Thank you for the comment. According to your suggestion, our analyses incorporated the variables at the interval scale for testing the association between academic achievement, cognitive performance and cardiorespiratory fitness and for estimating the regression coefficients included in the mediation analyses. However, to provide a more comprehensive analysis, we tested differences in the means of the academic achievement variables by executive functions and physical fitness categories, which was our first objective (to analyse whether there are differences in academic achievement in language or mathematics between low- and high-fit children and between low- and high-executive-functioning children). Likewise, we examined the potential confounder or mediator role of executive functions by using ANCOVA models in which cardiorespiratory fitness was categorized as low, middle and high; this is a common practice and can provide readers a comprehensive view and complement interval-scale analyses of changes in the relationship between independent and dependent variables.

This procedure has been performed in previous studies (e.g., Diez Fernandez et al. Diabetes Care. 2014;37(3):855-62).

However, we agree with you that this section could be difficult to follow. Thus, we have replaced the ANCOVA with figures (Fig 1 and Fig 2) in the main text. The table is included as supplementary material (S1 and S2), and the ANCOVA procedures are described in the methods section as follows:

‘Because there are no universally accepted cut offs for categorizing low, middle and high CRF and executive performance, we used quartiles for this aim as follows: low (Q1), middle (Q1-Q2) and high (Q4). Using these categories, ANCOVA models were estimated to examine differences in academic achievement (language and mathematics) by CRF and executive function performance (inhibition, cognitive flexibility and working memory). These ANCOVA models were also used to examine the potential confounding or mediating role of executive functions in the relationship between CRF and academic achievement. In these models, language and mathematics grades were used as dependent variables and weight status, CRF, inhibition, cognitive flexibility and working memory categories as fixed factors. In these models, language and mathematics were used as dependent variables and CRF, inhibition, cognitive flexibility and working memory categories as fixed factors, controlling for age and mother educational level (Model 1). Further adjustment for the executive function index or CRF, depending on the fixed factor, was included in Model 2. Pairwise post hoc hypotheses were tested using the Bonferroni correction for multiple comparisons. Effect size partial eta2 for ANCOVA test was calculated. Indicates small effects values of 0.01, intermediate effects 0.06 and strong effects >0.014 (Cohen J. Statistical power analysis for the behavioral sciences. New York: Academic Press 1988, pp 280-287). These ANCOVA models were estimated for the entire sample and stratified by gender. For the rest of the analyses, continuous variables were used’ (Page 9, lines 203-218).

The correlations may be presented in figures.

Authors’ response: We appreciate your comment. We have added the following correlation matrix plot, performed in Python, to the supplementary material (S1 Fig).

If the authors accept my suggestion and change the statistical approach, the discussion should be rewritten in the light of the new results.

Authors’ response: Thank you for the comment. As suggested, we have added the following sentences to the Discussion section:

“Our study suggested that the association between CRF and academic achievement in mathematics and language was partially mediated by inhibition and cognitive flexibility, even after controlling for age and mother educational level” (Page 19, lines 358).

“Our results indicated that the mediator effect of executive function between CRF and academic achievement was approximately 13.4 to 36 %” (Page 20, lines 396-397).

“However, mediation analyses revealed a stronger mediating role of executive functions in the relationship between fitness and academic achievement in mathematics in boys than in girls after controlling for mother educational level. This might be due to the higher influence of mother educational level on girls than on boys” (Page 21, lines 415-418).

For me the main limitations are: indirect assessment of CRF and academic performance; If academic performance and CRF are not assess in the same time point (as I am assuming), it could also be a strong limitation of the present investigation.

Authors’ response: Your comment is greatly appreciated. We have added the following sentences to “Strengths and limitations” in the Discussion section:

“Another limitation of the study was that both CRF and academic performance were not assessed simultaneously, and they were assessed using indirect procedures, i.e., the 20-meter shuttle run test and teacher evaluations. We should consider that academic achievement is the result of a long-term learning process, and the cross-sectional evaluation actually implies the final outcome of a 1-year learning follow up. Regarding the validity of the 20-meter shuttle run test to estimate CRF, this is the recommended test in the ALPHA battery, since the direct measurement of VO2max in population-based studies is unfeasible” (Page 21, lines 425-431).

Response to Reviewer 3 Comments

Executive functions as a mediator in the relationship between cardiorespiratory fitness and academic achievement in schoolchildren.

Comments

Title: can the title be changed to a declarative statement (e.g. Executive functions mediate the relationship between…) and better specify the study population (add country)?

Authors’ response: We appreciate the suggestion, and the following change has been made:

“Executive functions mediate the relationship between cardiorespiratory fitness and academic achievement in Spanish schoolchildren aged 8 to 11 years” (Page 1-2).

Abstract:

“It has been hypothesized that” or previous researched have actually studied this relationship?

Authors’ response: Thank you for the comment. We have modified the sentence as follows:

“Previous research has studied the influence of physical fitness on academic achievement through executive functions” (Page 2, lines 25-26).

“the associations between cardiorespiratory fitness (CRF) and the executive function domains with academic achievement and…” is unclear. Associations between A and B with C? Do you mean interrelationships (e.g. A and B, A and C, B and C)?

Authors’ response: Thank you for the comment. As suggested, we have modified sentence as follows:

“This study aimed to analyze how cardiorespiratory fitness (CRF) and executive functions are associated with academic achievement” (Page 2, lines 28-29)

Line 26 – Add “This” before cross-sectional.

Authors’ response: Done. Thank you for the comment.

Can you add a little more detail on the measurement of CRF and EF? Just add shuttle-run and NIH Toolbox.

Authors’ response: Thank you for the comment. We now include more information on the measures of CRF and EF in the abstract, which has been modified as follows:

“CRF (20-meter shuttle run test) and executive functions (inhibition, cognitive flexibility and working memory, NIH Toolbox battery in Spanish, v 1.8; iPad Pro, Apple, Inc.) were measured” (Page 2, lines 34-36).

Can you add effect sizes to the abstract?

Authors’ response: Thank you. As suggested, we have included ES information in the abstract, and in table S1 (supplementary material), partial eta squared has been included:

“…children in higher categories of CRF, inhibition, cognitive flexibility and working memory than in children in lower categories. The effect sizes were small to medium (p < 0.05, partial eta squared: from 0.05 to 0.12) (Page 2, lines 43-44).

And we have added the following sentence (in Data analyses section, page 9, lines 215-216):

“…Effect size partial eta2 for ANCOVA test was calculated. Values of 0.01, 0.06, and 0.14 to indicate small, medium, or large effects (Cohen J. Statistical power analysis for the behavioral sciences. New York: Academic Press 1988, pp 280-287)”.

Line 36 – this sentence errs on the causal side and; would reword to state that children in this study with higher CRF and EF had higher math and language scores. It’s just an association in this sample.

Authors’ response: Thank you for the comment. We have rephrased the sentence to avoid establishing a causal relation, as follows:

“Children in higher categories of both CRF and executive function showed higher grades in mathematics and language” (Page 3, lines 51-52).

Line 38 – mediated (past tense); otherwise it sounds like a population inference

Authors’ response: Thank you for the suggestion. The error has been modified.

Introduction

You may also want to cite

• Scott et al. 2016, Med Sci Sport Exer – Cardiorespiratory fitness is associated with better executive function in young women

• Scott et al. 2016, Journal of Nutrition – Combined iron deficiency and low aerobic fitness doubly burden academic performance among women attending university (see fig 3 for mediation)

Authors’ response: The comment is greatly appreciated. We found that those references support the relationship between CRF and cognition. Thus, we have included the references proposed by the reviewer in the introduction section (Page 4, lines 69, 76) and included references 6 and 11 in the bibliography.

Line 73 – same problem as in abstract: Associations between A and B with C?

Authors’ response: Thank you for the comment. We have reformulated the sentence as follows:

“the association between CRF and academic achievement (in language and mathematics) and the association between the three executive function domains and academic achievement” (Page 5, lines 92-93).

Methods

Line 98 – “in standardized conditions”? Do you mean “following standard procedures”? Was this done by nurses or the researchers?

Authors’ response: Thank you for the comment. We have rephrased the paragraph as follows:

“The research was carried out by a multidisciplinary team composed of nurses, psychologists, teachers and physical activity experts. Each test of the study was carried out by the most appropriate team members (e.g., anthropometric tests were carried out by nurses, cognitive tests by psychologists, physical activity tests by sports science educators) (Page 6, lines 125-128).

20 trials on the flanker task does not seem sufficient. Were multiple blocks performed? If you used only 20 trials, can you cite other studies to support that this is acceptable?

Authors’ response: Thank you for the comment. In our study, to measure cognitive inhibition, we used the NIH Flanker Inhibitory Control and Attention Test. This is a test included in a wider battery of tests aimed at assessing cognitive function in people aged 3-85 years. The validation process has been described elsewhere (Weintraub S, Dikmen SS, Heaton RK, Tulsky DS, Zelazo PD, Bauer PJ, et al. Cognition assessment using the NIH Toolbox. Neurology. 2013;80(11 Suppl 3):S54-64.), and the authors conclude that 20 trials is appropriate. In children aged 3-7, two blocks of trials are performed. The first one consists of a set of 20 fishes, and if a participant scores ≥ 90% on the fish stimuli, 20 additional trials with arrows are presented. Before the 20-trial block, 4 practice trials are performed in all tests. After checking validation and information about the NIH Toolbox, we found that the NIH Toolbox was a reliable measure for cognition.

To clarify this concern, we have added the following references supporting the validity and suitability of this test:

Zelazo PD, Anderson JE, Richler J, Wallner-Allen K, Beaumont JL, Weintraub S. II. NIH Toolbox cognition battery (cb): measuring executive function and attention: NIH Toolbox cognition battery (CB). Monographs of the Society for Research in Child Development. 2013;78(4):16-33

Brito NH, et al. Associations between cortical thickness and neurocognitive skills during childhood vary by family socioeconomic factors. Brain and cognition. 2017, vol. 116, p. 54-62.

Akshoomoff N, Brown T, Bakeman R, Hagler D. Developmental differentiation of executive functions on the NIH Toolbox Cognition Battery. Neuropsychology. 2018. 32(7), 777-7783.

Calderon J, Bellinger DC, Hartigan C, Lord A, Stopp C, Wypij D, Newburger JW. Improving neurodevelopmental outcomes in children with congenital heart disease: protocol for a randomised controlled trial of working memory training. 2019. BMJ open, 9(2).

Would it not be useful to treat accuracy and speed as separate variables? Were children with <80% accuracy dropped from the analysis?

Authors’ response: Thanks for the comment. In order to clarify this concern, we have included the following information about the convenience or not of jointly assessing accuracy and speed in the limitation section:

Because some authors recommend the measurement of accuracy and reaction time as separate variables, the assessment of these cognitive abilities as an unique score could be seen as a limitation; however, the NIH Toolbox´s total score has been used and validated in several studies and allows the avoidance of a ceiling effect in accuracy, which is typically achieved by the most of participants of this age” (Page 22, lines 436-440).

“For children scoring < 80%, a total score considering accuracy was performed” (Page 7, 164-165; 173-174).

Line 132 – what are aliments? Food items?

Authors’ response: Yes, we mean “food items”. We apologize for the confusion, and this text has been corrected. Thank you for the comment.

Please provide more information on the SES index. What were the education and employment categories and how were these used to construct the SES index? You say highest level of education in their family (all family members) and then either father or mother. Which was it? Too bad you didn’t ask about their income.

Authors’ response: Thank you for the thoughtful comment. Because most authors recognize not a whole SES assessment but mother education level as the main predictor of academic achievement, we have used SES categories for the description of the study sample characteristics and mother education level (gathered from the items included in the SES measurement) as control variables. We used an index developed by the Spanish Society of Epidemiology and the Spanish Society of Family and Community Medicine, following criteria proposed by Goldthorpe that are commonly used in the UK (please see Domingo‐Salvany A et al. Proposal for a social class measure. Working Group of the Spanish Society of Epidemiology and the Spanish Society of Family and Community Medicine. Aten Primaria. 2000; 25: 350‐ 363), as used in previous studies.

This information has been included in the methods section as follows:

“To asses socioeconomic status, we surveyed parents using the scale proposed by the Spanish Society of Epidemiology [22], with items related to employment and the highest level of education obtained by both the father and mother. Five SES categories were obtained: lower, lower middle, middle, upper middle and upper. Because most authors have reported that mother education level is a strong predictor of children’s academic achievement, we obtained this variable using items related to the highest level of education obtained by the mother from this questionnaire. We thus obtained a five-category index: no reading/no studies, elementary studies, secondary studies, high school and university studies” (Page 8, 183-191).

The model descriptions are unclear to me. All of your variables are continuous, so why not just use OLS regressions with multiple predictors? “We estimated ANCOVA models to test mean differences in language and mathematics by categories of CRF and executive function domain, controlling for age, pubertal status and SES (Model 1); further adjustment for the executive function index or CRF, depending on the fixed factor, was included in Model 2.”

Authors’ response: Your concern is valid. To address it, we have included a paragraph in the introduction section justifying the mediation analysis.

“Health studies commonly control for confounding or mediator variables using multivariate methods such as multiple linear regression, logistic regression, or ANCOVA, depending on the study aims and/or whether the dependent variable is quantitative or categorical. Mediation analysis is a statistical procedure suitable for clarifying whether a third variable underlies the relationship between two variables and determining the extent to which this relationship can be modified, mediated, or confounded by this third variable (Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol 1986;51:1173–1182). We consider that a mediation effect occurs when a significant proportion of the influence of the independent variable on the dependent variable takes place through a third variable (mediator)” (Page 5 95-102).

Does adjusting for pubertal status (I think you mean stage; status implies a dummy variable, i.e. pre/post pubertal) really add much? You already adjust for age, which I would assume is colinear with pubertal status, though I could be wrong.

Authors’ response: We apologize for the mistake, which has been corrected. We mean stage, not “status”.

According to your suggestion, we have repeated some analyses, and we find reasons to remove pubertal stage from the adjustment. First, most children in the sample had very low pubertal stage development (86% presented a pubertal stage <=2); moreover, this variable was closely associated with age. Thus, as the reviewer recommends, pubertal stage has been removed as a control variable. These changes can be observed in the methods section (Page 8, lines 194-196), Table 2 (Page 13), Table 3 (Page 18) and Table S1 and S2 (Supplementary material).

Results

Table 1

-add BMI

Authors’ response: Done. BMI is now included in Table 1 (Page 11) and Table 2 (Page 13). Thanks for the comment.

-add % falling into fitness categories based on CRF? VO2max of 46 seems fairly fit, but I don’t know what the ACSM cutoffs are in this age group. Need to get a sense of whether sample is fit or unfit.

Authors’ response: Thanks for the comment.

CRF categories were made attending to quartiles in our sample because at this age, there are no ACSM categories. Some authors have proposed points that could indicate a “red flag” of cardiovascular disease risk (e.g., Ruiz et al., 2015).

As suggested, to provide the readers an estimation of the children’s fitness levels, we have included the VO2max levels corresponding to each category in Table 1 (Page 11).

-need units for EF indicators. I assume accuracy is % incorrect responses? This is typically expressed as proportion correct.

Authors’ response: Thank you for the comment. Accuracy refers to total correct responses. Reaction time is time in milliseconds. The total score is a score that takes into account accuracy and time reaction, calculated by the app using the previously explained algorithm. It provides a score from 0-10.

To improve understandability, we have included the appropriate units of EF indicators in Table 1 (Page 11).

Table 3 is very hard to follow. I suggest moving this to supplement and creating a figure or figures for the main paper.

Authors’ response: Thank you for the comment. Table 3 has been moved to the supplementary material (S1 and S2 Tables), and a figure synthesizing the differences in academic achievement between children in lower and higher categories of CRF and EF has been included (Fig 1 and Fig 2).

Discussion – can you comment on what may mediate the other 70-85% of the relationship between CRF and language/math that is not explained by executive function, age, pubertal status, and SES?

Authors’ response: Thank you for the recommendation. As suggested, we have included some sentences addressing this concern in the discussion section as follows:

“Our results indicated that the moderator effect of EF between CRF and academic achievement was approximately 13.4 to 36 %. Several other fitness-related factors could influence academic achievement, such as motor skills. Two studies showed that motor skills, rather than aerobic fitness or physical activity, had the strongest association with executive functions and academic performance [33,34]. A review study [35] proposed that both CRF and motor skills were related to academic performance and that the influence of both could affect cognition and academic performance in different ways. Moreover, a mediation study showed that motor coordination—not cardiovascular endurance or muscular strength—was the only motor ability that accounted for a significant percentage of the variance in academic achievement [36]. Other variables that have been demonstrated to be related to academic achievement, possibly influencing the relationship between CRF and academic achievement, are physical activity and general health improved by cardiorespiratory fitness (Marques, Santos, Hillman & Sardinha, 2018)” (Page 19, lines 396-406).

Attachment

Submitted filename: Response_to_Reviewers.docx

Decision Letter 1

Tarek K Rajji

7 Feb 2020

PONE-D-19-14578R1

Executive functions mediate the relationship between cardiorespiratory fitness and academic achievement in Spanish schoolchildren aged 8 to 11 years.

PLOS ONE

Dear Mrs. SANCHEZ,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Mar 23 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Tarek K Rajji

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #4: (No Response)

Reviewer #5: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #4: Yes

Reviewer #5: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #4: Yes

Reviewer #5: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #4: Yes

Reviewer #5: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #4: Yes

Reviewer #5: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #4: Important note: This review pertains only to ‘statistical aspects’ of the study and so ‘clinical aspects’ [like medical importance, relevance of the study, ‘clinical significance and implication(s)’ of the whole study, etc.] are to be evaluated [should be assessed] separately/independently.

Please note that it is preferable [refer to item 1b of CONSORT checklist 2010: Structured summary of trial design, methods, results, and conclusions; though article type is ‘Research Article’] to divide the ABSTRACT with small sections like ‘Objective(s)’, ‘Methods’, ‘Results’, ‘Conclusions’, etc. which is the accepted practice of most good/standard journals [including PLOS]. Your ABSTRACT is well drafted but assay type.

This being a cross-sectional study, there are few ‘design’ issues involved, regarding which, I am sure, authors are well aware [clear as it is mentioned in ‘Strengths and limitations’ section later]. All sorts of biases [more likely ‘selection’ biases] are common occurrence in such cross-sectional studies. A cross-sectional study is easy to conduct but generally is of very limited value [since in no way any cross-sectional study will yield confirmatory conclusion(s) mainly because of absence of temporal sequence]. Since any cross-sectional study is considered as a low level of [scientific] evidence, such design is used only if that is what is possible [that is the only possibility]. {This point is raised here particularly in the backdrop of certainty needed in finding answer(s) to posed question(s)}.

Is the reference number 18 [Baron RM, Kenny DA. The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations] complete? (this question is raised because this reference is of vital importance, in my opinion). Although this study is off-shoot of another study [MOVI-daFIT! Intervention: Rationale and design of a cluster randomized controlled trial testing the effects on improving adiposity, cognition, and subclinical atherosclerosis by increasing cardiorespiratory fitness in children], it seems to be methodologically well conducted/executed one. My only query is : why line numbers are not given for ‘discussion’ section?

Reviewer #5: This manuscript presents baseline data from a randomized controlled trial and examined the mediating role of executive functioning in the relationship between cardiovascular fitness and academic achievement. This study is well powered and answers an interesting research question. Further thoughts are presented below:

Major Issues:

There is little to no background given on why males and females are examined separately. This should be expanded on in the introduction since it is such a large piece of the analytic strategy.

The results and data analysis are extremely unclear. Was a multiple mediation analysis conducted or were separate mediation analyses conducted for each potential mediator and each DV? It appears like separate mediation analyses were conducted. It would seem like a better analytic approach would be to examine a multiple mediation model and determine which EF domains are mediating the relationship instead of looking at them all separately. The data analysis section should be written more clearly and I would suggest reconsidering the analytic plan.

Minor Issues:

Line 55 – 60: There are many more cognitive processes than the 3 described. Even when considering EF there are many more components to EF than just the 3 that are described.

Line 69: “Indirect effect of executive functions” is not fully accurate. Indirect effect is really the effect of IV through the pathway of mediator

Line 85-89: Discussion of mediation analysis seems unnecessary in the intro and this discussion is somewhat misleading. Mediation cannot determine whether a variable is a true mediator or a confounding variable

Line 180 – strong effects should read 0.14

208 – “There were no significant differences…” should be rephrased given that there were several differences between gender

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #4: Yes: Dr. Sanjeev Sarmukaddam

Reviewer #5: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: renamed_390ab.doc

PLoS One. 2020 Apr 10;15(4):e0231246. doi: 10.1371/journal.pone.0231246.r004

Author response to Decision Letter 1


26 Feb 2020

Response to reviewer 4 Comments

Important note: This review pertains only to ‘statistical aspects’ of the study and so ‘clinical aspects’ [like medical importance, relevance of the study, ‘clinical significance and implication(s)’ of the whole study, etc.] are to be evaluated [should be assessed] separately/independently.

Please note that it is preferable [refer to item 1b of CONSORT checklist 2010: Structured summary of trial design, methods, results, and conclusions; though article type is ‘Research Article’] to divide the ABSTRACT with small sections like ‘Objective(s)’, ‘Methods’, ‘Results’, ‘Conclusions’, etc. which is the accepted practice of most good/standard journals [including PLOS]. Your ABSTRACT is well drafted but assay type.

Authors response: We sincerely appreciate the reviewer´s comment; thus, as suggested, we have structured the abstract (see Page 2, Abstract section).

This being a cross-sectional study, there are few ‘design’ issues involved, regarding which, I am sure, authors are well aware [clear as it is mentioned in ‘Strengths and limitations’ section later]. All sorts of biases [more likely ‘selection’ biases] are common occurrence in such cross-sectional studies. A cross-sectional study is easy to conduct but generally is of very limited value [since in no way any cross-sectional study will yield confirmatory conclusion(s) mainly because of absence of temporal sequence]. Since any cross-sectional study is considered as a low level of [scientific] evidence, such design is used only if that is what is possible [that is the only possibility]. {This point is raised here particularly in the backdrop of certainty needed in finding answer(s) to posed question(s)}.

Authors response: Thank you for the comment. Although temporal ambiguity is certainly a core limitation to stablish causality in the relationship analyses, our mediation models, as some authors such as Stillman et al. 1, support the usefulness of these statistical mediation models to test plausibility of causal models, when experimental manipulation (the gold standard for assessing causality) is not available. Moreover, although this temporal limitation cannot be ruled out, it seems more plausible, according to the existing literature 2–4, that higher cardiorespiratory fitness causes better academic achievement, and not the opposite.

Therefore, as suggested, we have rephrased some sentences related to the reviewer´s concern:

“Thus, this study supports the hypothesis that improvements in CRF may contribute to increasing academic achievement not only through a direct mechanism but also through improvements in executive functions” (Page 3, line 44).

“Although previous studies support a directional relationship between physical activity and fitness to academic achievement, the cross-sectional nature of our analyses prevented us from making cause–effect inferences, since temporal ambiguity bias cannot be completely ruled out” (Page 17, lines 369-372).

1. Stillman, C. M., Cohen, J., Lehman, M. E. & Erickson, K. I. Mediators of Physical Activity on Neurocognitive Function: A Review at Multiple Levels of Analysis. Frontiers in Human Neuroscience 10, (2016).

2. Álvarez-Bueno, C. et al. The Effect of Physical Activity Interventions on Children’s Cognition and Metacognition: A Systematic Review and Meta-Analysis. Journal of the American Academy of Child & Adolescent Psychiatry 56, 729–738 (2017).

3. Donnelly, J. E. et al. Physical Activity, Fitness, Cognitive Function, and Academic Achievement in Children: A Systematic Review. Med Sci Sports Exerc 48, 1197–1222 (2016).

4. Hillman, C. H. et al. Effects of the FITKids randomized controlled trial on executive control and brain function. Pediatrics 134, e1063-1071 (2014).

Is the reference number 18 [Baron RM, Kenny DA. The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations] complete? (this question is raised because this reference is of vital importance, in my opinion). Although this study is off-shoot of another study [MOVI-daFIT! Intervention: Rationale and design of a cluster randomized controlled trial testing the effects on improving adiposity, cognition, and subclinical atherosclerosis by increasing cardiorespiratory fitness in children], it seems to be methodologically well conducted/executed one. My only query is: why line numbers are not given for ‘discussion’ section?

Authors response: Thank you, we apologize for the inconvenience. Both typos have been corrected (please, see pages 15-19, in discussion section and this reference corrected now reference 37, page 24, lines 521-524).

37. Baron, R. M. & Kenny, D. A. The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations. search. Journal of Personality and Social Psychology 51 1173-1182 (1986).

Response to reviewer 4 Comments

This manuscript presents baseline data from a randomized controlled trial and examined the mediating role of executive functioning in the relationship between cardiovascular fitness and academic achievement. This study is well powered and answers an interesting research question. Further thoughts are presented below:

Major Issues:

There is little to no background given on why males and females are examined separately. This should be expanded on in the introduction since it is such a large piece of the analytic strategy.

Authors response: Thank you. The reviewer’s comments and, in general, his/her involvement in the review process are highly appreciated. In order to duly justify the need to present the results separated by gender, we have modified the paragraph as follows:

“Additionally, no study has provided results separately by gender, even though gender differences in the association between CRF and academic achievement have been reported [17]. Moreover, differential brain maturation and executive function development between boys and girls have been reported [18]” (Page 5, lines 77-80).

The results and data analysis are extremely unclear. Was a multiple mediation analysis conducted or were separate mediation analyses conducted for each potential mediator and each DV? It appears like separate mediation analyses were conducted. It would seem like a better analytic approach would be to examine a multiple mediation model and determine which EF domains are mediating the relationship instead of looking at them all separately. The data analysis section should be written more clearly, and I would suggest reconsidering the analytic plan.

Authors response: The reviewer´s comment seems thoughtful. Thus, we have repeated the analyses according to her/his recommendation. Both models led us to the same conclusions:

A.

B.

Fig 3. Parallel serial mediation model. Cardiorespiratory fitness (independent variable) on academic achievement (dependent variable), through executive functions (mediator variable). Path a, association between independent variable and mediators; path b, association between mediator and dependent variables; path c, total effect between independent and dependent variables; path c´, direct effect of independent variable on dependent variable.

Finally, we have decided to show separate mediation models for each potential mediator in order to provide the reader a more clearly and simply information. Moreover, we have included also parallel serial mediation (as supplementary material) in order to provide the reader, the complete analyses, although statistical significance disappeared by gender, probably due to the lack of statistical power. Thus, we have included some sentences regarding this concern:

“Simple mediation models were tested, by introducing independently the three different mediating variables. Then, a parallel serial mediation model was tested in which the three domains of executive function (inhibition, cognitive flexibility and working memory) sere simultaneously entered in the model in such a way that each mediator was controlled for the others” (Page 9, lines 206-210).

“The mediation model scheme is displayed in Fig 3, and the results of the mediation analysis are shown in Table 3. Inhibition and cognitive flexibility mediated the association between CRF and academic achievement, controlling for age and mother educational level. In the first regression step (path a), CRF was positively related to the executive function domains (p < 0.05). In the second step (path c), the regression coefficients of CRF were positively associated with academic achievement in all mediation models (p < 0.001). In the last regression model (path b), the executive function domains were positively related to the dependent variable (p < 0.001), and the relationship between CRF and academic achievement became weaker (although significant) when the executive function domains were included in the model (path c’). Finally, the indirect effects were statistically significant for inhibition and cognitive flexibility, confirming that executive function domains acted as a partial mediator in these models, except for working memory. The mediation analyses by gender showed that, after controlling for mother educational level, cognitive flexibility was not significant in girls and inhibition in boys. When parallel serial mediation was performed, the results were similar (S2, Fig 4).” (Page 13, line 270-282).

Minor Issues:

Line 55 – 60: There are many more cognitive processes than the 3 described. Even when considering EF there are many more components to EF than just the 3 that are described.

Authors response: Thank you for the comment. The reviewer´s is right. Thus, we have rephrased the sentence as follows:

“Executive functions are a set of cognitive operations, three of the most studied are inhibition, working memory and cognitive flexibility” (Page 4, line 58-59).

Line 69: “Indirect effect of executive functions” is not fully accurate. Indirect effect is really the effect of IV through the pathway of mediator

Authors response: The reviewer´s is right. We have modified the sentence as follows:

“These studies have shown a significant positive relationship between physical fitness and academic achievement mediated by executive functions” (Page 4, line 70-72)

Line 85-89: Discussion of mediation analysis seems unnecessary in the intro and this discussion is somewhat misleading. Mediation cannot determine whether a variable is a true mediator or a confounding variable

Authors response: We appreciate this comment, thus, we have removed that paragraph.

Conversely, we have added a brief commentary about the convenience of this analysis in the discussion section:

“Mediation analysis has been proposed as an statistical procedure suitable for clarifying whether a third variable underlies the relationship between two variables. Thus, this procedure allows us to consider the significant proportion of the influence of the independent variable (CRF) on the dependent variable (academic achievement) takes place through executive functions (mediator) [37]” (Page 17, line 365-369).

Line 180 – strong effects should read 0.14

Authors response: Thank you for the comment. We apologize for the inconvenience. It has been corrected (Page 9, line 193).

208 – “There were no significant differences…” should be rephrased given that there were several differences between gender

Authors response: Thank you for the comment. We have rephrased the sentence related to the reviewer’s concern:

“There were several differences between gender in (…)” (Page 10, line 216-217)

Attachment

Submitted filename: 4. Response to reviewers.docx

Decision Letter 2

Tarek K Rajji

11 Mar 2020

PONE-D-19-14578R2

Executive functions mediate the relationship between cardiorespiratory fitness and academic achievement in Spanish schoolchildren aged 8 to 11 years.

PLOS ONE

Dear Mrs. SANCHEZ,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

ACADEMIC EDITOR: Please insert comments here and delete this placeholder text when finished. Be sure to:

  • Indicate which changes are required versus recommended for acceptance

  • Address any conflicts between the reviews

  • Provide specific feedback from your evaluation of the manuscript

==============================

We would appreciate receiving your revised manuscript by Apr 25 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Joshua Jones

Academic Editor

PLOS ONE

Journal Requirements:

Additional Editor Comments (if provided):

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #4: All comments have been addressed

Reviewer #5: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #4: Yes

Reviewer #5: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #4: Yes

Reviewer #5: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #4: Yes

Reviewer #5: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #4: Yes

Reviewer #5: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #4: Although I recommend to accept the article for publication in this prestigious journal, I request you to note the following [regarding the article quoted in response to my earlier comment saying that “as some authors such as Stillman et al. support the usefulness of these statistical mediation models to test plausibility of causal models, when experimental manipulation (the gold standard for assessing causality) is not available.”]:

Refer to page 6 of

Stillman, C. M., Cohen, J., Lehman, M. E. & Erickson, K. I. Mediators of Physical Activity on Neurocognitive Function: A Review at Multiple Levels of Analysis. Frontiers in Human Neuroscience 10, (2016) which gives the following account:

Cross-sectional studies utilizing statistical mediation provide a theoretical and mechanistic foundation about the relationships between cardiorespiratory fitness, brain, and cognition. However, their correlational nature leaves open the possibility that the observed behavioral and structural fitness-related differences between high and low-fit groups are caused by some unmeasured factor. RCTs are necessary to account for potential selection bias, as well as to establish a direct, causal relationship in humans between aerobic fitness, brain structure, and cognitive functioning.

Reviewer #5: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #4: No

Reviewer #5: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachment

Submitted filename: renamed_3992f.docx

PLoS One. 2020 Apr 10;15(4):e0231246. doi: 10.1371/journal.pone.0231246.r006

Author response to Decision Letter 2


13 Mar 2020

Response to reviewer 4:

Although I recommend to accept the article for publication in this prestigious journal, I request you to note the following [regarding the article quoted in response to my earlier comment saying that “as some authors such as Stillman et al. support the usefulness of these statistical mediation models to test plausibility of causal models, when experimental manipulation (the gold standard for assessing causality) is not available.”]:

Refer to page 6 of

Stillman, C. M., Cohen, J., Lehman, M. E. & Erickson, K. I. Mediators of Physical Activity on Neurocognitive Function: A Review at Multiple Levels of Analysis. Frontiers in Human Neuroscience 10, (2016) which gives the following account:

Cross-sectional studies utilizing statistical mediation provide a theoretical and mechanistic foundation about the relationships between cardiorespiratory fitness, brain, and cognition. However, their correlational nature leaves open the possibility that the observed behavioral and structural fitness-related differences between high and low-fit groups are caused by some unmeasured factor. RCTs are necessary to account for potential selection bias, as well as to establish a direct, causal relationship in humans between aerobic fitness, brain structure, and cognitive functioning.

Authors response: We appreciate the reviewer´s comment. We have considered the difference between what he or she suggested and the idea we were trying to expose. Thus, we have rephrased the following sentences:

“(…) however, cross-sectional studies utilizing statistical mediation provide a theoretical and mechanistic foundation about the relationships between cardiorespiratory fitness, brain, and cognition. Nevertheless, their correlational nature leaves open the possibility that the observed behavioural and structural fitness-related differences between high and low-fit groups are caused by some unmeasured factor” (lines 361-365)

“(…) Randomized controlled trials are necessary to account for potential selection bias, as well as to establish a direct, causal relationship in humans between aerobic fitness, brain structure, and cognitive functioning” (lines 368-370, page).

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 3

Tarek K Rajji

20 Mar 2020

Executive functions mediate the relationship between cardiorespiratory fitness and academic achievement in Spanish schoolchildren aged 8 to 11 years.

PONE-D-19-14578R3

Dear Dr. SANCHEZ,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Tarek K Rajji

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Tarek K Rajji

24 Mar 2020

PONE-D-19-14578R3

Executive functions mediate the relationship between cardiorespiratory fitness and academic achievement in Spanish schoolchildren aged 8 to 11 years.

Dear Dr. Sánchez-López:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Tarek K Rajji

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig

    (TIFF)

    S2 Fig

    (TIF)

    S1 Table. Mean differences (ANCOVA) in academic achievement in language and mathematics by CRF categories, controlling for age and mother educational level.

    (DOCX)

    S2 Table. Mean differences (ANCOVA) in academic achievement in language and mathematics by inhibition, cognitive flexibility and working memory categories, controlling for age and mother educational level.

    (DOCX)

    Attachment

    Submitted filename: Prados review.docx

    Attachment

    Submitted filename: Response_to_Reviewers.docx

    Attachment

    Submitted filename: renamed_390ab.doc

    Attachment

    Submitted filename: 4. Response to reviewers.docx

    Attachment

    Submitted filename: renamed_3992f.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    Data are available from figshare: https://figshare.com/s/d032c7e016f2bf3dd4b4. Figure: 10.6084/m9.figshare.9746126.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES