Skip to main content
Children logoLink to Children
. 2021 Sep 11;8(9):799. doi: 10.3390/children8090799

A Short Version of the EFECO Online Questionnaire for the Assessment of Executive Functions in School-Age Children

Sabina Barrios-Fernandez 1, Margarita Gozalo 2,*, Maria Amado-Fuentes 2, Jorge Carlos-Vivas 3, Andres Garcia-Gomez 4
Editor: Zoe Knowles
PMCID: PMC8465183  PMID: 34572231

Abstract

Executive function (EF) is a group of processes that allow individuals to be goal-oriented and to have adaptive functioning, so that adequate performance is essential for success in activities of daily living, at school and in other activities. The present study aims to create a short version of the Executive Functioning Questionnaire (EFECO) since there is a gap in the Spanish literature due to the lack of behavioural observation questionnaires at school age. A total of 3926 participants completed the online questionnaire. Subsequently, the validity and reliability of the data are analysed. The results show that the short version of the questionnaire, the EFECO-S, has a structure with five dimensions (emotional self-control, initiation, working memory, inhibition, and spatial organisation), as well as a second-order factor (global executive skill) and high reliability (ordinal Alpha = 0.68–0.88). The EFECO is composed of 67 items, while the EFECO-S has 20 items, four per factor, which turns it into a quick and easy to apply test. Therefore, it becomes an interesting alternative to be applied in screening processes with children who may be experiencing executive difficulties.

Keywords: executive function, children, assessment, online questionnaire

1. Introduction

1.1. Executive Function Conceptualization

Although Luria was one of the earliest authors to highlight the important role of the frontal lobe in behavioural control [1], the first definition of executive function (EF) is attributed to Lezak, who defined it as a set of cognitive abilities to carry out coherent plans for the achievement of specific goals [2]. Subsequently, EF experienced great dissemination after the publication of Phineas Gage’s story, emphasizing the role of the frontal lobe in linking cognitive, emotional and behavioural skills [3,4]. Comprehensively, EF is considered a set of cognitive and metacognitive skills that allow us to direct our behaviour towards a specific goal, including the ability to plan, carry out, check and correct our behaviours [5]. However, its conceptualization and the identification of the subprocesses or components that comprise it is a complex task due to the plurality of existing theoretical conceptualizations [6]. Thus, the term executive function is considered an umbrella concept with boundaries still undefined [7,8], with ongoing discussions about its dimensional nature, its neurological correlate and its assessment.

Although all theoretical models define EF as a set of skills, they do not all agree on the number of components nor the hierarchical structure [9,10]. The diversity of models oscillates between considering different components of the so-called cold EFs, involved in goal achievement and problem-solving, including working memory, attentional control, cognitive flexibility, inhibition, planning, organization, among others; and warm EFs, which pay attention to the role of emotional processes in cognitive control such as the ability to delay reward, self-reinforcement, decision making with affective components, empathy, theory of mind, social judgement, or emotional self-regulation [11,12]. Other authors have referred to these domains as metacognitive EF, and emotional and motivational EF [13]. Moreover, the neural network structure that serves as a substrate for executive functioning suggests that both cold and warm EF operate simultaneously in everyday life, except for dysfunctions [14]. The neural substrate for EF lies through multiple frontal-subcortical pathways among which a predominantly dorsolateral pathway is identified for cold EF processes and an orbitofrontal/ventromedial pathway for warm EF [15,16].

Furthermore, EF has a major impact on people’s daily lives both in the successful management of daily life situations and during the learning process, throughout all vital stages [8,17,18]. EF issues are related to other disorders such as mental diseases (e.g., schizophrenia, posttraumatic stress disorder) [19,20,21], and neurological disorders (e.g., Alzheimer’s disease, traumatic brain injury) [22,23]. In children, executive difficulties have been reported in neurodevelopmental disorders [24], including autism spectrum disorder [25,26,27,28], attention-deficit/hyperactivity disorder [27,29,30], intellectual disabilities [31,32,33,34], learning [35,36,37,38] and language disorders [39,40]. In addition, links have been found between deficits in EF with stress, anxiety, and depression [41]; executive difficulties have also been found in children with Gilles de LaTourette syndrome [42] and with Disruptive, Impulse-Control, and Conduct Disorders diagnosis [43], among others.

1.2. Executive Function Assessment

Several approaches can be considered for the EF assessment. Firstly, there are specific performance tests for evaluating specific skills such as working memory, planning, or inhibition. Thus, different tests based on the n-back, Stenberg or Stroop paradigm, go-no-go tasks, towers and maze tasks (e.g., Hanoi and London [44]), tasks with criterion shifts (e.g., Wisconsin card sorting test [45]) or fluency exist [46,47]. Examples of neuropsychological batteries which include this type of task would be the Delis Kaplan Executive Functions System (DKEFS) [48], the Minnesota Executive Function Scale (MFES) [49], and the neuropsychological assessment of executive functions in children (ENFEN) [50]. Secondly, there are non-FE specific tests such as the Wechsler scales [51] or some subscales of the Luria Neuropsychological Battery [52] which contain tasks that can be administered for EF assessment. Finally, exploratory tests through behavioural observation are also mentioned. They are usually observational scales in the form of self-report for adolescents or adults, or proxy-type scales, usually for children, to be answered by people who are close to them. Within this approach are the Behavior Rating Inventory of Executive Function (BRIEF) [53] and the Dysexecutive Questionnaire (DEX) for adults [54], and the Metacognitive Awareness System (metaCOG) [55] and the Childhood Executive Functioning Inventory (CHEXI) [56] for children.

Although the first two groups of tests (specific executive performance tasks) offer high specificity, they show weaknesses in ecological validity: they only explain 20% of the variance of EF in activities of daily living (35). Therefore, the use of specific tests in conjunction with behavioural assessment questionnaires is recommended for an adequate EF assessment [57,58]. To the best of our knowledge, there is no short version of the observational EF questionnaires available in Spanish to be used as a screening instrument.

1.3. The Executive Functioning Questionnaire (EFECO)

During 2011 in Spain, there was a need for a Spanish instrument to assess EF in school-age children, as the English-language tests had not yet been translated. At that time, there were some EF-specific tests or batteries, and non-specific tests to measure EF in school-age children. However, no behavioural assessment questionnaires were available for EF ecological assessment in children from 6–13 years.

The Executive Functioning Questionnaire (EFECO) creation dates from 2011, and the first version with preliminary online validation data was obtained in 2013 [59] through the Educarex platform, owned by the Regional Ministry of Education of the Government, available at https://recursos.educarex.es/cuestionarios/?cuestionarios (accessed on 1 June 2021); preliminary validation data were published in 2015 [60]; subsequently, a self-report version was developed for adolescents [61]. Currently, the EFECO has become one of the most widely used executive functioning assessment questionnaires in Spanish with more than 20,000 uses in more than 35 countries. Observations were collected on many everyday life situations in children aged between 6 and 13 years, adding reliability, and structural and construct validity data enough for reliable psychoeducational and clinical assessment.

The original EFECO version was constructed comprehensively, with a miscellany of items grouped around the most used EF subprocesses to date. The EFECO is composed of 67 items related to six factors: working memory and monitoring, inhibition, initiative and planning, organization of materials, emotional self-control, and flexibility. Responses are collected on a Likert-type scale with four response possibilities: (1) never or rarely, (2) sometimes, (3) frequently, or (4) very frequently.

1.4. Aim

Both the EFECO questionnaire in its proxy and self-report versions are extensive tools that require detailed reflection on multiple aspects of EF in children. It was identified the need for a screening tool for children, as there is a gap in Spanish literature to date. Between their practical implications will be the rapid detection of possible dysfunctions in EF to allow the implementation of necessary educational or clinical measures to promote the successful development of the child.

Thus, this study presents the main reliability and validity indicators of the EFECO short version, the main novelty of which is to serve as a screening tool for deviations in EF that may be influencing the daily lives of Spanish-speaking schoolchildren aged between 6–13 years.

2. Materials and Methods

2.1. Participants

The sample was obtained through more than 20,000 responses provided by families and professionals via the Education platform of the Government of Extremadura, available at https://recursos.educarex.es/cuestionarios/?cuestionarios (accessed on 1 June 2021). Eligibility criteria were: (1) respond based on the behaviours of Spanish-speaking children (2) between 6 and 13 years of age, (3) without pathology or diagnoses established by a clinical professional (4) cover the whole questionnaire, and (5) provide informed consent.

Finally, a total of 3926 children aged 6–13 years (9.15 ± 2.53) participated, being 2611 boys (66.5%), and 1315 girls (33.5%); 1945 questionnaires (49.6%) were completed by families, while 1981 (50.4%) were covered by educational or clinical professionals.

2.2. Instruments

The EFECO questionnaire, a behavioural assessment tool for EF assessment for Spanish-speaking children was used. As mentioned, the EFECO is composed of 67 items related to six factors: working memory and monitoring, inhibition, initiative and planning, organization of materials, emotional self-control, and flexibility. Responses are collected on a Likert-type scale with four response possibilities (1) never or rarely, (2) sometimes, (3) frequently, or (4) very frequently [59,60,61,62].

The EFECO also allows for the collection of basic socio-demographic data such as the existence or not of a clinical diagnosis, age, gender, nationality, or whether it is covered by families or professionals. The questionnaire takes between 10 and 15 min to complete. Once completed, a personalized report is generated with direct scores and percentiles.

Regarding EFECO initial psychometric indicators for the proxy version, average reliability revealed excellent values (Cronbach’s α = 0.96 and Guttman s α = 0.94). As indicators of structural validity, a factorial solution composed of 6 components explained 67.21% of the variance [60]. In the self-report for adolescents (mean age 16.23), indicators were like those from the proxy questionnaire, with internal consistency ranging from α = 0.64 to α = 0.95. Factor analysis offered a solution consisting of six grouped components with better goodness-of-fit indicators around two second-order dimensions, including a behavioural supervisory system and a cognitive supervisory system [61].

2.3. Procedures

As mentioned, the EFECO questionnaire is free and open to all Spanish-speaking participants, professionals, and families on the Educarex web. This platform is owned by the Regional Ministry of Education of the Government of Extremadura and is at the service of the entire universal education community in Spanish. Its main users are teachers of non-university education, school counsellors and student’s families.

Thus, data recorded during 2013–2020 for those participants who met the eligibility criteria have been processed. Then, cleaning operations were performed, deleting repeated, incomplete, or atypical questionnaires. Subsequently, a series of conceptual and statistical operations are carried out to configure the proposal for the elaboration and validation of a reduced version of the EFECO questionnaire.

This study was approved by the Bioethics and Biosafety Committee of the University of Extremadura (approval number: 70/2021). We followed the updates of the Declaration of Helsinki, modified by the 64th General Assembly of the World Medical Association (Fortaleza, Brazil, 2013) and the Law 14/2007 on Biomedical Research.

2.4. Statistical Analysis

The free-to-use statistical package FACTOR v.10.10.02 (Rovira I Virgili University: Tarragona, ESP) [63,64,65] was used to carry out the analyses. All of them considered the ordinal nature of the data collected through a Likert-type scale with four response options.

The Kaiser–Meyer–Olkin (KMO) and Bartlett’s sphericity tests were used as indices of sampling adequacy [66,67]. Later, to conduct the factor analysis of the items, items with factor loadings below 0.60, those with cross-loadings above 0.40 and items with communalities below 0.30 were eliminated [68]. By using a polychoric correlation matrix, suitable for ordinal data [69], the most appropriate number of dimensions was determined using optimal implementation of parallel analysis [70,71,72]. For factor extraction, the robust unweighted least squares (RULS) method with oblique rotation was used, assuming a correlation between factors [73,74]. Then, to explore the second-order factor structure, the Schmid–Leiman solution was used for the hierarchical ordering of the factors [75]. To assess the goodness-of-fit, we used the chi-squared probability setting as appropriate non-significant values (p > 0.05); the comparative fit index (CFI) and the non-normed fit index (NNFI); the root mean square error of approximation (RMSEA); and the root mean square of residuals (RMSR) [67,76].

Furthermore, to support construct validity, separate analyses of the questionnaires completed by families and professionals are provided. Correlations between the original version of the EFECO and the short EFECO version are reported to provide concurrent validity data. Moreover, to assess internal consistency, the Ordinal Alpha coefficient was used, considering values >0.70 as acceptable, >0.80 as good, and >0.90 excellent [77].

The statistical analysis was carried out based on secondary data from the administration of the original version of the EFECO questionnaire.

3. Results

3.1. The EFECO Short Version (EFECO-S)

The original version of the EFECO questionnaire is composed of 67 items. After performing the analyses, the short version (EFECO-S) was finally formed by 20 items distributed in 5 factors (Appendix A). Moreover, all first-order factors are grouped into a second-order factor (Figure 1).

Figure 1.

Figure 1

Final structure of the Executive Functioning Questionnaire (EFECO) short version.

This instrument is created in Spanish, but items are provided in English for easy reading. As mentioned, results are presented separately, firstly questionnaires completed by professionals, and then questionnaires answered by families.

3.2. Results of Questionnaires Completed by Professionals

As sample adequacy calculations offer a good fit (Bartlett’s = 22,257.4; df = 190; p = 0.000 and Kaiser-Meyer-Olkin test = 0.888) analyses were performed. Thus, starting with the original version of the 67-item EFECO questionnaire, and after performing the reduction procedures and factor analysis, a factorial solution of 20 items grouped into 5 dimensions was obtained.

Table 1 shows the structure and factor loadings of each item. An interpretable solution of 5 correlated dimensions was found, calling them: factor 1: Emotional self-control; factor 2: initiation and planning; factor 3: working memory; factor 4: inhibition; and factor 5: Spatial organization.

Table 1.

EFECO short version rotated factorial solution and factor loadings.

Items Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
He/she is slow in doing his home and schoolwork. 0.70
Needs someone around of him/her to do his/her homework. 0.87
Needs help from an adult to finish homework. 0.90
Needs constant encouragement to start school and homework. 0.75
Is always moving, does not standstill. 0.60
Interferes with or disrupts the activities of others. 0.75
Finds it difficult to behave appropriately at social gatherings. 0.77
Can’t stop doing something when asked not to do it anymore. 0.68
Makes decisions. 0.60
Makes good proposals to solve problems. 0.83
Has initiative to start activities, games, or homework. 0.64
Has lots of ideas. 0.82
Sometimes gets very angry about insignificant things. 0.79
Gets very upset when he/she loses something. 0.70
Gets upset easily. 0.84
Has frequent mood swings (sad, happy, fearful, surprised). 0.75
When asked to pick up his/her things, put them away neatly. 0.71
Finds materials when looking for them in his/her room or desk. 0.71
Likes to take care of his toys and belongings. 0.65
Seems to leave everything untidy in his wake. 0.63

Table 2 shows the correlations between the EFECO-S factors.

Table 2.

EFECO short version inter-factors correlation matrix.

Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
Factor 1
Emotional self-control
1
Factor 2
Initiation, planning
−0.12 1
Factor 3
Working memory
0.03 0.46 1
Factor 4
Inhibition
0.53 −0.03 0.3 1
Factor 5
Spatial organization
0.23 0.25 0.41 0.45 1

Table 3 reports the EFECO-S goodness-of-fit indices from the factorial solution extracted from polychoric correlations with RULS and Robust Promin Rotation. Both model total and partial indicators show the adequate fit of the factorial model to data [68,78].

Table 3.

EFECO-S goodness-of-fit indices from the factorial solution.

Indices Cut-Off Value
CMIN/DF <2 1.87
p (χ2) >0.05 0.000
NNFI >0.90 0.996
CFI >0.90 0.998
RMSEA <0.06 0.021 (0.010–0.050)
RMSR <0.08 0.0153

CMIN/DF: minimum discrepancy per degree of freedom; p (χ2): chi-squared probability; CFI: comparative fit index; NNFI: non-normed fit index, RMSEA: root mean square error of approximation; RMSR: root mean square of residuals.

Table 4 shows the Schmid–Leiman solution used to explore the hierarchical structure of the factorial solution. It points to the existence of a unidimensional solution, grouping all first-order factors into a single second-order factor which was named global executive skill.

Table 4.

Second-order factor. Schmid–Leiman solution.

Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
Second-order factor 0.39 0.26 0.53 0.68 0.71

Table 5 shows adequate reliability indices for all the resulting dimensions through the ordinal alpha in the EFECO-S [77].

Table 5.

Internal consistency of the EFECO short version questionnaire.

Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
Ordinal Alpha 0.85 0.81 0.88 0.79 0.77

Table 6 reports the correlations between the EFECO original version (67 items) and EFECO-S (20 items), which is significant and of large magnitude.

Table 6.

EFECO original version and short version correlations.

EFECO Original Version Correlation (r) EFECO Short Version
Emotional self-control 0.96 Emotional self-control
Initiative, planning 0.77 Initiative, planning
Working memory 0.87 Working memory
Inhibition 0.88 Inhibition
Organization 0.94 Spatial organization
Total punctuation 0.95 Total punctuation

3.3. Results of Questionnaires Completed by Families

Sample adequacy calculations provide a good fit: Bartlett’s = 15,221.0; df = 190; p = 0.000 and Kaiser–Meyer–Olkin test = 0.851 [67]. The factor analysis provides a factor solution composed of five correlated dimensions as in the questionnaires answered by the professionals. Table 7 shows the factor structure and loadings of every item.

Table 7.

EFECO short version rotated factorial solution and factor loadings.

Items Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
He/she is slow in doing his home and schoolwork. 0.70
Needs someone around of him/her to do his/her homework. 0.75
Needs help from an adult to finish homework. 0.84
Needs constant encouragement to start school and homework. 0.74
Is always moving, does not standstill. 0.59
Interferes with or disrupts the activities of others. 0.62
Finds it difficult to behave appropriately at social gatherings. 0.75
Can’t stop doing something when asked not to do it anymore. 0.57
Makes decisions. 0.62
Makes good proposals to solve problems. 0.72
Has initiative to start activities, games, or homework. 0.61
Has lots of ideas. 0.81
Sometimes gets very angry about insignificant things. 0.75
Gets very upset when he/she loses something. 0.6
Gets upset easily. 0.84
Has frequent mood swings (sad, happy, fearful, surprised). 0.62
When asked to pick up his/her things, put them away neatly. 0.59
Finds materials when looking for them in his/her room or desk. 0.55
Likes to take care of his toys and belongings. 0.6
Seems to leave everything untidy in his wake. 0.61

Table 8 shows the correlations between the EFECO-S factors.

Table 8.

EFECO short version inter-factors correlation matrix.

Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
Factor 1
Emotional self-control
1
Factor 2
Initiation, planning
−0.05 1
Factor 3
Working memory
0.25 0.13 1
Factor 4
Inhibition
0.51 −0.03 −0.1 1
Factor 5
Spatial organization
0.17 0.26 0.29 0.28 1

Table 9 shows the goodness-of-fit indices of the factorial solution. Partial and total fit statistics report an adequate fit of the factor model to the data, although data from the professionals’ questionnaires provide slightly higher indicators than those of the families.

Table 9.

EFECO-S goodness-of-fit indices from the factorial solution.

Indices Cut-Off Value
CMIN/DF <2 2.36
p (χ2) >0.05 0.000
NNFI >0.90 0.990
CFI >0.90 0.995
RMSEA <0.06 0.027 (0.010–0.050)
RMSR <0.08 0.0185

CMIN/DF: minimum discrepancy per degree of freedom; p (χ2): chi-squared probability; CFI: comparative fit index; NNFI: non-normed fit index, RMSEA: root mean square error of approximation; RMSR: root mean square of residuals.

The Schmid–Leiman solution points to a one-dimensional solution, with all first-order factors being grouped into a second-order factor (Table 10).

Table 10.

Second-order factor. Schmid–Leiman solution.

Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
Second-order factor 0.58 0.05 0.49 0.78 0.40

Adequate reliability indices for all the resulting dimensions through the ordinal alpha in the EFECO-S are found, as shown in Table 11 [77].

Table 11.

Internal consistency of the EFECO short version questionnaire.

Factor 1
Emotional
Self-Control
Factor 2
Initiation,
Planning
Factor 3
Working Memory
Factor 4
Inhibition
Factor 5
Spatial
Organization
Ordinal Alpha 0.80 0.78 0.85 0.73 0.68

Finally, Table 12 illustrates that the correlation between both versions of the questionnaires answered by families is significant and of large magnitude.

Table 12.

EFECO original version and short version correlations.

EFECO Original Version Correlation (r) EFECO Short Version
Emotional self-control 0.95 Emotional self-control
Initiative, planning 0.64 Initiative, planning
Working memory 0.84 Working memory
Inhibition 0.84 Inhibition
Organization 0.92 Spatial organization
Total punctuation 0.94 Total punctuation

4. Discussion

The purpose of this study was to provide a short version of the EFECO questionnaire (EFECO-S) that will provide a screening tool for EF issues to be used as screening in educational and clinical settings. Both the results provided by professionals and families offer a factorial structure with optimal indicators of goodness of fit, composed of five related dimensions that allow a global EF index (global executive skill) to be obtained. Reliability, established through ordinal alpha, is high, and the magnitude of the correlation between the original version of the EFECO questionnaire and the short version was also high, which is an important support for validity.

The five factors obtained in the short EFECO were: (1) Emotional self-control as the ability to modulate emotions to perform goal-oriented behaviours and to regulate logical, affective and emotional processes involved in decision making [79]; (2) Initiative and planning, as the ability to develop new initiatives and ideas, as well as to plan actions [80]; (3) Working memory, or the ability to maintain and manipulate information to perform tasks, solve problems or generate new information [81,82]; (4) Inhibition, defined as the ability that allows inhibiting impulses to select the most appropriate behaviour, for specific goals and adapted the social context [83]; and (5) Spatial organisation, understood as the ability to keep order in the elements to perform activities of daily living or to solve challenges [53,84].

EF are a set of cognitive and metacognitive skills that allow emotional impulses to be regulated when contrary to desired actions (EFECO-S factor 1); taking the initiative and defining goals (EFECO-S factor 2); keeping information online, maintaining online information, to monitor performance during or after the performance of activities, checking that the proposed goal has been achieved (EFECO-S factor 3); inhibiting irrelevant stimuli and others that compromise goals achievement, persevering or making changes when appropriate (EFECO-S factor 4); and maintaining an organized environment for action, including needed materials and information (EFECO-S factor 5). Thus, the EFECO-S questionnaire covers the spectrum of EF basic skills described in most of the classical approaches [2,5,53,85,86].

The second-order factor analysis did not reveal the existence of a hierarchical multifactorial structure as in other models [53]. All dimensions are correlated and clustered around a higher-order factor that was labelled as global executive skill. This hierarchical structure that gathers all dimensions around a second-order factor is in line with the results of some recent reviews that indicate that EF hierarchical structure is produced by differentiation throughout human development [87]. This evolution towards a multidimensional reality has to do with neural and functional maturation mediated by language and culture. During early childhood, inhibition and attentional control emerge unspecifically and develop in a specialised way. Between the ages of 6 and 12, skills such as goal setting and cognitive flexibility mature, and during adolescence (12–18 years), attentional control, working memory and the development of goal-setting abilities. These skills reach their peak around the age of 30, after which a slow decline in some of these skills until old age [13,80,88,89].

One of the main contributions of the present work is the presentation of a short version questionnaire, with solid indicators of reliability and validity, being an easy to use and resource-saving instrument, as it allows an EF screening of children between 6 and 13 years of age to be carried out in approximately five minutes. EFECO-S characteristics can be useful in clinical, educational and research settings. Thus, when there is a need for collective assessments either for the design of intervention programmes or for research projects, the shortness of this test will make it far more eligible than the previous version or other alternatives for EF assessment. In the context of individual intervention, the characteristics of the test (free of charge, short duration, etc.) will allow the clinical or educational professional to request its completion by parents in real time, during a session or tutoring, among others. However, the use of EFECO-S is recommended as a screening tool, and not as a diagnostic test, as diagnosis requires the use of a comprehensive assessment system including medical and neuropsychological data derived from clinical observation, medical tests, behavioural assessment questionnaires (including simulated situations in virtual reality) and performance tests [7,90,91].

This study has used an online questionnaire as the method of collecting information, as direct collection methods provide more valid results than online or telephone surveys [92,93,94]. However, online questionnaires have advantages from the researcher’s point of view, as they allow reducing costs, relocating the interviewer from the respondents, expanding the sample, and facilitating the collection and processing of data. Moreover, the data cleaning operations, together with the consistent psychometric results offered in the present work, and the consistency between the data collected by the online questionnaire and those offered in previous validation studies by the direct collection of questionnaires [60,61], are definitive support for the relevance of the sample. Furthermore, these data should be taken with caution as they are preliminary results and the analyses have been carried out based on secondary data from the application of the original version of the EFECO questionnaire. Therefore, future data should be provided, among others, about its sensitivity and specificity among different disorders, concurrent validity concerning other performance tests, and predictive validity concerning other variables. Another limitation of this short version is that it does not allow explicit assessment of some of the EF classical dimensions such as flexibility, monitoring or goal setting.

5. Conclusions

This study presents a short questionnaire for the EF assessment (EFECO-S) composed of five basic dimensions of executive functioning at school age. EFECO-S has reliability and validity indicators suitable both for psychoeducational and clinical purposes.

This instrument fills the existing gap in the Spanish language and can be used as screening by the educational community, including teachers and families, and health science professionals, through a simple administration that takes no more than five minutes.

Appendix A. Versión Breve del Cuestionario EFECO (EFECO-S)

Autocontrol de emociones
1. A veces se enfada mucho por cosas insignificantes.
2. Se altera mucho cuando pierde algo.
3. Se molesta fácilmente.
4. Tiene cambios de ánimo frecuentemente (triste, alegre, miedoso, sorprendido).
Iniciativa y planificación
5. Toma decisiones.
6. Hace propuestas buenas para resolver problemas.
7. Tiene iniciativa para comenzar actividades, juegos o tareas escolares.
8. Tiene muchas ideas.
Memoria de trabajo
9. Es lento en la realización de sus tareas escolares y del hogar.
10. Necesita a alguien encima para realizar sus trabajos.
11. Necesita de la ayuda de un adulto para terminar las tareas.
12. Necesita que le animen constantemente para comenzar a hacer sus tareas escolares y del hogar.
Inhibición
13. Está siempre moviéndose, no para quieto.
14. Interfiere o interrumpe las actividades de los demás.
15. Le resulta difícil comportarse de forma adecuada en reuniones sociales
16. Le resulta difícil dejar de hacer algo cuando se le pide que no lo haga más.
Organización del entorno
17. Cuando se le pide que recoja sus cosas, es capaz de recogerlas y dejarlas ordenadas.
18. Encuentra rápidamente sus materiales al buscarlos en su cuarto o escritorio.
19. Le gusta cuidar sus juguetes y sus pertenencias.
20. Parece que lo va dejando a su paso todo desordenado.

Author Contributions

Conceptualization, S.B.-F., J.C.-V., M.G., M.A.-F. and A.G.-G.; Methodology, A.G.-G.; Software, A.G.-G.; Formal analysis, A.G.-G. and M.G.; Writing—original draft preparation, S.B.-F. and J.C.-V.; Writing—review and editing, S.B.-F., M.G. and M.A.-F.; Supervision, S.B.-F. and M.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Ethics Committee of The University of Extremadura (Spain) (approval number: 70/2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The datasets used during the current study are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Luria A.R. Disturbances of Higher Cortical Functions with Lesions of the Frontal Region. In: Luria A.R., editor. Higher Cortical Functions in Man. Springer; Boston, MA, USA: 1980. pp. 246–365. [Google Scholar]
  • 2.Lezak M.D. The Problem of Assessing Executive Functions. Int. J. Psychol. 1982;17:281–297. doi: 10.1080/00207598208247445. [DOI] [Google Scholar]
  • 3.Damasio H., Grabowski T., Frank R., Galaburda A.M., Damasio A.R. The Return of Phineas Gage: Clues about the Brain from the Skull of a Famous Patient. Science. 1994;264:1102–1105. doi: 10.1126/science.8178168. [DOI] [PubMed] [Google Scholar]
  • 4.Damasio A.R. Descartes’ Error: Emotion, Reason, and the Human Brain. G.P. Putnam; New York, NY, USA: 1994. [Google Scholar]
  • 5.Wilson B., Evans J.J., Alderman N., Burgess P.W., Emslie H. Methodology Of Frontal And Executive Function. Psychology Press; Hove, UK: 2004. Behavioural assessment of the dysexecutive syndrome; pp. 232–254. [Google Scholar]
  • 6.Baggetta P., Alexander P.A. Conceptualization and Operationalization of Executive Function: Executive Function. Mind Brain Educ. 2016;10:10–33. doi: 10.1111/mbe.12100. [DOI] [Google Scholar]
  • 7.Chan R.C.K., Shum D., Toulopoulou T., Chen E.Y.H. Assessment of Executive Functions: Review of Instruments and Identification of Critical Issues. Arch. Clin. Neuropsychol. 2008;23:201–216. doi: 10.1016/j.acn.2007.08.010. [DOI] [PubMed] [Google Scholar]
  • 8.Huizinga M., Baeyens D., Burack J.A. Editorial: Executive Function and Education. Front. Psychol. 2018;9:1357. doi: 10.3389/fpsyg.2018.01357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Tirapu Ustárroz J., Bausela Herreras E., Cordero Andrés P. Modelo de funciones ejecutivas basado en análisis factoriales en población infantil y escolar: Metaanálisis. Rev. Neurol. 2018;67:215. doi: 10.33588/rn.6706.2017450. [DOI] [PubMed] [Google Scholar]
  • 10.Tirapu Ustárroz J., Cordero Andrés P., Luna Lario P., Hernáez Goñi P. Propuesta de un modelo de funciones ejecutivas basado en análisis factoriales. Rev. Neurol. 2017;64:75. doi: 10.33588/rn.6402.2016227. [DOI] [PubMed] [Google Scholar]
  • 11.Wood R.L., Worthington A. Neurobehavioral Abnormalities Associated with Executive Dysfunction after Traumatic Brain Injury. Front. Behav. Neurosci. 2017;11:195. doi: 10.3389/fnbeh.2017.00195. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Poon K. Hot and Cool Executive Functions in Adolescence: Development and Contributions to Important Developmental Outcomes. Front. Psychol. 2018;8:2311. doi: 10.3389/fpsyg.2017.02311. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Ardila A. On the Evolutionary Origins of Executive Functions. Brain Cogn. 2008;68:92–99. doi: 10.1016/j.bandc.2008.03.003. [DOI] [PubMed] [Google Scholar]
  • 14.Kanwisher N. Functional Specificity in the Human Brain: A Window into the Functional Architecture of the Mind. Proc. Natl. Acad. Sci. USA. 2010;107:11163–11170. doi: 10.1073/pnas.1005062107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Nejati V., Salehinejad M.A., Nitsche M.A. Interaction of the Left Dorsolateral Prefrontal Cortex (l-DLPFC) and Right Orbitofrontal Cortex (OFC) in Hot and Cold Executive Functions: Evidence from Transcranial Direct Current Stimulation (TDCS) Neuroscience. 2018;369:109–123. doi: 10.1016/j.neuroscience.2017.10.042. [DOI] [PubMed] [Google Scholar]
  • 16.Salehinejad M.A., Ghanavati E., Rashid M.H.A., Nitsche M.A. Hot and Cold Executive Functions in the Brain: A Prefrontal-Cingular Network. Brain Neurosci. Adv. 2021;5 doi: 10.1177/23982128211007769. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Power J.D., Schlaggar B.L. Neural Plasticity across the Lifespan. WIREs Dev. Biol. 2017;6:e216. doi: 10.1002/wdev.216. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Cortés Pascual A., Moyano Muñoz N., Quílez Robres A. The Relationship between Executive Functions and Academic Performance in Primary Education: Review and Meta-Analysis. Front. Psychol. 2019;10:1582. doi: 10.3389/fpsyg.2019.01582. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Thai M.L., Andreassen A.K., Bliksted V. A Meta-Analysis of Executive Dysfunction in Patients with Schizophrenia: Different Degree of Impairment in the Ecological Subdomains of the Behavioural Assessment of the Dysexecutive Syndrome. Psychiatry Res. 2019;272:230–236. doi: 10.1016/j.psychres.2018.12.088. [DOI] [PubMed] [Google Scholar]
  • 20.Li G., Wang L., Cao C., Fang R., Cao X., Chen C., Elhai J.D., Hall B.J. Posttraumatic Stress Disorder and Executive Dysfunction among Children and Adolescents: A Latent Profile Analysis. Int. J. Clin. Health Psychol. 2019;19:228–236. doi: 10.1016/j.ijchp.2019.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Berberian A.A., Gadelha A., Dias N.M., Mecca T.P., Comfort W.E., Bressan R.A., Lacerda A.T. Component Mechanisms of Executive Function in Schizophrenia and Their Contribution to Functional Outcomes. Braz. J. Psychiatry. 2019;41:22–30. doi: 10.1590/1516-4446-2018-0021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Townley R.A., Graff-Radford J., Mantyh W.G., Botha H., Polsinelli A.J., Przybelski S.A., Machulda M.M., Makhlouf A.T., Senjem M.L., Murray M.E., et al. Progressive Dysexecutive Syndrome Due to Alzheimer’s Disease: A Description of 55 Cases and Comparison to Other Phenotypes. Brain Commun. 2020;2:fcaa068. doi: 10.1093/braincomms/fcaa068. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Ozga J.E., Povroznik J.M., Engler-Chiurazzi E.B., Haar C.V. Executive (Dys)Function after Traumatic Brain Injury: Special Considerations for Behavioral Pharmacology. Behav. Pharmacol. 2018;29:617–637. doi: 10.1097/FBP.0000000000000430. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 5th ed. American Psychiatric Association Publishing; Washington, DC, USA: 2013. [Google Scholar]
  • 25.Demetriou E.A., Lampit A., Quintana D.S., Naismith S.L., Song Y.J.C., Pye J.E., Hickie I., Guastella A.J. Autism Spectrum Disorders: A Meta-Analysis of Executive Function. Mol. Psychiatry. 2018;23:1198–1204. doi: 10.1038/mp.2017.75. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Demetriou E.A., DeMayo M.M., Guastella A.J. Executive Function in Autism Spectrum Disorder: History, Theoretical Models, Empirical Findings, and Potential as an Endophenotype. Front. Psychiatry. 2019;10:753. doi: 10.3389/fpsyt.2019.00753. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Craig F., Margari F., Legrottaglie A.R., Palumbi R., de Giambattista C., Margari L. A Review of Executive Function Deficits in Autism Spectrum Disorder and Attention-Deficit/Hyperactivity Disorder. Neuropsychiatr. Dis. Treat. 2016;12:1191–1202. doi: 10.2147/NDT.S104620. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Gómez-Pérez M.d.M., Calero M.D. Differential Analysis of Executive Functions in Children from Disadvantaged Families vs. Children with Autistic Spectrum Disorder. Anal. Psicol. 2019;36:102–110. doi: 10.6018/analesps.326531. [DOI] [Google Scholar]
  • 29.Brown T.E. Executive Functions and Attention Deficit Hyperactivity Disorder: Implications of Two Conflicting Views. Int. J. Disabil. Dev. Educ. 2006;53:35–46. doi: 10.1080/10349120500510024. [DOI] [Google Scholar]
  • 30.Silverstein M.J., Faraone S.V., Leon T.L., Biederman J., Spencer T.J., Adler L.A. The Relationship Between Executive Function Deficits and DSM-5-Defined ADHD Symptoms. J. Atten. Disord. 2020;24:41–51. doi: 10.1177/1087054718804347. [DOI] [PubMed] [Google Scholar]
  • 31.Salvador-Carulla L., García-Gutiérrez J.C., Ruiz Gutiérrez-Colosía M., Artigas-Pallarès J., García Ibáñez J., González Pérez J., Nadal Pla M., Aguilera Inés F., Isus S., Cereza J.M., et al. Borderline Intellectual Functioning: Consensus and Good Practice Guidelines. Rev. Psiquiatr. Salud Ment. Engl. Ed. 2013;6:109–120. doi: 10.1016/j.rpsm.2012.12.001. [DOI] [PubMed] [Google Scholar]
  • 32.Artigas-Pallares J., Rigau-Ratera E., García-Nonell C. Borderline intellectual capacity and executive dysfunction. Rev. Neurol. 2007;44((Suppl. 2)):S67–S69. [PubMed] [Google Scholar]
  • 33.Roelofs R.L., Visser E.M., Berger H.J.C., Prins J.B., Van Schrojenstein Lantman-De Valk H.M.J., Teunisse J.P. Executive Functioning in Individuals with Intellectual Disabilities and Autism Spectrum Disorders: Autism, Intellectual Disabilities and Executive Functioning. J. Intellect. Disabil. Res. 2015;59:125–137. doi: 10.1111/jir.12085. [DOI] [PubMed] [Google Scholar]
  • 34.Costanzo F., Varuzza C., Menghini D., Addona F., Gianesini T., Vicari S. Executive Functions in Intellectual Disabilities: A Comparison between Williams Syndrome and Down Syndrome. Res. Dev. Disabil. 2013;34:1770–1780. doi: 10.1016/j.ridd.2013.01.024. [DOI] [PubMed] [Google Scholar]
  • 35.Matthews D., Biney H., Abbot-Smith K. Individual Differences in Children’s Pragmatic Ability: A Review of Associations with Formal Language, Social Cognition, and Executive Functions. Lang. Learn. Dev. 2018;14:186–223. doi: 10.1080/15475441.2018.1455584. [DOI] [Google Scholar]
  • 36.El Wafa H.E.A., Ghobashy S.A.E.L., Hamza A.M. A Comparative Study of Executive Functions among Children with Attention Deficit and Hyperactivity Disorder and Those with Learning Disabilities. Middle East Curr. Psychiatry. 2020;27:64. doi: 10.1186/s43045-020-00071-8. [DOI] [Google Scholar]
  • 37.Ji L., Zhao Q., Gu H., Chen Y., Zhao J., Jiang X., Wu L. Effect of Executive Function on Event-Based Prospective Memory for Different Forms of Learning Disabilities. Front. Psychol. 2021;12:528883. doi: 10.3389/fpsyg.2021.528883. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Malekpour M., Aghababaei S. The Effect of Executive Functions Training on the Rate of Executive Functions and Academic Performance of Students with Learning Disability. Int. J. Dev. Disabil. 2013;59:145–155. doi: 10.1179/2047387712Y.0000000004. [DOI] [Google Scholar]
  • 39.Pauls L.J., Archibald L.M.D. Executive Functions in Children With Specific Language Impairment: A Meta-Analysis. J. Speech Lang. Hear. Res. 2016;59:1074–1086. doi: 10.1044/2016_JSLHR-L-15-0174. [DOI] [PubMed] [Google Scholar]
  • 40.Acosta Rodríguez V., Ramírez Santana G.M., Hernández Expósito S. Executive Functions and Language in Children with Different Subtypes of Specific Language Impairment. Neurol. Engl. Ed. 2017;32:355–362. doi: 10.1016/j.nrleng.2015.12.007. [DOI] [PubMed] [Google Scholar]
  • 41.Ajilchi B., Nejati V. Executive Functions in Students With Depression, Anxiety, and Stress Symptoms. Basic Clin. Neurosci. J. 2017;8:223–232. doi: 10.18869/nirp.bcn.8.3.223. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Cavanna A.E., Ganos C., Hartmann A., Martino D., Pringsheim T., Seri S. The Cognitive Neuropsychiatry of Tourette Syndrome. Cognit. Neuropsychiatry. 2020;25:254–268. doi: 10.1080/13546805.2020.1760812. [DOI] [PubMed] [Google Scholar]
  • 43.Cruz A.R., de Castro-Rodrigues A., Barbosa F. Executive Dysfunction, Violence and Aggression. Aggress. Violent Behav. 2020;51:101380. doi: 10.1016/j.avb.2020.101380. [DOI] [Google Scholar]
  • 44.Welsh M.C., Satterlee-Cartmell T., Stine M. Towers of Hanoi and London: Contribution of Working Memory and Inhibition to Performance. Brain Cogn. 1999;41:231–242. doi: 10.1006/brcg.1999.1123. [DOI] [PubMed] [Google Scholar]
  • 45.Eling P., Derckx K., Maes R. On the Historical and Conceptual Background of the Wisconsin Card Sorting Test. Brain Cogn. 2008;67:247–253. doi: 10.1016/j.bandc.2008.01.006. [DOI] [PubMed] [Google Scholar]
  • 46.Soprano A.M. Cómo Evaluar la Atención y Funciones Ejecutivas en los Niños. Paidós; Buenos Aires, Argentina: 2014. [Google Scholar]
  • 47.Soprano A.M. Evaluación de las funciones ejecutivas en el niño. Rev. Neurol. 2003;37:44. doi: 10.33588/rn.3701.2003237. [DOI] [PubMed] [Google Scholar]
  • 48.Swanson J. The Delis-Kaplan Executive Function System: A Review. Can. J. Sch. Psychol. 2005;20:117–128. doi: 10.1177/0829573506295469. [DOI] [Google Scholar]
  • 49.Carlson M.L. Minnesota Executive Function Scale: Technical Report. Reflection Sciences, Inc.; Saint Paul, MN, USA: 2021. [Google Scholar]
  • 50.Portellano Pérez J.A., Martínez Arias M.R., Zumárraga Astorqui L. ENFEN: Evaluación Neuropsicológica de las Funciones Ejecutivas en Niños: Manual. TEA; Madrid, Spain: 2009. [DOI] [PubMed] [Google Scholar]
  • 51.Watkins M.W., Canivez G.L. Assessing the Psychometric Utility of IQ Scores: A Tutorial Using the Wechsler Intelligence Scale for Children–Fifth Edition. Sch. Psychol. Rev. 2021 doi: 10.1080/2372966X.2020.1816804. [DOI] [Google Scholar]
  • 52.Moses J.A., Golden C.J. Cross Validation of the Discriminative Effectiveness of the Standardized Luria Neuropsychological Battery. Int. J. Neurosci. 1979;9:149–155. doi: 10.3109/00207457909147668. [DOI] [PubMed] [Google Scholar]
  • 53.Gioia G.A., Isquith P.K., Guy S.C., Kenworthy L. TEST REVIEW Behavior Rating Inventory of Executive Function. Child Neuropsychol. 2000;6:235–238. doi: 10.1076/chin.6.3.235.3152. [DOI] [PubMed] [Google Scholar]
  • 54.Simblett S.K., Bateman A. Dimensions of the Dysexecutive Questionnaire (DEX) Examined Using Rasch Analysis. Neuropsychol. Rehabil. 2011;21:1–25. doi: 10.1080/09602011.2010.531216. [DOI] [PubMed] [Google Scholar]
  • 55.Meltzer L., Rodity B., Pollica I., Steinberg J., Stacey W., Krishnan K. Metacognitive Awareness System (MetaCOG) Research Institute for Learning and Development (ResearchILD); Lexington, MA, USA: 2004. [Google Scholar]
  • 56.Thorell L.B., Nyberg L. The Childhood Executive Functioning Inventory (CHEXI): A New Rating Instrument for Parents and Teachers. Dev. Neuropsychol. 2008;33:536–552. doi: 10.1080/87565640802101516. [DOI] [PubMed] [Google Scholar]
  • 57.Gioia G.A., Isquith P.K. Ecological Assessment of Executive Function in Traumatic Brain Injury. Dev. Neuropsychol. 2004;25:135–158. doi: 10.1080/87565641.2004.9651925. [DOI] [PubMed] [Google Scholar]
  • 58.Lalonde G., Henry M., Drouin-Germain A., Nolin P., Beauchamp M.H. Assessment of Executive Function in Adolescence: A Comparison of Traditional and Virtual Reality Tools. J. Neurosci. Methods. 2013;219:76–82. doi: 10.1016/j.jneumeth.2013.07.005. [DOI] [PubMed] [Google Scholar]
  • 59.García A., Rubio J.C. Propuesta de un instrumento para la valoración de las funciones ejecutivas en entornos educativos. In: Navarro J., editor. Diversidad, Calidad y Equidad Educativas. Consejería de Educación, Formación y Empleo; Murcia, Spain: 2011. [Google Scholar]
  • 60.García-Gómez A. Desarrollo y validación de un cuestionario de observación para la evaluación de las funciones ejecutivas en la infancia. Rev. Intercont. Psicol. Educ. 2015;17:141–162. [Google Scholar]
  • 61.Galarza C.A.R., Pasquel M.B., Gómez A.G., Suárez P.C.M., Guerrero J.J. EFECO Scale f or Assessing Executive Functions i n Self-Report Format. Rev. Iberoam. Diagnóstico Eval. Psicológica. 2019;1:83–94. [Google Scholar]
  • 62.García-Gómez A., Rubio-Jiménez J.C. Instrumento de Evaluación de Funciones Ejecutivas. [(accessed on 27 March 2021)]. Available online: https://orientacion.educarex.es/index.php/recursos/materiales-interactivos10/931-instrumento-de-evaluacion-de-funciones-ejecutivas.
  • 63.Ferrando P.J., Lorenzo-Seva U. Program FACTOR at 10: Origins, Development and Future Directions. Psicothema. 2017;29:236–240. doi: 10.7334/psicothema2016.304. [DOI] [PubMed] [Google Scholar]
  • 64.Lorenzo-Seva U., Ferrando P.J. FACTOR: A Computer Program to Fit the Exploratory Factor Analysis Model. Behav. Res. Methods. 2006;38:88–91. doi: 10.3758/BF03192753. [DOI] [PubMed] [Google Scholar]
  • 65.Lorenzo-Seva U., Ferrando P.J. FACTOR 9.2: A Comprehensive Program for Fitting Exploratory and Semiconfirmatory Factor Analysis and IRT Models. Appl. Psychol. Meas. 2013;37:497–498. doi: 10.1177/0146621613487794. [DOI] [Google Scholar]
  • 66.Frías-Navarro M.D.F., Pascual-Soler M.P. Prácticas del análisis factorial exploratorio (AFE) en la investigación sobre conducta del consumidor y marketing. Suma Psicol. 2012;19:47–58. [Google Scholar]
  • 67.Jöreskog K.G., Sörbom D. LISREL 8: User’s Reference Guide. 2nd ed. Scientific Software International; Chicago, IL, USA: 1996. [Google Scholar]
  • 68.Hair J., Black W., Babin B., Anderson R. Multivariate Data Analysis: A Global Perspective. Pearson Education; Upper Saddle River, NJ, USA: 2010. [Google Scholar]
  • 69.Choi J., Kim S., Chen J., Dannels S. A Comparison of Maximum Likelihood and Bayesian Estimation for Polychoric Correlation Using Monte Carlo Simulation. J. Educ. Behav. Stat. 2011;36:523–549. doi: 10.3102/1076998610381398. [DOI] [Google Scholar]
  • 70.Horn J.L. A Rationale and Test for the Number of Factors in Factor Analysis. Psychometrika. 1965;30:179–185. doi: 10.1007/BF02289447. [DOI] [PubMed] [Google Scholar]
  • 71.Lloret-Segura S., Ferreres-Traver A., Hernández-Baeza A., Tomás-Marco I. Exploratory Item Factor Analysis: A Practical Guide Revised and Updated. An. Psicol. 2014;30:1151–1169. doi: 10.6018/analesps.30.3.199361. [DOI] [Google Scholar]
  • 72.Timmerman M.E., Lorenzo-Seva U. Dimensionality Assessment of Ordered Polytomous Items with Parallel Analysis. Psychol. Methods. 2011;16:209–220. doi: 10.1037/a0023353. [DOI] [PubMed] [Google Scholar]
  • 73.Holgado-Tello F.P., Morata-Ramírez M.Á., Barbero-García M.I., Holgado-Tello F.P., Morata-Ramírez M.Á., Barbero-García M.I. Confirmatory Factor Analysis of Ordinal Variables: H Simulation Study Comparing the Main Estimation Methods. Av. Psicol. Latinoam. 2018;36:601–617. doi: 10.12804/revistas.urosario.edu.co/apl/a.4932. [DOI] [Google Scholar]
  • 74.Li C.-H. The Performance of ML, DWLS, and ULS Estimation with Robust Corrections in Structural Equation Models with Ordinal Variables. Psychol. Methods. 2016;21:369–387. doi: 10.1037/met0000093. [DOI] [PubMed] [Google Scholar]
  • 75.Schmid J., Leiman J.M. The Development of Hierarchical Factor Solutions. Psychometrika. 1957;22:53–61. doi: 10.1007/BF02289209. [DOI] [Google Scholar]
  • 76.Ferrando P.J., Anguiano-Carrasco C. El análisis factorial como técnica de investigación en psicología. Papeles Psicólogo. 2010;31:18–33. [Google Scholar]
  • 77.George D., Mallery P. SPSS for Windows Step by Step: A Simple Guide and Reference, 11.0 Update. Allyn and Bacon; Boston, MA, USA: 2003. [Google Scholar]
  • 78.Browne M., Cudeck R. Alternative Ways of Assessing Model Fit. Sociol. Methods Res. 1992;21:230–258. doi: 10.1177/0049124192021002005. [DOI] [Google Scholar]
  • 79.Beaver K.M., Wright J.P., Delisi M. Self-Control as an Executive Function: Reformulating Gottfredson and Hirschi’s Parental Socialization Thesis. Crim. Justice Behav. 2007;34:1345–1361. doi: 10.1177/0093854807302049. [DOI] [Google Scholar]
  • 80.Anderson P. Assessment and Development of Executive Function (EF) During Childhood. Child Neuropsychol. 2002;8:71–82. doi: 10.1076/chin.8.2.71.8724. [DOI] [PubMed] [Google Scholar]
  • 81.Baddeley A. Working Memory: Theories, Models, and Controversies. Annu. Rev. Psychol. 2011;63:1–29. doi: 10.1146/annurev-psych-120710-100422. [DOI] [PubMed] [Google Scholar]
  • 82.Goldman-Rakic P.S. Working Memory and the Mind. Sci. Am. 1992;267:110–117. doi: 10.1038/scientificamerican0992-110. [DOI] [PubMed] [Google Scholar]
  • 83.Diamond A. Executive Functions. Annu. Rev. Psychol. 2013;64:135–168. doi: 10.1146/annurev-psych-113011-143750. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Meltzer L. Executive Function in Education: From Theory to Practice. Guilford Publications; New York, NY, USA: 2007. [DOI] [Google Scholar]
  • 85.Bechara A., Damasio H., Damasio A.R. Emotion, Decision Making and the Orbitofrontal Cortex. Cereb. Cortex. 2000;10:295–307. doi: 10.1093/cercor/10.3.295. [DOI] [PubMed] [Google Scholar]
  • 86.Ozonoff S., South M., Provencal S. New Developments in Autism: The Future is Today. Jessica Kingsley Publishers; London, UK: 2007. Executive functions in autism: Theory and practice; pp. 185–213. [Google Scholar]
  • 87.Karr J.E., Areshenkoff C.N., Rast P., Hofer S.M., Iverson G.L., Garcia-Barrera M.A. The Unity and Diversity of Executive Functions: A Systematic Review and Re-Analysis of Latent Variable Studies. Psychol. Bull. 2018;144:1147–1185. doi: 10.1037/bul0000160. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Anderson V.A., Anderson P., Northam E., Jacobs R., Catroppa C. Development of Executive Functions through Late Childhood and Adolescence in an Australian Sample. Dev. Neuropsychol. 2001;20:385–406. doi: 10.1207/S15326942DN2001_5. [DOI] [PubMed] [Google Scholar]
  • 89.Ferguson H.J., Brunsdon V.E.A., Bradford E.E.F. The Developmental Trajectories of Executive Function from Adolescence to Old Age. Sci. Rep. 2021;11:1382. doi: 10.1038/s41598-020-80866-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.McCloskey G., Perkins L.A. Essentials of Executive Functions Assessment. John Wiley & Sons; Hoboken, NJ, USA: 2012. [Google Scholar]
  • 91.Miyake A., Emerson M.J., Friedman N.P. Assessment of Executive Functions in Clinical Settings: Problems and Recommendations. Semin. Speech Lang. 2000;21:169–183. doi: 10.1055/s-2000-7563. [DOI] [PubMed] [Google Scholar]
  • 92.Erens B., Burkill S., Couper M.P., Conrad F., Clifton S., Tanton C., Phelps A., Datta J., Mercer C.H., Sonnenberg P., et al. Nonprobability Web Surveys to Measure Sexual Behaviors and Attitudes in the General Population: A Comparison with a Probability Sample Interview Survey. J. Med. Internet Res. 2014;16:e276. doi: 10.2196/jmir.3382. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Yeager D.S., Krosnick J.A., Chang L., Javitz H.S., Levendusky M.S., Simpser A., Wang R. Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and Non-Probability Samples. Public Opin. Q. 2011;75:709–747. doi: 10.1093/poq/nfr020. [DOI] [Google Scholar]
  • 94.Malhotra N., Krosnick J.A. The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior: Comparing the 2000 and 2004 ANES to Internet Surveys with Nonprobability Samples. Polit. Anal. 2007;15:286–323. doi: 10.1093/pan/mpm003. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used during the current study are available from the corresponding author on reasonable request.


Articles from Children are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES