Abstract
The aim of the study was to investigate the psychometric properties (internal consistency, factor structure, and convergent validity) of the Spanish version of the Eating Habits Questionnaire (EHQ-ES) and its links to disordered eating in young adults. Two university student samples with a total of 487 participants (N1age = 21.75 ± 5.10; N2age = 21.17 ± 6.81) participated in the study. They filled out the Eating Habits Questionnaire and the Eating Attitudes Test. Our findings showed that the EHQ-ES demonstrated strong internal consistency, with a Cronbach’s α = 0.903 and ω = 0.939. The EHQ-ES consists of 20 items to measure problems associated with healthy eating (α = 0.855, ω = 0.879), knowledge of healthy eating (α = 0.783, ω = 0.826) and feeling positively about healthy eating (α = 0.775, ω = 0.773). In addition, subscales of the EHQ correlated with subscales of the EAT-26, showing that Orthorexia Nervosa is associated with disordered eating in a sample of university students. The current study is the first to describe a Spanish version of the EHQ. This demonstrates that EHQ-ES is a reliable screening tool for Spanish-speaking young adults. Moreover, the EHQ-ES can be a useful instrument for assessing ON in research and clinical practice.
Keywords: orthorexia nervosa, EHQ-ES, validation, EFA, CFA
1. Introduction
Recently, there has been an increasing emphasis in society about the importance of food in human health [1]. The involvement of the population in decision making as to the quality and quantity of the food they should and want to include in their diet has become important in everyday life [2]. In this context, a new role appears for the individual as an active agent, manager and producer of their own nutritional health. At the same time and due to the promotion of healthy behaviors in general, society is paying more attention or even “excessive attention” to healthy eating [3,4]. In this new scenario, a potential disorder emerges, orthorexia nervosa (ON), which was first defined as an extreme form of healthy food consumption [5]. Despite the fact that ON is not yet included in the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) and despite the lack of accepted diagnosis criteria, an extreme adherence to this form of healthy eating can lead to individuals experiencing serious physical and psychological consequences that affect their quality of life, including social withdrawal, loss of independence, diminished self-esteem and depression [6,7,8]. Most individuals with ON report discomfort and feel a higher level of anxiety and panic during mealtimes, which affects their interactions with family and non-family members [8,9].
Typically, self-reported scales are used to measure ON or the risk of ON. Such tools are easy to implement, need little time to complete and provide an individual’s perspective on how their eating problems affect their daily lives [10]. They can provide valuable information to health services to help them direct management decisions on this problem [11]. In addition, nowadays, there is a growing realization that the focus on prevention and health promotion of individuals and the results reported in studies using these methods are of great importance in health care research and subsequent treatment. Previous studies [12,13,14] have found that ON is related to “eating disorder risk” in young adults; thus, many of them also assessed the relationship between ON and symptoms and concerns characteristic of eating disorders.
To measure ON, the scientific community has developed different measuring instruments [3,10,15,16]. The assessment of ON is closely dependent on the quality of the measurement methods. According to recent research, there are different instruments available to assess different aspects of ON, but not all of them have been formally evaluated for their reliability, validity and responsiveness [17]. The ORTO-15 has been one of the most used and translated tools to assess ON worldwide, and despite the large number of studies and translations of this scale into several languages [11,18,19,20,21], the scientific community has concluded that this tool lacks an acceptable model and showed low internal reliability and low correlation with the other instrument tools [22,23,24,25]. Therefore, in consideration of other available questionnaires, the use of the Eating Habits Questionnaire (EHQ) and the Düsseldorf Orthorexia Scale (DOS), which seem to be reliable assessments of ON symptomatology, has been recommended [7,17,26].
The EHQ [27] is a questionnaire that was initially created with 160 items to finally become a self-report instrument with 21 items, divided into three factors: (1) Knowledge of healthy eating with 5 items, (2) Problems associated with healthy eating with 12 items and (3) Feeling positively about healthy eating with 4 items. Items are scored on a four-point scale ranging from 1 (false, not at all true), 2 (slightly true), 3 (mainly true) to 4 (very true). The scores for individual subscales and the total scale were summed, with higher scores indicating increased ON tendencies. The authors of the EHQ demonstrated the validity of the questionnaire, finding its scores positively correlated with higher levels of disordered eating behaviors. Previous studies that have been conducted with different measures of ON symptomatology found these same correlations in order to clarify if ON has more in common with eating disorders, if it is a new disorder or a subtype of eating disorder [8,28].
It is worth pointing out the EHQ has never been translated and validated in a Spanish population. We believe it is innovative to validate the latest instrument used in ON studies, which seems to be closer, according to the scientific community, to an assessment of ON symptomatology, and which will therefore be very useful in the advances in the detection of this pathology in the Spanish-speaking community. Therefore, the objective of this study was to evaluate the psychometric properties (internal consistency, factor structure and convergent validity) of the Spanish version of the EHQ among young adults. The previous studies [24,27,28] found that ON is related to “eating disorder risk” in young adults; thus, we also assessed the relationship between symptoms associated with ON and symptoms commonly linked to eating disorders in our sample study.
2. Materials and Methods
2.1. Study Participants
This study was a cross-sectional survey with a total sample of 487 university students from the University of Castilla–La Mancha, Spain. Participants (N = 487) were recruited online during classes from April 2019 to January 2020. The participants completed the questionnaires voluntarily using the electronic platform “Google form” and according to the principles of the Helsinki Declaration. Data handling issues encompassed electronic systems (computer workstations and laptops) for storage, archival, sharing, and disposing off data. All the participants responded voluntarily to the survey and did not receive any financial compensation for participation in the study. Their anonymity was guaranteed and they completed their informed consent before starting the survey.
The study was approved by the Ethics Committee of the University Hospital of Castilla–La Mancha, in accordance with the ethical guidelines established by the Declaration of Helsinki in 2008 (Code C-270).
2.2. Measures
2.2.1. Assessment of the Symptoms and Concerns Characteristic of Eating Disorders: The EAT-26
The Eating Attitudes Test-26 [29], originating from the EAT-40 [30], is a 26-item tool assessing “eating disorder risk”. In our study, we used the Spanish version of the EAT-26 [31,32]. Each question had 6 response options (never, rarely, sometimes, often, very often, always); the first 3 were scored with 0, the fourth with 1, the fifth with 2 and the sixth with 3. The total score is the sum of the values of the items, taking into account that question 25 is scored inversely: the higher the score, the higher the risk of eating disorder. In the Spanish version of the EAT-26, there are 4 underlying domains: bulimia, dieting, preoccupation with food and oral control. Cronbach’s alpha was 0.90 for the Spanish version [32]. In the present study, Cronbach’s alpha also was 0.90.
2.2.2. Assessment of Orthorexia Nervosa: The EHQ
The EHQ [26] is a multidimensional measure of ON symptomatology with factors measuring: (1) knowledge of healthy eating, (2) problems associated with healthy eating, and (3) feeling positively about healthy eating. Items are on a 4-point scale (false, not at all true, slightly true, mainly true, very true), where higher scores are indicative of ON tendencies. Adequate internal consistency across all three subscales (α = 0.82 to 0.90) and 2- to 4-week test–retest reliability (r = 0.72 to 0.81) were reported [26].The Cronbach’s alpha in the current sample was α = 0.94 for the total scale, and α = 0.82, 0.89, and 0.73, respectively, for the knowledge, problems, and feelings subscales.
The cross-cultural adaptation includes cultural and linguistic adaptations of the questionnaire in addition to examining the psychometric properties of reliability and validity [31]. Prior to beginning the process, we received approval from the first author of the original scale (application approved in May 2019 by Gleaves). The process was begun in accordance with the international standards published by Beaton et al. [33]. The EHQ English questionnaire was translated back and forth from English to Spanish independently by subject matter and professional linguistic experts. To ensure content validity, a harmonization meeting was held to combine the two versions of the translated questionnaire, composed of a multidisciplinary team of experts. The adaptation process took into account barrier factors in linguistic comprehension, contextualized meaning associated with a construct and possible interpretations of the translated instrument. The final version of the Spanish EHQ-ES (Table 1) was then tested with four members of the target population (university students). This process ensured content and questionnaire validity and the comprehensibility of all items. No further modifications were necessary.
Table 1.
1. Estoy más informado/a que los demás acerca de la alimentación saludable. 1. I am more informed than others about healthy eating. |
2. Rechazo ofertas sociales que conllevan tener que comer comida poco sana. 2. I turn down social offers that involve eating unhealthy food. |
3. La forma en la que preparo mi comida es importante en mi dieta. 3. The way my food is prepared is important in my diet. |
4. Sigo una dieta que tiene muchas reglas. 4. I follow a diet with many rules. |
5. Mis hábitos alimenticios son superiores a los de los demás. 5. My eating habits are superior to others. |
6. Me distraigo con pensamientos de comer de forma saludable. 6. I am distracted by thoughts of eating healthily. |
7. Solo como lo que mi dieta me permite. 7. I only eat what my diet allows. |
8. Comer de forma saludable es una fuente significativa de estrés en mis relaciones. 8. My healthy eating is a significant source of stress in my relationships. |
9. He hecho muchos esfuerzos para comer de forma más saludable a lo largo del tiempo. 9. I have made efforts to eat more healthily over time. |
10. Mi dieta afecta el tipo de empleo que yo aceptaría. 10. My diet affects the type of employment I would take. |
11. Mi dieta es mejor que las dietas de los demás. 11. My diet is better than other people’s diets. |
12. Me siento en control cuando como de forma saludable. 12. I feel in control when I eat healthily. |
13. El año pasado, los amigos o miembros de la familia me han comentado que estoy demasiado/a preocupado/a con comer sano. 13. In the past year, friends or family members have told me that I am overly concerned with eating healthily. |
14. Tengo dificultad para encontrar restaurantes que sirvan las comidas que yo como. 14. I have difficulty finding restaurants that serve the foods I eat. |
15. Comer de la manera que yo lo hago me da una sensación de satisfacción. 15. Eating the way I do gives me a sense of satisfaction. |
16. Pocas comidas son saludables para que yo las coma. 16. Few foods are healthy for me to eat. |
17. Me paso más de tres horas al día pensando en comer de forma saludable. 17. I go out less since I began eating healthily. |
18. Salgo menos desde que he empezado a comer de forma saludable. 18. I spend more than three hours a day thinking about healthy food. |
19. Sigo de forma rígida una dieta de comida saludable. 19. I follow a health-food diet rigidly |
20. Me siento genial cuando como de forma saludable. 20. I feel great when I eat healthily. |
21. Preparo comida de la forma más saludable. 21. I prepare food in the most healthful way. |
2.3. Statistical Analysis
The whole sample (N = 487) was randomly split into two independent subsamples. We applied an Exploratory Factor Analysis (EFA) on the first subsample (N1 = 286) and a Confirmatory Factor Analysis (CFA) on the second subsample (N2 = 201). According to different authors [34,35], it is most appropriate, if the sample is considered as a large sample, to randomly split the sample in half. An EFA to identify the number of factors is conducted on the first half. Once the EFA reveals the best number of factors to represent the data, then a CFA is conducted on the second random half to confirm that this new factor structure fits the data [34,35].
With the first sample, an Exploratory Factor Analysis (EFA) was applied using SPSS 25 (IBM-SPSS, Armonk, NY, USA, 2017). Before the statistical analysis, data assumptions such as high sample size, multivariate normality, linearity and correlation between variables were tested; Kaiser–Meyer–Olkin (KMO) index and the Barlett test of Sphericity were the criteria (REF); to identify the adequate factor numbers, Cattell’s scree plot and Horn’s parallel analysis were applied with the first sample [36].
A Confirmatory Factor Analysis (CFA) was applied using AMOS 19.0 with a second sample (N2 = 201). We tried to confirm the exploratory solution and for this, the overall fit was tested using the following fit indices: the Chi-Square statistic X2, the Adjusted goodness of fit index (AGFI), Comparative Fit Index (CFI), Normed Fit Index (NFI), Tuckey–Lewis Fit Index (TLI). In these indices, the reference value is >0.90 to consider an acceptable model (range between 0 and 1); for parsimony adjustment, Root Mean Square Residual (RMSR) and Root Mean Square Error of Approximation (RMSEA) whose reference values are <0.06 [37] and Akaike Information Criterion [38,39].
3. Results
3.1. Characteristics of the Samples
3.1.1. Sample 1
Concerning the EFA, the analyses were focused on a sample of 286 nursing students from a public Spanish University. In the first sample, 81.9% were female and 18.9% were male. The mean age was 21.75 years (SD = 5.10). The mean Body Mass Index (BMI) was 22.61 kg/m2 (SD = 3.61, with mean weight of 63.78 kg (SD = 13.03) and mean height of 167.83 cm (SD = 8.14). Moreover, 56.9% of the nursing students had gone on a diet during the last year and 43.1% had never done a diet.
3.1.2. Sample 2
The second sample was composed of 201 nursing students. In the second sample, 52.2% were female and 47.8% were male. The mean age was 21.17 years (SD = 6.81). The mean BMI was 23.83 kg/m2 (SD = 2.85, with mean weight of 70.54 kg (SD = 12.26) and mean height of 171.65 cm (SD = 0.099). In addition, 65.2% had gone on a diet during the last year and 34.3% had not.
3.2. Exploratory and Confirmatory Factor Analysis
Table 2 summarizes the factorial solution of the EHQ, factorial weights, percentage of variance explained, Cronbach’s alpha and coefficient Omega. The number of factors was three, similar to the original instrument by Gleaves, Graham and Ambwani [27]. The first factor, named problems, was composed of nine items, for instance, “I only eat what my diet allows” or “I go out less since I began eating healthily”. The second factor, called knowledge, was composed of eight items, such as, “I follow a diet with many rules” or “I turn down social offers that involve eating unhealthy food”. The third factor, named feeling, consisted of three items, for instance “I feel in control when I eat healthily” or “I prepare food in the most healthful way”. The iterative process of item removal to improve model fit led to the suppression of one item: EHQ19, i.e., “I follow a health-food diet rigidly”. This item in the original test belongs to the feeling “dimension” but it has a factor weight of 0.614 on the problems dimension and 0.449 on the knowledge dimension and has no factor weight in its original feeling dimension. Furthermore, the skewness value was 1.73, the kurtosis value was 2.38 and the mean was 1.40 in a range of 1–4, which justifies its elimination.
Table 2.
Items | EFA First Sample |
CFA Second Sample |
||||
---|---|---|---|---|---|---|
P | K | F | P | K | F | |
EHQ18: I spend more than three hours a day thinking about healthy food | 0.706 | 0.585 | ||||
EHQ13: In the past year, friends or family members have told me that I am overly concerned with eating habits | 0.666 | 0.714 | ||||
EHQ8: My healthy eating is a significant source of stress in my relationship | 0.660 | 0.549 | ||||
EHQ17: I go out less since I began eating healthily | 0.652 | 0.586 | ||||
EHQ7: I only eat what my diet allows | 0.626 | 0.322 | 0.544 | |||
EHQ14: I have difficulty finding restaurants that serve the food I eat | 0.608 | 0.762 | ||||
EHQ10: My diet affects the type of employment I would take | 0.569 | 0.578 | ||||
EHQ16: Few foods are healthy for me | 0.540 | 0.654 | ||||
EHQ6: I am distracted by thoughts of eating habits | 0.457 | 0.435 | 0.523 | |||
EHQ5: My eating habits are superior to others | 0.768 | 0.577 | ||||
EHQ11: My diet is better than other people’s diet | 0.768 | 0.500 | ||||
EHQ3: The way my food is prepared is important in my diet | 0.518 | 0.480 | 0.620 | |||
EHQ1: I am more informed than others about healthy eating | 0.514 | 0.553 | ||||
EHQ4: I follow a diet with many rules | 0.482 | 0.513 | 0.544 | |||
EHQ2: I turn down social offers that involve eating unhealthy food | 0.425 | 0.395 | ||||
EHQ20: I feel great when I eat healthily. | 0.755 | 0.611 | ||||
EHQ12: I feel in control when I eat healthy | 0.666 | 0.577 | ||||
EHQ9: I have made efforts to eat more healthily over time | 0.653 | 0.627 | ||||
EHQ21: I prepare food in the most healthy way | 0.520 | 0.634 | ||||
EHQ15: Eating the way I do gives me a sense of satisfaction | 0.485 | 0.530 | ||||
Variance explained | 35.53 | 8.63 | 6.45 | |||
Cronbach’s Alpha | 0.855 | 0.783 | 0.775 | |||
Omega | 0.879 | 0.826 | 0.773 |
Note: Factorial weight less than 0.30 were excluded; P = Problems; K = Knowledge; F = Feelings.
Regarding reliability, the overall Cronbach’s alpha was 0.903 and Omega was 0.939. For each factor, the findings were: α = 0.855, ω = 0.879 for the first factor; α = 0.783, ω = 0.826 for the second factor; and α = 0.775, ω = 0.773 for the third factor. These indices can be interpreted as excellent and coherent with the internal consistency of the original questionnaire. Moreover, the homogeneity indices range was between 0.363 (item 2) and 0.636 (item 21).
According to the exploratory solution, a CFA was conducted on a second sample in order to confirm the fit of the model. The goodness-of-fit indices’ global scale was: X2 = 279.26, p = 0.000 (df = 156), Adjusted Goodness of Fit index = 0.831, Comparative Fit Index = 0.911, Normed Fit Index = 0.835, Tucker–Lewis Fit Index = 900, Root Mean Square Residual = 0.051, Root Mean Square Error of Approximation = 0.065 and Akaike Information Criterion was 387.268.
3.3. Convergent Validity
As presented in Table 3, the convergent validity of the EHQ was significantly correlated with EAT-26 and its dimensions. The correlations between three subscales of the EHQ (problems, knowledge and feeling) and four subscales of the EAT-26 (bulimia, diet, worry about food and control oral) were significant with a confidence level of p < 0.01. Only the correlations between oral control and knowledge (r = 0.084, p > 0.05) and feelings (r = 0.050, p > 0.05) were not significant.
Table 3.
EHQ Total | EHQ Problems | EHQ Knowledge | EHQ Feelings | |
---|---|---|---|---|
Bulimia | 0.565 ** | 0.645 ** | 0.379 ** | 0.398 ** |
Dieting | 0.644 ** | 0.595 ** | 0.515 ** | 0.537 ** |
Worry about food | 0.442 ** | 0.488 ** | 0.242 ** | 0.411 ** |
Oral control | 0.163 ** | 0.257 ** | 0.084 | 0.050 |
EAT-26 total | 0.582 ** | 0.629 ** | 0.391 ** | 0.459 ** |
** p < 0.01.
4. Discussion
This study aimed to evaluate the psychometric properties of the Spanish version of the EHQ (EHQ-ES) in young adults. The EHQ-ES demonstrated strong internal consistency with a Cronbach’s α = 0.903 and ω = 0.939. In other EHQ versions [12,40,41], the Cronbach’s α ranged from 0.75 to 0.90. The EHQ-ES consists of 20 items and has a similar factorial structure to the original version of the EHQ [27] as well as the Italian version [42]. The Polish version [12], compared to the original scale, had the same number of factors but a reduced number of items (14 items instead of 21). On the other hand, the Hungarian version of the EHQ [37] revealed four factors that the authors named differently (thoughts about healthy eating, dietary restriction, diet superiority and social impairment) but none of the items were eliminated. The French version of the EHQ [36] was reduced to 16 items in a three-factor structure. Although the psychometric properties of the different versions analyzed show promising results, the discussion among the scientific community is regarding the quality of the measurement model of ON [17,41]. In the English version of the EHQ [43], the authors named one of the dimensions “Behaviours-subscale” as a result of the loading of three items, belonging in the original scale to the dimension of “problems”, into the dimension “knowledge”; as a consequence, there is a change in the definition of this dimension [41].
Likewise, there are differences in the variability of the number of items eliminated among the different versions, and, in certain cases, there are similarities among the different versions. In relation to other validated ON tests, in which there is also this difference or shift of items from one dimension to another, some authors suggest that it may be due to sociocultural differences, taking into account the social aspect surrounding meals [8,11]. However, there are authors who accept this movement of items in terms of test structure or reliability [25]. In our study, within the information related to the EFA results, the item EHQ19 (“I follow a health-food diet rigidly”) was removed because it had no factorial weight on any dimension. According to different authors, a translated instrument needs to be revalidated with the target population because of the potential distortions of the items during the translation procedure [44,45]. However, according to other authors, instrument validation in cross-cultural research is evaluated with the assessment of multiple psychometric properties; scale means, variance, reliabilities, criterion validity and factorial validity are appropriate approaches for instrument validation [46]. The cultural differences and the translation procedure often induce the failure to obtain invariance of the psychometric properties of the original and the translated version of the instrument in cross-cultural research. The reliability and validity of the measures are main indicators of the quality of a measuring instrument and while the complexity of translation should not be underestimated, not having well-defined diagnostic criteria may alter the value of the meaning or weight of the measure in terms of what the questionnaire is supposed to measure.
According to the third factor of the EHQ (feelings), the factorial solution of the CFA showed that item 15 and item 21 did not have a significant weight on the construct feeling. Moreover, in the EFA, the factorial weights were almost similar to second factor (knowledge), in this sense, the items meaning could be related by the participants with the knowledge dimension. In fact, both items show actions related with eating habits; specifically, it involves actions that people make in order to eat healthy. Therefore, it would not be related directly with their feelings.
Regarding divergent validity, the correlational analysis of the EHQ-ES and the EAT-26 revealed that coefficient correlations ranged from 0.163 to 0.645. Our results showed that a higher score on the EHQ-ES designed to detect ON symptoms correlated with a higher score on the EAT-26, elevated symptoms and concerns characteristic of eating disorders in a sample of university students. Gleaves et al. [27] also found a relationship between problems (r = 0.79), knowledge (r = 0.54) and feelings (r = 0.41) and pathological eating (EAT-26 total score). In addition, problems associated with healthy eating in the original EHQ correlated more highly with measures of eating pathology (EAT-26) than with measures of general pathology, personality, or social desirability in a college student sample [27]. Our findings were consistent with previous studies [12,40,41,42] that found no significant relationship between feeling positively about healthy eating and self-control about food and social pressure to gain weight (oral control). It is worth adding that the Italian version of the EHQ total score correlated with eating pathology as well (measured by the Eating Disorder Inventory-3-Referral Form) [42]. To sum up, our results are consistent with numerous studies [27,43,47,48] showing that greater ON symptomatology is associated with higher levels of disordered eating.
Our study has some limitations. The first is that our sample was a convenience sample and was comprised of young adults (university students). This highlights the lack of generalizability of the current findings. Another limitation is the fact that as they are all nursing students and, therefore, more focused on health, this knowledge may indirectly affect their responses as they were more likely to have healthy eating habits. Nevertheless, our samples have very similar demographic characteristics to the original sample where the questionnaire was created. Therefore, it is important that psychometric evaluation of the EHQ-ES is repeated in a general population Moreover, a large sample size would provide more conclusive evidence regarding the psychometric properties of the EHQ-ES. Another limitation of the present study is selection bias (due to the non-representative nature of the respondents, also called the ‘volunteer effect’) [49]. Finally, due to the cross-sectional study design, test–retest reliability was not assessed in the present study. Notwithstanding these limitations, the study suggests that the EHQ-ES displays significant validity.
5. Conclusions
The EHQ-ES appears to be a valid and reliable instrument to assess cognition, behaviors, and feelings related to ON in Spanish-speaking young adults. The EHQ-ES can be a useful instrument for assessing ON in research and clinical practice.
Acknowledgments
A.B.-M. acknowledges the financial support by the “Excellence Initiative—Research University” program for the years 2020–2026 for the University of Wroclaw.
Author Contributions
Conceptualization, M.L.P.-F., M.D.O.-Z. and A.B.-M.; methodology, M.L.P.-F., M.D.O.-Z., J.J.F.-M. and A.B.-M.; software, M.L.P.-F., M.D.O.-Z., J.J.F.-M. and E.F-M.; validation, M.L.P.-F., M.D.O.-Z. and J.J.F.-M., formal analysis, M.L.P.-F. and J.J.F.-M.; investigation, M.L.P.-F., M.D.O.-Z. and J.J.F.-M.; resources: M.L.P.-F., M.D.O.-Z. and E.F.-M.; data curation, M.L.P.-F. and J.J.F.-M.; writing—original draft preparation, M.D.O.-Z., M.L.P.-F., J.J.F.-M. and A.B.-M.; writing—review and editing, M.D.O.-Z., M.L.P.-F., J.J.F.-M., A.G. and A.B.-M.; visualization, M.D.O.-Z., M.L.P.-F., J.J.F.-M. and A.B.-M.; supervision, M.D.O.-Z., M.L.P.-F. and A.B.-M.; project administration, M.L.P.-F. and M.D.O.-Z.; funding acquisition, M.L.P.-F. and M.D.O.-Z. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding. The APC was funded by Jan Dlugosz University in Czestochowa, Poland (RR B + R’s subvention).
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the University Hospital of Castilla-La Mancha (Code C-270).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The dataset used during the current study is available from the corresponding author on reasonable request.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Cao C., Xiao Z., Wu Y., Ge C. Diet and skin aging—From the perspective of food nutrition. Nutrients. 2020;12:870. doi: 10.3390/nu12030870. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Strahler J. The dark side of healthy eating: Links between orthorexic eating and mental health. Nutrients. 2020;12:3662. doi: 10.3390/nu12123662. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Barthels F., Meyer F., Pietrowsky R. Die düsseldorfer orthorexie skala—Konstruktion und evaluation eines fragebogens zur erfassung orthorektischen ernährungsverhaltens. Z. Klin. Psychol. Psychother. 2015;44:97–105. doi: 10.1026/1616-3443/a000310. [DOI] [Google Scholar]
- 4.He J., Sun S., Zickgraf H.F., Lin Z., Fan X. Meta-analysis of gender differences in body appreciation. Body Image. 2020;33:90–100. doi: 10.1016/j.bodyim.2020.02.011. [DOI] [PubMed] [Google Scholar]
- 5.Dunn T.M., Bratman S. On orthorexia nervosa: A review of the literature and proposed diagnostic criteria. Eat. Behav. 2016;21:11–17. doi: 10.1016/j.eatbeh.2015.12.006. [DOI] [PubMed] [Google Scholar]
- 6.Barthels F., Meyer F., Pietrowsky R. Orthorexic and restrained eating behaviour in vegans, vegetarians, and individuals on a diet. Eat. Weight Disord. 2018;23:159–166. doi: 10.1007/s40519-018-0479-0. [DOI] [PubMed] [Google Scholar]
- 7.Brytek-Matera A., Czepczor-Bernat K., Jurzak H., Kornacka M., Kołodziejczyk N. Strict health-oriented eating patterns (orthorexic eating behaviours) and their connection with a vegetarian and vegan diet. Bulim. Obes. 2019;24:441–452. doi: 10.1007/s40519-018-0563-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Varga M., Konkolÿ Thege B., Dukay-Szabó S., Túry F., Van Furth E.F. When Eating Healthy Is not Healthy: Orthorexia Nervosa and Its Measurement with the ORTO-15 in Hungary. BMC Psychiatry. 2014;14:59. doi: 10.1186/1471-244X-14-59. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Fidan T., Ertekin V., Işikay S., Kirpinar I. Prevalence of orthorexia among medical students in Erzurum, Turkey. Compr. Psychiatry. 2010;51:49–54. doi: 10.1016/j.comppsych.2009.03.001. [DOI] [PubMed] [Google Scholar]
- 10.Oberle C.D., De Nadai A.S., Madrid A.L. Orthorexia Nervosa Inventory (ONI): Development and validation of a new measure of orthorexic symptomatology. Eat. Weight Disord. 2020;26:609–622. doi: 10.1007/s40519-020-00896-6. [DOI] [PubMed] [Google Scholar]
- 11.Parra-Fernandez M.L., Rodríguez-Cano T., Onieva-Zafra M.D., Perez-Haro M.J., Casero-Alonso V., Camargo M.C.J., Notario-Pacheco B. Adaptation and validation of the Spanish version of the ORTO-15 questionnaire for the diagnosis of orthorexia nervosa. PLoS ONE. 2018;13:e0190722. doi: 10.1371/journal.pone.0190722. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Brytek-Matera A., Plasonja N., Décamps G. Assessing orthorexia Nervosa: Validation of the polish version of the eating habits questionnaire in a general population sample. Nutrients. 2020;12:3820. doi: 10.3390/nu12123820. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Farchakh Y., Hallit S., Soufia M. Association between orthorexia nervosa, eating attitudes and anxiety among medical students in Lebanese universities: Results of a cross-sectional study. Eat. Weight Disord. 2019;24:683–691. doi: 10.1007/s40519-019-00724-6. [DOI] [PubMed] [Google Scholar]
- 14.Parra-Fernández M.L., Onieva-Zafra M.D., Fernández-Muñoz J.J., Fernández-Martínez E. Adaptation and validation of the Spanish version of the DOS questionnaire for the detection of orthorexic nervosa behavior. PLoS ONE. 2019;14:e0216583. doi: 10.1371/journal.pone.0216583. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Donini L.M., Marsili D., Graziani M.P., Imbriale M., Cannella C. Orthorexia nervosa: Validation of a diagnosis questionnaire. Eat. Weight Disord. 2005;10:e28–e32. doi: 10.1007/BF03327537. [DOI] [PubMed] [Google Scholar]
- 16.Roncero M., Barrada J.R., Perpiñá C. Measuring Orthorexia Nervosa: Psychometric Limitations of the ORTO-15. Span. J. Psychol. 2017;20:E41. doi: 10.1017/sjp.2017.36. [DOI] [PubMed] [Google Scholar]
- 17.Opitz M.C., Newman E., Mellado A.S.A.V., Robertson M.D.A., Sharpe H. The psychometric properties of Orthorexia Nervosa assessment scales: A systematic review and reliability generalization. Appetite. 2020;155:104797. doi: 10.1016/j.appet.2020.104797. [DOI] [PubMed] [Google Scholar]
- 18.Brytek-Matera A., Krupa M., Poggiogalle E., Donini L.M. Adaptation of the ORTHO-15 test to Polish women and men. Eat. Weight Disord. 2014;19:69–76. doi: 10.1007/s40519-014-0100-0. [DOI] [PubMed] [Google Scholar]
- 19.Haddad C., Hallit R., Akel M., Honein K., Akiki M., Kheir N., Obeid S., Hallit S. Validation of the Arabic version of the ORTO-15 questionnaire in a sample of the Lebanese population. Eat. Weight Disord. 2020;25:951–960. doi: 10.1007/s40519-019-00710-y. [DOI] [PubMed] [Google Scholar]
- 20.Moller S., Apputhurai P., Knowles S.R. Confirmatory factor analyses of the ORTO 15-, 11- and 9-item scales and recommendations for suggested cut-off scores. Eat. Weight Disord. 2019;24:21–28. doi: 10.1007/s40519-018-0515-0. [DOI] [PubMed] [Google Scholar]
- 21.Babeau C., Le Chevanton T., Julien-Sweerts S., Brochenin A., Donini L.M., Fouques D. Structural validation of the ORTO-12-FR questionnaire among a French sample as a first attempt to assess orthorexia nervosa in France. Eat. Weight Disord. 2020;25:1771–1778. doi: 10.1007/s40519-019-00835-0. [DOI] [PubMed] [Google Scholar]
- 22.Heiss S., Coffino J.A., Hormes J.M. What does the ORTO-15 measure? Assessing the construct validity of a common orthorexia nervosa questionnaire in a meat avoiding sample. Appetite. 2019;135:93–99. doi: 10.1016/j.appet.2018.12.042. [DOI] [PubMed] [Google Scholar]
- 23.Meule A., Holzapfel C., Brandl B., Greetfeld M., Hessler-Kaufmann J.B., Skurk T., Quadflieg N., Schlegl S., Hauner H., Voderholzer U. Measuring orthorexia nervosa: A comparison of four self-report questionnaires. Appetite. 2020;146:104512. doi: 10.1016/j.appet.2019.104512. [DOI] [PubMed] [Google Scholar]
- 24.Missbach B., Hinterbuchinger B., Dreiseitl V., Zellhofer S., Kurz C., König J. When eating right, is measured wrong! A validation and critical examination of the ORTO-15 questionnaire in German. PLoS ONE. 2015;10:e0135772. doi: 10.1371/journal.pone.0135772. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Missbach B., Dunn T.M., König J.S. We need new tools to assess Orthorexia Nervosa. A commentary on “Prevalence of Orthorexia Nervosa among College Students Based on Bratman’s Test and Associated Tendencies”. Appetite. 2017;108:521–524. doi: 10.1016/j.appet.2016.07.010. [DOI] [PubMed] [Google Scholar]
- 26.Brytek-Matera A., Onieva-Zafra M.D., Parra-Fernández M.L., Staniszewska A., Modrzejewska J., Fernández-Martínez E. Evaluation of orthorexia nervosa and symptomatology associated with eating disorders among european university students: A multicentre cross-sectional study. Nutrients. 2020;12:3716. doi: 10.3390/nu12123716. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Gleaves D.H., Graham E.C., Ambwani S. (PDF) Measuring’Orthorexia’: Development of the Eating Habits Questionnaire | David Gleaves—Academia.edu. [(accessed on 25 February 2021)]; Available online: https://www.academia.edu/14380142/MeasuringOrthorexia_Development_of_the_Eating_Habits_Questionnaire.
- 28.Segura-Garcia C., Ramacciotti C., Rania M., Aloi M., Caroleo M., Bruni A., Gazzarrini D., Sinopoli F., De Fazio P. The prevalence of orthorexia nervosa among eating disorder patients after treatment. Eat. Weight Disord. 2015;20:161–166. doi: 10.1007/s40519-014-0171-y. [DOI] [PubMed] [Google Scholar]
- 29.Garner D.M., Bohr Y., Garfinkel P.E. The Eating Attitudes Test: Psychometric Features and Clinical Correlates. Psychol. Med. 1982;12:871–878. doi: 10.1017/S0033291700049163. [DOI] [PubMed] [Google Scholar]
- 30.Garner D.M., Garfinkel P.E. The Eating Attitudes Test: An index of the symptoms of anorexia nervosa. Psychol. Med. 1979;9:273–279. doi: 10.1017/S0033291700030762. [DOI] [PubMed] [Google Scholar]
- 31.Rivas T., Franco K., Bersabé R., Montiel C.B. Spanish version of the eating attitudes test 40: Dimensionality, reliability, convergent and criterion validity. Span. J. Psychol. 2013;16:E59. doi: 10.1017/sjp.2013.61. [DOI] [PubMed] [Google Scholar]
- 32.Rivas T., Bersabé R., Jiménez M., Berrocal C. The eating attitudes test (EAT-26): Reliability and validity in spanish female samples. Span. J. Psychol. 2010;13:1044–1056. doi: 10.1017/S1138741600002687. [DOI] [PubMed] [Google Scholar]
- 33.Beaton D.E., Bombardier C., Guillemin F., Ferraz M.B. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila. Pa. 1976) 2000;25:3186–3191. doi: 10.1097/00007632-200012150-00014. [DOI] [PubMed] [Google Scholar]
- 34.Tabachnick B.G., Fidell L.S. Using Multivariate Statistics. Harper & Row; New York, NY, USA: 1989. [(accessed on 4 June 2021)]. References—Scientific Research Publishing. Available online: https://scirp.org/reference/referencespapers.aspx?referenceid=1779665. [Google Scholar]
- 35.Comrey A.L. A First Course in Factor Analysis. Academic Press; New York, NY, USA: 1973. [(accessed on 4 June 2021)]. p. 342. References—Scientific Research Publishing. Available online: https://www.scirp.org/(S(czeh2tfqyw2orz553k1w0r45))/reference/ReferencesPapers.aspx?ReferenceID=1975093. [Google Scholar]
- 36.Horn J.L. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–185. doi: 10.1007/BF02289447. [DOI] [PubMed] [Google Scholar]
- 37.Steiger J.H., Lind C. “Statistically Based Tests for the Number of Common Factors”, Annual Meeting of the Psychometric Society. [(accessed on 1 March 2021)]; Available online: http://www.sciepub.com/reference/151685.
- 38.Hu L.T., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. 1999;6:1–55. doi: 10.1080/10705519909540118. [DOI] [Google Scholar]
- 39.Bagozzi R.P., Joreskog K.G., Sorbom D., Magidson J. Advances in Factor Analysis and Structural Equation Models. J. Mark. Res. 1980;17:133. doi: 10.2307/3151129. [DOI] [Google Scholar]
- 40.Godefroy V., Trinchera L., Dorard G. Optimizing the empirical assessment of orthorexia nervosa through EHQ and clarifying its relationship with BMI. Eat. Weight Disord. 2020;26:649–659. doi: 10.1007/s40519-020-00909-4. [DOI] [PubMed] [Google Scholar]
- 41.Mohamed Halim Z., Dickinson K.M., Kemps E., Prichard I. Orthorexia nervosa: Examining the Eating Habits Questionnaire’s reliability and validity, and its links to dietary adequacy among adult women. Public Health Nutr. 2020;23:1684–1692. doi: 10.1017/S1368980019004282. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Novara C., Pardini S., Pastore M., Mulatti C. Ortoressia Nervosa: Un’indagine del costrutto e delle caratteristiche psicometriche della versione italiana dell’Eating Habits Questionnaire-21 (EHQ-21) Psicoter. Cogn. e Comport. 2017;23:291–316. [Google Scholar]
- 43.Oberle C.D., Samaghabadi R.O., Hughes E.M. Orthorexia nervosa: Assessment and correlates with gender, BMI, and personality. Appetite. 2017;108:303–310. doi: 10.1016/j.appet.2016.10.021. [DOI] [PubMed] [Google Scholar]
- 44.Cha E.S., Kim K.H., Erlen J.A. Translation of scales in cross-cultural research: Issues and techniques. J. Adv. Nurs. 2007;58:386–395. doi: 10.1111/j.1365-2648.2007.04242.x. [DOI] [PubMed] [Google Scholar]
- 45.Streiner: Health Measurement Scales: A Practical...—Google Scholar. [(accessed on 4 June 2021)]; Available online: https://scholar.google.com/scholar_lookup?hl=en&publication_year=1989&author=D.L.+Streiner&author=G.R.+Norman&title=Health+Measurement+Scales%3A+A+Practical+Guide+to+their+Development+and+Use.
- 46.Paunonen S.V., Ashton M.C. The structure assessment of personality across cultures. J. Cross. Cult. Psychol. 1998;29:150–170. doi: 10.1177/0022022198291008. [DOI] [Google Scholar]
- 47.Hayes O., Wu M.S., De Nadai A.S., Storch E.A. Orthorexia nervosa: An examination of the prevalence, correlates, and associated impairment in a university sample. J. Cogn. Psychother. 2017;31:124–135. doi: 10.1891/0889-8391.31.2.124. [DOI] [PubMed] [Google Scholar]
- 48.Zickgraf H.F., Ellis J.M., Essayli J.H. Disentangling orthorexia nervosa from healthy eating and other eating disorder symptoms: Relationships with clinical impairment, comorbidity, and self-reported food choices. Appetite. 2019;134:40–49. doi: 10.1016/j.appet.2018.12.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Eysenbach G. Improving the quality of web surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES) J. Med. Internet Res. 2004;6:e34. doi: 10.2196/jmir.6.3.e34. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The dataset used during the current study is available from the corresponding author on reasonable request.