Abstract
This study aims to determine how higher-order thinking skills—namely creative thinking, critical thinking, metacognitive thinking, and empathic thinking—impact the academic achievement of pre-service teachers at both low and high levels. The study was conducted using the predictive model. The case sampling method, a purposive sampling method, was used in the study. The study participants included 196 volunteer pre-service teachers attending Artvin Coruh University, Faculty of Education. The study data were analyzed using binomial logistic regression analysis. The analysis revealed that the academic achievement of the pre-service teachers varied significantly based on other higher-order thinking skills, except for empathy. Furthermore, the contributions of these variables to academic achievement were ranked based on Exp(β) (odds/likelihood). The findings demonstrated that all variables affected academic achievement, while creative thinking skills contributed most significantly, followed by critical thinking and metacognitive thinking skills. It was also determined that the contribution of empathy skills was not statistically significant (p > 0.05). It was observed that the increase in higher-order thinking skills led to greater academic achievement. Similarly, low higher-order thinking skills significantly led to a decrease in achievement. Thus, it could be recommended that learning activities be revised, and the number of activities aimed at improving thinking skills should be increased for the active acquisition of higher-order thinking skills in higher teacher training institutions.
Keywords: creative thinking, critical thinking, metacognitive thinking, empathic thinking, academic achievement, logistic regression
1. Introduction
Currently, individuals live in an “information society” where they should possess various qualifications such as investigative skills, skills that allow them to solve complex and novel problems, creative and critical thinking, the ability to organize their thoughts, and skills associated with the recognition and employment of various thinking methods. A qualified and influential individual in this society should possess basic thinking skills (MEB 2023). Basic thinking skills are required for the effective use of knowledge, the development of creative solutions to daily problems and challenges, and socialization. Thinking skills play a key role in personal development at all stages of life, especially in academic settings. Thus, the education system should motivate students and teachers to actively participate in instruction and learning processes to train qualified individuals (Güven and Kürüm 2006).
Thinking, as a cognitive process, is the most crucial part of acquiring knowledge, understanding, and learning. At the same time, thinking serves as the foundation for questioning, evaluating, and generating new knowledge (Güneş 2012). Although there are various approaches to classifying levels of thinking, the distinction between lower-order thinking and higher-order thinking is widely accepted in the literature. The fundamental difference in this classification is that higher-order thinking involves using prior knowledge, skills, and experiences gained from the past—through methods such as deduction, induction, and analogy—when solving a problem or engaging in reasoning in cases where available information is insufficient (Kurnaz-Adıbatmaz and Kutlu 2020).
The concept of higher-order thinking is derived from Bloom’s (1956) cognitive taxonomy (Forehand 2010). The cognitive domain within this taxonomy encompasses knowledge and the development of intellectual skills (Bloom 1956). This taxonomy consists of six main categories, arranged from the simplest to the most complex cognitive processes, which involve recalling or recognizing specific facts, procedural patterns, and concepts. In summary, Bloom classified intellectual behavior into six levels: remembering, understanding, applying, analyzing, evaluating, and creating. While remembering, understanding, and applying are considered lower-order thinking skills as they primarily require basic recognition or recall (Brookhart 2010), analyzing, evaluating, and creating are classified as higher-order thinking skills (Forehand 2010; Kurnaz-Adıbatmaz and Kutlu 2020).
Higher-order thinking skills (HOTS) play a crucial role in enhancing individual and societal well-being as well as the quality of democratic structures (Vincent-Lancrin et al. 2019). Technological advancements and the increasing significance of artificial intelligence are affecting many professions and fields. However, AI technologies have not yet surpassed individuals who possess higher-order thinking competencies such as judgment, decision-making, critical thinking, and creative thinking. In this regard, teachers need to possess these competencies to cultivate individuals with these skills. Approaches that place the student at the center of the learning experience, encourage thinking, utilize Socratic questioning, adopt inquiry-based learning, incorporate project-based and experiential methods, and promote collaboration are effective in fostering HOTS in individuals (Siew and Ambo 2020; Kıraç and Elaldı 2023). Additionally, instructional methods and activities such as performance tasks, discussions, drama, real-world activities, and case studies significantly contribute to the development of higher-order thinking skills (HOTS) in higher education and teacher training institutions (Bezanilla et al. 2019).
The framework of basic thinking skills is employed to describe higher-order thinking skills and is used as a general term to describe thinking processes (Miri et al. 2007). Higher-order thinking skills have also been described as the capacity to go beyond available knowledge to classify, infer, generalize, and solve problems in complex situations (Lewis and Smith 1993). Higher-order thinking skills are required when encountering unfamiliar problems, uncertainties, questions, or dilemmas (Mainali 2012).
Higher-order thinking skills include several skills that are required in case of challenges that cannot be solved immediately, force the individual to try several methods to solve, require a different thinking approach, and allow the individuals to get to know themselves. Furthermore, the following have been described as traits that do not reflect higher-order thinking skills (Wellman 1997):
Unquestioning acceptance of data input;
Non-questioning;
Inability to determine the common denominator across current and prior knowledge;
Acceptance of previous methods instead of trying novel solutions.
Higher-order thinking skills require abstract thinking, the ability to imagine various dimensions of objects, categorize, and associate them with other concepts, distinguish the similarities and the differences, and combine these with holistic experiences and present them based on mental processes (Choorapanthiyil 2007).
Higher-order thinking skills have also been described as the ability to detail a given material, render it understandable, infer from the known, and associate (Richland and Simms 2015). Individuals with these skills not only require a strong vocabulary, syntax, and numerical skills but also should know how to express their experiences and ideas. Thus, individuals who reach the analysis and creation stages of higher-order thinking based on Bloom’s taxonomy would be more successful and could actively solve unpredicted economic and social solutions (Harpster 1999).
The views on thinking skills that are included in higher-order thinking vary. However, common cognitive skills included by authors are creative thinking, critical thinking, and reflective thinking (Kruger and Van der Merwe 2012). Mainali (2012) included metacognitive thinking skills among higher-order thinking skills, along with creative and critical thinking. Empathy has also been considered a cognitive skill since the 1950s; however, it is currently considered an affective skill (Topçu et al. 2010).
Emphasized higher-order thinking skills include creative thinking and critical thinking skills. Creative thinking is the ability to develop novel ideas, solutions, or products in emerging events or situations. It entails the ability of an individual to develop unique and original solutions to daily life problems. Common creative skill traits include the ability to associate previously unassociated objects with concepts, events, and situations, the ability to acquire different experiences, and the ability to try unique methods (Temizkan 2010).
Creative thinking skills include several skills. Significant skills include sensitivity to problems, the development of opinions and associations, flexibility, originality, elaboration, and re-description (Öncü 2003). Although creativity cannot be developed within a short time, it can be instructed and improved under adequate conditions. The development of creative thinking skills depends on the availability of a non-stressful and peaceful environment where the individual can feel free and safe (Özerbaş 2011). Creative thinking skills include unordinary thinking, flexibility, fluency, and originality under different conditions.
In addition to creative thinking, critical thinking skills are also included among higher-order thinking skills. Critical thinking is described as the ability to analyze facts, develop and organize ideas, defend opinions, make comparisons, draw conclusions, analyze discussions, and solve problems (Huitt 1998; Fisher 2001).
The primary critical thinking acts include “investigation, comprehensive thinking, free-thinking, and reconstruction.” Thus, the individual can perform the following actions (Ming-Lee Wen 1999):
Query, analysis, evaluation, and discussion of assumptions during investigation.
Investigation of the causality of decisions during comprehensive thinking.
Independence during free thinking.
Confirming, correcting, or replacing the existing value system with a new belief during reconstruction.
The employment of critical thinking skills begins at birth and continues throughout life (León 2015). Because individuals observe all the events around them starting from infancy and make certain inferences, based on these inferences, they begin to establish causality (Tozduman-Yaralı 2019). Later, as children complete cognitive development, they start to perform this skill consciously. Thus, instruction on critical thinking skill sub-dimensions from an early age allows children to think multidimensionally because children with critical thinking skills are like scientists who are curious about discovering everything (Florea and Hurjui 2015). Also, the acquisition of these skills at an early age determines the individual’s approach to problem solving in later years and contributes to the academic development of the individual (Köksal and Çöğmen 2018).
Metacognitive thinking skills are also considered a subset of the higher-order thinking skills. The concept of metacognition is significant in learning since it is assumed that metacognition supports learner autonomy (Yılmaz 2014). The concept of metacognition, first introduced by Flavell (1979), was described as an individual’s awareness of their personal learning process. Thus, the individuals’ ability to know how they learn best, develop and use effective learning strategies, and make self-assessments about what and how much they learned are the outcomes of metacognitive thinking skills.
Previous studies have reported that planning, monitoring, and analysis, which help individuals organize their cognitive processes in the learning environment, can improve metacognitive awareness and thus allow the control and self-regulation of cognitive thinking, learning, and products (Hartman 2001; Yurdakul 2004). According to Kuiper (2002), the instruction of metacognitive strategies such as planning, monitoring, and analysis can contribute to lifelong reflective thinking, problem solving, responsibility, and self-confidence in rapid decision-making. Metacognitive strategies that include planning, monitoring, and analysis can improve the metacognitive awareness of students about cognitive resources and the effective employment of these resources. Successful learning can be achieved with metacognitive awareness (Livingston 1997).
Similarly to creative thinking, critical thinking, and metacognitive thinking skills, empathy skills are also included among higher-order cognitive thinking skills. Empathy was described by German psychologist Lipps as individuals’ knowledge of objects, themselves, and other individuals during communication (Gürüz and Temel-Eğinli 2013).
Empathy has been described as follows in the literature:
A response similar to the emotional and cognitive state of another individual (Rasoal et al. 2011).
An individual’s efforts to accurately understand the emotions and thoughts of another individual (Dökmen 2002).
Recognition of the emotions of others and the factors that led to these emotions (Keen 2007).
Recognition and management of one’s own emotions, as well as sensitivity to the emotions, desires, and needs of others (Goleman 2005).
The ability to put oneself in someone else’s shoes regarding emotions and thoughts (TDK 2011).
Empathy entails responses to emotions, sharing what others feel, and reflection on these emotions like a mirror, and it allows the establishment of good relations with others, understanding others, and sharing their emotions (Krznaric 2008). Empathy is also a fundamental human skill that regulates relationships and promotes cooperation and group harmony (Rieffe et al. 2010). Empathy skills demonstrate that not everyone shares the same ideas, and individuals can have different views, emotions, and ideas (Dev 2010).
Students who are educated in an empathic school environment feel safe, loved, and socially confident (Kuzgun 2000), because in an empathic classroom, students can freely express their views (Özgan 1999). An empathic teacher can help improve student self-esteem and contribute not only to cognitive development but also to student personality (Karaman 2018).
Higher-order thinking skills are generally discussed separately in the literature. Certain studies have addressed only a single skill, while others have been conducted on several skills and the correlations between these skills. Furthermore, certain studies have investigated the correlations between these skills and academic achievement. Certain studies on the correlation between creative thinking and academic achievement have reported a positive correlation (Ai 1999; Erfani and Azad 2013), while others have reported an insignificant correlation (Kim 2005; Baran and Maskan 2011). Certain studies have reported a positive significant correlation between critical thinking skills and metacognitive thinking (Arslan 2015; Sadeghi et al. 2014). Others have reported a significantly weak correlation between metacognitive thinking skills and academic achievement (Kaya and Fırat 2011; Belet and Güven 2011; Cautinho 2007; Romainville 1994; Tok et al. 2010), while some have reported no correlation between academic achievement and metacognitive thinking skills (Ergül 2004; Sarwar et al. 2009).
Higher-order thinking skills are not merely the ability to recall information but also the competencies that enable individuals to confront challenges, difficulties, questions, or dilemmas encountered in both education and daily life. Moreover, these skills—especially critical thinking, creative thinking, metacognitive thinking, and similar cognitive abilities—are utilized to predict students’ academic achievement (Tanujaya et al. 2017). Therefore, it is crucial to introduce individuals to assessment tools based on higher-order thinking skills that prepare them to solve new problems, adapt to new environments, and make decisions on specific issues (Retnawati et al. 2018).
Thinking skills are also closely related to learning. In this context, an individual’s thought process can influence their learning capacity, speed, and performance. Improving their thinking abilities positively may impact their learning development. Students with higher-order thinking skills possess the ability to learn effectively, perform well, and minimize deficiencies. When individuals encounter problems requiring lower-order thinking skills, their cognitive capacities diminish, negatively affecting the development of higher-order thinking skills (Tanujaya et al. 2017). Conversely, when individuals frequently engage in situations demanding higher-order thinking skills, they engage in more mental activity. This, in turn, compels individuals to be more creative (Ünsal and Kaba 2022). From this perspective, examining the impact of higher-order thinking skills on academic achievement is significant. This study investigates how higher-order thinking skills—namely, critical thinking, creative thinking, metacognitive thinking, and empathic thinking—affect the academic achievement (low and high levels) of pre-service teachers.
The review of studies on higher-order thinking skills and academic achievement revealed no survey of the association between these skills and academic achievement. Furthermore, there is no study on the correlations between academic achievement and these skills or the impact of these skills on achievement. Moreover, it is important for teacher candidates to have higher-order thinking skills and to determine the relationship between academic achievement and thinking skills to fill the gap in the literature. Also, in Turkey, the Ministry of National Education revised the curricula at all educational levels in 2024, and the acquisition of higher-order thinking skills was accepted as the main theme in all programs (MEB 2024). Thus, it is important to determine the relationship between these skills and the academic achievement of pre-service teachers, as this would affect their graduation and appointment. Conducting this study based on these requirements, issues, and the description of the status according to the study findings could lead to the elucidation of new perspectives for future researchers. Thus, the present study aimed to determine how higher-order thinking skills, such as creative thinking, critical thinking, metacognitive thinking, and empathy, affect the academic achievement (low and high level) of pre-service teachers.
The hypothesis of this study is as follows: the higher-order thinking skills (HOTS) of creative thinking, critical thinking, metacognitive thinking, and empathy influence the academic success levels (high or low) of pre-service teachers.
2. Materials and Methods
The first step of a scientific study is research design and determining methodology. One way to design research is to use the data collection process suggested by the “research onion” model developed by Saunders et al. (2007). Initially, the research model was selected; then, the study group and the data collection method were determined.
2.1. The Research Model
In this study, a predictive model was utilized to identify variables that significantly predict a specific outcome or criterion (Fraenkel and Wallen 2006; Creswell 2005). More specifically, the predictive model was employed to analyze the factors influencing academic achievement levels.
2.2. The Study Groups
The study sample was assigned with the typical case sampling method, a purposive sampling approach. Purposive sampling allows the selection of information-rich cases that are not based on probability (Corbin and Strauss 2014) and the conduction of an in-depth investigation. On the other hand, typical case sampling includes ordinary and average cases within society (Patton 2005). Thus, typical cases are used to represent the population based on similar characteristics (Marshall and Rossman 2014). Therefore, the study data were collected from 196 volunteer pre-service teachers who attended Artvin Coruh University, Faculty of Education. This public university accepts students based on scores from the Higher Education Institutions Exam, a national exam in Turkey. Participant demographics are presented in Table 1.
Table 1.
Participant demographics.
| Variable | N | % | |
|---|---|---|---|
| Department | Mathematics Instruction | 30 | 15.3 |
| Preschool Instruction | 29 | 14.8 | |
| Guidance–Psychological Counseling | 15 | 7.7 | |
| Primary School Instruction | 24 | 12.2 | |
| Turkish Language Instruction | 44 | 22.4 | |
| Social Studies Instruction | 54 | 27.6 | |
| Gender | Female | 126 | 64.3 |
| Male | 70 | 35.7 |
2.3. Data Collection Instruments
Since the present study was conducted on higher-order thinking skills such as critical, empathic, creative, and metacognitive thinking skills, instruments developed to measure these skills were employed. The measurement tools and data collection methods were approved by the Artvin Coruh University Ethics Committee on 15 December 2023 (Approval no: E-114974). The measurement instruments employed in the study are presented below.
Demographic data form: The form was developed by the authors and included demographic questions (gender and department of the pre-service teachers).
Academic achievement: In this study, academic achievement, which serves as the dependent variable, is defined as the overall academic grade point average (GPA) of pre-service teachers. Data on this variable were collected through a short-response question in the “Demographic data form”. Academic GPA was self-reported by students.
Creative thinking aptitude scale: Marmara’s creative thinking attributes scale, developed by Özgenel and Çetin (2017), includes 25 items and six factors. Cronbach’s alpha internal consistency coefficient is 0.93 for the entire scale.
Critical thinking aptitude scale: The scale was adapted to the Turkish language by Kılıç and Şen (2014) and includes 25 items. The Cronbach alpha internal consistency coefficient was calculated as 0.92 with the data collected in the present study for the entire scale, 0.87 for the participation dimension, 0.79 for the cognitive maturity dimension, and 0.78 for the innovation dimension.
Metacognitive thinking scale: The scale was adapted to the Turkish language by Büyüköztürk et al. (2004). In the present study, 12 items in the metacognitive thinking subscale of the main scale were employed. The scale is a seven-point Likert-type scale. In the present study, the Cronbach alpha coefficient of the scale was calculated as 0.84.
Basic empathy scale: The Likert-type scale was adapted to the Turkish language by Topçu et al. (2010). In the present study, the Cronbach alpha coefficient of the scale was calculated as 0.81 for the emotion dimension and 0.78 for the cognitive dimension.
The construct validity of the scales employed in the study was analyzed with confirmatory factor analysis and the LISREL 8.8 software. In the confirmatory factor analysis, the χ2/df, RMSEA (Root Mean Square Error of Approximation), AGFI (Adjustment Goodness of Fit Index), NNFI (Non-Normed Fit Index), and CFI (Comparative Fit Index) were calculated to determine the statistical fit criteria and verification of the model. For a good model fit, the χ2/df (degrees of freedom) ratio should be between 2 and 3 (Yılmaz and Çelik 2009). The χ2/df ratio and RMSEA findings were as follows:
Creative thinking scale: χ2/df = (350.87/275) = 1.27, RMSEA = 0.08.
Critical thinking scale: χ2/df = (322.42/275) = 1.17; RMSEA = 0.07.
Metacognitive thinking scale: χ2/df = (60.03/54) = 1.11; RMSEA = 0.06.
Basic empathy scale: χ2/df = (190.67/169) = 1.12; RMSEA = 0.05.
These findings indicated that the fit of the scales and the data was acceptable, and construct validity was confirmed (Brown 2006). A figure less than or equal to 0.05 indicates a perfect fit, while a figure greater than 0.10 indicates an unfit model (Yılmaz and Çelik 2009). In the present study, the comparative fit indices, the CFI, AGFI, and NNFI, were between acceptable limits (Çokluk et al. 2016) for all three measurement instruments (CFI > 0.88, AGFI > 0.90 and NNFI > 0.95).
2.4. Data Analysis
Binomial logistic regression analysis was employed to determine the impact of high-level empathy, critical thinking, creative thinking, and metacognitive thinking skills of pre-service teachers on their academic achievement levels. Binomial logistic regression analysis was employed to estimate the impact of independent variables on dependent variables, where the dependent variables included binomial or multiple categorical data (Agresti 1996). Logistic regression analysis does not require the confirmation of assumptions such as the normal distribution of independent variables, linearity, or equality of variance–covariance matrices and is preferred when the dependent variable is categorical (present–absent, successful–unsuccessful, etc.) (Tabachnick and Fidell 2001). This analysis method determines factors (independent variables) that are expected to affect the probability of one of the categories. In logistic regression, the impact of independent variables on the dependent variable is determined as probabilities (Özdamar 1997).
In the logistic regression analysis employed in the current study, the academic achievement of the pre-service teachers (successful–unsuccessful) was determined as the dependent variable, and higher-order thinking skills were determined as independent variables.
The Kolmogorov–Smirnov normality test was applied to determine whether the dependent variable, the academic achievement scores of the pre-service teachers, exhibited normal distribution. The analysis revealed that academic achievement data were not distributed normally. This finding is presented in Table 2.
Table 2.
Normality test results.
| Academic achievement | Kolmogorov–Smirnov Statistic | df | Sig. |
| 0.141 | 196 | 0.000 |
Since the dependent variable, academic achievement, did not exhibit a normal distribution, a logistic regression analysis, which does not require the assumption of normality, was conducted. In the analysis, the academic achievement score was coded based on the CC grade, accepted as the cut-off value for passing the course and graduation. Thus, the CC score, the cut-off value for passing the course, and higher scores were classified as high achievement (1), while scores below the cut-off value were classified as low achievement (0). Analyses were carried out based on the cut-off value.
Before the interpretation of the logistic regression analysis findings, assumptions (multicollinearity, outliers, and model data fit) were tested. In the multicollinearity between independent variables, it was determined that the tolerance was between 0.56 and 0.90 and the variance inflation factor (VIF) was between 1.11 and 2.35, while the highest condition index (CI) was 26.65. These findings demonstrated that there was no significant multicollinearity between independent variables. Standardized residuals were investigated to determine outliers, and errors were within the accepted range of ±3, demonstrating no outliers. The data were analyzed with IBM SPSS v.27 (Statistical Package of the Social Sciences) software.
Regression coefficients, Wald statistics, degrees of freedom, standard error, 95% confidence intervals, odds (likelihood) ratios, and correct classification thresholds for independent variables were calculated in the logistic regression analysis. In all analyses, the statistical significance level was accepted as 0.05.
In this study, the effect of independent variables on the dependent variable was examined only through logistic regression analysis. The fact that potential interaction/moderation variables that could influence this effect were not considered or that statistical analyses regarding possible mediation relationships were not conducted constitutes the limitation of this study.
3. Results
The dependent variable in this study was examined in two categories. Accordingly, pre-service teachers classified as having low academic achievement constituted 30.1% (N = 59) of the participants, while those with high academic achievement accounted for 69.9% (N = 137). Descriptive statistics regarding independent variables are presented in Table 3.
Table 3.
Descriptive statistics regarding independent variables.
| İndependent Variables | N | Minimum | Maximum | Mean | Std. Deviation |
|---|---|---|---|---|---|
| Empathic | 196 | 52 | 72 | 61.28 | 4.09 |
| Critical | 196 | 54 | 118 | 88.35 | 16.88 |
| Creative | 196 | 64 | 125 | 95.20 | 16.39 |
| Metacognitive | 196 | 21 | 79 | 54.82 | 20.00 |
Four independent variables were included in the logistic regression analysis conducted to determine the variables that predicted the probability of academic achievement of pre-service teachers, and these variables contributed significantly to the probability equation formulated to predict the probability of academic achievement. The logistic model and the data fit were tested with the Hosmer–Lemeshow test. The Hosmer–Lemeshow test demonstrated a good model fit (χ2(8) = 3.88 p > .01). The β parameters determined in the logistic regression analysis, Wald statistics, degrees of freedom (df), significance levels (sig.), standard error (St.Er.), and Exp(β) (odds/likelihood) for these parameters are presented in Table 4.
Table 4.
Logistic regression model and significance of the variables.
| Variable | β | St.Er. | Wald | df | Sig. | Exp(β) |
|---|---|---|---|---|---|---|
| Constant | −22.355 | 5.390 | 17.200 | 1.000 | 0.000 * | 0.000 |
| Creative thinking | 0.104 | 0.038 | 7.577 | 1.000 | 0.006 * | 1.109 |
| Critical thinking | 0.100 | 0.033 | 9.359 | 1.000 | 0.002 * | 1.106 |
| Metacognitive thinking | 0.040 | 0.018 | 5.145 | 1.000 | 0.023 * | 1.041 |
| Empathy | 0.076 | 0.068 | 1.247 | 1.000 | 0.264 | 1.079 |
* p < 0.05.
As seen in Table 4, the academic achievements of pre-service teachers significantly varied based on the creative thinking, critical thinking, and metacognitive thinking variables, demonstrating that these variables had a significant impact on the possibility of reading comprehension. Empathy skills did affect academic achievement, albeit insignificantly. The ranking of the impact of each variable on academic achievement based on Exp(β)/likelihood revealed the following findings:
The academic achievement of pre-service teachers increased by 1.109 with the increase in their creative thinking score (p < 0.05).
The academic achievement of pre-service teachers increased by 1.106 with the increase in their critical thinking score (p < 0.05).
The academic achievement of pre-service teachers increased by 1.041 with the increase in their metacognitive thinking score (p < 0.05).
The increase in empathy skills positively affected academic achievement; however, the effect was not significant (p > 0.05).
The above-mentioned findings demonstrated that the impact of creative thinking skills was the most significant on academic achievement, while empathy skills had the least effect.
The classification success of the logistic model developed for the academic achievements of pre-service teachers is presented in Table 5.
Table 5.
Classification success of the logistic regression model.
| Observed Achievement | Predicted Achievement | Accuracy Percentage | |||
|---|---|---|---|---|---|
| Step 1 | Achievement | 0.00 | 49 | 10 | 83.1 |
| 1.00 | 17 | 129 | 87.6 | ||
| Overall Percentage | 0 | 86.2 | |||
As seen in Table 5, the accurate classification rate of the observations by the logistic regression model was 86.2%. Thus, the model assigned 129 pre-service teachers with high academic achievement and 49 pre-service teachers with low academic achievement into the accurate group.
The scatter diagram of the independent study variables based on the dependent variable, academic achievement, is presented Figure 1.
Figure 1.
The distribution of the independent study variables based on the dependent variable.
Since Figure 1 is a scatter diagram of the variables of the study, it also helps to visually interpret the findings regarding the classification of variables.
In this study, the Cox and Snell R2 value of the model was found to be 0.54. Together, these variables explain 54% of the total variance in academic achievement scores.
Cohen (1988) proposed the formula f2 = (R2/(1 − R2)) to calculate the standardized effect size in all regression analyses. Based on this value, the effect size was computed as f2 = (0.54/0.46) = 1.17. This result indicates that the effect size of the variables is considerably large.
4. Discussion
This section presents the study findings and links them to those reported in the literature. Then, certain recommendations are included.
In the present study, conducted with the data collected from pre-service teachers and the predictive model, it was determined that the academic achievements of pre-service teachers varied significantly based on high-level thinking skills except for empathy. Metacognitive thinking played a key role in both the personal and professional development of pre-service teachers. When pre-service teachers could manage the learning process and employ effective strategies, they could achieve higher academic achievement. The development of these skills is accepted as a significant step towards becoming an effective teacher.
In the study, the ranking of the contributions of creative thinking, critical thinking and empathy variables to academic achievement was investigated based on Exp(β)/likelihood. The findings demonstrated that although all variables had an effect on academic achievement, the impact of creative thinking skills was the highest. Certain previous reports are consistent with this finding (Kim 2005; Baran and Maskan 2011; Bryan and Nelson 1994; Erdoğdu 2006; Ai 1999; Erfani and Azad 2013).
The study also determined that critical thinking and metacognitive thinking contributed to academic achievement in that order. Several reports in the literature are consistent with this finding (Akama 2006; Arslan 2014; Antonietti et al. 2000; Başbay 2013; Berardi-Coletta et al. 1995; Black 2005; Choy and Cheah 2009; Coutinho et al. 2005; Kogut 1996; Kuhn and Dean 2004; Magno 2010; Orion and Kali 2005; Schroyens 2005).
Finally, it was determined that the correlation between empathy and academic achievement was insignificant. Individuals with empathy had better sensitivity, cooperation, sharing and collaboration skills (Palavan and Gemalmaz 2022; Roberts and Strayer 1996). In a study conducted by Onwubiko (2020), a positive correlation was found between students’ empathic behaviors and their academic performance. However, Tikkanen et al. (2022) reported that cognitive empathy led to lower participation in students’ learning activities. Similarly, Javaeed et al. (2022) found no relationship between empathy and academic performance. In another study, Uyaroğlu (2011) examined the relationship between empathy skills, emotional intelligence levels, and parental attitudes among gifted and normally developing elementary school students. The study concluded that empathy skills increased among normal children raised in democratic family environments, whereas empathy skills decreased among gifted children. This finding is particularly noteworthy.
Overall, the results of this study suggest that developing higher-order thinking skills plays a crucial role in enhancing academic achievement. Higher-order thinking skills involve applying learned knowledge to real-life situations. In this context, school success is a key factor in utilizing these skills. A student with well-developed higher-order thinking skills can synthesize existing and newly acquired information to develop alternative solutions to a given problem (Kenanlar 2014). Among the core components of higher-order thinking skills (HOTS), critical thinking and creative thinking hold particular significance. Additionally, the ability to organize one’s thinking is also a fundamental aspect of HOTS (Wang and Wang 2011; Miri et al. 2007). Therefore, individuals with well-developed metacognitive thinking skills are likely to have enhanced abilities in other cognitive domains as well. The literature highlights that the development of higher-order thinking skills enhances individuals’ learning speed and abilities. In other words, students with advanced thinking skills can learn more efficiently, address their shortcomings, and improve their performance (Yee et al. 2011). Investigating the impact of these variables on academic achievement provides valuable insights into student development.
Based on the present study findings, the development of creative thinking skills could help improve academic achievement. According to Sungur (1997), “there is no uncreative individual. There are only individuals who are more or less locked, blocked, frozen and in need of long- or short-term education”. Thus, individuals’ creative skills could be activated and improved with creativity education. Previous studies reported that creativity could be developed through education. Various education programs have been tested, including a creativity education program conducted by Torrance and Safter for higher education students. It was concluded that implementing this program could improve creativity, which was influenced by socio-psychological and cognitive variables (Aslan 2001). Furthermore, activities available in most courses that can be enhanced with pictures, shapes, and diagrams, as well as small jokes and dialogs that entertain and motivate the student, are significant for the achievement of permanent and effective learning.
The study findings demonstrated that critical thinking and metacognitive thinking also contribute to academic achievement. Thus, courses could be included in college curricula for the acquisition or development of critical thinking and metacognitive thinking skills. This finding is consistent with reports in the literature. Kanbay et al. (2017), D’Alessioa et al. (2019), Ghanizadeh (2017), and Sıburıan et al. (2019) reported that there was a positive correlation between academic achievement and critical thinking. Toker and Akbay (2022) reported that both critical thinking and metacognitive skills contributed to problem-solving skills. In the study, it was also determined that there was a positive correlation between these two skills (Arslan 2015). Furthermore, Qing et al. (2010) reported that critical thinking skills improve in learning environments where questioning learning approaches are adopted.
It was also determined, in the present study, that empathy did not contribute significantly to academic achievement. Previous studies classified empathy as an innate ability; however, it is currently considered a skill that can be learned and instructed (Pala 2008). Certain authors consider empathy an innate ability, while others consider it a skill acquired through experiences. The currently accepted view considers empathy an innate ability that can also be instructed (Gürtunca 2013) and is only one of the functions of the brain (Demir 2012). Thus, although empathy did not contribute significantly to academic achievement, it is certain that empathy is an important skill that pre-service teachers should acquire. An empathic teacher can understand their students and help them acquire empathy during communication (Elikesik and Alım 2014). Therefore, applications that aim for the acquisition of higher-order thinking skills should be included in learning activities in all educational institutions, especially teacher training schools. The following can be recommended based on the study findings. Based on the present study findings, the number of instructional methods and course activities that can develop thinking skills should be increased in tertiary education and course content, improving academic achievement. In curricula published by the Ministry of National Education on the new preschool, first grade and fifth grade of primary school, high school preparatory, and ninth grade of high school instructional models for the 2024–2025 academic year (MEB 2024), high-level thinking skills were particularly emphasized and related activities were frequently noted. Thus, future studies should be conducted to determine and improve the skills of pre-service teachers. Tok and Sevinç (2010) emphasized the significance of teachers’ thinking skills in supporting students’ development and enhancing the quality of education. Activating higher-order thinking skills effectively improves classroom achievement and leads to desired learning outcomes (Nditafon and Noumi 2018). Thus, teachers’ active use of these skills would increase the quality of education.
The fact that the study data were collected only from students attending the Faculty of Education at a single university was a limitation of the study. Studies conducted with a larger, randomly selected group would lead to more generalizable findings. Thus, future studies should be conducted with larger groups, utilizing these variables. Certain higher-order thinking skills were not addressed in the current study. Thus, it could be suggested that future studies should address higher-order thinking skills based on various variables associated with academic achievement. Furthermore, based on the findings of the present study, a qualitative dimension can be included regarding the development of these skills and their contributions to pre-service teachers in collecting more in-depth data.
Author Contributions
Conceptualization, H.K.-Ö. and Ö.U.-K.; methodology, H.K.-Ö. and Ö.U.-K.; software, H.K.-Ö. and Ö.U.-K.; validation, H.K.-Ö. and Ö.U.-K.; formal analysis, H.K.-Ö. and Ö.U.-K.; investigation, H.K.-Ö. and Ö.U.-K.; resources, H.K.-Ö. and Ö.U.-K.; data curation H.K.-Ö. and Ö.U.-K.; writing—original draft preparation, H.K.-Ö. and Ö.U.-K.; writing—review and editing, H.K.-Ö. and Ö.U.-K.; visualization: H.K.-Ö. and Ö.U.-K.; supervision, H.K.-Ö. and Ö.U.-K. All authors have read and agreed to the published version of the manuscript.
Institutional Review Board Statement
This study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Artvin Çoruh University Scientific Research and Publication Ethics Board (E-18457941-050.99-117024 and 15 December 2023) for studies involving humans.
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The data presented in this study are available on request from the corresponding author to protect the confidentiality of the participants.
Conflicts of Interest
The authors declare no conflicts of interest.
Funding Statement
This research received no external funding.
Footnotes
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
References
- Agresti Alan. An Introduction to Categorical Data Analysis. John Wiley and Sons; Hoboken: 1996. [Google Scholar]
- Ai Xiaoxia. Creativity and academic achievement: An investigation of gender differences. Creativity Research Journal. 1999;12:329–37. doi: 10.1207/s15326934crj1204_11. [DOI] [Google Scholar]
- Akama Kenichi. Relations among self-efficacy, goal setting, and metacognitive experiences in problemsolving. Psychological Reports. 2006;98:895–907. doi: 10.2466/pr0.98.3.895-907. [DOI] [PubMed] [Google Scholar]
- Antonietti Alessandro, Ignazi Sabrına, Perego Patrizio. Metacognitive knowledge about problem solving methods. The British Journal of Educational Psychology. 2000;70:1–16. doi: 10.1348/000709900157921. [DOI] [PubMed] [Google Scholar]
- Arslan Serhat. An Investigation of the relationships between metacognition and self regulation with structural equation. International Online Journal of Educational Sciences. 2014;6:603–11. [Google Scholar]
- Arslan Serhat. Investigating predictive role of critical thinking on metacognition with structural equation modeling. MOJES: Malaysian Online Journal of Educational Sciences. 2015;3:1–10. [Google Scholar]
- Aslan Esra. Turkish Version of the Torrance Creative Thinking Test. M.U. Atatürk Faculty of Education Journal of Educational Sciences. 2001;14:19–40. [Google Scholar]
- Baran Medine, Maskan A. Kadir. A study of relationships between academic self concepts, some selected variables and physics course achievement. International Journal of Education. 2011;3:1. doi: 10.5296/ije.v3i1.586. [DOI] [Google Scholar]
- Başbay Makbule. Analysing the relationship of Critical Thinking and Metacognition with epistemological beliefs through structural equation modeling. Education and Science. 2013;38:249–62. [Google Scholar]
- Belet S. Dilek, Güven Meral. Meta-cognitive strategy usage and epistemological beliefs of primary school teacher trainees. Educational Sciences: Theory and Practice. 2011;11:51–57. [Google Scholar]
- Berardi-Coletta Bernadette, Buyer Linda S., Dominowski Roger L., Rellinger Elizabeth R. Metacognition and problemsolving: A process-oriented approach. Journal of Consulting and Clinical Psychology. 1995;21:205–23. [Google Scholar]
- Bezanilla María J., Fernández-Nogueira Donna, Poblete Manuel, Galindo-Domínguez Hector. Methodologies for teaching-learning critical thinking in higher education: The teacher’s view. Thinking Skills and Creativity. 2019;33:100584. doi: 10.1016/j.tsc.2019.100584. [DOI] [Google Scholar]
- Black Susan. Teaching students to think critically. The Education Digest. 2005;70:42–47. [Google Scholar]
- Bloom Benjamin S. Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. McKay; New York: 1956. [Google Scholar]
- Brookhart Susan M. How to Assess Higher Level Thinking Skills in Your Classroom. ASCD; Alexandria: 2010. [(accessed on 23 November 2024)]. Available online: http://www.ascd.org. [Google Scholar]
- Brown Timothy A. Confirmatory Factor Analysis for Applied Research. Guilford; New York: 2006. [Google Scholar]
- Bryan Tanis, Nelson Carol. Doing homework: Perspectives of elementary and junior high school students. Journal of Learning Disabilities. 1994;7:488–99. doi: 10.1177/002221949402700804. [DOI] [PubMed] [Google Scholar]
- Büyüköztürk Şener, Akgün Özcan E., Özkahveci Özden, Demirel Funda. The Validity and Reliability Study the Turkish Version of the Motivated Strategies for Learning Questionnaire. Educational Sciences: Theory & Practice. 2004;4:207–39. [Google Scholar]
- Cautinho Savia A. The relationship between goals, metacognition and academic success. Educate. 2007;7:39–47. [Google Scholar]
- Choorapanthiyil Mathew J. Ph.D. thesis. Indiana State University; Terre Haute, IN, USA: 2007. How İnternational Teaching Assistants Conceptualize Teaching Higher Order Thinking: A Grounded Theory Approach. [Google Scholar]
- Choy Chee, Cheah Phaik K. Teacher perceptions of critical thinking among students and its influence on higher education. International Journal of Teaching and Learning in Higher Education. 2009;20:198–206. [Google Scholar]
- Cohen Jacob. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Lawrence Erlbaum Associates; Hillsdale: 1988. [Google Scholar]
- Corbin Juliet, Strauss Anselm. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. 4th ed. Sage Publications; Thousand Oaks: 2014. [Google Scholar]
- Coutinho Savia, Wiemer-Hastings Katja, Skowronski Jhon J., Britt M. Anne. Metacognition, need for cognition and use of explanations during ongoing learning and problem solving. Learning and Individual Differences. 2005;15:321–37. doi: 10.1016/j.lindif.2005.06.001. [DOI] [Google Scholar]
- Creswell John W. Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research. Pearson; Upper Saddle River: 2005. [Google Scholar]
- Çokluk Ömay, Şekercioğlu Güçlü, Büyüköztürk Şener. Multivarite Statistical SPSS and LISREL Applications for Social Sciences. Pegem Akademi; Ankara: 2016. [Google Scholar]
- D’Alessioa Fernando A., Avolioa Beatrice E., Charles Vincent. Studying the impact of critical thinking on the academic performance of executive MBA students. Thinking Skills and Creativity. 2019;31:275–83. doi: 10.1016/j.tsc.2019.02.002. [DOI] [Google Scholar]
- Demir Mehmet K. Analyzing empathy skills of primary school teacher candidates. Buca Faculty of Education Journal. 2012;33:107–21. [Google Scholar]
- Dev Necmi. Master’s thesis. Council of Higher Education Thesis Center, Yeditepe University; Ankara, Turkey: 2010. The Comparison of the Emphatic Skill Levels of Administrators and the Teachers at Primary Schools. [Google Scholar]
- Dökmen Üstün. Communication Conflicts and Empathy. 18th ed. Sistem Publishing; Ankara: 2002. [Google Scholar]
- Elikesik Meral, Alım Mete. The Investigation of Empathic Skills of Social Sciences Teachers in Terms of Some Variables. Journal of Graduate School of Social Sciences. 2014;17:167–80. [Google Scholar]
- Erdoğdu Mustafa Y. Relationships between creativity, teacher behaviours and academic success. Electronic Journal of Social Sciences. 2006;5:95–106. [Google Scholar]
- Erfani Nasrolah, Azad Zahra S. The relationship between state meta-cognition and creativity with academic achievement of students. Technical Journal of Engineering and Applied Sciences. 2013;3:3231–36. [Google Scholar]
- Ergül Hülya. Relationship between student characteristics and academic achievement in distance education and application on students of Anadolu University. Turkish Online Journal of Distance Education. 2004;5:81–90. [Google Scholar]
- Fisher Alec. Critical Thinking: An Introduction. What Is Critical Thinking and How to Improve It? Cambridge University Press; Cambridge: 2001. [Google Scholar]
- Flavell John H. Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American Psychologist. 1979;34:906. doi: 10.1037/0003-066X.34.10.906. [DOI] [Google Scholar]
- Florea Nadia M., Hurjui Elena. Critical thinking in elementary school children. Procedia-Social and Behavioral Sciences. 2015;180:565–72. doi: 10.1016/j.sbspro.2015.02.161. [DOI] [Google Scholar]
- Forehand Marry. Bloom’s taxonomy. Emerging Perspectives on Learning, Teaching, and Technology. 2010;41:47–56. [Google Scholar]
- Fraenkel Jack R., Wallen Norman E. How to Design and Evaluate Research in Education. 6th ed. McGraw-Hill; New York: 2006. [Google Scholar]
- Ghanizadeh Afsaneh. The interplay between reflective thinking, critical thinking, self-monitoring, and academic achievement in higher education. High Education. 2017;74:101–14. doi: 10.1007/s10734-016-0031-y. [DOI] [Google Scholar]
- Goleman Daniel. In: Emotional Intelligence: Why It Can Matter More Than IQ. Yüksel B. Seçkin., translator. Varlık Publishing; İstanbul: 2005. Turkish Translation. [Google Scholar]
- Güneş Firdevs. Improving the Thinking Skills of Students. Journal of Turkology Research. 2012;32:127–46. [Google Scholar]
- Gürtunca Aslı. Master’s thesis. Institute of Social Sciences, İstanbul Arel University; İstanbul, Turkey: 2013. Empathy Scale for Children and Adolescents: Turkish Validity and Reliability Study. [Google Scholar]
- Gürüz Demet, Temel-Eğinli Ayşe. Interpersonal Communication. Nobel Publishing; Ankara: 2013. [Google Scholar]
- Güven Meral, Kürüm Dilruba. Relationship between learning styles and critical thinking: A general review. Social Sciences Journal. 2006;6:75–89. [Google Scholar]
- Harpster David L. Ph.D. thesis. Montana State University; Bozeman, MT, USA: 1999. A Study of Possible Factors That Influence The Construction of Teacher-Made Problems That Asses Higher-Order Thinking Skills. [Google Scholar]
- Hartman Hope J. Metacognition in Learning and Instruction: Theory Research and Practice. Springer Science & Business Media; Berlin/Heidelberg: 2001. [DOI] [Google Scholar]
- Huitt William G. Critical Thinking: An Overview. Educational Psychology Interactive. Valdosta State University; Valdosta: 1998. [Google Scholar]
- Javaeed Arslaan, Rasheed Asifa Abdul, Manzoor Anum, Ain Qurra-Tul, Costa Prince Raphael D, Ghauri Sanniya Khan. Empathy scores amongst undergraduate medical students and its correlation to their academic performance. Journal of Advances in Medical Education & Professionalism. 2022;10:99–104. doi: 10.30476/jamp.2022.93026.1512. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kanbay Yalçın, Demirarslan Elif I., Aslan Özgür, Tektas Pınar, Kiliç Nurhayat. Critical thinking skill and academic achievement development in nursing students: Four-year longitudinal study. American Journal of Educational Research and Reviews. 2017;2:1–10. doi: 10.28933/ajerr-2017-12-0501. [DOI] [Google Scholar]
- Karaman Fatma. The empathetic tendency level of German language teacher candidates. Batman University Journal of Life Sciences. 2018;1:52–57. [Google Scholar]
- Kaya Nilüfer, Fırat Tahsin. The comparison of the Attitudes of the English language teaching department students in the Faculty of Education towards English and school and academic self-concepts according to various variables. Celal Bayar University Faculty of Education Journal. 2011;1:57–71. [Google Scholar]
- Keen Suzanne. Empathy and the Novel. Oxford University Press on Demand; Oxford: 2007. [Google Scholar]
- Kenanlar Selva. Doctoral thesis. Necmettin Erbakan University; Konya, Turkiye: 2014. Examination of the Effect of Revised Direct Reading and Thinking Activity (DR-TA) Strategy on the Development of Higher Order Thinking Skills in Reading. [Google Scholar]
- Kim Kyung H. Can only intelligent people be creative? A meta-analysis. Prufrock Journal. 2005;16:57–66. doi: 10.4219/jsge-2005-473. [DOI] [Google Scholar]
- Kılıç Hülya E., Şen Ahmet İ. UF/EMI Trurkish adaptation study of UF/EMI critical thinking disposition instrument. Education and Science. 2014;39:1–12. doi: 10.15390/EB.2014.3632. [DOI] [Google Scholar]
- Kıraç Buket, Elaldı Şenel. Evaluation of the effect of Problem-Based Learning on Higher Level thinking Skills: A meta-thematic analysis. Turkish Academic Research Review. 2023;8:1200–16. doi: 10.30622/tarr.1286769. [DOI] [Google Scholar]
- Kogut Leonard. S. Critical thinking in general chemistry. Journal of Chemical Education. 1996;73:218. doi: 10.1021/ed073p218. [DOI] [Google Scholar]
- Köksal Necla, Çöğmen Suna. Critical thinking and communication skills of secondary school students. PAU Journal of Education. 2018;44:278–96. doi: 10.9779/pauefd.422244. [DOI] [Google Scholar]
- Kruger Jaco, Merwe Liesl Van der. Learning about the world: Developing higher order thinking in music education. TD: The Journal for Transdisciplinary Research in Southern Africa. 2012;8:63–80. doi: 10.4102/td.v8i1.6. [DOI] [Google Scholar]
- Krznaric Roman. You Are Therefore I Am: How Empathy Education Can Create Social Change. Oxfam GB Research Report; Oxford: 2008. [Google Scholar]
- Kuhn Deanna, Dean David., Jr. Metacognition: A bridge between cognitive psychology and educational practise. Theory into Practise. 2004;43:268–74. doi: 10.1207/s15430421tip4304_4. [DOI] [Google Scholar]
- Kuiper RuthAnne. Enhancing metacognition through the reflective use of self-regulated learning strategies. The Journal of Continuing Education in Nursing. 2002;33:78–87. doi: 10.3928/0022-0124-20020301-11. [DOI] [PubMed] [Google Scholar]
- Kurnaz-Adıbatmaz Fatma B., Kutlu Ömer. Measuring Scientific Thinking Skills. Pegem Akademy; Ankara: 2020. [Google Scholar]
- Kuzgun Yıldız. Guidance in Primary Education. Nobel Publishing Distribution; Ankara: 2000. [Google Scholar]
- León Jenny M. A baseline study of strategies to promote critical thinking in the preschool classroom (Un Estudio de Base sobre Estrategias para la Promoción de Pensamiento Critico en las Aulas de Preescolar) GIST Education and Learning Research Journal. 2015;10:113–27. doi: 10.26817/16925777.270. [DOI] [Google Scholar]
- Lewis Arthur, Smith David. Defining Higher Order Thinking. Theory into Practice. 1993;32:131–37. doi: 10.1080/00405849309543588. [DOI] [Google Scholar]
- Livingston Jennifer A. Metacognition: An Overview. State University of New York at Buffalo; Buffalo: 1997. [Google Scholar]
- Magno Carlo. The role of metacognitive skills in developing critical thinking. Metacognition Learning. 2010;5:137–56. doi: 10.1007/s11409-010-9054-4. [DOI] [Google Scholar]
- Mainali Bhawani P. Higher order thinking in education. Academic Voices: A Multidisciplinary Journal. 2012;2:5–10. doi: 10.3126/av.v2i1.8277. [DOI] [Google Scholar]
- Marshall Catherine, Rossman Gretchen B. Designing Qualitative Research. Sage; New York: 2014. [Google Scholar]
- MEB [Ministry of Education in Turkey] Research Report on 21st Century Skills and Values. (MEB) Publications; Ankara: 2023. [(accessed on 13 November 2024)]. Available online: https://ttkb.meb.gov.tr/meb_iys_dosyalar/2023_05/11153521_21.yy_becerileri_ve_degerlere_yonelik_arastirma_raporu.f. [Google Scholar]
- MEB [Ministry of Education in Turkey] Circular Regarding the Education Model. [(accessed on 12 November 2024)];2024 Available online: https://ogm.meb.gov.tr/meb_iys_dosyalar/2024_08/19112933_genelge20242025egitimveogretimyiliturkiyeyuzyilimaarifmodelineiliskinisveislemler1.pdf.
- Ming-Lee Wen Sofia. Critical Thinking and Professionalism at the University Level; Paper presented at British Educational Research Association Conference, University of Sussex; Brighton, UK. September 2–5; 1999. [Google Scholar]
- Miri Barak, David Ben-Chaim, Uri Zoller. Purposely teaching for the promotion of higher-order thinking skills: A case of critical thinking. Research in Science Education. 2007;37:353–69. doi: 10.1007/s11165-006-9029-2. [DOI] [Google Scholar]
- Nditafon George, Noumi Emmanuel. Didactic Transposition for Inferential and Analogical Thinking, Reasoning and Transfer of School Knowledge for Societal Context-of-Use. Open Access Library Journal. 2018;5:1–29. doi: 10.4236/oalib.1104785. [DOI] [Google Scholar]
- Onwubiko Emmanuel C. A survey on the correlation between student librarians’ empathic behaviour and academic achievement. [(accessed on 20 November 2024)];Library Philosophy & Practice. 2020 :4652. Available online: https://digitalcommons.unl.edu/libphilprac/4652/ [Google Scholar]
- Orion Nir, Kali Yael. The effect of an earth-science learning program on students’ scientific thinking skills. Journal of Geoscience Education. 2005;53:387–94. doi: 10.5408/1089-9995-53.4.387. [DOI] [Google Scholar]
- Öncü Türkan. Comparison of creativity levels of children aged 12–14 years old according to age and gender using Torrance creative thinking tests-shape test. Ankara University Faculty of Language, History and Geography Journal. 2003;43:221–37. [Google Scholar]
- Özdamar Kazım. Statistical Data Analysis with Package Programs. Anadolu University Press; Eskişehir: 1997. [Google Scholar]
- Özerbaş Mehmet A. The effect of creative thinking teaching environment on academic achievement and retention of knowledge. GÜ, Gazi Faculty of Education Journal. 2011;31:675–705. [Google Scholar]
- Özgan Habib. Master’s thesis. Council of Higher Education Thesis Center, Karadeniz Technical University; Trabzon, Türkiye: 1999. Examining the Relationship Between High School Students’ Perceived Empathic Classroom Atmosphere Attitudes and Achievement and Self-Esteem. [Google Scholar]
- Özgenel Mustafa, Çetin Münevver. Development of the Marmara creative thinking dispositions scale: Validity and reliability analysis. Marmara University Atatürk Education Faculty Journal of Education and Science. 2017;46:113–32. [Google Scholar]
- Pala Aynur. A research on the levels of empathy of prospective teachers. Pamukkale University Faculty of Education Journal. 2008;23:13–23. [Google Scholar]
- Palavan Özcan, Gemalmaz Necati. An assessment of the communication sills, intra-family communication levels and empathy levels of high school students. Journal of Eurasian Human Science Research. 2022;2:36–63. [Google Scholar]
- Patton Michael Q. Qualitative Research. John Wiley & Sons; New York: 2005. [DOI] [Google Scholar]
- Qing Zhou, Jing Guo, Yan Wang. Promoting Pre-service Teachers’ Critical Thinking Skills byInquiry-Based Chemical Experiment. Innovation and Creativity in Education. 2010;2:4597–603. doi: 10.1016/j.sbspro.2010.03.737. [DOI] [Google Scholar]
- Rasoal Chato, Jungert Tomas, Hau Stephan, Andersson Gerhard. Development of a Swedish Version of the Scale of Ethnocultural Empathy. Psychology. 2011;2:568–73. doi: 10.4236/psych.2011.26087. [DOI] [Google Scholar]
- Retnawati Heri, Djidu Hasan, Kartianom, Apino Ezi, Anazifa Risqa D. Teachers’ knowledge about higher-order thinking skills and its learning strategy. Problems of Education in the 21st Century. 2018;76:215–30. doi: 10.33225/pec/18.76.215. [DOI] [Google Scholar]
- Richland Lindsey, Simms Nina. Analogy, higher order thinking, and education. WIREs Cognitive Science. 2015;6:177–92. doi: 10.1002/wcs.1336. [DOI] [PubMed] [Google Scholar]
- Rieffe Carolien, Ketelaar Lizet, Wiefferink Carin H. Assessing empathy in young children: Construction and validation of an empathy questionnaire (EmQue) Personality and Individual Differences. 2010;49:362–67. doi: 10.1016/j.paid.2010.03.046. [DOI] [Google Scholar]
- Roberts William, Strayer Janet. Empathy, Emotional Expressiveness, and Prosocial Behavior. Child Development. 1996;67:449–70. doi: 10.2307/1131826. [DOI] [Google Scholar]
- Romainville Marc. Awareness of cognitive strategies: The relationship between university students’ metacognition and their performance. Studies in Higher Education. 1994;19:359–66. doi: 10.1080/03075079412331381930. [DOI] [Google Scholar]
- Sadeghi Bahador, Hassani Mohammad-taghi, Rahmatkhah Masoumeh. The relationship between EFL learners’ metacognitive strategies, and their critical thinking. Journal of Language Teaching & Research. 2014;5:1167–75. doi: 10.4304/jltr.5.5.1167-1175. [DOI] [Google Scholar]
- Sarwar Muhammad S., Yousuf M. I., Hussain Shafgat, Noreen Shumaila. Relationship between achievement goals, meta-cognition and academic success in Pakistan. Journal of College Teaching& Learning. 2009;6:51–56. doi: 10.19030/tlc.v6i5.1141. [DOI] [Google Scholar]
- Saunders Marc N. K., Lewis Philip, Thornhill Adrian. Research Methods for Business Students. FT Prentice Hall; Edinburgh Gate/Harlow: 2007. [Google Scholar]
- Schroyens Walter. Knowledge and thought: An introduction to critical thinking. Experimental Psychology. 2005;52:163–64. doi: 10.1027/1618-3169.52.2.163. [DOI] [Google Scholar]
- Siew Niet M., Ambo Nurjanah. The scientific creativity of fifth graders in a STEM project-based cooperative learning approach. Problems of Education in the 21st Century. 2020;78:627–43. doi: 10.33225/pec/20.78.627. [DOI] [Google Scholar]
- Sıburıan Jodion, Corebıma Aloysius Duran, İbrohim, Saptasarı Murni. The Correlation Between Critical and Creative Thinking Skills on Cognitive Learning Results. Eurasian Journal of Educational Research. 2019;19:99–114. doi: 10.14689/ejer.2019.81.6. [DOI] [Google Scholar]
- Sungur Nuray. Creative Thought. Evrim Publishing; İstanbul: 1997. [Google Scholar]
- Tabachnick Barbara G., Fidell Linda S. Using Multivariate Statistics. 4th ed. Ally and Bacon Pearson Education, Inc.; Boston: 2001. [Google Scholar]
- Tanujaya Benidiktus, Mumu Jeinne, Margono Gaguk. The relationship between higher order thinking skills and academic performance of student in mathematics instruction. International Education Studies. 2017;10:78–85. doi: 10.5539/ies.v10n11p78. [DOI] [Google Scholar]
- TDK (Türk Dil Kurumu) Turkish Dictionary. 11th ed. Turkish Language Association Publications; Ankara: 2011. [Google Scholar]
- Temizkan Mehmet. Developing Creative writing skills in Turkish Language Education. Turkology Research. 2010;27:621–43. [Google Scholar]
- Tikkanen Lotta, Anttila Henrika, Pyhältö Kirsi, Soini Tiina, Pietarinen Janne. The role of empathy between peers in upper secondary students’ study engagement and burnout. Frontiers in Psychology. 2022;13:978546. doi: 10.3389/fpsyg.2022.978546. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tok Emel, Sevinç Müzeyyen. The effects of thinking skills education on The Critical Thinking and Problem Solving Skills of Preschool Teacher Candidates. Pamukkale University Journal of Education. 2010;27:67–82. [Google Scholar]
- Tok Hidayet, Özgan Habib, Döş Bülent. Assessing metacognitive awareness and learning strategies as positive predictors for success ın a distance learning class. Mustafa Kemal University Social Sciences Institute Journal. 2010;7:123–34. [Google Scholar]
- Toker Sacip, Akbay Tuncer. Comparison of recursive and non-recursive models of attitude towards problem-based learning, disposition to critical thinking, and creative thinking in a computer literacy course for preservice teachers. Education and Information Technologies. 2022;27:6715–51. doi: 10.1007/s10639-022-10906-y. [DOI] [Google Scholar]
- Topçu Çiğdem, Erdur-Baker Özgür, Çapa-Aydın Yeşim. Turkish Adaptation of Basic Empathy Scale: Validity and Reliability Study. Turkish Psychological Counseling and Guidance Journal. 2010;4:174–80. doi: 10.17066/pdrd.58553. [DOI] [Google Scholar]
- Tozduman-Yaralı Kevser. Ph.D. thesis. Gazi University; Ankara, Turkey: 2019. The Effect of the Education Program Based on the Storyline Method on Critical Thinking Skills of Preschool Children. [Google Scholar]
- Uyaroğlu Bahar. Master’s thesis. Hacettepe University Institute of Health Sciences; Ankara, Turkey: 2011. Analysing The Relation Between The Empathy Skills, Emotional Intelligence Level And Parent Attitude of Gifted And Normally Developed Primary School Students. [Google Scholar]
- Ünsal Serkan, Kaba Selçuk. The characteristics of the skill based questions and their reflections on teachers and students. Kastamonu Education Journal. 2022;30:273–82. doi: 10.24106/kefdergi.753717. [DOI] [Google Scholar]
- Vincent-Lancrin Stéphan, González-Sancho Carlos, Bouckaert Mathias, Luca Federico de, Fernández-Barrerra Meritxell, Jacotin Gwénaël, Urgel Joaquin, Vidal Quentin. Fostering Students’ Creativity and Critical Thinking: What It Means in School. Educational Research and Innovation. OECD Publishing; Paris: 2019. [(accessed on 17 December 2024)]. Available online: https://www.oecd.org/education/ceri/fostering-assessing-studentscreative-and-critical-thinking-skills-in-higher-education.htm. [Google Scholar]
- Wang Shouhong, Wang Hai. Teaching Higher Order Thinking in the Introductory MIS Course: A Model-Directed Approach. Journal of Education for Business. 2011;86:208–13. doi: 10.1080/08832323.2010.505254. [DOI] [Google Scholar]
- Wellman Laure E. Ph.D. thesis. University of California; Los Angeles, CA, USA: 1997. [(accessed on 11 December 2024)]. The Use of Multiple Representations, Higher Order Thinking Skills, İnteractivity, and Motivation When Designing a Cd-Rom 98 To Teach Self Similarity. Available online: https://www.proquest.com/docview/304351657?pqorigsite=gscholar&fromopenview=true&sourcetype=Dissertations%20&%20Theses. [Google Scholar]
- Yee Mei Heong, Othman Widad Binti, Yunos Jailani Bin Md, Kiong Tee Tze, Hassan Razali Bin, Mohamad Mimi Mohaffyza Binti. The level of Marzano higher order thinking skills among technical education students. International Journal of Social Science and Humanity. 2011;1:121–25. doi: 10.7763/IJSSH.2011.V1.20. [DOI] [Google Scholar]
- Yılmaz Ramazan. Ph.D. thesis. Ankara University; Ankara, Turkey: 2014. The Effect of Interaction Environment and Metacognitive Guidance in Online Learning on Academic Success, Metacognitive Awareness and Transactional Distance. [Google Scholar]
- Yılmaz Veysel, Çelik H. Eray. Structural Equation Modeling with LISREL-I: Basic Concepts, Applications, Programming. Pegem; Ankara: 2009. [Google Scholar]
- Yurdakul Bünyamin. Ph.D. thesis. Hacettepe University; Ankara, Turkey: 2004. The Effects of Constructivist Learning Approach on Learners’ Problem Solving Skills, Metacognitive Awareness, and Attitudes Towards the Course, and Contributions to Learning Process. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data presented in this study are available on request from the corresponding author to protect the confidentiality of the participants.

