Abstract
The research aims to design and develop learning innovation to enhance higher order thinking skills for students in Thailand junior high schools. The design development research model of Richey and Klien (2007) is used and divided into two phases: (1) to design and develop innovative learning and validate of its quality based on the interviews and survey from 13 experts, 10 teachers and 30 students, and (2) to test the tools' validity by three experts and 153 students from five junior high schools at five provinces in Thailand. The findings indicate that analytical thinking, creative thinking, problem-solving thinking and critical thinking skill are developed by researchers, and experienced and practiced by learners in their lessons. The higher order thinking skills of learners after experiencing the learning innovation have a higher average score than the previous one. Following the students' perspectives on the learning innovation, 1) The design of content is in line with students’ knowledge levels, easy to understand, and enable to connect science contents to their daily life. However, some contents cannot fully cover into all classroom lessons; 2) Multimedia. A navigation design is easy for students to find information and direct to their needs. The icon symbols could hint the meaning of various information sources and have links to these sources. Also, multimedia could considerably explain scientific processes and help students understand better; 3) The design of problem scenarios supports easier connection to the daily life. In addition, using videos as a learning resource could suitably illustrate scientific process, and improve communicative and collaborative skills in problem solving.
Keywords: Learning innovation, Higher order thinking skill, Junior high schools, Thailand
Learning innovation, Higher order thinking skill, Junior high schools, Thailand.
1. Introduction
The rapid development of information communication and technology has changed and affected the human learning in the 21st century. The learning management model must be adjusted in accordance with the current society. The rapid and continuous movement and change in many areas have taken the world into a globalization era and a knowledge-based society (Bureau of International Cooperation, Thailand, 2011). A national economic and social development plan on developing people to a sustainable learning society to support free trade opening of Thailand (Office of the National Economic and Social Development Council, 2016) indicated that learning in the 21st century has to transcend "subject matter” to learning. The teacher would design learning to train themselves to be a coach and facilitate in the problem-based learning of students.
The assessment results of the PISA 2015 found that the science average point of Thailand students was lower than the Organization for Economic Co-operation and Development (OECD) average (OECD, 2016), with 421 points. Besides, the science scores of Thailand students did not rise in following years in comparison with previous years. Another prominent finding also shown that one-fifth of students demonstrated higher knowledge of science than a given basic level. When considering separate areas in Thailand, students from all areas also had an average score lower than the OECD average. Following this, in the Northeastern area, the science average score was 418, which was lower than the Thai average (OECD, 2019), especially the provinces in the Mekong River Basin (MRB). The reason has derived from the limitation of cooperation in developing education at different levels. Therefore, it is important to change and keep up with the changes of the globalization and boost the educational cooperation between provinces in the Mekong River Basin.
Accordingly, Akarawang et al. (2015) revealed that in the past, Thailand teachers at junior high schools focused on the traditional teaching method by conveying their knowledge to learners. Nevertheless, with the changes of national policy, teachers have been encouraged to improve learning ways to students rather than knowledge transfer (Asanok and Chookhampaeng, 2016). Thus, media has been applied to encourage learners at educational institutions. On the other hand, most of teachers centered on developing and innovating teaching methods instead of learning innovation that stimulate students’ self-learning skills and boost searching information from teacher-prepared media.
The research findings from OECD (2019) figured out that approximately 56% Thai students has science competence at Level 2. With this level, students could explain familiar and basic scientific phenomena and indicate correctly conclusions in congruent with available data; however, it can be seen that Thai students still have lower scientific ability than the average of other countries (OECD, 2019). Naluan et al. (2013) mentioned the main reasons pertain to the lack of opportunities to develop higher thinking, and limitation of learning content. Besides, the teaching and learning of the science subjects emphasized on memorizing rather than exploring knowledge, and the constraint of experimental practice.
Some research has pointed out that learning innovation has been developed to promote higher order thinking skills (e.g., critical thinking, problem solving, creative thinking and critical thinking) by applying theoretical principles into practice and combining with media features. There are the learning environments, skill sets, multimedia, online lessons and mobile learning (Hong et al., 2000; Hwang et al., 2018; Ku and Ho, 2010; Lee et al., 2004, 2021; Pedaste and Sarapuu, 2006; Perschbach, 2006; Prahani et al., 2020; Saido et al., 2018; Strycker, 2020; Torres and Cano, 1995; Uribe et al., 2003; Wang et al., 2009; Whittington, 2000). However, there is no educational institution promoting knowledge formation and higher order thinking skills based on the social and culture context, and the integration of local wisdom into courses to enable learners to learn and connect, then contribute to the sustainable creation of new knowledge. In addition, teachers had the misunderstandings of learning management or the development of learning innovation fostering higher order thinking skills (Kwangmuang and Chaijaroen, 2016).
In the design and development of learning innovation, it is important to focus on supporting learners’ knowledge construction process and reflection instead of conveying and memorizing principles and facts (Chaijaroen, 2014; Jonassen, 2000; White et al., 1999). It can be seen that studying the understanding of cognitive processes is a new aspect enabling learning innovation to develop and enhance the learning quality. Hence, it might be interesting to further prepare necessary conditions to develop the quality of people and toward a wisdom and learning society in Thailand by increasing knowledge and basic skills, such as, analyzing, creating, solving problems, critical thinking, and team-working; having ethics, and working discipline to support and learn complex technologies easily, and to adapt to modern technologies and develop life-long learning skills.
Therefore, the aims of this research focus on:
-
(1)
Designing and developing learning innovation in order to enhance higher order thinking skills for learners at junior high schools in Thailand;
-
(2)
Measuring and evaluating the learners' higher order thinking skills;
-
(3)
Exploring the learners' opinions on learning innovation to promote higher order thinking skills.
This study is quite promising in enhancing the intellectual potential of the learners, and improving the teachers' competency about learning management design, learning innovation development and higher order thinking skills for students. Besides, this paper is useful for policymakers and educators to design appropriate curricula and the learners’ competence framework. The results of this study can also be used as a basis for research in education and social sciences.
2. Research questions
This study answers three following research questions:
-
(1)
What components of learning innovation are designed to enhance higher order thinking skills for students at Thailand secondary schools?
-
(2)
How are the students' higher-order thinking skills after experiencing learning innovation?
-
(3)
What are the learners' opinions on learning innovation to promote higher order thinking skills?
3. Literature review
3.1. Learning innovation
Educators gave the definition of leaning innovation is the interplay between the complex set of practices, methods, and designs that are part of the attempts by higher education to improve teaching and student learning (Kim and Maloney, 2020). Moreover, a set of core educational values and principles to inform decision-making of teachers, who appropriate these principles, make reflective interpretation and discretionary judgment, and develop specific designs and actions to achieve desired outcomes (Zhang et al., 2008). The goal of learning innovation is not only to enhance learning outcomes, but also to improve the teaching experience as an opportunity of the development of transversal skills. The “Pedagogy-Space-Technology” Framework (Radcliffe, 2009) is the tool used as a starting point for the design of innovative teaching-learning experiences.
Foxon and Pearson (2008) emphasized that designing learning innovation aims to support those who do not have a specific pedagogical background and wish to appropriate the basic tools of good teaching design and then continue exploring the frontiers of innovation. It is considered as a set of logical and methodological tools to innovate teaching, finding approaches more in harmony with one's vision of the teaching-learning experience. From this principle it was found that researchers have developed various forms of learning innovations, such as the development of learning innovation as a game for enhancing the active of the undergraduate student (Areekul, 2020), creating and developing learning innovations using multimedia integrated with online social networks (Phudthonamochai, 2021); technology-supported learning innovation in cultural contexts (Zhang, 2010); institutional change and leadership associated with blended learning innovation (Garrison and Vaughan, 2013); e-learning innovation through the implementation of an Internet supported learning environment (Smith and Hardaker, 2000).
It can be seen that researchers have developed learning innovations that focus on the learners' thinking process, not only by transferring knowledge. Most of the innovations are on different platforms, but there has been no development of learning innovations that foster higher order thinking skills, especially in Thailand. Therefore, to develop people to be able to create knowledge and learn by themselves, learning innovation is important. This will enable learners to learn and develop students' potential in a sustainable manner.
3.2. Higher order thinking skills (HOTS)
It is interesting to show that students should be experienced learning which helps them enhance knowledge and thinking skills. Previous studies mentioned HOTS is considered as the ability of analysis, synthesis, evaluation, develop skills, estimate, generalize, and create thinking, make decision, set up objectives, critical and systemic thinking (Dillon and Scott, 2002; Miri et al., 2007; Zohar and Dori, 2003).
Some previous studies indicated that HOTS include two components, such as critical and creative thinking skills (Heong et al., 2011; Plan, 2014; Sulaiman et al., 2017); logical thinking, critical thinking and reasoning skills (Marshall and Horton, 2011). Ramirez and Ganaden (2008) focused on the three cognitive processes, namely analysis, evaluation, and creation reviewed as HOTS. Meanwhile, others mentioned four aspects of HOTS, namely critical thinking, creative thinking, problem solving, decision making thinking (Apino and Retnawati, 2017; Lewis and Smith, 1993). According to Ahmad et al. (2017), HOTS is an important element in education because of its benefits in improving of students’ learning performance, reducing weakness, interpreting, synthesizing, solving problems, and controlling information, ideas and day-to-day activities.
Zohar and Dori (2003) emphasized the development of HOTS is one of important objectives of educational institutions because of the its influences of learning performance. The findings from the study of Zohar and Dori (2003) noted that students with high learning outcomes achieved higher thinking scores in comparison with peers who have lower learning performance. Miri et al. (2007) suggested that teachers should develop professional programs to support and encourage students in accomplishing their tasks which is required by higher order thinking skills (Zohar and Dori, 2003). In addition, Sulaiman et al. (2017) concluded that teacher's knowledge and competence play critical roles in ensuring the effectiveness of the deployment of HOTS to enhance learning outcomes for students (Retnawati et al., 2018). Therefore, the development of learning models, teachers' knowledge and skills, and learning resources is necessary conditions to boost HOTS for learners (Retnawati et al., 2018).
3.3. Science literacy
Science literacy is considered as an important factor influencing learning achievement of the students. According to Rustaman (2003 as cited in Ardianto &Rubini, 2016), science literacy is conceptualized as the learner's capability in using science knowledge in order to identify questions, issues, to understand and make decisions, and draw conclusions relied on evidence. Similarly, Rusilowati et al. (2017) also mentioned science literacy is characterized by individual's ability to understand, communicate and apply science knowledge to solve problems of daily life based on science considerations (Jufrida et al., 2019). In the study of Rusilowati et al. (2017), it is found that the concern of school's principal, the implementation process of science teaching and the interest in science of students are three main factors having influence the science literacy attitudes.
According to Ardianto and Rubini (2016), the integration of using socio-scientific issues into learning content is useful to develop the scientific literacy of students. Besides, “guided discovery and problem-based learning models” are also used to improve critical thinking skills and learning achievement in science literacy. As a result, these models yielded satisfaction for students in enhancing their scientific literacy within two aspects including science content and competency. However, the results in the study of Nurlaely et al. (2017) revealed that the science literacy score of students is relatively low, thus, it is important to build a learning innovation model to improve science knowledge and skills of learners (Jufrida et al., 2019). Besides, Wang (2013) suggested that teachers should integrate and link science knowledge with daily life to improve the students’ understanding of multiculture.
3.4. The conceptual framework
The researchers studied relevant documents and literature of cognitive processes to serve as the basis for designing learning innovation to enhance higher order thinking skills. The model research is used in this study focusing on the process of developing a model designed by Richey and Klein (2007). This model is in accordance with the development of teaching technology or educational technology and teaching design to develop teaching and learning models. This research used mixed-research method to measure and evaluate the learning innovation in two phases and was expressed in the following conceptual framework (Figure 1).
Figure 1.
The conceptual framework.
We studied relevant literature and formed a theoretical framework as shown in Figure 2. As a result, constructivist is in line with learning management in the educational reform and learning era which learner is the creator of self-knowledge and cognitive processes. It serves as the basis for designing innovative learning models promoting advanced thinking. Fundamentals of pedagogy include constructivist models, namely, the constructivist learning environments (CLEs) Model (Jonassen, 2000), SOI (Select, Organize, and Integrate) Model (Winarsih, 2018), open learning environments (OLEs) (Hannafin, 1999), and Cognitive Apprenticeship (Garner, 2012), information processing theory (Klausmeier, 1992). Media theory, media symbolic systems, and learning multimedia are also studied. Besides, thinking skills are as a basis for designing innovative learning, such as, 1) Analytical thinking (Jarutkamolpong et al., 2018) consisting of five phases; 2) Creative thinking applied from Guilford (1967); 3) Problem solving applied from Jonassen (2000); and 4) Critical thinking (Sangboonraung et al., 2019), as well as finding the effectiveness of learning innovation.
Figure 2.
A theoretical framework.
Next, based on the conceptual framework and theoretical framework, a designing framework of learning innovation to foster advanced thinking for learners, and convert theoretical principles into practice was drafted. This framework includes four important components: 1) Stimulating the creation of cognitive structures and promoting higher-order thinking skill, 2) supporting to cognitive balance, 3) promoting the expansion of cognitive structures and higher-order thinking skill, 4) helping cognitive balance (Figure 3).
Figure 3.
The designing framework of learning innovation.
4. Methodology
This research is divided into two phases: Phase 1, Design the theoretical framework; Phase 2, Testing the integrity of learning innovation.
4.1. Phase 1. Design the theoretical framework
In this phase, researchers carried out following steps:
-
(1)
Study and analyze principles, theories, and research on the design of learning innovation (i.e., constructivist learning theory, higher order thinking skill, media symbol system, network technology teaching and learning context).
-
(2)
Synthesize the theoretical framework from the analysis of related documents and research;
-
(3)
A designing framework of learning innovation is drafted to enhance higher order thinking skills in schools and proposed to the research team to criticize.
4.2. Phase 2. Testing the integrity of learning innovation
4.2.1. Participants
The participants of this study consist of:
-
-
13 experts are lecturers at Thailand universities to validate the quality of preliminary learning innovation concerning content, design and media;
-
-
10 teachers and 30 students in a sample group at five secondary schools to explore the school's context and have deeply understanding of real situation of learning innovation;
-
-
Three experts from universities who have experience about learning innovation to validate the quality of the elements of learning innovation after revising based on the suggestions of 13 abovementioned experts' suggestions;
-
-
153 grade 8 students in five junior high schools in five provinces of Mekong River Basin, Thailand (namely, Mukdahan, Nakhon Phanom, Sakon Nakhon, Nong Khai, and Bueng Kan Province). The choice of students in the Grade 8 level is to clarify the integration of local context and wisdom into science content which mainly concentrated in subjects in grade 8.
4.2.2. Research instruments
There are some research instruments used to monitor the quality of learning innovation and higher order thinking as follows:
-
-
An evaluative form is used to examine the quality of learning innovation, consisting of open-ended questions with reasons or suggestions to improve issues with consistent or inconsistent opinions;
-
-
An interview protocol is done to explore the teachers' perspectives of learning innovation and students' higher order thinking skills;
-
-
A questionnaire with yes/no questions and recommendations is used to survey the learners' perspectives about learning innovation;
-
-
A pre-test and post-test are used to measure academic achievement of Grade 8 students who experienced the learning innovation;
-
-
An interview protocol for learners (unstructured interviews and semi-structured interviews) on the application process of learning innovation, and study pre- and post-learning learners' solutions on the learning innovation to enhance higher order thinking skills;
-
-
The evaluation form is sent to experts to get their opinions on the use of learning innovation;
-
-
Measurement tools to evaluate of the learners' creative thinking, analytical thinking, critical thinking and problem-solving thinking;
-
-
A questionnaire is used to explore the learners' perspectives after experiencing the learning innovation.
4.2.3. Data analysis
Researchers used various data analysis ways for collected data, including:
-
-
In term of qualitative data from interviews and evaluation form, the data interpretation, synthesis and summary techniques are applied to examine the quality based on experts' perspectives, and get learners' opinions on learning innovation situation.
-
-
Regarding the quantitative data, SPSS software is done to process data from questionnaire with the descriptive statistics (e.g., percentage (%), mean (X̅), and standard deviation (S.D.))
Measuring higher order thinking skills of learners is used by specific instruments based on previous studies. These would be mentioned in 5.2 The learners’ higher order thinking skills.
5. Results and discussion
5.1. The results of the design and development of learning innovation to enhance higher order thinking skills for students
5.1.1. Phase 1 - Design and development of learning innovation
The real situation of learning innovation is not detailed mentioned in this paper. However, the results of teaching and learning in science subjects at secondary schools found that the teachers' teaching has not promoted the learners’ problem solving. Most of the teaching styles have focused on lectures because they fear that the students would not understand the content. Students have just waited for receiving knowledge from teachers. Consequently, they could not distinguish different things because they lacked analytical thinking, critical thinking, creative thinking and problem-solving thinking skill. Furthermore, teachers have not had hands-on examples to encourage students to link knowledge and apply in daily life. Therefore, it is crucial to design and develop learning innovation to enhance higher order thinking skills and combine with the integration of local wisdom.
The details of the design and development of learning innovation are mentioned in six components:
5.1.1.1. Problem-based
Based on the Piaget's theory of cognitive development (1963), this concept emphasized that the learner is as the creator of knowledge by taking actions. If the learners are motivated by a problem creating an intellectual conflict (Cognitive conflict) or loss of disequilibrium, they must try to adjust the cognitive structure into equilibrium. Therefore, the research team has converted this theory into practice by designing a problem situation. Following this, an authentic context is presented in the form of a problem regarding the real context of the story to help learners refer or relate to their previous experiences. Besides, a case study concerning local wisdom in the MRB is integrated and combined with the design of a learning mission promoting advanced thinking (including, problem solving, creative thinking, critical thinking, and analytical thinking) (Figure 4).
Figure 4.
An example of problem-based learning.
5.1.1.2. Learning resources
The learning resources are designed by integrating subject content according to the core curriculum for the grade 8 students, the science subjects and local wisdom in the Mekong River Basin combine with the principles of learning theory based on information processing theory. Then, we designed information for knowledge sources by presenting information with a mind map showing relationships of all contents; using animated graphics to show changes in objects and to highlight important information, such as, color, size; underlining designing information as a conceptual model, a visual concept of the connection; and classification of information by grouping related information together in a hierarchical network to show the learning resources for each innovation. As a result, (1) Fish farming in cages is the ecological content (biology course) is designed to enhance analytical thinking skill. (2) A device for fishing in the Mekong River relied on the liquid solid properties (Chemistry course) and fluid (Physics course) is integrated to improve creative thinking skill. (3) The fermented fish in the context of chemical reactions in living cells and the digestion of microorganisms and protozoa (Biology course) is used to improve problem-solving skill. And (4) Food processing and preservation in the context of energy and heat and chemicals used in daily life (chemistry course) is designed to enhance critical thinking skill.
5.1.1.3. Scaffolding
It is used for cognitive balance promoting advanced thinking. According to Vygotsky's theory (1978), “Social interaction plays an important role in cognitive development”. Ideas of the cognitive development potential may be limited to the phase of development known as the zone of proximal development if the student is below the zone. It is essential to support to learning known as Scaffolding, combined with the foundations of open learning environments (OLEs) of Hannafin (1999) and divided into four bases: 1) conceptual scaffolding, 2) metacognitive scaffolding, 3) procedural scaffolding, and 4) strategic scaffolding.
5.1.1.4. Related case
Based on the design of a constructivist learning environment of Jonassen (2000) known as CLEs (Constructivist learning environments), we designed a case study relating to a similar case to encourage learners to apply their knowledge to solve problems. For close cases, it allows students to learn from nearby cases to solve new problems that they are facing.
5.1.1.5. Coaching
The researchers draw on the principles of the cognitive apprenticeship model (Collins et al., 1988; Garner, 2012), a constructivist approach to learning management to change the teacher's role in transferring of knowledge, and guiding learners to learn, think and build their own wisdom. In addition, the principles of Intellectual Practice (Apprenticeship) of Collins et al. (1988) are designed to help new learners become an expert and intellectual internship when working. A classroom coaching and online coaching are designed to develop problem solving expertise. The coach also observes learners when they try to complete their mission and provides hints and assistance when needed. Learners could ask an expert anytime they want. Besides, the principles of Herrington and Oliver (1997) on how to design an appropriate situated learning is used to stimulate the learners' thoughts and to solve learning missions.
5.1.1.6. Higher order thinking skills
The theoretical principles promoting higher order thinking skills are used as the basis for the design to enhance:
-
1)
Problem solving thinking - The simple problem-solving process of Jonassen (2000) is applied to help learners face with problems in real contexts and practice problem solving skill by problems with simple structures, then assign missions for students to solve problems according to the process (Figure 5).
-
2)
Analytical thinking - In order to promote analytical thinking and help learners deal with situations and problems in real contexts and practice critical thinking, a learning mission promoting analytical thinking (Figure 6) is carried out the following steps (Jarutkamolpong et al., 2018): (1) Extent specify, (2) Consideration, consisting of identification, categorization, expiation, prediction, and discrimination, (3) Correlation, (4) Conclusion, and (5) Utilization.
-
3)
Creative thinking - It is a process encouraging students' creative thinking based on Guilford (1967) model. Four aspects of thinking are designed: 1) Fluency thinking - help students find answers as quickly as possible in the limited time of 1 min; 2) Flexibility - allow students to create ideas to change the interesting presentation form of different brochures; 3) Originality means the ability to create ideas - requires students to design a presentation of their local story by using the appropriate devices or technologies; and 4) Elaboration - develop thinking ability to expand, add or create new ideas from evaluating the answers according to the specified criteria (Figure 7).
-
4)
Critical thinking - Relied on critical thinking principles (applied from Norris and Ennis, 1989), six learning missions are carried out as follows: (1) Deductive summary by allowing students to give examples and then teach theories; (2) Provide meaning by allowing learners to identify similarities and classify; (3) Considering the reliability of the data source; (4) Inductive summarization by giving students an overview example of the ability to reason, as well as to draw conclusions by giving comprehensive examples; (5) Summarizing tests, hypotheses and predictions: students could consider reasonable alternatives based on available information and evidence; (6) Defining and specifying assumptions by giving learners the ability to reason to formulate problems (Figure 8).
Figure 5.
Learning missions to promote problem solving thinking.
Figure 6.
Learning missions promoting analytical thinking.
Figure 7.
An example of the encouragement of creative thinking.
Figure 8.
An example of six learning missions of critical thinking.
In term of the evaluation of the effectiveness of learning innovation. Examining the effectiveness of learning innovation is done to determine the quality of the model from the reviews of 13 experts. An evaluation form with open-ended questions pertaining to the design, content and media of learning innovation used in teaching and learning is sent experts to get their perspectives. The findings are found that all aspects are appropriate and consistent, and help promote knowledge creation and enhance higher order thinking skills for students.
5.1.2. Phase 2. Testing the integrity of learning innovation
The objective of this phase is to examine the various components of the model by using experts' perspectives and external validation, the impact of implementing innovative learning techniques, including advanced thinking of learners, academic achievement and learners' opinions of innovative learning.
5.1.2.1. Internal validation
The learning innovation is examined by three experts through an evaluation form with relevant questions to evaluate teaching design, the quality of design and media. The results are found that the overall design and development of the learning innovation is theoretically consistent and used as the basis for designing a conceptual framework of learning innovation.
5.1.2.2. External validation
The learning innovation is applied with target learners in real context to evaluate its influence. As a result, the advanced thinking skills of the learners are higher than before learning, with a post-test average score (X̅ = 15.86, S.D. = 1.41), and 83% students passed 70% criteria as specified by the educational institutions. An instrument used to evaluate learning innovation of students consists of the measurement of the learners' creative, analytical, critical and problem-solving thinking based on the test. This test is designed based on the content of the science courses to develop an ecosystem, the properties of solids, liquids (chemistry), and fluids (physics), reactions, microbial and protozoa digestion, energy and heat, and daily chemicals. Besides, learners said that learning innovation (content, multimedia, and design) helps promote their learning, knowledge creation, and advanced thinking. In addition, the results of learning innovation to enhance higher order thinking skills for students in Thailand junior high schools are found that all components are very effective in promoting learners' advanced thinking. Following this, the design and development of learning innovation help enhance advanced thinking (i.e., problem solving, analytical thinking, creative thinking, and critical thinking), stimulate students' curiosity and information seeking to answer questions or learning tasks, and create new ideas.
These results seem to support the evaluation of previous studies, which confirmed that design and develop a learning environment by applying the key elements and principles of constructivist theory to design and coordinate with the media in different ways could facilitate students' learning, promote self-knowledge creation, stimulate learning interest, and promote team-working (Hadjipanayi and Michael-Grigoriou, 2020; Pedaste and Sarapuu, 2006; Shah, 2019; Xu and Shi, 2018).
5.2. The learners’ higher order thinking skills
The measurement of higher order thinking skills of students from the survey and in-depth interviews is shown in Table 1, and explain detailed as follows:
Table 1.
The result of students’ higher order thinking skills.
| Higher order thinking skills | Before learning | After learning |
|---|---|---|
| Problem-solving thinking (full score: 15) | = 3.05; S.D. = 1.52 | = 11.01; S.D. = 2.25 |
| Analytical thinking (full score: 60) | = 21.98; S.D. = 5.43 | = 47.35; S.D. = 5.96 |
| Creative thinking (full score: 40) | = 10.77; S.D. = 2.17 | = 31.81; S.D. = 3.27 |
| Critical thinking (full score: 30) | = 11.16; S.D. = 2.10 | = 27.63; S.D. = 2.28 |
5.2.1. Problem-solving thinking
The results of in-depth interviews of problem-solving thinking are shown through three steps applied by Jonassen (2000), (1) Problem representation is found that students must connect problems with their daily life, identify the problems and what available solutions to solve them based on previous experiences. (2) Searching for solutions - students must associate problems with solutions, analyze the goals, solve problems, and use methods to separate the problem into subsections to understand reasons, and a simple solution test is created. (3) Implement solutions - the learners simulate the situation and experiment assumptions they have planned to solve the problem and to find the best solutions. The results of the evaluation by using the scale of Jonassen (2000) are figured out that the problem-solving thinking of learners after learning innovation has higher creativity with overall score (X̅ = 11.01, S.D. = 2.25) in comparison with before score (X̅ = 3.05, S.D. = 1.52).
The results of this study based on ID Theory could bring problem-solving principles into practice in each component of learning innovation. For example, the mission design for students to analyze problems according to the problem-solving processes of Jonassen (2000) is carried out through three steps. It is a computer-based design allowing students to think and solve problems with their peers in a three-step process (e.g., problem representation, search for solutions, implement solutions) by using the features of multimedia. This also allows students to interact and record what they think in the problem-solving process into the learning innovation immediately. The previous results highlighted that promote problem-solving thinking in the classroom helps learners get the higher learning achievement (Hew and Knapczyk, 2007; Hernandez-Serrano and Jonassen, 2003; Hong et al., 2000; Mooney et al., 1999; Pedaste and Sarapuu, 2006; Uribe et al., 2003; Wang et al., 2017; Wattanachai et al., 2010).
5.2.2. Analytical thinking
The learners’ analytical thinking is expressed through five steps relied on the study of Jarutkamolpong et al. (2018):
-
-
Step 1. Extent specify - learners are able to define information by considering what they are learning, including the collection of relevant content and knowledge.
-
-
Step 2. Consideration is divided into six parts: 1) Additional Query - the problem set earlier and effort in setting up new problems to find answers in multiple dimensions are considered carefully. 2) Identification is found that learners able to distinguish different subsections, including the detailed information gathered. 3) Categorization - A group of similar things following the characteristics or qualifications, including using previous knowledge or experience for classifying, distinguishing characteristics of each category could be effectively categorized by students. 4) Expedition - Learners could generate additional ideas by describing things considered, classified or categorized; and extend the connection with forward-anticipated information. 5) Prediction shows that learners could reasonably predict probabilities, judge the facts from personal experience, know the core cause to solve problems, assess the situation and make decisions. 6) Discrimination - students are able to compare events or things to see the similarity or different characteristics of each category (e.g., consistency, conflict, positive effect, negative effect, cause, effect, sequence, and continuity) to provide a clear summary of the characteristics and find the connection points for further data analysis.
-
-
Step 3. Correlation. It is found that the students could relate various information, then rationalize what happened to find the truth and a logical relationship.
-
-
Step 4. Conclusion - Comments could be concluded by summarizing and giving the meaning of data; capture points and have conclusions from those clearly defined.
-
-
Step 5. Utilization - Learners could create results for tangible benefits, gain experience from problems or events.
The result of the evaluation of the analytical thinking after joining in the learning innovation from 153 students with a full score of 60 points is higher than before learning with the overall average score X̅ = 47.35, S.D. = 5.96 compare to X̅ = 21.98, S.D. = 5.43. Therefore, schools could use analytical thinking to help learners study and gather information, consider problems, classify, categorize, expand forecasts, connect, find relationships, draw conclusions and apply at every step. It is interesting that other research also supported to the findings of this study relating to apply analytical thinking as the basis for the design of learning management, encourage and enhance learners' learning innovation (Irwanto et al., 2017; Rery and Erna, 2020; Rengganis and Yulianto, 2018; Rosadi et al., 2018).
5.2.3. Creative thinking
The creative thinking measurement based on the study of Guilford (1967) includes four dimensions:
-
1)
Fluency is the ability to generate ideas for answers or find a variety of solutions to problems fluently, fast, large quantity in limited time with two aspects, (1) Word fluency - students could answer a lot of questions in a limited time by trying to relate to their daily life, (2) Associative fluency - the learners try to connect and compare to find the correlation of the similarity things as many as possible.
-
2)
Flexibility - Different ideas to achieve the same goal could be created by learners; for example, using different fishing equipment to replace the existing one and designing them with appropriate size and quantity.
-
3)
Originality - students have designed fishing equipment based on the principles of scientific calculation.
-
4)
Elaboration. It is found that the students could add the concept of device design to replace what is lacking.
The assessment result of the creative thinking in innovative learning is figured out that after class students get the higher overall score (X̅ = 31.81, S.D. = 3.27) than before learning with X̅ = 10.77, S.D. = 2.17. This study differs from previous research that learning innovation relied on the framework of Guilford (1967) is designed and developed in all four areas. This is a concrete basis for fluency thinking, flexible thinking, initiative, and careful thinking and become the basis for design and learning innovation fostering advanced thinking in schools of MRB, Thailand.
These results seem to support the evaluation of the research of Buzan (2005), Ma and Corter (2019), and Tang (2017), who confirmed that educational institutions need to organize the teaching and learning activity by designing and developing a learning innovation to promote the students’ creativity and research in four dimensions (e.g., fluency, flexibility, originality, and elaboration).
5.2.4. Critical thinking
The basis of Norris and Ennis (1989) is used to measure critical thinking skill based on six steps through in-depth interviews. The results indicated that in every step the students could:
-
-
Step 1. Deductive summary - illustrate the teaching approach and overview of theory.
-
-
Step 2. The meaning - collect data, classify and select the actual data and explain the supporting evidence. When a student faces to a problem situation, he/she can give meaning to what happened in that situation. Besides, they could define the vocabulary clearly, face to the situation and problem in the story.
-
-
Step 3. Consider the credibility of the data source - understand problems and take reliable and appropriate sources of the context, compare the true data, and explain the obtaining process.
-
-
Step 4. Inductive summary - discuss and summarize options for solving problem.
-
-
Step 5. Conclusion by testing, hypothesis and prediction - know how to apply each method to solve the problem and explain the reasons.
-
-
Step 6. Defining and specifying assumptions - identify problems with the given story. When facing with problem situations, students could identify problems and what happened, and able to think of possible answers to that question.
The evaluation of learners' critical thinking by applying the Cornell critical thinking level X pointed out the overall higher score (X̅ = 27.63, S.D. = 2.28) than before learning (X̅ = 11.16, S.D. = 2.10).
The learning innovation has been designed to promote critical thinking and to give opportunities for students to practice thinking and to carry out their solutions. It requires a critical thinking process to apply the design of learning management that is suitable for the context of the learners. This is in line with the research of Miri et al. (2007), Cano and Martinez (1991), Ku and Ho (2010), Lee et al. (2004), Perschbach (2006), Kuhn (1999), Wang et al. (2009), Torres and Cano (1995), and Whittington (2000). Critical thinking could highly foster and develop by using learning materials, such as, skill training, learning on the network, organizing activities or a learning environment promoting critical thinking following the findings in the study of Hurt et al. (2003). In addition, collaborative learning techniques to solve problems are also a method encouraging learners to develop critical thinking.
5.3. The students’ opinions of learning innovation to enhance higher order thinking skills
The learners' opinions of the elements of learning innovation show that the content has the highest value (X̅ = 4.61, S.D. = 0.61), followed by design (X̅ = 4.28, S.D. = 0.69), and multimedia (X̅ = 4.02, S.D. = 0.95). The findings of a detailed analysis of the perspectives are as follows:
5.3.1. The content is interesting and in congruent with the level of the students, and the learning of science subjects
-
-
The content is up-to-date, completed and comprehensive, clear and conducive to study, research and get knowledge, and create easily hierarchical content. Besides, the design of content helps develop learner's knowledge and thinking;
-
-
The language is used compact, hierarchical, easy to understand, and sufficient for learning or building knowledge, and can be used and linked with daily life;
-
-
The format of content presentation is interesting and encourages the learners' interests by using letters, word emphasis, color, and animation;
-
-
Content presentation helps process information easily and learn better;
-
-
The illustrations are consistent and help promote good learning, including real and virtual pictures. However, some contents could not fully cover into all classroom lessons.
5.3.2. The multimedia
It is indicated that a navigation tool has designed to help find information more easily and meet the students' needs. Besides, a constant navigation design also allows easy access and search for information. There is an icon which can convey the meaning of various information sources. It is also linked to allow access to various information, conversations, and learning through Facebook.
In order to convenient access and easy to use, the design of the architecture elements is eye-catching and attractive. It is appropriate and consistent with the content, and boost the learning. Also, the animation helps learners pay attention and promote learning and information processing. The images and text sizes are used in accordance with the content by using appropriate, harmonious, and pay attention colors.
5.3.3. The design
The design is evaluated based on seven aspects as follows:
-
1)
Problem situations are designed according to the theory of information processing by inserting the story into a problem situation, and using conversations causing discrepancies and closing to the real context by creating an animation. It allows learners to control their own learning, and is embedded into the situation, and a real context of the local wisdom; helps build knowledge and encourage learners to connect experiences used in real events, to analyze and ponder the issues they want to find answers. Problem situations also motivate students to think critically the issues that need to be resolved.
-
2)
The learning resources have designed as a library of problems closing to the real context by creating an animation. This design allows students to search for information from various sources.
-
3)
Scaffolding allows research or guide to perform missions.
-
4)
Collaboration supports cooperative learning and working in groups, encourages everyone to participate in learning, to create and exchange ideas and solve problems together by finding possible solutions from a variety of perspectives. It also supports the interaction between learners or experts through Facebook and expands ideas and encourages the learning.
-
5)
The higher order thinking skills are designed to help enhance the thinking process, including problem solving, critical thinking, creative thinking, and critical thinking.
-
6)
Coach - Learners are able to communicate and provide information to boost thinking and find answers, as well as to carry out their learning missions actively. Besides, there are the designs providing guidance, mentoring and giving advices to the learners.
-
7)
Related case allows to see the example cases or how people have done it successfully to use as a guideline for solving different problems.
The findings are found that the design is consistent according to constructivism, and in line with the study results of Pande and Bharathi (2020), Jirasatjanukul and Jeerungsuwan (2018), Pedaste and Sarapuu (2006), and Yaisomboon and In-Udom (2011), who determined that the screen is beautiful, colorful, interesting and comfortable. The characters are appropriate, clear in terms of learning content and learning resources. Besides, it is easy to understand, interesting, adequate content to perform a learning mission. The content can be applied and helps enhance thinking, problem solving, and being up-to-date. This result also consolidates the perspective of Wattanachai et al. (2010) in term of the content of learning have sufficient information for solving problems and can be used in daily life. Furthermore, the media features are designed to help create the understanding and meaning of various sources of information, and search for information at any time by using easy-to-understand languages without translation.
6. Conclusions and recommendation
The findings of this study indicated that the design and development of learning innovation bring benefits for students in junior high schools at five provinces of MRB, Thailand. There are some prominent highlights summarized based on research objectives as follows:
-
(1)
The components of learning innovation are properly designed and applied into learning to enhance the creation of knowledge and high order thinking skills of students at junior high schools;
-
(2)
Students experienced learning innovation have higher average scores than before learning in four skills, namely, problem solving, analytical thinking, creative thinking and critical thinking.
-
(3)
Concerning the students' opinions on learning innovation, they appreciate the content, multimedia and design of learning helping enhance higher order thinking. However, the results of this research cannot completely cover all lessons taught for students.
Thus, some recommendations are suggested for junior high schools, educators, and teachers relied on the highlighted findings:
-
(a)
Educational policy makers should design and issue a general competency framework and national curriculum for junior high schools to promote the development of learning innovation for students;
-
(b)
Educational institutions need to use common framework and standards to integrate and create the curriculum and syllabi enhancing the enhanced thinking;
-
(c)
Teachers could design lessons and apply practical situation in daily life into lectures to stimulate and boost the higher order thinking skills for learners.
The findings of this study have both practical and theoretical implications:
-
-
The results can be used as a basis for designing the learning arrangements enabling learners to use advanced cognitive and thinking skills to solve their problems, and guide the design and development of learning innovations in other contents to enhance higher order thinking skills for learners;
-
-
Help educators, teachers and other stakeholders have the pro-founding understanding of the practical situation of learning innovation and higher order thinking skills of students, then issue holistic solutions to enhance this situation at junior high schools in Thailand.
This study only designs and develops learning innovation to enhance higher order thinking skills for students at five provinces in MRB, Thailand; therefore, the future research should focus on:
-
-
Studying the social and educational environment, etc. regarding the higher order thinking skills of learners who integrate local wisdom culture in accordance with the Thailand context;
-
-
The cognitive process of the learner, such as the cognitive load, scientific thinking, change of concept, and mental representation with learning innovation;
-
-
The impact of learning innovation components in enhancing higher order thinking skill for students in Thailand junior high schools.
Declarations
Author contribution statement
Parama Kwangmuang: Conceived and designed the experiments; Performed the experiments; Analyzed and interpreted the data; Contributed reagents, materials, analysis tools or data; Wrote the paper.
Suwisa Jarutkamolpong, Watcharee Sangboonraung, Srisuda Daungtod: Conceived and designed the experiments; Performed the experiments; Analyzed and interpreted the data; Contributed reagents, materials, analysis tools or data.
Funding statement
This work was supported by The National Research Council of Thailand.
Data availability statement
Data included in article/supplementary material/referenced in article.
Declaration of interests statement
The authors declare no conflict of interest.
Additional information
No additional information is available for this paper.
References
- Ahmad S., Prahmana R.C.I., Kenedi A.K., Helsa Y., Arianil Y., Zainil M. The instruments of higher order thinking skills. J. Phys. Conf. 2017;943(1) [Google Scholar]
- Apino E., Retnawati H. Developing instructional design to improve mathematical higher order thinking skills of students. J. Phys. Conf. 2017;812(1) [Google Scholar]
- Ardianto D., Rubini B. Comparison of students' scientific literacy in integrated science learning through model of guided discovery and problem-based learning. Jurnal Pendidikan IPA Indonesia. 2016;5(1):31–37. [Google Scholar]
- Akarawang C., Kidrakran P., Nuangchalerm P. Enhancing ICT competency for teachers in the Thailand basic education system. Int. Educ. Stud. 2015;8(6):1–8. [Google Scholar]
- Areekul C. The development of learning innovation as board game for enhanceing the active citizen of the undergraduate student. Panna Panithan Journal. 2020;5(2):137–150. [Google Scholar]
- Asanok M., Chookhampaeng C. Coaching and mentoring model based on teachers' professional development for enhancing their teaching competency in schools (Thailand) using video tape. Educ. Res. Rev. 2016;11(4):134–140. [Google Scholar]
- Bureau of International Cooperation Thailand. Amarin Printing & Publishing Public Company Limited; Bangkok: 2011. Education for ASEAN: One Vision, One Identity, One Community. [Google Scholar]
- Buzan T. Thorsons; London: 2005. Mind Map: the Ultimate Thinking Tool. [Google Scholar]
- Cano J., Martinez C. The relationship between cognitive performance and critical thinking abilities among selected agricultural education students. J. Agric. Educ. 1991;32(1):24–29. [Google Scholar]
- Chaijaroen S. Khon Kean: Anna offset; 2014. Instructional Design: Principles and Theories to Practices. [Google Scholar]
- Collins A., Brown J.S., Newman S.E. Cognitive apprenticeship: teaching the craft of reading, writing and mathematics. Thinking: The Journal of Philosophy for Children. 1988;8(1):2–10. [Google Scholar]
- Dillon J., Scott W. Perspectives on environmental education-related research in science education. Int. J. Sci. Educ. 2002;24(11):1111–1117. [Google Scholar]
- Foxon T., Pearson P. Overcoming barriers to innovation and diffusion of cleaner technologies: some features of a sustainable innovation policy regime. J. Clean. Prod. 2008;16(1):148–161. [Google Scholar]
- Garrison D.R., Vaughan N.D. Institutional change and leadership associated with blended learning innovation: two case studies. Internet High Educ. 2013;18:24–28. [Google Scholar]
- Garner D.L. University of Nevada; United States: 2012. The Acquisition of Cultural Competence: A Phenomenological Inquiry Highlighting the Processes, Challenges and Triumphs of Counselor Education Students. [Google Scholar]
- Guilford J.P. Creativity: yesterday, today and tomorrow. J. Creativ. Behav. 1967;1(1):3–14. [Google Scholar]
- Hadjipanayi C., Michael-Grigoriou D. Conceptual knowledge and sensitization on Asperger's syndrome based on the constructivist approach through virtual reality. Heliyon. 2020;6(6) doi: 10.1016/j.heliyon.2020.e04145. https://reader.elsevier.com/reader/sd/pii/S2405844020309890?token76837F781171BD674ABA8165655726368D66EC4C92BC0FF103D938F861EA9262C7ABF54AB697B1DB4C235FD66752CF80&originRegioneu-west-1&originCreation20210502160821 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hannafin R.D. Annual Meeting of the American Educational Research Association, Montreal, Canada. 1999. Achievement and other differences in positivist vs. open-ended learning environments. [Google Scholar]
- Heong Y.M., Othman W.B., Yunos J.B.M., Kiong T.T., Hassan R.B., Mohamad M.M.B. The level of marzano higher order thinking skills among technical education students. Int. J. Soc. Sci. Humanit. 2011;1(2):121–125. [Google Scholar]
- Hernandez-Serrano J., Jonassen D.H. The effects of case libraries on problem solving. J. Comput. Assist. Learn. 2003;19(1):103–114. [Google Scholar]
- Herrington J., Oliver R. Multimedia, magic and the way students respond to a situated learning environment. Australas. J. Educ. Technol. 1997;13(2):127–143. [Google Scholar]
- Hew K.F., Knapczyk D. Analysis of ill-structured problem solving, mentoring functions, and perceptions of practicum teachers and mentors toward online mentoring in a field-based practicum. Instr. Sci. 2007;35(1):1–40. [Google Scholar]
- Hong Y.Y., Morris M.W., Chiu C.Y., Benet-Martinez V. Multicultural minds: a dynamic constructivist approach to culture and cognition. Am. Psychol. 2000;55(7):709–720. doi: 10.1037//0003-066x.55.7.709. [DOI] [PubMed] [Google Scholar]
- Hurt J.A., Thibodeau S.A., Hirsh A.S., Pabo C.O., Joung J.K. Highly specific zinc finger proteins obtained by directed domain shuffling and cell-based selection. Proc. Natl. Acad. Sci. Unit. States Am. 2003;100(21):12271–12276. doi: 10.1073/pnas.2135381100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hwang G.J., Lai C.L., Liang J.C., Chu H.C., Tsai C.C. A long-term experiment to investigate the relationships between high school students’ perceptions of mobile learning and peer interaction and higher-order thinking tendencies. Educ. Technol. Res. Dev. 2018;66(1):75–93. [Google Scholar]
- Irwanto, Rohaeti E., Widjajanti E., Suyanta . Vol. 1868. 2017. Students’ science process skill and analytical thinking ability in chemistry learning. (AIP Conference Proceedings of Research, Implementation, and Education of Mathematics and Science). No. 1. [Google Scholar]
- Jarutkamolpong S., Kwangmuang P., Sangboonraung W., Daungtod S. Synthesizing innovative models of learning that promote analytical thinking skills of students at basic education level. Journal of Humanities and Social Sciences. 2018;8(3):43–51. Nakhon Phanom University. [Google Scholar]
- Jirasatjanukul K., Jeerungsuwan N. The design of an instructional model based on connectivism and constructivism to create innovation in real world experience. Int. Educ. Stud. 2018;11(3):12–17. [Google Scholar]
- Jonassen D.H. Toward a design theory of problem solving. Educ. Technol. Res. Dev. 2000;48(4):63–85. [Google Scholar]
- Jufrida J., Basuki F.R., Kurniawan W., Pangestu M.D., Fitaloka O. Scientific literacy and science learning achievement at junior high school. Int. J. Eval. Res. Educ. 2019;8(4):630–636. [Google Scholar]
- Kim J., Maloney E.J. JHU Press; Maryland: 2020. Learning Innovation and the Future of Higher Education. [Google Scholar]
- Klausmeier H.J. Concept learning and concept teaching. Educ. Psychol. 1992;27(3):267–286. [Google Scholar]
- Ku K.Y., Ho I.T. Metacognitive strategies that enhance critical thinking. Metacognition and learning. 2010;5(3):251–267. [Google Scholar]
- Kuhn D. A developmental model of critical thinking. Educ. Res. 1999;28(2):16–46. [Google Scholar]
- Kwangmuang P., Chaijaroen S. The result of synthesis framework of learning environment model to enhance information processing for the learners integrating between pedagogy and neuroscience. Panyapiwat Journal. 2016;8(3):188–201. [Google Scholar]
- Lee J.T., Connor-Appleton S., Haq A.U., Bailey C.A., Cartwright A.L. Quantitative measurement of negligible trypsin inhibitor activity and nutrient analysis of guar meal fractions. J. Agric. Food Chem. 2004;52(21):6492–6495. doi: 10.1021/jf049674+. [DOI] [PubMed] [Google Scholar]
- Lee C.B., Hanham J., Kannangara K., Qi J. Exploring user experience of digital pen and tablet technology for learning chemistry: applying an activity theory lens. Heliyon. 2021;7(1) doi: 10.1016/j.heliyon.2021.e06020. https://www.sciencedirect.com/science/article/pii/S2405844021001250 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lewis A., Smith D. Defining higher order thinking. Theory Into Pract. 1993;32(3):131–137. [Google Scholar]
- Ma Y., Corter J.E. The effect of manipulating group task orientation and support for innovation on collaborative creativity in an educational setting. Think. Skills Creativ. 2019;33:100587. [Google Scholar]
- Marshall J.C., Horton R.M. The relationship of teacher-facilitated, inquiry-based instruction to student higher-order thinking. Sch. Sci. Math. 2011;111(3):93–101. [Google Scholar]
- Miri B., David B.C., Uri Z. Purposely teaching for the promotion of higher-order thinking skills: a case of critical thinking. Res. Sci. Educ. 2007;37(4):353–369. [Google Scholar]
- Mooney G.A., Fewtrell R.F., Bligh J.G. Cognitive process modelling: computer tools for creative thinking and managing learning. Med. Teach. 1999;21(3):277–280. [Google Scholar]
- Naluan N., Phatthalung N.N., Kattiyamarn W. Vol. 10. 2013. The results of e-learning cycle model with questioning technique on analysis thinking abilities and scientific learning achievement of prathomsuksa 5 students; p. 2013. (Research for Social Development Thailand, Research Presented at Four Technical Conferences London on May). [Google Scholar]
- Norris S.P., Ennis R.H. Midwest Publications; California: 1989. Evaluating Critical Thinking. The Practitioners' Guide to Teaching Thinking Series. [Google Scholar]
- Nurlaely N., Permanasari A., Riandi R. Student’s STEM literacy in biotechnology learning at junior high school. J. Phys. Conf. 2017;895(1):1–6. [Google Scholar]
- OECD . Excellence and Equity in Education. OECD Publishing; Paris: 2016. PISA 2015 Results (Volume I) [Google Scholar]
- OECD . OECD Publishing; Paris: 2019. PISA 2018 Results (Volume I): what Students Know and Can Do. [Google Scholar]
- Office of the National Economic and Social Development Council . Bangkok: Office; 2016. The 10th National Economic and Social Development Plan (2017-2021)https://www.nesdc.go.th/nesdb_en/ewt_w3c/ewt_dl_link.php?filenamedevelop_issue&nid4345 [Google Scholar]
- Pande M., Bharathi S.V. Theoretical foundations of design thinking–A constructivism learning approach to design thinking. Think. Skills Creativ. 2020;36:100637. [Google Scholar]
- Pedaste M., Sarapuu T. Developing an effective support system for inquiry learning in a web-based environment. J. Comput. Assist. Learn. 2006;22(1):47–62. [Google Scholar]
- Perschbach J.W. Nova Southeastern University; United States: 2006. Blogging: an Inquiry into the Efficacy of a Web-Based Technology for Student Reflection in Community College Computer Science Programs. [Google Scholar]
- Phudthonamochai C. Creating and developing learning innovations using multimedia integrated with online social networks. Journal of MCU peace studies. 2021;9(1):215–255. [Google Scholar]
- Piaget J. W. W. Norton; New York: 1963. The Origins of Intelligence in Children. [Google Scholar]
- Plan Q.E. 2014. Improving Students’ Higher-Order Thinking Competencies, Including Critical Evaluation, Creative Thinking, and Reflection on Their Own Thinking.https://think.dasa.ncsu.edu/wp-content/uploads/sites/20/2015/04/qep-final.pdf [Google Scholar]
- Prahani B., Jatmiko B., Hariadi B., Sunarto D., Sagirani T., Amelia T., Lemantara J. Blended Web Mobile Learning (BWML) model to improve students’ higher order thinking skills. International Journal of Emerging Technologies in Learning (iJET) 2020;15(11):42–55. [Google Scholar]
- Ramirez R.P.B., Ganaden M.S. Creative activities and students’ higher order thinking skills. Educ. Q. 2008;66(1):22–33. [Google Scholar]
- Rengganis A.P., Yulianto A. Analysis of students’ analytical thinking skill in electromagnetic induction concept using mini tesla coil. Physics Communication. 2018;2(2):130–140. [Google Scholar]
- Rery R.U., Erna M. Validity and reliability of assessment instruments for analytical thinking ability and chemical literacy in the colligative properties. J. Phys. Conf. 2020;1655(1) [Google Scholar]
- Retnawati H., Djidu H., Kartianom A., Anazifa R.D. Teachers’ knowledge about higher-order thinking skills and its learning strategy. Probl. Educ. 21st Century. 2018;76(2):215–230. [Google Scholar]
- Richey R.C., Klein J.D. 2007. Design and Development Research. Mahwah: New Jersey. [Google Scholar]
- Rosadi I., Maridi M., Sunarno W. The effectiveness of process-oriented guided inquiry learning to improve students’ analytical thinking skills on excretory system topic. Biosaintifika: Journal of Biology & Biology Education. 2018;10(3):684–690. [Google Scholar]
- Rusilowati A., Linuwih S., Nugroho S.A. The profile of science literacy attitudes of junior high school students in Purbalingga. Proceeding of ICMSE. 2017;4(1):183–189. [Google Scholar]
- Saido G.M., Siraj S., Nordin A.B.B., Al_Amedy O.S. Higher order thinking skills among secondary school students in science learning. MOJES: Malays. Online J. Educ. Sci. 2018;3(3):13–20. [Google Scholar]
- Sangboonraung W., Kwangmuang P., Jarutkamolpong S., Daungtod S. Synthesis of conceptual frameworks for designing and development of learning innovationspromoting critical thinking skills in 21th century learning on greater Mekong educational service area. J. Educ. 2019;16(1):85–94. Rajabhat Maha Sarakham University. [Google Scholar]
- Shah R.K. Effective constructivist teaching learning in the classroom. Online Submission. 2019;7(4):1–13. [Google Scholar]
- Smith D., Hardaker G. E-learning innovation through the implementation of an internet supported learning environment. Journal of Educational Technology & Society. 2000;3(3):422–432. [Google Scholar]
- Strycker J. K-12 art teacher technology use and preparation. Heliyon. 2020;6(7) doi: 10.1016/j.heliyon.2020.e04358. https://www.sciencedirect.com/science/article/pii/S2405844020312020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sulaiman T., Muniyan V., Madhvan D., Hasan R., Rahim S.S.A. Implementation of higher order thinking skills in teaching of science: a case study in Malaysia. International research journal of education and sciences (IRJES) 2017;1(1):2550–2558. [Google Scholar]
- Tang M. Creativity and innovation: basic concepts and approaches. In: Tang L.M., Werner C., editors. Handbook of the Management of Creativity and Innovation: Theory and Practice. World Scientific Publishing; Singapore: 2017. pp. 3–32. [Google Scholar]
- Torres R.M., Cano J. Critical thinking as influenced by learning style. J. Agric. Educ. 1995;36:55–63. [Google Scholar]
- Uribe D., Klein J.D., Sullivan H. The effect of computer-mediated collaborative learning on solving III-defined problems. Educ. Technol. Res. Dev. 2003;51(1):5–19. [Google Scholar]
- Vygotsky L.S. Socio-cultural theory. Mind Soc. 1978;6:52–58. [Google Scholar]
- Wang Y.H. The multicultural science literacy of science teachers in Taiwan. Int. J. Asian Soc. Sci. 2013;3(9):2052–2059. [Google Scholar]
- Wang M., Derry S., Ge X. Guest editorial: fostering deep learning in problem-solving contexts with the support of technology. Journal of Educational Technology & Society. 2017;20(4):162–165. [Google Scholar]
- Wang Q., Woo H.L., Zhao J. Investigating critical thinking and knowledge construction in an interactive learning environment. Interact. Learn. Environ. 2009;17(1):95–104. [Google Scholar]
- Wattanachai S., Chaijaroen S., Ponimdang C. Design and development of constructivist web-based learning environment model to foster problem solving and transfer of learning. Academic Services Journal. 2010;21(3):46–67. [Google Scholar]
- White B.Y., Shimoda T.A., Frederiksen J.R. Enabling students to construct theories of collaborative inquiry and reflective learning: computer support for metacognitive development. Int. J. Artif. Intell. Educ. 1999;10:151–182. [Google Scholar]
- Whittington M.D. Assessing academic challenges for their contribution to cognitive development. J. Agric. Educ. 2000;41:114–122. [Google Scholar]
- Winarsih D. Vol. 2. Maret University; 2018. The SOI model of learning: bridging cognitive processes of knowledge construction in disruptive era. (Science, Engineering, Education, and Development Studies (SEEDS): Conference Series, Faculty of Teacher Training and Education Sebelas). No. 1. [Google Scholar]
- Xu Z., Shi Y. Application of constructivist theory in flipped classroom—take college English teaching as a case study. Theor. Pract. Lang. Stud. 2018;8(7):880–887. [Google Scholar]
- Yaisomboon W., In-Udom W. Effects of web-based instruction upon analytical thinking development for matthayomsuksa II students. J. Educ. 2011;5(2):107–112. Khon Kaen University (Graduate Studies Research) [Google Scholar]
- Zhang J. Technology-supported learning innovation in cultural contexts. Educ. Technol. Res. Dev. 2010;58(2):229–243. [Google Scholar]
- Zhang J., Hong H.-Y., Teo C., Scardamalia M., Morley E. Paper Presented at the Annual Meeting of American Educational Research Association; New York: 2008. Constantly Going Deeper: Knowledge Building Innovation in an Elementary Professional Community. [Google Scholar]
- Zohar A., Dori Y.J. Higher order thinking skills and low-achieving students: are they mutually exclusive? J. Learn. Sci. 2003;12(2):145–181. [Google Scholar]
- Radcliffe D. Learning spaces in higher education: Positive outcomes by design. Proceedings of the Next Generation Learning Spaces 2008 Colloquium, University of Queensland, Brisbane. 2009. A pedagogy-space-technology (PST) framework for designing and evaluating learning places; pp. 11–16. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data included in article/supplementary material/referenced in article.








