Abstract
Nowadays, education is going through a moment of methodological transformation. Two of the active methodologies with excellent projection within the educational field are gamification and flipped learning. This study analyzed the methodological contrast between gamification and flipped learning in the subject of Physical Education in three different educational stages to determine the most influential methodology in the training process. Research design was a quasi-experimental research with a sample of 356 students in Spain. Data collection took place with a questionnaire. The results show that gamification as a teaching and learning methodology is better valued at an early stage, while the more aged participants better value the flipped learning methodology. Both methodologies have shown great potential in the development of educational processes in Physical Education. Gamification indeed seems to have positive effects on students from the lower stages. On the other hand, flipped learning produces positive effects on the group stages, pre-university students.
Keywords: Active methodologies, Teaching innovation, Academic improvements, Physical education
Active methodologies, teaching innovation, academic improvements, physical education.
1. Introduction
Teachers are responsible for selecting the teaching methodologies they use in their classes. The role that these professionals play in the learning process is essential, especially if some of these methodologies use technology (Gil-Flores et al., 2017). Today's active methodologies have broken into the educational system with significant impact (Bernal-Gonzalez and Martinez-Dueñas, 2017). According to the methodology, this type of design provides students with content in a motivating way, where students have to actively build their own learning. This provokes meaningful learning that is remembered and excites the students, producing real learning (Ayén, 2017). All of this is impossible if teachers do not have sufficient training and mastery of the methodology they want to use (Oliveira et al., 2019).
Beyond motivation, the use of this type of methodology in the classroom has different benefits, such as the development of creative thinking (Bezanilla et al., 2019), fostering interactions between students (Flores-Fonseca and Gomez, 2017), cooperation development (Sein-Echaluce et al., 2019), or increased student engagement with their learning process (Montrezor, 2016). Within this scenario, the most commonly used active methodologies nowadays are gamification and flipped learning (Sein-Echaluce et al., 2019).
Gamification applies different learning elements, such as game designs or structures (Attali and Arieli-Attali, 2015). This methodology is based on the fact that learning and retaining information through different activities increases when students have fun during their development (Molina et al., 2017). As an active methodology, gamification has shown to foster a high incrementation in the motivation and development of cooperative work (Lopez-Quintero, Pontes-Pedrajas and Varo-Martínez, 2019), so necessary in the teaching-learning processes, for both the students and the teachers in their teaching work (Lee and Hammer, 2011). These elements, together with the development of a classroom climate (Perez-López and Rivera, 2017), are part of Physical Education classes, according to current trends (Ferriz-Valero et al., 2020; López-Belmonte et al., 2020).
This issue is relevant and is reflected in current studies, which show the positive effects of gamified experiences within the field of physical education (González et al., 2018; Quintas et al., 2020), whose application covers a wide range of possibilities. Gamification can be developed, utilizing various technological resources or didactic resources. This means that the range of gamification possibilities is broad and has various application forms (White Shellenbarger, 2018).
On the other hand, flipped learning consists of a mixed-method, which alternates digital and face-to-face training as indicated by Lee et al. (2017), where the teacher and student roles are exchanged (Mortensen and Nicholson, 2015). Through technology (Froehlich, 2018), teachers can create audiovisual material that students have to watch before the lesson (Turan and Akdag-Cimen, 2020), and afterward, in class, they work on the content from a different perspective than a traditional one (Long et al., 2017).
Flipped learning methodology can ease the teacher's work because the student can plan and self-regulate their learning (Chaves-Barboza et al., 2016). Due to this, the teacher can allocate more time in the classroom to guide the student, resolve doubts, and attend to the students' educational needs in a more individualized way. This is favored as explaining the content has been carried out in other learning spaces beforehand (Santiago and Bergmann, 2018). Therefore, this type of active methodology allows the student to work autonomously and actively during their learning (Molina-Aventosa et al., 2015). It also improves all of the associated educational processes, such as motivation, time in class, or the collaboration between students (Awidi and Paynter, 2019; Moreno-Guerrero et al., 2020). This set of possibilities makes the flipped classroom a methodology with great potential for physical education teachers (Sargent and Casey, 2020).
These new methodological trends have increased innovative practice in Physical Education, as it has been recommended by several studies on the matter, where the different academic indicators analyzed are favored (Wyant and Baek, 2019). For this reason, in relation to innovation, Physical Education is a subject that is being studied due to the improvements and potential it produces in student's formative development.
There are also studies where the teaching and learning processes have been developed and applied using a mix of the flipped learning method and gamification (Huang and Guo, 2019; Kwan and Foon, 2020; Segura-Robles et al., 2020). These studies agree that those students who have received a game-based teaching method utilizing invested learning improved their academic performance, besides obtaining better benefits in several dimensions of studies, such as motivation, the interaction between members of the pedagogical act, and problem-solving.
2. Study objective and research questions
Gamification and flipped learning and, what has been exposed in the scientific literature of recent years, have proven to be adequate instructional mechanisms to improve teaching and learning environments. In this sense, the scientific community that has developed studies on both training methodologies has revealed how these training methods, from their idiosyncrasy and their way of imparting and working on the contents, have turned out to be successful and influential in improving learning. An improvement occurs in different academic processes and factors, such as attitudinal, psychosocial, and student performance (Gómez-Carrasco et al., 2020; Parra-Gonzalez et al., 2020).
This study aimed to make a methodological contrast between gamification and flipped learning in the subject of Physical Education in three different educational stages (Primary Education, Secondary Education, and Baccalaureate), with the main aim of determining the most incidental training methodologies in the teaching and learning process. This general objective was broken down into different RQ (Research Questions):
-
•
RQ1: Does the training methodology influence the student's motivation?
-
•
RQ2: Does the training methodology influence the interaction between the students and the teacher?
-
•
RQ3: Does the training methodology used in the interaction with the students influence the didactic contents?
-
•
RQ4: Does the training methodology influence the interaction between students?
-
•
RQ5: Does the training methodology influence the autonomy of the students?
-
•
RQ6: Does the training methodology aid in the collaboration of the student's influence?
-
•
RQ7: Does the training methodology deepen the level of the content influence?
-
•
RQ8: Does the training methodology aid with the problem-solving of the student's influence?
-
•
RQ9: Does the training methodology have an influence on class-time with the students?
-
•
RQ10: Does the training methodology influence the ratings obtained by the students?
3. Materials and methods
3.1. Research design
The study has been developed using a quantitative methodology through a quasi-experimental research design, based on the experts’ research premises in this type of study (Hernández-Sampieri et al., 2014; Privitera, 2020). This kind of design involved obtaining a pre-test measure of prior interests, followed by a post-test measure after treatment occurs (Knapp, 2016; Salkind, 2010).
The nature of this type of research required the articulation of two study groups (control and experimental). The control group (CG) carried out a formative action through gamification, while the experimental group (EG) used flipped learning for this purpose (Figure 1). Thus, two study variables were established, an independent one that focused on the type of methodology used in students' training and a dependent variable that focused on the impact obtained in the different dimensions established in the research. When the methodological experimentation commenced, only post-test measurement was obtained to the end of the instruction. The selected groups were homogeneous regarding the sex of the students and the number of students. The two teachers who participated in the experience have training in teaching innovation and are specialists in the methodology they carry out.
Similarly, other published studies have been taken as a reference when carrying out a research process validated by the scientific community (Corujo-Vélez, Gómez del Castillo and Merla-González, 2020; Marín-Marín et al., 2020).
3.2. Participants
The sample obtained in this study was 356 Spanish students, coming from different educational stages (fourth level of Primary Education, aged between 9 and 10 = 100; first level of Secondary Education, aged between 12 and 13 = 118; first level of Baccalaureate, aged between 16 and 17 = 138). Four classes were chosen from both Primary and Secondary Education and from Baccalaureate, five classes were chosen. These students, as a whole, made up the groups presented in Table 1. Intentional sampling was used to select participants, justified in the ease of access to the sample, and collaboration of the teachers who carried out the training phase.
Table 1.
Group | n | Composition | Pretest | Treatment | Post-test |
---|---|---|---|---|---|
1- Control | 50 | Natural | - | G | O1 |
2- Experimental | 50 | Natural | - | FL | O2 |
3- Control | 59 | Natural | - | G | O3 |
4- Experimental | 59 | Natural | - | FL | O4 |
5- Control | 70 | Natural | - | G | O5 |
6- Experimental | 68 | Natural | - | FL | O6 |
Note: Gamification (G); Flipped learning (FL).
Although this type of sampling may not represent large populations, it is useful to provide the authors with previous results (Etikan, 2016). The sample size was adequate for this type of study in the field of education, as it is exposed in other reported studies, and does not suppose a limitation for its approach (Chou and Feng, 2019).
The sample is comprised of men (42.98%) and women (57.02%), with an average age of between 13 and 14 years (SD = 3.21). Two groups of students was created (Experimental gropup and control group), and the methodological treatment (gamification and flipped learning) was determined randomly; the control group was associated with gamification and the experimental group with flipped learning.
3.3. Study dimensions
To better understand this study's results, different dimensions were established in the research, which has been analyzed and presented (Santiago and Bergmann, 2018). These dimensions were selected from studies presented in this work, and methodological contrasts were carried out where the approaches, such as inverted learning and gamification, have intervened:
-
•
Socio-Educational: Caters socio educational variables as age, course, teaching methodology.
-
•
Motivation: Denotes the motivation levels from the students during the formative action.
-
•
Interactions: Denotes the students' interactions and may be of different types (with the teacher, with the content, and between the different students).
-
•
Autonomy: Addresses the level of autonomy developed by the students during the instructional process.
-
•
Collaboration: Addresses the level of collaboration and teamwork carried out by the students during the teaching and learning phase.
-
•
Deepening In The Contents: Attends to the level of treatment and the projection of the content in the teaching and learning process.
-
•
Problem-Solving: Attends to the students' decisive competence when faced with different problems in the training practice.
-
•
Class Time: Attends to the time used by the students during the development of the training action.
-
•
Ratings: Attends to the ratings reached by the students in the different tasks and assessment tests.
-
•
Teacher Ratings: Attends to the teacher's ratings to compare with the ratings reported by the student.
3.4. Instrument
Data collection was carried out through an ad hoc questionnaire. This questionnaire was derived from other instruments that report on the matter's state (Discroll, 2012; Santiago and Bergmann, 2018). Eight experts group in innovative methodologies analyzed the questionnaire through Delphi method. These judges offered feedback to optimize the questionnaire and revealed a positive opinion of it (M = 4.82; SD = 0.36; min = 1; max = 6). All of these observations were analyzed using the Kappa of Fleiss (K) and W of Kendall (W) statistics, which revealed agreement and adequacy of the guidelines and comments from the specialists (K = 0.84; W = 0.87). The instrument was then subjected to quantitative validation by exploratory factor analysis with the principal component's method. The sphericity Bartlett's test revealed dependency between the study variables (2148.25; p < 0.001), and the KMO (0.83) test reflected adequate adequacy of the sample. Furthermore, the designed questionnaire turned out to be reliable after the tests were carried out (Cronbach's alpha = 0.86; Composite reliability = 0.84; Average variance extracted = 0.82). Because the sample exceeded 50 participants, normality was assumed (Ghasemi &and Zahediasl, 2012; Pallant, 2003).
3.5. Procedure
In this study, as a treatment to determine the previously discussed models’ effectiveness, a didactic unit of eight sessions was developed. This unit was carried out in the subject of Physical Education, as this subject is assuming a fundamental role for the students' integral development (Sargent and Casey, 2020; Wyant and Baek, 2019). In this sense, Physical Education has undergone a methodological change in recent years. This is verified by the different active methodologies that are being carried out to deliver the content (Hinojo-Lucena et al., 2018). In turn, this subject is leaving behind traditional methods characterized by individual and purely physical work (Segura-Robles et al., 2020; Xiang et al., 2020).
Specifically, the didactic unit carried out encompassed corporal expression contents (the body, the movement, the rhythm, the dance, choreographic compositions). Regarding the activities carried out, each control group performed collaborative games based on problem-solving through different escape room-type dynamics.
This was based on a story told by a teacher in order to involve the students. This story had a series of challenges and missions that needed to be carried out to achieve badges, which would allow them to pass through various phases of the game and reach the final test. Passing the final test would mean reaching the didactic objectives formulated in the unit and, therefore, winning the challenge.
On the other hand, the experimental group's training activities had a hybrid character based on flipped learning. This was developed both in the digital environment, through a content management platform, and in-person in the educational center's different learning spaces. Previously, the students viewed the audiovisual material provided by the teacher. This material contained dances with different rhythms and musical styles. Then, the students carried out the activities and dynamics already shown in the videos in the classroom. In both cases, the teacher's role in question was focused on guiding and orienting the students during the different training tasks carried out and providing timely feedback that helped facilitate the students learning process. All of this was thanks to the autonomous work developed by the students. In the case of gamification, by solving problems by themselves. In flipped learning, thanks to the visualization of the contents before the face-to-face session, it allowed the students to come to class with familiar contents. Once the didactic unit was completed, the students filled out the questionnaire, and the collected data was then statistically analyzed to achieve and answer both the objective formulated in the research and the different questions derived.
3.6. Ethical considerations
Within this research, all of the principles and criteria were established using the Code of Good Research Practices, as established by the Declaration of Helsinki. Similarly, all participants were aware of the study objectives, informed consent was obtained, and their anonymity was preserved. Likewise, a regional Ethics Committee (BDS-ABL-20) made up of researchers external to the research approved the study.
3.7. Data analysis
For statistical analysis, SPSS (v.25) package was utilized. This tool is the most used software in Social Sciences, which provides a good interface to calculate some basic stadistics as Mean (M), standard deviation (SD), skewness (Skw) and kurtosis (Kme) to know the distribution of a data matrix. Student-t test (tn1 + n2-2), test was carried out to compare means between experimental and control group. To detect size of effect of significant results Cohen's d was applied. A cut-off standar of p < 0.05 was used to stablish significate differences.
4. Results
On the basis of the descriptive analysis carried out, it can be determined that there is a disparity in the responses, depending on the stage of development, and showing in all dimensions a normal distribution of response (Jöreskog and Moustaki, 2001). In Primary Education, the results obtained by pupils within the control group showed higher values for most dimensions than those obtained by pupils within the experimental group. Specifically, the best-valued dimensions, especially in the control group, are those of motivation, student-student, autonomy, resolutions, and ratings, where they exceeded in all cases the 3 points of average. Although the ratings are medium-high in the rest of the dimensions, they do not exceed the 3 points of average, both in the control and experimental groups. The standard deviation shows an equal response distribution by the students in all dimensions of the research. Kurtosis in the control group is variable since, in most dimensions, a platykurtic distribution is shown, except in autonomy and ratings, where the distribution is leptokurtic, and in collaboration and motivation, where the distribution is mesokurtic. In experimental group, kurtosis is platykurtic(Table 2).
Table 2.
Dimensions | Likert Scale n (%) |
Parameters |
|||||||
---|---|---|---|---|---|---|---|---|---|
None | Few | Enough | Completely | M | SD | Skw | Kme | ||
Control group | Motivation | 2(4) | 8(16) | 16(32) | 24(48) | 3.24 | .870 | -.884 | -.085 |
Teacher-student | 5(10) | 14(28) | 16(32) | 15(30) | 2.82 | .983 | -.293 | -.965 | |
Student-content | 3(6) | 14(28) | 17(34) | 16(32) | 2.92 | .922 | -.324 | -.879 | |
Student-student | 3(6) | 8(16) | 18(36) | 21(42) | 3.14 | .904 | -.805 | -.152 | |
Autonomy | 2(4) | 7(14) | 21(42) | 20(40) | 3.18 | .825 | -.806 | .178 | |
Collaboration | 3(6) | 7(14) | 17(34) | 23(40) | 3.20 | .904 | -.934 | .069 | |
Deepening | 2(4) | 12(24) | 24(48) | 12(24) | 2.92 | .804 | -.342 | -.317 | |
Resolution | 1(2) | 8(16) | 14(28) | 27(54) | 3.34 | .823 | -.946 | -.127 | |
Classtime | 2(4) | 14(28) | 22(44) | 12(24) | 2.88 | .824 | -.225 | -.579 | |
Ratingsa | 2(4) | 7(14) | 16(32) | 25(50) | 3.28 | .858 | -.989 | .196 | |
Teacher-ratingsa | 3(6) | 11(22) | 21(42) | 15(30) | 2.96 | .880 | -.482 | -.452 | |
Experimental group | Motivation | 4(8) | 15(30) | 17(34) | 14(28) | 2.82 | .941 | -.237 | -.902 |
Teacher-student | 6(12) | 16(32) | 16(32) | 12(24) | 2.68 | .978 | -.122 | -.980 | |
Student-content | 6(12) | 14(28) | 19(38) | 11(22) | 2.70 | .953 | -.236 | -.814 | |
Student-student | 6(12) | 14(28) | 20(40) | 10(20) | 2.68 | .935 | -.239 | -.742 | |
Autonomy | 5(10) | 14(28) | 19(38) | 12(24) | 2.76 | .938 | -.264 | -.778 | |
Collaboration | 5(10) | 14(28) | 19(38) | 12(24) | 2.76 | .938 | -.264 | -.778 | |
Deepening | 5(10) | 11(22) | 24(48) | 10(20) | 2.78 | .887 | -.457 | -.374 | |
Resolution | 5(10) | 12(24) | 22(44) | 11(22) | 2.78 | .910 | -.386 | -.534 | |
Classtime | 4(8) | 16(32) | 20(40) | 10(20) | 2.72 | .882 | -.153 | -.661 | |
Ratingsa | 5(10) | 13(26) | 20(40) | 12(24) | 2.78 | .932 | -.324 | -.669 | |
Teacher-ratingsa | 4(8) | 14(28) | 21(42) | 11(22) | 2.78 | .887 | -.274 | -.597 |
p < 0.05 was used (None: 1–4.9; Few: 5–5.9; Enough: 6–8.9; Completely: 9–10).
In the Secondary Education students, the means presented were, in general, slightly lower than those shown by the Primary Education students. In this case, the evaluations' mean is located in both the experimental and control groups, over 2.5. The difference is marked by the control group's dimensions, specifically motivation, student-student, autonomy, collaboration, and resolution, and where they are located, approximately, in the mean line of 3. Kurtosis, in all dimensions of the study, is platykurtic (Table 3).
Table 3.
Dimensions | Likert Scale n (%) |
Parameters |
|||||||
---|---|---|---|---|---|---|---|---|---|
None | Few | Enough | Completely | M | SD | Skw | Kme | ||
Control group | Motivation | 3(5.1) | 19(32.2) | 20(33.9) | 17(28.8) | 2.86 | .899 | -.166 | -.966 |
Teacher-student | 7(11.9) | 21(35.6) | 24(40.7) | 7(11.9) | 2.53 | .858 | -.081 | -.559 | |
Student-content | 5(8.5) | 24(40.7) | 21(35.6) | 9(15.3) | 2.58 | .855 | .097 | -.616 | |
Student-student | 3(5.1) | 17(28.8) | 19(32.2) | 20(33.9) | 2.95 | .918 | -.313 | -.965 | |
Autonomy | 3(5.1) | 15(5.4) | 20(33.9) | 21(35.6) | 3.00 | .910 | -.427 | -.817 | |
Collaboration | 3(5.1) | 13(22) | 22(37.7) | 21(35.6) | 3.03 | .890 | -.524 | -.586 | |
Deepening | 6(10.2) | 25(42.4) | 17(28.8) | 11(18.6) | 2.56 | .915 | .168 | -.815 | |
Resolution | 2(3.4) | 15(25.4) | 22(37.3) | 20(33.9) | 3.02 | .861 | -.369 | -.800 | |
Classtime | 3(5.1) | 27(45.8) | 21(35.6) | 8(13.6) | 2.58 | .792 | .279 | -.490 | |
Ratingsa | 4(6.8) | 24(40.7) | 24(40.7) | 7(11.9) | 2.58 | .792 | .063 | -.402 | |
Teacher-ratingsa | 6(10.2) | 18(30.5) | 25(42.4) | 10(16.9) | 2.66 | .883 | -.200 | -.595 | |
Experimental group | Motivation | 4(6.8) | 28(47.5) | 18(30.5) | 9(15.3) | 2.54 | .837 | .318 | -.573 |
Teacher-student | 3(5.1) | 27(45.8) | 22(37.3) | 7(11.9) | 2.56 | .772 | .261 | -.393 | |
Student-content | 5(8.5) | 25(42.4) | 18(30.5) | 11(18.6) | 2.59 | .893 | .160 | -.788 | |
Student-student | 5(8.5) | 27(45.8) | 17(28.8) | 10(16.9) | 2.54 | .877 | .263 | -.692 | |
Autonomy | 6(10.2) | 25(42.4) | 20(33.9) | 8(13.6) | 2.51 | .858 | .142 | -.574 | |
Collaboration | 4(6.8) | 25(42.4) | 20(33.9) | 10(16.9) | 2.61 | .851 | .164 | -.681 | |
Deepening | 6(10.2) | 25(42.4) | 18(30.5) | 10(16.9) | 2.54 | .897 | .166 | -.736 | |
Resolution | 7(11.9) | 22(37.3) | 21(35.6) | 9(15.3) | 2.54 | .897 | .017 | -.706 | |
Classtime | 5(8.5) | 26(44.1) | 20(33.9) | 8(13.6) | 2.53 | .838 | .190 | -.527 | |
Ratingsa | 7(11.9) | 23(39) | 19(32.2) | 10(16.9) | 2.54 | .916 | .080 | -.781 | |
Teacher-ratingsa | 7(11.9) | 21(35.6) | 22(37.3) | 9(15.3) | 2.56 | .896 | -.035 | -.696 |
Grade groups utilized (None: 1–4.9; Few: 5–5.9; Enough: 6–8.9; Completely: 9–10).
In the Baccalaureate stage, the response trend changes substantially compared to the secondary and primary education stages. In this case, the responses offered by the control group were lower, in most dimensions, than those given by the experimental group. The mean was approximately 2.7 points in the control group, while in the experimental group, the mean was above 3.1 points, except in resolution and teacher-ratings, whose mean was below 3. Kurtosis varies substantially between the CG and the EG. In the control group, the kurtosis is platykurtic. The kurtosis is mainly leptokurtic in the experimental group, except in motivation, resolution, ratings, and teacher-ratings, which are platykurtic, and in teacher-student, student-content, student-student, and class-time, which are mesokurtic (Table 4).
Table 4.
Dimensions | Likert Scale n (%) |
Parameters |
|||||||
---|---|---|---|---|---|---|---|---|---|
None | Few | Enough | Completely | M | SD | Skw | Kme | ||
Control group | Motivation | 7(10) | 21(30) | 27(38.6) | 15(2.4) | 2.71 | .919 | -.200 | -.762 |
Teacher-student | 8(11.4) | 19(27.1) | 24(34.3) | 19(27.1) | 2.77 | .981 | -.280 | -.931 | |
Student-content | 9(12.9) | 21(30) | 24(34.3) | 16(22.9) | 2.67 | .974 | -.162 | -.944 | |
Student-student | 8(11.4) | 19(27.1) | 26(37.1) | 17(24.3) | 2.74 | .958 | -.270 | -.845 | |
Autonomy | 7(10) | 19(27.1) | 26(37.1) | 18(25.7) | 2.79 | .946 | -.292 | -.816 | |
Collaboration | 9(12.9) | 21(30) | 26(37.1) | 14(20) | 2.64 | .948 | -.163 | -.848 | |
Deepening | 8(11.4) | 23(32.9) | 22(31.4) | 17(24.3) | 2.69 | .971 | -.105 | -.992 | |
Resolution | 8(11.4) | 21(30) | 25(35.7) | 16(22.9) | 2.70 | .953 | -.184 | -.880 | |
Classtime | 6(8.6) | 20(28.6) | 30(42.9) | 14(20) | 2.74 | .879 | -.255 | -.584 | |
Ratingsa | 8(11.4) | 21(30) | 24(34.3) | 17(24.3) | 2.71 | .965 | -.187 | -.928 | |
Teacher-ratingsa | 7(10) | 20(28.6) | 27(38.6) | 16(22.9) | 2.74 | .928 | -.243 | -.770 | |
Experimental group | Motivation | 3(4.4) | 12(17.6) | 20(29.4) | 33(48.5) | 3.22 | .859 | -.842 | -.297 |
Teacher-student | 3(4.4) | 10(14.7) | 23(33.8) | 32(47.1) | 3.24 | .866 | -.908 | .032 | |
Student-content | 2(2.9) | 10(14.7) | 24(35.3) | 32(47.1) | 3.26 | .822 | -.864 | .000 | |
Student-student | 3(4.4) | 10(14.7) | 22(32.4) | 33(48.5) | 3.25 | .870 | -.936 | .043 | |
Autonomy | 3(4.4) | 7(10.3) | 29(42.6) | 29(42.6) | 3.24 | .813 | -.978 | .651 | |
Collaboration | 3(4.4) | 8(11.8) | 29(42.6) | 28(41.2) | 3.21 | .821 | -.903 | .430 | |
Deepening | 2(2.9) | 8(11.8) | 28(41.2) | 30(44.1) | 3.26 | .785 | -.892 | .394 | |
Resolution | 3(4.4) | 20(39.4) | 25(36.8) | 20(29.4) | 2.91 | .876 | -.236 | -.873 | |
Classtime | 5(7.4) | 9(13.2) | 23(33.8) | 31(45.6) | 3.18 | .929 | -.939 | .004 | |
Ratingsa | 4(5.9) | 11(16.2) | 18(26.5) | 35(51.5) | 3.24 | .932 | -.949 | -.168 | |
Teacher-ratingsa | 2(2.9) | 21(30.9) | 28(41.2) | 17(25) | 2.88 | .820 | -.111 | -.816 |
Established grade group (None: 1–4.9; Few: 5–5.9; Enough: 6–8.9; Completely: 9–10).
Comparing the means between the stages analyzed shows how the measures of the control groups of the stages of Secondary and Primary Education are higher than those given by the experimental group. This fact is alternated in the High School stage, where the experimental group reflected averages higher than those of the control group (Figures 2, 3, and 4).
According to the results obtained from these tests, the stage where there were differences that are more significant was the Baccalaureate stage, followed by the Secondary Education stage and finally, the Primary Education stage. Regarding the Primary Education stage, where the mean differences were positive, the control group showed higher scores than the EG, the most significant dimensions were motivation, student-student, autonomy, collaboration, resolution, and ratings. In the Secondary Education stage, something similar to the Primary Education stage occurs, although in this case, the differences in means were smaller, and there were also negative differences in the two dimensions, teacher-student, and student-content. The most significant dimensions were the same as those obtained in Primary Education, except for the rating dimension, which shows no significant differences at this education stage.
In the Baccalaureate stage, the results turned around concerning the other two stages, having negative differences in all dimensions; that is, the EG showed higher values than those shown by the CG. In this case, all of the dimensions turned out to be significant, except for resolution and teacher-ratings. In those cases where the difference turned out to be significant, the force of association is negative in the stages of Primary and Secondary Education. This indicates that the force is indirectly proportional; that is, the control group showed a higher force than the experimental group. In the High School stage, the force of association was positive. In all cases, the partnership strength was medium-low. The magnitude of the effect was low in all cases, with even negative values or absolute zeros (Table 5). Negative values are directly related to non-significant values and have no direct interpretation. Positive values close to zero indicate that the strength of association is low.
Table 5.
Dimensions | μ(X1-X2) | tn1+n2-2 | df | d | rxy |
---|---|---|---|---|---|
Motivation | .420(3.24-2.82) | 2.317∗ | 98 | .029 | -.228 |
Teacher-student | .140(2.82-2.68) | n.s. | 98 | .006 | -.072 |
Student-content | .220(2.92-2.70) | n.s. | 98 | -.018 | -.118 |
Student-student | .460(3.14-2.68) | 2.501∗ | 98 | .018 | -.245 |
Autonomy | .420(3.18-2.76) | 2.377∗ | 98 | .023 | -.233 |
Collaboration | .440(3.20-2.76) | 2.389∗ | 98 | .029 | -.235 |
Deepening | .140(2.92-2.78) | n.s. | 98 | -.024 | -.083 |
Resolution | .560(3.34-2.78) | 2.227∗∗ | 98 | .000 | -.310 |
Classtime | .160(2.88-2.72) | n.s. | 98 | .000 | -.094 |
Ratingsa | .500(3.28-2.78) | 2.790∗∗ | 98 | .017 | -.271 |
Teacher-ratingsa |
.180(2.96-2.78) |
n.s. |
98 |
.012 |
-.102 |
Motivation | .322(2.86-2.54) | 2.013∗ | 116 | .044 | -.184 |
Teacher-student | -.034(2.53–2.56) | n.s. | 116 | .056 | .021 |
Student-content | -.017(2.58–2.59) | n.s. | 116 | .006 | .010 |
Student-student | .407(2.95-2.54) | 2.461∗ | 116 | .043 | -.223 |
Autonomy | .492(3.00-2.51) | 3.018∗∗ | 116 | .037 | -.270 |
Collaboration | .424(3.03-2.61) | 2.643∗∗ | 116 | .058 | -.238 |
Deepening | .017(2.56-2.54) | n.s. | 116 | .000 | -.009 |
Resolution | .475(3.02-2.54) | 2.932∗∗ | 116 | .011 | -.263 |
Classtime | .051(2.58-2.53) | n.s. | 116 | -.017 | -.031 |
Ratingsa | .034(2.58-2.54) | n.s. | 116 | -.022 | -.020 |
Teacher-ratingsa |
.102(2.66-2.56) |
n.s. |
116 |
.011 |
-.058 |
Motivation | -.506(2.71–3.22) | -3.277∗∗ | 136 | -.020 | .271 |
Teacher-student | -.464(2.77–3.24) | -2.943∗∗ | 136 | -.016 | .245 |
Student-content | -.593(2.67–3.26) | -3.862∗∗ | 136 | -.016 | .314 |
Student-student | -.507(2.74–3.25) | -3.251∗∗ | 136 | -.016 | .269 |
Autonomy | -.450(2.79–3.24) | -2.991∗∗ | 136 | -.032 | .248 |
Collaboration | -.563(2.64–3.21) | -3.725∗∗ | 136 | -.029 | .304 |
Deepening | -.579(2.69–3.26) | -3.846∗∗ | 136 | -.037 | .313 |
Resolution | -.212(2.70–2.91) | n.s. | 136 | .020 | .116 |
Classtime | -.434(2.74–3.18) | -2.816∗∗ | 136 | -.041 | .235 |
Ratingsa | -.521(2.71–3.24) | -3.224∗∗ | 136 | -.025 | .266 |
Teacher-ratingsa | -.139(2.74–2.88) | n.s. | 136 | .029 | .080 |
∗∗. The correlation is significant at the 0.01 level.
∗. Correlation is significant at the 0.05 level.
n.s. Not significant.
Established grade group (None: 1–4.9; Few: 5–5.9; Enough: 6–8.9; Completely: 9–10).
5. Discussion and conclusions
This study aimed to contrast the efficacy of two innovative methodologies, such as gamification and flipped learning in the area of Physical Education. This study shows that it is at the stages of Primary Education and Secondary Education where the active gamification methodology tends to be of better value. In contrast, in the Baccalaureate stage, the flipped learning active methodology was better valued (Martin-Rodríguez et al., 2016). Although greater autonomy associated with age could be a correct response, it has not been shown that there is a significant relationship between them (Kashefian-Naeeini and Riazi, 2011). The technological capacity or competence can better explain the students' results (Zainuddin and Perera, 2017).
The response trend in each of the stages is similar to the study dimensions. Both in the control group and the experimental group, except for those dimensions that have been identified as significant differences. Thus, motivation is one of the highlights. These results are not consistent with the scientific literature where various studies show significant increases in student motivation, both for gamified experiences and an inverted methodology (Zainuddin, 2018; Zainuddin et al., 2019).
The primary and secondary stages highlighted that gamification showed better results in the student-student, autonomy, collaboration, and resolution dimensions. These results agree with other studies in which the ability of gamification to develop different abilities has been shown (Banfield and Wilkerson, 2014; Parra-Gonzalez et al., 2020; Quintas et al., 2020; Tan and Hew, 2016). This is probably due to an increase in the students' intrinsic motivation (Ryan and Deci, 2002).
Contrastingly, the dimensions motivation, teacher-student, student-content, student-student, autonomy, collaboration, deepening, class-time, and ratings are significant for high school students concerning the flipped learning methodology. Although it may seem that these results may be influenced by age, they may, instead, be due to a different biological stage (Navarro et al., 2015).
To answer, in general, each of the research questions that have been carried out, it can be shown as:
-
•
Does the training methodology influence the motivation of the students? This research has shown that the methodology does influence the motivation of students. Furthermore, all of the educational stages were analyzed, but from different perspectives. In Primary and Secondary Education, gamification has an influence. In contrast, in Higher Education, it is flipped learning.
-
•
Does the training methodology influence the students' interaction with the teacher? In this case, it has only influenced higher education; it has not in the other stages. Specifically, in the development of flipped learning.
-
•
Does the training methodology influence the interaction of students with the content of the teaching? As with the previous question, this aspect only influenced higher education. Specifically, in the development of flipped learning.
-
•
Does the training methodology influence the interaction of students? Although it is more significant in higher education than in the primary and secondary stages, this aspect influences all education stages. In Higher Education, flipped learning has influence. In the other two educational stages, gamification has influence.
-
•
Does the training methodology influence student autonomy? Although it is more significant in higher and secondary education than in primary education, it has a positive influence. As in the previous cases, gamification influences secondary and primary education. In higher education, it is influenced by flipped learning.
-
•
Does the training methodology influence student collaboration? In this case, it is the same as in the previous question. It is significant at all stages, but more so in secondary and higher education. In Primary and Secondary Education, it is influenced by gamification. In Higher Education, flipped learning.
-
•
Does the training methodology influence the level of depth of the content? It only influences higher education. In the rest of the stages, there is no relationship of importance. In this case, flipped learning has an influence.
-
•
Does the training methodology influence the degree of problem-solving by students? Yes, it affects and is very significant for primary and secondary education stages, but it has no relation to higher education. In this case, gamification has influenced two educational stages.
-
•
Does the training methodology have an influence on class-time with students? Only in higher education. It does not influence the primary and secondary stages of education. In this case, only flipped learning has an influence.
-
•
Does the training methodology influence the degree of qualification of the students? The qualifications only influence, in a very significant way, the primary and higher education stages. It has no apparent influence on the secondary education stage. In Primary Education, gamification has an influence. In Higher Education, it is influenced by flipped learning.
To conclude, it has been shown that the use of two active methodologies, such as gamification and flipped learning, cause different improvements in the teaching and learning processes of Physical Education students. Most studies focus on comparing these types of methodologies with the traditional methodology, but few seek to detect the different advantages and possible applications of the different available methodologies.
It has been shown that, at least in the context where this research has been carried out, both methodologies are equally crucial for Physical Education students' learning processes. It is gamification that seems to have a better predisposition to be used by younger students or in the early stages of the educational system, such as primary and secondary education. At the same time, flipped learning is the one that obtains the best results in more advanced stages, such as secondary education.
As an extension of this study in the future, studying the proposed dimensions from a joint perspective is raised, where gamification and flipped learning are combined and compared with traditional teaching. On the other hand, it would be interesting to know the opinion, through interviews, of the teachers who develop the intervention to obtain qualitative information about the process carried out. Furthermore, this study can be extrapolated to other subjects, such as mathematics or language teaching. Similarly, it appears that there are undetected external or sociodemographic factors that may be affecting the results. Therefore, the study of different sociodemographic variables could guide future research.
Different implications derive from this research. At a theoretical level, the study has made it possible to expand the existing literature on active methodologies in the educational field, in this case, gamification and flipped learning. This has made it possible to bring together the most recent and impact studies to understand and analyze its state.
On a practical level, this research has revealed the most significant and conclusive results achieved to date. Especially regarding the application of gamification and flipped learning in the Physical Education subject. This study has reflected its potentialities with the prospect that other teachers can carry out training practices through these emerging methodologies. On the other hand, the scientific community is encouraged to continue investigating these training actions and contrast and discuss the findings presented here with future works.
Declarations
Author contribution statement
J. López Belmonte, E. Parra-González: Conceived and designed the experiments; Contributed reagents, materials, analysis tools or data; Wrote the paper.
A. Segura-Robles: Conceived and designed the experiments; Performed the experiments; Analyzed and interpreted the data; Wrote the paper.
A. J. Moreno-Guerrero: Performed the experiments; Analyzed and interpreted the data; Wrote the paper.
Funding statement
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Data availability statement
The data that has been used is confidential.
Declaration of interests statement
The authors declare no conflict of interest.
Additional information
No additional information is available for this paper.
References
- Attali Y., Arieli-Attali M. Gamification in assessment: do points affect test performance? Comput. Educ. 2015;83:57–63. [Google Scholar]
- Awidi I.T., Paynter M. The impact of a flipped classroom approach on student learning experience. Comput. Educ. 2019;128:269–283. [Google Scholar]
- Ayén F. ¿Qué es la gamificación y el ABJ? Iber: didáctica de las ciencias sociales. geografía e historia. 2017;1(86):7–15. [Google Scholar]
- Banfield J., Wilkerson B. Increasing student intrinsic motivation and self-efficacy through gamification pedagogy. Contemp. Issues Educ. Res. 2014;7(4):291–298. [Google Scholar]
- Bezanilla M.J., Fernández-Nogueira D., Poblete M., Galindo-Domínguez H. Methodologies for teaching-learning critical thinking in higher education: the teacher’s view. Think. Skills Creativ. 2019;33:78–88. [Google Scholar]
- Chaves-Barboza E., Trujillo-Torres J.M., López-Núñez J.A. Acciones para la Autorregulación del Aprendizaje en Entornos Personales. Píxel-Bit, Revista de Medios y Educación. 2016;(48):67–82. [Google Scholar]
- Chou P.-N., Feng S.-T. Using a tablet computer application to advance high school students’ laboratory learning experiences: a focus on electrical engineering education. Sustainability. 2019;11(2):381–395. [Google Scholar]
- Corujo-Vélez M.C., Gómez del Castillo M.T., Merla-González A.E. Construtivist and collaborative methodology mediated by ICT in higher education using webquest. Pixel-Bit: Revista de Medios y Educación. 2020;57:7–57. [Google Scholar]
- Discroll T. Columbia University; USA: 2012. Flipped Learning And Democratic Education (Graduate Thesis) [Google Scholar]
- Etikan I. Comparison of convenience sampling and purposive sampling. Am. J. Theor. Appl. Stat. 2016;5(1):1. [Google Scholar]
- Ferriz-Valero A., Østerlie O., García Martínez S., García-Jaén M. Gamification in physical education: evaluation of impact on motivation and academic performance within higher education. Int. J. Environ. Res. Publ. Health. 2020;17(12):1–16. doi: 10.3390/ijerph17124465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flores-Fonseca V.M., Gomez J. Applying active methodologies for teaching software engineering in computer engineering. IEEE Revista Iberoamericana de Tecnologias Del Aprendizaje. 2017;12(4):182–190. [Google Scholar]
- Froehlich D.E. Non-technological learning environments in a technological world: flipping comes to the aid. J. N. Approaches Educ. Res. 2018;7(2):88–92. [Google Scholar]
- Ghasemi A., Zahediasl S. Normality tests for statistical analysis: a guide for non-statisticians. Int. J. Endocrinol. Metabol. 2012;10(2):486–489. doi: 10.5812/ijem.3505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gil-Flores J., Rodríguez-Santero J., Torres-Gordillo J.-J. Factors that explain the use of ICT in secondary-education classrooms: the role of teacher characteristics and school infrastructure. Comput. Hum. Behav. 2017;68:441–449. [Google Scholar]
- Gómez-Carrasco C.J., Monteagudo-Fernández J., Moreno-Vera J.R., Sainz-Gómez M. Evaluation of a gamification and flipped-classroom program used in teacher training: perception of learning and outcome. PloS One. 2020;15(7):1–19. doi: 10.1371/journal.pone.0236083. [DOI] [PMC free article] [PubMed] [Google Scholar]
- González L.E.Q., Jiménez F.J., Moreira M.A. Más allá del libro de texto. La gamificación mediada con TIC como alternativa de innovación en Educación Física. Retos: nuevas tendencias en educación física, deporte y recreación. 2018;(34):343–348. [Google Scholar]
- Hernández-Sampieri R., Fernández-Collado C., Baptista-Lucio P., Méndez-Valencia S., Mendoza-Torres C.P. first ed. McGrawHill; Mexico, D.F.: 2014. Metodología de la investigación. [Google Scholar]
- Hinojo-Lucena F., Mingorance-Estrada Á., Trujillo-Torres J., Aznar-Díaz I., Cáceres Reche M. Incidence of the flipped classroom in the physical education students’ academic performance in university contexts. Sustainability. 2018;10(5):1334. [Google Scholar]
- Huang Y.-T., Guo M. Facing disadvantages: the changing professional identities of college English teachers in a managerial context. System. 2019;82:1–12. [Google Scholar]
- Jöreskog K.G., Moustaki I. Factor Analysis of ordinal variables: a comparison of three approaches. Multivariate Behav. Res. 2001;36(3):347–387. doi: 10.1207/S15327906347-387. [DOI] [PubMed] [Google Scholar]
- Kashefian-Naeeini S., Riazi A.M. Beliefs and autonomy: a case of Iranian students. Eur. J. Soc. Sci. 2011;20(3):425–430. [Google Scholar]
- Knapp T.R. Why is the one-group pretest–posttest design still used? Clin. Nurs. Res. 2016;25(5):467–472. doi: 10.1177/1054773816666280. [DOI] [PubMed] [Google Scholar]
- Kwan C., Foon K. A comparison of flipped learning with gamification, traditional learning, and online independent study: the effects on students’ mathematics achievement and cognitive engagement. Interact. Learn. Environ. 2020;28(4):464–481. [Google Scholar]
- Lee J.J., Hammer J. Gamification in education: what, how, why bother? Acad. Exchange Q. 2011;15(2):146–151. [Google Scholar]
- Lee J., Lim C., Kim H. Development of an instructional design model for flipped learning in higher education. Educ. Technol. Res. Dev. 2017;65(2):427–453. [Google Scholar]
- Long T., Cummins J., Waugh M. Use of the flipped classroom instructional model in higher education: instructors’ perspectives. J. Comput. High Educ. 2017;29(2):179–200. [Google Scholar]
- López-Belmonte J., Segura-Robles A., Fuentes-Cabrera A., Parra-González M.E. Evaluating activation and absence of negative effect: gamification and escape rooms for learning. Int. J. Environ. Res. Publ. Health. 2020;17(7):2224. doi: 10.3390/ijerph17072224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- López-Quintero J.L., Pontes-Pedrajas A., Varo-Martínez M. Las TIC en la enseñanza científico-técnica hispanoamericana: una revisión bibliográfica. Digit. Educ. Rev. 2019;(35):229–243. 0. [Google Scholar]
- M.del C Bernal-Gonzalez, Martinez-Dueñas M.S. Metodologías activas para la enseñanza y el aprendizaje. Rev. Panam. Pedagog. 2017;1(25):271–275. [Google Scholar]
- Marín-Marín J., Soler-Costa R., Moreno-Guerrero A., López-Belmonte J. Effectiveness of diet habits and active life in vocational training for higher technician in dietetics: contrast between the traditional method and the digital resources. Nutrients. 2020;12(11):3475. doi: 10.3390/nu12113475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Molina J.J., Ortiz A., Agreda M. Análisis de la integración de procesos gamificados en Educación Primaria. In: Ruiz-Palmero J., Sanchez-Rodríguez J., Sánchez-Rodriguez j., editors. Innovación docente y uso de las TIC en eduación. Málaga: Universidad de Málaga (UMA); 2017. pp. 12–13.https://dialnet.unirioja.es/servlet/articulo?codigo=6224871 Retrieved from. [Google Scholar]
- Molina-Aventosa P., Valenciano-Valcarcel J., Valencia-Peris A. Los blogs como entornos virtuales de enseñanza y aprendizaje en Educación Superior. Rev. Complut. Educ. 2015;26:15–31. (0) [Google Scholar]
- Montrezor L.H. Performance in physiology evaluation: possible improvement by active learning strategies. Adv. Physiol. Educ. 2016;40(4):454–457. doi: 10.1152/advan.00022.2016. [DOI] [PubMed] [Google Scholar]
- Moreno-Guerrero A.J., Jurado de los Santos P., Pertegal-Felices M.L., Soler Costa R. Bibliometric study of scientific production on the term collaborative learning in web of science. Sustainability. 2020;12(14):1–19. [Google Scholar]
- Mortensen C.J., Nicholson A.M. The flipped classroom stimulates greater learning and is a modern 21st century approach to teaching today’s undergraduates. J. Anim. Sci. 2015;93(7):3722–3731. doi: 10.2527/jas.2015-9087. [DOI] [PubMed] [Google Scholar]
- Navarro J.-J., García-Rubio J., Olivares P.R. The relative age effect and its influence on academic performance. PloS One. 2015;10(10) doi: 10.1371/journal.pone.0141895. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Oliveira C., Lopes J., Spear-Swerling L. Teachers’ academic training for literacy instruction. Eur. J. Teach. Educ. 2019;42(3):315–334. [Google Scholar]
- Pallant J. Open Univ. Press; 2003. SPSS Survival Manual: A Step-by-step Guide to Data Analysis Using SPSS for Windows (Versions 10 and 11) [Google Scholar]
- Parra-Gonzalez M.E., López-Belmonte J., Segura-Robles A., Fuentes-Cabrera A. Active and emerging methodologies for Ubiquitous education: potentials of flipped learning and gamification. Sustainability. 2020;12(2):1–11. doi: 10.3389/fpsyg.2020.01103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perez-López I., Rivera E. Formar Docentes, Formar Personas: análisis de los Aprendizajes Logrados por Estudiantes Universitarios desde una Experiencia de Gamificación. Signo y Pensamiento. 2017;36(70):112–129. [Google Scholar]
- Privitera G.J. third ed. Sage Publications, Inc; Los Angeles: 2020. Research Methods for the Behavioral Sciences. [Google Scholar]
- Quintas A., Bustamante J.-C., Pradas F., Castellar C. Psychological effects of gamified didactics with exergames in Physical Education at primary schools: results from a natural experiment. Comput. Educ. 2020 [Google Scholar]
- Ryan R.M., Deci E.L. Handbook of Self-Determination Research. University of Rochester Press; Rochester, NY, US: 2002. Overview of self-determination theory: an organismic-dialectical perspective; pp. 3–33. [Google Scholar]
- Salkind N.J., editor. Encyclopedia of Research Design. SAGE Publications; Thousand Oaks, Calif: 2010. [Google Scholar]
- Santiago R., Bergmann J. first ed. Paidós; Barcelona: 2018. Aprender al revés: Flipped learning 3.0 y metodologías activas en el aula. [Google Scholar]
- Sargent J., Casey A. Flipped learning, pedagogy and digital technology: establishing consistent practice to optimise lesson time. Eur. Phys. Educ. Rev. 2020;26(1):70–84. [Google Scholar]
- Segura-Robles A., Fuentes-Cabrera A., Parra-González M.E., López-Belmonte J. Effects on personal factors through flipped learning and gamification as combined methodologies in secondary education. Front. Psychol. 2020;11:1103. doi: 10.3389/fpsyg.2020.01103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sein-Echaluce M.L., Fidalgo-Blanco A., García Peñalvo F.J. Information Science Reference; Hershey, PA: 2019. Innovative Trends in Flipped Teaching and Adaptive Learning. [Google Scholar]
- Tan M., Hew K.F. Incorporating meaningful gamification in a blended learning research methods class: examining student learning, engagement, and affective outcomes. Australas. J. Educ. Technol. 2016;32(5):19–34. [Google Scholar]
- Turan Z., Akdag-Cimen B. Flipped classroom in English language teaching: a systematic review. Comput. Assist. Lang. Learn. 2020;33(5-6):590–606. [Google Scholar]
- White M., Shellenbarger T. Gamification of nursing education with digital badges. Nurse Educat. 2018;43(2):78–82. doi: 10.1097/NNE.0000000000000434. [DOI] [PubMed] [Google Scholar]
- Wyant J., Baek J.-H. Re-thinking technology adoption in physical education. Curriculum Studies in Health and Physical Education. 2019;10(1):3–17. [Google Scholar]
- Xiang N., Hwa Y., Teck K., Camiré M., Yi J. Singapore teachers’ attitudes towards the use of information and communication technologies in physical education. Eur. Phys. Educ. Rev. 2020;26(2):481–494. [Google Scholar]
- Zainuddin Z. Students’ learning performance and perceived motivation in gamified flipped-class instruction. Comput. Educ. 2018;126:75–88. [Google Scholar]
- Zainuddin Z., Perera C.J. Exploring students’ competence, autonomy and relatedness in the flipped classroom pedagogical model. J. Furth. High. Educ. 2017;(1):1–12. [Google Scholar]
- Zainuddin Z., Habiburrahim H., Muluk S., Keumala C.M. How do students become self-directed learners in the EFL flipped-class pedagogy? A study in higher education. Indonesian Journal of Applied Linguistics. 2019;8(3):678–690. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data that has been used is confidential.