Abstract
Background
Sexual education has become increasingly important as unhealthy sexual practices and subsequent health risks become more prevalent during adolescence. Traditional sex education teaching methodologies are limiting for digital natives exposed to various digital technologies. Harnessing the power of technology applications attractive to the younger generation may be a useful approach for teaching sex education.
Objective
The aim of this study was to improve sexual health knowledge and understanding of the problems associated with unhealthy sexual practices and address sexual and reproductive health challenges experienced in a low-tech setting.
Methods
A participatory design approach was used to develop the digital gamified methodology. A sample of 120 secondary school students aged 11-15 were randomly assigned to either experimental or control group for each of the 3 teaching approaches: (1) gamified instruction (actual serious games [SG] in teaching); (2) gamification (GM; making nongames, such as game-like learning); and (3) traditional teaching (TT) methods.
Results
The SG and GM approaches were more effective than TT methods in teaching sexual health education. Specifically, the average scores across groups demonstrated an increase of mean scores from the pre- to posttest (25.10 [SD 5.50] versus 75.86 [SD 13.16]; t119=41.252; P<.001 [2 tailed]). Analysis of variance indicated no significant differences across groups for pretest scores (F2,117=1.048, P=.35). Significant differences across groups were evident in the posttest scores. Students in the SG and GM groups had higher average scores than the TT group (F2,117=83.98; P<.001). Students reported increased learning motivation, attitude, know-how, and participation in learning (P<.001) when using SG and GM approaches.
Conclusions
Digital health technologies (particularly teaching and learning through gamified instruction and other novel approaches) may improve sexual health education. These findings may also be applied by practitioners in health care settings and by researchers wishing to further the development of sex education.
Keywords: gamified instruction, serious gaming, gamification, educational innovation, teenage students, digital generation, e-learning, low-tech setting
Introduction
Background
Unhealthy sexual activity and its related diseases have increased globally. Nowhere is the effect of sexually transmitted diseases more apparent than in the countries of sub-Saharan Africa (SSA). In SSA countries, many adolescents are exposed early to sexual intercourse and sexual and emotional abuse [1]. Consequently, adolescents are vulnerable to unsafe sexual intercourse practices, sexual encounters with many partners, forced sexual contact, exploitive sexual activity and relationships, and influence from sexually active friends [2-5]. Exposure to these types of sexual practice has led to an increase in sexually transmitted infections (STIs), such as HIV/AIDS and Chlamydia [6-8], and other consequences. A plethora of research studies have supported the increase of sexual health literacy as a way to reduce the spate of unhealthy sexual practices and curb the current increase in sexually transmitted diseases [3,9-11]. A variety of sexual health education programs for adolescents have been implemented globally. However, the efficacy of pedagogy plays a crucial role in fostering sexual health knowledge acquisition. An effective pedagogy supports a host of academic achievement paradigms [7,8,12-15]. Although effective pedagogy has been given less emphasis in sexual health education than in core curriculum subjects [16], initiatives are being undertaken for more effective sexual health education in the digital era.
Digital health games designed to target sexual health practices have increasingly demonstrated their capabilities, appeal, and influence on educating digital native adolescents [17]. Gamified learning (serious games [SG] and gamification [GM]) platforms provide unique methods for delivering educational objectives, increasing knowledge, and reducing sex-related problems faced by adolescents [18-20]. The capacity of outreach for digital games is higher than that for traditional teaching (TT) methods [21]. Approximately 97% of adolescents normally engage in digital games, whereas 50% spend more than 1 hour per day on one kind of gaming equipment or platform or another. The Speak Up Project for Digital Learning revealed a higher preference for digital gamified learning platforms for instruction over traditional ways of learning [22]. When considering the sensitive nature of sexual health knowledge dissemination, digital games are attractive because they offer a discreet, interactive, and confidential environment for learning. This makes a difference for conservative societies [3,23].
Digital games facilitate role playing and offer challenging approaches to learning improving attitude and decision-making skills applicable to real-life scenarios. Because digital platforms offer an engaging approach for learners, they promote knowledge acquisition [8]. The novelty of this study is highlighted by the exploration into sexual health education in SSA countries, which have limited technology use. Only one study has investigated attitude changes and sexual health knowledge acquisition in a country with a similar low-tech environment [24]. Appeals for data supporting the use of technology to disseminate sexual health knowledge in low-tech settings have been documented [25]. This study employs a participatory research approach. It does this to design 2 digital health interventions (SG and GM) that assess 4 aspects (motivation, attitude, knowledge, and engagement [MAKE]) among adolescents in SSA countries.
Objective of This Study
The aims of this study are to (1) add to the limited existing knowledge of game-based technologies and (2) address the interest in using this novel kind of technology as the teaching approach in a low-tech setting in Africa. First, we hypothesized that the application of game elements and mechanics in learning would enhance the sexual health literacy of teenage students. Second, we hypothesized that the teenage students would develop an attitude toward gamified instruction (SG and GM) that was more favorable and receptive than that toward the traditional learning approaches. Henceforth, this study looks at how gamified instruction can improve the sexual health education of adolescents, address their sexual health challenges, and help them overcome those challenges, all of this in developing countries, which tend to be far less invested in digital technologies than developed countries [26].
Methods
Study Design
This study employed a quasi-experimental research design. The design guided the sexual health literacy interventions for students clustered in 3 classes. Sexual health education was made mandatory for all students to sanction the randomization technique [26,27]. The study was also in line with previous empirical studies and other publications that guide quasi-experimental research design [28-30]. It evaluated learning outcomes using pre- and posttest evaluations across the 3 teaching approaches (SG, GM, and TT). The students’ perceptions were compared to determine which instructional approach was the most effective in motivating students to learn, change attitudes, acquire knowledge, and to become engaged in the courses. Figure 1 presents the quasi-experimental research design employed in this study.
Participants
The study involved teenage students (n=120) aged 11-15 who were enrolled in a secondary school at the time of the study. The research was carried out in a school in Dar es Salaam, Tanzania. This school was selected because it had 2 computer laboratories, each able to accommodate around 40 students. They had internet connectivity, a power supply, and a standby generator. The 3 classes had around 40 students each. Everyone in a class was in the same grade. The participants were not chosen randomly. Each participant was assigned to either an experimental group or a control group based on their intact classroom settings. The researchers had no authority to form or annihilate the existing study population setting. The research team randomly designated 2 of the classes as experimental (digital game and GM) and 1 class as control (traditional).
Each group was unaware of the other groups. The learning materials were the same for all the 3 groups. The only differences were in the instructional approaches. The participants were from different schools that had taken part in the revision and participatory design process of the interventions. Finally, there were 5 topics, each covered in one 40-minute class per week, as reported in Table 1.
Table 1.
Topics | Week | Duration (minutes) | Serious game | Gamification | Traditional teaching |
1. Personal hygiene and good manners | 1 | 40 | 40 | 40 | 40 |
2. Sexual responsibility and decision making | 2 | 40 | 40 | 40 | 40 |
3. Dealing with peer pressure during adolescence | 3 | 40 | 40 | 40 | 40 |
4. Prevention of sexually transmitted infections, including HIV/AIDS | 4 | 40 | 40 | 40 | 40 |
5. Dealing with harmful practices and sexual violence | 5 | 40 | 40 | 40 | 40 |
Study Conditions
Interventions
SG and GM interventions were developed following “activity theory” [31], “design-based research” [32], and participatory design approach [15,33]. All of these emphasize the involvement of stakeholders in developing instructional interventions for addressing the intended needs of the study population. As this was the third round of intervention testing, the games were refined based on outcomes from the second round. Students from this group shared their comments for making further improvement. The participatory research design approach employed led to the refinement of the 2 gamified interventions with a view to addressing the challenges faced by the adolescents [18,25]. While the revisions were carried out, the intended users of the systems/learning platforms and other stakeholders (eg, pediatricians; sexual and reproductive health specialists; sexual health teachers from participating schools; computer and information science specialists, including a game designer who was a computer engineer; and targeted secondary school student end users) were all involved in the study. These stakeholders were invited to participate in a series of design workshops during the refining of the intervention. This study also reports the research conducted during the third iteration. Further details of the SG and GM design and development have been published in another research [26]. The descriptions of each study condition are presented below.
Traditional Teaching Class
Students assigned to receive TT were treated as the control group. They were taught in a conventional classroom manner. Their teacher taught 1 day a week for 40 minutes for 5 weeks. Students were given hand-outs for further reading after each session. No digital technology was used.
Serious Gaming Teaching Class
Students in this group received sexual health education using an SG approach (Figures 2 and 3). A week before the classes started, SG students were oriented on the game in the school computer laboratory. Students played the “My Future Begins Today” game individually under the watchful eye of a teacher and the researchers after the classes have commenced. There were 5 topics arranged in chronological order. Each topic took about 40 minutes per week. The students were also allowed to use the game during free time.
The game has an introduction which presents the general learning objective. Each topic has a game scenario in which there are avatars representing a teacher and students interacting in a classroom. There were conversations between the teacher and the students’ avatars. After watching the scenarios, the students were asked to complete the quizzes online. There were 10 quizzes on each topic, to be completed within 90 minutes. Scores were provided for correct answers, and students would lose points for each wrong answer. The students also had an opportunity to repeat the gameplay within the 40-minute margin.
Gamification Teaching Class
GM is the process of giving some of the characteristics of real games to activities that are not games. GM aims to make the learning activities more interactive. This is supposed to motivate students to learn in a way that is more effective because it is fun. GM is an emerging technique within education [3,34,35]. The concept is also a recent development in low-tech settings, especially in SSA countries. With GM, more actual learning tends to take place [36]. There are various types of learning management system platforms with built-in game mechanics [37,38]. This study used “Moodle” to organize and integrate the material we wanted to teach with game elements, such as badges, levels, leader boards, points, scores, competition, and quizzes (Figure 4). As with the SG students, the students who participated in the GM instruction received a 1-week orientation before the classes began.
There were 5 topics and for each topic 40 minutes were allocated per week for 5 consecutive weeks. Each student studied individually, but they could interact online via a discussion forum devoted to each topic. Students were asked to read and practice the lesson materials provided online. There were 10 questions under each section, some true/false and some multiple choice. There were 7 types of badges (Figure 4). One was automatically awarded upon completion of a lesson using the award rules as outlined in Table 2. Overall, the GM concept was used to make learning more fun, motivate the students to learn, support a change of attitude, and increase engagement. This study observed that learning in a competitive spirit increased the desire for continuous learning [39,40]. Students were also automatically positioned on the leaderboards and assigned levels based on the points they had gained after completing the learning activities.
Table 2.
Badge name | Description |
1st Level Badge | Rewarded to students who complete the first topic and are moving to the second topic |
2nd Level Badge | Rewarded to students who complete the second topic and are moving to the third topic |
3rd Level Badge | Rewarded to students who complete the third topic and are moving to the fourth topic |
4th Level Badge | Rewarded to students who complete the fourth topic and are moving to the fifth topic |
5th Level Badge | Rewarded to students who complete the fifth topic |
Exclusive Top Badge | Rewarded to a student with the highest score for a particular topic |
Outstanding Achievement Badge | Rewarded to a student with the highest total of points from all topics |
Procedure and Data Collection Methods
Sexual Health Literacy Tests
During the design of the interventions the selected research team and participating parties, especially the teachers and sexual/reproductive health specialists, were involved in developing a set of questions covering the 5 topics taught. This test was titled Adolescent Sexual Health Literacy Test (ASHLT). There were 50 questions, 10 per topic in the following format: Section A (multiple choice), Section B (true/false), and Section C (short answer). The ASHLT took up to 45 minutes to complete. Before initiating the actual learning, students were asked to do a pretest (using the ASHLT) to assess their sexual health knowledge (baseline). Within a week following the training, the same ASHLT questions were given to measure their level of understanding.
Students’ Perceptions of Teaching Approaches
This study used the MAKE framework [41], according to which a teaching method is regarded as effective if it shows the ability to motivate students, improve their attitude, increase their knowledge acquisition, and increase their engagement in learning. Several scholars have employed the method for evaluating the efficacy of the 4 components of MAKE independently [8,15,24,42-44]. This study employed a MAKE evaluation framework to evaluate and compare the efficacy of the 3 instructions by taking into account the 4 different perspectives (motivation, attitude, knowledge, and engagement) at once. The resultant MAKE instrument we used has 46 items, with the motivation construct containing 16 items and the other 3 constructs (attitude, knowledge, and engagement) having 10 each. We measured the students’ viewpoints through a self-rating method that had a 5-point Likert scale (5=strongly agree to 1=strongly disagree). The ratings took 10 minutes to complete and were all conducted within a week.
Focus Group Interviews
We conducted focus group interviews (FGIs) to yield more comments on the teaching methods [45]. The FGIs were conducted to corroborate and complement the quantitative data. A total of 21 students were requested to participate in the FGI, 7 students for each of the 3 learning instructions. These are realistic numbers for an FGI [46]. There were 3 focus group discussions, one for each of the instruction categories. A semistructured interview guide/protocol was adopted from the MAKE evaluation framework. Students were asked to share their views on the effectiveness and other aspects of their learning approach, and an audio record of the FGI data was made. Verbatim transcriptions were made using pseudonyms for data analysis. The participants were given equal time (1 hour) to provide their comments.
Quantitative Data Analysis
Overview
The collected data were imported from the Excel (Microsoft) file format to the IBM SPSS software tool for statistics (version 24) to perform the quantitative analytic tests. This was for data generated using ASHLT and the MAKE evaluation framework. A paired t test was conducted to compare the pre- and posttest average scores. This was done to determine whether there were changes in the learning scores after a series of sexual health literacy sessions. Besides, a one-way analysis of variance (ANOVA) was performed to analyze the numerical data collected from the pre- and posttest scores. This test compared the variations across the 3 learning approaches. In other words, we performed the pretest comparison across the 3 instructions to establish possible significant differences before the training. This would especially rule out any possible bias in the sexual health knowledge of students collected at baseline. The descriptive statistics was focused on determining the mean, median, and SD on the self-rating scale of the measurement using the MAKE evaluation framework pertaining to the students’ perceptions of the 3 instruction approaches. The self-ratings of the effectiveness of the 3 teaching methods using the MAKE evaluation framework for each component were tested using the one-sample Kolmogorov–Smirnov and Shapiro–Wilk tests for normality. Table 3 presents the results of the normality tests.
Table 3.
Construct | Kolmogorov–Smirnov | Shapiro–Wilk | ||||||
Statistic | df | P valuea,b | Statistic | df | P valuea,b |
|
||
Motivation | .085 | 120 | .03 | .956 | 120 | <.001 |
|
|
Attitude | .213 | 120 | <.001 | .800 | 120 | <.001 |
|
|
Knowledge | .174 | 120 | <.001 | .896 | 120 | <.001 |
|
|
Engagement | .103 | 120 | .003 | .961 | 120 | .002 |
|
aAll P values are <.05, and thus significant.
bLilliefors significance correction.
Although the results indicated that the data samples violated the assumption of normality (P<.05), as the scores are non-normally distributed in the Kolmogorov–Smirnov and Shapiro–Wilk tests (Table 3), a nonparametric Kruskal–Wallis test was consequently used to compare and contrast the responses across the 3 groups for each component. A significant value of P<.05 was used to determine the results of the statistical analysis.
Measurement Reliability
The validated instruments and reported questionnaires appeared to be satisfactory [41,47] following the factor analysis and reliability checks we conducted and documented for 120 samples. The sample size met the minimum of 100 or larger, or a ten-to-one ratio of observations per domain [48]. The motivation questionnaires showed a Cronbach α of .92. The attitude questionnaire showed a Cronbach α of .90, and the knowledge survey developed from the sexual health education syllabus showed a Cronbach α of .92. The engagement questionnaires developed from many sources with no existing reliability results indicated Cronbach α of .90. The results of the different scale reliability checks are presented in Table 4.
Table 4.
Constructs and components | Number of items | Cronbach α | Standardized α | Kaiser–Meyer–Olkin | P value | |
Motivation |
|
|
.92 | .88 | <.001a | |
|
Attitude | 4 | .92 |
|
|
|
Relevance | 4 | .93 | ||||
Confidence | 4 | .90 | ||||
Satisfaction | 4 | .85 | ||||
Attitude |
|
|
.90 | .88 | <.001a | |
|
Affective | 5 | .91 |
|
|
|
Cognitive | 5 | .89 | ||||
Knowledge |
|
|
.92 | .86 | <.001a | |
|
Importance | 4 | .93 |
|
|
|
Effectiveness | 3 | .93 | ||||
Application | 3 | .89 | ||||
Engagement |
|
|
.90 | .87 | <.001a | |
|
Emotional | 6 | .91 |
|
|
|
Cognitive | 4 | .88 |
aThe mean difference is significant if P value is <.05.
Qualitative Data Reliability and Analysis
The qualitative data collection instrument was developed using the MAKE evaluation. FGI transcriptions and records complemented the quantitative results. Membership checking, conformability, and validation were applied to the collected data to come up with critical comments on the sufficiency of the results for ensuring the reliability of the qualitative data. At the end of the data collection process, students were asked to review the transcripts to determine whether the transcripts presented incorporated their comments. Thus, based on the MAKE evaluation instrument, 4 themes were developed (ie, motivation, attitude, knowledge, and engagement) to enable an ample analysis of the collected data. Then, a codebook was created using the 4 MAKE constructs. The students’ transcripts were merged with the quantitative data (based on the 4 MAKE themes).
Results
Baseline Characteristics of Participants
In all, 120 teenage students participated in testing the interventions. Table 5 presents their demographic features and socioeconomic status, including their access to and use of digital technologies.
Table 5.
Characteristics | Value | |
Sex, n (%) |
|
|
|
Male | 69 (57.5) |
|
Female | 51 (42.5) |
Age, mean (SD) |
|
|
|
Male | 13.65 (0.99) |
|
Female | 13.65 (1.01) |
Living group, n (%) |
|
|
|
With both parents | 89 (74.2) |
|
With father only | 7 (5.8) |
|
With mother only | 16 (13.3) |
|
With guardian only | 8 (6.7) |
Economic group, n (%) |
|
|
|
High class | 14 (11.7) |
|
Middle high class | 47 (39.2) |
|
Middle low class | 57 (47.5) |
|
Poor | 2 (1.7) |
Access to a computer at school or home, n (%) |
|
|
|
Yes | 118 (98.3) |
|
No | 2 (1.7) |
Access to smart devices at school or home, n (%) |
|
|
|
Yes | 119 (99.2) |
|
No | 1 (0.8) |
Play of computer or mobile phone games, n (%) |
|
|
|
Yes | 117 (97.5) |
|
No | 3 (2.5) |
ASHLT Test Results
Main Findings
The study carried out a paired sample t test to assess the mean differences or effect of the 3 teaching methods based on the students’ average scores in the ASHLT. Statistically, there emerged a significant improvement in the knowledge acquisition, as the data demonstrated an increase in mean scores in the ASHLT from pretest mean of 25.10 (SD = 5.50) to posttest mean of 75.86 (SD 13.16; t119=41.252, P<.001; 2-tailed). A one-way ANOVA was then used to compare and contrast pre- and posttest across the 3 instructions. The average of pretest scores indicate that participants were equally distributed in all the 3 teaching methods: F2,117=1.048, P=.35. The average posttest scores stemming from the experimental instructions (SG and GM) also indicated an increase—as opposed to their counterparts in the control group (TT): F2,117=83.98, P<.001. Figure 5 presents a comparison of the effectiveness of the 3 teaching groups.
Likewise, we conducted post hoc tests (which served as follow-up analysis) to establish the differences in the 3 pairs of teaching groups: 2 experimental and 1 control. Significant divergences emerged for both the traditional and game-based groups (P<.001) and between the TT and GM groups (P<.001). However, there was no significant difference between SG and GM groups (P=.19). These results suggest that students assigned to the experimental groups achieved a higher score after the lessons than the students in the control group.
Comparison of Average Scores Before the Series of Lessons
Table 6 presents the results for all the 5 topics. For example, the descriptive data we provide below demonstrate the average scores for the “personal hygiene and good manner during adolescence” topic as follows:
Table 6.
Topic | Pretest, mean (SD) | One-way ANOVA | |||
TT | SG | GM |
|
||
1 | 5.45 (1.73) | 5.36 (2.15) | 5.68 (2.22) | F2,117=0.26, P=.76 | |
2 | 4.92 (1.59) | 4.92 (1.45) | 5.31 (1.44) | F2,117=0.89, P=.41 | |
3 | 4.85 (1.18) | 4.87 (1.65) | 5.40 (1.60) | F2,117=1.72, P=.18 | |
4 | 4.66 (1.16) | 4.67 (1.57) | 4.71 (1.15) | F2,117=0.01, P=.98 | |
5 | 4.76 (1.52) | 4.68 (1.53) | 5.01 (1.36) | F2,117=0.53, P=.58 |
TT group mean score of 5.45 (SD 1.73)
SG group mean score of 5.36 (SD 2.15)
GM mean score of 5.68 (SD 2.22)
As gathered in Table 6, a one-way ANOVA was conducted to compare each sexual health education topic taught across the 3 instructions (ie, TT, SG, and GM). The results indicated a nonstatistically significant difference in any of the 5 topics detected with P>.05. The results suggest that all the 3 teaching methods can be considered similar regarding sexual health knowledge in all 5 topics before the training.
Comparison of Average Scores After the Series of Lessons
The students in each group also completed the same (ASHLT) quizzes as a posttest. The one-way ANOVAs were performed to evaluate the students’ average test scores across the 3 teaching methods. The descriptive data from the one-way ANOVAs and post hoc comparison tests are illustrated in Multimedia Appendix 1. The results indicated that the SG and GM groups had higher averages than the TT group.
The one-way ANOVAs revealed that the students received effective sexual health knowledge and that the acquisition rate increased for each topic in the 3 learning groups. Students from the SG and GM instruction groups showed a significant knowledge acquisition in topic 1, compared with students in the TT group (F2,117=19.04, P<.001). Constant effects remained for the other 4 topics. The Tukey HSD post hoc multiple comparison tests indicated that the average scores for all the 5 topics significantly varied between the control and experimental groups (P<.001). The experimental groups did not differ significantly as P values were over .05 (refer to Multimedia Appendix 1 for details).
Students’ Perceptions Toward Instruction Approaches
The study evaluated the students’ perceptions of the 3 instructional approaches using a self-rating scale and FGI. The details of both the quantitative and qualitative results are presented below.
Quantitative Component
The averages for the responses to each aspect of the MAKE evaluation framework were compared for the 3 groups. A Kruskal–Wallis test was performed to determine the existence or nonexistence of statistically significant difference among the 3 groups after rating the average scores from each MAKE evaluation framework. Statistically significant dissimilarities between the 3 groups’ averages were demonstrated (Multimedia Appendix 2). For instance, the Kruskal–Wallis test showed that there was a significant difference in motivation between the 3 instructions: SG mean of 4.51 (SD 0.25), GM mean of 4.40 (SD 0.38), and TT mean of 4.12 (SD 0.59); P<.001. Post hoc tests were also conducted to make pairwise comparisons. In the post hoc tests, we found that TT differed significantly from both GM (P=.04) and SG (P<.001). By contrast, GM and SG were not significantly different from each other (P=.79). Moreover, this effect remained consistent with the other aspects of the MAKE evaluation.
Qualitative Component
Comments were received from both the experimental and the control groups on the 3 instruction methods. Like the results from the quantitative data, students from the experimental groups commented favorably on the SG and GM instructions, whereas those in the control group commented unfavorably on TT. For example, for motivation, the students reported:
the games were fun
SG-3
...that learning was easy
SG-5
...the learning offered a self-regulatory method that improved my confidence
GM-1
...learning was [done] in a competitive [way], which helped me gain problem solving-skills
GM-7
Students also pointed out that
...the learning inspired me; hence I focused on learning
SG-2
...I was extremely interested in the learning approach
GM-4
...the availability of badges encouraged [me to learn] the subject
GM-2
By contrast, students from the TT group were largely negative about their learning experience:
...there were no visuals
TT-5
...[there was] no clarification on many issues
TT-2
...[there were] limited, or no activities for concentration
TT-6
...little or none of the critical thinking strategies were provided, including role play, demos, quizzes, team-work activities, [or] collaboration.
TT-3
Regarding the attitude change, the FDIs revealed the opinion of the experimental group students about SG and GM:
...particularly useful in changing attitudes
GM-3
...a non-embarrassing learning environment
SG-1
...suitable and worthwhile for the delivery of sexual health education
SG-7
I was excited about the activities, competitions, leader-boards, badges, avatars, and scenarios
GM-4
By contrast, the control group students commented:
I was bored listening to lectures
TT-1
...[it was] hard to understand how the sexual health subject is important for changing my attitude
TT-7
...[it is] unfriendly learning
TT-6
...[it was an] uncomfortable learning environment due to the sensitivity of the topic taught
TT-5
...it hides potential information for changing my attitude
TT-4
...questions were not encouraged or not well clarified; hence I ended up with no clues that could change the myths [that produce] negative sexual health attitudes
TT-2
Experimental group students reported having had positive interactions with the SG and GM interventions and a substantial improvement in their sexual health knowledge:
I acquired the required knowledge for practicing healthy sexual behaviours through this learning approach
GM-6
I acquired potential sexual health knowledge that will help my making informed decisions
SG-6
I will apply the skills and understanding that are essential and applicable for curbing unhealthy sexual behaviours.
SG-4
from today onwards I will not participate in risky sexual activities as I am [now] knowledgeable and will apply the knowledge acquired to make informed decisions for better sexual health outcomes and future goals.
SG-4
By contrast, control group students commented on their teaching method as follows:
traditional teaching was less informative
TT-3
technical language was used that made it difficult to understand
TT-7
[there was a] lack of vivid examples
TT-1
the learning strategy narrowed the thinking capacity required for applying the knowledge and skills acquired
TT-4
Finally, students in the experimental learning groups (SG and GM) reported that the SG and GM components were effective in engaging them:
the learning activities made our minds active
GM-6
I was connected to the learning process
SG-4
I focused on the learning activities
SG-4
the learning made me concentrate on learning all the time
GM-2
Students in SG-2 and GM-7 reported that
...the learning provided opportunities for hands-on activities that made it easy to learn and remember.
By contrast, the TT students reported that
our learning was indirect
TT-3, TT-5, TT-2
the learning was passive, as no hands-on activities were provided
TT-1, TT4
there was little or poor interaction
TT-7
I lost focus during learning
TT-6
Discussion
Findings and Interpretation
The study showed that the game elements embedded in SG and GM instruction catalyzed motivation and engagement during learning and that this contributed to attitude change, knowledge acquisition, and ultimately better learning performance.
The study results demonstrated that sexual health education taught using SG and GM approaches works better than TT methods. The SG and GM approaches resulted in higher test scores for knowledge acquisition than the TT control group. This finding conforms with previous research which found gamified learning systems to have a significant impact on sexual health education [25]. In our study, most students acknowledged several factors in their improved learning: The first factor is motivation (to learn), which consists of elements of attention, relevance, confidence, and satisfaction [49]. Indeed, motivation is a significant component for accomplishing or failing a task [50]. Students reported that their interest was caught and improved with the game elements (scenarios, quizzes, competition, challenges, scores) provided during the learning process. The game elements motivated the students to learn [45]. Furthermore, the game elements made the learning more interactive and fun, which increased the students’ motivation to learn [50].
This study found that gamified learning contents were experienced as “relevant.” For instance, the students realized that there was a common connection between what they were learning and real life. These results were consistent with an earlier study [19], which had indicated that gamifying sexual health learning approaches was promising for adolescents because the role plays and scenarios reflect the actual lifestyle of the current generation. The students felt confident while going through the self-regulated learning material provided through the gamified learning (which stimulated and sustained their learning). Perhaps this means that they would succeed in learning the subject matter to a great extent. As this paper demonstrates, such confidence enabled them to succeed and derive self-esteem from the knowledge they acquired and apply it in real life [49]. Although Keller [49] did not examine the effectiveness of the mediating role of increased knowledge in sexual health literacy, this work showed that sexual health education interventions through gamified learning are effective for the development of self-efficacy. As a result, they encourage healthy sexual practices including the digitally savvy adolescents [24]. Students reported satisfaction with their learning experience. The quality of the gamifying content gave them an experience of fun learning (thus, accomplishing learning goals). The awards and scoring mechanics also inspired them to learn with persistence and intensity [51].
The second factor accounting for the effectiveness of the gamified learning was that it changed the attitude of the students. As a similar study [7] reported, gamified learning induces positive changes in the sexual health attitude of adolescents. Essentially, the My Future Begins Today gamified learning incorporated in its design most of the known relevant features that have proved effective in transforming adolescents’ negative sexual health attitudes to positive ones and, as a consequence, curbing risky sexual behavior [10]. It considered specific settings and co-opted various stakeholders, including the targeted users (high-school students and their teachers) in the design.
During the gamified design and development, students provided input on the type of avatars and scenarios they found appealing. Their opinions were based on their different cultural settings, their level of digital literacy, their use of state-of-the-art technology, among others. This study was grounded on the social–cultural theory known as activity theory that encourages participation of different stakeholders in the development of instructional interventions [52-54]. Members of the community participated in the design process by contributing to the design of the knowledge-acquisition components useful in addressing the problems related to acquisition of sexual health knowledge among adolescents in the studied region. The resultant gamified learning elements were found to be relevant in changing the students’ attitude toward problems such as negative peer pressure, teen pregnancy, STIs (including HIV/AIDS), and sexual violence. Although this research found no participatory design being applied within the TT environment, the gamified learning instructions invited the targeted users to participate in the design. This allowed us to apprehend the participants’ relevant ideas and needs and in turn effectively deliver the sexual health information required to induce a change in attitudes of the participants [15].
The third factor accounting for the efficacy of gamified learning was that it improved the knowledge acquisition among students in the experimental groups. The students indicated that gamified learning helped them to acquire sexual health information and skills that could purportedly help them engage in healthy sexual practices. Notably, the students reported that the sexual health knowledge delivered through gamified instructions were highly effective for their current and future lives and that they now felt knowledgeable and able to resist detrimental sexual health risks or factors. According to Chu et al [15], gamified learning is effective because knowledge is acquired in a safe, nonrisk (simulated) environment. Gamified learning offers students the opportunity to experiment in their learning, play, apply decision-making skills, and test scenarios without negative consequences. Evidence from follow-up studies shows that the effect of sexual health knowledge acquired through gamified learning is compelling and persistent, but no effectiveness has been demonstrated in terms of delay in sexual initiation [7], although the determination of outcomes was based on self-reporting. An iterative design study with the objective to describe a methodology for developing an SG intervention for improving sexual health education among youth in Boston [8] demonstrated that nonidentified study participants (ie, students and street youths) in underserved communities would have acquired more knowledge on chlamydia because they enjoyed the gameplay and actively participated in acquiring the information. This may explain why the experimental groups in our study showed better results than their counterparts in the control group.
The fourth and final factor that boosted students’ learning was engagement. The evaluation of the effectiveness of each of the instructional approaches was based on the students’ engagement. Studies have documented the effectiveness of gamified learning in engaging students during learning [8,42,43], with some studies related to the ability of gamified instructions to entertain and reduce stress when learning [43,50]. The My Future Begins Today (GM and SG) platform was designed to trigger students’ engagement by having learning tasks performed in a problem-solving way and by having students participate in skills-based challenges that required critical thinking. The gamified learning platforms are useful for the students, especially when it comes to (1) the skills that are needed to thrive or (2) use the latest technologies of this century. The presence of game elements (badges, score, leaderboards, levels, immediate feedback, time pressure, and repetition) may explain why gamified learning increased the engagement of students in the experimental group, which, in turn, bolstered their learning. Besides, game elements were positively commented on by the students who saw increased engagement with the PR:EPARe game [42]. Although Jiang et al [8] did not find a significant correlation between the participants’ game engagement and learning, this study shows that the 2 concepts are useful for learning purposes.
Limitations
This study used a participatory design approach. Such an approach is vital in designing instructions that address the needs of the users [15,43] in their social–cultural context. It was informed by design-based research (from a technology perspective) [32] and grounded in sociocultural learning theory [53,54]. As good as the foundations are, we must acknowledge some limitations in our efforts to put them into practice. This study evaluated knowledge acquired by the students and the effectiveness of that knowledge in changing their attitudes toward sexual activities. However, it is would be difficult to determine how much of and for how long the change took place after the study. Hence, would need to know how many students dropped out of school due to pregnancy, were infected with STIs, encountered sexual violence, or were peer pressured into harmful sexual practices. A follow-up study could be conducted when the students are about to finish their ordinary-level studies.
Conclusions
Educational gamified learning (GM and SG) has the potential to significantly increase the sexual health literacy of adolescents. The digital health gamified interventions designed in this study provide a user-friendly learning environment. The designs were influenced by a theory-driven assessment of learning. This assessment is supported by testing the learning of the users. This study treats serious digital health gamified instructions as a brain activator: it keeps students active during the learning process. The students’ participation in the learning process is catalyzed by the motivation and engagement that are enabled by the game elements and mechanics. The My Future Begins Today (the digital health gamified learning interventions using the SG and GM) design increases knowledge acquisition and attitude change. Students reported the learning to be more interactive through participating in the gamified learning activities.
SG and GM methods were found to be effective and efficient in increasing motivation, improving attitudes, increasing knowledge acquisition, and encouraging engagement in the learning process. Future empirical studies may verify the efficacy of the My Future Begins Today learning platforms in improving sexual health literacy acquisition in other countries, especially in SSA, where the TT method is widely practiced and tends to limit the learning with gamified digital technologies and process [19,25]. This paper also addresses more than ever the call from a previous study [25] to evaluate the effect of gamifying sexual health education when different key stakeholders are involved in the design process in low-tech settings. This is due to the fact that in developing countries information and communication technologies and digital literacy are limited.
Abbreviations
- ASHLT
Adolescent Sexual Health Literacy Test
- AVOVA
analysis of variance
- FGI
focus group interview
- SG
serious game
- GM
gamification
- MAKE
motivation, attitude, knowledge, and engagement
- SSA
sub-Saharan Africa
- STI
sexually transmitted infections
- TT
traditional teaching
Comparison of average scores, one-way ANOVA, and post hoc comparison tests after the lessons.
Evaluation of the efficacy of the instructional approachesa.
Footnotes
Conflicts of Interest: Non declared.
References
- 1.Thompson R, Lewis T, Neilson EC, English DJ, Litrownik AJ, Margolis B, Proctor L, Dubowitz H. Child Maltreatment and Risky Sexual Behavior. Child Maltreat. 2017 Feb 24;22(1):69–78. doi: 10.1177/1077559516674595. http://europepmc.org/abstract/MED/27777330 .1077559516674595 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Sani As, Abraham C, Denford S, Mathews C. Design, implementation and evaluation of school-based sexual health education in sub-Saharan Africa: a qualitative study of researchers’ perspectives. Sex Education. 2017 Dec 21;18(2):172–190. doi: 10.1080/14681811.2017.1414040. [DOI] [Google Scholar]
- 3.Haruna H, Hu X, Wah Chu SK. Adolescent School-Based Sexual Health Education and Training: A Literature Review on Teaching and Learning Strategies. GJHS. 2018 Feb 19;10(3):172. doi: 10.5539/gjhs.v10n3p172. [DOI] [Google Scholar]
- 4.Zimmerman GM, Farrell C. Parents, Peers, Perceived Risk of Harm, and the Neighborhood: Contextualizing Key Influences on Adolescent Substance Use. J Youth Adolesc. 2017 Jan;46(1):228–247. doi: 10.1007/s10964-016-0475-5.10.1007/s10964-016-0475-5 [DOI] [PubMed] [Google Scholar]
- 5.Sani AS, Abraham C, Denford S, Ball S. School-based sexual health education interventions to prevent STI/HIV in sub-Saharan Africa: a systematic review and meta-analysis. BMC Public Health. 2016 Oct 10;16(1):1069. doi: 10.1186/s12889-016-3715-4. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-016-3715-4 .10.1186/s12889-016-3715-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cates JR, Fuemmeler BF, Diehl SJ, Stockton LL, Porter J, Ihekweazu C, Gurbani AS, Coyne-Beasley T. Developing a Serious Videogame for Preteens to Motivate HPV Vaccination Decision Making: Land of Secret Gardens. Games Health J. 2018 Feb;7(1):51–66. doi: 10.1089/g4h.2017.0002. http://europepmc.org/abstract/MED/29161529 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Fiellin LE, Hieftje KD, Pendergrass TM, Kyriakides TC, Duncan LR, Dziura JD, Sawyer BG, Mayes L, Crusto CA, Forsyth BW, Fiellin DA. Video Game Intervention for Sexual Risk Reduction in Minority Adolescents: Randomized Controlled Trial. J Med Internet Res. 2017 Sep 18;19(9):e314. doi: 10.2196/jmir.8148. https://www.jmir.org/2017/9/e314/ v19i9e314 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Jiang R, McKanna J, Calabrese S, Seif El-Nasr M. Iterative Design and Testing for the Development of a Game-Based Chlamydia Awareness Intervention: A Pilot Study. Games Health J. 2017 Aug;6(4):205–216. doi: 10.1089/g4h.2016.0112. http://europepmc.org/abstract/MED/28816513 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Temple-smith M, Moore S, Rosenthal D. Sexuality in Adolescence: The digital generation. New York: Taylor & Francis Group; 2016. [Google Scholar]
- 10.Goesling B, Colman S, Trenholm C, Terzian M, Moore K. Programs to reduce teen pregnancy, sexually transmitted infections, and associated sexual risk behaviors: a systematic review. J Adolesc Health. 2014 May;54(5):499–507. doi: 10.1016/j.jadohealth.2013.12.004.S1054-139X(13)00798-2 [DOI] [PubMed] [Google Scholar]
- 11.Mullinax M, Mathur S, Santelli J. Adolescent sexual healthsexuality education. In: Cherry A, Baltag V, Dillon M, editors. International Handbook on Adolescent Health and Development. Cham, Switzerland: Springer International Publishing; 2017. pp. 143–167. [Google Scholar]
- 12.Aarø LE, Mathews C, Kaaya S, Katahoire AR, Onya H, Abraham C, Klepp K, Wubs A, Eggers SM, de Vries H. Promoting sexual and reproductive health among adolescents in southern and eastern Africa (PREPARE): project design and conceptual framework. BMC Public Health. 2014 Jan 18;14:54. doi: 10.1186/1471-2458-14-54. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-14-54 .1471-2458-14-54 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Pesare E, Roselli T, Corriero N, Rossano V. Game-based learning and Gamification to promote engagement and motivation in medical learning contexts. Smart Learn. Environ. 2016 Apr 27;3(1):1–21. doi: 10.1186/s40561-016-0028-0. [DOI] [Google Scholar]
- 14.Cederbaum JA, Rodriguez AJ, Sullivan K, Gray K. Attitudes, Norms, and the Effect of Social Connectedness on Adolescent Sexual Risk Intention. J Sch Health. 2017 Aug 09;87(8):575–583. doi: 10.1111/josh.12532. [DOI] [PubMed] [Google Scholar]
- 15.Chu SKW, Kwan ACM, Reynolds R, Mellecker RR, Tam F, Lee G, Hong A, Leung CY. Promoting Sex Education Among Teenagers Through an Interactive Game: Reasons for Success and Implications. Games Health J. 2015 Jun;4(3):168–74. doi: 10.1089/g4h.2014.0059. [DOI] [PubMed] [Google Scholar]
- 16.Goldman JDG. An exploration in health education of an integrated theoretical basis for sexuality education pedagogies for young people. Health Educ Res. 2011 Jun;26(3):526–41. doi: 10.1093/her/cyq084.cyq084 [DOI] [PubMed] [Google Scholar]
- 17.Kachur R, Mesnick J, Liddon N, Kapsimalis C, Habel M, David-Ferdon C, Brown K, Gloppen K, Tevendale H, Gelaude DJ, Romero L, Seitz H, Heldman AB, Schindelar J. Adolescents, Technology and Reducing Risk for HIV, STDs and Pregnancy. Atlanta, GA: Centers for Disease Control and Prevention; 2013. [2020-06-22]. https://www.cdc.gov/std/life-stages-populations/adolescents-tech.htm . [Google Scholar]
- 18.Eleftheriou A, Bullock S, Graham CA, Ingham R. Using Computer Simulations for Investigating a Sex Education Intervention: An Exploratory Study. JMIR Serious Games. 2017 May 03;5(2):e9. doi: 10.2196/games.6598. http://games.jmir.org/2017/2/e9/ v5i2e9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Patchen L, Ellis L, Ma TX, Ott C, Chang KH, Araya B, Atreyapurapu S, Alyusuf A, Gaines Lanzi R. Engaging African American Youth in the Development of a Serious Mobile Game for Sexual Health Education: Mixed Methods Study. JMIR Serious Games. 2020 Jan 31;8(1):e16254. doi: 10.2196/16254. https://games.jmir.org/2020/1/e16254/ v8i1e16254 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Kimberly H, Duncan LR, Pendergrass T, Sawyer B, Fiellin LE. Development of an HIV prevention videogame intervention: lessons learned. IJSG. 2016 Apr;3(2):83–90. doi: 10.17083/ijsg.v1i4.47. https://www.play2prevent.org/wp-content/uploads/2016/07/Lessons-learned-article.pdf . [DOI] [Google Scholar]
- 21.Lenhart A, Kahne J, Middaugh E E, Rankin Macgill A, Evans C, Vitak J. Teens, Video Games, and Civics. 2008. Sep 16, [2021-09-22]. https://files.eric.ed.gov/fulltext/ED525058.pdf .
- 22.Horn M, Staker H. Trends in digital learning: Empowering innovative classroom models for learning. Proj Tomorrow. [2020-07-02]. http://www.tomorrow.org/speakup/2015_ClassroomModels.html .
- 23.Haruna H, Hu X, Chu S, Mellecker R, Gabriel G, Ndekao P. Improving Sexual Health Education Programs for Adolescent Students through Game-Based Learning and Gamification. Int J Environ Res Public Health. 2018 Sep 17;15(9):2027. doi: 10.3390/ijerph15092027. https://www.mdpi.com/resolver?pii=ijerph15092027 .ijerph15092027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Chib A. Promoting sexual health education via gaming: Evidence from the Barrios of Lima, Peru. In: Patrick F, editor. Handbook of Research on Improving Learning and Motivation Through Educational Games: Multidisciplinary Approaches. Hershey, PA: IGI Global; 2011. pp. 895–912. [Google Scholar]
- 25.Sharifzadeh N, Kharrazi H, Nazari E, Tabesh H, Edalati Khodabandeh M, Heidari S, Tara M. Health Education Serious Games Targeting Health Care Providers, Patients, and Public Health Users: Scoping Review. JMIR Serious Games. 2020 Mar 05;8(1):e13459. doi: 10.2196/13459. https://games.jmir.org/2020/1/e13459/ v8i1e13459 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Haruna H, Zainuddin Z, Mellecker RR, Chu SK, Hu X. An iterative process for developing digital gamified sexual health education for adolescent students in low-tech settings. ILS. 2019 Nov 11;120(11/12):723–742. doi: 10.1108/ils-07-2019-0066. [DOI] [Google Scholar]
- 27.Feser E. Isserman’s Impact. International Regional Science Review. 2012 Nov 09;36(1):44–68. doi: 10.1177/0160017612464051. [DOI] [Google Scholar]
- 28.Thyer B. Quasi-Experimental Research Designs. New York, NY: Oxford University Press; 2012. [Google Scholar]
- 29.Creswell J, Creswell D. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Thousand Oaks, CA: SAGE; 2018. [Google Scholar]
- 30.Creswell J. Educational Research : Planning, Conducting, and Evaluating Quantitative and Qualitative Research (4th Edition) New York, NY: Pearson; 2011. [Google Scholar]
- 31.Plant T, Mann D. Introduction to new insights into the neurobiology of reproduction and puberty. Brain Res. 2010 Dec 10;1364:1–2. doi: 10.1016/j.brainres.2010.11.002.S0006-8993(10)02450-9 [DOI] [PubMed] [Google Scholar]
- 32.Reeves T. Educational Design Research. London, UK: Routledge; 2006. Design research from a technology perspective; pp. 52–66. [Google Scholar]
- 33.DeSmet A, Thompson D, Baranowski T, Palmeira A, Verloigne M, De Bourdeaudhuij Ilse. Is Participatory Design Associated with the Effectiveness of Serious Digital Games for Healthy Lifestyle Promotion? A Meta-Analysis. J Med Internet Res. 2016 Apr 29;18(4):e94. doi: 10.2196/jmir.4444. https://www.jmir.org/2016/4/e94/ v18i4e94 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Bai S, Hew KF, Huang B. Does gamification improve student learning outcome? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts. Educational Research Review. 2020 Jun;30:100322. doi: 10.1016/j.edurev.2020.100322. [DOI] [Google Scholar]
- 35.Zainuddin Z, Shujahat M, Haruna H, Chu S. The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system. Computers & Education. 2020 Feb 7;145:103729. doi: 10.1016/j.compedu.2019.103729. [DOI] [Google Scholar]
- 36.Kapp K. The Gamification of Learning and Instruction: Game-Based Methods and Strategies for Training and Education. Hoboken, NJ: John Wiley and Sons; 2012. May 15, [Google Scholar]
- 37.Huang B, Hew KF, Lo CK. Investigating the effects of gamification-enhanced flipped learning on undergraduate students’ behavioral and cognitive engagement. Interactive Learning Environments. 2018 Jul 20;27(8):1106–1126. doi: 10.1080/10494820.2018.1495653. [DOI] [Google Scholar]
- 38.Zichermann G. Intrinsic and Extrinsic Motivation in Gamification. 2011. [2018-01-09]. http://www.gamification.co/2011/10/27/intrinsic-and-extrinsic-motivation-in-gamification/
- 39.Dicheva D, Dichev C, Agre G, Angelova G. Gamification in Education: A Systematic Mapping Study. J Educ Technol Soc. 2015;18(3):88. [Google Scholar]
- 40.Sugawara E, Nikaido H. Properties of AdeABC and AdeIJK efflux systems of Acinetobacter baumannii compared with those of the AcrAB-TolC system of Escherichia coli. Antimicrob Agents Chemother. 2014 Dec;58(12):7250–7. doi: 10.1128/AAC.03728-14. http://europepmc.org/abstract/MED/25246403 .AAC.03728-14 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Haruna H, Hu X, Chu S, Mellecker R. Initial Validation of the MAKE Framework: A Comprehensive Instrument for Evaluating the Efficacy of Game-Based Learning and Gamification in Adolescent Sexual Health Literacy. Ann Glob Health. 2019 Feb 28;85(1):19. doi: 10.5334/aogh.1110. https://annalsofglobalhealth.org/articles/10.5334/aogh.1110 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Arnab S, Brown K, Clarke S, Dunwell I, Lim T, Suttie N, Louchart S, Hendrix M, de Freitas S. The development approach of a pedagogically-driven serious game to support Relationship and Sex Education (RSE) within a classroom setting. Computers & Education. 2013 Nov;69:15–30. doi: 10.1016/j.compedu.2013.06.013. [DOI] [Google Scholar]
- 43.Arnab S, Clarke S. Towards a trans-disciplinary methodology for a game-based intervention development process. Br J Educ Technol. 2015 Dec 29;48(2):279–312. doi: 10.1111/bjet.12377. [DOI] [Google Scholar]
- 44.Bowen E, Walker K, Mawer M, Holdsworth E, Sorbring E, Helsing B, Bolin A, Leen E, Held P, Awouters V, Jans S. “It's like you’re actually playing as yourself”: Development and preliminary evaluation of ‘Green Acres High’, a serious game-based primary intervention to combat adolescent dating violence+ Psychosocial Intervention. 2014 Apr;23(1):43–55. doi: 10.5093/in2014a5. [DOI] [Google Scholar]
- 45.Rose J, O’Meara J, Gerhardt T, Williams M. Gamification: using elements of video games to improve engagement in an undergraduate physics class. Phys. Educ. 2016 Jul 22;51(5):055007. doi: 10.1088/0031-9120/51/5/055007. [DOI] [Google Scholar]
- 46.Hyde A, Howlett E, Brady D, Drennan J. The focus group method: insights from focus group interviews on sexual health with adolescents. Soc Sci Med. 2005 Dec;61(12):2588–99. doi: 10.1016/j.socscimed.2005.04.040.S0277-9536(05)00211-X [DOI] [PubMed] [Google Scholar]
- 47.Vaughn S, Schumm J, Sinagub J. Focus Group Interviews in Education and Psychology. London, UK: SAGE; 1996. [Google Scholar]
- 48.Rajalahti T, Kvalheim OM. Multivariate data analysis in pharmaceutics: a tutorial review. Int J Pharm. 2011 Sep 30;417(1-2):280–90. doi: 10.1016/j.ijpharm.2011.02.019.S0378-5173(11)00135-9 [DOI] [PubMed] [Google Scholar]
- 49.Keller JM. Motivation, Learning, and Technology: Applying the ARCS-V Motivation Model. Per. 2016 Aug 01;3(2):1–15. doi: 10.17275/per.16.06.3.2. [DOI] [Google Scholar]
- 50.Baskaran G, Rawi MIM. Emotion Digital Game-Based Learning Application: ARCS Motivational Model? International Journal of Advanced Computational Engineering and Networking. 2017 Sep;5(9):148. https://www.researchgate.net/publication/318456635_Emotion_Digital_Game-based_Learning_Application_ARCS_Motivational_MODEL . [Google Scholar]
- 51.Garris R, Ahlers R, Driskell JE. Games, Motivation, and Learning: A Research and Practice Model. Simulation & Gaming. 2016 Aug 18;33(4):441–467. doi: 10.1177/1046878102238607. [DOI] [Google Scholar]
- 52.Hung DWL, Wong AFL. Activity theory as a framework for project work in learning environments. Educ Technol. 2000;40(2):33–37. [Google Scholar]
- 53.Kaptelinin V. Activity Theory Internet. 2013. [2020-05-18]. https://www.interaction-design.org/literature/book/the-encyclopedia-of-human-computer-interaction-2nd-ed/activity-theory .
- 54.Roth W, Radford L, La CL. Working with cultural-historical activity theory. Forum Qual Sozialforsch. 2012;13(2):1–20. doi: 10.17169/FQS-13.2.1814. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Comparison of average scores, one-way ANOVA, and post hoc comparison tests after the lessons.
Evaluation of the efficacy of the instructional approachesa.