Skip to main content
BMC Medical Education logoLink to BMC Medical Education
. 2019 May 15;19:147. doi: 10.1186/s12909-019-1575-1

Does blended problem-based learning make Asian medical students active learners?: a prospective comparative study

Ikuo Shimizu 1,, Hideyuki Nakazawa 2, Yoshihiko Sato 3, Ineke H A P Wolfhagen 4, Karen D Könings 4
PMCID: PMC6521359  PMID: 31092243

Abstract

Background

Asian educators have struggled to implement problem-based learning (PBL) because students rarely discuss their work actively and are not sufficiently engaged in self-directed learning. Supplementing PBL with additional e-learning, i.e. ‘blended’ PBL (bPBL), could stimulate students’ learning process.

Methods

We investigated the effects of bPBL on tutorial group functioning (discussion, self-efficacy, self-directed learning, active participation, and tutor’s perceived authority) and students’ level of acceptance of the e-learning elements. We compared PBL and bPBL in a medical university in Japan. In the bPBL condition, the tutor’s instructions were replaced with online materials and short quizzes. After the course, a 13-item questionnaire using a 5-point Likert scale was distributed regarding the tutorial group functioning of the tutorial group (influence of discussion, self-efficacy, self-directed learning, active participation, and tutors’ authority). The mean scores of subscales were compared with analysis of covariance. Knowledge levels were measured using a pre-test post-test design. A multiple regression analysis was performed to explore the association between e-learning acceptance and the subscales related to PBL.

Results

Ninety-six students participated in the study (PBL: n = 24, bPBL: n = 72). Self-efficacy and motivation for learning triggered by group discussions was significantly higher for students in bPBL (p = 0.032 and 0.007, respectively). Knowledge gain in test scores was also significantly better in the bPBL condition (p = 0.026), and self-directed learning related positively to the acceptance of blended learning (p = 0.044).

Conclusions

bPBL seemed more effective in promoting active learning and improving knowledge, without affecting tutors’ authority. Implementing e-learning into PBL is suggested to be an effective strategy in the Asian context.

Keywords: Blended learning, Health professions education, Problem-based learning, Quiz, Self-directed learning

Introduction

Problem-based learning as an example of cultural gap between west and east

Undergraduate medical education in Asia was traditionally characterised by predominantly lecture-based, teacher-centred educational approaches and highly discipline-specific curricula until the late twentieth century, during which the West-inspired theories on learning have been introduced [1]. Problem-based learning (PBL) is one of the typical examples of Western-inspired learning theories. It is defined as the learning that results from the process of working towards the understanding or resolution of a problem [2]. Important goals of PBL include supporting knowledge structuring in clinical contexts, development of clinical reasoning skills and self-directed learning skills, and increasing students’ learning motivation [3]. PBL has been proven equal to lecture-based education in terms of general success [48] as well as communication skills, and learning strategies [911].

The theoretical origins of the effectiveness of PBL have been variously explored. Among them, self-directed learning is one of key learning principles behind PBL [12]. It is the degree to which students metacognitively, motivationally, and behaviourally participate actively in their own learning process [13]. It refers both to a motivational, volitional component of being willing to engage in learning activities, as well as the ability to do so [14]. Since the amount of knowledge included in standard clinical performance increased rapidly [15], health professions have had to practice life-long learning. Therefore, PBL seems to be a more innovative pathway to learning in medical education, and seemed a convenient and obvious choice for educators to adopt [16]. It has thus been recommended in many countries, including Asia [17]. However, contrary to studies highlighting the success of PBL in Western countries, Asian medical educators have struggled to implement it [18], and Japan is no exception. In Japan, PBL was first incorporated into a curriculum in 1990. It was later suggested that PBL should be implemented in the ‘Model Core Curriculum’, which defined the essential core components of the undergraduate medical curriculum in Japan [19]; PBL was the prevalent educational method at 63 (80%) of the 79 Japanese medical schools in 2004 [20], and 70 in 2016 [21]. However, in 56 of those schools (80%) the implementation of PBL is considered problematic, mainly because of the high burden it places on faculties [22]. As a result, the latest research revealed that a growing number of faculties are avoiding PBL [23], underlining the necessity of coming up with solutions for the implementation problems which have arisen.

Several characteristics of Asian students could be relevant in this matter and should be carefully considered when Asian medical schools are planning and preparing to implement PBL. Students are very deferential towards tutors as authority figures [19]; they fear confrontations with these authority figures and tend to be dependent. There are also vast differences between students’ learning attitudes and their prior knowledge, as well as a lack of passion for what they study during PBL [24]. Effective implementation of PBL builds on students’ prior knowledge and stimulates self-directed learning. Therefore, a lack of prior knowledge could hinder developing one’s own learning objectives in PBL [25]. Conversely, Asian students are so accustomed to the examination-oriented learning culture that they have difficulty applying their prior knowledge and collaborating with peers [26]. In addition, Asian culture predominantly pivots towards teacher-centred pedagogies. In such a prevalent culture, students gain self-efficacy through certified achievements in examinations, rather than through self-directed activities or peer-review, and thus feel less stimulated to develop self-directed learning skills during PBL sessions [27].

Blended learning

Blended learning is defined as a combination of traditional face-to-face and online instruction [28]. Educational technology offers great flexibility in terms of time and place [2931] and improves accessibility and opportunities for students to learn regardless of where they are (e.g. campus, hospital, or clinic). The available e-learning materials vary, such as lectures, quizzes, bulletin boards, and online discussion forums. Blended learning has enriched several learning models in various educational strategies, including PBL. Previous studies conducted in the Western context have shown that PBL as a blended learning environment (blended PBL; bPBL) can enhance the satisfaction and self-reliance of participants [32], strengthen students’ commitment [33], and reduce tutors’ presence [34]. The effectiveness of quizzes has been subject to particular scrutiny. A recent meta-analysis revealed that quizzes significantly improve the objective effectiveness and attractiveness of blended learning [35]. Quizzes strengthen learners’ ability to memorise information, which enables easy recall as needed [36]. Feedback on quizzes provides useful information on the correct answers [37]. Additionally, when students are well prepared for face-to-face meetings, these meetings can be used to a larger extent for active learning [38]. Furthermore, task experience can work as performance accomplishment and may be a source of self-efficacy [39]. In terms of the practical relevance of blended learning, better accessibility of online educational materials may enable students to engage in self-directed learning.

While it is important to ascertain whether bPBL is an effective approach for Asian medical students, it is also necessary to understand the drivers which motivate users to accept e-learning in bPBL. Among several theories and models of technology acceptance, the technology acceptance model (TAM) [40] is widely cited in the technology acceptance literature. The TAM explains and predicts user behaviour regarding information technology [41], and provides a basis for tracing how external variables influence perception — particularly perceived usefulness and perceived ease of use — attitude, and intention to use. Some research on e-learning acceptance has been conducted in the context of blended learning [4244]. For example, learners’ perception of the ease of use of blended learning was associated with self-efficacy [42]. This result is especially relevant for bPBL, as PBL is known to cultivate learners’ attitude towards self-directed learning [3], and learners’ perceived self-directed learning in PBL is positively correlated with perceived self-efficacy [45]. However, learners’ acceptance of e-learning and its effect on bPBL in terms of self-efficacy and self-directed learning as well as discussion activities, active participation, and tutors’ authority have not been examined. Therefore, it is as yet unknown which of these variables is associated with Asian students’ acceptance when e-learning is implemented in PBL. Our study will therefore address the following three research questions:

  1. How does bPBL affect students’ perceptions of discussion activities, self-efficacy, self-directed learning, active participation, and tutors’ authority in tutorial group meetings compared to the original PBL?

  2. Does bPBL improve Asian students’ knowledge gain compared to the original PBL?

  3. Is students’ level of e-learning acceptance of bPBL related to their perceptions of discussion activities, self-efficacy, self-directed learning, active participation, and tutors’ authority?

Methods

Context and participants

The context of this study was the PBL programme during the internal medicine clinical rotation of two subspecialties (haematology and endocrinology) for fourth-year students in the six-year undergraduate medical curriculum at a medical school in central Japan. Every student had taken and passed the national summative assessment examinations, called the Common Achievement Tests (CAT), just before starting their clinical clerkship. It was a set of summative assessments comprising a computer-based test (CBT) and an objective structured clinical examination. The tutorial groups were composed of four to six students based on their CBT scores to minimise the difference of average scores within groups.

The PBL programme was conducted in accordance with the widely applied format, referred to as the “seven-jump approach” [46]:

  1. Case presentation: The paper-based case is presented and unknown terms are explained.

  2. Problem definition: The group defines the fundamental issue.

  3. Brainstorming: The students collect ideas.

  4. Formation of hypothesis: The results of the brainstorming are formed into a working hypothesis.

  5. Defining educational objectives: The students define a detailed agenda to gain a more profound knowledge of the processes forming the crux of the problem.

  6. Self-study: The students acquire the necessary knowledge by themselves.

  7. Synthesis: The results are presented within the group and the case is revisited based on the insights achieved.

There were two meetings. The first meeting included steps 1–5 and the second meeting included step 7. Between these meetings, students were expected to conduct self-study (i.e. step 6). In the experimental condition, we implemented the bPBL course. The students who were enrolled in the bPBL condition were expected to use e-learning resources in an online environment, which consisted of self-study lecture modules and short quizzes to supplement usual PBL practice. The e-learning environment was based on the institutional learning management system (LMS)—students receive information on the LMS at their freshman orientation and routinely use it in their regular curricula. The tutors were also trained in how to use the system. During the PBL course, three self-study modules were provided. The purpose of the modules was to provide knowledge and improve students’ self-study skills. In order to ensure that students completed the online modules, quizzes related to the learning content were inserted after every few pages in a module. Tutors could check the login information and progress status of students on the LMS. Every module took between 15 to 20 min to complete. Students were expected to spend an average of one hour studying online to prepare for the tutorial meeting. Additionally, the students in the bPBL course could access the online literature resources, which would be in printed versions in the original PBL course.

The students who rotated through departments in October and November 2015 participated in the original PBL condition, and no e-learning module was provided for them. The student groups in the rest of the academic year 2015–2016 participated in the bPBL condition.

Internal medicine specialists participated in the programme as tutors. The same tutors participated in the meetings in both groups. They used the same reference guide for PBL throughout the study [46], and tried to act in a same manner throughout the study. In order to ensure that equal learning opportunities were provided to all students, the blended materials were open to students in the PBL condition afterwards.

Figure 1 provides a summary of the context and study design. In the original PBL condition, students would first take a pre-test, then received feedback and guidance at the first meeting. In the self-study phase, some of the study materials were available from a tutor, while online quizzes were not included. Subsequently, after the self-study phase, students share the knowledge they have acquired with their peers during the second meeting. Finally, the post-test and feedback comments on what they learned and discussed were provided by a tutor. In the bPBL condition, tests, results feedback, and guidance were provided online. The self-study materials were also available online.

Fig. 1.

Fig. 1

Study context and design. Additional materials were provided by paper (original PBL) or online (bPBL). Online quizzes were provided only in the bPBL condition

Design and instruments

The research questions were addressed using a quantitative approach. Regarding the first research question, a 13-item questionnaire on tutorial group functioning using a 5-point Likert scale a scale ranging from 1 (totally disagree) to 5 (totally agree) was administered after each of the two tutorial group meetings. The questionnaire contained six subscales: motivational impact of tutorial group discussions, self-directed learning, self-efficacy during the tutorial, active participation and tutors’ authority [4750]. As the questionnaire was provided in Japanese, the original English items were translated into Japanese and then back-translated, to confirm the consistency between the original and provided items.

With regard to the second research question, a pre-test and post-test on students’ knowledge level were conducted before the first meeting and after the second meeting, respectively. The purpose of these tests was to measure the students’ knowledge level and evaluate their progress. Questions in the tests were related to the content of the course and consisted of 10 multiple-choice questions adapted from the past national licence examinations. The fundamental recall of prior knowledge was the focus of the pre-test, while higher cognition, including application and analysis of the case problems, were assessed in the post-test. After answering the tests, students received feedback and a short explanation for each question, either face-to-face or online.

For the third research question, four items which represented four constructs in the TAM (ease of use, usefulness, attitude towards the use, and behavioural intention) [40] were included in the questionnaire to identify blended learning acceptance. These items were drawn from a previous study on the acceptance of blended learning [44]. Only students who participated in the bPBL condition were asked to answer these items.

Analysis

Background characteristics—gender, self-study time, and CAT-CBT—of the two conditions were compared using the chi-square test for gender and the t-test for self-study time and CAT-CBT. The mean scores of each subscale on functioning of the tutorial group (influence of discussion, self-efficacy, self-directed learning, active participation, and tutors’ authority) were compared between the original PBL and the bPBL conditions, by conducting analyses of variance (ANOVA). For the second research question, progress in the test scores (the difference between the pre-test and post-test) were compared between the conditions. Regarding the third research question, a multiple regression analysis was performed to explore the association between e-learning acceptance and the subscales related to PBL (i.e. motivation for learning triggered by group discussions, self-efficacy, self-directed learning, active participation, and tutors’ authority), controlled for gender, subspecialty, self-study time, and prior knowledge). A forced entry method was used for covariates, then a stepwise method was used for the subscales related to PBL. As a measure of effect size, we used eta-squared (η2), where .01 corresponded to a small effect, .06 to a medium effect, and .14 to a large effect [51]. The required sample size was estimated between 52 (with large effect size;η2 = 0.14) and 128 (with medium effect size; η2 = 0.06), when alpha error and power were set as 0.05 and 0.8, respectively. There was no multicollinearity between the measures used. All analyses were performed using SPSS Statistics 23.0.

Results

Ninety-six students consented to participate in this study (PBL: n = 24, bPBL: n = 72). Characteristics of the students are shown in Table 1. Students in these conditions did not differ in terms of gender, self-study time during the rotation, or CAT-CBT scores (p > .05); thus, the participants in our conditions were similar on these characteristics.

Table 1.

Students’ characteristics

Original PBL (n = 24) Blended PBL (n = 72) df p
Gender Male 17 Male 53 χ2 = 0.07 1 0.791
Female 7 Female 19
CAT-CBT M = 56.654 M = 58.039 t = − 0.607 33.01 0.548
SD = 10.175 SD = 8.003
Self-study time (hour/week) M = 16.236 M = 16.312 t = − 0.036 67.58 0.971
SD = 7.295 SD = 12.298

CAT-CBT Common Achievement Tests – Computer-Based Testing

The Cronbach’s alphas for the subscales were: 0.843 (motivation for learning triggered by group discussions), 0.724 (self-efficacy), 0.821 (active participation), 0.829 (tutor’s authority), and 0.914 (e-learning acceptance). Thus, their internal consistencies were considered appropriate. Self-directed learning was evaluated with a single item.

Comparison between original PBL and bPBL

Results on the comparison of the motivation for learning triggered by group discussions, self-directed learning, self-efficacy, active participation, and tutors’ authority are presented in Table 2. Scores on the scales motivation for learning and self-efficacy were significantly higher in the bPBL condition than in original PBL condition (p = 0.032 and 0.007, respectively). Also, self-directed learning in the bPBL tended to be higher (p = 0.089). There were no significant differences in terms of active participation or tutors’ authority.

Table 2.

Results of analysis comparing PBL and bPBL conditions

Mean (SD) analysis η 2 power
PBL bPBL F (1, 90) p
Motivation for learning 3.479 (0.961) 3.521 (0.921) 2.412 0.032 0.325 0.830
Self-directed learning 3.049 (0.94) 3.104 (0.897) 2.18 0.089 0.179 0.590
Self-efficacy 3.319 (0.515) 3.597 (0.641) 3.026 0.007 0.405 0.935
Active participation 3.300 (0.64) 3.679 (0.66) 1.306 0.247 0.314 0.654
Tutors’ authority 3.688 (0.998) 3.819 (0.802) 1.089 0.389 0.16 0.406
Progress in test scores −0.625 (0.998) 0.755 (1.834) 2.277 0.026 0.406 0.893

The progress in test scores was computed as the difference between pre-test (X = 5.792, SD = 2.245 in original PBL and X = 4.994, SD = 1.674 in bPBL) and post-test (X = 5.167, SD = 2.401 in original PBL and X = 5.740, SD = 1.861 in bPBL). Results of the comparison between the conditions revealed that students in the bPBL condition significantly improved on the test score between the pre-test and post-test (p = 0.0026), compared to the PBL condition (see Table 2).

Association between e-learning acceptance and PBL-related subscales

Level of acceptance of e-learning on average was 3. 120 (SD = 0.912). Multiple regression analysis showed that students’ perception of their self-directed learning related positively to the acceptance of blended learning (p = 0.044). No relation between technology acceptance and discussion activities, self-efficacy, active participation, or tutor’s authority was found (Table 3).

Table 3.

Results of a multiple regression analysis between blended learning acceptance and PBL-related variables (i.e. influence of discussion, self-efficacy, self-directed learning, active participation, and tutor’s authority), controlled for covariates (i.e. gender, prior knowledge, and self-study time)

B (95% CI) SE B β p
Gender 0.093 (−0.417, 0.604) 0.093 0.046 0.716
Prior knowledge (CAT-CBT scores) 0.093 (−0.0417, 0.604) 0.014 −0.445 0.716
Self-study time −0.011 (−0.045, 0.012) 0.009 −0.445 0.253
Self-directed learning 0.228 (0.006, 0.451) 0.111 0.241 0.044

R2 = 0.568

To explore which items of e-learning acceptance were associated with self-directed learning, an additional regression analysis was conducted at item-level. The results (Table 4) revealed that the usefulness of e-learning, in particular, was positively related with self-directed learning (p = 0.047).

Table 4.

Results of a multiple regression analysis between self-directed learning and blended learning acceptance scale items, controlled for covariates (i.e. gender, prior knowledge, and self-study time)

B (95% CI) SE B β p
Usefulness 0.209 (0.003, 0.415) 0.103 0.235 0.047
Ease of use −0.256 (−0.551, 0.040) 0.148 −0.320 0.656
Attitude towards use 0.287 (−0.177, 0.751) 0.223 0.336 0.537
Behavioral intention to use −0.110 (−0.526, 0.306) 0.208 −0.128 0.706

R2 = 0.470

Discussion

In this study, we clarified three issues in Asian context; (1) the effect of bPBL on students’ perceptions of discussion activities, self-efficacy, self-directed learning, active participation, and tutors’ authority, (2) students’ knowledge gain in bPBL, and (3) students’ acceptance of bPBL related to their perceptions of discussion activities, self-efficacy, self-directed learning, active participation, and tutors’ authority.

Although several educational methods were developed and implemented successfully in higher education, PBL has proven difficult to implement in Asia. One reason is that an ontological change is necessary for PBL [52], rather than simply introducing its procedures. While the influence of traditional culture such as Confucianism has been assessed [53], similar structural problems have also been observed even in Western cultures [54]. In the present study, instead of intervening in such cultural characteristics, we focused on modifying the PBL programme and attempted to overcome the identified problems such as student participation and engagement by implementing e-learning in the original PBL.

In response to the first research question, which aimed to clarify the effects of adding blended learning elements to PBL on students’ perception of the learning process, our results affirm that it improved self-efficacy and motivational impact of tutorial group discussions. These results may be due to the structural improvement of PBL by implementing e-learning. Instruction and assessment with e-learning complemented supportive information by decreasing the need for tutor-support and providing enactive mastery experience, which was essential for self-efficacy [39] and consequently contribute to self-directed learning.

With regard to the second research question on the effects of bPBL on knowledge improvement, the students using bPBL achieved better progress in test scores, without a difference in study time. A possible reason is that we applied quizzes in the e-learning modules. Evidence of the efficacy in the e-learning quizzes may explain this result [35, 36]. Another reason might be that quizzes were more popular among East Asian students because the examination-oriented learning culture is predominant in most East Asian societies [55], and acts as a school or policy reform barriers in most East Asian societies which rely on examination-centred education [26]. While quizzes are familiar to students, they can also promote the active learning approach [38]. Therefore, if educators try to design blended learning programmes to strengthen active learning for students who prefer examination-centred education, it may be effective to take advantage of the benefits of using quizzes. However, further research is required on how examination-centred educators perceive online quizzes.

Furthermore, as the results relating to the third research question show, self-directed learning is positively associated with blended learning acceptance. We cannot draw conclusions about the direction of this effect. Self-directed students might use bPBL better, but it is also possible that a higher degree of acceptance of bPBL improves students’ self-directed learning.

While previous research suggested that self-efficacy was a strong predictor of perceived ease of use in e-learning acceptance [56], it was not associated with blended learning acceptance in this study. This might be explained by the fact that Japanese students take advantage of extensive prior experience with information and communication technology (ICT) [57]. Park [43] previously reported similar results on e-learning acceptance due to extensive internet experience among university students in Korea, another Asian country with a rich ICT environment. We observed that the usefulness of bPBL was positively correlated with self-directed learning. Usefulness is a fundamental factor in the success and adoption of an e-learning programme [58]. Teachers should commit to purposefully designing e-learning courses to reduce students’ anxiety and to enhance their satisfaction [59].

In contrast to our expectation, we did not observe any significant change in the perception of the authority of the tutor. Because PBL requires knowledge development grounded in discussion and rational argument rather than authority [60], authority has been usually considered a barrier to a suitable PBL environment. Hussain et al. [61] reported that the ‘Asian’ version of PBL requires greater authority on the part of tutors. However, implementing blended learning in PBL does not reduce perceptions of authority. PBL does not abandon all forms of authority: For example, it is the tutor’s role to create a participative, cooperative, reflective, and constructive atmosphere, and there are times when authority is required.

An explanation for our findings is that authority does not always mean authoritarian attitudes [62]. Weber’s model [63] breaks down authority into three types: traditional, legal-rational, and charismatic. Of these three, what happens in the relationship between the teacher and students in a traditional classroom is traditional authority, because the teacher tries to follow his or her management plan based on cultural or learned behaviour [64]. In the traditional learning environment, teachers also rely on charismatic authority to maintain a harmonious environment. These notions are also consistent with the belief that Asian students see teachers as authority figures [50]. On the other hand, legal-rational authority is established on the basis of rational values and established rules. In this type of authority, obedience is impersonal rather than individual [63]. As seen in the observations of a secondary school [64], authority generated from technology is legal-rational, because it functions under a rationally developed rule rather than a person, and can thus be associated with student-centred environments rather than teacher-centred ones. The results of our study, thus, might indicate that blended learning supplements legal-rational authority instead of traditional authority, with possibly remaining charismatic authority for harmony during discussions, and enhances students’ self-directedness through student-centred learning. In the context of bPBL, more empirical evidence is needed to ensure rigour.

Previously, it has been attempted in Asia to improve knowledge-gaining processes in PBL by implementing a hybrid PBL, which is a combined curriculum of lecture and PBL [65]. However, hybrid PBL is still more or less teacher-centred and does not focus primarily on the development of self-directed learning [27]. Our blended PBL with online quizzes was successful in retaining authority, while improving students’ self-efficacy and their learning motivation due to group discussions. As e-learning and online quizzes were provided by the faculty and functioned rationally, discussion grounded by knowledge from such resources might not diminish authority. Our ‘quiz-blended’ PBL is thus suitable for Asian learning environments because it can engage students in PBL while maintaining authority, which is essential in the Asian context.

Limitations

This study has several limitations. We did a quasi-experimental study and divided groups by rotation schedule. Ideally, it would have been a randomized experimental study. Currently, the possibility of confounding cannot be ruled out. Students differed in their experiences from other rotations and might have communicated with each other about the bPBL, which might have resulted in exchange of additional information. Also, we could not precisely reveal the benefits of blended learning environment because the original PBL did not include quizzes. Furthermore, a benefit of PBL in comparison to traditional learning strategies is its long-term effect [11]. Since we only evaluated after a short period, we recommend future research to investigate long-term effects of bPBL. For drawing stronger conclusions on our research question, a prospective randomized study design should be conducted.

Conclusions

The results of the study revealed that the effectiveness of PBL can be strengthened by combining with e-learning; moreover, students’ motivation for learning and self-efficacy improved. Thus, the more students are self-directed learners, the higher is their acceptance of the technology in bPBL.

By adding e-learning elements in PBL, we were able to stimulate knowledge-building in a student-centred way, thus supporting self-efficacy and self-directed learning without diminishing tutors’ authority. Therefore, we can conclude that an adjustment strategy of PBL is necessary to adapt it to the Asian context, where greater emphasis has been placed knowledge development grounded in tutors’ authority than in discussion and rational argument. By further improving the design of bPBL to promote the students’ acceptance, this effect could be amplified.

Acknowledgements

We appreciate the institutional e-learning management centre for supporting the implementation and management of the e-learning contents in this research.

Funding

This work was supported by the JSPS KAKENHI under Grant #15 K19145.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ANOVA

Analyses of variance

bPBL

Blended problem-based learning

CAT

Common Achievement Tests

CBT

Computer-based test

ICT

Information and communication technology

LMS

Learning management system

PBL

Problem-based learning

TAM

Technology acceptance model

Authors’ contributions

IS made substantial contributions to: conception and design, acquisition of data, analysis and interpretation of data as well as drafting the document the manuscript. KDK made substantial contributions to: conception and design, analysis and interpretation of data as well as drafting and critically revising the manuscript. IW made substantial contributions to conception and design and participated in the critical revision of the article. HN and YS made substantial contributions to design of the work, acquisition of data, as well as critically revising the manuscript. All the authors approved the final version of the manuscript to be submitted. Each author has participated sufficiently in the work to take public responsibility for appropriate portions of the content and each has agreed to be accountable for all aspects of the work.

Authors’ information

Ikuo Shimizu is an assistant professor at Center for Medical Education and Clinical Training, Shinshu University, Japan, and a PhD candidate at School of Health Professions Education, Maastricht University, the Netherlands. His research interest is collaborative learning in the Asian context. He holds Master of Health Professions Education at Maastricht University, the Netherlands.

Hideyuki Nakazawa is a lecturer at Department of Internal Medicine II, Shinshu University, Japan. His research interest in education is workplace learning at the clinical setting.

Yoshihiko Sato is an associate professor at Department of Internal Medicine IV, Shinshu University, Japan. His research interest in education is lecture strategies and clinical teaching.

Ineke Wolfhagen is an associate professor at Department of Educational Development and Research, Maastricht University, the Netherlands. She has expertise in management, consultancies and workshops on quality assurance and problem-based learning.

Karen D. Könings is an associate professor at Department of Educational Development and Research, Maastricht University, the Netherlands. Her main research interest is participatory design of education, to better account for the different perspectives of students, teachers, and educational designers.

Ethics approval and consent to participate

This study was approved by the Institutional Review Board of Shinshu University (#3247).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Ikuo Shimizu, Phone: +81 263-37-3359, Email: ishimizu@shinshu-u.ac.jp.

Hideyuki Nakazawa, Phone: +81 263-37-2634, Email: hnaka@shinshu-u.ac.jp.

Yoshihiko Sato, Phone: +81 263-37-2686, Email: ysato@shinshu-u.ac.jp.

Ineke H. A. P. Wolfhagen, Phone: +31(0)43 3885726, Email: i.wolfhagen@maastrichtuniversity.nl

Karen D. Könings, Phone: +31(0)43 3885728, Email: kd.konings@maastrichtuniversity.nl

References

  • 1.Örtenblad A, Babur M, Kumari R. Learning in Asia. Asia Pacific J Educ. 2012;32(2):131–136. [Google Scholar]
  • 2.Barrows HS, Tamblyn R. Problem-based learning: an approach to medical education. New York: Springer; 1980. [Google Scholar]
  • 3.Barrows HS. A taxonomy of problem-based learning methods. Med Educ. 1986;20(6):481–486. doi: 10.1111/j.1365-2923.1986.tb01386.x. [DOI] [PubMed] [Google Scholar]
  • 4.Albanese M, Mitchell SM. Problem-based learning: A Review of Literature on Its Outcomes and Implementation Issues. Acad Med. 1993;68(1):52–81. doi: 10.1097/00001888-199301000-00012. [DOI] [PubMed] [Google Scholar]
  • 5.Vernon DT, Blake RL. Does problem-based learning work? A meta-analysis of evaluative research. Acad Med. 1993;68(7):550–563. doi: 10.1097/00001888-199307000-00015. [DOI] [PubMed] [Google Scholar]
  • 6.Enarson C, Cariaga-Lo L. Influence of curriculum type on student performance in the United States medical licensing examination step 1 and step 2 exams: problem-based learning vs. lecture-based curriculum. Med Educ. 2001;35(11):1050–1055. doi: 10.1046/j.1365-2923.2001.01058.x. [DOI] [PubMed] [Google Scholar]
  • 7.Michel MC, Bischoff A, Jakobs KH. Comparison of problem-and lecture-based pharmacology teaching. Trends Pharmacol Sci. 2002;23(4):168–170. doi: 10.1016/s0165-6147(00)01940-4. [DOI] [PubMed] [Google Scholar]
  • 8.Newman M, Van den BP, Gijbels D, McKendree J, Roberts T, Rolfe I, et al. Responses to the pilot systematic review of problem-based learning. Med Educ. 2004;38(9):921–923. doi: 10.1111/j.1365-2929.2004.01943.x. [DOI] [PubMed] [Google Scholar]
  • 9.Mennin S, Gordan P, Majoor G, Osman HAS. Network: TUFH. Position paper on problem-based learning. Educ Health (Abingdon) 2003;16(1):98–113. doi: 10.1080/1357628031000066633. [DOI] [PubMed] [Google Scholar]
  • 10.Lycke KH, Grøttum P, Strømsø HI. Student learning strategies, mental models and learning outcomes in problem-based and traditional curricula in medicine. Med Teach. 2006;28(8):717–722. doi: 10.1080/01421590601105645. [DOI] [PubMed] [Google Scholar]
  • 11.Schmidt HG, Vermeulen L, van der Molen HT. Longterm effects of problem-based learning: a comparison of competencies acquired by graduates of a problem-based and a conventional medical school. Med Educ. 2006;40(6):562–567. doi: 10.1111/j.1365-2929.2006.02483.x. [DOI] [PubMed] [Google Scholar]
  • 12.Dolmans DHJM, De Grave W, Wolfhagen IHAP, Van Der Vleuten CPM. Problem-based learning: future challenges for educational practice and research. Med Educ. 2005;39(7):732–741. doi: 10.1111/j.1365-2929.2005.02205.x. [DOI] [PubMed] [Google Scholar]
  • 13.Zimmerman BJ. A social cognitive view of self-regulated academic learning. J Educ Psychol. 1989;81(3):329. [Google Scholar]
  • 14.Loyens SMM, Magda J, Rikers RMJP. Self-directed learning in problem-based learning and its relationships with self-regulated learning. Educ Psychol Rev. 2008;20(4):411–427. [Google Scholar]
  • 15.Densen P. Challenges and opportunities facing medical education. Trans Am Clin Climatol Assoc. 2011;122:48–58. [PMC free article] [PubMed] [Google Scholar]
  • 16.MC-E G. Globalization of problem-based learning (PBL): cross-cultural implications. Kaohsiung J Med Sci. 2008;24(3):S14–S22. doi: 10.1016/s1607-551x(08)70089-5. [DOI] [PubMed] [Google Scholar]
  • 17.Keng Gie EK. A problem-based approach to learning economics: an experiment in Progress at the Ngee Ann Polytechnic. Sing J Educ. 1989;10(1):60–65. [Google Scholar]
  • 18.Khoo HE. Implementation of problem-based learning in Asian medical schools and students’ perceptions of their experience. Med Educ. 2003;37(5):401–409. doi: 10.1046/j.1365-2923.2003.01489.x. [DOI] [PubMed] [Google Scholar]
  • 19.Ministry of Education, Culture, Sports, science and technology. Model core curriculum in medical education, the 2016 revised version. 2016. Available from: http://www.mext.go.jp/component/b_menu/shingi/toushin/__icsFiles/afieldfile/2017/06/28/1383961_01.pdf.
  • 20.Kozu T. Medical education in Japan. Acad Med. 2006;81(12):1069–1075. doi: 10.1097/01.ACM.0000246682.45610.dd. [DOI] [PubMed] [Google Scholar]
  • 21.Colleges . The current status of medical curriculum in Japan. Tokyo: Association of Japanese Medical colleges; 2016. A of JM. Problem-based learning and team-based learning. [Google Scholar]
  • 22.Tomise N. Association of Japanese Medical Colleges, editor. Tokyo: White paper on Japanese medical schools of Japan; 2016. Problem-based learning. [Google Scholar]
  • 23.Matsuo O. Questionnaire survey about problem-based learning tutorial system. Medical Education (Japan) 2013;44(1):37–40. [Google Scholar]
  • 24.Oda Y, Koizumi S. Status of medical education reform at Saga medical school 5 years after introducing PBL. Kaohsiung J Med Sci. 2008;24(3):S46–S53. doi: 10.1016/s1607-551x(08)70094-9. [DOI] [PubMed] [Google Scholar]
  • 25.O’Neill PA. The role of basic sciences in a problem-based learning clinical curriculum. Med Educ. 2000;34(8):608–613. doi: 10.1046/j.1365-2923.2000.00629.x. [DOI] [PubMed] [Google Scholar]
  • 26.Kwok P. Examination-oriented knowledge and value transformation in east Asian cram schools. Asia Pacific Educ Rev. 2004;5(1):64–75. [Google Scholar]
  • 27.Frambach JM, Driessen EW, Chan LC, Van der Vleuten CPM. Rethinking the globalisation of problem-based learning: how culture challenges self-directed learning. Med Educ. 2012;46(8):738–747. doi: 10.1111/j.1365-2923.2012.04290.x. [DOI] [PubMed] [Google Scholar]
  • 28.Graham CR. Emerging practice and research in blended learning. In: MG M, editor. Handbook of distance education. 3. New York: Routledge; 2013. [Google Scholar]
  • 29.Turney CSM, Robinson D, Lee M, Soutar A. Using technology to direct learning in higher education. Act Learn High Educ. 2009;10(1):71–83. [Google Scholar]
  • 30.Ng ML, Bridges S, Law SP, Whitehill T. Designing, implementing and evaluating an online problem-based learning (PBL) environment--a pilot study. Clin Linguist Phon. 2014;28(1–2):117–130. doi: 10.3109/02699206.2013.807879. [DOI] [PubMed] [Google Scholar]
  • 31.de Jong N, Maggi Savin-Baden B, Anne Marie Cunningham B, Daniëlle L Verstegen BM, de Jong N, Savin-Baden M, et al. Blended learning in health education: three case studies. Perspect Med Educ. 2014;3:278–288. doi: 10.1007/s40037-014-0108-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Back DA, Haberstroh N, Antolic A, Sostmann K, Schmidmaier G, Hoff E. Blended learning approach improves teaching in a problem-based learning environment in orthopedics - a pilot study. BMC Med Educ. 2014;14:17. doi: 10.1186/1472-6920-14-17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Starenko M, Vignare K, Humbert J. Enhancing student interaction and sustaining faculty instructional innovations through blended learning. In: Picciano A, Dzubian C, editors. Blending learning: research perspectives. Newburyport, MA: online learning consortium. 2007. pp. 161–178. [Google Scholar]
  • 34.Woltering V, Herrler A, Spitzer K, Spreckelsen C. Blended learning positively affects students’ satisfaction and the role of the tutor in the problem-based learning process: results of a mixed-method evaluation. Adv Heal Sci Educ. 2009;14(5):725–738. doi: 10.1007/s10459-009-9154-6. [DOI] [PubMed] [Google Scholar]
  • 35.Spanjers IAE, Könings KD, Leppink J, Verstegen DML, de Jong N, Czabanowska K, et al. The promised land of blended learning: quizzes as a moderator. Educ Res Rev. 2015;15:59–74. [Google Scholar]
  • 36.Dirkx KJH, Kester L, Kirschner PA. The testing effect for learning principles and procedures from texts. J Educ Res. 2014;107(5):357–364. [Google Scholar]
  • 37.Butler AC, Karpicke JD, Roediger HL. Correcting a metacognitive error: feedback increases retention of low-confidence correct responses. J Exp Psychol Learn Mem Cogn. 2008;34(4):918–928. doi: 10.1037/0278-7393.34.4.918. [DOI] [PubMed] [Google Scholar]
  • 38.Bartini M. An empirical comparison of traditional and web-enhanced classrooms. J Instr Psychol. 2008;35(1):3–12. [Google Scholar]
  • 39.Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191–215. doi: 10.1037//0033-295x.84.2.191. [DOI] [PubMed] [Google Scholar]
  • 40.Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989;13(3):319–340. [Google Scholar]
  • 41.Legris P, Ingham J, Collerette P. Why do people use information technology? A critical review of the technology acceptance model. Inf Manag. 2003;40(3):191–204. [Google Scholar]
  • 42.Pituch KA, Lee Y. The influence of system characteristics on e-learning use. Comput Educ. 2006;47(2):222–244. [Google Scholar]
  • 43.Park SY. An analysis of the technology acceptance model in Understanding University students’ behavioral intention to use e-learning. J Educ Technol Soc. 2009;12(3):150–162. [Google Scholar]
  • 44.Tselios N, Daskalakis S, Papadopoulou M. Assessing the acceptance of a blended Learning University course. Educ Technol Soc. 2011;14(2):224–235. [Google Scholar]
  • 45.Demirören M, Turan S, Öztuna D. Medical students’ self-efficacy in problem-based learning and its relationship with self-regulated learning. Med Educ Online. 2016;21:30049. doi: 10.3402/meo.v21.30049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Schmidt HG. Problem-based learning: rationale and description. Med Educ. 1983;17:11–16. doi: 10.1111/j.1365-2923.1983.tb01086.x. [DOI] [PubMed] [Google Scholar]
  • 47.Dolmans D, Schmidt HG. What drives the student in problem-based learning? Med Educ. 1994;28(5):372–380. doi: 10.1111/j.1365-2923.1994.tb02547.x. [DOI] [PubMed] [Google Scholar]
  • 48.Pintrich PR, De Groot EV. Motivational and self-regulated learning components of classroom academic performance. J Educ Psychol. 1990;82(1):33–40. [Google Scholar]
  • 49.Dolmans DHJM, Wolfhagen IHAP, van der Vleuten CPM. Thinking about student thinking: motivational and cognitive processes influencing tutorial groups. Acad Med. 1998;73(10):22–24. doi: 10.1097/00001888-199810000-00034. [DOI] [PubMed] [Google Scholar]
  • 50.Littlewood W. Do Asian students really want to listen and obey? ELT J. 2000;54(1):31–36. [Google Scholar]
  • 51.Cohen J. Statistical power analysis for the behavioral sciences. New York: Routledge; 1988. [Google Scholar]
  • 52.Harland T. Moving towards problem-based learning. Teach High Educ. 1998;3(2):219–230. [Google Scholar]
  • 53.Nishigori H, Harrison R, Busari J, Dornan T. Bushido and medical professionalism in Japan. Acad Med. 2014;89(4):560–563. doi: 10.1097/ACM.0000000000000176. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Walker A, Bridges E, Chan B. Wisdom gained, wisdom given: instituting PBL in a Chinese culture. J Educ Adm. 1996;34(5):12–31. [Google Scholar]
  • 55.Bray M. In: Bray M, editor. Comparative education: continuing traditions, new challenges, and new paradigms (Vol. 7): Dordrecht: Kluwer Academic; 2003.
  • 56.Venkatesh V, Davis FD. A model of the antecedents of perceived ease of use: development and test. Decis Sci. 1996;27(3):451. [Google Scholar]
  • 57.International Telecommunication Union. Measuring the Information Society Report 2017. Available from: https://www.itu.int/en/ITU-D/Statistics/Documents/publications/misr2017/MISR2017_Volume1.pdf.
  • 58.Liaw S-S. Investigating students’ perceived satisfaction, behavioral intention, and effectiveness of e-learning: a case study of the blackboard system. Comput Educ. 2008;51(2):864–873. [Google Scholar]
  • 59.Sun P-C, Tsai RJ, Finger G, Chen Y-Y, Yeh D. What drives a successful e-learning? An empirical investigation of the critical factors influencing learner satisfaction. Comput Educ. 2008;50(4):1183–1202. [Google Scholar]
  • 60.Barnett R. Higher education: a critical business. London: McGraw-hill education; 1997. [Google Scholar]
  • 61.Hussain RMR, Mamat WHW, Salleh N, Saat RM, Harland T. Problem-based learning in Asian universities. Stud High Educ. 2007;32(6):761–772. [Google Scholar]
  • 62.Peters RS. Authority, responsibility and education. New York: Eriksson; 1959.
  • 63.Weber M. The theory of social and economic organization. New York: Oxford University Press; 1947.
  • 64.Pellegrino AM. Pre-service teachers and classroom authority. Am Second Educ. 2010;38(3):62–78. [Google Scholar]
  • 65.Armstrong EG. A hybrid model of PBL. In: Boud D, Feletti G, editors. The challenge of problem-based learning. London: Kogan Page; 1991. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.


Articles from BMC Medical Education are provided here courtesy of BMC

RESOURCES