Abstract
Background:
A meta-analysis was conducted to assess the effectiveness of problem-based learning (PBL) in gynecology and obstetrics education in China.
Methods:
English and Chinese databases were systematically searched for eligible studies that compared the effects of PBL and traditional teaching methods measuring theoretical knowledge, student satisfaction, clinical operations, and clinical practice scores in gynecology and obstetrics education in China. The authors restricted included studies to randomized controlled trials and performed a meta-analysis. Standardized mean difference (SMD) and risk ratio with 95% confidence interval (CI) were estimated
Results:
A total of 38 randomized controlled trials with 3005 participants were included. Compared with traditional teaching group, the PBL group significantly increased theoretical knowledge scores (SMD: 3.17, 95% CI: 2.28, 4.07), student satisfaction (risk ratio: 1.29, 95% CI: 1.16, 1.43), clinical operations (SMD: 1.15, 95% CI: 0.93, 1.37) and clinical practice (SMD: 2.17, 95% CI: 3.63, 2.71).
Conclusion:
The current research shows that PBL in gynecology and obstetrics education in China is more effective than the traditional teaching in enhancing theoretical knowledge, student satisfaction, clinical operations, and clinical practice scores. However, more delicate-designed studies on this topic are needed in the future to validate these results.
Keywords: gynecology and obstetrics, meta-analysis, randomized controlled trials
1. Introduction
Problem-based learning (PBL), an innovative approach in medical education, was originally introduced at McMaster University in the late[1] 1960s. It is a student-centered, teacher-directed education method that uses real problems as the context of learning and acquires knowledge actively[2] and innovatively. Nowadays, it has been widely used in many training programs under various circumstances.[3] As shown in the previous literature,[4–6] PBL students would sometimes outperform the students with traditional teaching methods, but sometimes did not. Besides, the results would also be different when considering the different outcomes such as knowledge- and skills-related outcomes.
As 1 expert review[7] pointed out, the changing of generations means the corresponding modification of the teaching method in education. The online PBL has already been an example of e-learning.[8] Moreover, due to the recent improvements in the education approach in China, an increasing number of training programs chose PBL as one of the experimental educational methods[3,9] in multiple majors. However, the implementation of PBL in medical education is still a novel teaching method in China since the different educational system and cultural background. Most Chinese students have not received this kind of education since the beginning of primary school their primary school.[10] There is no published study indicating whether PBL is superior to traditional teaching methods in obstetrics and gynecology education or not. The aim of the current meta-analysis was to investigate the effectiveness of PBL compared with the traditional teaching methods in Chinese obstetrics and gynecology education focusing on theoretical knowledge, student satisfaction, clinical operation, and clinical practice.
2. Methods
2.1. Data sources
The following English and Chinese databases were searched systematically: China National Knowledge Infrastructure, Wanfang Data (WAN-FANGDATA), CQVID, PubMed, EMBASE, and Cochrane Database using the following terms: (PBL OR [problem-based learning]) AND (obstetrics and gynecology). The publishing dates of including articles were from January 1, 2015 to the searching date: February 22, 2020 without any language restriction. Reference lists of primary articles were reviewed for more extra literature. The present study does not need ethical approval since all analyses were based on previously published studies,
2.2. Inclusion criteria and study selection
Inclusion criteria are as follows:
-
(1)
target population: obstetrics and gynecology medical students, interns or resident doctors in China;
-
(2)
study design: controlled trials in obstetrics and gynecology education;
-
(3)
interventions: PBL teaching in the experimental group and traditional teaching in the control group;
-
(4)
outcome measurements: student satisfaction, clinical operation score, theoretical knowledge score, and clinical practice scores.
Meanwhile, we excluded studies with insufficient data for calculating effect sizes. All of the titles and abstracts were reviewed independently by the 2 reviewers (SWB, JYL). Any differences were resolved through consensus, and if necessary, a senior reviewer (RQL) was consulted.
2.3. Data extraction and quality assessment.
This process was conducted independently by the 2 reviewers (SWB, JYL) by the Cochrane Collaboration for Systematic Reviews guidelines.[11] Relevant data from the eligible studies were extracted including the 1st author's name, the published date, the study type, the number of participants, median age, duration of study, population, intervention, and outcome measurements. The methodologic quality of each study was evaluated based on the assessment of the following items: random sequence generation, allocation sequence concealment, blinding of participants and personnel, blinding of the outcome assessment, incomplete outcome data, selective reporting, and other biases. For each study, every item was rated as “low risk of bias,” “high risk of bias,” or “unclear risk of bias.”[12]
2.4. Subgroup analysis and statistical analysis
Standardized mean difference (SMD) for continuous outcomes, risk ratio for dichotomous outcomes with 95% confidence interval (CI), was calculated for each study. Studies were then pooled together using SMD as appropriate with 2-sided P < .05 considered as statistically significant. The Q-statistic was calculated to examine result heterogeneity among studies, and P < .10 was considered significant. The authors first used the fixed-effects model with the assumption that the included studies were homogenous with P > .10; otherwise, the random-effects model was applied. The I2 statistic was also calculated to efficiently test for the heterogeneity, with I2 < 25%, 25% to 75%, and >75% to represent a low, moderate, and high degree of inconsistency, respectively.[13] Moreover, we ran influence[14,15] analysis for each outcome in the random model to find out the contribution of each study to the pooled effect and overall heterogeneity. Influence analysis is based on the Leave-One-Out-method, in which we recalculate the results of our meta-analysis K−1 times, each time leaving out 1 study. (K equals to the number of included studies) This way, studies that influence the overall estimate of meta-analysis the most would be detected. Publication bias was examined in contour-enhanced[16] funnel plots where 3 studies with most heterogeneity contributions were highlighted. After excluding these 3 most heterogenous studies, we conducted a subgroup analysis to detect the source of heterogeneity further based on the populations. The meta-analysis and illustrations were performed using R 3.6.2 with packages[17–20]: “gemtc,” “rjags,” and “dmetar,” and “ggplot2.”
3. Results
3.1. Search results
The flowchart for the study selection process is shown in Figure 1. A total of 519 studies was selected from databases for further screening. We excluded 13 duplicated articles and 422 other articles because of inappropriate topics (n = 327), lack of abstract (n = 15), unanticipated target population (n = 16) and publishing restriction (n = 80). After assessing articles with full text, 30 studies were excluded since the different outcomes from our studies. In the end, a total of 38 controlled studies with 1494 participants in the PBL group and 1511 participants in traditional teaching groups were included for this meta-analysis.[21–58]
Figure 1.

Flowchart for searching and identifying eligible studies.
3.2. Study characteristics
The characteristics of included 38 studies are shown in Table 1. All of them were published in Chinese between 2015 and 2020 with an assessment of the effects of PBL compared with traditional teaching in obstetrics and gynecology courses. The sample sizes ranged from 31 to 218 with a median of 71. The majority of studies focused on the interns (n = 21) and 12 studies for medical students, 3 for resident doctors, 1 for foreign students, and 1 for master's degree students. We combined the foreign students with medical students for the following subgroup analysis. Twelve studies are missing duration data while 12 studies chose 12 months as the study duration. For bringing in as little bias as possible, we only included the studies with duration longer than 6 months in the meta-analysis (n = 21). The most frequent outcome is theoretical knowledge scores which was used to assess how well the students mastered the related theoretical knowledge. The scores in the clinical practical evaluate the students’ clinical practice including medical history collecting, physical examination, and case presentation. Measurements on how students perform during operation test and their satisfaction towards teaching are clinical operation scores and student satisfaction, respectively.
Table 1.
The detailed baseline characteristics of all included studies.
| Author | Publication time | Study type | Populations | M/F | No. of PBL group | Mean Age of PBL group | No. of traditional teaching group | Mean Age of traditional teaching group | Study Duration (mo) | Outcomes |
| HJ Chen[21] | 2020 | RCT | Resident Doctor | 7/65 | 36 | 38.58 | 36 | 37.10 | 12 | SS, CO, TK |
| WH Huang[22] | 2019 | RCT | Interns | 15/55 | 35 | 23 | 35 | 21.9 | 13 | CO, TK, CP |
| K Wang[23] | 2019 | RCT | Interns | 8/92 | 50 | 20.4 | 50 | 21.5 | 26 | TK, CP |
| HQ Wang[24] | 2019 | RCT | Interns | 6/54 | 30 | 21.2 | 30 | 21.2 | 1 | TK |
| YH Jiao[25] | 2019 | RCT | Interns | 27/29 | 28 | 24.38 | 28 | 25.01 | 17 | CO, TK |
| YD Yang[26] | 2019 | RCT | Medical students | 38/42 | 40 | 20.12 | 40 | 20.52 | 12 | TK, CP |
| L Li[27] | 2019 | RCT | Medical students | 5/115 | 60 | 22.9 | 60 | 23.2 | 9 | TK, CP |
| Y Li[28] | 2019 | RCT | Resident Doctor | 34/66 | 50 | 22.47 | 50 | 21.06 | 24 | SS, TK, CP |
| YJ Zhang[29] | 2019 | RCT | Interns | 47/33 | 40 | 20.12 | 40 | 22.12 | 12 | SS, CP |
| XP Shang[30] | 2019 | RCT | Medical students | 44/47 | 29 | 20.17 | 62 | 20.34 | NA | TK |
| Q Han[31] | 2018 | RCT | Interns | All female | 22 | 22.5 | 22 | 22.5 | 12 | SS, CO, TK |
| LS Guo[32] | 2018 | RCT | Medical students | NA | 60 | NA | 60 | NA | NA | SS, TK |
| HJ Zhen[33] | 2018 | RCT | Interns | All female | 30 | 21.3 | 30 | 21.3 | 12 | SS |
| LJ Zhen[34] | 2018 | RCT | Resident Doctor | 17/17 | 18 | 25.26 | 16 | 25.05 | 24 | SS, CO, TK |
| YY Wang[35] | 2018 | RCT | Interns | 9/81 | 45 | 23.4 | 45 | 22.5 | 12 | CO, TK |
| HX Wang[36] | 2018 | RCT | Interns | NA | 30 | 21.6 | 30 | 21.1 | 3 | CO, TK, CP |
| ZL Wang[37] | 2018 | RCT | Master | NA | 19 | NA | 12 | NA | NA | TK, CP |
| XM Shen[38] | 2018 | RCT | Medical students | 40/44 | 44 | 20.6 | 42 | 20.8 | NA | SS, CO, TK |
| X Li[39] | 2018 | RCT | Medical students | NA | 50 | NA | 50 | NA | NA | TK |
| FF Zhu[40] | 2018 | RCT | Interns | All female | 40 | NA | 40 | NA | NA | CO, TK |
| X Zhang[41] | 2018 | RCT | Medical students | NA | 20 | 21.35 | 21 | 21.35 | NA | SS, TK |
| JH Dang[42] | 2018 | RCT | Medical students | NA | 28 | NA | 28 | NA | NA | CO, TK |
| WZ Chen[43] | 2017 | RCT | Medical students | NA | 30 | NA | 31 | NA | NA | SS, TK |
| YY Wang[44] | 2017 | RCT | Interns | 65/55 | 60 | 18 | 60 | 19 | NA | SS, CO, TK |
| XF Tang[45] | 2017 | RCT | Interns | NA | 30 | NA | 28 | NA | 9 | CO, TK |
| Y Hua[46] | 2017 | RCT | Interns | 54/78 | 66 | 23.3 | 66 | 23.5 | 12 | TK |
| HY Liu[47] | 2017 | RCT | Medical students | 35/25 | 30 | 20.31 | 30 | 20.2 | 4 | SS, TK |
| WJ Hou[48] | 2017 | RCT | Interns | 84/164 | 109 | 23.8 | 109 | 23.8 | 12 | TK, CP |
| ZJ Gao[49] | 2016 | RCT | Interns | 11/59 | 35 | 24.06 | 35 | 24.11 | 2 | CO, TK |
| JH Han[50] | 2016 | RCT | Interns | All female | 20 | 22.7 | 20 | 22.7 | 15 | SS, CO |
| XL Wang[51] | 2016 | RCT | Medical students | 26/54 | 40 | 24.3 | 40 | 24.3 | 12 | SS, CO, TK |
| HX Wang[52] | 2016 | RCT | Medical students | NA | 40 | NA | 39 | NA | NA | TK |
| YH Li[53] | 2016 | RCT | Interns | 12/86 | 49 | 22 | 49 | 22 | 39 | CP |
| DY Zhu[54] | 2016 | RCT | Interns | 28/32 | 30 | NA | 30 | NA | NA | CO, TK |
| F He[55] | 2016 | RCT | Interns | 2/58 | 30 | NA | 30 | NA | 12 | SS, CO |
| MF Lin[56] | 2015 | RCT | Interns | NA | 56 | NA | 52 | NA | 12 | TK |
| CD Liu[57] | 2015 | RCT | Foreign students | 21/39 | 30 | 25.31 | 30 | 25.41 | 6 | TK |
| CY Mai[58] | 2015 | RCT | Interns | All female | 35 | 22.5 | 35 | 21.8 | 12 | CO, TK |
3.3. Study quality assessment
The summary risk of bias assessment of the 38 included studies was illustrated in Figure 2. The authors showed the results of each quality item as percentages across studies. Although all studies claimed randomized controlled trial (RCT)-designed, 16 studies are ambiguous about random sequence generation and all studies did not clarify the blinding of participants and personnel and blinding of the outcome assessment. We downgraded the 12 studies without clear definition of follow-up duration accordingly in the other bias section. All studies reported complete outcome data and were free of selective reporting.
Figure 2.

Summary of risk of bias in the included randomized controlled trials.
3.4. Meta-analysis result for theoretical knowledge
Nineteen studies reported on theoretical knowledge score results. There were 827 participants in PBL group and 843 participants in traditional teaching group. The influence diagnostics analysis showed WJ Hou, L Li, and Y Li are the 3 studies with most heterogeneity (Fig. 3A and see Supplementary Content). After excluding the study of WJ Hou, L Li, and Y Li, the meta-analysis results showed the PBL group significantly increased theoretical knowledge scores by a standardized mean of 3.17 compared with those of the traditional teaching model (95% CI: 2.28, 4.07, Fig. 4). However, the heterogeneity was still significant in the pooled effect (I2 = 98%, P < .01) and also subgroups.
Figure 3.

Contour-enhanced funnel plots. (A) Potential publication bias in the meta-analysis for theoretical knowledge scores. (B) Potential publication bias in the meta-analysis for student satisfaction. (C) Potential publication bias in the meta-analysis for clinical practice. (D) Potential publication bias in the meta-analysis for clinical operation. Each dot represents 1 study and the studies which were excluded from further meta-analysis are annotated with authors’ name.
Figure 4.

Forest plot and subgroups analysis results for theoretical knowledge scores. Experimental: problem-based learning method. Control: traditional teaching method. CI = confidence interval, SD = standard deviation, SMD = standardized mean difference.
3.5. Meta-analysis result for student satisfaction
A total of 8 studies reported on student satisfaction on a dichotomous scale. Two hundred thirty-nine participants were enrolled in the PBL group and 256 participants in the traditional teaching group. The studies conducted by XM Shen, YJ Zhang, and HJ Chen are the 3 studies with most heterogeneity (Fig. 3B and see Supplementary Content). After excluding these studies, the meta-analysis of the student satisfaction found that the PBL teaching model significantly increased student satisfaction compared with the traditional teaching model (risk ratio: 1.29, 95% CI: 1.16, 1.43, Fig. 5). There was insignificant heterogeneity in pooled effect (I2 = 0%, P = .75).
Figure 5.

Forest plot and subgroups analysis results for student satisfaction. Experimental: problem-based learning method. Control: traditional teaching method. CI = confidence interval, RR = risk ratio.
3.6. Meta-analysis result for clinical practice
Ten studies reported their results regarding clinical practice. There were 318 participants in the PBL group and 312 participants in the traditional teaching group. The influence diagnostics analysis showed HJ Chen, YY Wang, and XL Wang are the 3 studies with most heterogeneity which we excluded before the meta-analysis (Fig. 3C and see Supplementary Content). Compared with the traditional teaching model, the PBL teaching model significantly increased the clinical practice score (SMD: 2.17, 95% CI: 1.63, 2.71, Fig. 6). The heterogeneity was significant across the pooled effect result (I2 = 77%, P < .01) and subgroup results.
Figure 6.

Forest plot and subgroups analysis results for clinical practice. Experimental: problem-based learning method. Control: traditional teaching method. CI = confidence interval, SD = standard deviation, SMD = standardized mean difference.
3.7. Meta-analysis result for clinical operation
As for clinical practice scores, 5 studies reported on a continuous scale. Two hundred thirty-nine participants were enrolled in the PBL group and 256 the traditional teaching group, respectively. Since the rather small number of studies, we did not exclude any studies (Fig. 3D and see Supplementary Content). The meta-analysis results showed that the PBL teaching model increased clinical operation scores significantly compared with traditional teaching (SMD: 1.15, 95% CI: 0.93, 1.37, Fig. 7). Significant heterogeneity was found in the pooled effect (I2 = 98%, P < .01) and also subgroups.
Figure 7.

Forest plot and subgroups analysis results for clinical operation. Experimental: problem-based learning method. Control: traditional teaching method. CI = confidence interval, SD = standard deviation, SMD = standardized mean difference.
4. Discussion
As compared with the traditional teaching model, 1 central idea of PBL is that the learning situation activates prior knowledge, facilitates learning new knowledge. It is resembling the ways in which knowledge will be demanded in real-world situations, through which students can increase the probability of recalling and applying what is stored in memory.[59] This was supported by the results that the PBL group showed significant improvements in the theoretical knowledge exam compared with the traditional teaching group. However, when we interpret such a result, it should be noticed that there are many factors that affect the exam scores. Feeley et al[60] asserted that important factors such as motivation, learning skills, and study methods should be taken into account which makes it difficult to make solid conclusions about the effect of PBL and traditional teaching method take in theoretical knowledge scores.
Moreover, the scores of clinical practices are based on items such as medical history collecting, physical examination, case presentation, and diagnosis. The assessment of clinical operation takes more emphasis on operation capability. For students in gynecology and obstetrics,[61] it is important to not only be a theoretical knowledge learner, but also a clinical practitioner. Our study also showed better clinical practices and operation scores in the PBL group compared with traditional teaching group. These results were contrary to an earlier study conducted in England,[62] which concluded that, no measurable difference observed in clinical evaluations comparing basic science education by traditional and PBL. Notably, a significant improvement of knowledge-related outcomes in PBL group were reported in several published articles globally.[63–65] The discrepancy between the knowledge- and skill related outcomes in China and other countries could be explained by several factors. Firstly, given the fact that PBL model is such a novelty for most of Chinese students, it would stimulate their interest in learning[66] greatly. Another point is that, in the PBL group, students[67] usually would have more contacts with teachers. The habit of clinical thinking would probably be exercised more frequently.
Another crucial parameter of the effectiveness of one teaching method is student satisfaction. PBL has shown a consistent popularity among students in different courses,[68] which is also the case in our study. In previous studies[63,64] conducted specifically in obstetrics and gynecology courses in India and USA, researchers have demonstrated that, compared to the traditional teaching group, the PBL method resulted in better outcomes of critical thinking, problem solving skills, and greater learning satisfaction. Similarly, Sally et al[66] showed that the PBL method was associated with improved student and faculty satisfaction. Several important points were reported to be the key players in achieving such popularity including small group size, realistic case scenarios.[68] Organizers should focus on these factors when designing and constructing the courses. Other studies also showed PBL resulted in better outcomes such as communication skills, critical thinking, and passion for learning. The authors did not measure these outcomes since the number of studies is relatively small and a not reliable result could be obtained.
The heterogeneity of the current study is one non-negligible concern when interpreting our results. Interestingly, the heterogeneity did not significantly alter after influence diagnosis and subgroup analysis, except the teaching satisfaction which heterogeneity of pooled effect could be partially explained by the subgroup stratification. However, the comparatively small number of studies in most of the subgroups and large credential interval makes it hard to draw solid conclusion within subgroups. Many factors could contribute to heterogeneity. Firstly, the methodologies to implement the PBL were not unified in China, such as the time distribution of each procedure in PBL. Second, the organizers who are actually teaching students would be another potential contributor to the heterogeneity since the learning process could be seriously impacted by the teachers’ performances. The learning habit of students is also an important source that is hard to unify.
Other than the obvious heterogeneity, the current research has a few other limitations. For example, the current work is based on the RCTs which is restricted to China. Moreover, although, our study enrolled RCTs mostly, all these trials have an unclear bias in terms of blinding of participants and personnel and blinding of outcome assessment. This would inevitably undermine the methodological quality of our study.
To sum up, the current study focused on the effectiveness of PBL in obstetrics and gynecology education in China compared with the traditional teaching method. The results showed significant improvements in theoretical knowledge, student satisfaction, clinical practice, and clinical operation in the PBL group. Nonetheless, more delicate-designed studies on this topic are needed in the future to validate these results.
Author contributions
Conceptualization: Jun Gu.
Data curation: Siwei Bi, Ruiqi Liu, Jingyi Li, Jun Gu.
Formal analysis: Siwei Bi, Ruiqi Liu, Jingyi Li, Jun Gu.
Funding acquisition: Siwei Bi, Ruiqi Liu, Jun Gu.
Investigation: Siwei Bi, Ruiqi Liu, Jingyi Li, Jun Gu.
Methodology: Siwei Bi, Ruiqi Liu, Jingyi Li, Jun Gu.
Project administration: Siwei Bi, Ruiqi Liu, Jun Gu.
Resources: Siwei Bi, Ruiqi Liu, Jun Gu.
Software: Siwei Bi, Ruiqi Liu, Jun Gu.
Supervision: Siwei Bi, Ruiqi Liu, Jun Gu.
Validation: Siwei Bi, Ruiqi Liu, Jingyi Li, Jun Gu.
Visualization: Siwei Bi, Ruiqi Liu, Jun Gu.
Writing – original draft: Siwei Bi, Ruiqi Liu.
Writing – review & editing: Siwei Bi, Ruiqi Liu, Jun Gu.
Supplementary Material
Footnotes
Abbreviations: CI = confidence interval, PBL = problem-based learning, RCT = Randomized controlled trials, SMD = standardized mean difference.
How to cite this article: Bi S, Liu R, Li J, Gu J. The effectiveness of problem-based learning in gynecology and obstetrics education in China: a meta-analysis of randomized controlled trials. Medicine. 2021;100:9(e24660).
SB and RL contributed equally to this work.
The authors have no conflicts of interest to disclose.
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Supplemental digital content is available for this article.
CO = clinical operation, CP = clinical practice, KS = knowledge scores, PBL = problem-based learning, SS = student satisfaction.
References
- [1].Neufeld VR, Barrows HS. The “McMaster Philosophy”: an approach to medical education. J Med Educ 1974;49:1040–50. [PubMed] [Google Scholar]
- [2].Wood DF. Problem based learning. BMJ 2003;326:328–30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [3].Rui Z, Rong-Zheng Y, Hong-Yu Q, et al. Preliminary investigation into application of problem-based learning in the practical teaching of diagnostics. Adv Med Educ Pract 2015;6:223–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [4].Khobragade S, Abas AL, Khobragade YS. Comparative study on the measurement of learning outcomes after powerpoint presentation and problem based learning with discussion in family medicine amongst fifth year medical students. J Family Med Prim Care 2016;5:298–301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [5].Khatiban M, Falahan SN, Amini R, et al. Lecture-based versus problem-based learning in ethics education among nursing students [published online ahead of print, 2018 Jan 1]. Nursing ethics 2018;26:1753–64. [DOI] [PubMed] [Google Scholar]
- [6].Dochy F, Segers M, Van den Bossche P, et al. Effects of problem-based learning: a meta-analysis. Learn Instr 2003;13:533–68. [Google Scholar]
- [7].Hopkins L, Hampton BS, Abbott JF, et al. To the point: medical education, technology, and the millennial learner. Am J Obstet Gynecol 2018;218:188–92. [DOI] [PubMed] [Google Scholar]
- [8].Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med 2006;81:207–12. [DOI] [PubMed] [Google Scholar]
- [9].Zhang Y, Zhou L, Liu X, et al. The effectiveness of the problem-based learning teaching model for use in introductory Chinese undergraduate medical courses: a systematic review and meta-analysis. PLoS One 2015;10:e0120884. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [10].Xie Y, Yang ZZ, Chai BC. Application of problem-based learning (PBL) in clinical teaching in pediatrics [in Chinese]. China Higher Med Educ 2008;12:18–9. [Google Scholar]
- [11].Higgins JP, Thomas J, Chandler J, et al. Cochrane handbook for systematic reviews of interventions. John Wiley & Sons 2019. [Google Scholar]
- [12].Higgins JP, Altman DG, Gotzsche PC, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [13].Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ 2003;327:557–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14].Viechtbauer W, Cheung MW. Outlier and influence diagnostics for meta-analysis. Res Synth Methods 2010;1:112–25. [DOI] [PubMed] [Google Scholar]
- [15].Baujat B, Mahé C, Pignon JP, et al. A graphical method for exploring heterogeneity in meta-analyses: application to a meta-analysis of 65 trials. Stat Med 2002;21:2641–52. [DOI] [PubMed] [Google Scholar]
- [16].Peters JL, Sutton AJ, Jones DR, et al. Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. J Clin Epidemiol 2008;61:991–6. [DOI] [PubMed] [Google Scholar]
- [17].Harrer M, Cuijpers P, Furukawa T, et al. D, Dmetar: Companion R Package for the Guide ’Doing Meta-analysis in R’. R Package Version 0.0.9000. 2019. [Google Scholar]
- [18].Valkenhoef G, Kuiper J, Gemtc: Network Meta-analysis Using Bayesian Methods R Package Version 0.7-1. [Google Scholar]
- [19].Plummer M, Stukalov A, Denwood M, Rjags: Bayesian Graphical Models Using MCMC 2019. [Google Scholar]
- [20].Wickham H. Ggplot2: Elegant Graphics for Data Analysis. New York: Springer; 2009. [Google Scholar]
- [21].Chen HJ. Application of multiple teaching modes in standardized training of resident doctors [in Chinese]. China Continuing Med Educ 2020;12:7–10. [Google Scholar]
- [22].Huang HW. The specific application of PBL teaching method in clinical teaching of gynecology and obstetrics [in Chinese]. J World Latest Med Inf 2019;19:268–71. [Google Scholar]
- [23].Wang K, Zhou HL, Jin XX, et al. Application analysis of PBL bilingual teaching method in clinical teaching of obstetrics and gynecology [in Chinese]. China Mod Doc 2019;57:1–3. [Google Scholar]
- [24].Wang HQ. Application effect of PBL teaching method in clinical teaching of gynecology and obstetrics nursing [in Chinese]. J World Latest Med Inf 2019;19:287–93. [Google Scholar]
- [25].Jiao YH, Zhang YM, Huang Y. Analysis of specific application of PBL teaching method in obstetrics and gynecology clinical teaching [in Chinese]. China Continuing Med Educ 2019;11:16–8. [Google Scholar]
- [26].Yang YD, Wang YF. Application of the effect of PBL method in obstetrics and gynecology teaching [in Chinese]. China Continuing Med Educ 2019;11:22–4. [Google Scholar]
- [27].Li L, Zhao J, Yang T, et al. Observation of the effect of PBL teaching and conventional teaching in obstetrics and gynecology teaching [in Chinese]. China Higher Med Educ 2019;2019:57–8. [Google Scholar]
- [28].Li Y. Analysis of the application value of PBL teaching method in the teaching of obstetrics and gynecology residents [in Chinese]. Women's Health Res 2019;2019:193–4. [Google Scholar]
- [29].Zhang YJ, Zhang SX. Observation of the effect of problem-based teaching method in clinical teaching of obstetrics and gynecology [in Chinese]. China Health Ind 2019;16:129–30. [Google Scholar]
- [30].Shang XP. Study on PBL teaching in obstetrics and gynecology to promote students’ clinical thinking [in Chinese]. China Rural Health 2019;11:84–6. [Google Scholar]
- [31].Han Q. Evaluation of the effect of introducing PBL teaching method in obstetrics and gynecology nursing to improve the core competence of nurses [in Chinese]. J Pract Gynecol Endocrinol 2018;5:95–9. [Google Scholar]
- [32].Guo LS, Zhu WP. Developing evidence-based medicine thinking while using PBL in obstetrics and gynecology [in Chinese]. China Higher Med Educ 2018;2018:61–2. [Google Scholar]
- [33].Zheng HJ. The introduction of PBL teaching method to improve the core competence of nurses [in Chinese]. China Continuing Med Educ 2018;10:22–3. [Google Scholar]
- [34].Zheng LJ, Guo LS. Application of PBL teaching methods in the standardized resident training of obstetrics and gynecology [in Chinese]. China Continuing Med Educ 2018;10:5–7. [Google Scholar]
- [35].Wang YY, Wang SF, Zhang WJ, et al. Application effect of problem combined with case based learning method teaching model [in Chinese]. China Continuing Med Educ 2018;10:9–11. [Google Scholar]
- [36].Wang HX, Gao Y. The application of PBL teaching method in the clinical teaching of gynecology and obstetrics [in Chinese]. Chin Med Mod Distance Educ China 2018;16:30–2. [Google Scholar]
- [37].Wang ZL. Application evaluation of PBL teaching method in graduate teaching of gynecology of traditional Chinese medicine [in Chinese]. Chin Med Mod Distance Educ China 2018;16:34–6. [Google Scholar]
- [38].Shen XM, Huang X. Application of PBL teaching in gynecology and obstetrics [in Chinese]. China Continuing Med Educ 2018;10:13–5. [Google Scholar]
- [39].Li X. The learning practice of PBL teaching method in medical undergraduate class of gynecology of traditional Chinese medicine [in Chinese]. J Chin Med Mod Distance Educ China 2018;16:27–8. [Google Scholar]
- [40].Zhu FF. Application effect of PBL teaching method in obstetrics and gynecology teaching [in Chinese]. J Tradit Chin Med Manag 2018;26:157–8. [Google Scholar]
- [41].Zhang X, Li SW, Xie XY, et al. Application of PBL teaching method in eight-year teaching of gynecology and obstetrics [in Chinese]. Guide Sci Educ 2018. 123–4. [Google Scholar]
- [42].Dang JH, Luo Y, Wang J, et al. The role of medical model simulation teaching in improving the quality of obstetrics and gynecology practice teaching [in Chinese]. J Mod Med Health 2018;34:3248–50. [Google Scholar]
- [43].Chen ZW, Gao J, Ma W, et al. Application and exploration of PBL teaching method in clinical practice of obstetrics and gynecology [in Chinese]. Continuing Med Educ 2017;31:32–4. [Google Scholar]
- [44].Wang YY, Yu DS. Application of PBL teaching method based on clinical pathway in obstetrics and gynecology practice teaching [in Chinese]. China Continuing Med Educ 2017;9:31–2. [Google Scholar]
- [45].Tang XF. Application of multimedia teaching method based on pbl in the teaching of obstetrics and gynecology nursing students [in Chinese]. China Health Ind 2017;14:73–4. [Google Scholar]
- [46].Hua Y, Mu RW, Xiong WD, et al. Application of the combination of evidence-based medicine thinking and PBL teaching in obstetrics and gynecology practice teaching [in Chinese]. Health Vocat Educ 2017;35:114–5. [Google Scholar]
- [47].Liu HY, Chen FX, Liu LL, et al. Application of transitional PBL in obstetrics and gynecology teaching [in Chinese]. China Continuing Med Educ 2017;9:11–2. [Google Scholar]
- [48].Hou WJ, Han L. Practice and thinking on PBL teaching method in obstetrics and gynecology [in Chinese]. China Continuing Med Educ 2017;9:25–6. [Google Scholar]
- [49].Gao ZJ, Wang FL, Yue CY, et al. Proble-based learning: its application of gynecology and obstetrics nursing [in Chinese]. J Qingdao Univ (Med Sci) 2016;52:243–6. [Google Scholar]
- [50].Han JH. Study on the influence and effect of PBL teaching method on the core competence of nursing after obstetrics and gynecology nurses [in Chinese]. World Latest Med Inf 2016;16:274–5. [Google Scholar]
- [51].Wang XL, Niu ZJ, Zou XL, et al. Application and practice of PBL teaching method in the clinical practice teaching in the department of gynaecology and obstetrics [in Chinese]. China Health Ind 2016;13:78–80. [Google Scholar]
- [52].Wang HX, Zhang YJ, Gu YH, et al. Application of PBL bilingual teaching method in the clinical practice of obstetrics and gynecology [in Chinese]. Chin Med Record 2016;17:70–1. [Google Scholar]
- [53].Li YH. Application effect of PBL teaching method in nursing teaching of obstetrics and gynecology [in Chinese]. For All Health 2016;10:284–5. [Google Scholar]
- [54].Zhu DY, Li L. Application of PBL teaching method in obstetrics and gynecology teaching [in Chinese]. J World Latest Med Inf 2016;16:150–1. [Google Scholar]
- [55].He F. The role of introducing PBL teaching method in obstetrics and gynecology nursing [in Chinese]. J Med Theory Pract 2016;29:3431–2. [Google Scholar]
- [56].Lin MF. Application effect of PBL teaching method in obstetrics and gynecology teaching [in Chinese]. J Tradit Chin Med Manag 2015;23:115–6. [Google Scholar]
- [57].Liu CD. The influence of two teaching schemes on the learning methods of obstetrics and gynecology for foreign students [in Chinese]. Continuing Med Educ 2015;29:37–8. [Google Scholar]
- [58].Mai CY. The introduction of PBL teaching method in gynecology and obstetrice nursing teaching effect observation [in Chinese]. China Continuing Med Educ 2015;7:13–4. [Google Scholar]
- [59].Akcay B. Problem-based learning in science education. J Turkish Sci Educ. 2009;6:28–38. [Google Scholar]
- [60].Feeley AM, Biggerstaff DL. Exam success at undergraduate and graduate-entry medical schools: is learning style or learning approach more important? A critical review exploring links between academic success, learning styles, and learning approaches among school-leaver entry (“traditional”) and graduate-entry (“nontraditional”) medical students. Teach Learn Med 2015;27:237–44. [DOI] [PubMed] [Google Scholar]
- [61].Hammond I, Karthigasu K. Training, assessment and competency in gynaecologic surgery. Best Pract Res Clin Obstet Gynaecol 2006;20:173–87. [DOI] [PubMed] [Google Scholar]
- [62].Augusthy VC. A comparative study of the learning outcomes and students’ satisfaction from problem-based learning and lecture-based learning in obstetrics and gynaecology. Int J Reprod Contracept Obstet Gynecol 2017;5:1368–74. [Google Scholar]
- [63].Phelan ST, Jackson F, Berner E S. Comparison of problem-based and traditional education on student performance in the obstetrics and gynecology clerkship. J Obstet Gynecol 1993;82:159–61. [PubMed] [Google Scholar]
- [64].Casey PM, Magrane D, Lesnick TG, et al. Improved performance and student satisfaction after implementation of a problem-based preclinical obstetrics and gynecology curriculum. Am J Obstet Gynecol 2005;193:1874–8. [DOI] [PubMed] [Google Scholar]
- [65].Nalesnik SW, Heaton JO, Olsen CH, et al. Incorporating problem-based learning into an obstetrics/gynecology clerkship: impact on student satisfaction and grades. Am J Obstet Gynecol 2004;190:1375–81. [DOI] [PubMed] [Google Scholar]
- [66].Ren X, Yin J, Wang B, et al. A descriptive analysis of medical education in China. Med Teach 2008;30:667–72. [DOI] [PubMed] [Google Scholar]
- [67].Hamdy H, Agamy E. Is running a problem-based learning curriculum more expensive than a traditional subject-based curriculum? Med Teach 2011;33:e509–14. [DOI] [PubMed] [Google Scholar]
- [68].Kilgour JM, Grundy L, Monrouxe LV. A rapid review of the factors affecting healthcare students’ satisfaction with small-group, active learning methods. Teach Learn Med 2016;28:15–25. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
