Abstract
Background
Students' perception of their educational environment has a significant impact on their behavior and academic progress. The recent worldwide usage of innovative problem-based learning (PBL) medical programs requires major changes in medical schools and their environments. Therefore, measuring students' perceptions of the complex PBL environment has become a critical necessity as a determinant of students' academic success and as a part of attaining the quality standards of education. Ours being a new medical college employing the PBL curriculum, it was important to measure the students' perception of the educational environment in order to identify the strengths and weaknesses of the curriculum and to plan for any future improvements.
Aim and Objectives
The aim of this study was to evaluate students' perceptions in the preclinical phase of the PBL educational environment in the College of Medicine, Sharjah Medical College, United Arab Emirates, and to recommend remedial procedures.
Material and Methods
In this cross-sectional study, the English version of the Dundee Ready Education Environment Measure (DREEM) inventory was submitted to 250 students in years 1, 2, and 3. The data were analyzed using the SPSS 20 software, and significance was taken at P ≤ 0.05. The survey was performed in a mid-semester week, ie, in March 2014. No ethical issues were encountered during the process of this study.
Results
Two-hundred and fifty students responded to the questionnaire (100% response rate). The overall DREEM score was 113.4/200 (56.7%). First-year students expressed higher overall significant level of perception (119.4/200) than second-year (107.4/200) and third-year (112.7/200) students. In addition, first-year students perceived their learning, teaching, and academic climates as more significant than the other two batches. The scores obtained in the five domains were as follows; 28/48 in perception of learning, 26/44 in perception of teaching, 18/32 in academic self-perceptions, 27/48 in perceptions of atmosphere, and 15/28 in social self-perceptions. First-year students achieved the highest score (18.7/32) in the academic self-perception, and second-year students achieved the lowest (16.5/32). The total score was significantly higher in female students than in male students (115.9 vs 108.1).
Conclusions
The present study revealed that the PBL environment is generally perceived positively by our medical students. Female students exhibited higher perception than male students. Nevertheless, areas such as curriculum overload and inadequate student support still require further fine-tuning and remedial measures.
Keywords: educational environment, perceptions, undergraduate medical students, questionnaires, problem-based learning
Introduction
Educational environment (EE), climate, or milieu, is everything that is happening in the classroom, department, faculty, or university, and it is vital in determining the progress of undergraduate medical education.1,2 EE is a key component of the curriculum, 1 and its measurement should be part of curriculum evaluation. 3 Although EE has been less studied in the literature than content, teaching methods, or assessment, it is, nevertheless, of equal importance. 3 Medical students experience a variety of learning activities in the environs of the medical college, which are usually complex and unique. 4 Modern strategies in learning methodology and innovative curricula are shifting more toward student-centered learning approaches. 5 Consequently, the organizational and educational environments are likely to be altered and become more complicated. This might explain the recent growing interest in measuring students' perceptions of EE 6 in many medical schools, 7 particularly those adopting integrated and problem-based learning (PBL) programs. According to Vygotsky's theory of social cognitive development, 8 EE is the “culture” that determines students' learning development. In classrooms, clinical wards, and community health centers, students' learning scaffolding and development take place when interactions between students and teachers, peers, and other health care professionals occur. With the existence of friendships (high affiliation) and teacher support in classrooms, students' level of learning would be improved. In other words, EE is the “culture” that teaches students how to think and acquire knowledge, skills, and attitudes through the classroom environment.
The quality of the EE has been recognized to be vital for effective learning in terms of students' achievement, happiness, motivation, and success.4,9–11 Additionally, EE is one of the most important factors determining the effectiveness of the curriculum, 12 and its role has been stressed as being the curriculum's most significant manifestation and conceptualization.13,14 Gender differences in perceptions of the EE might well emerge in particular academic or cultural contexts, with particular curricula. A comparative study of data from a Nigerian undergraduate medical school and a Nepalese health professional institution reported that female students seem to be significantly less pleased with the EE in these institutions.15,16 In addition, it is important to monitor students' perceptions of EE at different stages and in different forms of curricula. The UK Standing Committee on Postgraduate Medical Education 17 highlighted the importance of EE by stating that “A working environment that is conducive to learning is critically important to successful training”. Furthermore, the World Federation for Medical Education (WFME) singles out the “learning environment” as one of the “targets” for what it terms “the conduction of the evaluation of medical education programs”. 18 For measuring such an environment, Roff et al (1997) 19 developed the Dundee Ready Education Environment Measure (DREEM) inventory, which has been used diagnostically to identify areas of the strength and weakness in a medical EE.12,15 In addition, it has been used to compare different medical educational institutions,15,20 students at different stages of the course,15,21,22 and male and female students.15,16,20,21 It has been used to measure the existing EE as a precursor to curriculum change, to identify priority areas for change, and to act as a baseline for comparison after curriculum change.21,23
Organizational context
Sharjah Medical College (SMC) is one of the 13 colleges of the University of Sharjah, United Arab of Emirates, and was founded in 2004. It offers a six-year MBBS program in three educational phases. Phase 1 is the foundation year and phase 2 is the preclinical phase, which includes years 1–3 and is followed by a comprehensive exam. Students in years 4 and 5, ie, the clinical phase 3, undergo rotational clinical trainings in public hospitals in Sharjah. Since its foundation, SMC has adopted an innovative PBL with integrated, student-centered, competency-based, and community-based curriculum in all phases of the program. Students of SMC are from mixed nationalities; although the majority is from the United Arab Emirates and Arab countries, they have diverse cultural backgrounds and come out of different educational systems. Moreover, male and female students undergo coeducation without segregation within the classrooms. Though the individual components of our curriculum are periodically monitored, EE has not been assessed since the first implementation of its curriculum 10 years ago.
Therefore, the aim of the current study was to monitor the perceptions of students about their EE in the PBL-based curriculum in SMC using DREEM. We assume that both the strengths and weaknesses would be identified. The results might offer a starting point for implementing measures toward curricular reform. The objectives of the study were as follows:
-
1.
How students perceive the educational environment in the PBL curriculum;
-
2.
Whether there is any gender difference in the students' perception;
-
3.
How students at different levels (years) perceive the educational environment;
-
4.
The perceived strengths and weaknesses of the curriculum.
Subjects and Methods
Population and samples
All undergraduate medical students of years 1–3, ie, the preclinical phase of the SMC, were invited to participate in this cross-sectional study. The total number of enrolled students in the three batches was 301, with 111 in the first year, 97 in the second year, and 93 in the third year. The current study obtained ethical clearance from the SMC.
Instrument for data collection
The DREEM inventory is a widely used, culturally nonspecific, and generic instrument developed to analyze undergraduate EE in the health profession.16,19,21 It has been found to be a validated tool19,24 with proven high reliability15,19,24,25 and has been applied in a variety of cultural contexts in various countries worldwide. With its help, medical institutions can identify the deficient areas in the learning process and then effect the required changes in curriculum.4,19,26–28
DREEM was developed at the University of Dundee in 1997; 19 and was universally tested in Europe, Africa, Asia, Australia, and America. 15 The inventory consists of 50 items categorized under five domains, namely Students' Perception of Learning (SPL, 12 items with a maximum score of 48), Students' Perception of Teachers (SPT, 11 items with a maximum score of 44), Students' Academic Self-Perception (SAP, 8 items with a maximum score 32), Students' Perception of the Atmosphere (SPA, 12 items with a maximum score of 48), and the Students' Social Self-Perception (SSP, 7 items with a maximum score of 28). The maximum score for all domains is 200, indicating the ideal EE. Each item is scored using a 5-point Likert scale with 4 for strongly agree, 3 for agree, 2 for uncertain, 1 for disagree, and 0 for strongly disagree. However, 9 out of 50 items, ie, items 4, 8, 9, 17, 25, 35, 39, 48, and 50, were negatively phrased statements and have scores 0 for strongly agree, 1 for agree, 2 for uncertain, 3 for disagree, and 4 for strongly disagree. Taking into account these maximum scores, the data are converted into percentages of their respective domains. 29 The approximate interpretation of the DREEM overall score is as follows: 0–50: very poor; 51–100: plenty of problems; 101–150: more positive than negative; and 151–200: excellent. An approximate guide for interpreting the five DREEM domains is summarized in Table 1. To pinpoint more specific strengths and weaknesses within the EE, items with a mean score >3 are considered positive, while items with a mean score of ≤2 are considered as problem areas, and were identified in the study population. Items with a mean score between 2 and 3 are considered as aspects that could be improved.30,31
Table 1.
DOMAIN | SCORE | INTERPRETATION |
---|---|---|
SPL | 0–12 | Very poor |
13–24 | Teaching is viewed negatively | |
25–36 | A more positive approach | |
37–48 | Teaching highly thought of | |
SPT | 0–11 | Abysmal |
12–22 | In need of some retraining | |
23–33 | Moving in the right direction | |
34–44 | Model teachers | |
SAP | 0–8 | Feeling of total failure |
9–16 | Many negative aspects | |
17–24 | Feeling more on the positive side | |
25–32 | Confident | |
SPA | 0–12 | A terrible environment |
13–24 | There are many issues that need changing | |
25–36 | A more positive atmosphere | |
37–48 | A good feeling overall | |
SSP | 0–7 | Miserable |
8–14 | Not a nice place | |
15–21 | Not too bad | |
22–28 | Very good socially |
Abbreviations: DREEM, Dundee Ready Education Environment; SPL, Students' Perception of Learning; SPT, Students' Perception of Teachers; SAP, Students' Academic Self-Perception; SPA, Students' Perception of Atmosphere; SSP, the Students' Social Self-Perception.
Data collection
Data collection was done in March 2014. A mid-semester week was selected for the survey in order to avoid the dominant effect of stress of the pre-final exams on student responses. The English version of DREEM inventories was submitted to 250 students in the first, second, and third years personally on three separate occasions in their classrooms. Before starting the survey, the author briefly explained the objectives and importance of the study and cleared the doubts about the questionnaire items with special emphasis on the importance of voluntary participation and the anonymity of the process. All students responded positively, and returned the questionnaires after about 30 minutes, thereby avoiding discussions among them. A separate consent form was collected along with survey. No ethical issues were encountered during the course of this process. Although the total number of the registered students in all three years was 301, only 250 students were available at the time of data collection (83%). The valid questionnaires collected and analyzed were 250, ie, 100% response rate.
Data management and analysis
The returned questionnaires were examined for completeness and consistency. Data were entered in MS-EXCEL, and were analyzed using IBM SPSS PC + statistical software (version 19). As the study outcome variables (scores of five domains and total score) are continuous variables, they were quantified by their mean and standard deviation. Student's t-test was used to determine statistically significant differences between male and female students. One-way analysis of variance (ANOVA) was carried out to analyze comparisons between the mean scores of the three different years. For this study, P ≤ 0.05 was considered statistically significant. Post hoc Fisher's least significant difference (LSD) test 32 was used after a null hypothesis in the ANOVA test was rejected. The resulting scores for the domains were interpreted as proposed by McLeer and Roff 30 and Gall et al. 33
Results
The mean age of the participants in the study was 20.3 (±0.04) years, in the range 17–23. Two-hundred and forty-five students specified their genders, while five did not. The study included 170 women (69%) and 75 men (31%). The total number of the analyzed questionnaires was 250, distributed as 98, 91, and 61 from years 1, 2, and 3, respectively.
The overall mean DREEM score of this study was 113.4/200 (56.7%), which was interpreted as “more positive than negative”. Regarding the five domains of the DREEM inventory, ANOVA test revealed significant differences among the three groups in the overall mean scores as well as in the SPL, SPT, and SAP domains (Table 2). When compared to those in years 2 and 3, year 1 students exhibited the highest level in their total perception of EE as well as in SPL and SPT domains. However, in the SAP domain, year 1 students revealed a significantly higher perception than year 2 students.
Table 2.
DOMAIN | MAX SCORE | YEAR LEVEL | MEAN ± SD (%) | P-VALUE | TOTAL (±SD) | INTERPRETATION 30 |
---|---|---|---|---|---|---|
SPL a | 48 | Y 1 | 30.5 ± 7.6 (63.5) | ≤0.001 | 28.1 (±7.4) | A more positive approach |
Y 2 | 25.7 ± 6.6 (53.6) | |||||
Y 3 | 27.8 ± 7.0 (57.9) | |||||
SPT | 44 | Y 1 | 27.9 ± 6.0 (63.4) b | ≤0.001 | 25.7 (±5.8) | Moving in the right direction |
Y 2 | 23.8 ± 5.6 (54.1) | |||||
Y 3 | 25.0 ± 4.6 (56.7) | |||||
SAP | 32 | Y 1 | 18.7 ± 5.9 (58.4) c | ≤0.05 | 17.6 (±5.8) | Feeling more in the positive side |
Y 2 | 16.5 ± 5.1 (51.5) | |||||
Y 3 | 17.5 ± 4.1 (54.7) | |||||
SPA | 48 | Y 1 | 27.1 ± 7.9 (56.4) | 0.696 | 26.8 (±7.5) | a more positive atmosphere |
Y 2 | 26.2 ± 7.5 (54.7) | |||||
Y 3 | 27.1 ± 6.8 (56.4) | |||||
SSP | 28 | Y 1 | 15.3 ± 4.7 (54.6) | 0.937 | 15.2 (±4.3) | not too bad |
Y 2 | 15.1 ± 4.1 (53.9) | |||||
Y 3 | 15.3 ± 4.2 (54.7) | |||||
Total score a | 200 | Y 1 | 119.4 ± 26.7 (59.7) | ≤0.01 | 113.4 (±23.4) | More positive than negative |
Y 2 | 107 ± 22.6 (53.7) | |||||
Y 3 | 112 ± 20.8 (56.4) |
Notes:
Significant difference among the three groups (ANOVA).
Significantly different from years 2 and 3 (Fisher's test).
Significantly different from year 2 only (Fisher's test).
Abbreviations: DREEM, Dundee Ready Education Environment; SPL, Students' Perception of Learning; SPT, Students' Perception of Teachers; SAP, Students' Academic Self-Perception; SPA, Students' Perception of Atmosphere; SSP, Students' Social Self-Perception; SD, standard deviation.
Neither the SPA nor the SSP domain showed significant difference among the three years. For assessing the weaknesses and strengths of the EE, the guide of Mcaleer and Roff 30 was used to interpret the mean scores of the five domains of DREEM (Table 2). Figure 1 shows that the majority of SMC students (72.1%) exhibited excellent and positive perceptions e.g. scored 50% and above to the overall DREEM inventory.
Table 3 shows the detailed scores of DREEM's individual items. The overall mean score (±SD) was 2.26 (±0.39), which is interpreted as “educational aspects that could be improved”. Out the 50-item scores, one item, ie, item 15 (I have good friends in this school) was found to be above 3.0, ie, positive area, while 11 items were found to be below 2.0, ie, problem areas for all the students. The remaining 38 items range between 2.0 and 3.0, ie, require improvement. The lowest item (1.37) was item 3 (There is a good support system for students who get stressed), while the highest item (3.12) was item 15 (I have good friends in this school). All items of SPL received mean scores >2. Regarding the SPT, all items received mean scores >2, except items 9 (The teachers are authoritarian) and 50 (The students irritate the teachers). In terms of SAP, all items received mean scores >2 except items 5 (Learning strategies which worked for me before continue to work for me now), 21 (I feel I am being well prepared for my profession), and 27 (I am able to memorize all I need). Regarding SPA, all items received mean scores >2, except items 12 (This school is well timetabled), 35 (I find the experience disappointing), and 42 (The enjoyment outweighs the stress of studying medicine). The SSP items 15 (I have good friends in this school), 19 (My social life is good), 28 (I seldom feel lonely), and 46 (My accommodation is pleasant) received mean scores >2 (Table 3).
Table 3.
ITEM NO. | ITEM | MEAN (±SD) |
---|---|---|
Students' perceptions of learning (SPL) | ||
1 | I am encouraged to participate in class | 2.24 (±1.07) |
7 | The teaching is often stimulating | 2.26 (±0.94) |
13 | The teaching is student centered | 2.74 (±0.97) |
16 | The teaching is sufficiently concerned to develop my competence | 2.12 (±0.99) |
20 | The teaching is well focused | 2.18 (±0.97) |
22 | The teaching is sufficiently concerned to develop my confidence | 2.21 (±0.98) |
24 | The teaching time is put to good use | 2.00 (±1.10) |
25 | The teaching over-emphasizes factual learning (N) | 2.30 (±0.94) |
38 | I am clear about the learning objectives of the course | 2.60 (±0.99) |
44 | The teaching encourages me to be an active learner | 2.49 (±0.98) |
47 | long-term learning is emphasized over short-term | 2.37 (±1.02) |
48 | The teaching is too teacher-centered (N) | 2.48 (±1.13) |
Students' perceptions of teachers (SPT) | ||
2 | The teachers are knowledgeable | 2.59 (±0.97) |
6 | The teachers are patient with the students/patients | 2.74 (±0.93) |
8 | The teachers ridicule the students (N) | 2.25 (±0.98) |
9 | The teachers are authoritarian (N) | 1.73 (±0.93) * |
18 | The teachers have good communication skills with students/patients | 2.52 (±0.98) |
29 | The teachers are good at providing feedback to students | 2.29 (±1.01) |
32 | The teachers provide constructive criticism here | 2.15 (±0.92) |
37 | The teachers give clear examples | 2.64 ± (0.86) |
39 | The teachers get angry in class (N) | 2.10 (±1.11) |
40 | The teachers are well prepared for their classes | 2.69 (±0.89) |
50 | The students irritate the teachers (N) | 1.89 (±1.09) * |
Students' Academic self-perceptions (SAP) | ||
5 | Learning strategies which worked for me before continue to work for me now | 1.91 (±1.1) * |
10 | I am confident about my passing this year | 2.67 (±1.09) |
21 | I feel I am being well prepared for my profession | 1.66 (±1.07) * |
26 | last year work has been a good preparation for this year's work | 2.09 (±1.14) |
27 | I am able to memorize all I need | 1.49 (±1.11) * |
31 | I have learned a lot about empathy in my profession | 2.51 (±1.04) |
41 | My problem-solving skills are being well developed here | 2.46 (±1.03) |
45 | Much of what i have to learn seems relevant to a career in medicine | 2.76 (±0.89) |
Students' perceptions of atmosphere (SPA) | ||
11 | The atmosphere is relaxed during the ward teaching | 2.47 (±1.05) |
12 | This school is well timetabled | 1.52 (±1.27) * |
17 | Cheating is a problem in this school (N) | 2.32 (±1.3) |
23 | The atmosphere is relaxed during lectures | 2.52 (±1.06) |
30 | There are opportunities for me to develop interpersonal skills | 2.56 (±0.95) |
33 | I feel comfortable in the class socially | 2.67 (±0.98) |
34 | The atmosphere is relaxed during seminars/tutorials | 2.69 (±0.92) |
35 | I find the experience disappointing (N) | 1.99 (±1.07) * |
36 | I am able to concentrate well | 2.17 (±1.06) |
42 | The enjoyment outweighs the stress of studying medicine | 1.61 (±1.2) * |
43 | The atmosphere motivates me as a learner | 2.02 (±1.07) |
49 | I feel able to ask the questions I want | 2.27 (±1.08) |
Students' social self-perceptions (SSP) | ||
3 | There is a good support system for students who get stressed | 1.37 (±1.21) * |
4 | I am too tired to enjoy this course (N) | 1.57 (±1.19) * |
14 | I am rarely bored on this course | 1.72 (±1.16) * |
15 | I have good friends in this school | 3.12 (±0.96) ** |
19 | My social life is good | 2.69 (±1.2) |
28 | I seldom feel lonely | 2.36 (±1.23) |
46 | My accommodation is pleasant | 2.41 (±1.16) |
Notes:
items with a mean score ≤2 are taken as problem areas.
items with a mean score >3 are taken as positive points. items score between 2 and 3 are taken as aspects that could be improved.
Abbreviations: DREEM, Dundee ready Education Environment; SD, standard deviation; N, negatively phrased statements.
Demographic differences
Statistical analysis showed that female students exhibited a significantly higher perception of EE than male students in the overall DREEM score as well as in the SPL and SPT domains (Table 4).
Table 4.
DOMAIN | MAX SCORE | MEAN (±SD) |
|
---|---|---|---|
MALES (n = 75) | FEMALES (n = 170) | ||
SPL | 48 | 26.6 (±7.1) | 28.8 (±7.3) * |
SPT | 44 | 24.2 (±5.9) | 26.4 (±5.6) * |
SAP | 32 | 16.9 (±5.5) | 18.0 (±5.1) |
SPA | 48 | 25.2 (±8.8) | 27.5 (±6.8) |
SSP | 28 | 15.1 (±4.9) | 15.3 (±4.1) |
Total DREEM score | 200 | 108.1 (±26.6) | 115.9 (±22.7) * |
Note:
Significantly different (P-value ≤0.05).
Abbreviations: DREEM, Dundee Ready Education Environment; SPL, Students' Perception of Learning; SPT, Students' Perception of Teachers; SAP, Students' Academic Self-Perception; SPA, Students' Perception of Atmosphere; SSP, Students' Social Self-Perception; SD, standard deviation.
Discussion
It has been reported that assessing EE should be a part of an institution's good educational practice. 34 Considerations of EE in the medical school along the lines of continuous quality improvement and innovation are likely to further the medical school as a learning organization with the attendant benefits. 1 As SMC is a new medical college with an innovative PBL curriculum, it was essential to assess the EE of the SMC in order to implement the required reforms. Students' perceptions of the EE may be influenced by their expectations about the educational program, diversity of the student population, variations in the style of teaching of the faculty, educational facilities and equipment, and other circumstances of the university. 35 Review of the literature shows the wide use of DREEM inventory in medical9,16,36 and dental schools.37, 38
The response rate in the preset study was 100%, which is a perfect indicator about student's interest in completing the survey and their interest to develop their institution. This is likely due to using face-to-face methodology rather than using an online survey. In the current study, the overall DREEM total mean score was 113.4/200, indicating that the SMC students' perception of the EE is more positive than negative. On the other hand, it indicates that there is vast room for improvement, as there is no curriculum without weaknesses.
SMC adopts a student-centered educational model where students are the center of the learning process and an integrated PBL curriculum with team-based teaching methodology. The teacher's role changes to a facilitator of learning rather than an information giver. This model is in contrast to the traditional teacher-centric norms. Therefore, it would be useful to explore the different perceptions of EE in PBL versus traditional curricula. The overall score of DREEM inventory of the current study (113.4/200) was not very much different from those of other studies carried out regionally and internationally. In comparison with other studies conducted in PBL medical curricula, the score of this study was similar to the scores of 113.8/200 in Egypt 39 and 114.4/200 in Pakistan. 40 However, it was higher than that in KSA, 41 Kuwait, 42 and Sri Lanka, 43 which reported mean DREEM scores of 111.5/200, 105/200, and 107.4/200, respectively. On the other hand, our mean score was lower than the scores of 143/200 in a dental school with an enquiry-based curriculum in the UK, 37 137/200 in Australia, 44 and 139/200 in the UK. 45 In comparison with the scores reported from traditional and teacher-centered curricula, our DREEM score was higher than that in King Saud University (90/200), 9 King Abdul Aziz University (102/200), 23 and Umm Al-Qura University (107/200) in KSA; 46 Sana'a University (100/200) in Yemen; 20 and Iran (99/200). 47 Some studies have reported a more positive EE mostly after making some educational reforms toward innovative curricula, such as in UAE 48 and Chile. 49 Furthermore, comparable studies performed in different institutions with traditional versus PBL curricula concluded that students of PBL curricula would evaluate their EE more positively than their counterparts in primarily conventional curricula.20,26 This highlights the importance of the positive influence of the new educational strategies in the innovative curricula on students' perceptions of EE rather than traditional programs. It seems that the integrated and student-centered curricula stimulate and provoke students to be active learners; also, they develop and evolve their skills. 50
The scores of our study show that year 1 students displayed a higher positive perception of EE than year 3 students. However, year 2 students exhibited the lowest mean scores of perception. These findings are consistent with the results of in King Saud University. 9 In addition, this is similar to the finding in a previous report that students who had enrolled at the school for a longer period became less satisfied with the teaching and with the support system for stressed students. 19 Al Ayed and Shiek 9 suggested that this might simply mean that first-year students were not too stressed (yet) by their studies. It became clear that students lost some of the neutrality that they exhibited in the first year and became more critical of the EE as they progressed through the program. It could also be explained by the enthusiasm and excitement of first-year students on successfully gaining entry into the medical college. 9
In the current study, the scores of the domains were SPL 28.1/48, SPT 25.7/44, SAP 17.6/32, SPA 26.8/48, and SSP 15.2/28. Most of the items, ie, 38 items, received mean scores between 2 and 3, which could be enhanced. 30 On the other hand, the problem areas, or the DREEM items that scored ≤2, were 11 items; none of them was in the learning domain. Out of the 11 items, 2 are related to the teachers domain (The teachers are authoritarian; The students irritate the teachers). Another three problem items belong to SAP domain (Learning strategies which worked for me before continue to work for me now; I feel I am being well prepared for my profession; I am able to memorize all I need). Another three items belong to SPA domain (This school is well timetabled; I find the experience disappointing; The enjoyment outweighs the stress of studying medicine). The last three items belong to SSP domain (There is a good support system for students who get stressed; I am too tired to enjoy this course; I am rarely bored on this course). One item domain belongs to SSP and scored >3 (I have good friends in this course).
The results showed that the whole groups exhibited the highest level of perception in the SPL domain, which is perceived as a positive approach. The agreement of all students groups on the SPL is crucially important for the PBL curriculum of the new SMC.
On the basis of the scores of the individual items of the DREEM inventory of the present study, attention will be paid to the areas that need improvements, and recommendations would be made for rectification. In the SPT domain, the majority of our students agreed that The teachers are knowledgeable (item 2), which received a score of 2.59, They are well prepared in their classes, give clear examples, and They are patient. These items scored between 2 and 3. Nevertheless, items 9 (The teachers are authoritarian) and 50 (The students irritate the teacher) scored ≤2. This is consistent with the finding of Demiroren et al, 11 which indicated that teachers are still wearing their traditional hats. Therefore, the teaching staff should be supported to be more oriented toward the PBL setting. The role of Continuous Professional Development (CPD) programs should be emphasized in order to reacquaint the faculty members with the effective feedback techniques on learning. 51 In addition, such programs would motivate the faculty to acquire modern teaching skills required for the PBL environment. 42
Although year 1 students achieved the highest score in the SAP (18.7/32), year 2 students achieved the lowest (16.5/32) score in the same domain. Such a difference might be related to the heavy load and timetabling in year 2, which need considerable attention. Reorganization of the timetable and well-communicated, explicit learning objectives with pre-class preparation material are the need of the hour in this concern.
Item 5 (Learning strategies which work for me before continue to work for me now) and item 21 (I feel I am being well prepared to my profession) scored low. They reflect the transformation of learning strategies that the students face while moving from the traditional and didactic way of teaching of the high school to our teaching and learning philosophies. The PBL, student-centered, integrated, and community-based practices in SMC might contradict the previous learning strategies that the students were used to at school. Therefore, we recommend more emphasis on preparing students during the foundation year as a transitional phase in order to gain the skills required for the complex needs of the PBL environment.
Item 27 (I am able to memorize all I need) had a low score of 1.49; This item scored ≤2.0 in many other studies as well.12,15,20,22,52 The low score of this item might indicate that there should be a substantial reduction of the core curriculum, ie, what students must know and the encouragement of peer-to-peer learning. 53 It is well known that students' perception of the atmosphere represents the real life of EE and thus the dynamism of the curriculum. 21 In a medical school in England, 54 a low score was found for item 12, which is similar to our finding. Timetabling was deemed inadequate, as shown in item 12 (This school is well timetabled) with a low score (1.52), and this highlights the need of more organizational skills to remedy this deficiency. In King Abdul Aziz University, Saudi Arabia, 23 item 42 (The enjoyment outweighs the stress studying medicine) had a poor score (1.6), which echoed in our study. A low rating of this item is indicative of the pressure felt by students studying medicine.
Regarding the SSP domain, all the participating students in this study shared the lowest perception (1.37) of item 3 (There is no good supporting system for those who get stressed). In confirmation with this finding, many studies have documented problem areas in the same item.22,23,55,56 There is agreement that PBL compared to lecture-based learning is time consuming and had clearly higher student workload if it is not adequately planned and monitored.57,58 Students in our PBL program are required to attend PBL tutorials as well as hospital- and community-based sessions. In addition, they have to complete assessment projects and tasks. Therefore, they are more likely to be overloaded and consequently anxious and stressed. 59 This may be reflected on their low perception with their EE. 60 This problem area should be seriously considered by reducing student workload, revisiting the amount of the delivered content, and improving methods of instructions and timetabling. This result should be taken seriously and discussed not only at the level of curriculum formation but also at the level of student advisory system. Based on these results, it is highly recommended to discuss the need to establish a more supporting system for those who are stressed. Item 4 (I am too tired to enjoy this course) showed also a low score (1.57). The same low score was obtained in other study. 21 A low score was seen in item 14 (I am rarely bored on this course). These two observations should be critically considered since they may indicate that students are overburdened with extra learning activities. It should be discussed within the continuous process of curriculum improvement and by investigating what causes such boredom and whether the courses can be made more engaging. Actually, SMC has a student advisory system where every faculty is assigned to give personal academic advice to a group of students, with special attention paid to low achievers or to students “at risk”. Apparently, this is not sufficient, as indicated by the scores ≤3 for the item 3. The introduction of a “Stressful Experience Report Form” can be considered to enhance the student support system. This would give the students the opportunity to report any distressing incidents and seek support. 36
Our results revealed a significantly higher perception of the overall score among female students than male students (115.9 vs 108.1). This is in agreement with the results reported in the studies from Trinidad, 12 Argentina, 16 India, 35 the UK, 56 Malaysia, 61 and Australia.44,53 On the contrary, gender showed no statistically significant difference in Canada, 22 India, 13 and King Saud University, Saudi Arabia. 9 Additionally, female students' responses were statistically significantly in their positive perception of learning when compared with those of males (28.8 vs 26.6). This might be explained by the differences observed in learning styles between male and female undergraduates. 62 Female students generally spend more time studying compared to males, 36 and are more critical about the quality of teaching and the general climate of the school, especially in the areas of student participation in class and the authoritarian attitudes of teachers. 16 Within the context of the current research, where the conservative and traditional culture of the Middle East countries dominate, females have less chance for spending time in extracurricular activities than males. However, the studies performed in Saudi Arabia and Yemen medical universities20,23 revealed less perception of EE among females than males. This contrast might be due gender segregation in these universities. Furthermore, female students demonstrated more positive perceptions toward teaching than male students (26.4 vs 24.2). Research findings show that female students develop more trust toward their lecturers when compared with males. 63
Conclusion
On the basis of the results of the present study, it can be concluded that the overall perception of SMC students of the EE is more positive than negative. The ultimate outcome was that the integrated PBL curriculum of the newly established institution is moving in the right direction. Gender differences and year level of students showed significant variations regarding the perception of the EE. Nevertheless, as identified by the DREEM inventory, many problem areas need to be critically investigated and remedied. Therefore, DREEM inventory is an effective tool in identifying the strengths and weaknesses of the curriculum. The message our students try to convey to us is that we need a support system for the stressed students, more motivating teaching instructions, reducing the curriculum overload, and better timetabling in order to enjoy the atmosphere and attain better outcomes. Consequently, the study strongly suggests presenting these results to the relevant educational and administrative authorities and decision makers for utilizing them as the basis for strategic planning and resource utilization. In addition, the results should be used as guidance to institutional corrective actions regarding the students' perception of areas of concern.
Limitation and Recommendations
As there is no comparable data from previous studies performed in the context of SMC, the results of the current study could be accepted as a baseline for further studies. The sole use of the questionnaire as a quantitative method of data collection might be a limitation of the current study with the possibility of leaving out some specific components of the context. 64 Another limitation is that the individual items were not analyzed by parallel qualitative data. Therefore, future qualitative studies may help confirm the current findings and more deeply address the specific problems or highlight strengths within the college.
Author Contributions
Conceived and designed the experiments: RMM. Analyzed the data: EN. Wrote the first draft of the manuscript: RMM and EN. Contributed to the writing of the manuscript: EN and RMM. Agree with manuscript results and conclusions: EN, RMM, and ZM. Jointly developed the structure and arguments for the paper: EN and ZM. Made critical revisions and approved final version: EN, RMM, and ZM. All authors reviewed and approved of the final manuscript.
Acknowledgment
We are extremely grateful to all SMC students who took part in this study.
References
- 1.Genn J.M. AMEE medical education guide No. 23 (Part 2): curriculum, environment, climate, quality and change in medical education—a unifying perspective. Med Teach. 2001; 23(5): 445–454. [DOI] [PubMed] [Google Scholar]
- 2.Roff S., Mcaleer S. What is educational climate? Med Teach. 2001; 23(4): 333–334. [DOI] [PubMed] [Google Scholar]
- 3.Harden R.M. “Curriculum Planning and Development.” A Practical Guide for Medical Teachers. Edinburgh: Elsevier Churchill Livingstone; 2005. [Google Scholar]
- 4.Veerapen K., McAleer S. Students’ perception of the learning environment in a distributed medical program. Medical Education Online. 2010; 15: 10.3402/meo.v15i0.5168. doi: 10.3402/meo.v15i0.5168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hannafin M., Hill J., Land S. Student-centered learning and interactive multimedia: status, issues, and implications. Contemp Educ. 1997; 68(2): 94–99. [Google Scholar]
- 6.Genn J.M., Harden R.M. What is medical education here really like? Suggestions for action research studies of climates of medical education environments. Med Teach. 1986; 8(2): 111–124. [DOI] [PubMed] [Google Scholar]
- 7.Miles S., Leinster S.J. Medical students’ perceptions of their educational environment: expected versus actual perceptions. Med Educ. 2007; 41(3): 265–272. [DOI] [PubMed] [Google Scholar]
- 8.Vygotsky L.S. Mind in Society: The Development of Higher Psychological Processes. Cambridge, MA: Harvard University Press; 1978. [Google Scholar]
- 9.Al-Ayed I.H., Sheik S.A. Assessment of the educational environment at the College of Medicine of King Saud University, Riyadh. East Mediterr Health J. 2008; 14(4): 953–959. [PubMed] [Google Scholar]
- 10.Arzuman H., Yusoff M.S., Chit S.P. Big Sib students’ perceptions of the educational environment at the School of Medical Sciences, Universiti Sains Malaysia, using Dundee Ready Educational Environment Measure (DREEM) Inventory. Malays J Med Sci. 2010; 17: 40–47. [PMC free article] [PubMed] [Google Scholar]
- 11.Demiroren M., Palaoglu O., Kemahli S., Ozyurda F., Ayhan I.H. Perceptions of students in different phases of medical education of educational environment: Ankara University Faculty of Medicine. Med Educ Online. 2008; 13: 8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Bassaw B., Roff S., Mcaleer S. et al. Students’ perspectives on the educational environment, Faculty of Medical Sciences, Trinidad. Med Teach. 2003; 25(5): 522–526. [DOI] [PubMed] [Google Scholar]
- 13.Abraham R., Ramnarayan K., Vinod P., Torke S. Students’ perceptions of learning environment in an Indian medical school. BMC Med Educ. 2008; 8: 20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Genn J.M. AMEE medical education guide No. 23 (Part 1): curriculum, environment, climate, quality and change in medical education-a unifying perspective. Med Teach. 2001; 23(4): 337–344. [DOI] [PubMed] [Google Scholar]
- 15.Roff S., Mcaleer S., Ifere O.S., Bhattacharya S. A global diagnostic tool for measuring educational environment: comparing Nigeria and Nepal. Med Teach. 2001; 23(4): 378–382. [DOI] [PubMed] [Google Scholar]
- 16.Mayya S., Roff S. Students’ perceptions of educational environment: a comparison of academic achievers and under-achievers at kasturba medical college, India. Educ Health (Abingdon). 2004; 17(3): 280–291. [DOI] [PubMed] [Google Scholar]
- 17.Standing Committee on Postgraduate Medical Education (SCOPME). Good practice in SHO Training. London: SCOPME; 1991. [Google Scholar]
- 18.The Executive Council of WFME. International standards in medical education, assessment and accreditation of medical schools‘-educational programs. A WFME position paper. Med Educ. 1998; 32(5): 549–558. [DOI] [PubMed] [Google Scholar]
- 19.Roff S., Mcaleer S., Harden R.M. et al. Development and validation of the Dundee Ready ducation Environment Measure (DR EEM). Med Teach. 1997; 19(4): 295–299. [Google Scholar]
- 20.Al-Hazimi A., Zaini R., Al-Hyiani A. et al. Educational environment in traditional and innovative medical schools: a study in four undergraduate medical schools. Educ Health (Abingdon). 2004; 17(2): 192–203. [DOI] [PubMed] [Google Scholar]
- 21.Jiffry M.T., Mcaleer S., Fernando S., Marasinghe R.B. Using the DREEM questionnaire to gather baseline information on an evolving medical school in Sri Lanka. Med Teach. 2005; 27(4): 348–352. [DOI] [PubMed] [Google Scholar]
- 22.Till H. Identifying the perceived weaknesses of a new curriculum by means of the Dundee Ready Education Environment Measure (DREEM) Inventory. Med Teach. 2004; 26(1): 39–45. [DOI] [PubMed] [Google Scholar]
- 23.Al-Hazimi A., Al-Hyiani A., Roff S. Perceptions of the educational environment of the medical school in King Abdul Aziz University, Saudi Arabia. Med Teach. 2004; 26(6): 570–573. [DOI] [PubMed] [Google Scholar]
- 24.McAleer S., Roff S., Harden R.M. et al. The medical education environment measure: a diagnostic tool. Med Educ. 1997; 32: 209–221. [Google Scholar]
- 25.Pimparyon P., Roff S., McAleer S. Educational environment, student approaches to learning and academic achievement in a Thai nursing school. Med Teach. 2000; 22(4): 359–364. [Google Scholar]
- 26.Zawawi A.H., Elzubeir M. Using DREEM to compare graduating students’ perceptions of learning environments at medical schools adopting contrasting educational strategies. Med Teach. 2012; 34(suppl 1): S25–S31. [DOI] [PubMed] [Google Scholar]
- 27.Dimoliatis I.D., Vasilaki E., Anastassopoulos P., Ioannidis J.P., Roff S. Validation of the Greek translation of the Dundee Ready Education Environment Measure (DREEM). Educ Health (Abingdon). 2010; 23: 348. [PubMed] [Google Scholar]
- 28.Roff S. The Dundee Ready Educational Environment Measure (DREEM)—a generic instrument for measuring students’ perceptions of undergraduate health professions curricula. Med Teach. 2005; 27(4): 322–325. [DOI] [PubMed] [Google Scholar]
- 29.Denz-Pehey H., Murdoch C. A comparison between findings from the DREEM questionnaire and that from qualitative reviews. Med Teach. 2009; 31: e449–e453. [DOI] [PubMed] [Google Scholar]
- 30.McAleer S., Roff S. A practical guide to using the Dundee Ready Education Environment Measure (DREEM). In Genn J. M. (Ed.), Curriculum, environment, climate, quality and change in medical education: A Unifying Perspective. Dundee: AMEE; 2001. (pp. 29–33). AMEE Education Guide no. 23, Scotland: AMEE. [Google Scholar]
- 31.Louise S., Miles S., Leinster S.J. The analysis and reporting of the Dundee Ready Education Environment Measure (DREEM): some informed guidelines for evaluators. Creat Educ. 2013; 4(05): 340. [Google Scholar]
- 32.Hayter A.J. The maximum familywise error rate of fisher's least significant difference test. J Am Stat Assoc. 1986; 81(396): 1000–1004. [Google Scholar]
- 33.Gall M.D., Borg W.R., Gall J.P. Educational Research an Introduction. 6th ed. Harlow: Longman Publishers; 1996. [Google Scholar]
- 34.Soemantri D., Herrera C., Riquelme A. Measuring the educational environment in health professions studies: a systematic review. Med Teach. 2010; 32(12): 947–952. [DOI] [PubMed] [Google Scholar]
- 35.Chandran C.R., Ranjan R. Students’ perceptions of educational climate in a new dental college using the DREEM tool. Adv Med Educ Pract. 2015; 6: 83–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Whittle S.R., Whelan B., Murdoch-Eaton D.G. DREEM and beyond; studies of the educational environment as a means for its enhancement. Educ Health (Abingdon). 2007; 20(1): 7. [PubMed] [Google Scholar]
- 37.Ali K., McHarg J., Kay E. et al. Academic environment in a newly established dental school with an enquiry-based curriculum: perceptions of students from the inaugural cohorts. Eur J Dent Educ. 2012; 16(2): 102–109. [DOI] [PubMed] [Google Scholar]
- 38.Thomas B.S., Abraham R.R., Alexander M., Ramnarayan K. Students’ perceptions regarding educational environment in an Indian dental school. Med Teach. 2009; 31(5): e185–e186. [DOI] [PubMed] [Google Scholar]
- 39.Youssef W.T., Wazir Y.M.E., Ghaly M.S., Khadragy R.A.E. Of the learning environment at the Faculty of Medicine, Suez Canal University: students’ perceptions. Intel Prop Rights. 2013; 1: 102. [Google Scholar]
- 40.Jawaid M., Raheel S., Ahmed F., Aijaz H. Students’ perception of educational environment at public sector Medical University of Pakistan. J Res Med Sci. 2013; 18(5): 417. [PMC free article] [PubMed] [Google Scholar]
- 41.Al-Kabbaa A.F., Ahmad H.H., Saeed A.A., Abdalla A.M., Mustafa A.A. Perception of the learning environment by students in a new medical school in Saudi Arabia: areas of concern. J Taibah Univ Med Sci. 2012; 7(2): 69–75. [Google Scholar]
- 42.Bouhaimed M., Thalib L., Doi S.A.R. Perception of the educational environment by medical students undergoing a curricular transition in Kuwait. Med Princ Prac. 2009; 18(3): 204–208. [DOI] [PubMed] [Google Scholar]
- 43.Lokuhetty M.D., Warnakulasuriya S.P., Perera R.I., De Silva H.T., Wijesinghe H.D. Students’ perception of the educational environment in a medical faculty with an innovative curriculum in Sri Lanka. South East Asian J Med Educ. 2010; 4: 9–16. [Google Scholar]
- 44.Brown T., Williams B., Lync M. The Australian DREEM: evaluating student perceptions of academic learning environments within eight health science courses. Int J Med Educ. 2011; 2: 94–101. [Google Scholar]
- 45.Varma R., Tiyagi E., Gupta J.K. Determining the quality of educational climate across multiple undergraduate teaching sites using the DREEM inventory. BMC Med Educ. 2005; 5: 8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Zaini R. Use of Dundee Ready Educational Environment (DREEM) for curriculum needs analysis in the Faculty of Medicine and Medical Sciences at Umm Al-Qura University, Saudi Arabia. [Masters dissertation]. Centre for Medical Education, University of Dundee: Scotland; 2003. [Google Scholar]
- 47.Aghamolaei T., Fazel I. Medical students’ perceptions of the educational environment at an Iranian Medical Sciences University. BMC Med Educ. 2010; 10: 87. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Shehnaz S.I., Sreedharan J. Students’ perceptions of educational environment in a medical school experiencing curricular transition in United Arab Emirates. Med Teach. 2011; 33(1): e37–e42. [DOI] [PubMed] [Google Scholar]
- 49.Riquelme A., Oporto M., Oporto J. et al. Measuring students’ perceptions of the educational climate of the new curriculum at the Pontificia Universidad Cato’ lica de Chile: performance of the Spanish Translation of the Dundee Ready Education Environment Measure (DREEM). Educ Health. 2009; 22: 112. [PubMed] [Google Scholar]
- 50.Al-Qahtani M.F. Approaches to study and learning environment in medical schools with special reference to the gulf countries [PhD thesis]. Faculty of Medicine, Dentistry and Nursing, University of Dundee: Dundee, 1999. [Google Scholar]
- 51.Norcini J. The power of feedback. Med Educ. 2010; 44: 16–17. [DOI] [PubMed] [Google Scholar]
- 52.Arzuman H., Youseff M.S., Chit S.P. Bid Sib students’ perception of the educational environment at the school of medical sciences, Universiti Sains Malaysia, using Dundee Ready Educational Environment Measure (DREEM) Inventory. Malaysian J Med Sci. 2010; 17(3): 40–47. [PMC free article] [PubMed] [Google Scholar]
- 53.Davis M.H., Harden R.M. Planning and implementing an undergraduate medical curriculum: the lessons learned. Med Teach. 2003; 25: 596–608. [DOI] [PubMed] [Google Scholar]
- 54.Fidelma D., Mcaleer S., Roff S. Assessment of the undergraduate medical education environment in a large UK medical school. Health Educ J. 2006; 65(2): 49–58. [Google Scholar]
- 55.Palmgren P.J., Chandratilake M. Perception of educational environment among undergraduate students in a chiropractic training institution. J Chiropr Educ. 2011; 25(2): 151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Dunne F., McAleer S., Roff S. Assessment of the undergraduate medical education environment in a large UK medical school. Health Educ J. 2006; 65(2): 149–158. [Google Scholar]
- 57.Ruiz-Gallardo J.R., Castaño S., Gómez-Alday J.J., Valdés A. Assessing student workload in problem based learning: relationships among teaching method, student workload and achievement. A case study in natural sciences. Teach Teach Educ. 2011; 27(3): 619–627. [Google Scholar]
- 58.Lo A. Development quality students for the hospitality and tourism industries through problem-based learning. In: Conference Proceedings of Hospitality, Tourism and Foodservice Industry in Asia: development, marketing and sustainability, May 27–29, Phuket; 2004.
- 59.Diaz R.J., Glass C.R., Arnkoff D.B., Tanofsky-Kraff M. Cognition, anxiety, and prediction of performance in 1st-year law students. J Educ Psychol. 2001; 93(2): 420–429. [Google Scholar]
- 60.Pogacnik M., Juznic P., Kosorok-Drobnic M. et al. An attempt to estimate students’ workload. JVME. 2004; 31: 3. [DOI] [PubMed] [Google Scholar]
- 61.Rahman N.I.A., Aziz A.A., Zainal Zulkifli M.A.H. et al. Perceptions of students in different phases of medical education of the educational environment: Universiti sultan Zainal Abidin. Adv Med Educ Prac. 2015; 6: 211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Wehrwein E.A., Lujan H.L., DiCarlo S.E. Gender differences in learning style preferences among undergraduate physiology students. Adv Physiol Educ. 2007; 31(2): 153–157. [DOI] [PubMed] [Google Scholar]
- 63.Schulte-Pelkum J.V., Schweer M.K.W., Pollak B. Dyadic trust relations between teachers and students—an empirical study about conditions and effects of perceived trustworthiness in the classroom from a differential perspective. Beziehungen in Unterricht und Schule. 2014; 9(5): 1–14. [Google Scholar]
- 64.Seabrook M.A. Clinical students’ initial reports of the educational climate in a single medical school. Med Educ. 2004; 38(6): 659–669. [DOI] [PubMed] [Google Scholar]