Table 3.
Product evaluation: methods and results
| Method | Details of the method | Main results |
|---|---|---|
| 1. Student evaluation questionnaire | To evaluate the students’ perceptions regarding the quality of the basic science phase and its application to the next phase, a 96-item questionnaire was developed based on the graduation survey by the Association of American Medical Colleges. A total of 136 students (response rate, 51 %) completed the questionnaire four month after completing the basic science phase in June 2014 | More students agreed or strongly agreed that: - Overall, I am satisfied with the quality of my basic science (53.7 %) More students disagreed or strongly disagreed that: - Basic science content had sufficient illustrations of clinical relevance (50.7 %) |
| 2. Student self-assessment regarding vertically integrated themes outcomes | 23 items of the above-mentioned questionnaire were related to outcomes of the vertically integrated themes | More students agreed or strongly agreed that: - In practical classes, my behaviour and appearance are appropriate to the medical profession (78.7 %) - I do not hesitate to share my knowledge and ability to my classmate during the group work (77.2 %) |
| 3. DREEM questionnaire | A total of 102 students (response rate, 44 %) enrolled in 2011 and 197 students (response rate, 87 %) enrolled in 2010 completed the standard DREEM questionnaire after completing their basic science phase | No significant differences were found between traditional and revised programme in Overall DREEM questionnaire scores. Students in revised programme evaluated the educational environments in 10 items significantly better than students in traditional programme (items 2, 5, 9, 11, 16, 28, 30, 37, 39 and 44) |
| 4. Individuals interviews with faculty | Individual interviews were conducted with 14 basic science faculty 3 years after running the revised programme. Each session lasted 20–45 min | Faculty concerns were: - Decreased faculty authority - Disturbed faculty schedule - Gradual weakening of the programme - Influence on student learning - Insufficiency of team-based learning |
| 5. Results of achievement tests | To compare the student performance in exams in the revised and traditional programme, a total of 724 exams results were extracted related to the: - 231 students of the revised programme enrolled in 2011 - 225, 184 and 184 students of the traditional programme enrolled in 2010, 2009 and 2008, respectively |
No significant differences (p s > 0.05) were detected between traditional and new programme in: Grade point average Failure rates National Comprehensive Basic Science Exam result |