Evaluation of a telemedicine-based training for final-year medical students including simulated patient consultations, documentation, and case presentation

Abstract

Background: Focused history taking, knowledge-based clinical reasoning, and adequate case presentation during hand-offs represent important facets of competence of practicing physicians. Based on a validated 360-degree assessment simulating a first day of residency we developed a training for final-year medical students including patient consultation, patient management, and patient hand-off. Due to the COVID-19 pandemic the training was changed to a telemedicine format and evaluated.

Methods: In 2019, 103 final-year students participated in a newly designed competence-based training including a consultation hour with simulated patients, a patient management phase with an electronic patient chart, and a case presentation in hand-off format. Due to social distancing regulations, the training was not allowed to take place in this way. Therefore, we changed the training to a telemedicine format. In May 2020, 32 students participated in the telemedicine training. A 5-point Likert scale (1: does not apply to 5: fully applies) was used for the evaluation items. The two formats were compared with t-tests.

Results: The students were similarly satisfied with the content of the training independently of its format. Both groups found the patient cases interesting (presence: 4.68 ± 0.49, telemedicine: 4.66 ± 0.48). With respect to the telemedicine format, participants were glad that an option had been found that could be offered throughout the final year (4.94 ± 0.24) despite the COVID-19 pandemic and they regarded it as a very useful training for their final examination (4.94 ± 0.24).

Conclusion: The telemedicine format of the competence-based training worked as well as the presence format. In its telemedicine format, the training can be offered to students independently of their location.

Introduction

Competence-based medical education is supposed to prepare medical students for clinical problem solving [1]. Focused history taking, knowledge-based clinical reasoning, and adequate case presentation represent important facets of competence which are crucial for good patient management [2], [3], [4]. To acquire these competences, communication trainings with simulated patients, seminars, and other training programs have been established in undergraduate medical education [5], [6], [7], [8]. Since the COVID-19 pandemic began, undergraduate medical education encountered a cease of classroom courses and bedside teaching [9]. In patient care, the number of telemedicine-based patient consultations increased enormously during the COVID-19 pandemic and will presumably continue at a high rate for much longer [10]. For medical education, the use of telemedicine has been proposed for the core entrustable professional activities (EPA) defined by the Association of American Medical Colleges (AAMC), including virtual history taking, documentation of clinical encounters, and giving or receiving a patient hand-off [11].

Project description

In 2019, we developed a competence-based training for final-year medical students in the newly founded Center for Training and Assessment of Medical Competences at the University Hospital Hamburg Eppendorf based on a validated 360-degree assessment simulating a first day of residency [8]. This training included a consultation hour with four simulated patients per participant, patient documentation and management with a newly developed electronic patient chart, and one case presentation per participant in hand-off format. The patients designed for this training are shown in table 1 (Tab. 1). All patient cases were adapted from real patients who had been treated in the emergency department of the University Hospital Hamburg-Eppendorf. Results of the physical examination and a set of basic laboratory results were given to the participants after every simulated patient encounter. Before the case presentation, every participant received further results for one patient, e.g. ECG, X-rays or results of further blood tests. In October and December 2019 (presence), 103 medical students (63.1% female) participated in this training. At the end of each training, an electronic evaluation was presented to the participants. All consultations and case presentations were videographed. The simulated patients filled out a questionnaire (ComCare) including aspects of communication and interpersonal skills after every consultation [12]. Further trainings were planned for 2020. However, due to the social distancing regulations taking effect in March 2020, these trainings could not take place in their established way. Thanks to the funding of ten tablet computers we were able to offer the training via telemedicine. Via Zoom, virtual rooms were established for the consultations with the simulated patients, for working with the electronic patient charts, and for the case presentations. In May 2020 (telemedicine), 32 medical students (56.3% female), participated in the telemedicine-based training. This training was also electronically evaluated by the participants. All participants answered questions regarding the content of the training. Participants of the telemedicine-based training additionally answered questions with respect to the format of the training. All items were assessed on a 5-point Likert scale (1: does not apply, 2: somewhat applies, 3: partly applies, 4: rather applies, 5: fully applies). Comparisons with respect to the training content were calculated with t-tests for independent samples. Significance levels were set to p<0.05.

Table 1. Simulated patient roles.

Results

All 135 participants completed the training and no critical problems occurred in either format. Small technical problems during the telemedicine format were easily solved. All participants seemed to be very satisfied with the content of the training (see table 2 (Tab. 2)). No significant differences were found between the presence and the telemedicine group. Both groups regarded the patient cases as interesting (presence: 4.68±0.49, telemedicine: 4.66±0.48) and hardly knew the solution to the patient cases immediately (presence: 2.75±0.88, telemedicine: 2.75±0.76). With respect to the telemedicine format of the training (see table 3 (Tab. 3)), participants found it very useful (4.94±0.24) as a training for their final examination and felt that trainings like this should be offered throughout the final year (4.94±0.24). Participants felt that the telemedicine training was useful to exercise taking over responsibility as a physician (4.75±0.50) and that it should be offered in undergraduate medical education starting in year 4 (4.56±0.61).

Table 2. Students’ evaluation of the training content.

Table 3. Students’ evaluation of the telemedicine training.

Discussion and conclusion

Changing a training that simulates a first day of residency from a presence to a telemedicine format led to no significant changes in the high evaluation of the usefulness of the training content. Participants wished to be offered more possibilities for training exercises in this format which might – with its design and content – help to improve the transition from undergraduate to postgraduate medical training [13]. Since students reported – independently of the training format – that they did not know the solutions to the patient cases immediately, our training seems to be a useful teaching tool to improve students’ diagnostic decision making [14]. The context of the patient cases, which is relevant for clinical reasoning [15], was designed in such a way, that both ways of clinical reasoning, pattern recognition and analytical thinking [16], had to be applied in patient workup. This seems to have worked successfully. In its telemedicine format, our competence-based training can be easily offered to final-year medical students independently of their current study location.

Funding

This work was supported by the Joachim Herz Stiftung. The Claussen Simon Siftung provided additional support for five tablet computers.

Ethical approval

The study was performed in accordance with the Declaration of Helsinki and the Ethics Committee of the Chamber of Physicians (Ethik-Kommission, Ärztekammer Hamburg), Hamburg, approved this study and confirmed its innocuousness. The study included written consent by the participants and participation was voluntary and anonymized (reference number: PV3649).

Acknowledgements

We thank all participating medical students and the actors and actresses Christian Bruhn, Christiane Filla, Franziska Herrmann, Ulrike Johannson, Thomas Klees, Thorsten Neelmeyer, Frank Thomé, and Claudia Wiedemer who helped us to make this training work despite the COVID-19 pandemic.

Competing interests

The authors declare that they have no competing interests.