Skip to main content
GMS Zeitschrift für Medizinische Ausbildung logoLink to GMS Zeitschrift für Medizinische Ausbildung
. 2015 Nov 16;32(5):Doc51. doi: 10.3205/zma000993

Virtual Patients in continuing medical education and residency training: a pilot project for acceptance analysis in the framework of a residency revision course in pediatrics

Virtuelle Patienten in der ärztlichen Fort- und Weiterbildung: Ein Pilotprojekt zur Akzeptanzanalyse im Rahmen eines Weiterbildungs-Repetitoriums in der Pädiatrie

Ronny Lehmann 1,*, Benjamin Hanebeck 1, Stephan Oberle 1, Anke Simon 1, Daniela Choukair 1, Burkhard Tönshoff 1, Sören Huwendiek 1,2
PMCID: PMC4647158  PMID: 26604993

Abstract

Aim: Virtual patients (VPs) are a one-of-a-kind e-learning resource, fostering clinical reasoning skills through clinical case examples. The combination with face-to-face teaching is important for their successful integration, which is referred to as “blended learning”. So far little is known about the use of VPs in the field of continuing medical education and residency training. The pilot study presented here inquired the application of VPs in the framework of a pediatric residency revision course.

Methods: Around 200 participants of a pediatric nephology lecture (‘nephrotic and nephritic syndrome in children’) were offered two VPs as a wrap-up session at the revision course of the German Society for Pediatrics and Adolescent Medicine (DGKJ) 2009 in Heidelberg, Germany. Using a web-based survey form, different aspects were evaluated concerning the learning experiences with VPs, the combination with the lecture, and the use of VPs for residency training in general.

Results: N=40 evaluable survey forms were returned (approximately 21%). The return rate was impaired by a technical problem with the local Wi-Fi firewall. The participants perceived the work-up of the VPs as a worthwhile learning experience, with proper preparation for diagnosing and treating real patients with similar complaints. Case presentations, interactivity, and locally and timely independent repetitive practices were, in particular, pointed out. On being asked about the use of VPs in general for residency training, there was a distinct demand for more such offers.

Conclusion: VPs may reasonably complement existing learning activities in residency training.

Keywords: medical education, residency training, continuing medical education, virtual patients, blended learning

1. Background and aim

Virtual Patients (VPs) offer the possibility to interactively guide learners through diagnostics and treatment of a specific clinical case, imparting clinical patterns and diagnostic and therapeutic algorithms. In recent years, different designs and approaches have been described [1]. VPs are especially suited for promoting clinical reasoning skills [2]. Moreover, current educational research also focuses on the successful integration of e-learning activities in existing medical curricula and residency programs [3]. To achieve optimal benefit, “blended learning” approaches gain popularity which combine e-learning activities with conventional face-to-face teaching [4], [5], [6], [7], [8]. Despite a lot of positive experiences with VPs and blended learning in the training of medical students [9], [10], [11], [12], [13], [14][, possibilities offered for continuing medical education and residency training were noticed quite recently [15], [16].

The survey presented here evaluates the pilot use of VPs at a residency training course. Different aspects of the learning experience with VPs, the combination with a common lecture, and the general opinion about the use of VPs for residency training were evaluated.

The main question was whether and how VPs can be a reasonable complement to learning activities in residency programs. Underlying positive experiences in the training of medical students, the hypothesis was that VPs are suited well in this field, as also in continuing medical education. The use of VPs is flexible, timely and locally independent, and the possibility to customize their content might provide great benefits.

2. Project description

Twice a year, the German Society for Pediatrics and Adolescent Medicine (DGKJ) hosts a revision course offered particularly to pediatric residents. In 2009, this course was hosted at the Center for Pediatrics and Adolescent Medicine Heidelberg, Germany, and one of the authors (DC) was announced for the lecture on nephrotic and nephritic syndrome in children. Two existing VPs on these topics were adapted to the requirements of residency training with the help of experienced specialists and blended with the lecture. The VPs were designed in accordance with published design criteria [17] using CAMPUS software [18]. They were drafted as a wrap-up session of the lecture and were worked-up by around 200 participants in a separate session at the end of the revision course on personal mobile devices via Wi-Fi (see Figure 1 (Fig. 1)). In addition, the VPs were available on the internet for another eight weeks (via http://www.virtuellepatienten.de).

Figure 1. Work-up of a virtual patient on the smart phone.

Figure 1

After the completion of the cases, the participants were asked to fill in an online survey. The survey was based on a shortened version of published evaluation instruments for the design of VPs and their curricular integration [19]. It comprised 10 items; six of them asked for agreement on a Likert scale from 1 (totally disagree) to 5 (totally agree), and four questions for multiple free text answers (see table 1 (Tab. 1)). For these open questions, all answers are presented that were mentioned more than once.

Table 1. Survey form and results (N=40).

Table 1

Unfortunately, the online survey was unavailable at the revision course due to a problem with the firewall of the Wi-Fi network used. Cases could be completed without any problem, but evaluation was not possible locally. These circumstances reduced the return rate because surveys could only be sent when working with the VPs from the hotel or back home. As the wrap-up session was placed at the event of the course, we were not able to switch to a paper and pencil version after the problem appeared.

3. Results

A total of 42 survey forms was returned, with N=40 evaluable forms (approximately 21%). 62.5% of the participants were female; 36 residents, two specialists and two consultants participated in the survey. Results of the Likert scaled items are presented as mean ± standard deviation in Table 1 (Tab. 1); the number of answers is shown in round brackets.

There were strong agreements with the statements that work-up of the cases prepares for diagnostics and medical care of real patients (4.4±0.5 and 4.2±0.8, respectively) and it was perceived as a worthwhile learning experience (4.5±0.7). The case presentation with symptoms, (differential) diagnostics and treatment (9 mentions) was mentioned being a specific strength of this kind of training, followed by interactivity (4) and easy access in a timely and locally independent manner (2). Sporadic criticism was mentioned for diagnostic or therapeutic steps (3), too much text-intensive parts (2), and missing comparison of the correct answer with the given one (2) – altogether criticism on the cases themselves or the software platform. On being asked about the use of VPs in the field of residency training in general, there was a strong agreement for VPs being very suitable (4.7±0.6) with the wish for more such offers (4.7±0.7). VPs should be provided via the internet (34), with secure access via central websites e.g. of the DGKJ (11), and free of charge (6). The blended learning approach, comprising a lecture and adapted VPs, was rated a worthwhile learning experience (4.4±0.7).

4. Discussion

The pilot study presented here evaluated acceptance of a blended learning approach, combining virtual patients as a wrap-up of a pediatric lecture in the field of residency training. Participants felt better prepared for real patients with these clinical symptoms after completion of both parts, and perceived the work-up of the VPs as a worthwhile learning experience. Strengths of VPs were mentioned, e.g., the interactive case presentation, its diagnostics and treatment, as well as the timely and local independence of learning. VPs were considered an appropriate learning modality in the field of residency training and continuing medical education, with the wish for more such offers.

The existing offers concerning VPs – except for student education – are rare and often of a commercial nature [20]. Regarding relevant but infrequently occurring content, like e.g. resuscitation algorithms, VPs may fill gaps in continuing medical education curricula or residency training [21]. Flexible use combined with practical relevance of a concrete clinical case suit these target groups well. Content can be tailored individually to specific needs and learning goals, and learning is provided in a timely and locally independent manner allowing repetitive practice.

Blended learning approaches are more and more highlighted for residency curricula as they facilitate an intensive extra-occupational face-to-face training by a structured self-directed learning with interpersonal exchange and networking [16]. There is only little experience with the use of VPs in residency training and continuing medical education. One of the few examples is the inter-professional emergency course at the Center for Pediatrics and Adolescent Medicine Heidelberg, Germany, in which medical and nursing staff are trained to deal with emergency situations in teams after individual preparation with VPs [22]. This course concept was primarily implemented within the local skills laboratories for undergraduate training [14].

The pilot study presented here, for the use of VPs curricular blended with face-to-face teaching, is limited – given the sample size and the use of a non-validated survey instrument. The limitation of the sample size is mainly due to the fact that the survey form was only available to those who completed the cases at home or hotel, as the survey form was not available at the course because of the problem mentioned with the local Wi-Fi firewall. This might be a bias as it addresses mainly tech-savvy participants.

The combination of face-to-face lectures with VPs is innovative in the field of residency training as there is very little experience. It seems a reasonable approach for the application of knowledge learned from face-to-face teaching in virtual practice with feedback.

5. Conclusions

VPs may reasonably complement curricula in the fields of residency training and continuing medical education. Their practice orientation and flexible use seem to suit these target groups well. Because of the sample limitations, further studies are necessary to confirm these findings and to optimize this approach.

Competing interests

The authors declare that they have no competing interests.

References

  • 1.Huwendiek S, de Leng BA, Zary N, Fischer MR, Ruiz JG, Ellaway R. Towards a typology of virtual patients. Med Teach. 2009;31(8):743–748. doi: 10.1080/01421590903124708. Available from: http://dx.doi.org/10.1080/01421590903124708. [DOI] [PubMed] [Google Scholar]
  • 2.Cook DA, Triola MM. Virtual patients: a critical literature review and proposed next steps. Med Educ. 2009;43(4):303–311. doi: 10.1111/j.1365-2923.2008.03286.x. Available from: http://dx.doi.org/10.1111/j.1365-2923.2008.03286.x. [DOI] [PubMed] [Google Scholar]
  • 3.Triola MM, Huwendiek S, Levinson AJ, Cook DA. New directions in e-learning research in health professions education: Report of two symposia. Med Teach. 2012;34(1):e15–e20. doi: 10.3109/0142159X.2012.638010. [DOI] [PubMed] [Google Scholar]
  • 4.Bonk CJ, Graham CR. Handbook of blended learning: Global perspectives, local designs. San Francisco: Pfeiffer Publishing; 2006. [Google Scholar]
  • 5.Fischer MR, Hege I, Hörnlein A, Puppe F, Tönshoff B, Huwendiek S. Virtuelle Patienten in der medizinischen Ausbildung: Vergleich verschiedener Strategien zur curricularen Integration. Z Evid Fortbild Qual Gesundhwesen. 2008;102(10):648–653. doi: 10.1016/j.zefq.2008.11.021. Available from: http://dx.doi.org/10.1016/j.zefq.2008.11.021. [DOI] [PubMed] [Google Scholar]
  • 6.Hege I, Ropp V, Adler M, Radon K, Mäsch G, Lyon H, Fischer MR. Experiences with different integration strategies of case-based e-learning. Med Teach. 2007;29(8):791–797. doi: 10.1080/01421590701589193. Available from: http://dx.doi.org/10.1080/01421590701589193. [DOI] [PubMed] [Google Scholar]
  • 7.Huwendiek S, Duncker C, Reichert F, De Leng BA, Dolmans D, van der Vleuten CP, Haag M, Hoffmann GF, Tönshoff B. Learner preferences regarding integrating, sequencing and aligning virtual patients with other activities in the undergraduate medical curriculum: A focus group study. Med Teach. 2013;35(11):920–929. doi: 10.3109/0142159X.2013.826790. Available from: http://dx.doi.org/10.3109/0142159X.2013.826790. [DOI] [PubMed] [Google Scholar]
  • 8.Edelbring S, Broström O, Henriksson P, Vassiliou D, Spaak J, Dahlgren LO, Fors U, Zary N. Integrating virtual patients into courses: follow-up seminars and perceived benefit. Med Educ. 2012;46(4):417–425. doi: 10.1111/j.1365-2923.2012.04219.x. Available from: http://dx.doi.org/10.1111/j.1365-2923.2012.04219.x. [DOI] [PubMed] [Google Scholar]
  • 9.Deladisma AM, Johnsen K, Raij A, Rossen B, Kotranza A, Kalapurakal M, Szlam S, Bittner JG, 4th, Swinson D, Lok B, Lind DS. Medical student satisfaction using a virtual patient system to learn history-taking communication skills. Stud Health Technol Inform. 2008;132:101–105. [PubMed] [Google Scholar]
  • 10.Deladisma AM, Gupta M, Kotranza A, Bittner JG, Imam T, Swinson D, Gucwa A, Nesbit R, Lok B, Pugh C, Lind DS. A pilot study to integrate an immersive virtual patient with a breast complaint and breast examination simulator into a surgery clerkship. Am J Surg. 2009;197(1):102–106. doi: 10.1016/j.amjsurg.2008.08.012. Available from: http://dx.doi.org/10.1016/j.amjsurg.2008.08.012. [DOI] [PubMed] [Google Scholar]
  • 11.Triola M, Feldman H, Kalet AL, Zabar S, Kachur EK, Gillespie C, Anderson M, Griesser C, Lipkin M. A randomized trial of teaching clinical skills using virtual and live standardized patients. J Gen Intern Med. 2006;21(5):424–429. doi: 10.1111/j.1525-1497.2006.00421.x. Available from: http://dx.doi.org/10.1111/j.1525-1497.2006.00421.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Edelbring S, Dastmalchi M, Hult H, Lundberg IE, Dahlgren LO. Experiencing virtual patients in clinical learning: a phenomenological study. Adv Health Sci Educ Theory Pract. 2011;16(3):3313–3345. doi: 10.1007/s10459-010-9265-0. Available from: http://dx.doi.org/10.1007/s10459-010-9265-0. [DOI] [PubMed] [Google Scholar]
  • 13.Huwendiek S, Hanebeck B, Bosse HM, Haag M, Hoffmann GF, Tönshoff B. Lernen und Prüfen mit virtuellen Patienten am Zentrum für Kinder- und Jugendmedizin des Universitätsklinikums Heidelberg: Ergebnisse der Evaluation im Rahmen des E-Learning-Preises Baden-Württemberg 2007. GMS Med Inform Biom Epidemiol. 2009;5(1):Doc10. doi: 10.3205/mibe000089. Available from: http://dx.doi.org/10.3205/mibe000089. [DOI] [Google Scholar]
  • 14.Lehmann R, Bosse HM, Simon A, Nikendei C, Huwendiek S. An innovative blended learning approach using virtual patients as preparation for skills laboratory training: perceptions of students and tutors. BMC Med Educ. 2013;13:23. doi: 10.1186/1472-6920-13-23. Available from: http://dx.doi.org/10.1186/1472-6920-13-23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Beutner M, Bristrup R, Kirberg S, Koreny K, Kusserow M, Rehbold RR. Blended Learning im Gesundheitswesen: Chancen für die Fortbildung durch Multimedia. Dtsch Ärztebl. 2007;104(25):A–1808/B. [Google Scholar]
  • 16.Borg E, Waschkau AW, Engelbrecht J, Brösicke K. Ärztliche Fortbildung im Internet: Kriterien für gutes E-Learning. Dtsch Ärztebl. 2010;107(10):A–421/B. [Google Scholar]
  • 17.Huwendiek S, Reichert F, Bosse HM, de Leng BA, van der Vleuten CP, Haag M, Hoffmann GF, Tönshoff B. Design principles for virtual patients: a focus group study among students. Med Educ. 2009;43(6):580–5888. doi: 10.1111/j.1365-2923.2009.03369.x. Available from: http://dx.doi.org/10.1111/j.1365-2923.2009.03369.x. [DOI] [PubMed] [Google Scholar]
  • 18.Haag M, Singer R, Bauch M, Heid J, Hess F, Leven FJ. Challenges and perspectives of computer-assisted instruction in medical education: lessons learned from seven years of experience with the CAMPUS system. Methods Inf Med. 2007;46(1):67–69. [PubMed] [Google Scholar]
  • 19.Huwendiek S, de Leng BA. Virtual patient design and curricular integration evaluation toolkit. Med Educ. 2010;44(5):519. doi: 10.1111/j.1365-2923.2010.03665.x. Available from: http://dx.doi.org/10.1111/j.1365-2923.2010.03665.x. [DOI] [PubMed] [Google Scholar]
  • 20.EB Aus- und Weiterbildung: Auf Visite beim virtuellen Patienten. Dtsch Ärztebl. 2008;105(15):A–789/B. Available from: http://m.aerzteblatt.de/print/59692.htm. [Google Scholar]
  • 21.Ventre KM, Collingridge DS, DeCarlo D. End-user evaluations of a personal computer-based pediatric advanced life support simulator. Simul Healthc. 2011;6(3):134–142. doi: 10.1097/SIH.0b013e318207241e. Available from: http://dx.doi.org/10.1097/SIH.0b013e318207241e. [DOI] [PubMed] [Google Scholar]
  • 22.EB Kinderärzte: Notfälle virtuell trainieren. Dtsch Ärztebl. 2011;108(40):67. Available from: http://www.aerzteblatt.de/archiv/108372/Kinderaerzte-Notfaelle-virtuell-trainieren. [Google Scholar]

Articles from GMS Zeitschrift für Medizinische Ausbildung are provided here courtesy of German Medical Science

RESOURCES