Educational Assessment of Medical Student Rotation in Emergency Ultrasound

Abstract

Background

Medical student ultrasound education is sparse. In 2002, we began the first medical student rotation in emergency ultrasound.

Objective

To evaluate if medical students can learn and retain sonographic skills during a two- or four-week elective.

Methods

We gave students an exam on the first and last days of the rotation. Six months later, students took the exam a third time. A control group was used for comparison.

Results

Over a 19-month period, we enrolled 45 students (25 on the two-week and 20 on the four-week elective). The four-week student post-test score was significantly better than the two- week post-test score (81% vs 72%, p=0.003). On the six-month exam, the four-week student post-test score was significantly better than the two-week post-test score (77% vs 69%, p=0.008). The control group did not statistically improve.

Conclusion

Medical students can learn bedside ultrasound interpretation with clinical integration and retain the knowledge six months later.

BACKGROUND

Emergency physicians (EPs) have used bedside ultrasound for almost two decades^1,2 with studies demonstrating its accuracy and utility.^3–15 Bedside ultrasound is required for residency training in Emergency Medicine (EM)⁶ and is used in other specialties, but it is not routinely taught in U.S. medical schools. Several studies have evaluated emergency ultrasound (EU) curricula for resident and practicing physicians, but this is the first study to address medical student learning in emergency ultrasound. ^16–19

We established the first Emergency Department (ED)-based, fourth-year medical student rotation for EU in 2002. We offer both two- and four-week rotations. Each week includes two hours of didactics and five hours of image interpretation review (approximately 100 scans), the content of which varied during the study period according to patient variability and didactic scheduling. Each student spent 40 hours per week in the ED performing bedside ultrasounds with supervision by resident and attending EPs. This EM group consists of several registered diagnostic medical sonographer (RDMS) certified-physicians and other EPs who hold hospital credentialing in the interpretation of EU. Each student had the opportunity to work with a variety of attending EPs, including the emergency ultrasound fellow and the director of emergency ultrasound.

Purposes

We sought to determine if these rotations promote improved image interpretation and clinical integration, and whether these skills were retained six-months later. Furthermore, we hypothesized that students would score better after a four-week than a two-week rotation.

METHODS

We prospectively enrolled medical students over a 19-month period at our academic, urban, Level I trauma center ED. Informed consent was obtained from each student. We designed a 35-question exam, covering the primary applications of EU as described in the American College of Emergency Physicians Emergency Ultrasound Guidelines (Table 1).²⁰ In addition, we tested ocular ultrasound, detection of soft-tissue abscess, and deep venous thrombosis (DVT). Of the 35 questions, 13 assessed physics and image-acquisition techniques, 13 involved image interpretation with clinical integration, and nine were purely image interpretation, with the majority of the images demonstrating positive findings. An interactive DVD with live ultrasound video clips accompanied the exam (available on journal website at www.insertdvdtesthere.com). The university IRB committee approved the study.

Table 1.

Primary Applications for Emergency Ultrasound (American College of Emergency Physician guidelines²⁰)

Focused Assessment of Sonography in Trauma (FAST) Ultrasound in pregnancy (intra-uterine pregnancy, fetal movement, cardiac activity

Abdominal Aortic Aneurysm Emergency echocardiography

Biliary ultrasound

Renal ultrasound

Procedural ultrasound

We instructed students in ultrasound physics and instrumentation, and aortic, biliary, pelvic (transabdominal/endovaginal), renal, DVT, trauma, cardiac, soft tissue, and ocular ultrasound. Students also did four hours of DVD self-study in both rotations. Didactic and tape review instructors were RDMS-certified EM faculty and fellows. Finally, students were encouraged to read a 500-page collection of selected ultrasound textbook chapters and research articles.

On the first day of the elective, students were approached for enrollment whether on the two or four week rotation, and before any ultrasound instruction. None refused. We planned to exclude students if they had prior ultrasound instruction or experience. None did. Students took the exam on day one and again on the final day of their rotation. Six months after the completion of the rotation, a follow-up exam with DVD was mailed to the students to be completed at their convenience. The same exam was used each time, but students were blinded to both the correct answers and their previous score. Students who completed the six-month exam received a gift card for a large, multi-national coffee chain. Nine students who did not take the emergency ultrasound rotation (control group) took the same exam on two occasions four weeks apart. We calculated p-values using the Student’s t-test, analysis of variance (ANOVA), and a linear regression model that included the pre-test score and a binary variable for the difference between the two and four week electives. Statistical significance was set at p < 0.05.

RESULTS

Over a 19-month period, we enrolled 45 students (25 on the two-week and 20 on the four-week elective). Their results are summarized in Table 2. Thirty-four of 45 students (76%) completed the six-month follow-up exam. Table 3 shows these results compared to the four-week group’s pre-tests.

Table 2.

Exam scores for control, and two and four week rotation students.

	Pre-test	Post-test	p=(t-test)
Control (n=9)	43%	39%	0.116 (ns)
2 week (n=25)	46%	72%	< 0.005
4 week (n=20)	47%	81%	< 0.005

^*p=0.003 for post-test comparison of two and four week groups

Table 3.

Exam scores of subset of two and four week rotation students who completed six-month follow-up, compared with the same students’ pre-test scores

	Six-month follow-up scores	p=(t-test)
2 week (n=19)	69%	< 0.0005
4 week (n=15)	77%	< 0.0005

^*p=0.008 for post-test comparison of two and four week groups

There was no difference between pre-test scores in the three groups (p=0.688 by ANOVA). However, there was a statistically significant improvement in the post-test scores for the four-week group as compared with the two-week group (p=0.005), as well as six-month follow-up scores between the groups (p=0.008). These two comparisons were made using linear regression controlling for pre-test scores. Therefore, not only did scores improve after the two and four week rotations, but both groups retained this improved performance at the six-month follow up.

DISCUSSION

This study is the first to investigate the effectiveness of a medical student rotation in bedside ultrasound in the ED. Such education is broadly applicable outside of EM, including obstetrics and gynecology, surgery, critical care and office-based practices. Our results demonstrate that students have a significant increase in their ability to interpret ultrasound images and integrate them into clinical decision-making after a short period of training. Although the students on the four-week rotation showed a greater improvement than the two-week students at both the completion of the rotation and the six-month follow up, the two-week students nonetheless showed a significant improvement. These results suggest that incorporating ultrasound education into medical school curricula is feasible and can be successful in a short rotation.

More than 32,000 emergency physicians practice in the United States, but only a small fraction are ultrasound trained. A recent survey documents that ultrasound equipment is consistently available in only 19% of U.S. EDs.²¹ The primary reason cited for this limited availability was lack of EP training. Our study of medical students suggests relatively short, focused periods of training are effective and may begin to bridge this training gap.

LIMITATIONS

This study tested image interpretation and integration into patient management but did not test actual image acquisition. Therefore, we cannot comment on whether two or four weeks of bedside training is sufficient to develop and retain these skills. As our exam addressed clinical management of patients based on ultrasound findings, we cannot separate ultrasound skills from improved clinical acumen during the rotation. It is possible that students who chose a four-week elective in EU are more motivated to learn EM than those choosing two weeks, and this could account for the improved test performance. Furthermore, an inclusion bias may be present; the 76% that chose to complete the six- month follow-up examination may have been the same students who were more motivated during the rotation and had greater retention of information.

The examination focused on detection of “positive” ultrasound findings suggestive of pathology. To most accurately assess image-interpretation skills, a more thorough exam would have consisted of multiple normal, abnormal and indeterminate examples for each indication; however, the investigators were concerned that a lengthier exam could have decreased the completion rate. Given that the pre- and post-test were identical, we cannot exclude improvement in scores based simply on taking the same test twice. However, our control group, with no ultrasound training did not improve their test scores, making this confounder unlikely. Due to the variable nature of the ED patient population, the bedside ultrasounds performed by the students and the images available for review during the image interpretation sessions were not controlled for and may have affected individual student performance on questions evaluating certain applications.

We also did not control for the number of scans that either group performed, the random variability in the proportion of each type of scan performed by each student, or any ultrasound experience following the post-test but preceding the six-month follow-up examination. Finally, this educational study was performed at only one site, and therefore generalizability is limited.

CONCLUSION

This study demonstrates that medical students are able to acquire skills necessary for image interpretation of fundamental emergency ultrasound applications and integrate this into clinical scenarios. A four-week rotation is superior to a two-week rotation. Students are able to retain a significant amount of their training six months after the rotation.