Abstract
Introduction: Point-of-care-ultrasound (POCUS) as a useful bedside tool is growing. Few studies have examined residents’ attitude towards POCUS or compared POCUS image interpretation skills between residents with and without POCUS training in medical school.
Material and Methods: We distributed an anonymous survey and image interpretation test to assess residents’ attitude towards POCUS, confidence, and skills in interpreting POCUS images and videos. Using independent samples t-tests, we compared mean confidence levels and test scores between residents with and without prior POCUS training.
Results: Fifty-two residents responded to survey (response rate 68%) and 59 took the image interpretation test (77%). Most residents (90%) reported being interested in POCUS. Residents with prior POCUS training (n=13) were either PGY-1 (9) or PGY-2 (4). No PGY-3 resident had prior training. Most residents (83%) thought POCUS could be extremely useful in the inpatient setting compared to 29% for outpatient setting. PGY-1 residents with prior training had a higher mean confidence level than PGY-1 residents without prior training, but the difference was not statistically significant (3.26 vs 2.64; p=0.08). PGY-1 with prior training had a mean confidence level that was close to that of PGY-3 residents. PGY-1 residents with prior training scored significantly higher than PGY-1 residents without prior training in image interpretation test (10.25 vs 7; p=0.01). Residents felt most confident in interpreting inferior vena cava images (mean 3.7; max. 5), which also had the highest score in image interpretation test (correct response rate of 88%).
Conclusion: Our residents seem very interested in POCUS. PGY-1 residents with prior POCUS training in medical school seem to have higher confidence in their POCUS skills than PGY-1 residents without prior training and outperformed them in image interpretation test. The study is very instructive in building our future POCUS curriculum for residents.
Keywords: Point-of-care-ultrasound, bedside ultrasound, internal medicine residents, graduate medical education
Introduction
Point-of-care-ultrasound (POCUS) is the use of ultrasound at the bedside by the treating clinician to look for specific findings that help to answer specific clinical questions.1–4 Many see it as an extension of physical examination.5–9 The use of POCUS is expanding beyond the emergency room, obstetrical examination, and intensive care units. It is emerging as a useful tool for specialties like anesthesiology, physical medicine and rehabilitation, rheumatology, nephrology, and emergency medical services.10–16 The utility of ultrasound to enhance success rate and safety of medical procedures is well known.17–19 Nowadays, there is also a mounting body of evidence to support its effectiveness in general internal medicine and hospital medicine practices.7,20–27
Given its growing applications, POCUS has become more prevalent than ever in the context of internal medicine residents beginning their training in recent times. How residents perceive the rise of POCUS as a new skill to learn during residency is not well known. Our internal medicine residency program acquired 4 handheld ultrasound devices (GE Vscan® with dual probe) in 2016 for inpatient use. Faculty hospitalists who use POCUS in their practice noticed that residents were not using the available devices as often as faculty thought they would. Therefore, we perceived that our residents need a longitudinal curriculum in POCUS to address their concerns and to assess their skills. No formal training or longitudinal curriculum in POCUS was introduced to our residents apart from the availability of ultrasound devices in inpatient wards and intensive care unit, the intermittent interaction with faculty who are interested in POCUS during these two rotations, and the free access to a website with POCUS video modules (EMsono®).
Few studies have examined residents’ skills and attitude towards POCUS training,28–38 but to the best of our knowledge, no prior study has compared POCUS image interpretation skills and self-reported confidence between residents with and without POCUS training in medical school. The goal of this study was to assess our residents’ attitude, basic needs, and prior knowledge about POCUS and whether POCUS training and exposure during medical school influences their POCUS image interpretation skills and confidence level. We also wanted to compare the results of their self-reported confidence level to their actual score in a POCUS image interpretation test. This study will be part of a formal future longitudinal curriculum to train our residents on cardiovascular and lung POCUS.
Material and methods
We distributed a 24-question, anonymous, and voluntary electronic survey (using Qualtrics, LLC). A secured email was sent to residents as a group with voluntary participation encouraged. Completion of the survey was deemed to be informed consent. Respondents self-reported their attitude towards POCUS and their confidence in recognizing specific lung and cardiovascular POCUS images (using a Likert scale where 5=extremely confident, 4=mostly confident, 3=not sure, 2=mostly not confident, and 1=not confident at all). In addition to this survey, we also conducted an anonymous, voluntary, and timed image interpretation test to examine our residents’ skills in interpreting normal and abnormal common cardiovascular and lung POCUS images (total of 15 videos: 6 lung exams, 6 cardiac exams, 1 inferior vena cava [IVC] exam, 1 right internal jugular [RIJ] vein exam for jugular venous distension (JVD), and 1 lower extremity deep venous thrombosis [DVT] exam). The image interpretation test was a mixture of fill-in-the-blank and multiple-choice questions where the residents were shown 30 seconds video clips of ultrasound findings each with a question that included brief clinical scenario and the type of the exam. A typical example of the format of questions is shown in Media (Video S1). The test was reviewed by 3 faculty hospitalists who use POCUS in their practice to make sure that images are optimum in quality and interpretation. Videos were mostly recorded by the senior author, but some were also obtained from the book “Point-of-Care Ultrasound,” first edition.39 Using descriptive statistics, we compared the results of the test to the residents’ self-reported confidence in their ability to perform and recognize these specific images. Using t-tests, we compared mean confidence levels and test scores between residents with and without POCUS training in medical school. Analysis was done using IBM® SPSS Statistics software, version 25. The study was approved by the Community Regional Medical Center institutional review board.
Results
Fifty-two residents (total 74) took the survey (one resident did not fully complete the survey). The overall response rate was 68% (67% [22/33] PGY-1, 77% [17/22] PGY-2, and 58% [11/19] PGY-3). Thirteen residents (25% of respondents) indicated having some form of POCUS training in medical school (mostly lectures and hands-on experience, but also two-week elective, simulation, and exams). Residents with prior POCUS training (n=13) were either PGY-1 (9, but one did not complete the survey) or PGY-2 (4). No PGY-3 resident had prior training (Figure 1). When asked about their interest in learning POCUS during residency, 46 residents (90% overall; 86% [20/23] PGY-1, 88% [15/17] PGY-2, 100% [11/11] PGY-3) reported being extremely or mostly interested. Most residents (83%) thought that POCUS can be extremely useful in the inpatient setting versus 29% for the outpatient setting (Figure 2). About 94% of the residents felt that dedicated workshops to train them on POCUS would be extremely or most likely to be helpful in learning POCUS skills. Other opportunities residents felt can be helpful as well include one-to-one training during the Procedure Service rotation, online videos, and bedside use of ultrasound by attending physicians (ultrasound rounds). The POCUS exam skills that residents thought would be most useful to learn during residency were the cardiac exam (15.5% of respondents), IVC exam (14.8%), lung exam (13.8%), and RIJ exam for JVD (12.7%) (Figure 3). Only 1 resident mentioned that he/she knows all the keys or functions of the Vscan® devices and 10 said they know most of them. When it comes to the knowledge about which ultrasound probe to use for which exam, most residents (63%) felt extremely or somewhat confident about choosing the right probe for the right exam.
Residents were also assessed for how confident they feel about recognizing some common pulmonary, cardiac, and vascular POCUS exams in clinical practice (Table 1). Residents rated their confidence level on scale of 1 to 5, with 1=not confident at all, 2=mostly not confident, 3=not sure, 4=mostly confident, and 5=extremely confident. PGY-1 residents with prior training had higher mean confidence level than PGY-1 without prior training, but the difference was not statistically significant (3.26 vs 2.64; p=0.08). PGY-1 residents with prior training had a mean confidence level that was close to that of PGY-3 residents, none of whom had prior training (Figure 4).
Table 1.
POCUS exam | Mean confidence level |
---|---|
IVC diameter and collapsibility | 3.7 |
Pleural effusion | 3.6 |
RIJ exam for JVD | 3.3 |
B-lines in cardiogenic pulmonary edema | 3.2 |
Pericardial effusion | 3.2 |
B-lines and hyperechoic areas in consolidation | 2.9 |
Assess LVF contractility | 2.8 |
Absent pleural sliding for pneumothorax | 2.8 |
Signs of tamponade | 2.8 |
Signs of large pulmonary embolism | 2.7 |
Lower extremity exam for DVT | 2.4 |
Abbreviations: POCUS, Point-of-care ultrasound; IVC, inferior vena cava; RIJ, right internal jugular; JVD, jugular venous distension; LVF, left ventricular function; DVT, deep venous thrombosis.
Fifty-nine residents (response rate 77%) took the POCUS image interpretation test. The most correctly answered image interpretation questions are shown in Table 2. PGY-1 residents with prior training scored significantly higher than PGY-1 residents without prior training (10.25 vs 7; p=0.01) (Figure 5). Residents felt most confident in interpreting IVC images (mean 3.7), and the same exam had the highest score in the image interpretation test with a correct response of 88% (in addition to identifying small-to-moderate pericardial effusion).
Table 2.
POCUS exam video | Number (%) |
---|---|
IVC diameter and collapsibility interpretation | 52 (88%) |
Presence of small-to-moderate pericardial effusion (left parasternal long axis cardiac view) | 52 (88%) |
Hypercontractile LVF (left parasternal short axis view at the papillary muscle level) | 45 (76%) |
Presence of DVT in the right common femoral vein by collapsibility criteria | 45 (76%) |
Presence of hyperechoic areas and moving air bronchogram, favoring consolidation | 43 (73%) |
Presence of small-to-mod pleural effusion | 39 (66%) |
Severely reduced LVF (left parasternal long axis cardiac view) | 35 (59%) |
Elevated JVD (patient’s RIJ tapering high in the neck) | 34 (58%) |
Pleural effusion (vs pericardial) | 32 (54%) |
Multiple B lines (upper lung field anteriorly using high frequency probe) | 24 (41%) |
Normal LVF (left parasternal long axis cardiac view) | 23 (39%) |
Absent lung sliding (upper lung field anteriorly with using frequency probe) | 22 (37%) |
Absence of pleural effusion at the lung base (positive lung curtain sign) | 20 (34%) |
D-shaped septum suggesting high right ventricular pressure (left parasternal short axis view) | 14 (24%) |
Barcode sign with M-mode (upper lung field anteriorly with high frequency probe) | 11 (19%) |
Lung point sign (upper lung field anteriorly with high frequency probe) | 7 (12%) |
Abbreviations: POCUS, Point-of-care ultrasound; IVC, inferior vena cava; RIJ, right internal jugular; JVD, jugular venous distension; LVF, left ventricular function; DVT, deep venous thrombosis.
Discussion
The results of this study were very helpful in planning the POCUS curriculum for our residents. It created a good platform for faculty to know which POCUS exams residents are more interested to learn and what are their baseline skills and perceptions regarding cardiovascular and lung POCUS training. Similar to other studies,28,36 we also learned that the vast majority of our residents are either extremely or mostly interested to learn POCUS during residency. Most of them also were extremely or mostly supportive of workshops as one method to learn POCUS skills, and so arrangement will be made to have workshops as part of the curriculum.
Although our residents currently have no or minimal exposure to ultrasound training in primary care clinics, most of them still think that POCUS can be either extremely or mostly useful in outpatient practice. Not surprising, though, more residents agreed that it is more useful in the inpatient setting. This can be explained by the fact that our residents use ultrasound more during inpatient than the outpatient service, probably because of the availability of the 4 hand-held devices in inpatient rotation and most faculty who use POCUS are in the inpatient practice. In line of what our faculty hospitalists who use POCUS believe, our residents chose cardiac, inferior vena cava, and lung exams as the top three exams they think are most useful to learn during residency. Knowing this assures more participation of residents in our workshops and curriculum which will start with these three systems.
Although all residents have access to the hand-held ultrasound devices during medical wards, most of them reported that they either know some or very few of the keys and functions of the device. Non-familiarity with the available ultrasound devices can obviously be a barrier to learn POCUS. Therefore, this is an area that needs to be particularly addressed during the workshops. When it comes to the use of the probes, most residents feel confident that they know which probe to use for which exam.
The comparison between the residents’ self-reported level of confidence in image interpretation and their actual performance in the image interpretation test was instructive. It gave an idea about areas in cardiovascular and lung POCUS exams that might need more attention during the course of the POCUS curriculum. For example, the highest level of self-reported confidence in image recognition and interpretation was reported for examination of IVC diameter and collapsibility, which is one of the common applications of POCUS. In the image interpretation test, 88% of residents were able to recognize a small and collapsible IVC. This suggests that IVC exam is probably the most common exam performed by our residents and most of them might not need much help in that area, although it will still be included in the workshop to help them refine their image acquisition skills. The next highest self-reported level of confidence was reported for recognizing pleural effusion in lung exam. When shown an image of small to moderate effusion at the lung base, 67% were able to recognize the presence of the effusion. But when shown an image of normal lung base with no pleural effusion, only about one third of residents were able to recognize the absence of effusion in that image. This suggest that our residents might be more familiar with appreciating pleural effusion than recognizing the normal pattern that they might see in patients without effusion, an area that can be practiced more during the workshops with healthy live models. Also, recognizing DVT was amongst the areas that only few residents (19%) reported to be extremely or mostly confident to recognize, but when shown an image of a positive exam by compressibility criteria, 78% were able to recognize the positive exam and report the presence of DVT. This might suggest that, when it comes to lower extremity exam for DVT, our residents probably need more training on image acquisition skills more than image interpretation using the compressibility criteria. Interestingly, residents’ low confidence levels for DVT exam was also reported in other study in Canada.29 Image acquisition generally seems to be more challenging than image interpretation.7
One interesting finding was the fact that PGY-1 residents were the most among our residents who had some form of formal or informal ultrasound training in medical school, followed by PGY-2, with no PGY-3 resident reported having any prior training. This supports the notion that more and more medical schools now are introducing at least basic ultrasound training opportunities for their students, an indicator for the growth of POCUS training. Therefore, faculty are likely to encounter more and more medical students getting into internal medicine residency with at least basic knowledge of bedside ultrasound skills. These future residents will expect their faculty to help them acquire more advanced POCUS skills during their training, and hence, faculty should be encouraged to seek development of their own POCUS skills. The subset of PGY-1 residents who had POCUS training during medical school had higher self-reported confidence in lung and cardiovascular POCUS skills and they outperformed the PGY-1 residents without prior training in the image interpretation test as well. PGY-1 residents’ confidence level and performance were comparable to that of PGY-3 residents. This is encouraging for medical schools who provide POCUS training for their students. Ultrasound skills are largely operator-dependent so these residents are expected to develop their POCUS skills even more during the course of the curriculum, an assumption that can be examined by repeating the survey and test at the end of the curriculum. Internal medicine residency programs who are interested to build POCUS curriculum can consider involving residents with prior POCUS training in medical school to assist with curriculum development since they seem to have more confidence in their skills and likely to perform better in image interpretation than those without prior training.
This study has several limitations. Although our program is considered large by number of residents, this study still reflects the attitudes and baseline ultrasound skills of residents in only one internal medicine training program.
Moreover, the survey was anonymous and so when we repeat the survey and exam at the end of the curriculum, we will not be able to compare the results of resident’s self-reported confidence level and image interpretation skills individually, but we should be able to do so for the whole group. The survey and test only examined residents’ POCUS skills in cardiovascular and lung systems. Nevertheless, these are the exams that seem to attract the most interest of the residents. Our goal is to introduce more systems as residents’ skills advance.
Conclusion
Our internal medicine residents seem quite interested in acquiring and developing POCUS skills during residency, especially cardiovascular and lung examinations. PGY-1 residents with prior POCUS training in medical school seem to have higher confidence in their POCUS skills than PGY-1 residents without prior training and outperformed them in image interpretation test. The study was very instructive in building our future POCUS curriculum for our residents. Standardization of POCUS training for internal medicine residency programs is still evolving. Other programs including Obstetrics and Gynecology, Diagnostic Radiology, and Emergency Medicine have ACGME (Accreditation on Council for Graduate Medical Education) program requirements for graduate medical education on utilizing ultrasonography. Given the many applications of ultrasonography in Internal medicine, programs interested in developing POCUS curriculum can start with similar data gathering to better understand their residents’ baseline knowledge and attitude towards POCUS skills and training.
Acknowledgments
Authors would like to thank Drs. Steven Tringali, Eyad Almasri, Elieth Martinez, and Ali Saadi for their suggestions and support.
Disclosure
The authors report no conflicts of interest in this work.
References
- 1.Moore CL, Copel JA. Current concepts: point-of-care ultrasonography. N Engl J Med. 2011;364(8):749–757. doi: 10.1093/jnci/djk094 [DOI] [PubMed] [Google Scholar]
- 2.Dietrich CF, Goudie A, Chiorean L, et al. Point of care ultrasound: a WFUMB position paper. Ultrasound Med Biol. 2017;43(1):49–58. doi: 10.1016/j.ultrasmedbio.2016.06.021 [DOI] [PubMed] [Google Scholar]
- 3.Arienti V, Camaggi V. Clinical applications of bedside ultrasonography in internal and emergency medicine. Intern Emerg Med. 2011;6(3):195–201. doi: 10.1007/s11739-010-0424-3 [DOI] [PubMed] [Google Scholar]
- 4.Canadian Association of Radiologists. Position statement on the use of point of care ultrasound; 2013; June:1–10. Available from: http://www.car.ca/uploads/standardsguidelines/point_of_care_ultrasound_position_statement_20140527.pdf. Accessed March 28, 2019. [DOI] [PubMed]
- 5.Medd D. Bedside ultrasound: part of the physical examination. Am J Med. 2010;123(5):e11. doi: 10.1016/j.amjmed.2009.11.016 [DOI] [PubMed] [Google Scholar]
- 6.Low D, Vlasschaert M, Novak K, Chee A, Ma IWY. An argument for using additional bedside tools, such as bedside ultrasound, for volume status assessment in hospitalized medical patients: A needs assessment survey. J Hosp Med. 2014;9(11):727–730. doi: 10.1002/jhm.2256 [DOI] [PubMed] [Google Scholar]
- 7.Martin LD, Howell EE, Ziegelstein RC, et al. Hand-carried ultrasound performed by hospitalists: does it improve the cardiac physical examination? Am J Med. 2009;122(1):35–41. doi: 10.1016/j.amjmed.2008.07.022 [DOI] [PubMed] [Google Scholar]
- 8.Brennan JM, Blair JE, Goonewardena S, et al. A comparison by medicine residents of physical examination versus hand-carried ultrasound for estimation of right atrial pressure. Am J Cardiol. 2007;99(11):1614–1616. doi: 10.1016/j.amjcard.2007.01.037 [DOI] [PubMed] [Google Scholar]
- 9.Cessford T, Meneilly GS, Arishenkoff S, et al. Comparing physical examination with sonographic versions of the same examination techniques for splenomegaly. J Ultrasound Med. 2018;37(7):1621–1629. doi: 10.1002/jum.14506 [DOI] [PubMed] [Google Scholar]
- 10.Griffin J, Nicholls B. Ultrasound in regional anaesthesia. Anaesthesia. 2010;65(Suppl 1):1–12. doi: 10.1111/j.1365-2044.2009.06200.x [DOI] [PubMed] [Google Scholar]
- 11.Desjardins G, Cahalan M. The impact of routine Trans-oesophageal echocardiography (TOE) in cardiac surgery. Best Pract Res Clin Anaesthesiol. 2009;23(3):263–271. doi: 10.1016/j.bpa.2009.02.007 [DOI] [PubMed] [Google Scholar]
- 12.Finnoff JT, Smith J, Nutz DJ, Grogg BE. A musculoskeletal ultrasound course for physical medicine and rehabilitation residents. Am J Phys Med Rehabil. 2010;89(1):56–69. doi: 10.1097/PHM.0b013e3181c1ee69 [DOI] [PubMed] [Google Scholar]
- 13.Grassi W, Filippucci E. Ultrasonography and the rheumatologist. Curr Opin Rheumatol. 2007;19(1):55–60. doi: 10.1097/BOR.0b013e3280119648 [DOI] [PubMed] [Google Scholar]
- 14.Noble VE, Lamhaut L, Capp R, et al. Evaluation of a thoracic ultrasound training module for the detection of pneumothorax and pulmonary edema by prehospital physician care providers. BMC Med Educ. 2009;9(1). doi: 10.1186/1472-6920-9-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Bøtker MT, Jacobsen L, Rudolph SS, Knudsen L. The role of point of care ultrasound in prehospital critical care: A systematic review. Scand J Trauma Resusc Emerg Med. 2018;26(1). doi: 10.1186/s13049-018-0518-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Brennan JM, Ronan A, Goonewardena S, et al. Handcarried ultrasound measurement of the inferior vena cava for assessment of intravascular volume status in the outpatient hemodialysis clinic. Clin J Am Soc Nephrol. 2006;1(4):749–753. doi: 10.2215/CJN.00310106 [DOI] [PubMed] [Google Scholar]
- 17.Havelock T, Teoh R, Laws D, Gleeson F. Pleural procedures and thoracic ultrasound: british Thoracic Society pleural disease guideline 2010. Thorax. 2010;65(SUPPL. 2):i61–i76. doi: 10.1136/thx.2010.137026 [DOI] [PubMed] [Google Scholar]
- 18.Facs.org. Revised statement on recommendations for use of real-time ultrasound guidance for placement of central venous catheters. Published 2011. Available from: https://www.facs.org/about-acs/statements/60-real-time-ultrasound.Accessed March 28, 2019.
- 19.Feller-Kopman D. Ultrasound-guided central venous catheter placement: the new standard of care? Crit Care Med. 2005;33(8):1875–1877. doi: 10.1016/j.jweia.2011.07.001 [DOI] [PubMed] [Google Scholar]
- 20.Alpert JS, Mladenovic J, Hellmann DB. Should a hand-carried ultrasound machine become standard equipment for every internist? Am J Med. 2009;122(1):1–3. doi: 10.1016/j.amjmed.2008.05.013 [DOI] [PubMed] [Google Scholar]
- 21.Bhagra A, Tierney DM, Sekiguchi H, Soni NJ. Point-of-care ultrasonography for primary care physicians and general internists. Mayo Clin Proc. 2016;91(12):1811–1827. doi: 10.1016/j.mayocp.2016.08.023 [DOI] [PubMed] [Google Scholar]
- 22.Ailon J, Mourad O, Nadjafi M, Cavalcanti R. Point-of-care ultrasound as a competency for general internists: a survey of internal medicine training programs in Canada. Can Med Educ J. 2016;7(2):e51–e69. doi: 10.1145/3130800.3130828 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Blans MJ, Bosch FH. Ultrasound in acute internal medicine; time to set a European standard. Eur J Intern Med. 2017;45:51–53. doi: 10.1016/j.ejim.2017.09.040 [DOI] [PubMed] [Google Scholar]
- 24.Mathews B, Zwank M. Hospital medicine point of care ultrasound credentialing: an example protocol. J Hosp Med. 2017;12(9):767–772. doi: 10.12788/jhm.2809 [DOI] [PubMed] [Google Scholar]
- 25.Sabath BF, Singh G. Point-of-care ultrasonography as a training milestone for internal medicine residents: the time is now. J Community Hosp Intern Med Perspect. 2016;6(5):33094. doi: 10.3402/jchimp.v6.33094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Kimura BJ, Amundson SA, Shaw DJ. Hospitalist use of hand-carried ultrasound: preparing for battle. J Hosp Med. 2010;5(3):163–167. doi: 10.1002/jhm.591 [DOI] [PubMed] [Google Scholar]
- 27.Galasko GIW, Lahiri A, Senior R. Portable echocardiography: an innovative tool in screening for cardiac abnormalities in the community. Eur J Echocardiogr. 2003;4(2):119–127. doi: 10.1053/euje.2002.0627 [DOI] [PubMed] [Google Scholar]
- 28.Kessler C, Bhandarkar S. Ultrasound training for medical students and internal medicine residents-A needs assessment. J Clin Ultrasound. 2010;38(8):401–408. doi: 10.1002/jcu.20719 [DOI] [PubMed] [Google Scholar]
- 29.Watson K, Lam A, Arishenkoff S, et al. Point of care ultrasound training for internal medicine: a Canadian multi-centre learner needs assessment study. BMC Med Educ. 2018;18(1):217. doi: 10.1186/s12909-018-1326-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Yamada T, Minami T, Soni NJ, et al. Skills acquisition for novice learners after a point-of-care ultrasound course: does clinical rank matter? BMC Med Educ. 2018;18(1):202. doi: 10.1186/s12909-018-1310-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Anstey JE, Jensen TP, Afshar N. Point-of-care ultrasound needs assessment, curriculum design, and curriculum assessment in a large academic internal medicine residency program. South Med J. 2018;111(7):444–448. doi: 10.14423/SMJ.0000000000000831 [DOI] [PubMed] [Google Scholar]
- 32.Kelm DJ, Ratelle JT, Azeem N, et al. Longitudinal ultrasound curriculum improves long-term retention among internal medicine residents. J Grad Med Educ. 2015;7(3):454–457. doi: 10.4300/JGME-14-00284.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Town JA, Bergl PA, Narang A, McConville JF. Internal medicine residents’ retention of knowledge and skills in bedside ultrasound. J Grad Med Educ. 2016;8(4):553–557. doi: 10.4300/JGME-D-15-00383.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Clay RD, Lee EC, Kurtzman MF, Dversdal RK. Teaching the internist to see: effectiveness of a 1-day workshop in bedside ultrasound for internal medicine residents. Crit Ultrasound J. 2016;8(1):11. doi: 10.1186/s13089-016-0047-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Skalski JH, Elrashidi M, Reed DA, McDonald FS, Bhagra A. Using standardized patients to teach point-of-care ultrasound-guided physical examination skills to internal medicine residents. J Grad Med Educ. 2015;7(1):95–97. doi: 10.4300/JGME-D-14-00178.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Schnobrich DJ, Olson APJ, Broccard A, Duran-Nelson A. Feasibility and acceptability of a structured curriculum in teaching procedural and basic diagnostic ultrasound skills to internal medicine residents. J Grad Med Educ. 2013;5(3):493–497. doi: 10.4300/JGME-D-12-00214.1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Dulohery MM, Stoven S, Kurklinksy A, Halvorsen A, McDonald FS, Bhagra A. Ultrasound for internal medicine physicians. J Ultrasound Med. 2014;33(6):1005–1011. doi: 10.7863/ultra.33.6.1005 [DOI] [PubMed] [Google Scholar]
- 38.Nardi M, Shaw DJ, Amundson SA, Phan JN, Kimura BJ. Creating a novel cardiac limited ultrasound exam curriculum for internal medical residency: four unanticipated tasks. J Med Educ Curric Dev. 2016;3:JMECD.S18932. doi: 10.4137/JMECD.S18932 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Soni N, Arntfield R, Kory P. Point of Care Ultrasound. 20th August Philadelphia: Saunders; 2014. [Google Scholar]