Abstract
Objectives
Point‐of‐care ultrasound (POCUS) has been identified as a critical skill for pediatric emergency medicine (PEM) physicians. The purpose of this study was to profile the current status of PEM POCUS in pediatric emergency departments (EDs).
Methods
An electronic survey was distributed to PEM fellows and attending physicians at four major pediatric academic health centers. The 24‐item questionnaire covered professional demographics, POCUS experience and proficiency, and barriers to the use of POCUS in pediatric EDs. We used descriptive and inferential statistics to profile respondent's PEM POCUS experience and proficiency and Rasch analysis to evaluate barriers to implementation.
Results
Our return rate was 92.8% (128/138). Respondents were attending physicians (68%) and fellows (28%). Most completed pediatric residencies prior to PEM fellowship (83.6%). Almost all had some form of ultrasound education (113/128, 88.3%). Approximately half (46.9%) completed a formal ultrasound curriculum. More than half (53.2%) said their ultrasound education was pediatric‐specific. Most participants (67%) rated their POCUS proficiency low (Levels 1–2), while rating proficiency in other professional competencies (procedures 52%, emergency stabilization 70%) high (Levels 4–5). There were statistically significant differences in POCUS proficiency between those with formal versus informal ultrasound education (p < 0.001) and those from pediatric versus emergency medicine residencies (p < 0.05). Participants identified both personal barriers discomfort with POCUS skills (76.7%), insufficient educational time to learn POCUS (65%), and negative impact of POCUS on efficiency (58.5%)—and institutional barriers to the use of ultrasound‐consultants will not use ultrasound findings from the ED (60%); insufficient mentoring (64.7%), and POCUS not being a departmental priority (57%).
Conclusions
While POCUS utilization continues to grow in PEM, significant barriers to full implementation still persist. One significant barrier relates to the need for dedicated time to learn and practice POCUS to achieve sufficient levels of proficiency for use in practice.
Point‐of‐care ultrasound (POCUS) is defined as medical sonography performed and interpreted for medical decision making or procedural guidance by the bedside clinician.1 This imaging modality has been in use by general emergency physicians since the 1980s and has been deemed a critical component of the practice of emergency medicine (EM) by the American College of Emergency Physicians (ACEP), the American Board of Emergency Medicine, the Society of Academic Emergency Medicine, and the American Institute of Ultrasound in Medicine.2, 3, 4 The recently updated ACEP policy statement includes detailed guidelines for the use of POCUS in EM and outlines POCUS training recommendations for all practicing EM residents in the United States.5 The Accreditation Council for Graduate Medical Education (ACGME) EM Milestones, which track trainee development biannually in established core competencies, denotes POCUS as one of the 23 milestones for EM residents (Table 1A).6
Table 1.
Level 1 | Level 2 | Level 3 | Level 4 | Level 5 |
---|---|---|---|---|
A. Goal‐directed focused ultrasound (diagnostic/procedural)—PC12 a | ||||
Describes the indications for emergency ultrasound |
Explains how to optimize ultrasound images and identifies the proper probe for each of the focused applications Performs an eFAST |
Performs goal‐directed focused ultrasound examinations Correctly interprets acquired images |
Performs a minimum of 150 focused ultrasound examinations | Expands ultrasonography skills to include: advanced echo, TEE, bowel, adnexal and testicular pathology, and transcranial Doppler |
B. Our competency‐based self‐assessment for PEM POCUS fashioned after the ACGME milestones | ||||
Describe the indications for emergency ultrasound |
Explain how to optimize ultrasound images and identify the proper probe for each of the focused ultrasound applications I also can perform a FAST/eFAST examination |
Perform goal‐directed focused ultrasound examinations and correctly interpret acquired images | Perform a minimum of 150 focused ultrasound examinations | Consistently achieve scans at the technical level of an imaging professional, meaning I would feel comfortable documenting the results, making a clinical decision based on my findings, saving the images to the chart, and billing the patient for my images |
C. ACGME PEM milestone for general approach to procedures—PC9 b | ||||
Identifies pertinent anatomy and physiology for a specific procedure; uses appropriate universal precautions | Performs patient assessment, obtains informed consent, and ensures monitoring equipment is in place in accordance with patient safety standards; knows indications, contraindications, anatomic landmarks, equipment, anesthetic and procedural techniques, and potential complications for common ED procedures; performs the indicated common procedure on a patient with moderate urgency who has identifiable landmarks and a low‐to‐moderate risk for complications; performs postprocedural assessment and identifies any potential complications | Determines a back‐up strategy if initial attempts to perform a procedure are unsuccessful; correctly interprets the results of a diagnostic procedure | Performs indicated procedures on any patients with challenging features (e.g., poorly identifiable landmarks, at extremes of age or with comorbid conditions; performs the indicated procedure, takes steps to avoid potential complications, and recognizes the outcome and/or complications resulting from the procedure | Teaches procedural competency and corrects mistakes |
D. ACGME PEM milestone for emergency stabilization—PC5 c | ||||
Recognizes abnormal vital signs | Recognizes when a patient is unstable requiring immediate intervention; performs a primary assessment on a critically ill or injured patient; discerns relevant data to formulate a diagnostic impression and plan | Manages and prioritizes critically ill or injured patients; prioritizes critical stabilization actions in the resuscitation of a critically ill or injured patient; reassesses after implementing a stabilizing intervention; evaluates the validity of a DNAR order | Recognizes in a timely fashion when further clinical intervention is futile; integrates hospital support services into a management strategy for a problematic stabilization situation | Develops policies and protocols for the management and/or transfer of critically ill or injured patients |
ACGME = Accreditation Council for Graduate Medical Education; DNAR = do not attempt resuscitation; PEM = pediatric emergency medicine; POCUS = point‐of‐care ultrasound; TEE = transesophageal echocardiography.
Uses goal‐directed focused ultrasound for the bedside diagnostic evaluation of emergency medical conditions and diagnoses, resuscitation of the acutely ill or injured patient, and procedural guidance.
Performs the indicated procedure on all appropriate patients and takes steps to avoid potential complications, and recognizes the outcome and/or complications resulting from the procedure—PC9.
Prioritizes critical initial stabilization action and mobilizes hospital support services in the resuscitation of a critically ill or injured patient and reassesses after stabilizing intervention—PC5.
More recently, POCUS has gained recognition in the field of pediatric emergency medicine (PEM) as an ideal imaging modality as it is painless, noninvasive, rapid, and dynamic.7, 8, 9, 10, 11, 12, 13 Most importantly, ultrasound does not use ionizing radiation, which has the potential for harmful effects over the course of a lifetime.14, 15, 16, 17, 18 POCUS has been a testable content specification for the American Board of Pediatrics PEM board examination since 2009, and in 2013 consensus PEM POCUS education guidelines and a model curriculum were published.19, 20 In 2015, the American Academy of Pediatrics issued a policy statement supporting the use of POCUS by PEM physicians.8, 9
In the past decade, a few studies have sought to profile the use of POCUS in PEM, particularly through the lens of POCUS education and utilization.10, 11, 13, 21 One study attempted to characterize the use of POCUS by PEM physicians through a survey of PEM fellowship directors, asking them to report the amount of POCUS training in PEM fellowships.21 Other studies profiled POCUS education and its use in the emergency department (ED) from a broader perspective, using PEM fellowship program directors, PEM medical directors, and PEM fellows.10, 11, 13
Despite the increased interest in incorporating bedside ultrasound imaging into the care of pediatric patients, we wondered whether the use of POCUS was actually gaining significant traction in PEM. Our study sought to profile the current state of POCUS in PEM by directly asking practitioners in major academic pediatric EDs about their POCUS education, experience, perceived skill with the modality, and barriers to its use in their departments.
Methods
Population of Interest
Ultimately, we are interested in profiling PEM physicians across the United States and Canada. However, for practical reasons such as increasing study buy‐in and maximizing response rates, we chose to focus on studying the profile of a smaller, regional group for this pilot study. We selected four academic children's hospitals from Ohio, Michigan, and Pennsylvania on the basis of their close geographical proximity to our site, their size, their academic interest in pediatric POCUS, and involvement in POCUS education at the resident and fellowship level. We also selected sites based on whether they had ultrasound expertise in the form of a designated ultrasound director. By remaining regional, we were able to enlist the support of coinvestigators at each site, which helped to promote a substantial survey return rate.
Survey Design
The questionnaire used for gathering data for this study was developed by a panel of ultrasound educators at the principal investigator site. After the questionnaire was designed, it was evaluated, tested, and discussed by the site investigators and manuscript authors, all of whom had content expertise in either EM‐POCUS or PEM‐POCUS, ultrasound education, or survey design. DLG, JRM, and DH are experts in PEM‐POCUS and emergency ultrasound directors at their respective academic health centers. DPB has considerable expertise in EM‐POCUS. LMS was a pediatric emergency ultrasound fellow at the time of this study. RMS and JMK are experts in research and survey design, data collection, and survey implementation. Minor modifications were made based on feedback from the site investigators regarding content, clarity, and the importance of each question.
The final version of the questionnaire was 24 items and contained both multiple‐choice and open‐ended items. The questionnaire covered four specific content domains: 1) How and when the survey participant received their POCUS education (six items); 2) their confidence and perceived level of proficiency in using POCUS with children (four items); 3) how often and for what purpose they used POCUS in practice, and if they did not, what they perceived as barriers to more widespread use of POCUS (6‐items); and 4) basic participant demographics (eight items).
To assess survey participant's pediatric POCUS proficiency, we designed a competency‐based self‐assessment fashioned after the ACGME milestones. This pediatric POCUS assessment was adapted from the ACGME Emergency Medicine Patient Care (PC12) milestone for bedside ultrasound (Tables 1A and 1B).6 As a check for the inevitable rating inflation that arises from self‐assessment,22 we also included two well established ACGME PEM Milestones–General Approach to Procedures (PC9) and Emergency Stabilization (PC5); (Tables 1C and 1D).23 Subjects used behavioral anchors to rate their level of proficiency using a 1 to 5 scale. A “1” on this scale represents the proficiency of a beginning intern or subspecialty fellow, whereas a “5” represents the proficiency of an expert.
Participants were asked to rate both personal barriers to the use of POCUS in their practice and barriers imposed by their institution. Barriers were rated using Likert response sets: 1 = strongly disagree, 2 = disagree, 3 = neutral, 4 = agree, and 5 = strongly agree.24 A final version of the questionnaire was distributed to and approved by the site investigators prior to study implementation (Appendix S1, available as supporting information in the online version of this paper, which is available at https://doi.org/onlinelibrary.wiley.com/doi/10.1002/aet2.10049/full).
Survey Implementation
The survey was administered through a Web‐based survey service (SurveyMonkey) over 4 weeks in Autumn 2015. Site investigators were responsible for identifying and surveying eligible participants at their home institutions. We sent an initial e‐mail with an explanatory introduction and survey link to the site investigators, who then forwarded it to their eligible participants. Site investigators followed up with weekly reminder e‐mails for 4 weeks. At the conclusion of data collection, survey responses were deidentified. No incentives were offered for survey completion.
Data Analysis
We calculated frequencies and percentages of respondent demographics to profile their POCUS education, experience, and perceived level of proficiency in three domains of physician competency. We ran additional analyses involving inferential statistics including chi‐square and independent t‐tests to compare subgroups within the survey sample including comparisons of those who received formal versus informal ultrasound education, attendings versus fellows, and pediatrics versus emergency medicine training pathways. These analyses were performed using IBM SPSS for Windows (IBM Corp. Released 2016. IBM SPSS Statistics for Windows, Version 24.0, IBM Corp). Cohen's d effect sizes (es) were calculated for each significant statistical test using the effect size calculators from Psychometrica.25
Finally, we performed a Rasch analysis to profile responses regarding individual and institutional barriers to the use of POCUS in practice. Rasch analysis was used to convert the ordinal level rating scale data (Likert ratings of barriers) into interval level data using Winsteps Rasch measurement software (version 3.75.0, Winsteps Inc.).26 The conversion to Rasch logits using the “rating scale model” provides the reader with a measure of the difficulty each barrier poses, relative to the other barriers. A large, negative logit value represents a significant challenge to POCUS implementation, while a large, positive logit represents an insignificant challenge. This study was deemed exempt by the principal investigator's institutional review board.
Results
The eligible population for this study included 138 attendings and fellows across four sites. We received 128 questionnaires, 123 of which were thoroughly completed for a response rate of 89% (123/138). Over 60% of respondents were female (78 of 128, 61%). Respondents represented the four hospitals studied almost equally, with slightly higher percentages of respondents from Children's Hospitals A (98%) and B (94%) and slightly fewer from Children's Hospitals C (85%) and D (86%). We received surveys from 87 (68%) attending physicians, 54 of whom had been in practice for 6 or more years, and 36 fellows (28%), evenly distributed over 3 years of fellowship. Most of our respondents had completed pediatric residencies followed by PEM fellowships (107/128, 83.6%). The remainder had completed emergency medicine residencies followed by PEM fellowships (16/128, 12.5%). Less than half of our respondents had completed formal ultrasound education through medical school, residency, or fellowship (60/128, 46.9%). Slightly more than 40% had completed informal ultrasound training through CME or independent study. Most of our respondents learned ultrasound through didactics (70.3%), simulation in a skills laboratory (52.3%), or structured rotations/scanning shifts supervised by POCUS trained faculty (39.1%). Only 11.7% of our respondents reported having no ultrasound education at all. Among those who completed ultrasound education, over half (68 of 128, or 53.2%) learned ultrasound specific to pediatrics (Table 2).
Table 2.
Demographics | n (%) |
Sex | |
Female | 78 (61) |
Male | 45 (35) |
No response | 5 (4) |
Hospital | |
Site A | 43 (34) |
Site B | 30 (23) |
Site C | 23 (18) |
Site D | 30 (23) |
No response | 2 (2) |
Current position | |
Attending | 87 (68) |
Years in practice (posttraining) | |
0–5 | 17 (13) |
6–15 | 35 (27) |
>15 | 35 (27) |
Fellow | 36 (28) |
Fellowship Year 1 | 13 (10) |
Fellowship Year 2 | 11 (8.6) |
Fellowship Year 3 | 12 (9.4) |
No response | 5 (4) |
Training pathway | |
Pediatrics or IM‐peds residency with PEM fellowship | 107 (83.6) |
Emergency medicine residency with PEM fellowship | 16 (12.5) |
No response | 5 (4) |
Ultrasound education | |
Formal US education program (in medical school, residency, or fellowship) | 60 (46.9) |
Informal US education program (self‐taught, bedside instruction, CME as an attending) | 53 (41.4) |
No US Education | 15 (11.7) |
Proportion of US education specific to pediatrics | |
All US training is in pediatrics (100%) | 34 (26.6) |
Most | 34 (26.6) |
Some | 24 (18.8) |
None is pediatrics (0%) | 21 (16.4) |
No US education at all | 15 (11.7) |
PEM = pediatric emergency medicine; US = ultrasound.
We found that respondents rated their level of competency on goal‐directed focused ultrasound (mean ± SD = 2.14 ± 1.13) significantly lower than they did procedures (mean ± SD = 3.45 ± 1.59; t = –9.02, df = 122, p < 0.001, es = 0.94) or emergency stabilization (mean ± SD = 3.98 ± 1.14; t = –14.88, df = 122, p < 0.001, es = 1.63; Table 3). In comparing subgroups on their ratings of competency on goal‐directed focused ultrasound, we found that those who had received formal ultrasound training (mean ± SD = 2.56 ± 1.16) rated themselves significantly higher than those who received informal or no training (mean ± SD = 1.75 ± 0.93; t = 4.25, df = 121, p < 0.001, es = 0.77). Furthermore, we found that those who came from an emergency medicine residency pathway (mean ± SD = 2.88 ± 1.50) rated themselves significantly higher than those who came from a pediatric residency pathway (mean ± SD = 2.03 ± 1.02; t = 2.18, df = 121, p < 0.05, es = 0.66; Note: effect sizes of 0.77–1.63 are considered large to very large. An effect size of 0.66 is considered medium).
Table 3.
Level of Achievement | Goal‐directed Focused Ultrasound of Pediatric Patients | Procedures With Pediatric Patients | Emergency Stabilization of Pediatric Patients |
---|---|---|---|
1 | 42 (33) | 21 (16) | 4 (3) |
2 | 44 (34) | 23 (18) | 14 (11) |
3 | 21 (16) | 12 (9) | 15 (12) |
4 | 10 (8) | 14 (11) | 38 (30) |
5 | 6 (5) | 53 (41) | 52 (40) |
Missing | 5 (4) | 5 (4) | 5 (4) |
Total | 128 (100) | 128 (100) | 128 (100) |
PEM = pediatric emergency medicine.
When comparing fellows to attending faculty, we found that ratings of competency on goal‐directed focused ultrasound to be equally low for both groups (fellow mean ± SD = 2.28 ± 1.09; attending mean ± SD = 2.08 ± 1.14; t = –0.884, df = 121, p = 0.38). With regards to procedural competency, attending physicians and fellows again rated themselves similarly (fellow mean ± SD = 3.17 ± 1.08; attending mean ± 3.56, SD. 1.75; t = 1.26, df = 121, p = .21). However, attendings rated their competency of emergency stabilization significantly higher than did fellows (attending mean ± SD = 4.31 ± 1.06; fellow mean ± SD = 3.17 ± 0.91; t = 5.66, df = 121, p = 0.001, es = 1.12).
When asked about barriers to the use of POCUS in their PEM practice, 49 of 128 (38%) said that they experience barriers at both the personal and the institutional level. The number who reported experiencing no barriers was 35 of 128 (27%). The remaining 44 (34%) reported experiencing one barrier or the other. The most significant barriers to the use of ultrasound in practice were personal: comfort with ultrasound skills and time to learn ultrasound. Institutionally, participants suggest that the most significant barrier was a lack of subspecialist consultants who would use ultrasound findings from an ED physician. The least significant barrier was availability of ultrasound equipment since almost all respondents said that they had direct access to an ultrasound machine within their department (Table 4).
Table 4.
Potential Barrier | Rasch Logits | SE | Rank | SD (1) | D (2) | N (3) | A (4) | SA (5) |
---|---|---|---|---|---|---|---|---|
P‐2 I do not feel comfortable enough with my ultrasound skills to use this modality clinically | –0.91 | 0.13 | 1 | 3 (3.9) | 7 (9.1) | 8 (10.4) | 35 (45.5) | 24 (31.2) |
P‐3 I do not have sufficient educational time to dedicate to learning pediatric emergency ultrasound | –0.65 | 0.12 | 2 | 1 (1.3) | 11 (14.3) | 15 (19.5) | 34 (44.2) | 16 (20.8) |
I‐6 There is a lack of subspecialists/consultants who would use emergency ultrasound findings for medical decision making | –0.54 | 0.13 | 3 | 2 (3.1) | 12 (18.5) | 12 (18.5) | 20 (30.8) | 19 (29.2) |
P‐5 I feel that using emergency ultrasound during my clinical shifts negatively impacts my efficiency and patient flow | –0.50 | 0.12 | 4 | 3 (3.9) | 10 (13.0) | 19 (24.7) | 32 (41.6) | 13 (16.9) |
I‐4 There is not sufficient mentorship or emergency ultrasound trained faculty to use this modality effectively and safely | –0.40 | 0.13 | 5 | 4 (6.2) | 12 (18.5) | 7 (10.8) | 30 (46.2) | 12 (18.5) |
I‐5 The use of pediatric emergency ultrasound is not a priority in my department | –0.40 | 0.13 | 5 | 2 (3.1) | 11 (16.9) | 15 (23.1) | 25 (38.5) | 12 (18.5) |
I‐7 We encounter resistance to usage of emergency ultrasound from other departments at our site (e.g., surgery, radiology). | –0.20 | 0.12 | 7 | 5 (7.7) | 15 (23.1) | 14 (21.5) | 16 (24.6) | 15 (23.1) |
I‐3 There is no structured curriculum to educate the physicians on how to use pediatric emergency ultrasound | –0.17 | 0.12 | 8 | 6 (9.2) | 12 (18.5) | 12 (18.5) | 27 (41.5) | 8 (12.3) |
I‐2 There is a lack of funding to further emergency ultrasound pursuits and education | 0.28 | 0.12 | 9 | 12 (18.5) | 16 (24.6) | 14 (21.5) | 17 (26.2) | 6 (9.2) |
P‐1 I do not ascribe significant value to using emergency ultrasound clinically in my patients | 0.68 | 0.12 | 10 | 20 (26.0) | 30 (39.0) | 13 (16.9) | 9 (11.7) | 5 (6.5) |
P‐4 I do not work enough clinical shifts to effectively practice my emergency ultrasound skills | 0.72 | 0.12 | 11 | 16 (20.8) | 36 (46.8) | 14 (18.2) | 8 (10.4) | 3 (3.9) |
I‐1 There is no functional ultrasound machine available for use | 2.10 | 0.19 | 12 | 42 (64.6) | 18 (27.7) | 3 (4.6) | 0 (0) | 2 (3.1) |
Data are based on respondent ratings (using Likert response sets) of barriers to the use of ultrasound in practice. Responses of agreement (strongly agree or agree) were considered more significant barriers than responses of disagreement (strongly disagree or disagree).
Barriers are listed from most (1) to least (12) significant.
Fit statistics were all within the acceptable range of –2.0 to +2.0.
A = agree; D = disagree; N = neutral; PEM = pediatric emergency medicine; POCUS = point‐of‐care ultrasound; SA = strongly agree; SD = strongly disagree; SE = standard error.
Discussion
Our study objective was to describe the current POCUS milieu through investigation of a select group of pediatric hospitals with established PEM POCUS programs. Almost 90% of subjects reported some form of POCUS education, with the majority having significant pediatric‐focused instruction. Yet despite this training, study participants rated their POCUS proficiency much lower than they did other professional competencies expected of PEM physicians: general procedural skills and emergency stabilization. Notably, those who had experienced formal ultrasound training programs and those who were trained in emergency medicine residency programs rated their level of POCUS proficiency higher than did those with informal education or those from pediatric residencies. We found no difference in ratings of ultrasound proficiency between current fellows and attending physicians.
These findings are important because they have ramifications for how we should be preparing future physicians to use goal‐directed focused ultrasound in the pediatric ED. PEM practitioners reported having difficulty learning PEM POCUS through informal, self‐directed learning programs due to competing demands for their time. POCUS is a complex and highly technical imaging modality that involves both cognitive and psychomotor skill sets.7, 8, 9 Accordingly, developing PEM POCUS skills requires substantial formal education programs with dedicated time to learn and practice, as well as the provision of assessment and feedback to the learner. The finding that emergency medicine residency graduates report higher levels of proficiency in PEM POCUS than those from pediatric residencies, suggest the need for pediatric residency programs to develop clearly defined learning competencies framed in a structure similar to the ones we adapted from emergency medicine.
The ACGME milestones provide a structure for the competencies expected of physicians at designated stages of professional development. The milestones represent knowledge, skills, and attitudes organized in a developmental framework from less to more advanced.6, 23, 27, 28 We adapted the ACGME Emergency Medicine Ultrasound Milestones (PC12) to profile PEM practitioners use of POCUS in practice. The adaptation became an instrument for self‐assessment on PEM POCUS. Perhaps a PEM POCUS milestone will be useful in the future for providing structure to the professional development of ultrasound skills for PEM practitioners.
The use of POCUS among pediatric care providers is growing, yet significant barriers exist to its use in the ED. The barriers that we identified mirror those identified at the medical undergraduate level, and the graduate medical education level in PEM, as well as other specialties.10, 11, 29, 30, 31, 32
Most of our respondents reported personal barriers related to a lack of ultrasound education earlier in their careers and inadequate amounts of time to learn and practice PEM POCUS skills. These findings compare directly to the findings from a 2012 study of PEM fellowship program directors who identified the most significant barriers to the use of PEM POCUS to be a lack of time to learn the imaging modality and a lack of experienced PEM POCUS educators.10
Beyond personal barriers, our findings suggest that there are institutional and cultural barriers preventing POCUS from being fully accepted in PEM departments. The most significant of these involves a lack of confidence in the PEM physician's ability to acquire and interpret POCUS images, among practitioners from other specialties. This problem is potentially compounded by the general lack of interest in POCUS by pediatric EDs and the concern that its use interferes with clinical efficiency. These institutional barriers along with the aforementioned personal barriers have a negative impact on the broader scale adoption of POCUS among PEM practitioners.
Barriers to PEM POCUS at both the personal and the institution level might be overcome by establishing site champions/ultrasound directors at hospitals, hiring formally POCUS‐trained faculty, providing accessible formal continuing education programs, incentivizing department credentialing metrics, and billing for scans.7, 8, 9 Future research should provide a more in‐depth look into the efforts to surmount both individual and institutional barriers to PEM POCUS. Additionally, administrative barriers such as those tied to reimbursement should be the subject of further research.
Limitations
The primary limitation to this study occurred from the tradeoffs we made to achieve a respectable return rate of our questionnaires. First, we restricted our study population to a regional level, which may have implications for generalizability to a national population. An additional limitation is that we relied on survey respondents to self‐assess professional competencies. There is a considerable body of literature that highlights the unreliability of self‐assessment.33, 34, 35 For this study, however, we incorporated additional self‐assessments of professional competencies as a check for inflated self‐assessment on POCUS. Because participants rated their proficiency low on POCUS when compared to other professional proficiencies, we believe that our respondents’ self‐assessments reflect that they feel their POCUS skills are lacking relative to their other clinical skills.
Conclusions
Despite having significant ultrasound education, our respondents rated their competency in pediatric emergency medicine point‐of‐care ultrasound low relative to other professional competencies. Characteristics of those with higher ratings of ultrasound competency included those who had formal ultrasound education and those from emergency medicine residency programs. The most significant barriers to pediatric emergency medicine point‐of‐care ultrasound implementation included both personal barriers in the form of confidence in pediatric emergency medicine point‐of‐care ultrasound skills and lack of dedicated time to learn and practice. Institutional barriers include a culture that does not support the use of point‐of‐care ultrasound in pediatric emergency medicine, including lack of confidence in point‐of‐care ultrasound results among colleagues from other medical disciplines and a fear that the use of point‐of‐care ultrasound negatively impacts clinical productivity. The broader adoption of point‐of‐care ultrasound will require formal ultrasound education programs containing clearly articulated learning goals such as POCUS milestones designed specifically for pediatric emergency medicine.
Supporting information
AEM Education and Training 2017;1:325–333.
This work has been presented as a research poster presentation at the following meetings: American Institute of Ultrasound Medicine Annual Conference, March 25‐29, 2016, New York, NY; the Pediatric Academic Societies Annual Conference, Apr 30‐May 3, 2016, Baltimore, MD; and the Society for Academic Emergency Medicine Annual Conference, May 10‐13, 2016, New Orleans, LA.
The authors have no relevant financial information or potential conflicts to disclose.
References
- 1. Moore CL, Copel JA. Current concepts: point‐of‐care ultrasonography. N Engl J Med 2011;364:749–57. [DOI] [PubMed] [Google Scholar]
- 2. Moak J. SAEM Endorses the 2008 ACEP Ultrasound guidelines. Available at: http://sinaiem.us/news/saem-endorses-the-2008-acep-ultrasound-guidelines. Accessed Aug 14, 2016.
- 3. American Institute of Ultrasound in Medicine . Recognition of American College of Emergency Physicians Policy Statement “Ultrasound Guidelines: Emergency, Point‐of‐care, and Clinical Ulstrasound Guidelines in Medicine.” Approved November 5, 2011. Available at: http://www.aium.org/OfficialStatements/45. Accessed Sep 9, 2016.
- 4. Akhtar S, Theodoro D, Gaspari R, et al. Resident training in emergency ultrasound: consensus recommendations from the 2008 Council of Emergency Medicine Residency Directors conference. Acad Emerg Med 2009;16(Suppl 2):S32–6. [DOI] [PubMed] [Google Scholar]
- 5. American College Emergency Physicians . Ultrasound guidelines: emergency, point‐of‐care, and clinical ultrasound guidelines. Approved June 2016. Available at: https://www.acep.org/Clinical-Practice-Management/Ultrasound/. Accessed Oct 26, 2016.
- 6. Accreditation Council for Graduate Medical Education and the American Board of Emergency Medicine . The Emergency Medicine Milestone Project (2015). Available at: http://www.acgme.org/Portals/0/PDFs/Milestones/EmergencyMedicineMilestones.pdf. Accessed Sep 15, 2016.
- 7. McLario DJ, Sivitz AB. Point‐of‐care ultrasound in pediatric clinical care. JAMA Pediatr 2015;169:594–600. [DOI] [PubMed] [Google Scholar]
- 8. Marin JR, Abo AM, Doniger SJ, Fischer JW, Kessler DO, Levy JA, et al. Point‐of‐care ultrasonography by pediatric emergency physicians. Ann Emerg Med 2015;65:472–8. [DOI] [PubMed] [Google Scholar]
- 9. Marin JR, Lewiss RE, Shook JE, et al. Point‐of‐care ultrasonography by pediatric emergency medicine physicians. Pediatrics 2015;135:e113–22. [DOI] [PubMed] [Google Scholar]
- 10. Marin JR, Zuckerbraun NS, Kahn JM. Use of emergency ultrasound in United States pediatric emergency medicine fellowship programs in 2011. J Ultrasound Med 2012;31:1357–63. [DOI] [PubMed] [Google Scholar]
- 11. Cohen JS, Teach SJ, Chapman JI. Bedside ultrasound education in pediatric emergency medicine fellowship programs in the united states. Pediatr Emerg Care 2012;28:845–50. [DOI] [PubMed] [Google Scholar]
- 12. Levy JA, Noble VE. Bedside Ultrasound in pediatric emergency medicine. Pediatrics 2008;121:e1404–12. [DOI] [PubMed] [Google Scholar]
- 13. Chamberlain MC, Reid SR, Madhok M. Utilization of emergency ultrasound in pediatric emergency departments. Pediatr Emerg Care 2011;27:628–32. [DOI] [PubMed] [Google Scholar]
- 14. Brenner DJ, Hall EJ. Computed tomography–an increasing source of radiation exposure. N Engl J Med 2007;357:2277–84. [DOI] [PubMed] [Google Scholar]
- 15. Pearce MS, Salotti JA, Little MP, et al. Radiation exposure from CT scans in childhood and subsequent risk of leukemia and brain tumors: a retrospective cohort study. Lancet 2012;380:499–505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Zacharias C, Alessio AM, Otto RK, et al. Pediatric CT: strategies to lower radiation dose. Am J Roentgenol 2013;200:950–56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Goske MJ, Applegate KE, Bulas D, et al. Alliance for Radiation Safety in Pediatric Imaging. Image Gently: progress and challenges in CT education and advocacy. Pediatr Radiol 2011;41:461–6. [DOI] [PubMed] [Google Scholar]
- 18. Brody AS, Frush DP, Huda W, Brent RL. American Academy of Pediatrics Section on radiology: radiation risk to children from computed tomography. Pediatrics 2007;120:677–82. [DOI] [PubMed] [Google Scholar]
- 19. American Board of Pediatrics . Content Outline—Pediatric Emergency Medicine: Subspecialty In‐Training, Certification, and Maintenance of Certification (MOC) Examinations. Available at: https://www.abp.org/sites/abp/files/pdf/pediatric_emergency_medicine_content_outline.pdf. Accessed Nov 23, 2016.
- 20. Viera RL, Hsu D, Nagler J, Chen L, Gallagher R, Levy JA. Pediatric emergency medicine fellow training in ultrasound: consensus educational guidelines. Acad Emerg Med 2013;20:300–6. [DOI] [PubMed] [Google Scholar]
- 21. Ramirez‐Schrempp D, Dorman DH, Tien I, Liteplo AS. Bedside ultrasound in pediatric emergency medicine fellowship programs in the United States: little formal training. Pediatr Emerg Care 2008;24:664–7. [DOI] [PubMed] [Google Scholar]
- 22. Regehr G, Eva K. Self‐assessment, self‐direction, and the self‐regulating professional. Clin Orthop Relat Res 2006;449:34–8. [DOI] [PubMed] [Google Scholar]
- 23. Accreditation Council for Graduate Medical Education, the American Board of Pediatrics, and the American Board of Emergency Medicine 2015. The Pediatric Emergency Medicine Milestone Project. Available at: http://www.acgme.org/Portals/0/PDFs/Milestones/PediatricEmergencyMedicineMilestones.pdf. Accessed Sep 15, 2016.
- 24. Likert R. A technique for the measurement of attitudes. Arch Psychol 1932;140:1–55. [Google Scholar]
- 25. Lenhard A, Lenhard W. Computation of Effect Sizes #4: Calculation of d and r from the Test Statistics of Dependent and Independent t‐tests. Psychometrica Freeware. Available at: https://www.psychometrica.de/effect_size.html. Accessed Mar–Apr 2017
- 26. Salzberger T. Does the Rasch model convert an ordinal scale into an interval scale? Rasch Meas Trans 2010;24:1273–5. [Google Scholar]
- 27. Beeson MS, Carter WA, Christopher TA, et al. The development of the emergency medicine milestones. Acad Emerg Med 2013;20:724–9. [DOI] [PubMed] [Google Scholar]
- 28. Beeson MS, Holmboe ES, Korte RC, et al. Initial validity analysis of the emergency medicine milestones. Acad Emerg Med 2013;22:838–44. [DOI] [PubMed] [Google Scholar]
- 29. Bahner DP, Goldman E, Way D, Royall NA, Liu JT. The state of ultrasound education in U.S. medical schools: results of a national survey. Acad Med 2014;89:1681–6. [DOI] [PubMed] [Google Scholar]
- 30. Dinh VA, Fu JY, Lu S, Chiem A, Fox JC, Blaivas M. Integration of ultrasound in medical education at united states medical schools: a national survey of directors’ experiences. J Ultrasound Med 2016;35:413–9. [DOI] [PubMed] [Google Scholar]
- 31. Mosier JM, Malo J, Stolz LA, et al. Critical care ultrasound training: a survey of US fellowship directors. J Crit Care 2014;29:645–9. [DOI] [PubMed] [Google Scholar]
- 32. Kornblith AE, vanSchaik S, Reynolds T. Useful but not used: pediatric critical care physician views on bedside ultrasound. Pediatr Emerg Care 2015;31:186–9. [DOI] [PubMed] [Google Scholar]
- 33. Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self‐assessments. J Pers Soc Psychol 1999;77:1121–34. [DOI] [PubMed] [Google Scholar]
- 34. Ward M, Gruppen L, Regehr G. Measuring self‐assessment: current state of the art. Adv Health Sci Educ 2002;7:63–80. [DOI] [PubMed] [Google Scholar]
- 35. Davis DA, Mazmanian PE, Fordis M, Harrison RV, Thorpe KE, Perrier L. Accuracy of physician self‐assessment compared with observed measures of competence: a systematic review. JAMA 2006;296:1094–102. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.