Abstract
Objective:
We surveyed obstetric sonographers, who are at the forefront of the screening process to determine how barriers to prenatal cardiac screening impacted screening abilities.
Methods:
We performed a cross-sectional national survey of obstetric sonographers in the U.S. using a sampling frame from ARDMS mailing lists. The web survey measured ability to obtain and interpret fetal heart images. Several cognitive, socio-demographic and system-level factors were measured, including intention to perform cardiac imaging. Regression and mediation analyses determined factors associated with intention to perform, and ability to obtain and interpret cardiac images. Subgroup analyses of sonographers in tertiary versus non-tertiary centers were also performed.
Results:
Survey response rate either due to non-contact or non-response was 40%. Of 480 eligible sonographers, ~30% practiced in tertiary settings. Sonographers had lower intention to perform outflow views compared to four chambers. Higher self-efficacy and professional expectations predicted higher odds of intention to perform outflow views (OR 2.8 - CI 1.9, 4.2 and 1.9 - CI 1.1, 3.0 respectively). Overall accuracy of image interpretation was 65% (±14%). For the overall cohort and non-tertiary subgroup, higher intention to perform outflows was associated with increased accuracy in overall image interpretation. For the tertiary subgroup, self-efficacy and feedback were strongly associated with accuracy.
Conclusions:
We identified several modifiable (some heretofore unrecognized) targets to improve prenatal cardiac screening. Priorities identified by sonographers that are associated with screening success should guide future interventions.
Keywords: congenital heart defect, screening, prenatal diagnosis, ultrasound, cross-sectional survey
2. Introduction
Congenital heart disease (CHD) is the most common birth defect and a leading cause of neonatal deaths, yet screening for CHD is challenging.(1) Approximately 80% of CHD occurs in fetuses of mothers without risk factors.(2,3) Currently, prenatal cardiac screening occurs as part of a second trimester fetal anomaly scan.(4) While research and experience indicate that high quality cardiac screening should detect >80% of CHD, only 30-50% of CHD is detected in the U.S. and most developed countries, with high variation between centers, regions, and countries.(5–10)
Strategies to improve detection have been studied for the past 3 decades. Those previously found to have some success include: targeted sonographer training,(11–13) screening views,(14–16) tiered screening strategies,(17,18) and employing novel technologies such as 3-D or real-time 3-D sonographic imaging.(19,20) These strategies have not been widely implemented, especially in the United States, where highly varied training and practice environments limit feasibility.
Effective interventions for improving CHD detection need to be practical, feasible, and relevant for sonographers who perform in low-risk settings – where the majority of prenatal screening for heart defects occurs. In the U.S., obstetric sonographers who obtain screening images of the fetal heart and the physicians who interpret these scans are on the frontline of the screening process. Sonographers often may not communicate with the interpreting physician.(21) For this reason, they must recognize whether their imaging adequately captures the important structures of the fetal heart and in some cases differentiate between “normal” and “abnormal” images to demonstrate their findings for the interpreting physician. If they are unable to recognize and obtain standardized images that highlight the key cardiac findings, CHD detection may be missed.(22,23) The input of sonographers who perform imaging in a variety of clinical settings is central to understanding which strategies might be most effective and sustainable for improving CHD detection in practice.
The aim of this study was to 1) investigate cognitive, socio-demographic and system-level barriers and facilitators with screening for sonographers across the U.S., and 2) prioritize intervention targets, understand the association of these factors with sonographer ability to interpret cardiac screening images. We conducted a national survey of obstetric sonographers using a web-based instrument previously piloted regionally.(23) Furthermore, we sought to explore differences in identified barriers and their associations with sonographer ability by type of practice setting (tertiary/high-risk pregnancy imaging centers vs. community hospitals/clinics).
3. Materials and Methods:
Study Design:
We performed a cross-sectional nationally representative survey of obstetric sonographers in the United States. The target population was sonographers who perform second trimester obstetric screening (or fetal anomaly) ultrasound scans. Participants were recruited from a comprehensive list of sonographers registered with the American Registry of Diagnostic Medical Sonography (ARDMS) who designated obstetric ultrasound as their field. Sonographers who had performed a second trimester obstetric ultrasound independently in a non-training capacity in the prior 6 months were eligible (determined by the first two questions in the survey). To ensure participation from sonographers in rural settings, we employed a stratified probability sampling strategy; we created a sample of 2000 from a national list of ARDMS mailing addresses geocoded using Esri© street network files and ArcGIS software©. Geocoded cases were assigned a rural versus urban designation based on census tract using Rural Urban Commuting Area Codes (RUCA).(24,25) Sampling was stratified on 1) U.S. Census region (proportionate sampling based on registration) and 2) rural-urban designation (disproportionate oversampling for a 1:1 distribution). We used a multi-phase mixed-mode, evidence-based recruitment strategy including a pre-notification letter, e-mail follow-up with a survey link, and three additional electronic reminders.(26,27)
We adapted a survey that was previously developed for a prior regional pilot study(23) utilizing input from sonographer focus group discussions (Appendix A). The first section of the survey measured factors influencing sonographers’ intention to perform and ability to perform cardiac screening images. Candidate factors were based on published behavioral theory frameworks previously used to understand evidence implementation, health professional behaviors, and adoption of new technologies.(28–34) These, along with salient themes identified by focus groups in our previous work were used to develop an explanatory model of potential factors that contribute to sonographer performance of prenatal cardiac screening.(23) The main factors measured for this study included self-efficacy, outcome expectancy, perceived ease of use, feedback, professional expectancies, and knowledge. Most measures were adapted from the literature.(33,35) Previously validated scales had excellent internal consistency (Cronbach alpha range 0.80-0.94) as well as high internal convergent and discriminant validity and predictive validity. Self-efficacy measured a sonographer’s confidence or belief about their own ability to interpret screening images and was measured with a 6-item scale that asked about their confidence in obtaining images in different circumstances. Outcome expectancy (usefulness) measured sonographer’s beliefs about the usefulness of obstetric cardiac screening views (2-item scale). Perceived ease of use (ease of use) measured the degree to which sonographers felt obtaining screening images was free of effort (4-item). Feedback was measured using a novel 4-item scale validated in our regional survey that specifically asked sonographers to rate how both how important they felt feedback on their cardiac imaging was and how much feedback on their cardiac scanning they received. Professional expectations measured sonographer belief about whether screening was expected by peers, superiors or professional guidelines (3-item). Knowledge was measured using 5 questions around screening techniques and the current status of prenatal detection. Behavioral intention to perform cardiac screening was measured with several scale items (intent to perform any cardiac screening, 4 chamber screening, and outflow tract screening) both for its direct influence on performance as well as a mediator of other important factors that influence screening. All items, with the exception of knowledge, were measured using a 5-point Likert response scale.
Since measuring actual sonographer scanning ability on a national scale was unrealistic for this study, we used a surrogate measures. These included self-reported time to obtain cardiac imaging, self-reported ability to obtain 4 chamber and outflow tract screening views, and accuracy in image interpretation. The second part of the web survey presented 20 video clips of fetal heart screening views. Sonographers were asked to interpret four sets of five images each. The first set asked sonographers to interpret whether 4 chamber view images provided were adequate or inadequate for screening purposes since sonographers are responsible for obtaining adequate images to present providers for interpretation. The 2nd set of images asked them to interpret whether the 4 chamber view images provided were normal or abnormal. The remaining 2 sets repeated the same for outflow tract view images. Images that mimicked barriers such as maternal body habitus, suboptimal fetal lie, and early and late gestational ages were also incorporated. Two fetal cardiologists and a sonographer specializing in fetal echocardiography independently reviewed candidate images and only those with 100% inter-rater reliability were included. To decrease the impact of the image choice itself on sonographer performance, we had 3 sets of 20 images that were randomly selected for each survey participant.
Analysis:
The main outcome was accuracy of image interpretation. Descriptive summaries of the primary demographics and survey items were performed. Sonographers were designated as practicing in a tertiary setting if they performed any obstetric scanning at a high-risk obstetrics clinic or an imaging center associated with such a clinic. Scales for each measured factor were tabulated for raw and mean scores with standard deviations. Measured factors were examined for possible collinearity using pairwise correlations and variance inflation factors. Those with correlations higher than 0.7 were re-evaluated when fitting the models described below and the item with the most explanatory relevance was retained. The main analyses evaluated the association of the independent variables (self-efficacy, outcome expectancy, perceived ease of use, feedback, professional expectancies and knowledge) with 1) behavioral intention to perform outflow tract imaging using a logistic regression model and 2) overall percent accuracy using a linear regression model. Univariate regression of factors with self-reported time to obtain cardiac images and ability to obtain views were also performed. Models for intention included covariate adjustment for facilitating conditions (a measure of the availability of equipment and/or resources that supported cardiac scanning) and experience/training and models for accuracy included these as well as image test number (since there were 3 sets of images). Models for accuracy adjusted for all covariates when analyzing relationship to behavioral intention, but did not adjust for intention when evaluating all other covariates since intention may have mediated their association with accuracy of interpretation in our model.
Linear regression models were repeated separately for the specific secondary outcomes of accuracy of interpretation of 4 chamber view images and outflow images. Additionally, exploratory analyses examining factors associated with accurate interpretation of inadequate/adequate and normal/abnormal images were performed. Finally, a subgroup analysis of sonographers practicing in tertiary versus non-tertiary practice settings was performed for regression models.
In addition to regression modeling, a mediation analysis(36,37) was performed which considered behavioral intention to examine outflow tracts as an intermediate variable in the causal pathway for the overall accuracy of image interpretation as an additional sensitivity analysis.
The study was approved by the University of Utah Institutional Review Board.
4. Results:
Of 2000 sonographers with addresses registered through the ARDMS where contact was attempted by mail, the response rate among non-returns was 40% (n=758); 278 were ineligible based on lack of recent performance of obstetric ultrasounds. Participant (n=480) demographics are presented in Table 1. Most sonographers were female with an average of 17 (±10) years of experience. About 1/3 performed ultrasounds in a high-risk or tertiary care setting. Sonographers that performed scans in non-tertiary settings compared to those in tertiary settings did not differ significantly in age or experience, but did differ with regard to number of scans performed per week (12 versus 15 scans respectively). In tertiary settings, sonographers reported longer times on average to obtain cardiac screening images. Cardiac imaging was not a required part of the second trimester fetal anomaly scan for 12% of sonographers in their practices. Demographics for the cohort included in the primary multivariable analyses for accuracy in image interpretation (n=339) are provided in Supplemental Table 1.
Table 1.
Characteristics and summary of primary survey predictors and outcomes for entire cohort and by practice setting.
| Factor | Entire cohort | Non-tertiary | Tertiary | P value* | |||
|---|---|---|---|---|---|---|---|
| N | Mean/N (STD/%) | N | Mean/N (STD/%) | N | Mean/N (STD/%) | ||
| Female | 318 | 291 (91.5%) | 215 | 200 (93.0%) | 103 | 91 (88.3%) | 0.16 |
| Experience (years) | 474 | 17.49 ± 9.90 | 336 | 17.34 ± 10.18 | 138 | 17.83 ± 9.20 | 0.62 |
| Training (years) | 325 | 2.81 ± 4.96 | 220 | 1.99 ± 1.99 | 105 | 4.53 ± 7.99 | <0.001 |
| Age (years) | 317 | 45.66 ± 11.56 | 215 | 45.44 ± 11.76 | 102 | 46.12 ± 11.15 | 0.63 |
| Ultrasounds per week | 471 | 15.39 ± 14.48 | 333 | 12.23 ± 12.47 | 138 | 23.03 ± 16.10 | <0.001 |
| Scan at tertiary center | 480 | 138 (28.7%) | 342 | 138 | |||
| Addt’l training in cardiac | 325 | 111 (34.2%) | 220 | 63 (28.6%) | 105 | 48 (45.7%) | 0.00 |
| Domain/Factor | |||||||
| Professional Expectations | 442 | 4.49 ± 0.86 | 311 | 4.34 ± 0.92 | 131 | 4.85 ± 0.56 | <0.001 |
| Feedback | 442 | 3.82 ± 0.91 | 311 | 3.60 ± 0.88 | 131 | 4.35 ± 0.77 | <0.001 |
| Facilitating conditions | 442 | 3.81 ± 0.95 | 311 | 3.58 ± 0.93 | 131 | 4.33 ± 0.79 | <0.001 |
| Self-efficacy 4C | 446 | 3.70 ± 0.73 | 314 | 3.65 ± 0.70 | 132 | 3.82 ± 0.79 | 0.02 |
| Self-efficacy outflow | 446 | 3.10 ± 1.00 | 314 | 2.93 ± 0.98 | 132 | 3.50 ± 0.92 | <0.001 |
| Outcome expectancy 4C | 455 | 4.67 ± 0.79 | 321 | 4.60 ± 0.88 | 134 | 4.85 ± 0.50 | 0.002 |
| Outcome expectancy outflow | 455 | 4.56 ± 0.83 | 321 | 4.43 ± 0.91 | 134 | 4.86 ± 0.49 | <0.001 |
| Attitude 4C | 455 | 3.12 ± 0.62 | 321 | 3.09 ± 0.64 | 134 | 3.18 ± 0.57 | 0.18 |
| Perceived ease of use 4C | 455 | 4.28 ± 0.84 | 322 | 4.15 ± 0.89 | 134 | 4.59 ± 0.63 | <0.001 |
| Perceived ease of use outflow | 455 | 3.54 ± 1.09 | 321 | 3.30 ± 1.07 | 134 | 4.13 ± 0.91 | <0.001 |
| Knowledge | 339 | 0.70 ± 0.17 | 234 | 0.69 ± 0.17 | 105 | 0.72 ± 0.16 | 0.23 |
| Outcome | |||||||
| Intention to perform 4C imaging | 466 | 463 (99.4%) | 331 | 330 (99.7%) | 135 | 134 (99.3%) | 0.51 |
| Intention to perform outflow imaging | 466 | 348 (74.7%) | 331 | 220 (66.5%) | 135 | 128 (94.8%) | <0.001 |
| Overall accuracy (%) | 390 | 65.39 ± 14.24 | 272 | 63.83 ± 13.02 | 118 | 68.99 ± 16.21 | <0.001 |
| Time to obtain cardiac screening images (min) | 466 | 8.99 ± 6.45 | 331 | 8.26 ± 5.42 | 135 | 10.80 ± 8.20 | <0.001 |
| Self-reported ability to obtain 4C | 464 | 459 (98.9%) | 330 | 327 (99.1%) | 134 | 132 (98.5%) | 0.63 |
| Self-reported ability to obtain outflows | 464 | 350 (75.4%) | 330 | 227 (68.8%) | 134 | 123 (91.8%) | <0.001 |
| Accuracy 4C (%) | 390 | 70.32 ± 15.30 | 272 | 68.67 ± 13.89 | 118 | 74.12 ± 17.62 | 0.001 |
| Accuracy outflow (%) | 369 | 60.51 ± 16.50 | 254 | 58.47 ± 16.65 | 115 | 65.01 ± 15.30 | <0.001 |
| Accuracy adequate (%) | 390 | 56.22 ± 16.42 | 272 | 55.81 ± 15.63 | 118 | 57.16 ± 18.14 | 0.46 |
| Accuracy normal (%) | 376 | 76.04 ± 16.68 | 261 | 72.80 ± 16.94 | 115 | 83.39 ± 13.50 | <0.001 |
For comparison between Non-tertiary and tertiary
The majority of sonographers (78%) indicated that interpreting physicians never performed any scanning themselves, with another 12% stating physicians sometimes scanned but for less than half of their studies. The proportion of sonographers who had verbal interaction with the interpreting physician was higher -- 20% every time, 38% did for less than half their scans, but 20% reported never speaking with a physician.
Independent Factors
The raw averages for the main factors that could influence cardiac imaging are summarized in Table 1. In general, sonographers reported that professional expectations for cardiac screening were generally high, but raw scores for adequacy of feedback or facilitating conditions for performing cardiac screening were lower. In general scores for outflow imaging in terms of both self-efficacy and outcome expectancy/usefulness were lower than for 4 chamber imaging. The average score for the knowledge module was 70% (±17). All response averages were higher from sonographers who performed in tertiary settings with the exception of knowledge scores which did not differ significantly. The largest differences between types of setting were for feedback, facilitating conditions, and self-efficacy and outcome expectancy/usefulness for outflow tract view imaging.
Behavioral Intention
Most sonographers answered that they intended to perform cardiac screening “most” or “every time” and responses were similar when asked about intention to perform imaging 4 chamber views (Table 1). Responses were more variable for behavioral intention regarding outflow tract screening and >12% of sonographers “never” or “almost never” intended to image outflow tracts. In terms of ability, almost all sonographers believed they could obtain a 4 chamber “most of the time”, but only 75% felt the same about outflow tract views.
Image Interpretation
Image interpretation was completed by 390 of the 480 sonographers who started the survey. The overall accuracy in image interpretation was 65% ± 14% with lower accuracy for interpreting outflow tract views (61% ± 17%) and for determining the adequacy of cardiac images for screening purposes (56% ± 16%) (Table 1).
Regression Models
Primary models included only 339 respondents who had completed all assessments for accuracy as well as knowledge. When self-efficacy and outcome expectancy/usefulness measures for both 4 chamber and outflow views were included in the model, they created effects in opposite directions likely due to measured and unmeasured collinearity (Table 2). As a result, we chose to include only self-efficacy and outcome expectancy/usefulness for outflow tracts (which had wider distributions than those for 4 chambers) in the models.
Table 2.
Factors associated with cardiac imaging behaviors and abilities using a generalized linear regression model
| Parameter | Time to obtain images (minutes to complete image) | Self-reported ability – 4C | Self-reported ability – outflow | |||
|---|---|---|---|---|---|---|
| Estimate | p | Estimate | p | Estimate | p | |
| Facilitating Conditions | 0.558 | 0.310 | −0.435 | 0.658 | 0.830 | 0.002 |
| Professional Expectations | −0.076 | 0.898 | −0.267 | 0.813 | 0.462 | 0.071 |
| Feedback | 1.420 | 0.011 | 0.461 | 0.683 | 0.107 | 0.694 |
| Outcome Expectancy | 0.269 | 0.668 | 0.049 | 0.97 | −0.107 | 0.710 |
| Self-Efficacy | −2.073 | <0.001 | 2.925 | 0.118 | 1.561 | <0.001 |
| Year of Experience | −0.002 | 0.947 | 0.08 | 0.396 | 0.002 | 0.923 |
For the univariate linear regression analysis, increased self-efficacy (or confidence in abilities) was associated with decreased self-reported time to obtain cardiac images. There were no measures associated with self-reported ability to obtain 4 chamber images, but facilitating conditions and self-efficacy were associated with improved self-reported ability to obtain outflow tract views.
In examining behavioral intention to perform outflow images, each additional increase of 1 on the Likert response scale for self-efficacy in ability to obtain outflow views resulted in a 2.8 (CI 1.9, 4.2) higher odds of the intent to always perform outflow views after controlling for other predictor variables (Table 3). A similar increase in professional expectations for cardiac screening increased odds 1.9 (CI 1.1, 3.0) times. Knowledge, feedback, facilitating conditions and experience were not associated with intention. In the non-tertiary subgroup, higher professional expectations and self-efficacy were similarly associated with intention, but higher outcome expectancy/belief in the usefulness for outflow imaging was also associated with higher intention to image outflow tracts (odds ratio 1.6, CI 1.0, 2.7).
Table 3.
Multivariable Regression of Predictors of Odds of Intention to Perform Outflow Screening Images (N=339)
| Predictor | Odds ratio (95% confidence interval) of Intention to Perform Outflow Imaging | |
|---|---|---|
| Overall Cohort | Non-Tertiary Practice | |
| Professional expectations | 1.9 (1.1, 3.0) | 1.8 (1.1, 3.0) |
| Outcome expectancy outflow | 1.4 (0.9, 2.3) | 1.6 (1.0, 2.7) |
| Self-efficacy outflow | 2.8 (1.9, 4.2) | 2.6 (1.7, 3.9) |
| Feedback | 1.5 (0.9, 2.6) | 1.3 (0.7, 2.3) |
| Knowledge | 4.7 (0.7, 30.0) | 3.0 (0.4, 22.5) |
| Facilitating conditions | 1.0 (0.6, 1.6) | 0.8 (0.5, 1.4) |
| Experience | 1.0 (1.0, 1.0) | 1.0 (1.0, 1.0) |
Overall accuracy in image interpretation was associated with increasing behavioral intention to image the outflow tracts in the overall cohort (~%5 increase for every unit increase in intention, Table 4). Behavioral intention was also positively associated with accuracy in interpreting outflow tract images and if images were normal or abnormal. Self-efficacy in outflow imaging was the only other factor independently associated with accuracy in overall images and all subtypes with the exception of interpreting image adequacy though the estimates of effect were smaller than for behavioral intention (2-3.6% increase in accuracy across measures for every unit increase in self-efficacy).
Table 4.
Multivariable Regression† of Predictors of % Change in Accuracy of Cardiac Image Interpretation in Cohort (N=339)
| Predictors | Overall Accuracy% (95% CI) | Accuracy 4C% (95% CI) | Accuracy Outflow% (95% CI) | Accuracy Adequacy% (95% CI) | Accuracy Normal% (95% CI) |
|---|---|---|---|---|---|
| Professional expectations* | 1.6 (−0.6, 3.7) | 1.1 (−1.3, 3.5) | 2.0 (−0.7, 4.8) | 0.4 (−2.3, 3.0) | 2.8 (−0.1, 5.6) |
| Outcome expectancy outflow* | 0.5 (−1.6, 2.6) | 0.3 (−2.1, 2.7) | 0.7 (−2.0, 3.4) | −0.3 (−2.9, 2.3) | 1.3 (−1.5, 4.1) |
| Self-efficacy outflow* | 2.2 (0.7, 3.6) | 2.0 (0.3, 3.6) | 2.4 (0.5, 4.2) | 0.7 (−1.1, 2.5) | 3.6 (1.7, 5.5) |
| Knowledge* | 6.5 (−0.5, 13.5) | 8.7 (0.7, 16.7) | 4.3 (−4.8, 13.4) | 7.2 (−1.5, 16.0) | 5.8 (−3.6, 15.2) |
| Feedback* | −0.1 (−2.1, 1.9) | 1.4 (−0.9, 3.7) | −1.6 (−4.2, 1.0) | −0.6 (−3.2, 1.9) | 0.4 (−2.3, 3.1) |
| Facilitating conditions* | 1.0 (−1.0, 3.0) | −0.1 (−2.4, 2.2) | 2.0 (−0.5, 4.6) | 0.7 (−1.8, 3.2) | 1.2 (−1.4, 3.9) |
| Experience* | 0.04 (−0.08, 0.16) | 0.01(−0.13, 0.14) | 0.07 (−0.08, 0.23) | 0.04 (−0.11, 0.18) | 0.04 (−0.12, 0.20) |
| Intention outflow† | 4.8 (1.2, 8.3) | 3.8 (−0.2, 7.7) | 5.9 (1.4, 10.3) | 0.6(−3.7, 5.0) | 9.0 (4.4, 13.6) |
Coefficients indicate the estimated mean differences in accuracy % associated with a one unit increment increase in each predictor variable in a multivariable model jointly including professional expectations, outcome expectancy outflow, self-efficacy outflow, knowledge, feedback, facilitating conditions, and experience as predictor variables, with test number also included as an additional covariate.
Coefficients indicate the estimated mean differences in accuracy % associated with a one unit increment increase in intention outflow in an expanded multivariable model that includes intention outflow as well as all of the other predictor variables, again controlling also for test number as an additional covariate
Subgroup analysis
For sonographers who practice in tertiary settings, behavioral intention to perform outflow tract imaging was no longer a predictor of accuracy in interpretation (Table 4b), as intention varied little and was high for almost all in this group (Table 2). In the tertiary care subgroup model, self-efficacy for outflow imaging was strongly associated with all measures of accuracy (overall and by subtype of image) with no other independent predictors other than feedback for accuracy in interpreting 4 chamber images. For the subgroup of sonographers who practiced only in non-tertiary settings, behavioral intention remained strongly associated with overall accuracy as well as accuracy in interpreting outflows and if images were normal or abnormal.
Table 4b.
Multivariable Regression† of Predictors of % Change in Accuracy of Cardiac Image Interpretation in Subgroups
| Predictor | Overall Accuracy% (95% CI) | Accuracy 4C% (95% CI) | Accuracy Outflow % (95% CI) | Accuracy Adequacy% (95% CI) | Accuracy Normal % (95% CI) | |
|---|---|---|---|---|---|---|
| Professional expectations* | Tertiary | 3.5 (−2.2, 9.2) | 3.7 (−2.6, 10.0) | 3.2 (−4.1, 10.6) | −0.2 (−8.0, 7.6) | 7.1 (0.7, 3.5) |
| Non-Tertiary | 1.5 (−0.8, 3.9) | 0.9 (−1.7, 3.6) | 2.1 (−0.9, 5.2) | 0.5 (−2.3, 3.4) | 2.6 (−0.7, 5.8) | |
| Outcome expectancy outflow* | Tertiary | −1.3 (−7.4, 4.7) | −2.7 (−9.3, 4.0) | 0.0 (−7.7, 7.7) | −0.7 (−9.0, 7.6) | −2.0 (−8.8, 4.7) |
| Non-Tertiary | 1.3 (−1.0, 3.5) | 1.4 (−1.2, 3.9) | 1.1 (−1.8, 4.1) | 0.5 (−2.3, 3.2) | 2.0 (−1.1, 5.2) | |
| Self-efficacy outflow* | Tertiary | 4.6 (1.9, 7.2) | 4.8 (1.9, 7.8) | 4.4 (0.9, 7.8) | 4.0 (0.4, 7.7) | 5.1 (2.1, 8.1) |
| Non-Tertiary | 1.0 (−0.7, 2.7) | 0.8 (−1.1, 2.7) | 1.3 (−1.0, 3.5) | −0.5 (−2.6, 1.6) | 2.6 (0.2, 5.0) | |
| Knowledge* | Tertiary | 8.5 (−4.0, 21.1) | 11.3 (−2.5, 25.2) | 5.6 (−10.5, 21.7) | 12.3 (−5.0, 29.5) | 4.9 (−9.2, 19.0) |
| Non-Tertiary | 6.1 (−2.3, 14.4) | 6.7 (−2.9, 16.3) | 5.4 (−5.7, 16.4) | 4.9 (−5.4, 15.2) | 7.2 (−4.6, 19.0) | |
| Feedback* | Tertiary | 1.1 (−3.4, 5.7) | 5.9 (0.8, 10.9) | −3.6 (−9.5, 2.2) | 0.8 (−5.5, 7.1) | 1.4 (−3.7, 6.5) |
| Non-Tertiary | −1.0 (−3.3, 1.4) | −0.3 (−2.9, 2.4) | −1.7 (−4.7, 1.4) | −1.2 (−4.1, 1.6) | −0.7 (−4.0, 2.6) | |
| Facilitating conditions* | Tertiary | −1.5 (−6.0, 2.9) | −5.7 (−10.6, −0.8) | 2.7 (−3.0, 8.4) | −2.1 (−8.2, 4.1) | −1.0 (−6.0, 4.0) |
| Non-Tertiary | 1.0 (−1.3, 3.2) | 0.4 (−2.2, 2.9) | 1.6 (−1.4, 4.5) | 1.0 (−1.8, 3.7) | 0.9 (−2.2, 4.1) | |
| Experience* | Tertiary | −0.2 (−0.4, 0.0) | −0.3 (−0.5, −0.0) | −0.2 (−0.4, 0.1) | −0.2 (−0.5, 0.1) | −0.2 (−0.5, 0.0) |
| Non-Tertiary | 0.1 (0, 0.3) | 0.1 (−0.1, 0.3) | 0.1 (0, 0.3) | 0.1 (0, 0.3) | 0.1 (−0.1, 0.3) | |
| Intention Outflow† | Tertiary | 5.5 (−7.8, 18.9) | 9.8 (−4.9, 24.5) | 1.3 (−15.9, 18.5) | 2.4 (−16.0, 20.8) | 8.6 (−6.3, 23.6) |
| Non-Tertiary | 4.8 (1.1, 8.4) | 3.3 (−0.9, 7.5) | 6.3(1.4, 11.1) | 0.8 (−3.8, 5.3) | 8.8 (3.7, 13.9) |
Coefficients indicate the estimated mean differences in accuracy % associated with a one unit increment increase in each predictor variable in a multivariable model jointly including professional expectations, outcome expectancy outflow, self-efficacy outflow, knowledge, feedback, facilitating conditions, and experience as predictor variables, with test number also included as an additional covariate.
Coefficients indicate the estimated mean differences in accuracy % associated with a one unit increment increase in intention outflow in an expanded multivariable model that includes intention outflow as well as all of the other predictor variables, again controlling also for test number as an additional covariate
5. Discussion:
This study extends our previous regional work(23) and is the first national survey of U.S. obstetric sonographers identifying their perceived barriers to prenatal cardiac screening. Several barriers were associated with self-reported imaging ability, intention to perform imaging, as well as their ability to interpret cardiac images. These included sonographer self-efficacy (confidence in performing imaging) and the professional expectations of supervising staff and physicians; for sonographers in non-tertiary practice settings, beliefs about the usefulness of cardiac imaging were also important.
As in our regional survey study,(23) behavioral intention to perform cardiac imaging views was the strongest predictor of how well sonographers interpreted cardiac images. Modifying behavioral intention requires understanding the motivation behind it.(6,38,39) Experience, as measured by years of scanning, was not associated with intention or accuracy of image interpretation and did not correlate with sonographer ratings of self-efficacy or other important predictors. This finding contrasts previous studies,(12) and may be related to our measure of specific behavioral factors that may be more important and also, encouragingly, more amenable to modification.
Self-efficacy or confidence in one’s ability to scan fetal hearts both directly and indirectly influenced accuracy in interpreting images in our study. Targeted sonographer training, one way to increase self-efficacy, has been undertaken with some local and regional success.(11,13,40,41) In the U.S., training, and education are highly variable.(4,42) National advocacy for more rigorous educational standards and testing of cardiac knowledge and scanning skills may improve self-efficacy. At a local level, maternal-fetal medicine (MFM) specialists and fetal cardiologists can ensure adequate educational opportunities with hands-on training for their referral regions.(43,44)
Professional expectations were also strongly associated with behavioral intention. Strengthening guidelines in 2013 to require inclusion of outflow imaging in second trimester obstetric ultrasounds(45) was an important step in increasing expectations for cardiac imaging. While we launched our survey 6 months after this change, the majority of surveys were completed more than a year after. Yet, there may not have been optimal dissemination. Nonetheless, it is remarkable that a quarter of sonographers did not always perform outflow tract imaging. Canadian guidelines incorporated outflows much earlier and subsequent improvements in detection of cardiac defects suggest that guidelines and professional expectations impact screening.(46) While we did not specifically assess sonographer factors related to other screening views that were not specifically required by national guidelines, there has been increasing focus on the three vessel view as an additional more facile screening image for the outflow tracts that may increase detection of abnormal outflow anomalies(16). This has led the International Society of Ultrasound in Obstetrics and Gynecology guidelines to recommend (though not mandate) inclusion of this view as part of a comprehensive evaluation of the outflows.(47) Guidelines alone, however, are usually insufficient to change practice and formalizing expectations with audit systems, protocols, or quality improvement initiatives may be necessary.(48–51)
Efforts are also needed to improve knowledge around screening imaging methods and to address gaps in understanding the impact of prenatal cardiac screening. Sonographers rated their beliefs in the usefulness of outflow tract views significantly lower than 4 chamber views despite the fact that this view is necessary to capture a significant portion of critical congenital heart defects.(52) This belief or lack thereof in the usefulness of this imaging particularly influenced sonographer intentions to perform outflow tract imaging in low-risk settings suggesting that sonographers should not only be taught “how” but also “why,” these views are necessary.
Our results highlight that efforts to improve prenatal cardiac screening must be tailored to practice setting. While sonographers in community settings did not differ significantly from those in tertiary setting with regard to age, experience and knowledge, they had lower professional expectations of their imaging, confidence, and perceived usefulness of cardiac screening images. These differences, while not surprising, are concerning since the majority of prenatal screening occurs in low risk settings.(3,39,53) For sonographers in tertiary centers, efforts need to focus on improving self-efficacy and feedback on imaging.(54) For sonographers in community settings, multifaceted interventions are needed to target the multiple factors that influence their intention to perform fetal heart imaging. While reaching sonographers in low-risk settings is challenging, several recent studies have successfully used decentralized approaches to disseminate education, auditing systems, and screening protocols.(44,48,55)
Strengths and Limitations
Our study may be limited by selection bias; respondents may be more interested in cardiac imaging than non-respondents. Since we did not mandate responses to all survey items and respondents were anonymous to encourage participation, we were unable to weight our sample. Causal interpretations of our regression models were limited by the cross-sectional observational study design. Though image interpretation is a surrogate measure of true ability to screen for heart defects, performing a similarly scaled study measuring scanning ability and recognition of abnormalities during scanning would be formidable. While sonographers do not provide official interpretation, interpreting adequacy and relationship to normal of screening images is an essential skill to provide the reading provider with adequate information, especially when images are often presented as still frames.(21) Visual motor and spatial skills including the recognition of expected sonographic anatomy of normal structures is a necessary psychomotor skill for performing high quality imaging.(56) Finally, our findings were strengthened by basing our design and analysis on previously validated behavioral theory and surveying sonographers across the country.
Conclusion
This national survey of sonographers identified several modifiable and some heretofore unrecognized intervention targets to improve prenatal screening for heart defects. Interventions must address sonographers’ needs and priorities while also addressing system/practice level factors such as minimum standards for education/training and infrastructure to meet the recommended screening metrics to effectively improve prenatal screening for congenital heart disease.
Supplementary Material
8.1. Acknowledgments
This investigation was supported by the University of Utah Study Design and Biostatistics Center, with funding in part from the National Center for Research Resources and the National Center for Advancing Translational Sciences, National Institutes of Health, through Grant 5UL1TR001067-02 (formerly 8UL1TR000105 and UL1RR025764).
8.4 Funding Sources:
The research presented herein was supported by a grant from the Saving Tiny Hearts Society.
6. Appendix
A. Paper version of the web survey.
B. Mediation Analysis Methods
For each independent factor, we considered the effects on outflow intention that resulted when the predictor variable was changed from a reference value (the 25th %ile) to a modified value (the 75th %tile). Estimates of the 1) controlled direct effect (CDE), 2) the natural direct effect (NDE), 3) the natural indirect effect (NIE) and 4) the total effect (MTE) were presented for each predictor variable after adjusting for the other predictor variables. The natural direct and indirect effects sum to the total effect. Intuitively, under strong assumptions of no unmeasured confounding, the natural indirect effect represents the portion of the total effect of the predictor variable which is mediated by outflow intention and the natural direct effect represents the portion of the effect that modified accuracy by other mechanisms.(57) Of note, the controlled and natural direct effects are equal to each other when there is no interaction between a predictor variable and the outflow intention, but differ if there is such an interaction. Finally, as knowledge score was the most frequently missing response and limited the number of participants in the model, sensitivity analyses were performed for the mediation with missing knowledge scores imputed and with knowledge dropped from the analysis.
C. Mediation Analysis Results
Trends consistent with indirect effects mediated through intention were observed for professional expectations and self-efficacy for outflow tracts (Supplemental Table 2). Self-efficacy for outflow tracts also had a direct effect on accuracy, as did increased knowledge scores. Knowledge and feedback had significant interactions with behavioral intention so that their relationship with accuracy differed depending on the level of behavioral intention (resulting in different controlled and natural direct effects). However, with the exception of knowledge, none of the associations were significant.
Footnotes
Statement of Ethics:
Subjects in this study have given their written consent. The study protocol has been approved by the University of Utah Institutional Review Board.
Disclosures of Interests:
The authors have no conflicts of interest to declare.
9. References:
- 1.Hoffman JI. Incidence of congenital heart disease: II. Prenatal incidence. Pediatr Cardiol [Internet]. 1995/July/01. 1995;16(4):155–65. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=7567659 [DOI] [PubMed] [Google Scholar]
- 2.Kleinert S Routine prenatal screening for congenital heart disease. Lancet [Internet]. 1996/September/28. 1996;348(9031):836. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=8826802 [DOI] [PubMed] [Google Scholar]
- 3.Stumpflen I, Stumpflen A, Wimmer M, Bernaschek G. Effect of detailed fetal echocardiography as part of routine prenatal ultrasonographic screening on detection of congenital heart disease. Lancet [Internet]. 1996/September/28. 1996;348(9031):854–7. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=8826811 [DOI] [PubMed] [Google Scholar]
- 4.AIUM Practice Guideline for the Performance of Obstetric Ultrasound Examinations. J Ultrasound Med [Internet]. 2010;29(1):157–66. Available from: http://www.jultrasoundmed.org/content/29/1/157.short [DOI] [PubMed] [Google Scholar]
- 5.Quartermain MD, Pasquali SK, Hill KD, Goldberg DJ, Huhta JC, Jacobs JP, et al. Variation in Prenatal Diagnosis of Congenital Heart Disease in Infants. Pediatrics. 2015/July/29. 2015;136(2):e378–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Khoo NS, Van Essen P, Richardson M, Robertson T. Effectiveness of prenatal diagnosis of congenital heart defects in South Australia: a population analysis 1999-2003. Aust N Z J Obs Gynaecol [Internet]. 2009/January/10. 2008;48(6):559–63. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=19133043 [DOI] [PubMed] [Google Scholar]
- 7.Stoll C, Garne E, Clementi M. Evaluation of prenatal diagnosis of associated congenital heart diseases by fetal ultrasonographic examination in Europe. Prenat Diagn [Internet]. 2001/April/05. 2001;21(4):243–52. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=11288111 [DOI] [PubMed] [Google Scholar]
- 8.Marek J, Tomek V, Skovranek J, Povysilova V, Samanek M. Prenatal ultrasound screening of congenital heart disease in an unselected national population: a 21-year experience. Heart [Internet]. 2010/December/18. 97(2):124–30. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=21163892 [DOI] [PubMed] [Google Scholar]
- 9.McBrien A, Sands A, Craig B, Dornan J, Casey F. Major congenital heart disease: antenatal detection, patient characteristics and outcomes. J Matern Fetal Neonatal Med [Internet]. 2008/December/17. 2009;22(2):101–5. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=19085626 [DOI] [PubMed] [Google Scholar]
- 10.Campana H, Ermini M, Aiello HA, Krupitzki H, Castilla EE, Lopez-Camelo JS. Prenatal sonographic detection of birth defects in 18 hospitals from South America. J Ultrasound Med [Internet]. 2010/January/28. 29(2):203–12. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=20103790 [DOI] [PubMed] [Google Scholar]
- 11.Carvalho JS, Mavrides E, Shinebourne EA, Campbell S, Thilaganathan B. Improving the effectiveness of routine prenatal screening for major congenital heart defects. Heart [Internet]. 2002/September/17. 2002;88(4):387–91. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=12231598 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Tegnander E, Eik-Nes SH. The examiner’s ultrasound experience has a significant impact on the detection rate of congenital heart defects at the second-trimestr fetal examination. Ultrasound Obs Gynecol [Internet]. 2006/June/01. 2006;28(1):8–14. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=16736449 [DOI] [PubMed] [Google Scholar]
- 13.McBrien A, Sands A, Craig B, Dornan J, Casey F. Impact of a regional training program in fetal echocardiography for sonographers on the antenatal detection of major congenital heart disease. Ultrasound Obstet Gynecol [Internet]. 2010. September 1 [cited 2017 Nov 14];36(3):279–84. Available from: 10.1002/uog.7616 [DOI] [PubMed] [Google Scholar]
- 14.Wong SF, Chan FY, Cincotta RB, Lee-Tannock A, Ward C. Factors influencing the prenatal detection of structural congenital heart diseases. Ultrasound Obs Gynecol [Internet]. 2003/January/16. 2003;21(1):19–25. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=12528156 [DOI] [PubMed] [Google Scholar]
- 15.Tongsong T, Tongprasert F, Srisupundit K, Luewan S. The complete three-vessel view in prenatal detection of congenital heart defects. Prenat Diagn [Internet]. 2009/November/17. 30(1):23–9. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=19911415 [DOI] [PubMed] [Google Scholar]
- 16.Yagel S, Arbel R, Anteby EY, Raveh D, Achiron R. The three vessels and trachea view (3VT) in fetal cardiac scanning. Ultrasound Obs Gynecol [Internet]. 2002/October/18. 2002;20(4):340–5. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=12383314 [DOI] [PubMed] [Google Scholar]
- 17.Sananes N, Guigue V, Kohler M, Bouffet N, Cancellier M, Hornecker F, et al. Nuchal translucency and cystic hygroma colli in screening for fetal major congenital heart defects in a series of 12,910 euploid pregnancies. Ultrasound Obs Gynecol [Internet]. 2010/January/14. 35(3):273–9. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=20069678 [DOI] [PubMed] [Google Scholar]
- 18.Bahado-Singh RO, Wapner R, Thom E, Zachary J, Platt L, Mahoney MJ, et al. Elevated first-trimester nuchal translucency increases the risk of congenital heart defects. Am J Obs Gynecol [Internet]. 2005/May/20. 2005;192(5):1357–61. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=15902108 [DOI] [PubMed] [Google Scholar]
- 19.Yagel S, Cohen SM, Rosenak D, Messing B, Lipschuetz M, Shen O, et al. Added value of three-/four-dimensional ultrasound in offline analysis and diagnosis of congenital heart disease. Ultrasound Obs Gynecol [Internet]. 2010/October/30. 37(4):432–7. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=21031348 [DOI] [PubMed] [Google Scholar]
- 20.Bennasar M, Martinez JM, Gomez O, Bartrons J, Olivella A, Puerto B, et al. Accuracy of four-dimensional spatiotemporal image correlation echocardiography in the prenatal diagnosis of congenital heart defects. Ultrasound Obs Gynecol [Internet]. 2010/June/16. 36(4):458–64. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=20549767 [DOI] [PubMed] [Google Scholar]
- 21.Scott TE, Jones J, Rosenberg H, Thomson A, Ghandehari H, Rosta N, et al. Increasing the Detection Rate of Congenital Heart Disease During Routine Obstetric Screening Using Cine Loop Sweeps. J Ultrasound Med [Internet]. 2013. June 1 [cited 2017 Nov 14];32(6):973–9. Available from: 10.7863/ultra.32.6.973 [DOI] [PubMed] [Google Scholar]
- 22.Chaoui R The four-chamber view: four reasons why it seems to fail in screening for cardiac abnormalities and suggestions to improve detection rate. Ultrasound Obs Gynecol [Internet]. 2003/July/15. 2003;22(1):3–10. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=12858294 [DOI] [PubMed] [Google Scholar]
- 23.Pinto N, Sheng X, Keenan HT, Byrne JLB, Stanton B, Kinney AY. Sonographer-Identified Barriers and Facilitators to Prenatal Screening for Congenital Heart Disease: A Mixed Methods Study. J Diagnostic Med Sonogr. 2017;33(1). [Google Scholar]
- 24.United States Department of Agriculture. Rural-Urban Commuting Area Codes Overview [Internet]. Vol. 2012. Available from: http://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes.aspx
- 25.Morrill R (WWAMI RHRC, Cromartie J (Depatrment of AERS, Hart G (University of ND. No Title [Internet]. RUCA - Rural Health Research Center. 2005. Available from: http://depts.washington.edu/uwruca/ruca-about.php [Google Scholar]
- 26.VanGeest JB, Johnson TP, Welch VL. Methodologies for improving response rates in surveys of physicians: a systematic review. Eval Heal Prof [Internet]. 2007/November/08. 2007;30(4):303–21. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=17986667 [DOI] [PubMed] [Google Scholar]
- 27.Dillman Smyth JD, and Christian LMDA. The Tailored Design Method. In: Internet, Mail and Mixed-Mode Surveys: The Tailored Design Method. 3rd ed. Hoboken: John Wiley and Sons; 2009. p. 15–39. [Google Scholar]
- 28.Ajzen L From intentions to actions: A theory of planned behavior. In: Kuhl Beckmann, Jurgen J, editor. Action control: From cognition to behavior. New york: Springer-Verlag; 1985. p. 11–39. [Google Scholar]
- 29.Maue SK, Segal R, Kimberlin CL, Lipowski EE. Predicting physician guideline compliance: an assessment of motivators and perceived barriers. Am J Manag Care [Internet]. 2004/June/24. 2004;10(6):383–91. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=15209482 [PubMed] [Google Scholar]
- 30.Bandura A Social Cognitive Theory. In: Vasta R, editor. Annals of Child Development Vol 6 Six theories of child development. Greenwich, CT: JAI Press; 1989. p. 1–60. [Google Scholar]
- 31.Cabana MD, Ebel BE, Cooper-Patrick L, Powe NR, Rubin HR, Rand CS. Barriers pediatricians face when using asthma practice guidelines. Arch Pediatr Adolesc Med [Internet]. 2000/July/13. 2000;154(7):685–93. Available from: http://www.ncbi.nlm.nih.gov/pubmed/10891020 [DOI] [PubMed] [Google Scholar]
- 32.Cabana MD, Rand C, Slish K, Nan B, Davis MM, Clark N. Pediatrician self-efficacy for counseling parents of asthmatic children to quit smoking. Pediatrics [Internet]. 2004/January/02. 2004;113(1 Pt 1):78–81. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=14702452 [DOI] [PubMed] [Google Scholar]
- 33.Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: Toward a unified view. MIS Q. 2003;27(3):425–78. [Google Scholar]
- 34.Duyck P, Pynoo B, Devolder P, Voet T, Adang L, Vercruysse J. User acceptance of a picture archiving and communication system. Applying the unified theory of acceptance and use of technology in a radiological setting. Methods Inf Med [Internet]. 2008/March/14. 2008;47(2):149–56. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=18338086 [PubMed] [Google Scholar]
- 35.Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989;13(3):319–40. [Google Scholar]
- 36.VanderWeele TJ. Explanation in causal inference: methods for mediation and interaction. Oxford University Press; 2015. [Google Scholar]
- 37.VanderWeele TJ, Vansteelandt S. Odds Ratios for Mediation Analysis for a Dichotomous Outcome. Am J Epidemiol [Internet]. 2010. December 15 [cited 2018 Mar 14];172(12):1339–48. Available from: 10.1093/aje/kwq332 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Friedberg MK, Silverman NH, Moon-Grady AJ, Tong E, Nourse J, Sorenson B, et al. Prenatal detection of congenital heart disease. J Pediatr [Internet]. 2009/April/28. 2009;155(1):26–31, 31 e1. Available from: http://www.ncbi.nlm.nih.gov/pubmed/19394031 [DOI] [PubMed] [Google Scholar]
- 39.Pinto NM, Keenan HT, Minich LL, Puchalski MD, Heywood M, Botto LD. Barriers to prenatal detection of congenital heart disease: A population-based study. Ultrasound Obstet Gynecol. 2012;40(4). [DOI] [PubMed] [Google Scholar]
- 40.Hildebrand E, Dahlgren MA, Sved C, Gottvall T, Blomberg M, Janerot-Sjoberg B. Impact of a standardized training program on midwives’ ability to assess fetal heart anatomy by ultrasound. [cited 2018 Feb 2]; Available from: https://link.springer.com/content/pdf/10.1186%2F1471-2342-14-20.pdf [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Hunter S, Heads A, Wyllie J, Robson S. Prenatal diagnosis of congenital heart disease in the northern region of England: benefits of a training programme for obstetric ultrasonographers. Heart [Internet]. 2000/August/24. 2000;84(3):294–8. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=10956294 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Radiology AC of, editor. American College of Radiology Practice Guideline for the Performance of Obstetrical Ultrasound [Internet]. Reston, VA; 2007. Available from: http://www.acr.org/SecondaryMainMenuCategories/quality_safety/guidelines/us/us_obstetrical.aspx [Google Scholar]
- 43.Levi S Ultrasound in prenatal diagnosis: polemics around routine ultrasound screening for second trimester fetal malformations. Prenat Diagn [Internet]. 2002. April 1 [cited 2018 Feb 8];22(4):285–95. Available from: 10.1002/pd.306 [DOI] [PubMed] [Google Scholar]
- 44.Acherman RJ, Evans WN, Luna CF, Rollins R, Kip KT, Collazos JC, et al. Prenatal detection of congenital heart disease in southern Nevada: the need for universal fetal cardiac evaluation. J Ultrasound Med [Internet]. 2007/November/22. 2007;26(12):1711–5. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=18029923 [DOI] [PubMed] [Google Scholar]
- 45.AIUM Practice Guideline for the Performance of Obstetric Ultrasound Examinations. J Ultrasound Med [Internet]. 2013;32(6):1083–101. Available from: http://www.jultrasoundmed.org/content/32/6/1083.short [DOI] [PubMed] [Google Scholar]
- 46.Ravi P, Mills L, Fruitman D, Savard W, Colen T, Khoo N, et al. Population Trends in Prenatal Detection of Transposition of Great Arteries: Impact of Obstetrical Screening Ultrasound Guidelines. Ultrasound Obstet Gynecol [Internet]. 2017. April [cited 2017 Dec 28]; Available from: 10.1002/uog.17496 [DOI] [PubMed] [Google Scholar]
- 47.Carvalho J, Allan L, Chaoui R, Copel J, DeVore G, Hecher K, et al. ISUOG Practice Guidelines (updated): sonographic screening examination of the fetal heart. Ultrasound Obstet Gynecol [Internet]. 2013. March 1 [cited 2019 May 13];41(3):348–59. Available from: 10.1002/uog.12403 [DOI] [PubMed] [Google Scholar]
- 48.Sairam S, Awadh AMA, Cook K, Papageorghiou AT, Carvalho JS. Impact of audit of routine second-trimester cardiac images using a novel image-scoring method. Ultrasound Obstet Gynecol [Internet]. 2009. May 1 [cited 2018 Feb 2];33(5):545–51. Available from: 10.1002/uog.6323 [DOI] [PubMed] [Google Scholar]
- 49.Ursem NTC, Peters IA, Kraan-van der Est MN, Reijerink-Verheij JCIY, Knapen MFCM, Cohen-Overbeek TE. An Audit of Second-Trimester Fetal Anomaly Scans Based on a Novel Image-Scoring Method in the Southwest Region of the Netherlands. J Ultrasound Med [Internet]. 2017. June 1 [cited 2018 Feb 2];36(6):1171–9. Available from: 10.7863/ultra.16.06055 [DOI] [PubMed] [Google Scholar]
- 50.Jaudi S, Tezenas Du Montcel S, Fries N, Nizard J, Halley Desfontaines V, Dommergues M. Online evaluation of fetal second-trimester four-chamber view images: a comparison of six evaluation methods. Ultrasound Obstet Gynecol [Internet]. 2011. August 1 [cited 2018 Feb 2];38(2):185–90. Available from: 10.1002/uog.8941 [DOI] [PubMed] [Google Scholar]
- 51.Jaudi S, Granger B, Herpin CN, Fries N, Montcel ST Du, Dommergues M. Online audit and feedback improve fetal second-trimester four-chamber view images: a randomised controlled trial. Prenat Diagn [Internet]. 2013. July 1 [cited 2018 Feb 2];33(10):1–6. Available from: 10.1002/pd.4173 [DOI] [PubMed] [Google Scholar]
- 52.Sklansky MS, Berman DP, Pruetz JD, Chang RK. Prenatal screening for major congenital heart disease: superiority of outflow tracts over the 4-chamber view. J Ultrasound Med [Internet]. 2009;28(7):889–99. Available from: http://www.ncbi.nlm.nih.gov/pubmed/19546331 [DOI] [PubMed] [Google Scholar]
- 53.Bromley B, Estroff JA, Sanders SP, Parad R, Roberts D, Frigoletto FD Jr., et al. Fetal echocardiography: accuracy and limitations in a population at high and low risk for heart defects. Am J Obs Gynecol [Internet]. 1992/May/11. 1992;166(5):1473–81. Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=1595802 [DOI] [PubMed] [Google Scholar]
- 54.Cuneo BF, Curran LF, Davis N, Elrad H. Trends in Prenatal Diagnosis of Critical Cardiac Defects in an Integrated Obstetric and Pediatric Cardiac Imaging Center. J Perinatol [Internet]. 2004. November 29 [cited 2018 Feb 2];24(11):674–8. Available from: http://www.nature.com/articles/7211168 [DOI] [PubMed] [Google Scholar]
- 55.Letourneau KM, Horne D, Soni RN, McDonald KR, Karlicki FC, Fransoo RR. Advancing Prenatal Detection of Congenital Heart Disease: A Novel Screening Protocol Improves Early Diagnosis of Complex Congenital Heart Disease. J Ultrasound Med [Internet]. 2018. May 1 [cited 2019 Jan 30];37(5):1073–9. Available from: 10.1002/jum.14453 [DOI] [PubMed] [Google Scholar]
- 56.Nicholls D, Sweet L, Hyett J. Psychomotor Skills in Medical Ultrasound Imaging. J Ultrasound Med [Internet]. 2014. August 1 [cited 2018 Oct 4];33(8):1349–52. Available from: 10.7863/ultra.33.8.1349 [DOI] [PubMed] [Google Scholar]
- 57.Valeri L, VanderWeele TJ. Mediation analysis allowing for exposure–mediator interactions and causal interpretation: Theoretical assumptions and implementation with SAS and SPSS macros. Psychol Methods [Internet]. 2013. [cited 2018 Mar 14];18(2):137–50. Available from: 10.1037/a0031034 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
