Abstract
Objective
Handheld ultrasound devices (HUD) has diagnostic value in the assessment of patients with suspected left ventricular (LV) dysfunction. This meta-analysis evaluates the diagnostic ability of HUD compared with transthoracic echocardiography (TTE) and assesses the importance of operator experience.
Methods
MEDLINE and EMBASE databases were searched in October 2020. Diagnostic studies using HUD and TTE imaging to determine LV dysfunction were included. Pooled sensitivities and specificities, and summary receiver operating characteristic curves were used to determine the diagnostic ability of HUD and evaluate the impact of operator experience on test accuracy.
Results
Thirty-three studies with 6062 participants were included in the meta-analysis. Experienced operators could predict reduced LV ejection fraction (LVEF), wall motion abnormality (WMA), LV dilatation and LV hypertrophy with pooled sensitivities of 88%, 85%, 89% and 85%, respectively, and pooled specificities of 96%, 95%, 98% and 91%, respectively. Non-experienced operators are able to detect cardiac abnormalities with reasonable sensitivity and specificity. There was a significant difference in the diagnostic accuracy between experienced and inexperienced users in LV dilatation, LVEF (moderate/severe) and WMA. The diagnostic OR for LVEF (moderate/severe), LV dilatation and WMA in an experienced hand was 276 (95% CI 58 to 1320), 225 (95% CI 87 to 578) and 90 (95% CI 31 to 265), respectively, compared with 41 (95% CI 18 to 94), 45 (95% CI 16 to 123) and 28 (95% CI 20 to 41), respectively, for inexperienced users.
Conclusion
This meta-analysis is the first to establish HUD as a powerful modality for predicting LV size and function. Experienced operators are able to accurately diagnose cardiac disease using HUD. A cautious, supervised approach should be implemented when imaging is performed by inexperienced users. This study provides a strong rationale for considering HUD as an auxiliary tool to physical examination in secondary care, to aid clinical decision making when considering referral for TTE.
Trial registration number
CRD42020182429.
Keywords: echocardiography, diagnostic imaging, cardiac imaging techniques, meta-analysis
Introduction
Echocardiography is the first-line imaging modality for assessing cardiac size and function. Indications for transthoracic echocardiography (TTE) as recommended by the British Society of Echocardiography and other international societies include but not limited to: murmur in the presence of cardiac or respiratory symptoms, valvular stenosis or regurgitation, ischaemic heart disease, any suspicion of heart failure (HF) and arrhythmias.1–3 TTE allows determination of left ventricular (LV) dysfunction by assessing LV cavity size, wall thickness, valvular appearances and function as well as for the presence of abnormal blood flow within the heart.4
The miniaturisation of ultrasound technology has led to the introduction of handheld cardiac ultrasound devices (HUD).5 The portability and accessibility of HUD allow for the augmentation of the bedside physical examination. While physical examination remains the primary method for screening cardiovascular disease, the quality and subsequent referral to echocardiography depend on the examiner’s experience and skill, or lack thereof.6 HUD therefore can bridge the gap between the physical examination and the more costly and time-consuming departmental TTE.
Several recent studies have assessed the performance of HUD in diagnosing cardiac disease. The aim of this systematic review and meta-analysis is to assess the diagnostic accuracy of HUD to detect LV abnormalities when compared with TTE in both experienced and non-experienced users.
Methods
The Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines and the Cochrane Handbook of Diagnostic Test Accuracy were followed in the study selection, review process and evidence synthesis.7 8
Patient and public involvement
Patients or the public were not involved in the design, or conduct, or reporting, or dissemination plans of our research.
Eligibility criteria
Any study comparing the diagnostic performance of HUD and TTE was eligible. The index test was any type or size of a HUD performed by operators of any level of experience. The reference standard was TTE performed by experienced imagers. Studies were included if subjects were aged >18 years, sensitivity, specificity, true positive and negative and false positive and negative findings were reported or if diagnostic data could be extrapolated from the results. Studies with a sample size of <20 participants were excluded.
Search strategy and study selection
MEDLINE (ProQuest, 1946 to 13 October 2020), EMBASE (Ovid, 1974–2020 week 42) were searched on 13 October 2020. No search filters were applied. The full search strategy is available in the online supplemental document. The references of the included studies were also screened for relevant studies.
heartjnl-2021-319561supp001.pdf (785.5KB, pdf)
Two authors (SJ and PG) screened the titles and abstracts and reviewed full texts for inclusion criteria. Any disagreements were discussed with a third author (SA). Data extraction and risk of bias analysis was performed by two authors (SJ and PG) and disagreements discussed with a third author (SA). Methods for the quality assessment of individual studies are detailed in online supplemental figure 1.
Statistical analysis
A bivariate random‐effects model was used to obtain the summary point for the sensitivity and specificity and estimate the corresponding 95% CI and prediction regions for all meta‐analyses including four or more studies. The metandi command in Stata V.16 (StataCorp, College Station, Texas, USA) was used to perform the analyses and create summary receiver operating characteristics (SROC). The mada package in R was used to calculate the diagnostic ORs (DORs) for each study and the summary DOR for the pooled results with their respective 95% CIs (R Core Team, R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing, 2020). The Wilson method was used to calculate the CIs for sensitivities, specificities and false positive rates. The Yates correction was used for testing the equality of sensitivities and specificities. The input for the mada command was the number of true positives (TP), false negatives (FN), true negatives (TN) and false postives (FP) for each study.
The effect of operator experience on the effect size of the diagnostic accuracy was assessed in a subgroup analysis and graphically represented in SROC curves comparing the diagnostic accuracy of experienced and inexperienced operators. A meta-regression was also performed to assess the effect of operator experience.
Results
Search results
Our comprehensive search identified 33 studies which were incorporated into the meta-analysis. The results of the literature search are outlined in the study flow diagram (figure 1).
Description of included studies
All studies had a prospective design, with consecutive or random patient selection reported in 21 studies. The studies were published between 2002 and 2019. The majority of studies (22 studies) had a large sample size ≥100 participants, with the largest study by Galasko et al 8 recruiting 562 patients.9 Individual study data incorporated into the meta-analysis can be found in online supplemental table 1 and a summary graph of the overall risk of bias is shown in online supplemental figure 1.
Study characteristics
A total of 6062 patients conducted in 13 different countries were included in the meta-analysis. The mean age of patients was 65±5 years with a slight male predominance (54%). Study characteristics are presented in table 1. Study-level HUD data including sensitivity and specificity to predict reduced LV ejection fraction (LVEF), wall motion abnormality (WMA), LV dilatation and hypertrophy (LVH) are reported in the online supplemental materials.
Table 1.
Study | Country | Design | Study period | Size | Male (%) | Age, years | Level of experience | HUD |
Aldaas et al 21 | USA | Consecutive | NR | 70 | 50 | 61±18 | Both | Vscan |
Alexander et al 22 | USA | NR | April–November 2000 | 537 | 53 | 59 | Inexperienced | Optigo |
Andersen et al 23 | Norway | Random | March–September 2010 | 108 | 64 | 69.1±14 | Experienced | Vscan |
Biais et al 24 | France | Consecutive | February–May 2011 | 151 | 35 | 55±20 | Experienced | Vscan |
Bruce et al 9 | USA | NR | NR | 374 | 62 | 66 | Both | SonoHeart |
Coletta et al 25 | Italy | Consecutive | April–June 2003 | 112 | 57 | 61±11 | Experienced | Optigo |
Cullen et al 26 | USA | Consecutive | 2012–2013 | 190 | 49 | 62±17 | Experienced | Vscan |
DeCara et al 27 | USA | NR | NR | 300 | NR | NR | Experienced | Optigo |
Fedson et al 28 | USA | Consecutive | NR | 103 | NR | NR | Inexperienced | Optigo |
Galasko8 | UK | Consecutive | 2000–2001 | 562 | 56 | 62±11 | Experienced | Optigo |
Ghani et al 29 | USA | Consecutive | NR | 80 | 51 | 75±13 | Inexperienced | Optigo |
Giusca et al 30 | Romania | Consecutive | NR | 56 | 54 | 60±12 | Inexperienced | Acuson P10 |
Gulič et al 31 | Slovenia | Consecutive | NR | 200 | 43 | 70 | Both | Vscan |
Khan32 | USA | Consecutive | 2012–2013 | 240 | 53 | 71±17 | Experienced | Vscan |
Kirkpatrick33 | USA | NR | NR | 63 | 46 | 65±16 | Inexperienced | Optigo |
Kobal et al 34 | USA | Consecutive | NR | 61 | 62 | 70±19 | Inexperienced | Optigo |
Liebo35 | USA | Consecutive | February–March 2010 | 97 | 45 | 68±17 | Both | Vscan |
López-Palmero et al 36 | Spain | NR | July–December 2013 | 223 | 42 | 76 | Inexperienced | Vscan |
Lucas et al 37 | USA | Consecutive | March–May 2007 | 322 | 53 | 56±13 | Inexperienced | Micromaxx |
Lucas et al 38 | USA | Consecutive | 2008–2009 | 210 | 55 | 55 | Inexperienced | NR |
Martin et al 39 | USA | Consecutive | 2004–2005 | 354 | 47 | 63±19 | Inexperienced | Sonosite Elite |
Mehta et al 40 | USA | NR | NR | 250 | 66 | 61±15 | Experienced | Vscan |
Mjølstad et al 41 | Norway | Consecutive | April–June 2011 | 199 | 54 | 66±18 | Inexperienced | Vscan |
Nilsson et al 42 | Sweden | NR | 2016–2017 | 100 | 55 | 70±12 | Inexperienced | Vscan |
Olesen43 | Denmark | NR | NR | 260 | 49 | 80 | Experienced | Vscan |
Perez-Avraham et al 44 | Israel | Consecutive | July–December 2004 | 85 | 37 | 59±14 | Inexperienced | Optigo |
Razi et al 45 | USA | Consecutive | NR | 50 | 58 | 57±17 | Inexperienced | Vscan |
Ruddox et al 46 | Norway | NR | 2011–2012 | 303 | 61 | 73 | Inexperienced | Vscan |
Stokke et al 13 | Norway | Random | February–May 2012 | 72 | 72 | 65±16 | Both | Vscan |
Vignon et al 47 | France | Consecutive | NR | 55 | 69 | 61±16 | Experienced | SonoHeart |
Vourvouri et al 48 | The Netherlands | Consecutive | NR | 88 | 64 | 59±12 | Experienced | SonoHeart or Optigo |
Wejner-Mik et al 49 | Poland | Consecutive | NR | 87 | 67 | 61±16 | Experienced | Lumify |
Xie et al 50 | USA | Consecutive | NR | 100 | 55 | 59±17 | Experienced | SonoHeart |
HUD, handheld ultrasound devices; NR, not reported.
Assessment of methodological quality
The majority of studies (19/25) reported a prospective and consecutive or random design. Only one study reported that HUD assessors were unblinded to TTE results while three studies were judged to incorporate a high risk of bias with TTE assessors unblinded to HUD results. There was some concern for bias when time between HUD and TTE was >48 hours. One study was judged to have a high risk of bias as time between HUD and TTE was >7 days.10 The detailed results of the quality assessment are outlined in online supplemental figure 2.
Meta-analysis of HUD indices
Each characteristic was separated into subgroups based on the investigator’s level of experience. Inexperienced operators were those that learnt HUD as part of the study with limited or no prior echocardiography experience. This subgroup included nurses, medical students, residents, general practitioners and inexperienced cardiology trainees. Experienced operators were those who had undergone level II/III echocardiography training or who were stated to be experienced, expert, or trained in echocardiography.
Experienced operators could determine reduced LVEF, LV dilatation, WMA and LVH with pooled sensitivities of 88%, 89%, 85% and 85%, respectively (figures 2–4). In inexperienced hands, pooled sensitivities measured were 83%, 68%, 78% and 80%, respectively. Pooled specificities of HUD by experienced users compared with inexperienced users for reduced LVEF, LV dilatation, WMA and LVH measured 96% vs 89%, 98% vs 95%, 95% vs 88% and 91% vs 87%. Online supplemental figure 3 displays a box plot assessing the pooled accuracy of HUD to diagnose moderate/severe LVEF (<45%). SROC curves show an improvement in diagnostic accuracy of reduced LVEF, WMA and LV dilatation when performed by experienced users (figure 5). A summary of the meta-analysis data is provided in table 2.
Table 2.
HUD compared with TTE | |||||||||
Sensitivity % | Total | Experienced | Inexperienced | ||||||
Studies (n) | Prevalence | Sensitivity (95% CI) | Studies (n) | Prevalence | Sensitivity (95% CI) | Studies (n) | Prevalence | Sensitivity (95% CI) | |
LVEF (any abnormality) | 15 (2936) | 0.23 | 86 (80 to 90) | 9 (1406) | 0.18 | 88 (81 to 92) | 9 (1530) | 0.28 | 83 (71 to 90) |
LVEF (moderate/severe) | 10 (1611) | 0.27 | 91 (86 to 94) | 5 (722) | 0.27 | 93 (89 to 96) | 7 (889) | 0.27 | 84 (72 to 92) |
WMA | 13 (1931) | 0.27 | 81 (74 to 85) | 6 (794) | 0.26 | 85 (76 to 91) | 7 (1137) | 0.28 | 78 (70 to 84) |
LV dilatation | 10 (1966) | 0.13 | 73 (59 to 84) | 6 (966) | 0.17 | 89 (64 to 97) | 6 (1000) | 0.09 | 68 (51 to 81) |
LVH | 12 (2229) | 0.24 | 83 (73 to 90) | 6 (1096) | 0.23 | 85 (72 to 92) | 7 (1133) | 0.26 | 80 (61 to 91) |
LVEF (any abnormality) | 14 (2851) | 0.21 | 91 (87 to 95) | 8 (1368) | 0.16 | 96 (90 to 98) | 8 (1483) | 0.26 | 89 (81 to 93) |
LVEF (moderate/severe) | 10 (1611) | 0.27 | 92 (87 to 96) | 5 (722) | 0.27 | 96 (87 to 99) | 7 (889) | 0.27 | 91 (83 to 95) |
WMA | 12 (1876) | 0.28 | 90 (88 to 92) | 6 (759) | 0.27 | 95 (93 to 96) | 6 (1117) | 0.28 | 88 (85 to 90) |
LV dilatation | 10 (1966) | 0.13 | 95 (94 to 97) | 6 (966) | 0.17 | 98 (93 to 99) | 6 (1000) | 0.09 | 95 (93 to 96) |
LVH | 11 (2228) | 0.25 | 90 (82 to 95) | 5 (1095) | 0.23 | 91 (82 to 96) | 7 (1133) | 0.26 | 87 (67 to 96) |
HUD, handheld ultrasound devices; LV, left ventricular; LVEF, LV ejection fraction; LVH, LV dilatation and hypertrophy; TTE, transthoracic echocardiography; WMA, wall motion abnormalities.
The highest diagnostic ORs were in assessing LV dilatation (DOR 96, 95% CI 40 to 229). This result indicates that the odds of a positive result in a patient with LV dilatation is approximately 96 times higher than the odds for a positive result in a person with no LV dilatation. There was a significant difference in the diagnostic accuracy between experienced and inexperienced users in LV dilatation, LVEF (moderate/severe) and WMA. The DOR for LVEF (moderate/severe), LV dilatation and WMA in an experienced hand was 276, 225 and 90, respectively, compared with 41, 45 and 28, respectively, for inexperienced users. The total effect sizes and subgroup differences test comparing the HUD parameters in experienced and inexperienced users are shown in online supplemental table 2. A sensitivity analysis excluding studies that visually assessed LVH and LV dilatation showed that quantitative analysis improves the diagnostic accuracy of HUD. Meta-regression analysis confirmed experience to be a significant factor in the detection of any degree of LVEF dysfunction (p=0.04) and WMA (p=0.01) (online supplemental table 3).
Heterogeneity
Heterogeneity can be visualised in all the forest plots depicting sensitivity and in the LVEF and LVH plot depicting specificity. Despite there being some overlap of CIs, sampling variation does not completely explain the differences between studies. This apparent heterogeneity can also be observed in the SROC curves for LVEF, WMA and LV dilatation. The increased heterogeneity in the sensitivity plots may be partly explained by fewer patients with the target condition than without. This provides less certainty and results in wider CIs.
A negative correlation between sensitivity and specificity was shown in the meta-analysis of LVEF<45%, WMA and LV dilatation indicating no significant heterogeneity. The correlation coefficients for LVEF (any abnormality) and LVH was positive indicating the presence of possible heterogeneity in the results. We planned to assess the effect of operator experience, pre-existing comorbidities and baseline LV function on the results in a meta-regression covariate analysis. However, only operator experience was sufficiently reported and showed that experience was a significant factor in detecting LVEF, WMA and LV dilatation.
Variation in thresholds likely accounts for some heterogeneity when measuring LVEF (any abnormality), LV dilatation and LVH. Studies with both qualitative and quantitative methodologies were incorporated into the meta-analysis. Quantitative thresholds of LV dilatation ranged from >53 mm to >59 mm, with some studies classifying LV dilatation subject to gender. Similarly, studies measuring LVH were both qualitative and quantitative, with thresholds ranging from >10 mm to >12 mm. A sensitivity analysis excluding qualitative assessment of LVH and LV dilatation showed an improvement in the diagnostic accuracy (online supplemental table 3).
Other sources of heterogeneity may also exist that cannot be assessed including functionality and technological advancement of handheld devices that may allow for more accurate results to be obtained. Some studies reported any abnormality in LVEF as a positive finding without quantifying the results into mild, moderate or severe, which may have led to heterogeneity between studies. However, to limit the effect of the possible heterogeneity we analysed studies reporting LVEF <45% (moderate and severe degrees of LV dysfunction) separately. This analysis allowed for a detailed assessment of HUD in significant disease.
Varying levels of experience using HUD by experienced echocardiographers may account for some heterogeneity. The level and volume of training received by non-experienced users prior to each study was also variable adding to heterogeneity within the non-experienced subgroup.
Discussion
To the best of our knowledge, this is the first meta-analysis of the diagnostic accuracy of HUD for imaging LV cardiac structural and functional abnormalities and the first to report the impact of user experience. The meta-analysis shows that HUD is both a sensitive and specific method for assessing LV function and morphology when performed by experienced operators. While a basic competence in HUD can be achieved in a relatively short period of time, in clinical practice, a cautious, supervised approach should be applied when inexperienced users are acquiring and interpreting images. This mostly applies to secondary care where the prevalence of disease and the availability of experienced echocardiographers is greatest. Our findings demonstrate that HUD is a valuable bedside tool that can be used to identify those who require further investigation and as a result may lead to a reduction in the number of unnecessary echo referrals (table 3).
Table 3.
Review question | Is handheld echocardiography able to accurately diagnose LV dysfunction compared with TTE? | |||
Population | 6062 participants aged 65±5 years with a male predominance of 54% requiring routine referral for TTE | |||
Setting | Single centres with access to TTE | |||
Studies | Studies of diagnostic tests | |||
Quality of evidence | Majority of studies reported consecutive or random sampling, blinding of assessors and short time between HUD and TTE imaging (24–28 hours) | |||
Pooled results | Sensitivity (95% CI) | Specificity (95% CI) | ||
Experienced | Inexperienced | Experienced | Inexperienced | |
LVEF (any abnormality) | 88 (81 to 92) | 83 (71 to 90) | 96 (90 to 98) | 89 (81 to 93) |
LVEF (moderate/severe) | 93 (89 to 96) | 84 (72 to 92) | 96 (87 to 99) | 91 (83 to 95) |
WMA | 85 (76 to 91) | 78 (70 to 84) | 95 (93 to 96) | 88 (85 to 90) |
LV dilatation | 89 (64 to 97) | 68 (51 to 81) | 98 (93 to 99) | 95 (93 to 96) |
LVH | 85 (72 to 92) | 80 (61 to 91) | 91 (82 to 96) | 87 (67 to 96) |
HUD, handheld ultrasound devices; LV, left ventricular; LVEF, LV ejection fraction; LVH, LV dilatation and hypertrophy; TTE, transthoracic echocardiography; WMA, wall motion abnormalities.
Training is required to be able to use HUD competently and therefore the results of our study should be interpreted based on the level of operator experience. The amount of training offered and ability to practise using HUD will also impact the diagnostic outcome that can be expected. Operators with limited training however were less able to detect LV dilatation and WMA, recording pooled sensitivities of 68% and 78%, respectively compared with 89% and 85% achieved by experienced echocardiographers. A positive scan in an experienced hand had a 3–6 times higher odds of showing true LV impairment, LV dilatation or WMA compared with inexperienced operators. Operator experience was not a significant discriminating factor when measuring LVH suggesting that it can be more accurately measured by clinicians with minimal training.
Important logistical points need to be considered including cost-effectiveness, training and accessibility by clinicians. HUD has been shown to be more cost-effective in comparison to TTE and reduces overall costs when compared with physical examination.6 11 Despite these potential savings, implementation requires training and frequent revalidation to maintain the clinician’s skill. Didactic and practical sessions are required before clinicians can achieve basic competence in HUD. A minimum of 30 scans has been recommended, however brief training is associated with an increased false-positive rate.12 13 This first highlights that HUD performed by inexperienced users should be supervised by experienced echocardiographers as previously mentioned and second, the importance of frequent training and consolidation in echocardiography before allowing users to image patients without supervision. Accessibility of recorded images is therefore a fundamental property of a HUD if sufficient supervision is to be achieved.
Our data suggest that HUD is best positioned at the beginning of the clinical pathway when suspicious of cardiac pathology, thus augmenting the cardiovascular examination. Detecting cardiac disease earlier, when the prevalence of any abnormality is at its lowest, is likely to incur higher rates of false positives. However, HUD should be considered as a method of triaging patients who may require further investigation. HUD should not be considered as a replacement to TTE. HUD can be conducted at the bedside and take <6 min.14 It can be argued that this is preferable compared with the potential of unnecessarily having to wait for a more complex scan, which may require the patient to return on a separate day or result in a longer stay in hospital. However, a negative finding on HUD and not proceeding to full TTE risks cardiac abnormalities being missed, a factor which should be considered on an individual patient basis.
Negative results (ie, specificity) can be used with reasonable confidence used to determine normal cardiac physiology. However, positive results need to be interpreted with caution, especially when performed by inexperienced HUD users. Clinical decision making should not be solely guided by the interpretation of HUD images, even by experienced echocardiographers. Instead, these results suggest that HUD should act as an initial diagnostic test to aid decision making on whether further investigation, including TTE, and treatment is required.
Given the excellent sensitivity and specificity particularly seen with more experienced operators, it is likely that the role of HUD will become even more prominent in future clinical practice. We would support earlier teaching and training of HUD and its incorporation into the medical school curriculum, thus providing an important way of ensuring adequate training for all future doctors.
Strengths and limitations
An extensive literature search was performed. No search filters were used revealing results from an unpublished source, thus minimising the risk of publication bias. To limit the effect of any reporting bias, data were carefully extracted from the results of some studies that did not explicitly state sensitivity and specificity values. The search and data extraction were performed by two authors independently to minimise the bias in the review process.
Half of the included studies are >10 years old and improvement in screen technology, image processing and other advancements might play a pivotal role in improving the diagnostic accuracy of HUD.
The lack of a common threshold for WMA, LV dilatation and LVH means the diagnostic performance may vary between centres. Our results do however show that despite variation in thresholds, the specificity of HUD remains ≥87% for all characteristics. Even if sensitivity is reduced, the use of HUD as an initial diagnostic tool means diagnosing a condition and determining disease severity is not the aim of this test. Any uncertainty when interpreting the image should result in referral for further investigation. Clinical suspicion of HF and measurement of LV filling pressures is an important indication for echocardiography assessment and would be a valuable bedside tool. Clarius is one of the only scanners on the market capable of pulse-wave Doppler (PWD), permitted by the installation of a liquid heating device which prevents overheating.15 The current technological capabilities of most HUDs do not include PWD and therefore filling pressures cannot be measured using these devices.16 We were therefore unable to analyse sufficient data regarding this variable.
Future applications
With advancement of technology, LV border tracking and other methods of automatic, device-generated, quantitative measures of ejection fraction may become routinely available.17 Incorporation of PWD and continuous-wave Doppler technology into a greater number of available HUDs will also allow for a more extensive range of quantitative cardiovascular assessments to be undertaken at the bedside. Qualitative assessment of valvular heart disease using colour-flow Doppler is available on most HUDs, however is outside the scope of this review. Images may ultimately be sent remotely following acquisition directly to an experienced echocardiographer who can review and interpret images immediately, fast-tracking patients who require further investigation.18 19 Further developments in HUD therefore have the potential to revolutionise the bedside cardiovascular examination.
This study highlights the need to further develop methods to bridge the gap between experienced and inexperienced users. Education and introduction of an ultrasound curriculum for medical students and junior doctors can improve understanding of clinical anatomy, develop basic ultrasound skills and later their diagnostic ability.20 21 Formulation of a designated HUD training pathway would allow for standardisation of HUD competencies and provide structure to those wishing to advance their experience using HUDs. These suggestions are limited by the financial burden this would incur as well as a shortfall of clinicians adequately trained using HUDs.
Conclusion
This meta-analysis supports the use of HUD as a powerful modality for predicting LV size and systolic function. HUD diagnostic yield is superior when performed by experienced echocardiographers. Images acquired by an inexperienced operator should be done under direct supervision or validated by a more experienced user. This study provides a strong rationale for considering HUD as an auxiliary tool to the physical examination in secondary care, to aid the clinical decision making when considering referral for TTE.
Key messages.
What is already known on this subject?
Handheld cardiac ultrasound device (HUD) offers rapid bedside assessment of cardiac morphology and function.
The diagnostic accuracy of HUD previously reported has shown heterogeneity between studies and its clinical value has yet to be determined.
What might this study add?
To the best of our knowledge, this is the first study to perform a meta-analysis evaluating the diagnostic accuracy of HUD devices to detect cardiac dysfunction and the impact of operator experience on test accuracy.
This study reports that HUD test accuracy is significantly improved when performed by experienced operators.
How might this impact on clinical practice?
The clinical utility of HUD is rapidly expanding.
Augmentation of the physical cardiovascular examination using HUD may improve detection of cardiac size and function at the bedside and lead to a reduction in the number of unnecessary departmental transthoracic echocardiography referrals.
Image interpretation by inexperienced operators should be confirmed by more experienced echocardiographers before clinical decisions and referral for further imaging are made.
Footnotes
Twitter: @smrabd, @pswoboda81
Contributors: SJ, SA and PG contributed to the study conception and design. Material preparation, data collection and analysis were performed by SJ, SA and PG. SA performed the meta-analysis of the diagnostic accuracy parameters. All authors contributed to the interpretation of data. The first draft of the manuscript was written by SJ and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Funding: This work was funded in part by the Wellcome Trust (215799/Z/19/Z, 214567/Z/18/Z and 205188/Z/16/Z). For the purpose of Open Access, the authors have applied a CC BY public copyright licence to any Author Accepted Manuscript version arising from this submission.
Competing interests: PG is an advisor for Pie Medical Imaging and Medis Medical Imaging. JW lists commercial relationships with AstraZeneca, Bayer and Novartis.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
Ethics statements
Patient consent for publication
Not required.
References
- 1. Indications for echocardiography.pdf. Available: https://www.bsecho.org/common/Uploaded%20files/Education/Protocols%20and%20guidelines/Indications%20for%20echocardiography.pdf [Accessed 19 Feb 2021].
- 2. Mitchell C, Rahko PS, Blauwet LA, et al. Guidelines for performing a comprehensive transthoracic echocardiographic examination in adults: recommendations from the American Society of echocardiography. J Am Soc Echocardiogr 2019;32:1–64. 10.1016/j.echo.2018.06.004 [DOI] [PubMed] [Google Scholar]
- 3. Sicari R, Galderisi M, Voigt J-U, et al. The use of pocket-size imaging devices: a position statement of the European association of echocardiography. Eur J Echocardiogr 2011;12:85–7. 10.1093/ejechocard/jeq184 [DOI] [PubMed] [Google Scholar]
- 4. Wharton G, Steeds R, Allen J, et al. A minimum dataset for a standard adult transthoracic echocardiogram: a guideline protocol from the British Society of echocardiography. Echo Res Pract 2015;2:G9–24. 10.1530/ERP-14-0079 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Bhavnani SP, Narula J, Sengupta PP. Mobile technology and the digitization of healthcare. Eur Heart J 2016;37:1428–38. 10.1093/eurheartj/ehv770 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Pathan F, Fonseca R, Marwick TH. Usefulness of Hand-Held Ultrasonography as a Gatekeeper to Standard Echocardiography for "Rarely Appropriate" Echocardiography Requests. Am J Cardiol 2016;118:1588–92. 10.1016/j.amjcard.2016.08.027 [DOI] [PubMed] [Google Scholar]
- 7. Diagnostic test accuracy (DTA) reviews. Available: https://training.cochrane.org/diagnostic-test-accuracy-dta-reviews [Accessed 6 Jul 2021].
- 8. Galasko GIW, Lahiri A, Senior R. Portable echocardiography: an innovative tool in screening for cardiac abnormalities in the community. Eur J Echocardiogr 2003;4:119–27. 10.1053/euje.4.2.119 [DOI] [PubMed] [Google Scholar]
- 9. Bruce CJ, Montgomery SC, Bailey KR, et al. Utility of hand-carried ultrasound devices used by cardiologists with and without significant echocardiographic experience in the cardiology inpatient and outpatient settings. Am J Cardiol 2002;90:1273–5. 10.1016/s0002-9149(02)02853-9 [DOI] [PubMed] [Google Scholar]
- 10. Greaves K, Jeetley P, Hickman M, et al. The use of hand-carried ultrasound in the hospital setting--a cost-effective analysis. J Am Soc Echocardiogr 2005;18:620–5. 10.1016/j.echo.2004.09.015 [DOI] [PubMed] [Google Scholar]
- 11. Spencer KT, Kimura BJ, Korcarz CE, et al. Focused cardiac ultrasound: recommendations from the American Society of echocardiography. J Am Soc Echocardiogr 2013;26:567–81. 10.1016/j.echo.2013.04.001 [DOI] [PubMed] [Google Scholar]
- 12. Wilkinson JS, Barake W, Smith C, et al. Limitations of condensed teaching strategies to develop hand-held cardiac ultrasonography skills in internal medicine residents. Can J Cardiol 2016;32:1034–7. 10.1016/j.cjca.2015.10.008 [DOI] [PubMed] [Google Scholar]
- 13. Stokke TM, Ruddox V, Sarvari SI, et al. Brief group training of medical students in focused cardiac ultrasound may improve diagnostic accuracy of physical examination. J Am Soc Echocardiogr 2014;27:1238–46. 10.1016/j.echo.2014.08.001 [DOI] [PubMed] [Google Scholar]
- 14. Hammoudi N, Arangalage D, Boubrit L, et al. Ultrasound-based teaching of cardiac anatomy and physiology to undergraduate medical students. Arch Cardiovasc Dis 2013;106:487–91. 10.1016/j.acvd.2013.06.002 [DOI] [PubMed] [Google Scholar]
- 15. Mjolstad OC, Dalen H, Graven T, et al. Routinely adding ultrasound examinations by pocket-sized ultrasound devices improves inpatient diagnostics in a medical department. Eur J Intern Med 2012;23:185–91. 10.1016/j.ejim.2011.10.009 [DOI] [PubMed] [Google Scholar]
- 16. C3 Overview - Handheld Curvilinear Ultrasound Scanner - Clarius. Available: https://clarius.com/gb/scanners/c3/ [Accessed 24 May 2021].
- 17. Rykkje A, Carlsen JF, Nielsen MB. Hand-Held ultrasound devices compared with High-End ultrasound systems: a systematic review. Diagnostics 2019;9. 10.3390/diagnostics9020061. [Epub ahead of print: 15 06 2019]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Narula S, Shameer K, Salem Omar AM, et al. Machine-Learning algorithms to Automate morphological and functional assessments in 2D echocardiography. J Am Coll Cardiol 2016;68:2287–95. 10.1016/j.jacc.2016.08.062 [DOI] [PubMed] [Google Scholar]
- 19. Sengupta PP, Narula N, Modesto K, et al. Feasibility of intercity and trans-atlantic telerobotic remote ultrasound: assessment facilitated by a nondedicated bandwidth connection. JACC Cardiovasc Imaging 2014;7:804–9. 10.1016/j.jcmg.2014.03.014 [DOI] [PubMed] [Google Scholar]
- 20. Boman K, Olofsson M, Berggren P, et al. Robot-assisted remote echocardiographic examination and teleconsultation: a randomized comparison of time to diagnosis with standard of care referral approach. JACC Cardiovasc Imaging 2014;7:799–803. 10.1016/j.jcmg.2014.05.006 [DOI] [PubMed] [Google Scholar]
- 21. Aldaas OM, Igata S, Raisinghani A, et al. Accuracy of left ventricular ejection fraction determined by automated analysis of handheld echocardiograms: a comparison of experienced and novice examiners. Echocardiography 2019;36:2145–51. 10.1111/echo.14546 [DOI] [PubMed] [Google Scholar]
- 22. Alexander JH, Peterson ED, Chen AY, et al. Feasibility of point-of-care echocardiography by internal medicine house staff. Am Heart J 2004;147:476–81. 10.1016/j.ahj.2003.10.010 [DOI] [PubMed] [Google Scholar]
- 23. Andersen GN, Haugen BO, Graven T, et al. Feasibility and reliability of point-of-care pocket-sized echocardiography. Eur J Echocardiogr 2011;12:665–70. 10.1093/ejechocard/jer108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Biais M, Carrié C, Delaunay F, et al. Evaluation of a new pocket echoscopic device for focused cardiac ultrasonography in an emergency setting. Crit Care 2012;16:R82. 10.1186/cc11340 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Coletta C, De Marchis E, Lenoli M, et al. Reliability of cardiac dimensions and valvular regurgitation assessment by sonographers using hand-carried ultrasound devices. Eur J Echocardiogr 2006;7:275–83. 10.1016/j.euje.2005.06.003 [DOI] [PubMed] [Google Scholar]
- 26. Cullen MW, Blauwet LA, Vatury OM, et al. Diagnostic capability of comprehensive handheld vs transthoracic echocardiography. Mayo Clin Proc 2014;89:790–8. 10.1016/j.mayocp.2013.12.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. DeCara JM, Lang RM, Koch R, et al. The use of small personal ultrasound devices by internists without formal training in echocardiography. Eur J Echocardiogr 2003;4:141–7. 10.1053/euje.2002.0617 [DOI] [PubMed] [Google Scholar]
- 28. Fedson S, Neithardt G, Thomas P, et al. Unsuspected clinically important findings detected with a small portable ultrasound device in patients admitted to a general medicine service. J Am Soc Echocardiogr 2003;16:901–5. 10.1016/S0894-7317(03)00426-7 [DOI] [PubMed] [Google Scholar]
- 29. Ghani SN, Kirkpatrick JN, Spencer KT, et al. Rapid assessment of left ventricular systolic function in a pacemaker clinic using a hand-carried ultrasound device. J Interv Card Electrophysiol 2006;16:39–43. 10.1007/s10840-006-9011-y [DOI] [PubMed] [Google Scholar]
- 30. Giusca S, Jurcut R, Ticulescu R, et al. Accuracy of handheld echocardiography for bedside diagnostic evaluation in a tertiary cardiology center: comparison with standard echocardiography. Echocardiography 2011;28:136–41. 10.1111/j.1540-8175.2010.01310.x [DOI] [PubMed] [Google Scholar]
- 31. Gulič TG, Makuc J, Prosen G, et al. Pocket-size imaging device as a screening tool for aortic stenosis. Wien Klin Wochenschr 2016;128:348–53. 10.1007/s00508-015-0904-6 [DOI] [PubMed] [Google Scholar]
- 32. Khan HA, Wineinger NE, Uddin PQ. Can Hospital rounds with pocket echocardiography by cardiologists reduce standard transthoracic echocardiography? Am J Med 2014;127:669.e1–669.e7. 10.1016/j.amjmed.2014.03.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Kirkpatrick JN, Ghani SN, Spencer KT. Hand carried echocardiography screening for LV systolic dysfunction in a pulmonary function laboratory. Eur J Echocardiogr 2008;9:381–3. 10.1016/j.euje.2007.06.013 [DOI] [PubMed] [Google Scholar]
- 34. Kobal SL, Trento L, Baharami S, et al. Comparison of effectiveness of hand-carried ultrasound to bedside cardiovascular physical examination. Am J Cardiol 2005;96:1002–6. 10.1016/j.amjcard.2005.05.060 [DOI] [PubMed] [Google Scholar]
- 35. Liebo MJ, Israel RL, Lillie EO. Pocket mobile echocardiography: the next-generation stethoscope? A comparison of rapidly acquired PME images to standard TTE. Ann Intern Med 2011;155:33–8. 10.7326/0003-4819-155-1-201107050-00005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. López-Palmero S, Bolivar-Herrera N, López-Lloret G, et al. Diagnostic utility of handheld ultrasonography as an extension of the physical examination of patients with heart failure. Rev Clin Esp 2015;215:204–10. 10.1016/j.rce.2015.01.015 [DOI] [PubMed] [Google Scholar]
- 37. Lucas BP, Candotti C, Margeta B, et al. Diagnostic accuracy of hospitalist-performed hand-carried ultrasound echocardiography after a brief training program. J Hosp Med 2009;4:340–9. 10.1002/jhm.438 [DOI] [PubMed] [Google Scholar]
- 38. Lucas BP, Candotti C, Margeta B, et al. Hand-Carried echocardiography by hospitalists: a randomized trial. Am J Med 2011;124:766–74. 10.1016/j.amjmed.2011.03.029 [DOI] [PubMed] [Google Scholar]
- 39. Martin LD, Howell EE, Ziegelstein RC, et al. Hand-carried ultrasound performed by hospitalists: does it improve the cardiac physical examination? Am J Med 2009;122:35–41. 10.1016/j.amjmed.2008.07.022 [DOI] [PubMed] [Google Scholar]
- 40. Mehta M, Jacobson T, Peters D, et al. Handheld ultrasound versus physical examination in patients referred for transthoracic echocardiography for a suspected cardiac condition. JACC Cardiovasc Imaging 2014;7:983–90. 10.1016/j.jcmg.2014.05.011 [DOI] [PubMed] [Google Scholar]
- 41. Mjølstad OC, Andersen GN, Dalen H, et al. Feasibility and reliability of point-of-care pocket-size echocardiography performed by medical residents. Eur Heart J Cardiovasc Imaging 2013;14:1195–202. 10.1093/ehjci/jet062 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Nilsson G, Söderström L, Alverlind K, et al. Hand-Held cardiac ultrasound examinations performed in primary care patients by nonexperts to identify reduced ejection fraction. BMC Med Educ 2019;19:282. 10.1186/s12909-019-1713-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Olesen LL, Andersen A, Thaulow S. Hand-Held echocardiography is useful for diagnosis of left systolic dysfunction in an elderly population. Dan Med J 2015;62:A5100. [PubMed] [Google Scholar]
- 44. Perez-Avraham G, Kobal SL, Etzion O, et al. Left ventricular geometric abnormality screening in hypertensive patients using a hand-carried ultrasound device. J Clin Hypertens 2010;12:181–6. 10.1111/j.1751-7176.2009.00247.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Razi R, Estrada JR, Doll J, et al. Bedside hand-carried ultrasound by internal medicine residents versus traditional clinical assessment for the identification of systolic dysfunction in patients admitted with decompensated heart failure. J Am Soc Echocardiogr 2011;24:1319–24. 10.1016/j.echo.2011.07.013 [DOI] [PubMed] [Google Scholar]
- 46. Ruddox V, Stokke TM, Edvardsen T, et al. The diagnostic accuracy of pocket-size cardiac ultrasound performed by unselected residents with minimal training. Int J Cardiovasc Imaging 2013;29:1749–57. 10.1007/s10554-013-0278-7 [DOI] [PubMed] [Google Scholar]
- 47. Vignon P, Frank MBJ, Lesage J, et al. Hand-held echocardiography with Doppler capability for the assessment of critically-ill patients: is it reliable? Intensive Care Med 2004;30:718–23. 10.1007/s00134-003-2128-x [DOI] [PubMed] [Google Scholar]
- 48. Vourvouri EC, Schinkel AFL, Roelandt JRTC, et al. Screening for left ventricular dysfunction using a hand-carried cardiac ultrasound device. Eur J Heart Fail 2003;5:767–74. 10.1016/s1388-9842(03)00155-7 [DOI] [PubMed] [Google Scholar]
- 49. Wejner-Mik P, Kasprzak JD, Filipiak-Strzecka D, et al. Personal mobile device-based pocket echocardiograph-The diagnostic value and clinical utility. Adv Med Sci 2019;64:157–61. 10.1016/j.advms.2018.11.003 [DOI] [PubMed] [Google Scholar]
- 50. Xie T, Chamoun AJ, McCulloch M, et al. Rapid screening of cardiac patients with a miniaturized hand-held ultrasound imager--comparisons with physical examination and conventional two-dimensional echocardiography. Clin Cardiol 2004;27:241–5. 10.1002/clc.4960270414 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
heartjnl-2021-319561supp001.pdf (785.5KB, pdf)
Data Availability Statement
All data relevant to the study are included in the article or uploaded as supplementary information.