Skip to main content
BMJ Open logoLink to BMJ Open
. 2020 Oct 29;10(10):e038449. doi: 10.1136/bmjopen-2020-038449

Standard echocardiography versus handheld echocardiography for the detection of subclinical rheumatic heart disease: a systematic review and meta-analysis of diagnostic accuracy

Lisa Helen Telford 1,2,, Leila Hussein Abdullahi 2,3, Eleanor Atieno Ochodo 4, Liesl Joanna Zuhlke 5,6, Mark Emmanuel Engel 1
PMCID: PMC7597508  PMID: 33122317

Abstract

Objective

To summarise the accuracy of handheld echocardiography (HAND) which, if shown to be sufficiently similar to that of standard echocardiography (STAND), could usher in a new age of rheumatic heart disease (RHD) screening in endemic areas.

Design

Systematic review and meta-analysis.

Data sources

PubMed, Scopus, EBSCOHost and ISI Web of Science were initially searched on 27 September 2017 and again on 3 March 2020 for studies published from 2012 onwards.

Eligibility criteria

Studies assessing the accuracy of HAND compared with STAND when performed by an experienced cardiologist in conjunction with the 2012 World Heart Federation criteria among populations of children and adolescents living in endemic areas were included.

Data extraction and synthesis

Two reviewers independently extracted data and assessed the methodological quality of included studies against review-specific Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 criteria. A meta-analysis using the hierarchical summary receiver operating characteristic model was conducted to produce summary results of sensitivity and specificity. Forest plots and scatter plots in receiver operating characteristic space in combination with subgroup analyses were used to investigate heterogeneity. Publication bias was not investigated.

Results

Six studies (N=4208) were included in the analysis. For any RHD detection, the pooled results from six studies were as follows: sensitivity: 81.56% (95% CI 76.52% to 86.61%) and specificity: 89.75% (84.48% to 95.01%). Meta-analytical results from five of the six included studies were as follows: sensitivity: 91.06% (80.46% to 100%) and specificity: 91.96% (85.57% to 98.36%) for the detection of definite RHD only and sensitivity: 62.01% (31.80% to 92.22%) and specificity: 82.33% (65.15% to 99.52%) for the detection of borderline RHD only.

Conclusions

HAND displayed good accuracy for detecting definite RHD only and modest accuracy for detecting any RHD but demonstrated poor accuracy for the detection of borderline RHD alone. Findings from this review provide some evidence for the potential of HAND to increase access to echocardiographic screening for RHD in resource-limited and remote settings; however, further research into feasibility and cost-effectiveness of wide-scale screening is still needed.

PROSPERO registration number

CRD42016051261.

Keywords: echocardiography, paediatric cardiology, valvular heart disease, public health, cardiovascular imaging


Strengths and limitations of this study.

  • Language restrictions were not imposed during the literature search to minimise the chance of missing studies.

  • Data extraction was performed by two independent reviewers, thereby reducing the risk of bias.

  • Insufficient reporting limited our ability to adequately assess risk of bias and investigate potential sources of heterogeneity.

  • The small number of included studies prevented us from performing meta-regression.

Introduction

Rheumatic heart disease (RHD) is an acquired permanent heart valve condition which results from an atypical immune reaction to group A streptococcal infection typically occurring in childhood.1 2 Disease progression leading to chronic RHD can result in irreversible heart valve damage, cardiac failure and premature death.3 4 RHD is, however, a preventable and treatable chronic condition which most often effects disadvantaged populations.3 5

Significantly, RHD can remain asymptomatic for many years, particularly during the initial stages, thereby hindering the timely implementation of penicillin prophylaxis.6 Echocardiographic screening to identify those with subclinical disease has been advocated as a means to support secondary prevention and potentially slow disease progression to overt clinical RHD.7 8 Yet the feasibility of wide-scale echocardiographic screening remains hindered by high costs and the scarcity of trained personnel.9 Alternative RHD screening tests, which are both accurate and affordable, are therefore needed in many endemic areas.

Handheld echocardiography (HAND) is a non-invasive, highly portable and comparatively less expensive device which has been presented in recent publications to be a promising alternative to standard echocardiography (STAND), despite some limitations such as a lack of spectral Doppler capabilities.10 11 For HAND to be considered a suitable replacement for STAND, the device’s accuracy needs to be similar to that of STAND.

We conducted a systematic review and meta-analysis of studies assessing the diagnostic accuracy of HAND for the detection of RHD in children and adolescents. The findings of this review may offer direction to guideline developers as well as assist with the identification of gaps in diagnostic testing for RHD in endemic areas.

Methods

This systematic review was prepared according to the Preferred Reporting Items for a Systematic Review and Meta-Analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) guidelines.12 The protocol for this review is registered with the International Prospective Register of Systematic Reviews (PROSPERO) under the registration number CRD42016051261 and has been published in BMJ Open.13

Patient and public involvement

No patient involved.

Data sources and study eligibility

Studies were considered eligible for inclusion if the following criteria were met: (1) the accuracy of HAND compared with STAND when performed by an experienced cardiologist and in conjunction with the 2012 World Heart Federation (WHF) criteria was evaluated, and (2) the sample consisted of populations of children and adolescents living in endemic areas. Only primary observational studies of either a cross-sectional, cohort or diagnostic case–control design were considered. Descriptive studies such case studies and case series were excluded as were studies reporting on the same data. Studies using non-handheld devices as the index test or criteria other than the 2012 WHF criteria in combination with STAND as the reference test were also excluded.

We conducted systematic electronic literature searches of four sources (PubMed, Scopus, EBSCOHost and ISI Web of Science) using predefined tailor-made strategies (see online supplemental file 1). No restrictions in terms of language were applied; however, searches were limited to articles published from 2012 onwards. Both published and unpublished literature were considered eligible for inclusion. A manual search of the reference lists of all included studies as well as relevant review articles was also conducted.

Supplementary data

bmjopen-2020-038449supp001.pdf (53.5KB, pdf)

The titles and/or abstracts of all identified articles were screened independently by two reviewers. During this process, and on the basis of predefined eligibility criteria, all clearly ineligible studies were excluded. Discrepancies regarding eligibility were resolved through discussion and consensus. Some authors were contacted for additional information on published data.

Data extraction and management

Using a predefined data extraction form, two reviewers independently extracted information on metrics of diagnostic accuracy: numbers of true positives (TP), false positives (FP), true negatives (TN) and false negatives (FN) as well as other covariates relating to study characteristics, population, reference and index test details, test outcome and number of missing or unavailable test results from all included studies.

For accuracy measures, sensitivity and specificity were calculated using the numbers of TP, FP, TN and FN in accordance with standard convention. Data extraction conflicts were resolved through discussion and with the assistance of a third reviewer where necessary. Information garnered through the data extraction process was used to determine each study’s quality as well as for synthesising evidence.

Assessment of methodological quality

A review-specific Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 tool was used to assess the risk of bias and concerns regarding applicability in all included studies.14 The tool, encompassing four domains, was tailored to meet the specific requirements of this review. Two reviewers independently assessed the risk of bias in all included studies according to review-specific QUADAS-2 criteria. Discrepancies were resolved through discussion until consensus was reached and the assistance of a third reviewer was enlisted when necessary.

Statistical analysis and data synthesis

A meta-analysis using the hierarchical summary receiver operating characteristic (HSROC) model was conducted to produce summary results of sensitivity and specificity. The HSROC model was used for meta-analysis as it accounts for variations in test thresholds.

Statistical measures of variability or heterogeneity to determine whether or not to conduct a meta-analysis were not used. While the Cochrane Q test and I2 are routinely used to examine and quantify the amount of variability in meta-analyses of intervention studies where there is a single measure of effect or univariate outcome such as a risk or OR,15 16 meta-analyses of diagnostic test accuracy generally do not employ such measures.17 Instead, forest plots and scatter plots in receiver operating characteristic (ROC) space in combination with subgroup analyses were used to investigate heterogeneity.

Data were analysed according to three categorisations of RHD: any RHD (definite or borderline), definite RHD only and borderline RHD only. The any RHD category was selected as the main meta-analysis as it had the most complete data. We were unable to extract metrics of diagnostic accuracy for the definite and borderline RHD only categories from Beaton (2016) and therefore excluded this study from these meta-analyses. We chose to use nurse A’s results for Mirabel (2015) since nurse A and nurse B both interpreted the same HAND images which prevented the pooling of data.

Data from Zühlke (2016) were included in the analysis and synthesis of data even though the age range of participants fell outside the predefined range for eligibility. It was determined that this study should be included, regardless, since the data overall were quite few and the variation in age was not significant enough to warrant exclusion. However, data from Zühlke (2016) were excluded from all summary estimates of disease prevalence since this study used a nested case–control design which predetermines disease prevalence by design.

Heterogeneity was examined for the main meta-analysis only. We were only able to investigate the relationship between test accuracy and echocardiographer expertise through subgroup analysis. A sensitivity analysis was performed instead of subgroup analysis for the categorical covariates; HAND protocol and geographical location due to the skewed distribution of studies within each subgroup. We were unable to perform meta-regression for the covariates; age and sex due to insufficient and inadequately reported data.17 We were also unable to conduct a sensitivity analysis on risk of bias since no studies were found to have a high risk of bias. All plots were generated using the Review Manager (RevMan) software package, V.5.3.18 Meta-analysis was performed using SAS software, V.9.4.19

We did not investigate publication bias as methods of assessing publication bias for studies of diagnostic accuracy are still being developed. While the Deeks test has been suggested for use in diagnostic accuracy studies, the test has low power for detecting asymmetry in funnel plots, particularly when a large amount of heterogeneity is present.17

Results

Results of the search

Results of the literature search are reported in accordance with the PRISMA statement and the study selection process is illustrated in figure 1.20 All electronic searches were performed by two independent reviewers on 27 September 2017. Combined, the search yielded a total of 92 records, of which 9 were duplicates. A total of 67 were excluded based on title or abstract, leaving 16 for full-text review. Nine studies were excluded on the basis of a full-text review, while an additional study was also excluded after consultation with study authors. Six studies which met the predefined eligibility criteria were included in this review.

Figure 1.

Figure 1

Preferred Reporting Items for a Systematic Review and Meta-Analysis (PRISMA) flow diagram illustrating study identification, selection, eligibility and inclusion. From Moher et al.20

The same search was re-run on 3 March 2020 to check for any additional eligible studies. Only one potentially eligible study21 22 was found but has been excluded on the basis of being an abstract-only publication with no full-text available for review.

Included studies

A summary of notable characteristics of all included studies23–28 is shown in table 1. One study did not avoid a case–control design, however, cases and controls were sampled from the same population. Research has shown that case–control studies that use alternative diagnosis controls, controls from non-endemic areas or confirmed disease-free (healthy) controls tend to overestimate specificity.29

Table 1.

Summary of characteristics of included studies: ordered alphabetically by study author

Study Study design City, country (Classification*) Recruitment site/setting Participant selection
method
Sample size (N) % Female Mean age (years) SD
Beaton, 201423 Spiked cohort Kampala, Uganda
(low income)
A school and the Mulago Hospital Complex Unclear 125 55.2 10.8†
Beaton, 201524 Cross sectional Gulu, Uganda
(low income)
5 public schools A random 10% subset of the entire sample plus any child with mitral or aortic regurgitation were preselected to receive HAND 1420 53 10.8 ±2.6
Beaton, 201625 Cross sectional Belo Horizonte, Brazil
(upper-middle income)
2 primary and 3 secondary public schools A subset of the sample containing all STAND abnormals plus a random 25% of all STAND normals were preselected for HAND 397 49.1 13.9 ±2.6
Mirabel, 201526 Cross sectional Nouméa, New Caledonia
(high income)
Primary schools Consecutive 1217 50.5 9.6 ±0.5
Ploutz, 201627 Cross sectional Gulu, Uganda
(low income)
2 primary schools Consecutive 956 60.7 11.1 ±2.5
Zühlke, 201628 Nested case–control Cape Town, South Africa (upper-middle income) Schools Unclear 93 68.8 17†‡
Total 4208 54 10.8 ±1.9

*According to the World Bank’s economic classification system.

†Excluded from pooled mean and SD calculations (incomplete or incomparable data).

‡Median age (mean age not available).

HAND, handheld echocardiography; STAND, standard echocardiography.

Significantly, all but two studies were conducted in Africa. Screening was performed in RHD endemic areas among children and adolescents with most studies being school based. Combined, all six studies included a total of 4208 participants, of which 54% were female. The pooled mean age of participant’s was 10.8 years (SD: ±1.9).

All included studies used the same make of handheld device; the Vscan machine (General Electric, Medical Systems, Milwaukee, Wisconsin, USA) paired with a 1.7 to 3.4 MHz transducer. These machines provide both two-dimensional (2D) and colour imaging on an integrated 8.9 cm display.24 26 Frame rates range from 25 to 30 Hz for greyscale imaging and from 12 to 16 Hz for colour Doppler.23 27 Vscan machines are, however, limited by a lack of spectral Doppler capabilities.24

Excluded studies

Ten studies9 10 30–37 were excluded during full-text screening. Reasons for exclusion included abstract-only publications,32 33 35 the use of ineligible reference30 31 or index34 tests, the use of duplicate data,10 37 not specifying the test threshold a priori9 and not being a study of diagnostic accuracy.36

Methodological quality of included studies

A summary of the assessment of methodological quality of all included studies is illustrated in figure 2. Overall, only two25 26 of the six23–28 included studies were assessed as having a low risk of bias, while the risk in the remaining four23 24 27 28 was unclear. Two studies23 28 had participant selection bias concerns. Of these, both23 28 failed to adequately describe participant enrolment methods, while one28 also did not avoid a case–control design. The risk of bias in terms of flow and timing was unclear in two studies.24 27 Of these, one27 did not include all participants in the analysis due to technical difficulties, while the time interval between the index and reference test was unclear in the other.24 Overall, time intervals between index and reference tests were poorly described. Likewise, reporting of quality control of the index test was uniformly poor across all included studies. Concerns regarding applicability were low in all six23–28 studies.

Figure 2.

Figure 2

Risk of bias and applicability concerns graph: review authors’ judgements about each domain presented as percentages across included studies.

Findings

For any RHD

A total of six evaluations of HAND for any RHD were performed with data from six studies and a total of 4208 participants. Pooled prevalence of any RHD from five included studies was 12% (95% CI 6% to 19%). The forest plot revealed little variation in estimates of sensitivity and specificity and the HSROC plot (see online supplemental file 2 for all plots) revealed moderate accuracy of the test. Meta-analytical sensitivity and specificity (95% CI) of data at mixed thresholds were 81.56% (76.52% to 86.61%) and 89.75% (84.48% to 95.01%), respectively.

Supplementary data

bmjopen-2020-038449supp002.pdf (406.6KB, pdf)

For definite RHD

A total of five evaluations of HAND for definite RHD were performed with data from five studies and a total of 3588 participants. Pooled prevalence of definite RHD from four included studies was 6% (95% CI 2% to 12%). The forest plot revealed some variation in estimates of specificity while estimates of sensitivity were largely homogeneous, with the exception of a single outlier. The HSROC plot indicated good accuracy of the test. Meta-analytical sensitivity and specificity (95% CI) of data at mixed thresholds were 91.06% (80.46% to 100%) and 91.96% (85.57% to 98.36%), respectively.

For borderline RHD

A total of five evaluations of HAND for borderline RHD were performed with data from five studies and a total of 3685 participants. Pooled prevalence of borderline RHD from four included studies was 20% (95% CI 6% to 39%). The forest plot revealed some variation in estimates of specificity, while estimates of sensitivity were largely homogeneous with the exception of a single outlier. The HSROC plot indicated poor accuracy of the test. Meta-analytical sensitivity and specificity (95% CI) of data at mixed thresholds were 62.01% (31.80% to 92.22%) and 82.33% (65.15% to 99.52%), respectively.

Investigations of heterogeneity

Heterogeneity or variation between studies was investigated both visually and through subgroup analysis for the main meta-analysis only. We were only able to perform this analysis for the any RHD category as the data were too few to enable model convergence for the definite and borderline RHD only categories.

Covariates in the models

We were only able to use one of the five prespecified covariates to investigate heterogeneity due to insufficient and inadequately reported data. HAND echocardiographer expertise (expert vs non-expert) was investigated as a possible source of heterogeneity through subgroup analysis. Half of all included studies evaluated the accuracy of HAND when performed and interpreted by trained non-experts, while the other half assessed its accuracy in the hands of experts.

Subgroup and sensitivity analyses

A subgroup analysis was performed to investigate variations in echocardiographer expertise as a potential source of heterogeneity. Since no studies were found to have a high risk of bias, we did not explore the effect of excluding such studies on the accuracy of summary estimates. Sensitivity analyses were, however, conducted to investigate the effect of removing a single study on summary estimates of sensitivity and specificity for the covariates: geographical location and HAND protocol.

A subgroup analysis for the covariate; echocardiographer expertise, as shown in table 2 and illustrated in online supplemental file 3, revealed that both sensitivity (82.54% vs 80.76%) and specificity (94.57% vs 85.71%) were higher for any RHD detection using HAND when tests were performed and interpreted by experts compared with non-experts.

Table 2.

Sources of heterogeneity for handheld echocardiography for any RHD

Group Covariate Subgroup n (N=6) Median pooled sensitivity (95% Crl) Median pooled specificity (95% Crl)
Overall 6 81.56% (76.52–86.61) 89.75% (84.48–95.01)
Subgroup analysis HAND interpreter expertise Expert 3 82.54% (74.71–90.37) 94.57% (87.52–100)
Non-expert 3 80.76% (73.18–88.33) 85.71% (79.91–91.51)
Sensitivity analysis Geographical location Overall 80.40% (64.96–95.84) 87.15% (76.35–97.96)
Low-income and middle-income countries 5 81.17% (75.63–86.71) 90.07% (82.98–97.15)
HAND protocol Overall 85.35% (80.60–90.09) 88.80% (84.55–93.06)
Multiple views 5 80.98% (75.38–86.59) 87.46% (83.24–91.67)

HAND, handheld echocardiography; Crl, credible interval; n, number of studies; N, total number of included studies.

Supplementary data

bmjopen-2020-038449supp003.pdf (113KB, pdf)

Sensitivity analyses (see table 2) were performed to investigate the effect of excluding (1) the single high-income country study and (2) the study which employed a single view protocol on the accuracy of summary estimates. We found that both sensitivity (81.17% vs 80.4%) and specificity (90.07% vs 87.15%) increased compared with the overall analysis when only low-income and middle-income country studies were considered whereas both sensitivity (80.98% vs 85.35%) and specificity (87.46% vs 88.8%) decreased in comparison with the overall analysis when only studies which employed multiple view protocols were considered.

Discussion

Summary of main findings

We evaluated the accuracy of HAND for three distinct disease categories and found that, overall, the test was both sensitive and specific for detecting definite RHD only and moderately accurate for detecting any RHD but demonstrated insufficient accuracy for detecting borderline RHD alone.

Findings from this review provide some evidence for the potential of HAND to increase access to echocardiographic screening for RHD in resource-limited and remote settings. A summary of the accuracy estimates produced by meta-analysis using the HSROC method is included in table 3.

Table 3.

Summary of findings

What is the diagnostic accuracy of handheld echocardiography in detecting any RHD (definite or borderline)?
Patients/Population People residing in areas endemic for RHD (6 out of 6 studies)
Prior testing with echo Yes (2 studies), no (4 studies)
Settings 5 out of 6 screening studies were field setting (communities and schools) based, while 1 study was half hospital registry follow-up, half school based.
4 of the 6 studies were conducted in Africa with 3 of those from Uganda.
Index test(s) General Electric (GE) Vscan handheld machine (6 out of 6 studies)
Reference standard Standard echocardiography (2D, continuous-wave, and colour-Doppler echocardiography) performed by an experienced imager and in conjunction with the 2012 WHF criteria (6 out of 6 studies).
Test brands included GE Vivid-I ultrasound machine (2 studies); GE Vivid-Q ultrasound machine (2 studies); Philips CX-50 ultrasound machine (1 study); either a GE Vivid-I or Q or Philips CX-50 ultrasound machine (1 study)
Importance HAND is being used as first line replacement for STAND in disease screening programmes for RHD, as it is comparably inexpensive, quick, user friendly, easy to interpret and may have similar sensitivity to STAND
Studies Cross-sectional (n=4), spiked cohort (n=1) and nested case–control (n=1) studies. More than half (n=4) of all included studies did not explicitly state the study design used and were thus assigned a study design based on other reported characteristics and participant enrolment methods used.
Quality concerns Poor reporting of study design, participant characteristics and pretest probability were common concerns. For the majority of studies the risk of bias was unclear in terms of ‘patient selection’ and ‘flow and timing’. Concerns regarding applicability were low in all included studies.
Test types Number of participants* (n) Summary estimates (95% credible CI)
HAND for any RHD 4208 (6) Sensitivity: 81.56% (76.52–86.61)
Specificity: 89.75% (84.48–95.01)
HAND for definite RHD 3588 (5) Sensitivity: 91.06% (80.46–100)
Specificity: 91.96% (85.57–98.36)
HAND for borderline RHD 3685 (5) Sensitivity: 62.01% (31.8–92.22)
Specificity: 82.33% (65.15–99.52)

*Excluding participants with other diagnoses on STAND.

HAND, handheld echocardiography; n, number of studies; RHD, rheumatic heart disease; STAND, standard echocardiography.

Strengths and limitations of this review

Strengths

We have evaluated and summarised the accuracy of HAND for the detection of RHD in endemic areas, making this review relevant to current global agendas. This review also serves to highlight the existing gaps in evidence for which further research could be beneficial. We did not impose any limits in terms of language during the literature search so as to minimise the chance of missing studies. Data extraction was performed by two independent reviewers, thereby reducing the risk of bias.

Limitations

There were a number of shortcomings of this review, which included the following.

Eligibility

We were unable to include studies which used STAND in conjunction with criteria other than the 2012 WHF criteria as the reference standard, which limited the number of studies eligible for inclusion.

Quality of included studies

Insufficient reporting of participant characteristics and study methods including study design, participant selection and test timing restricted our ability to adequately assess risk of bias and investigate potential sources of heterogeneity.

Paucity of data

Insufficient and inadequately reported data, as well as the presentation of aggregate data, limited the scope of our investigations of heterogeneity, while the small number of included studies prevented us from performing meta-regression. Overall, the findings from this review may lack power due to the small sample size.

Applicability of findings to the review question

Concerns regarding the applicability of included studies to the review question were considered low according to review-specific QUADAS-2 criteria. Since all but one were conducted in low- or middle-income countries, and all studies with one exception were conducted in field settings, the results of this review are applicable for use in endemic areas for which screening programmes are frequently targeted. However, our limited assessment of risk of bias and investigations into sources of heterogeneity such as age and gender due to insufficient reporting may lessen the applicability of findings to the review question.

In the context of disease control programmes, being able to demonstrate variation in test accuracy associated with factors such as age and gender would be beneficial for policy makers. Fully understanding included studies’ risk of bias would also assist in objectively assessing the strength of evidence. For these reasons, prospective authors of diagnostic test accuracy studies are urged to make use of the Standards for Reporting of Diagnostic Accuracy Studies (STARD) guidelines38 when reporting methods of study design and conduct.

Conclusion

This review provides a summary of the accuracy of HAND for the detection of RHD. In populations of children and adolescents living in RHD endemic areas, HAND is both sensitive and specific for detecting definite RHD. The device is less accurate at detecting any RHD and demonstrates substandard accuracy for the detection of borderline RHD only. Nonetheless, HAND may hold value as a replacement for first-line screening due to its high sensitivity for definite RHD detection and adequate accuracy for any RHD detection.

Implications for practice

We have summarised the accuracy of HAND when used as a screening tool; however, the device’s potential value in terms of diagnostics has yet to be established. We therefore posit that HAND could be recommended as an acceptable replacement test for first-line screening in endemic areas provided a standardised set of device-specific diagnostic criteria are developed.

Another key consideration is the applicability of these findings for recommendations to integrate screening into routine clinical practice. A recent publication has reviewed the cost-effectiveness of screening in high-risk populations39 and determined that screening all indigenous Australian aged 5–12 years old in half of their communities in alternate years was found to be cost-effective, if RHD can be detected at least 2 years earlier. However, this result was sensitive to a number of assumptions, including local costs and context. Other cost-effectiveness models have also suggested modestly improved outcomes at lower cost.40 Neither of these studies included the significant cost-reduction of using HAND instead of STAND, hence, we highly recommend adding a cost-effectiveness analysis into proposed new screening studies.

Finally, our findings demonstrate comparable results by non-experts; this has also been demonstrated in several other reports,31 41 but again there are no detailed cost-effectiveness analyses using non-experts and HAND.

Implications for research

The findings of this review highlight the need for a new set of evidence-based guidelines tailored to the capabilities of HAND in order to maximise the device’s diagnostic potential. Further studies assessing the diagnostic accuracy of HAND when using a standardised protocol are needed as is further research into the feasibility, cost-effectiveness and consequences of implementing wide-scale screening programmes. Furthermore, the development of standardised training programmes for non-experts is recommended as screening for RHD in endemic areas inevitably rests on the success of task shifting.27 We conclude that while HAND has been shown to be sufficiently accurate for the detection of RHD, there is still a need for further research before its wide-scale use can be endorsed.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @_Miss_T__, @lieslzuhlke

Contributors: LJZ and MEE jointly conceived of the study and provided content advice. LHT and LHA performed the systematic review of the literature, independently extracted the data and are responsible for the quality control of study selection. EAO provided methodological advice and was responsible for conducting the meta-analysis. LHT significantly contributed to the interpretation of the data and wrote the first draft of the manuscript. All authors contributed to editing subsequent versions of the manuscript.

Funding: LJZ, LHT and LHA all receive funding from the Medtronic Foundation through support to RHD Action. LHT receives support from the National Research Foundation of South Africa (NRFSA) through its internship programme. LJZ is supported by both the NRFSA and Medical Research Council (MRC).

Competing interests: None declared.

Patient consent for publication: Not required.

Provenance and peer review: Not commissioned; externally peer reviewed.

Data availability statement: All data relevant to the study are included in the article or uploaded as supplementary information.

Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

References

  • 1.Marijon E, Mirabel M, Celermajer DS, et al. Rheumatic heart disease. Lancet 2012;379:953–64. 10.1016/S0140-6736(11)61171-9 [DOI] [PubMed] [Google Scholar]
  • 2.Zühlke LJ, Beaton A, Engel ME, et al. Group A Streptococcus, acute rheumatic fever and rheumatic heart disease: epidemiology and clinical considerations. Curr Treat Options Cardiovasc Med 2017;19:15. 10.1007/s11936-017-0513-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.World Heart Federation Rheumatic heart disease: neglected ncd of poverty (Factsheet. Geneva: World Heart Federation, 2013. [Google Scholar]
  • 4.Seckeler MD, Hoke TR. The worldwide epidemiology of acute rheumatic fever and rheumatic heart disease. Clin Epidemiol 2011;3:67–84. 10.2147/CLEP.S12977 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Dougherty S, Khorsandi M, Herbst P. Rheumatic heart disease screening: current concepts and challenges. Ann Pediatr Cardiol 2017;10:39. 10.4103/0974-2069.197051 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Moloi AH, Mall S, Engel ME, et al. The health systems barriers and facilitators for RhD prevalence: an epidemiological meta-analysis from Uganda and Tanzania. Glob Heart 2017;12:5–15. 10.1016/j.gheart.2016.12.002 [DOI] [PubMed] [Google Scholar]
  • 7.Zühlke LJ, Watkins DA, Perkins S, et al. A comprehensive needs assessment tool for planning RhD control programs in limited resource settings. Glob Heart 2017;12:25–31. 10.1016/j.gheart.2016.10.028 [DOI] [PubMed] [Google Scholar]
  • 8.Palafox B, Mocumbi AO, Kumar RK, et al. The WHF roadmap for reducing cv morbidity and mortality through prevention and control of RhD. Glob Heart 2017;12:47–62. 10.1016/j.gheart.2016.12.001 [DOI] [PubMed] [Google Scholar]
  • 9.Lu JC, Sable C, Ensing GJ, et al. Simplified rheumatic heart disease screening criteria for handheld echocardiography. J Am Soc Echocardiogr 2015;28:463–9. 10.1016/j.echo.2015.01.001 [DOI] [PubMed] [Google Scholar]
  • 10.Godown J, Lu JC, Beaton A, et al. Handheld echocardiography versus auscultation for detection of rheumatic heart disease. Pediatrics 2015;135:e939–44. 10.1542/peds.2014-2774 [DOI] [PubMed] [Google Scholar]
  • 11.Saxena A. Rheumatic heart disease screening by 'point-of-care' echocardiography: an acceptable alternative in resource limited settings? Transl Pediatr 2015;4:210–3. 10.3978/j.issn.2224-4336.2015.06.01 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.McInnes MDF, Moher D, Thombs BD, et al. Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: the PRISMA-DTA statement. JAMA 2018;319:388–96. 10.1001/jama.2017.19163 [DOI] [PubMed] [Google Scholar]
  • 13.Telford LH, Abdullahi LH, Ochodo EA, et al. Standard echocardiography versus handheld echocardiography for the detection of subclinical rheumatic heart disease: protocol for a systematic review. BMJ Open 2018;8:e020140. 10.1136/bmjopen-2017-020140 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Whiting PF, Rutjes AWS, Westwood ME, et al. Research and reporting methods accuracy studies. Ann Intern Med 2011;155:529–36. [DOI] [PubMed] [Google Scholar]
  • 15.Higgins J, Thomas J, Chandler J, et al. Cochrane Handbook for systematic reviews of interventions version 6.0. Cochrane, 2019. https://training.cochrane.org/handbook [Google Scholar]
  • 16.Naaktgeboren CA, Ochodo EA, Van Enst WA, et al. Assessing variability in results in systematic reviews of diagnostic studies. BMC Med Res Methodol 2016;16:6. 10.1186/s12874-016-0108-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Macaskill P, Gatsonis C, Deeks JJ, et al. Chapter 10: Analysing and Presenting Results : Deeks JJ, Bossuyt PM, Gatsonis C, et al., Cochrane Handbook for systematic reviews of diagnostic test accuracy. Version 1 The Cochrane Collaboration, 2010. https://methods.cochrane.org/sites/methods.cochrane.org.sdt/files/public/uploads/Chapter10-Version1.0.pdf [Google Scholar]
  • 18.The Cochrane Collaboration Review manager (RevMan). Copenhagen: The Nordic Cochrane Centre, 2014. [Google Scholar]
  • 19.SAS Institute Inc SAS/STAT software, 2011. [Google Scholar]
  • 20.Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009;6:e1000097. 10.1371/journal.pmed.1000097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Francis J, Fairhurst H, Kaethner A, et al. Handheld PLAX view echocardiography by Healthworkers for detection of RhD. Heart, Lung and Circulation 2019;28:S51–2. 10.1016/j.hlc.2019.05.133 [DOI] [Google Scholar]
  • 22.Francis J, Fairhurst H, Kaethner A, et al. P3133Single parasternal long axis echocardiography by briefly trained health workers using handheld devices for detection of rheumatic heart disease: a prospective study of diagnostic accuracy. Eur Heart J 2019;40:3133 10.1093/eurheartj/ehz745.0208 [DOI] [Google Scholar]
  • 23.Beaton A, Aliku T, Okello E, et al. The utility of handheld echocardiography for early diagnosis of rheumatic heart disease. J Am Soc Echocardiogr 2014;27:42–9. 10.1016/j.echo.2013.09.013 [DOI] [PubMed] [Google Scholar]
  • 24.Beaton A, Lu JC, Aliku T, et al. The utility of handheld echocardiography for early rheumatic heart disease diagnosis: a field study. Eur Heart J Cardiovasc Imaging 2015;16:475–82. 10.1093/ehjci/jeu296 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Beaton A, Nascimento BR, Diamantino AC, et al. Efficacy of a standardized computer-based training curriculum to teach echocardiographic identification of rheumatic heart disease to Nonexpert users. Am J Cardiol 2016;117:1783–9. 10.1016/j.amjcard.2016.03.006 [DOI] [PubMed] [Google Scholar]
  • 26.Mirabel M, Bacquelin R, Tafflet M, et al. Screening for rheumatic heart disease: evaluation of a focused cardiac ultrasound approach. Circ Cardiovasc Imaging 2015;8:e002324. 10.1161/CIRCIMAGING.114.002324 [DOI] [PubMed] [Google Scholar]
  • 27.Ploutz M, Lu JC, Scheel J, et al. Handheld echocardiographic screening for rheumatic heart disease by non-experts. Heart 2016;102:35–9. 10.1136/heartjnl-2015-308236 [DOI] [PubMed] [Google Scholar]
  • 28.Zühlke LJ, Engel ME, Nkepu S, et al. Evaluation of a focussed protocol for hand-held echocardiography and computer-assisted auscultation in detecting latent rheumatic heart disease in scholars. Cardiol Young 2016;26:1097–106. 10.1017/S1047951115001857 [DOI] [PubMed] [Google Scholar]
  • 29.Rutjes AWS, Reitsma JB, Vandenbroucke JP, et al. Case-Control and two-gate designs in diagnostic accuracy studies. Clin Chem 2005;51:1335–41. 10.1373/clinchem.2005.048595 [DOI] [PubMed] [Google Scholar]
  • 30.Mirabel M, Celermajer DS, Ferreira B, et al. Screening for rheumatic heart disease: evaluation of a simplified echocardiography-based approach. Eur Heart J Cardiovasc Imaging 2012;13:1024–9. 10.1093/ehjci/jes077 [DOI] [PubMed] [Google Scholar]
  • 31.Colquhoun SM, Carapetis JR, Kado JH, et al. Pilot study of nurse-led rheumatic heart disease echocardiography screening in Fiji-a novel approach in a resource-poor setting. Cardiol Young 2013;23:546–52. 10.1017/S1047951112001321 [DOI] [PubMed] [Google Scholar]
  • 32.Godown J, JC L, Beaton A, et al. Handheld echocardiography improves detection of rheumatic heart disease in Ugandan schoolchildren compared to auscultation. Circulation 2014;130. [Google Scholar]
  • 33.JC L, Sable C, Ensing GJ, et al. Abstract 11138: simplified rheumatic heart disease screening criteria for handheld echocardiography. Circulation 2014;130:A11138 LP–A11138. [DOI] [PubMed] [Google Scholar]
  • 34.Engelman D, Kado JH, Reményi B, et al. Focused cardiac ultrasound screening for rheumatic heart disease by briefly trained health workers: a study of diagnostic accuracy. Lancet Glob Health 2016;4:e386–94. 10.1016/S2214-109X(16)30065-1 [DOI] [PubMed] [Google Scholar]
  • 35.Hardie J, Goodman N, Khan N, et al. Abstract: P1373 feasibility of focused cardiac ultrasound by non-expert operators as a strategy for a rheumatic heart disease screening programme. Eur Heart J 2016;37:241.26475833 [Google Scholar]
  • 36.Lopes ELV, Beaton AZ, Nascimento BR, et al. Telehealth solutions to enable global collaboration in rheumatic heart disease screening. J Telemed Telecare 2018;24:101–9. 10.1177/1357633X16677902 [DOI] [PubMed] [Google Scholar]
  • 37.Diamantino A, Beaton A, Aliku T, et al. A focussed single-view hand-held echocardiography protocol for the detection of rheumatic heart disease. Cardiol Young 2017:1–10. [DOI] [PubMed] [Google Scholar]
  • 38.Bossuyt PM, Reitsma JB, Bruns DE, et al. Stard 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 2015;277:h5527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Roberts K, Cannon J, Atkinson D, et al. Echocardiographic screening for rheumatic heart disease in Indigenous Australian children: a cost-utility analysis. J Am Heart Assoc 2017;6:e004515. 10.1161/JAHA.116.004515 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Zachariah JP, Samnaliev M. Echo-based screening of rheumatic heart disease in children: a cost-effectiveness Markov model. J Med Econ 2015;18:410–9. 10.3111/13696998.2015.1006366 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Musuku J, Engel ME, Musonda P, et al. Prevalence of rheumatic heart disease in Zambian school children. BMC Cardiovasc Disord 2018;18:135. 10.1186/s12872-018-0871-8 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2020-038449supp001.pdf (53.5KB, pdf)

Supplementary data

bmjopen-2020-038449supp002.pdf (406.6KB, pdf)

Supplementary data

bmjopen-2020-038449supp003.pdf (113KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES