Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2022 Nov 18.
Published in final edited form as: Eur Radiol. 2022 Apr 29;32(11):7448–7462. doi: 10.1007/s00330-022-08815-2

Ultrasound High–Definition Microvasculature Imaging with Novel Quantitative Biomarkers Improves Breast Cancer Detection Accuracy

Redouane Ternifi 1, Yinong Wang 2, Juanjuan Gu 1, Eric C Polley 3, Jodi M Carter 4, Sandhya Pruthi 5, Judy C Boughey 6, Robert T Fazzio 2, Mostafa Fatemi 1,, Azra Alizad 1,2,¶,*
PMCID: PMC9616967  NIHMSID: NIHMS1803198  PMID: 35486168

Abstract

Objectives

To overcome the limitations of power Doppler in imaging angiogenesis, we sought to develop and investigate new quantitative biomarkers of a contrast-free ultrasound microvasculature imaging technique for differentiation of benign from malignant pathologies of breast lesion.

Methods

In this prospective study a new high-definition microvasculature imaging (HDMI) was tested on 521 patients with 527 ultrasound-identified suspicious breast masses indicated for biopsy. Four new morphological features of tumor microvessels, microvessel fractal dimension (mvFD), Murray’s deviation (MD), Bifurcation angle (BA) and spatial vascularity pattern (SVP) as well as initial biomarkers were extracted, analyzed and the results correlated with pathology. Multivariable logistic regression analysis was used to study the performance of different prediction models, initial biomarkers, new biomarkers, and combined new and initial biomarkers in differentiating benign from malignant lesions.

Results

The new HDMI biomarkers, mvFD, BA, MD and SVP were statistically significantly different in malignant and benign lesions, regardless of tumor size. Sensitivity and specificity of the new biomarkers in lesions >20mm were 95.6% and 100%, respectively. Combining the new and initial biomarkers together showed an AUC, sensitivity, and specificity of 97% (95% CI: 95%-98%), 93.8%, 89.2%, respectively for all lesions regardless of mass size. The classification was further improved by adding the BI-RADS score to the prediction model, showing an AUC, sensitivity and specificity of 97% (95% CI: 95%-98%), 93.8%, 89.2%, respectively.

Conclusion

The addition of new quantitative HDMI biomarkers significantly improved the accuracy in breast lesion characterization when used as a complementary imaging tool to the conventional ultrasound.

Keywords: breast cancer, contrast-agent free method, neovascularization, quantitative biomarkers, ultrasound

Introduction

Invasive breast carcinoma is an angiogenesis-dependent malignancy and studies have indicated that an increased tumor microvessel density is associated with poor prognosis [1; 2]. Importantly, blood vessels in malignant tumors are extremely heterogeneous and very different from vessels found in normal tissues or benign tumors. Poor oxygen levels in early emerging tumors stimulate the release of vascular endothelial growth factors (VEGF), which initiates new vascularization and tumor growth [2; 3]. In turn, the demand for additional oxygen in growing tumors leads to formation of leaky, fragile, tortuous vessels [4]. In contrast, in most benign cases, tumor growth is controlled by mechanisms similar to those of normal tissue, leading to the creation of organized and non-tortuous vessel shapes [4; 5].

Conventional Doppler methods with differentiating potential in breast masses [6-10] are sensitive only to fast flows, leading to highly fragmented and patchy images of the underlying vessels, preventing structural analysis of microvessels. The utility of photoacoustic imaging approaches has been shown for microvessel architectural differences in superficial breast lesions [11], but has limited use in deep-seated tumors. Contrast-enhanced US has been investigated for increasing the specificity of ultrasound for differentiation of benign and malignant breast masses [12; 13]. Acoustic angiography and ultrasound localization microscopy [14-16], with the help of contrast agents, could resolve microvessels in preclinical studies [17].

Recently, obtaining fine vascular features of breast tumors at super-resolution scales was possible in a spontaneous mouse model of breast cancer [18] and in human [19], but this approach is associated with inconvenience and increased cost associated with injection of contrast agents. Contrast-free ultrasound imaging of tumor microvessels for differentiation malignant from benign breast masses has been investigated, however, these efforts were limited to a pixel count method and visual inspection of images for the assessment of vessel shapes and distribution[20-22]. To address these research gaps, we have previously developed a contrast-free ultrasound-based technology to visualize small sub-millimeter vessels (as small as 300 μm) and quantify tumor microvessel morphological structures, named quantitative high-definition microvasculature imaging (qHDMI) [23; 24]. The objective of this research is to complement the gray scale morphology-based assessment of conventional ultrasound with the microvasculature features of breast tumor for increased accuracy in cancer detection.

Recently, the basic principles of 4 new quantitative biomarkers based on microvessel images, as well as some simulations and a limited patient study results, were presented to illustrate the role of each biomarker [25]. The four biomarkers are: 1) microvessel fractal dimension, 2) Murray’s deviation, 3) Bifurcation angle (BA) and 4) spatial vascular pattern [25]. The goal of this study is to investigate the performance of the four newly developed HDMI quantitative biomarkers on a relatively large population. Thus, more lesion categories allowed us to investigate the performance of HDMI individual biomarkers and the combination of them in a multivariable analysis for different pathologies and different lesion size groups. The study also tests the performance of multiple prediction models, using only new biomarkers, only initial biomarkers, combination of new and initial with or with or without BI-RADS scores. Furthermore, the correlation of HDMI biomarkers with cancer grades has been investigated. As such, the current validation study substantially expands the previous works. The proposed method objectively classifies the tumor in benign or malignant, which makes this method operator independent and eliminate the observer/reader variability for a reliable clinical use.

Materials and methods

Participants

We received institutional review board approval in compliance with the Health Insurance Portability and Accountability Act. A signed written informed consent with permission for publication was obtained from each enrolled participant prior to the prospective study. Patients were prospectively enrolled at the Department of Radiology, Breast imaging Division. From June 2016 to April 2021, 530 patients with ultrasound-identified suspicious breast masses indicated for biopsy were consecutivelyenrolled for the study. As expected, most cases were classified as BI-RADS scores 4 and 5, those patients with BI-RADS 2 and 3 included in this study all underwent biopsy because of the risk factors such as the history of breast cancer in first-degree family member and the will of the patient for biopsy. Details of participant selection, inclusion and exclusion criteria are provided in Figure 1. Lesions were assigned BI-RADS assessments by different radiologists and the investigative team was blinded to these assessments during the investigation. HDMI results were not used for the clinical decision for the enrolled patients. In total, 521 participants with 527 lesions were included in this HDMI study. Demographic characteristics are shown in Table 2. After HDMI research examination, all patients underwent core needle biopsy within an hour, from which histopathological results served as the gold diagnostic standard. The results of HDMI were not available to the pathologist who assessed and reported the breast biopsy. The pathology results of core-needle biopsy rather than the surgical pathology served as the gold reference standard because: 1) surgical pathology is not available in benign lesions as benign lesion does not normally have surgical excision for treatment; 2) there is no cancer for patients who are complete pathological responders to neoadjuvant therapy.

Figure 1.

Figure 1.

Flow chart for the study participants. *9 patients were excluded from HDMI study because the lesions were lymph nodes. #BI-RADS 2 and 3 were biopsied due to patient preference. HDMI = high-definition microvasculature imaging.

Table 2.

Demographic and lesion characteristics

Benign Malignant Statistical significance (P value)
Gender (F/M) 316/0 211/1 NA
Age (y) 49±15 (18-88) 61±12 (27-89) <0.0001
Mass Size (mm) 14±8.6 (4-60) 18.5±11.9 (5-72) <0.0001
BI-RADS <0.0001
  2 2 0
  3 17 0
  4 287 115
  5 10 96

Mean values of age and tumour size are shown with standard deviations and minimum–maximum intervals in parentheses. Statistical comparison of age, mass size and BI-RADS between benign and malignant groups was performed using a Wilcoxon rank sum test (last column), a P value < 0.05 was considered to reflect statistical significance.

High-definition Microvasculature Imaging and Quantitative Biomarkers

The ultrasound examinations were performed by two sonographers with more than 30 and 15 years of US scanning experience, respectively. The sonographers were instructed minimize the preload to reduce unwanted pressure on the tissue microvessels. To reduce motion artifacts, patients were instructed stay still and suspend respiration for approximately 3 seconds during data acquisition. To increase reproducibility, 2 acquisitions at each scan orientation were acquired. For each participant, only one of the two sonographers conducted the HDMI scanning.

Using an ultrasound platform with capability of plain wave imaging (Alpinion Ecube12-R, ALPINION Medical Systems, Seoul, South Korea), and a linear array L3-12H operating at 8.5 MHz, breast lesions were identified on plane-wave B-mode. Then a sequence of high frame rate data (at ~600 frames per second) was acquired on the lesion site. This ultrasound system provides a sequence of frames in the form of raw in-phase and quadrature beamformed data for a total duration of 3 seconds. Each frame of the data was formed using 5-angle coherent plane-wave compounding [26]. The methods for obtaining HDMI images, vessel extraction and steps for vessel segmentation [23; 24] have been detailed in supplemental material, available online.

Definitions and calculations of the new biomarkers: 1) Microvessel fractal dimension (mvFD), [25; 27; 28], 2) Bifurcation angle (BA) [25; 29; 30], 3) Murray’s deviation (MD) [25; 31; 32], 4) and Spatial vascularity pattern (SVP) [25; 33] calculated by vessel density ratio (VDR) [34] as well as initial biomarkers[24] are detailed in Table 1 and Supplementary material.

Table 1.

HDMI quantitative biomarkers

Biomarkers Definition and calculation
Initial HDMI biomarkers
 NB Numbers of branch points: defined as any node that connected to three or more vessel segments [24].
 NV Number of vessel segments
 VD Vessel density: defined as the proportion of vessel area with blood flow over the total area measured [24].
 D (mm) Vessel diameter (Dmean, Dmax): defined as two times of the minimum distance between the vessel centerline and the vessel border ([24].
 DM Distance metric (DMmean, DMmax): defined as the ratio between the actual path length of a meandering curve (vessel) and the linear distance between the two end points [24]. Distance metric measures vascular tortuosity.
Novel HDMI biomarkers
 MD Murray’s deviation: diameter mismatch, defined as the deviation from Murray's law, increases in the vasculature network of malignant tumors Using skeleton image, the diameters of sub-vessels were used to define mother vessel (the sub-vessel with the largest diameter) and daughter vessels (the remaining sub-vessels).MD was Calculated Using MD = Dmother3Ddaughter3Dmother3. If NB = 0, MD = 1 [25; 31; 32].
 mvFD Microvessel fractal dimension: A unit-less geometrical feature is a marker of microvascular complexity. Can be calculated using the Box counting method. Knowing the box size, s, and the number of boxes, Ns, to cover all the vessels, the mvFD can be calculated, mvFD = lims0logNslog1s, to identify the structural complexity of tumor vessels [25; 27; 28].
 BA (°) Bifurcation angle: refers to the angle between two daughter vessels Two straight lines were generated by fitting two daughter vessels, and the angle between them is calculated as BA [25; 29; 30]. If NB = 0, BA = 180°.
 VDR Vessel density ratio (VDR): tumor vessel distributions at the periphery (VDR<1), or at the center (VDR>1) or both (VDR ≈ 1) VDR = VDR=Vessel DensitycenterVessel Densityperipheral [34].
 SVP Spatial vascularity pattern: the distribution pattern of microvessels, either concentrated peripherally (peritumoral vascularization) or inside the lesion (intratumoral vascularization. SVP is calculated by VDR. If VDR < 1, SVP = 0, meaning a more peripherally concentrated vessel. distribution. If VDR > 1, SVP = 1, meaning a more centrally concentrated vessel distribution [25; 33].

Clinical pathologic data (Please see supplemental Materials)

Data Analysis

For each image, a statistical distribution of the new and initial HDMI biomarkers was obtained. Using pathology results as the gold standard, vessel morphological features were tested for statistical significance in differentiating between benign and malignant lesions using receiver operating characteristics (ROC) analysis. For each new biomarker, error bar plots with 95% confidence intervals (CI) were obtained for different lesion size constraints. Specificity, sensitivity, area under the curve (AUC) and 95% CI were obtained. Statistical significance analyses were performed using a Wilcoxon rank-sum test using R (version 3.6.2, Boston, MA), with a p-value < 0.05 considered significant. The correlation between two biomarkers were calculated using the cor function with the pearson method. In addition to analyzing the performance of individual biomarkers, a multivariable logistic regression analysis was done to study the performance of the combination of all new and initial HDMI biomarkers in differencing lesions. Further, BI-RADS with US descriptors [36; 37], used to categorize breast lesions to select candidates for biopsy, were included in our analysis to determine the added value of quantitative HDMI for increased detection accuracy. The malignancy probability was The malignancy probability was calculated with the equation: probability = logit1(B+i=1mCmPm), where B is a constant obtained from the multi-variable logistic regression analysis, Pm is the quantitative HDMI biomarker, or the BI-RADS score, and Cm is the coefficient for the corresponding quantitative biomarker obtained from the multi-variable logistic regression analysis, m is the number of quantitative biomarkers included in the prediction model and the logistic function logit−1 is defined as logit−1(α) = 1/(1 + exp (−α)).

Results

Of a total of 527 breast lesions examined by HDMI, 316 were benign and 211 were malignant. Table 2 shows the participant demographic and lesion characteristics. The distribution of lesion types by pathology are summarized in Table 3. The most common benign histologic type was fibroadenoma. As expected, invasive primary breast carcinoma comprised most of the malignant tumors, with 66% as invasive ductal carcinoma (IDC). The Nottingham grades of each invasive breast cancer type are provided in Table 3.

Table 3.

Distribution of lesion types by pathology in total of 527 breast lesions

Breast lesions lesion number Percentage
Total breast lesions 527 NA
  Total benign lesions 316 60% (316/527)
  Fibroadenoma 114 36% (114/316)
  Benign changes/stromal fibrosis 77 24% (77/316)
  Fibrocystic changes 31 10% (31/316)
  Papilloma 28 9% (9/316)
  Pseudoangiomatous stromal hyperplasia 22 7% (22/316)
  Fat necrosis 18 6% (6/316)
  Atypiaa 14 4% (14/316)
  Duct ectasia 6 2% (6/316)
  Adenosis 4 1% (4/316)
  Othersb 2 1% (2/316)
Total malignant lesions 211 40% (211/527)
  Primary breast carcinomas 209 99% (209/211)
  Invasive ductal carcinoma 138 66% (138/209)
  Invasive mammary carcinoma with mixed ductal and lobular features 30 14% (30/209)
  Invasive lobular carcinoma 26 12% (26/209)
  Ductal carcinoma in situ 15 7% (15/209)
  Non-mammary malignancies in breast 2 1% (2/211)
  Malignant grade for invasive breast carcinomas 194
  Grade I 50 26% (50/194)
  Grade II 92 47% (92/194)
  Grade III 52 27% (52/194)
  Malignant grade for ductal carcinoma in situ 15
  Low grade 7 46% (7/15)
  Intermediate grade 4 27% (4/15)
  High grade 4 27% (4/15)
a

Atypia: 8 atypical ductal hyperplasia, 2 atypical lobular hyperplasia, 2 atypical papillary lesion, 1 radial scar with focal residual atypical hyperplasia associated with flat epithelial atypia and 1 atypical/high risk and fibrocystic changes.

b

Others: 1 ductal hyperplasia and 1 organizing abscess with associated granulomatous reaction. Number in parentheses represent the numerator and denominator for the corresponding percentage.

Figure 2 is a visual presentation of the HDMI images of malignant and benign breast lesions in comparison with conventional Doppler. While conventional Doppler images showed slightly higher blood activity in the form of patchy and large vessels in the malignant cases, HDMI provided high-definition images of both increased peripheral and internal microvascularity with higher complexity than seen in benign masses with noticeably fewer microvessels and less complex morphology. This increased sensitivity and enhanced image resolution of HDMI enabled additional quantitative analysis of vessel morphological features by extracting vessel skeleton and branching into vessel segments, leading to a classification power of HDMI biomarkers as seen in the statistical results.

Figure 2.

Figure 2.

Representative cases of tumor vasculature images using different imaging methods Regular Color Doppler (1st row row), overlay HDMI on B-mode (2nd row), and the HDMI of the breast mass (3rd row). The representative new and initial biomarkers are shown at the left side for each HDMI image (3rd row). The two columns on the left represent two malignant breast masses (M1 and M2), and the two columns on the right represent benign breast lesions (B1 and B2). The histological results for both malignant cases (M1 and M2) are reported as invasive mammary carcinoma with mixed ductal and lobular features, Grade III, and invasive ductal carcinoma Grade III, respectively. The biopsy results for the benign cases (B1 and B2) are indicated as benign fibroadenoma. The reference clinical Doppler images shown on row 1, were acquired in a clinical setting by a different sonographer using a clinical ultrasound scanner different from the research ultrasound platform used by the investigative team.

Statistical results of HDMI biomarkers

Each new HDMI biomarker shows statistically significant differences (P<0.05) between malignant and benign in different size groups (Figure 3). In the analyses of HDMI biomarkers for different pathological grades of malignant tumors, low SVP factor was noted in grade III malignant breast tumors, which includes larger size tumors with higher vessel density in the peritumoral area. Moreover, higher values of mvFD, NV, NB, and Dmax (all P < 0.05) were seen in IDC, NG grade III (Figure 4). The performance of all new and initial HDMI biomarkers for lesion classification in terms of sensitivity, specificity, PPV, NPV, AUC, 95% CI, and p-value are shown in the Supplementary Table, available online.

Figure 3.

Figure 3.

Error-bar plots for differentiation of benign and malignant breast lesions in different lesion size groups using new biomarkers: (A) mircovessel fractal dimension (mvFD), (B) maximum Murray’s Deviation, (C) maximum bifurcation angle (BA), (D) vessel density ratio (VDR), and initial biomarkers: (E) number of vessel segments (NV), (F) vessel density (VD), (G) number of branch points (NB) and (H) maximum distance metric (DMmax, tortuosity metric). d=lesion diameter, * p < 0.05, ** p < 0.01, *** p < 0.001. No constraint: Benign (n=316), Malignant (n=211); d < 10 mm, Benign (n=103), Malignant (n=50); 10≤d≤20 mm, Benign (n= 152), Malignant (n=93); d >20 mm, Benign (n=61), Malignant (n=68).

Figure 4.

Figure 4.

Error-bar plots of HDMI biomarkers for differentiation of invasive breast cancer grade: (A) mircovessel fractal dimension (mvFD), (B) number of branch points (NB), (C) number of vessel segments and (NV), (D) maximum diameter (Dmax). * p < 0.05, ** p < 0.01, *** p < 0.001, **** p < 0.0001. HDMI = high-definition microvasculature imaging.

The performance of HDMI biomarkers for predicting the immunohistochemical (IHC) biomarkers, as well as the molecular subtypes are summarized in Table 4. Significant differences were found for FD, NV and NB for predicting the PR status, HER2 status, and Ki-67, with PR positive presented significantly lower FD, NV and NB values, while HER2 positive showed significantly higher values. BAmean, NV and NB showed significances in predicting the molecular subtypes. Among the five subtypes, Luminal A subtype showed the smallest NV and NB values.

Table 4.

Diagnostic performance of HDMI biomarkers for predicting the status of ER, PR, HER2, Ki-67 and molecular subtypes in malignant masses.

Immunohistochemical
biomarkers
BAmean ap
value
FD ap value NV ap
value
NB ap
value
ER 0.141 0.259 0.950 0.908
 Negative (25) 68.3±45.2 1.2±0.3 13.6±12.3 6.2±5.8
 Positive (159) 80.6±44.1 1.1±0.2 14.0±14.6 6.6±7.9
PR 0.711 0.020 0.019 0.026
 Negative (38) 80.6±40.7 1.2±0.3 18.6±14.9 8.6±7.8
 Positive (146) 78.5±45.4 1.1±0.2 12.7±14.0 6.0±7.6
HER2 0.393 0.036 0.004 0.016
 Negative (159) 77.1±40.1 1.1±0.2 12.6±13.6 5.9±7.3
 Positive (25) 90.6±30.1 1.2±0.2 22.4±16.3 10.4±9.2
Ki-67 0.209 0.036 0.001 0.004
 <0.14 (113) 75.7±46.0 1.2±0.2 12.4±14.2 5.8±7.4
 ≥0.14 (71) 84.1±41.4 1.1±0.3 16.4±14.2 7.7±8.0
Subtypes 0.047 0.776 0.018 0.050
 Luminal A (77) 74.3±47.5 1.1±0.2 11.2±14.1 5.3±7.5
 Luminal B (HER2+) (61) 84.5±44.2 1.1±0.2 14.3±13.3 6.7±7.4
 Luminal B (HER2−) (21) 92.4±24.7 1.2±0.3 23.7±16.6 11.1±9.6
 HER2+ (4) 81.1±54.8 1.2±0.2 15.8±14.5 7.3±6.4
 TN (21) 65.8±44.3 1.2±0.3 13.2±12.2 5.9±5.9

Number in parentheses are lesion numbers.

a

A p value smaller than 0.05 indicates significance.

Table 5 explains the relationship between different HDMI parameters. A correlation coefficient smaller than 0.45 indicates that a low correlation relationship (marked with * in Table 5). In other words, they are less dependent on each other; therefore, their contributions are added in predicting the diagnosis of breast cancer. Among the new biomarkers, FD has low correlation with BAmean or MDmean. Among the initial biomarkers, τmean has low correlation coefficient with other initial biomarkers. The new biomarkers BAmean and MDmean have low correlations with all the initial biomarkers.

Table 5.

Summary of the correlation coefficients between the HDMI biomarkers

BAmean MDmean FD τ Dmean NB NV VD
BAmean 1 ∐0.643 −0.257* −0.111* −0.224* −0.102* −0.107* −0.164*
MDmean 1 0.259* 0.088* 0.181* 0.144* 0.160* 0.167*
FD 1 0.324* 0.678 0.596 0.634 0.724
τmean 1 0.340* 0.147* 0.162* 0.303*
D 1 0.284* 0.316* 0.511
NB 1 0.956 0.693
NV 1 0.684
VD 1

HDMI = high-definition microvasculature imaging. Negative correlation coefficient indicates an inverse correlation.

The summary of logistic regression multivariable analysis results in differentiating benign from malignant groups for the new and initial HDMI biomarkers alone as well as the combination of new and initial are shown in Figure 5. New HDMI biomarkers outperformed the initial biomarkers for classification of breast masses in all lesions regardless of size, showing an AUC 93.0% (95% CI: 91%-95%) with sensitivity and specificity of 83.4% and 88.6%, respectively. The best performance was observed in the group of lesions larger than 20mm, showing an AUC 98.5% (95% CI: 97%-100%), sensitivity of 95.6% and specificity of 100.0%. The AUC ranged from 93% to 99% depending on the size constraints. Figure 5 also includes the ROC curves for all lesions in different size constraints using new and initial HDMI biomarkers alone and combined. A similar multivariable logistic regression analysis was done by including the BI-RADS score [36] as an additional parameter, showing an AUC, sensitivity and specificity of 97% (95% CI: 95%-98%), 93.8%, 89.2%, respectively for all lesion regardless of mass size. The best classification was achieved in lesions larger than 20 mm, showing an AUC, sensitivity, and specificity of 99.5% (95% CI: 99%-100%), 100%, and 96.7%, respectively.

Figure 5.

Figure 5.

Summary of logistic regression multivariable analysis and ROC curves for differentiating between benign and malignant in different size groups using new/ initial HDMI biomarkers and combined new/ initial ± BI-RADS. (B (Benign), M (Malignant), Sen (Sensitivity), Sp (Specificity), PPV (Positive Predictive Value), NPV (Negative Predictive Value), AUC (Area under Curve), CI (Confidence Interval), BI-RADS (Breast Imaging Reporting and Data System). The numbers for Sen, Sp, PPV, NPV, AUC and CI are given in percentile.) ROC curves for New HDMI Biomarkers, Initial HDMI Biomarkers, Combined HDMI Biomarkers, Combined Biomarkers With BI-RADS.

We have shown six representative cases in 3 pair- images of benign and malignant breast masses with the values of new biomarkers in bar graph and comparative images in Figure 6. These results are detailed in supplementary materials available online. The combined HDMI biomarkers (initial and new) were also tested on two major benign and malignant histological types with the highest sample size in our study, fibroadenoma (n=114) and invasive ductal carcinoma (n=138). The ROC analysis resulted an area under ROC curve of 97.1%, a sensitivity of 95.5% and a specificity of 98.7% (Figure B-Suppl, please see Supplementary material, available online).

Figure 6.

Figure 6.

Representative benign and malignant cases: Groups I and II represent SVP diagrams for microvessel images of breast masses. Group (III) represents mvFD graphs for the microvessel images of a benign and a malignant breast mass.

Group I shows breast masses<10mm (benign, top row and a malignant mass, second row). Panels A1, D1, B1 and E1 are the HDMI images. Panels C1 and F1 show the SVP diagrams, indicating peripherally located vessels in the benign mass and centrally located microvessels in the small malignant mass. Group II shows l breast masses>10mm (fibroadenoma, top of row and invasive poorly differentiated ductal carcinoma, NG Gr. III, at the bottom). Panels A2, D2, B2 and E2 are the HDMI images of group II masses. Panels C2 and F2 are the SVP diagrams showing centrally concentrated vessels in the large benign breast mass and peripherally distributed microvessels in the large malignant mass. Group III shows a benign mass (hyalinized fibroadenoma) and a malignant mass (invasive ductal carcinoma, grade II.). Panels A3, D3, B3 and E3 are the HDMI images. Panel C3 is the mvFD graph indicating the complexity of microvessels in these two masses. This graph shows a remarkable difference in the complexity between the malignant and benign masses. The bar graphs on the right side of Figure 6 show that the value of each of the new HDMI biomarkers (mvFD, BA, MD and VDR (representing SVP)) is remarkably different between the benign and malignant masses in each of the three groups.

Discussion

This study investigated the performance of the novel quantitative biomarkers of contrast-free high-definition microvessel imaging (HDMI) for differentiating malignant and benign breast masses. Our findings show that four new HDMI biomarkers, SVP calculated by VDR, mvFD, BA and MD provided meaningful separation between malignant and benign lesion groups and outperformed our initial biomarkers (vessel diameter, vessel density, tortuosity, number of vessel segments and number of branch points) [24]. The multivariable analysis using a logistic regression classification method with all new biomarkers provided consistently better discrimination performance than any individual biomarker alone. Additionally, the discrimination power improved as tumors grow. The addition of BI-RADS scores based on US descriptors to the multivariable analysis using all biomarkers, remarkably increased the sensitivity, specificity, and AUC in all size groups. This finding suggests that new quantitative HDMI offers complementary diagnostic information to conventional ultrasound for increased accuracy in breast cancer diagnosis. Moreover, an important advantage of this new tool is that it does not require injection of a contrast agent for better vessel enhancement. The envisioned strategy for the clinical use of the quantitative HDMI technique includes the following steps: 1) the ultrasound machine with the associated HDMI processing technique automatically processes the data providing the quantitative biomarkers. 2) The quantitative HDMI biomarkers will be further input to the prediction model implemented in the ultrasound machine to calculate the malignancy probability. 3) Then, the radiologist reads the malignancy probability and compares the value with the threshold for decision making. The clinical application value of this HDMI technology is: 1) if the malignancy probability calculated with the prediction equation is lower than the threshold, the algorithm would be more supportive of follow up. As such, this model could help clinical decision making, possibly downgrading a presumptive BI-RADS 4a lesion to BI-RADS 3 with recommendation for follow-up. 2) If the malignancy probability is higher than the threshold, the algorithm would be supportive of breast biopsy. With additional validation, refinement and testing with multi-center large population studies, the threshold would be further validated.

Few studies have proposed ultrasound microvessel imaging for differentiation of breast masses, either with [19; 22] or without [38] contrast agents, with limited patient studies using a few morphological biomarkers. The current quantitative HDMI study includes a wide range of tumor microvessel morphological biomarkers tested on a relatively large group of patients. An additional advantage is that the enhancement and visualization of tumor vessels at the submillimeter level can be done without the need for contrast agents. Moreover, our method is capable of quantifying vessel diameter, which may be challenging in contrast-enhanced tracking approaches [39].

This research investigates the performance of MD, BA, mvFD and SVP as new morphological biomarkers of tumor microvessels in contrast-free ultrasound microvessel imaging for differentiation of breast lesions. The diagnostic value of MD was demonstrated for different diseases [40-43], indicating that the vascular network of diseased tissue could show a deviation from Murray’s law [44]. Our study also showed a higher MD in malignant breast lesions. Moreover, our study found a statistically significant decrease in BA in malignant breast lesions. Similarly, a decreased BA in invasive carcinomas of the colon has been shown in a previous study [30]. In our study, mvFD, was found to have higher values in malignant compared to benign lesions for all size constraints. This finding is consistent with the results of other studies, indicating that microvascular complexity calculated by mvFD may provide important diagnostic and prognostic information as well as insight into tumor angiogenesis [27; 28]. In our study, the SVP biomarker indicated that peripherally concentrated vascularity in larger tumors (diameter >20 mm) is associated with malignancy; however, in smaller tumors (diameter ≤20 mm), a centrally concentrated vascularity is an indicator of malignancy. This finding is also consistent with other studies suggesting that small malignant tumors have few large vessels in the periphery, but as the tumor enlarges, the vessel density decreases in the central area and the microvessels tend to have more peripheral distribution [4; 45; 46]. If there are no or few microvessels within the lesion, the quantitative HDMI could classify the lesion as benign.

In this study, Dmax was statistically significantly higher in malignant lesions compared to benign masses. In fact, using Dmax, one can test the possibility of a major feeding vessel that may be indicative of malignancy. This result is consistent with the fact that VEGF-A forms numerous larger blood vessels (presumably mother vessels) in the periphery of malignant tumors, but fewer and smaller vessels in the central part of the tumor [4; 45; 47]. Therefore, maximum vessel diameter has a better discriminatory power than averaging the diameter of the vessels. A similar observation was also made for vessel tortuosity. With tortuosity averaged over the entire vascular bed, there were no statistically significant differences between malignant and benign in all size groups; however, the maximum vessel tortuosity was statistically significantly higher in the malignant cases compared to the benign cases. These findings concur with the fact that, as a malignant tumor enlarges, more tortuous vessels with increased diameter are seen at the tumor-host interface than in the central region [4], indicating that averaging these biomarkers has less diagnostic value than determining their maxima. This indicates that vessel tortuosity analysis can offer information complementary to flow imaging and may offer additive value in discrimination when both benign and malignant tumors are hypervascular [48]. The increased numbers of branch points and vessel segments in our study signify a greater level of vessel sprouting, endorsing them as discriminators of benign and malignant tumors [49].

Additionally, HDMI biomarkers were statistically significantly different between higher and lower NG grades of malignant breast tumors. Higher values of mvFD, a marker of vessel complexity, NB, NV and VD were seen in the higher grades of breast carcinomas. Previous studies reported a higher microvessel density, sprouting and structural irregularity associated with higher pathological grades of breast carcinomas that may lead to higher incidences of metastasis and a poorer prognosis [28; 50; 51].

One limitation in this study is that the quantitative biomarkers were estimated using 2D HDMI which may overlook some important 3-dimensional (3D) morphological features and the connectivity of tumor microvessels, potentially leading to either underestimation or overestimation of these features. To address these limitations, a complementary study would involve quantitative 3D HDMI imaging and morphometric analysis using either a mechanical scanning system equipped with a linear array [52], or using a matrix ultrasound transducer [53] for volumetric imaging. Such approaches would enable a more comprehensive vessel morphological analysis. To keep a single gold reference standard for all patient, the pathology results of core-needle biopsy rather than the surgical pathology served as the gold reference standard. As surgical pathology is not available in benign lesions who do not normally have surgical excision for treatment and in the group of complete pathological responders to neoadjuvant therapy will be no cancer. However, the histological features of cancer in core needle biopsy were the same as with surgical pathology.

Future work should also focus on using the emerging radiomic analysis approach by incorporating a data characterization algorithm to extract numerous features from images. Although radiomic analysis has its own challenges [54], it may have the potential to facilitate improved clinical decision making [55]. Another direction for improving diagnostic performance of ultrasound is to combine our microvasculature morphometric analysis with established conventional ultrasound metrics. Conventional ultrasound provides information about the shape and texture of a breast lesion to aid in cancer detection, while our quantitative microvasculature method provides information related to angiogenesis. Combining these two pieces of information may improve the overall diagnostic performance of ultrasound. The HDMI study was performed on patients with suspicious breast lesions detected by clinical ultrasound and scheduled for biopsy. Nearly all cases were classified as BI-RADS 4 and 5. Therefore, we believe it would not be fair to compare the sensitivity and specificity of our method to conventional ultrasound since limited numbers of BI-RADS categories lower than 4 were included in our study. A future study could include microvasculature morphometric analysis of breast lesions regardless of their BI-RADS category, with the caveat that cases in lower BI-RADS categories will not have pathology results for comparison. The focus of the present study is to validate the performance of the new HDMI biomarkers for breast lesion differentiation on a large patient population. For future studies, we would like to compare the performance of HDMI to other diagnostic methods, e.g., B-Mode, color Doppler, and the contrast-enhanced ultrasound.

In conclusion, the efficacy of the four novel quantitative biomarkers HDMI method for breast cancer detection is promising. The fact that HDMI does not require injection of a contrast agent simplifies its use in routine clinical practice. In the future, the proposed method with new biomarkers can offer a new means of detecting breast cancer when used as a complementary imaging tool to conventional ultrasound.

Supplementary Material

Supplementary file
supplemental table

Key points.

  • Novel quantitative biomarkers extracted from tumor microvessel images increase the sensitivity and specificity in discriminating malignant from benign breast masses.

  • New HDMI biomarkers Murray’s deviation, bifurcation angles, microvessel fractal dimension and spatial vascularity pattern outperformed the initial biomarkers.

  • The addition of BI-RADS scores based on US descriptors to the multivariable analysis using all biomarkers, remarkably increased the sensitivity, specificity, and AUC in all size groups.

Funding

This work was supported by grants from the National Cancer Institute at the National Institutes of Health, R01CA239548 and R01CA195527 (A. Alizad and M. Fatemi), R01CA168575 (M. Fatemi). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. The NIH did not have any additional role in the study design, data collection and analysis, decision to publish or preparation of the manuscript.

Abbreviations

AUC

Area under the curve

BA

Bifurcation angle

CI

Confidence interval

DM

Distance metric

HDMI

High-definition microvasculature imaging

IDC

Invasive ductal carcinoma

mvFD

Microvessel fractal dimension

NG

Nottingham

NB

Number of branch points

NV

Number of vessel segments

ROC

Receiver operating characteristics

SVP

Spatial vascularity pattern

VD

Vessel density

VEGF

Vascular endothelial growth factors

References

  • 1.Nakamura Y, Yasuoka H, Tsujimoto M et al. (2003) Flt-4-positive vessel density correlates with vascular endothelial growth factor-d expression, nodal status, and prognosis in breast cancer. Clinical Cancer Research 9:5313–5317 [PubMed] [Google Scholar]
  • 2.Longatto Filho A, Lopes JM, Schmitt FC (2010) Angiogenesis and breast cancer. Journal of oncology 2010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Carmeliet P, Jain RK (2000) Angiogenesis in cancer and other diseases, nature 407:249. [DOI] [PubMed] [Google Scholar]
  • 4.Nagy J, Chang S, Dvorak A, Dvorak H (2009) Why are tumour blood vessels abnormal and why is it important to know? British journal of cancer 100:865. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Fukumura D, Duda DG, Munn LL, Jain RK (2010) Tumor microvasculature and microenvironment: novel insights through intravital imaging in pre-clinical models. Microcirculation 17:206–225 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Busilacchi P, Draghi F, Preda L, Ferranti C (2012) Has color Doppler a role in the evaluation of mammary lesions? Journal of ultrasound 15:93–98 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Chang Y-C, Huang Y-H, Huang C-S, Chang R-F (2012) Vascular morphology and tortuosity analysis of breast tumor inside and outside contour by 3-D power Doppler ultrasound. Ultrasound in medicine & biology 38:1859–1869 [DOI] [PubMed] [Google Scholar]
  • 8.Lee SW, Choi HY, Baek SY, Lim SM (2002) Role of color and power Doppler imaging in differentiating between malignant and benign solid breast masses. Journal of clinical ultrasound 30:459–464 [DOI] [PubMed] [Google Scholar]
  • 9.Davoudi Y, Borhani B, Rad MP, Matin N (2014) The role of Doppler sonography in distinguishing malignant from benign breast lesions. Journal of Medical Ultrasound 22:92–95 [Google Scholar]
  • 10.Raza S, Baum JK (1997) Solid breast lesions: evaluation with power Doppler US. Radiology 203:164–168 [DOI] [PubMed] [Google Scholar]
  • 11.Yamaga I, Kawaguchi-Sakita N, Asao Y et al. (2018) Vascular branching point counts using photoacoustic imaging in the superficial layer of the breast: A potential biomarker for breast cancer. Photoacoustics 11:6–13 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Lee SC, Tchelepi H, Grant E et al. (2019) Contrast-enhanced ultrasound imaging of breast masses: adjunct tool to decrease the number of false-positive biopsy results. Journal of Ultrasound in Medicine 38:2259–2273 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Du Y-R, Wu Y, Chen M, Gu X-G (2018) Application of contrast-enhanced ultrasound in the diagnosis of small breast lesions. Clinical hemorheology and microcirculation 70:291–300 [DOI] [PubMed] [Google Scholar]
  • 14.Gessner RC, Aylward SR, Dayton PA (2012) Mapping microvasculature with acoustic angiography yields quantifiable differences between healthy and tumor-bearing tissue volumes in a rodent model. Radiology 264:733–740 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Gessner RC, Frederick CB, Foster FS, Dayton PA (2013) Acoustic angiography: a new imaging modality for assessing microvasculature architecture. Journal of Biomedical Imaging 2013:14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Errico C, Pierre J, Pezet S et al. (2015) Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging. nature 527:499. [DOI] [PubMed] [Google Scholar]
  • 17.Opacic T, Dencks S, Theek B et al. (2018) Motion model ultrasound localization microscopy for preclinical and clinical multiparametric tumor characterization. Nature communications 9:1527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Shelton SE, Stone J, Gao F, Zeng D, Dayton PA (2020) Microvascular ultrasonic imaging of angiogenesis identifies tumors in a murine spontaneous breast cancer model. International Journal of Biomedical Imaging 2020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Christensen-Jeffries K, Couture O, Dayton PA et al. (2020) Super-resolution ultrasound imaging. Ultrasound in medicine & biology 46:865–891 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Gong P, Song P, Huang C et al. (2019) Ultrasensitive Ultrasound Microvessel Imaging for Characterizing Benign and Malignant Breast Tumors. Ultrasound in medicine & biology 45:3128–3136 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Park AY, Seo BK, Han M-R (2021) Breast ultrasound microvascular imaging and radiogenomics. Korean Journal of Radiology 22:677. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Xiao X-y, Chen X, Guan X-f, Wu H, Qin W, Luo B-m (2016) Superb microvascular imaging in diagnosis of breast lesions: a comparative study with contrast-enhanced ultrasonographic microvascular imaging. The British journal of radiology 89:20160546. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Bayat M, Fatemi M, Alizad A (2018) Background removal and vessel filtering of noncontrast ultrasound images of microvasculature. IEEE Transactions on Biomedical Engineering 66:831–842 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Ghavami S, Bayat M, Fatemi M, Alizad A (2020) Quantification of Morphological Features in Non-Contrast-Enhanced Ultrasound Microvasculature Imaging. IEEE Access 8:18925–18937 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Ternifi R WY, Polley EC, Fazzio RT, Fatemi M, and Alizad A (2021) Quantitative Biomarkers for Cancer Detection Using Contrast-Free Ultrasound High-Definition Microvessel Imaging: Fractal Dimension, Murray’s Deviation, Bifurcation Angle & Spatial Vascularity Pattern. IEEE transactions on medical imaging Early Access:1–10 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Bjaerum S, Torp H, Kristoffersen K (2002) Clutter filter design for ultrasound color flow imaging. IEEE transactions on ultrasonics, ferroelectrics, and frequency control 49:204–216 [DOI] [PubMed] [Google Scholar]
  • 27.Sabo E, Boltenko A, Sova Y, Stein A, Kleinhaus S, Resnick MB (2001) Microscopic analysis and significance of vascular architectural complexity in renal cell carcinoma. Clinical Cancer Research 7:533–537 [PubMed] [Google Scholar]
  • 28.Chen C, He Z-c, Shi Y et al. (2018) Microvascular fractal dimension predicts prognosis and response to chemotherapy in glioblastoma: an automatic image analysis study. Laboratory Investigation 98:924–934 [DOI] [PubMed] [Google Scholar]
  • 29.Ziyrek M, Sertdemir AL, Duran M (2020) Effect of Coronary Artery Bifurcation Angle on Atherosclerotic Lesion Localization Distance to the Bifurcation Site. Journal of the Saudi Heart Association 32:399. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Konerding M, Fait E, Gaumann A (2001) 3D microvascular architecture of pre-cancerous lesions and invasive carcinomas of the colon. British journal of cancer 84:1354–1362 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Taber LA, Ng S, Quesnel AM, Whatman J, Carmen CJ (2001) Investigating Murray's law in the chick embryo. Journal of biomechanics 34:121–124 [DOI] [PubMed] [Google Scholar]
  • 32.Secomb TW, Dewhirst MW, Pries AR (2012) Structural adaptation of normal and tumour vascular networks. Basic & clinical pharmacology & toxicology 110:63–69 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Caresio C, Caballo M, Deandrea M et al. (2018) Quantitative analysis of thyroid tumors vascularity: A comparison between 3-D contrast-enhanced ultrasound and 3-D Power Doppler on benign and malignant thyroid nodules. Medical physics 45:3173–3184 [DOI] [PubMed] [Google Scholar]
  • 34.Liu H, Jiang Y, Dai Q, Zhu Q, Wang L, Lu J (2014) Peripheral enhancement of breast cancers on contrast-enhanced ultrasound: correlation with microvessel density and vascular endothelial growth factor expression. Ultrasound in medicine & biology 40:293–299 [DOI] [PubMed] [Google Scholar]
  • 35.Goldhirsch A, Wood WC, Coates AS et al. (2011) Strategies for subtypes—dealing with the diversity of breast cancer: highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2011. Annals of oncology 22:1736–1747 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Mendelson EB, Berg WA, Merritt CR (2001) Toward a standardized breast ultrasound lexicon, BI-RADS: ultrasoundSeminars in roentgenology. Elsevier, pp 217–225 [DOI] [PubMed] [Google Scholar]
  • 37.Abdullah N, Mesurolle B, El-Khoury M, Kao E (2009) Breast imaging reporting and data system lexicon for US: interobserver agreement for assessment of breast masses. Radiology 252:665–672 [DOI] [PubMed] [Google Scholar]
  • 38.Yongfeng Z, Ping Z, Wengang L, Yang S, Shuangming T (2016) Application of a novel microvascular imaging technique in breast lesion evaluation. Ultrasound in medicine & biology 42:2097–2105 [DOI] [PubMed] [Google Scholar]
  • 39.Kanoulas E, Butler M, Rowley C et al. (2019) Super-resolution contrast-enhanced ultrasound methodology for the identification of in vivo vascular dynamics in 2D. Investigative radiology 54:500. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Sun M, Lv W, Zhao X et al. (2020) Vascular branching geometry relating to portal hypertension: a study of liver microvasculature in cirrhotic rats by X-ray phase-contrast computed tomography. Quantitative imaging in medicine and surgery 10:116. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Xuan R, Zhao X, Jian J et al. (2019) Phase-contrast computed tomography: A correlation study between portal pressure and three dimensional microvasculature of ex vivo liver samples from carbon tetrachloride-induced liver fibrosis in rats. Microvascular research 125:103884. [DOI] [PubMed] [Google Scholar]
  • 42.Chen X, Dai J, Lin J et al. (2020) Image-based morphometric studies of human coronary artery bifurcations with/without coronary artery disease. Computer Methods in Biomechanics and Biomedical Engineering:1–17 [DOI] [PubMed] [Google Scholar]
  • 43.Schoenenberger AW, Urbanek N, Toggweiler S et al. (2012) Deviation from Murray's law is associated with a higher degree of calcification in coronary bifurcations. Atherosclerosis 221:124–130 [DOI] [PubMed] [Google Scholar]
  • 44.Murray CD (1926) The physiological principle of minimum work applied to the angle of branching of arteries. The Journal of general physiology 9:835–841 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Grunstein J, Masbad JJ, Hickey R, Giordano F, Johnson RS (2000) Isoforms of vascular endothelial growth factor act in a coordinate fashion to recruit and expand tumor vasculature. Molecular and cellular biology 20:7282–7291 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Ferrara KW, Merritt CR, Burns PN, Foster FS, Mattrey RF, Wickline SA (2000) Evaluation of tumor angiogenesis with US: imaging, Doppler, and contrast agents. Academic radiology 7:824–839 [DOI] [PubMed] [Google Scholar]
  • 47.Tozer GM, Akerman S, Cross NA et al. (2008) Blood vessel maturation and response to vascular-disrupting therapy in single vascular endothelial growth factor-A isoform–producing tumors. Cancer research 68:2301–2311 [DOI] [PubMed] [Google Scholar]
  • 48.Bullitt E, Zeng D, Gerig G et al. (2005) Vessel tortuosity and brain tumor malignancy: a blinded study1. Academic radiology 12:1232–1240 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Chappell JC, Wiley DM, Bautch VL (2012) How blood vessel networks are made and measured. Cells Tissues Organs 195:94–107 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Uzzan B, Nicolas P, Cucherat M, Perret G-Y (2004) Microvessel density as a prognostic factor in women with breast cancer: a systematic review of the literature and meta-analysis. Cancer research 64:2941–2955 [DOI] [PubMed] [Google Scholar]
  • 51.Rykala J, Przybylowska K, Majsterek I et al. (2011) Angiogenesis markers quantification in breast cancer and their correlation with clinicopathological prognostic variables. Pathology & Oncology Research 17:809–817 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Demené C, Tiran E, Sieu L-A et al. (2016) 4D microvascular imaging based on ultrafast Doppler tomography. Neuroimage 127:472–483 [DOI] [PubMed] [Google Scholar]
  • 53.Flesch M, Pernot M, Provost J et al. (2017) 4D in vivo ultrafast ultrasound imaging using a row-column addressed matrix and coherently-compounded orthogonal plane waves. Physics in Medicine & Biology 62:4571. [DOI] [PubMed] [Google Scholar]
  • 54.Rizzo S, Botta F, Raimondi S et al. (2018) Radiomics: the facts and the challenges of image analysis. European radiology experimental 2:36. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Gillies RJ, Kinahan PE, Hricak H (2015) Radiomics: images are more than pictures, they are data. Radiology 278:563–577 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary file
supplemental table

RESOURCES