Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2022 Nov 1.
Published in final edited form as: Annu Int Conf IEEE Eng Med Biol Soc. 2021 Nov;2021:2879–2882. doi: 10.1109/EMBC46164.2021.9630278

Improving Minimum Variance Beamforming with Sub-Aperture Processing for Photoacoustic Imaging

Rashid Al Mukaddim 1, Rifat Ahmed 2, Tomy Varghese 3
PMCID: PMC8908882  NIHMSID: NIHMS1782851  PMID: 34891848

Abstract

Minimum variance (MV) beamforming improves resolution and reduces sidelobes when compared to delay-and-sum (DAS) beamforming for photoacoustic imaging (PAI). However, some level of sidelobe signal and incoherent clutter persist degrading MV PAI quality. Here, an adaptive beamforming algorithm (PSAPMV) combining MV formulation and sub-aperture processing is proposed. In PSAPMV, the received channel data are split into two complementary nonoverlapping sub-apertures and beamformed using MV. A weighting matrix based on similarity between sub-aperture beamformed images was derived and multiplied with the full aperture MV image resulting in suppression of sidelobe and incoherent clutter in the PA image. Numerical simulation experiments with point targets, diffuse inclusions and microvasculature networks are used to validate PSAPMV. Quantitative evaluation was done in terms of main-lobe-to-side-lobe ratio, full width at half maximum (FWHM), contrast ratio (CR) and generalized contrast-to-noise ratio (gCNR). PSAPMV demonstrated improved beamforming performance both qualitatively and quantitatively. PSAPMV had higher resolution (FWHM =0.19 mm) than MV (0.21 mm) and DAS (0.22mm) in point target simulations, better target detectability (gCNR =0.99) than MV (0.89) and DAS (0.84) for diffuse inclusions and improved contrast (CR in microvasculature simulation, DAS = 15.38, MV = 22.42, PSAPMV = 51.74 dB).

I. Introduction

Beamforming is a critical building block to ensure high quality photoacoustic imaging (PAI) with linear array clinical and pre-clinical imaging systems. Delay-and-sum (DAS) beamforming is commonly employed and preferred for its low computational complexity and real time capability. However, when DAS beamforming is applied to PAI, the resultant images suffer from resolution degradation and clutter corruption due to off-axis and sidelobe signal contributions [1]. Therefore, alternative beamforming algorithm development has been pursued in the PAI community. Several advanced PAI beamforming algorithms have been reported in literature for example minimum variance (MV) [1], coherence processing [26], delay-multiply-and-sum (DMAS) [79] and machine learning based image reconstructions [1013]. In this paper, we focus on improving the performance of MV for PAI.

MV beamforming calculates optimal aperture weighting using data statistics in aperture domain to reduce contributions from off-axis signals. Park et al. adapted MV beamforming for PAI and demonstrated resolution improvement over DAS [1]. Mozaffarzadeh et al. combined both MV and eigen-based MV with DMAS to improve the resolution of DMAS beamforming [14, 15]. We have previously demonstrated the use of MV for in vivo cardiac PAI [4] and showed that incoherent clutter noise was not suppressed using only MV beamforming. Paridar et al. incorporated a sparse regularization constraint to the MV optimization problem improving performance [16]. Even though MV improves resolution and reduces sidelobes when compared to DAS, some level of sidelobe signals persist. One simple solution is to weight MV images with coherence factor [1, 4, 17, 18]. However, this may not be an ideal solution in low signal-to-noise ratio environments resulting in undesirable PA signal suppression [19]. In this paper, we propose to utilize a recently developed photoacoustic sub-aperture processing (PSAP) method [19] with MV to address the sidelobe corruption problem while preserving resolution improvement obtained with MV.

II. Theoretical Background

A. Delay-and-sum (DAS) Beamforming

Consider, a linear array ultrasound transducer with a M-element aperture that receives PA generated acoustic waves. These are stored in a column vector X(t) after applying element-wise delays, dm for dynamic receive focusing. DAS beamforming defined as weighted sum of vector elements of X(t) represented as below:

DAS(t)=W(t)HX(t) (1)

where, W(t) is the aperture weighting vector and t denotes time-of-arrival which is mapped into imaging depth assuming constant speed of sound in the propagating medium.

B. Minimum Variance (MV) Beamforming

MV beamforming [1, 4, 20] calculates W(t) by minimizing the variance of beamformed signals by solving the following optimization problem:

minW(t)W(t)HR(t)W(t)s.t.W(t)Ha=1 (2)

where, R(t) is the co-variance matrix and a is the steering vector. The solution using a Lagrange multiplier method results in a MV weighting vector:

WMV(t)=R(t)1aaHR(t)1a (3)

In practice, R(t) is replaced with RSA(t) by dividing the full array into overlapping sub-arrays with the sub-array length denoted by S. Finally, MV beamformed image can be represented as follows:

MV(t)=1MS+1s=1MS+1WMV(t)HXs(t) (4)

where, Xs(t) is the sub-array signal vector.

C. Photoacoustic Sub-aperture Processing (PSAP) for Minimum Variance (MV) Beamforming

We first generate two MV beamformed images, MV1(t) and MV2(t) using two non-overlapping sub-apertures having no common elements [19, 21, 22]. Then, 2-D normalized cross-correlation (NCC) between MV1(t) and MV2(t) is performed to separate on-axis main-lobe signals and interfering side-lobe signals. NCC(t) is used to estimate a dynamic weighting matrix, PSAPW(t) using following equation:

PSAPw(t)=max(NCC(t),ε) (5)

where, ε is a minimum NCC threshold value to estimate a weighting matrix having a range of [ε, 1] (ε=0.001, empirically chosen to distinguish between main and side lobe signals). Finally, PSAPw(t) is multiplied with MV(t) resulting in a PSAP MV beamformed image denoted as PSAPMV(t). Here, we design the first sub-aperture with ones and zeros with an alternating pattern of N elements on and N elements off, with the second sub-aperture is complementary to the first one. For comparative studies, PSAP images were also derived using DAS images termed as PSAPDAS(t).

III. Materials and Methods

A. Numerical Simulation Study

The proposed method was validated using numerical simulations with point targets, diffuse inclusion and microvasculature networks. A point target phantom was designed with four 100 μm point targets placed equidistantly starting from a depth of 8 mm with an initial pressure magnitude of 3 Pa. PA channel data were simulated using the k-Wave toolbox [23]. Diffuse inclusion phantom contained two 3 mm-diameter circular targets with random spatial distribution of optical absorbers (299 absorbers/mm2) [24]. For the microvasculature phantom, vascular images collected from the fundus oculi drive [25] were used [19]. For both inclusion and microvasculature simulations, a hybrid simulation framework [4] with MCMatlab [26] and k-Wave [23] toolbox was used. MCMatlab estimated the initial pressure distribution by performing optical simulation while PA channel data were derived using k-Wave. Optical simulation was done to model 95% oxygenated blood using an 850 nm laser irradiation wavelength with target and background absorption coefficients of 5.6 and 0.01 cm−1, respectively. An acoustic receiver with 128-elements (72-μm element width, 18-μm kerf) operating at fc = 21 MHz, 100% fractional bandwidth and 84 MHz sampling frequency was modelled.

B. Algorithm Implementation

DAS beamforming was performed with a 64-element aperture, uniform apodization and f-number of 1. MV beamforming used sub-arrays with length S = 24 and diagonal loading Δ = 1/(100× S) to estimate RSA(t). PSAP parameters used are listed in Table I. Parameters were chosen based on previous studies reported in [19]. Algorithms were run using a GPU and MATLAB Parallel Computing toolbox for accelerated computation.

Table I:

PSAP Parameters

Experiment Parameter Value
Point Target Alternating elements (N) 16-16
NCC Kernel (Wavelength, A-lines) (4.5λ,3)

Diffuse Inclusion Microvasculature Alternating elements (N) 2-2
NCC Kernel (Wavelength, A-lines) (1.5λ,3)

C. Quantitative Performance Analysis

For point target simulations, we computed the main-lobe-to-sidelobe (MLSL) ratio (dB) and full-width-at-half-maximum (FWHM) at −6 dB as follows [19]:

MLSL=20×log10(mmaxmminσn) (6)

where, mmax and mmin denote the maximum and minimum signal amplitude within a target rectangular region-of-interest (ROI) centered on each point (green ROI in Fig. 1 (a)) and σn represents the standard deviation from two noise ROIs (blue ROIs in Fig. 1 (a)) around the target ROI.

Fig. 1.

Fig. 1.

Beamformed images from point target simulation. (a) DAS, (b) MV, (c) PSAPDAS and (d) PSAPMV.

Diffuse inclusion and microvasculature simulations were quantified using contrast ratio (CR) and generalized contrast-to-ratio (gCNR) [27, 28]:

CR=20×log10(mtmb) (7)
gCNR=1j=0Nbin1min{kt(xj),kb(xj)} (8)

where, mt, and mb denote average envelope PA signal amplitudes for target and background ROIs, respectively. For gCNR, kt and kb denote histograms with 1000 bins (Nbin with bin centers indicated by j and chosen empirically) derived from the target and background ROIs (mean ROI size = 838 pixels), respectively.

IV. Results and Discussion

Figures 1 (a)(d) show point target beamformed images with DAS, MV, PSAPDAS and PSAPMV respectively. Note the presence of strong sidelobe signals with DAS. MV reduced sidelobes seen with DAS but does not suppress it completely. Incorporation of PSAP with both MV and DAS provided beamformed images with significant performance improvements over DAS and MV.

Figures 2 (a)(b) show the point spread function (PSF) at a depth of 8 mm and 20 mm, respectively. PSAPMV and PSAPDAS have narrower PSFs with lowest sidelobe level. Tables II and III summarize the results for MLSL and FWHM comparison. Improvement in lateral resolution (lowest FWHM) and sidelobe reduction (highest MLSL) was achieved using PSAPMV.

Fig. 2.

Fig. 2.

Lateral PSF at depths of (a) 8 and (b) 20 mm, respectively.

Table II:

MLSL (dB) Results

DAS MV PSAPMV PSAPDAS
8 mm 41.15 50.84 84.63 67.98
12 mm 38.16 47.40 107.85 65.97
16 mm 35.91 46.89 100.12 65.62
20 mm 33.82 42.26 95.05 66.92

Table III:

FWHM (mm) Results

DAS MV PSAPMV PSAPDAS
8 mm 0.22 0.21 0.19 0.19
12 mm 0.32 0.17 0.16 0.27
16 mm 0.41 0.22 0.21 0.34
20 mm 0.53 0.26 0.25 0.42

Beamformed images for the diffuse inclusion simulation using DAS, MV, PSAPDAS and PSAPMV are shown in Figs. 3 (b)(e). The ground truth initial pressure distribution with target (green circle) and background (white half-circles) ROIs is presented in Fig. 3 (a). For DAS, we observe high sidelobe signal levels specially near the borders for shallow targets as indicated by arrows (Fig. 3 (b)). MV results show significant image quality improvements with suppression of the strong border region clutter signals (Fig. 3 (c)). PSAPDAS further reduced sidelobes except for some noise signals near the borders (white arrows in Fig. 3 (d)). Highest performance enhancement with increased sidelobe suppression was achieved with PSAPMV (Fig. 3 (e)).

Fig. 3.

Fig. 3.

Diffuse inclusion beamforming results. (a) Ground truth initial pressure distribution, (b) DAS, (c) MV (d) PSAPDAS and (e) PSAPMV. Display dynamic range 55 dB.

CR and gCNR comparison results for diffuse inclusion simulation are shown in Figs. 4 (a)(b) respectively. PSAPMV and PSAPDAS demonstrated similar results with better CR and gCNR compared to DAS and MV alone. For example, mean gCNR values (n = 10) for the inclusion at 8 mm, for DAS = 0.84, MV = 0.89, PSAPMV = 0.98 and PSAPDAS = 0.99 demonstrate that improvement in both contrast and target detectability is achieved using PSAP for MV and DAS.

Fig. 4.

Fig. 4.

(a) CR and (b) gCNR comparison for diffuse inclusion.

Figures 5 (b)(e) show microvasculature beamformed images with DAS, MV, PSAPDAS and PSAPMV, respectively. The ground truth initial pressure distribution is presented in Fig. 5 (a). Note that DAS image suffer from high level of sidelobe signals specially near the borders for shallower vessels (white arrows in 5 (b)). Results using MV show suppression of the strong sidelobe signals but unexpected background clutter persist. PSAPDAS further reduced sidelobes except for some noise signals near the borders (white arrows in Fig. 5 (d)). Best quality image was achieved with PSAPMV (Fig. 5 (e)) showing a close resemblance with the ground truth image. CR and gCNR were computed by placing small rectangular ROIs covering the shallowest vessels as target ROIs (green ROI in Fig. 5 (a)) and then translating them into the sidelobe regions as background ROIs (red ROI in Fig. 5 (a)). PSAPMV had the highest CR and gCNR values (Mean CR [dB] for DAS = 15.38, MV = 22.42, PSAPMV = 51.74, PSAPDAS = 43.64 and mean gCNR for DAS = 0.71, MV = 0.81, PSAPMV = 0.84, PSAPDAS = 0.82).

Fig. 5.

Fig. 5.

Simulated microvasculature beamformed images. (a) Ground truth initial pressure distribution, b) DAS, (c) MV (d) PSAPDAS and (e) PSAPMV, (f) axial profile comparison at a blue line ROI shown in fig. 5 (a). Display dynamic range 55 dB.

V. Conclusion

In this paper, a sub-aperture processing technique to suppress sidelobes and background clutter with MV beamforming have been reported and validated using numerical simulations. This hybrid beamforming algorithm coupled better resolution from MV with sidelobe signal suppression from PSAP. The resulting PSAPMV demonstrated higher contrast and improved target detectability. Future work will involve validation in more complicated simulation environments (e.g., addition of channel noise, acoustic attenuation), phantom experiments and in vivo applications.

Acknowledgments

This work is funded in part by UW-Madison Office of the Vice Chancellor for Research and Graduate Education from the Wisconsin Alumni Research Foundation and National Institutes of Health Grants S10 OD018505 and 1R01 HL147866-01

Contributor Information

Rashid Al Mukaddim, Department of Medical Physics, University of Wisconsin (UW) School of Medicine and Public Health (SMPH), Madison.

Rifat Ahmed, Department of Biomedical Engineering, Duke University.

Tomy Varghese, Department of Medical Physics, University of Wisconsin (UW) School of Medicine and Public Health (SMPH), Madison.

References

  • [1].Park S, Karpiouk AB, Aglyamov SR, and Emelianov SY, “Adaptive beamforming for photoacoustic imaging,” Optics letters, vol. 33, pp. 1291–1293, 2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [2].Bell MAL, Guo X, Kang HJ, and Boctor E, “Improved contrast in laser-diode-based photoacoustic images with short-lag spatial coherence beamforming,” in 2014 IEEE International Ultrasonics Symposium, 2014, pp. 37–40. [Google Scholar]
  • [3].Gonzalez EA and Bell MAL, “GPU implementation of photoacoustic short-lag spatial coherence imaging for improved image-guided interventions,” Journal of Biomedical Optics, vol. 25, p. 077002, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [4].Mukaddim RA and Varghese T, “Spatiotemporal Coherence Weighting for In Vivo Cardiac Photoacoustic Image Beamformation,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [5].Pourebrahimi B, Yoon S, Dopsa D, and Kolios MC, “Improving the quality of photoacoustic images using the short-lag spatial coherence imaging technique,” in Photons Plus Ultrasound: Imaging and Sensing 2013, 2013, p. 85813Y. [Google Scholar]
  • [6].Wang Y-H and Li P-C, “SNR-dependent coherence-based adaptive imaging for high-frame-rate ultrasonic and photoacoustic imaging,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 61, pp. 1419–1432, 2014. [DOI] [PubMed] [Google Scholar]
  • [7].Kirchner T, Sattler F, Gröhl J, and Maier-Hein L, “Signed real-time delay multiply and sum beamforming for multispectral photoacoustic imaging,” Journal of Imaging, vol. 4, p. 121, 2018. [Google Scholar]
  • [8].Mozaffarzadeh M, Hariri A, Moore C, and Jokerst JV, “The double-stage delay-multiply-and-sum image reconstruction method improves imaging quality in a led-based photoacoustic array scanner,” Photoacoustics, vol. 12, pp. 22–29, 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [9].Park J, Jeon S, Meng J, Song L, Lee JS and Kim C, “Delay-multiply-and-sum-based synthetic aperture focusing in photoacoustic microscopy,” Journal of biomedical optics, vol. 21, p. 036010, 2016. [DOI] [PubMed] [Google Scholar]
  • [10].Kim MW, Jeng G-S, Pelivanov I, and O’Donnell M, “Deep-learning Image Reconstruction for Real-time Photoacoustic System,” IEEE Transactions on Medical Imaging, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [11].Allman D, Reiter A, and Bell MAL, “Photoacoustic source detection and reflection artifact removal enabled by deep learning,” IEEE transactions on medical imaging, vol. 37, pp. 1464–1477, 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [12].Johnstonbaugh K, Agrawal S, Durairaj DA, Fadden C, Dangi A, Karri SPK, et al. , “A deep learning approach to photoacoustic wavefront localization in deep-tissue medium,” IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [13].Lan H, Jiang D, Yang C, Gao F, and Gao F, “Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo,” Photoacoustics, vol. 20, p. 100197, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [14].Mozaffarzadeh M, Mahloojifar A, Orooji M, Kratkiewicz K, Adabi S, and Nasiriavanaki M, “Linear-array photoacoustic imaging using minimum variance-based delay multiply and sum adaptive beamforming algorithm,” Journal of biomedical optics, vol. 23, p. 026002, 2018. [DOI] [PubMed] [Google Scholar]
  • [15].Mozaffarzadeh M, Mahloojifar A, Nasiriavanaki M, and Orooji M, “Eigenspace-based minimum variance adaptive beamformer combined with delay multiply and sum: experimental study,” in Photonics in Dermatology and Plastic Surgery 2018, 2018, p. 1046717. [Google Scholar]
  • [16].Paridar R, Mozaffarzadeh M, Mehrmohammadi M, and Orooji M, “Photoacoustic image formation based on sparse regularization of minimum variance beamformer,” Biomedical Optics Express, vol. 9, pp. 2544–2561, 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [17].Shamekhi S, Periyasamy V, Pramanik M, Mehrmohammadi M, and Asl BM, “Eigenspace-based minimum variance beamformer combined with sign coherence factor: Application to linear-array photoacoustic imaging,” Ultrasonics, p. 106174, 2020. [DOI] [PubMed] [Google Scholar]
  • [18].Mukaddim RA, Weichmann AM, and Varghese T, “Photoacoustic Delay-and-Sum Beamforming with Spatiotemporal Coherence Factor,” 2020 IEEE International Ultrasonics Symposium (IUS), IEEE, 2020., 2020. [Google Scholar]
  • [19].Mukaddim RA, Ahmed R, and Varghese T, “Sub-aperture Processing Based Adaptive Beamforming for Photoacoustic Imaging,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [20].Synnevag J-F, Austeng A, and Holm S, “Benefits of minimum-variance beamforming in medical ultrasound imaging,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 56, pp. 1868–1879, 2009. [DOI] [PubMed] [Google Scholar]
  • [21].Seo CH and Yen JT, “Sidelobe suppression in ultrasound imaging using dual apodization with cross-correlation,” IEEE transactions on ultrasonics, ferroelectrics, and frequency control, vol. 55, pp. 2198–2210, 2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [22].Yen JT and Seo CH, “Sidelobe suppression in ultrasound imaging using dual apodization with cross-correlation,” ed: Google Patents, 2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [23].Treeby BE and Cox BT, “k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields,” Journal of biomedical optics, vol. 15, p. 021314, 2010. [DOI] [PubMed] [Google Scholar]
  • [24].Dixon LR, “The complete blood count: physiologic basis and clinical usage,” The Journal of perinatal & neonatal nursing, vol. 11, pp. 1–18, 1997. [DOI] [PubMed] [Google Scholar]
  • [25].Staal J, Abràmoff MD, Niemeijer M, Viergever MA, and Van Ginneken B, “Ridge-based vessel segmentation in color images of the retina,” IEEE transactions on medical imaging, vol. 23, pp. 501–509, 2004. [DOI] [PubMed] [Google Scholar]
  • [26].Marti D, Aasbjerg RN, Andersen PE, and Hansen AK, “MCmatlab: an open-source, user-friendly, MATLAB-integrated three-dimensional Monte Carlo light transport solver with heat diffusion and tissue damage,” Journal of biomedical optics, vol. 23, p. 121622, 2018. [DOI] [PubMed] [Google Scholar]
  • [27].Kempski KM, Graham MT, Gubbi MR, Palmer T, and Bell MAL, “Application of the generalized contrast-to-noise ratio to assess photoacoustic image quality,” Biomedical Optics Express, vol. 11, pp. 3684–3698, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [28].Rodriguez-Molares A, Rindal OMH, D’hooge J, Måsøy S-E, Austeng A, Bell MAL, et al. , “The generalized contrast-to-noise ratio: a formal definition for lesion detectability,” IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 67, pp. 745–759, 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES