Abstract
Photoacoustic tomography (PAT), a hybrid imaging modality that acoustically detects the optical absorption contrast, is a promising technology for imaging hemodynamic functions in deep tissues far beyond the traditional optical microscopy. However, the most clinically compatible PAT often suffers from the poor image fidelity, mostly due to the limited detection view of the linear ultrasound transducer array. PAT can be improved by employing highly-absorbing contrast agents such as droplets and nanoparticles, which, however, have low clinical translation potential due to safety concerns and regulatory hurdles imposed by these agents. In this work, we have developed a new methodology that can fundamentally improve PAT’s image fidelity without hampering any of its functional capability or clinical translation potential. By using clinically-approved microbubbles as virtual point sources that strongly and isotropically scatter the local pressure waves generated by surrounding hemoglobin, we can overcome the limited-detection-view problem and achieve high-fidelity functional PAT in deep tissues, a technology referred to as virtual-point-source PAT (VPS-PAT). We have thoroughly investigated the working principle of VPS-PAT by numerical simulations and in vitro phantom experiments, clearly showing the signal origin of VPSs and the resultant superior image fidelity over traditional PAT. We have also demonstrated in vivo applications of VPT-PAT for functional small-animal studies with physiological challenges. We expect that VPS-PAT can find broad applications in biomedical research and accelerated translation to clinical impact.
Keywords: Photoacoustic tomography, Deep imaging, Virtual point source, Microbubbles, Single value decomposition, Hemodynamic imaging, Functional imaging
1. Introduction
Photoacoustic tomography (PAT, also referred to as optoacoustic tomography) is a hybrid imaging modality that acoustically detects the optical absorption contrast via photoacoustic (PA) effect. PAT has been proven powerful for imaging hemodynamics using hemoglobin as the endogenous contrast in biological tissues, with high resolution, deep penetration, and inherent functional and molecular sensitivity. Using diffuse light excitation and acoustic detection, PAT is less limited by the tissue’s strong optical scattering, and can achieve high spatial resolution and large penetration depth that are not achievable by pure optical imaging [1], [2]. Recently, PAT has been increasingly applied in (pre)clinical studies such as breast cancer screening [3], [4], [5], skin disease diagnosis [6], [7], [8], and functional brain imaging [9], [10], [11], [12]. So far, most clinically-translatable PAT technologies utilize linear ultrasound transducer arrays, which are convenient for different anatomical locations and directly compatible with clinical ultrasound scanners. However, linear-array-based PAT systems are often hindered by the limited detection view problem, which manifests as low fidelity in the reconstructed images, such as missing vertical vessels, reduced spatial resolution, and strong streaking artifacts [13], [14], [15].
The limited view problem arises from the coherent signal generation in the PA effect, as well as the high density of red blood cells in the blood volume (∼50% v/v) and thus the homogeneity of optical absorption. When illuminated with pulsed laser, each individual red blood cell generates PA signals with coherent phases. With a high red blood cell density, pressure waves from the neighboring red blood cells tend to cancel out and constructive interference is only prominent at the vessel boundaries [16]. Therefore, instead of emitting spherical waves from each individual red blood cells, the blood vessels generate pressure waves traveling along the vessel boundaries, which have high dependence on the vessel orientations. For an exact image reconstruction, PAT requires full record of the pressure wavefront traveling in all orientations, i.e., a solid angular detection aperture of 2π for a planar detection geometry or 4π for a spherical or a cylindrical detection geometry [13], [17]. When a linear transducer array with limited detection aperture is used, only partial wavefronts from the blood vessels can be recorded, which results in the limited view problem.
Current solutions for the limited view problem in PAT include increasing the detection aperture, employing exogenous highly-absorbing contrast agent, and reconstructing with deep learning approaches. Increasing the detection aperture is usually achieved by either rotating the linear transducer array to cover a large detection angle [18], [19], or using a ring-shaped or spherical transducer [20], [21]. The former method requires complex system design, and the later greatly increases the cost of the system. Both methods would substantially hamper the clinical translation. The limited view problem can also be addressed by introducing sparsely-distributed exogenous contrast agents such as gold nanoparticles, which have much stronger optical absorption than hemoglobin and can disrupt the homogeneity of the optical absorption inside the bloodstream. The exogenous contrast agents can generate spherically traveling pressure waves and be well detected by the linear transducer array. Blood vessels in arbitrary orientations can be imaged by accumulating sufficient number of frames [22], [23]. The major limitation of this approach is that the received PA signals are from the exogenous absorbers, and thus physiological information such as oxygen saturation of hemoglobin (sO2) cannot be estimated. In addition, none of these exogenous contrast agents are approved by FDA for clinical applications with unknown safety effects and difficult regulatory clearance. Alternatively, various deep-learning networks have been used for artifact removal in linear-array based PAT, which have shown improved image fidelity [24], [25], [26]. However, the deep-learning based methods may introduce overfitting artifacts for data with significant noise, and their in vivo performance are mostly unknown [27]. Therefore, there still lacks a clinically-translatable PAT technology with high imaging quality and functional imaging capability.
In this work, we have demonstrated a novel method to overcome the limited view problem and improve the image fidelity of clinically-translatable PAT, by using microbubbles as virtual point sources (VPS), referred to as VPS-PAT. In VPS-PAT, although the microbubbles themselves have close to zero optical absorption, they can redirect the local PA pressure waves traveling in any directions via Rayleigh scattering and emit spherical waves that can be well detected by the linear transducer array. By reconstructing the sparsely distributed microbubbles as VPS over a number of imaging frames, VPS-PAT can produce high-fidelity images of the vasculature with improved visibility of the vertical structures and reduced reconstruction artifacts. Importantly, since the detected signals from the VPS originate from the surrounding hemoglobin, VPS-PAT keeps the functional sensitivity to the blood oxygenation level. Moreover, since microbubbles have been routinely used in clinical ultrasound imaging, we expect that VPS-PAT should have accelerated clinical translation compared with other PAT technologies relying on highly-absorbing contrast agents. We have thoroughly investigated the working principle of VPS-PAT by numerical simulations and phantom studies, showing its superior imaging performance over traditional PAT. We have applied VPS-PAT for small animal studies to demonstrate its functional imaging capability. Our experimental results have collectively illustrated that VPS-PAT can effectively improve the image fidelity of clinically-translatable PAT, and may find broad applications in preclinical research and clinical practice.
2. Materials and methods
2.1. Photoacoustic tomography
In PAT, photons in pulsed laser are absorbed by chromophores in tissue, and their energy is completely or partially converted to heat. The transient temperature rise leads to increased pressure and subsequent sound wave generation. The amplitude of pressure increase, as well as the intensity of the sound wave, is directly proportional to the chromophore concentration and local optical fluence. The sound wave is then detected by an ultrasonic transducer and used to form an image to tomographic map the original energy deposition in the tissue. Using acoustic detection, the penetration depth of PAT is less limited by optical scattering and is comparable to that of ultrasound imaging.
2.2. VPS-PAT system
The VPS-PAT system was adapted from a commercial ultrasound scanner (Vantage 256, Verasonics). An L7-4 linear array transducer (Philips ATL) was used for both phantom and animal studies. The transducer had 128 elements, with a central frequency of 5 MHz and a 60 % bandwidth. Laser pulses, available at 532 and 1064 nm, with 8 ns pulse-width and pulse rep rate of 10 Hz (Q-smart 850, Quantel Laser) or 100 Hz (DRL 100, Qutantel Laser), were delivered with a bifurcated linear light guide (Dolan-Jenner, 50 % coupling efficiency) attached on the sides of the transducer and illuminated the elevational focal region of the transducer (∼ 25 mm focal length; ∼ 1 mm imaging plane thickness). The 1064 nm light for in vivo imaging had an energy fluence of 75 mJ/cm2 on the sample surface, which was way below the ANSI laser safety limit. The channel data from the array transducer was sampled at 60 MHz and saved for further processing.
2.3. Ultrasound Doppler imaging
The same commercial ultrasound scanner (Vantage 256, Verasonics, Washington) and the L7–4 linear array transducer were used to acquire in-phase/quadrature (IQ) data for both real-time B-mode and ultrafast Doppler imaging of microbubbles. US plane waves were transmitted at a center frequency of 5 MHz with a PRF of 5000 Hz. Coherent spatial compounding was implemented with 7 steering angles (− 3.5° to 3.5° with an increment of 1.16 degree), which led to a post-compounding frame rate of 500 Hz. For a single frame, each transmission event was separated by 160 μs to cover an imaging depth of 35 mm. An ensemble of 4000 compounded frames at the region of interest was acquired in 8 s and the IQ data were saved. The image data were stabilized using phase correlation-based sub-pixel registration [28]. Global singular value thresholding (SVT) was applied to the motion-corrected data to separate the microbubble signals from the tissue signals. As tissue signals typically resided in the large spectral components with high singular values, the SVT cutoff was determined by searching for the turning point which the singular value curve began to flatten [29]. The singular values larger than the cutoff were set to zero, and the ensemble after thresholding were averaged for further SNR improvement.
2.4. k-Wave simulation
The k-Wave toolbox was used for simulation [30]. In 2D k-Wave simulation, the field of view covered a 12 × 15 mm2 with a grid size of 5 × 5 µm2. The microbubbles’ location was randomly generated within the blood vessel region and was defined as a single pixel with acoustic impedance of 500 kg/(m2 s). As the initial pressure in PAT is always smaller than 10 kPa, the microbubble oscillation is negligible, and we assumed no harmonics were generated. The sensor defined in the simulation had the same configuration as the L7-4 linear array, which contained 42 elements and 1/3 of the original aperture. The acquired PA channel signal was filtered using a 5th-order Butterworth filter with a 4–7 MHz cutoff. As the pressure generated during the PA imaging is usually less than 10 kPa, the oscillation and the diameter change of the microbubble was negligible [31].
2.5. Microbubble preparation
Perfluorocarbon-filled phospholipid microbubbles (VesselVue S-formulation 4–5 µm, SonoVol) with mean diameter of 4.37 µm were used for PAT. The vial had an initial concentration of 2.21 × 109 particles/ml and was mixed with PBS to yield a final concentration of 2 × 106 and 2 × 107 particles/ml for phantom and animal study respectively. A 27-gauge needle was used for injection via the tail vein to avoid microbubble bursting. Since the microbubble is much smaller than the system resolution, the microbubble size should not impact the eventual system resolution. However, as bigger microbubbles can scatter more acoustic energies, 4–5-µm microbubbles were used for our work.
2.6. PAT singular value thresholding
Similar to slow-time signal in the US color Doppler image, the slow-time signal from PAT with microbubbles is comprised of three constituent components: 1) non-scattered signals, which are PA signals transmitted directly from blood and received within the detection aperture; 2) scattered signals, which are PA signals isotropically scattered from the microbubbles and received within the detection aperture; 3) random white noise, which originates from thermal and electronic noises [32]. For an image pixel that does not contain microbubbles, the slow-time signal should have only non-scattered signals and random white noise. A slow-time signal ensemble x can be expressed in following two forms for a give ensemble size ND:
| (1) |
In (1), x(n) represents the nth slow-time data sample, and d, s, n are vectors of length ND for non-scattered PA signals, scattered PA signals, and white noise, respectively. Based on our simulation results, the non-scattered signal, usually from horizontal structures, is stronger than other signal components, including scattered PA signals from both vertical and horizontal structures. Therefore, we need to suppress the non-scattered component.
It is known that eigenvalues contain information about the signal energy represented by the individual eigen-components. In particular, a large eigenvalue signifies that its respective eigen-component accounts for a substantial energy portion of the slow-time ensemble. Such a representation matches the characteristics of non-scattered PA signals. In order to use eigenvalue-based filtering, we first decomposed the slow-time signal contents into a sum of mutually orthogonal components that have the minimum mean-squared modeling error. For a given slow-time ensemble x [33], [34], [35]:
| (2) |
is the kth eigenvector and is the corresponding expansion weight that satisfies the following orthogonality relation:
| (3) |
By identifying the eigen-components of non-scattered signals as the ones whose eigenvalues are above a predefined threshold λd, we can remove these eigen-components and suppress the non-scattered signals. The resultant eigen-component subset for scattered signals is
| (4) |
It has been shown that singular value decomposition (SVD) is related to eigenvalue decomposition [32]. The eigenvectors of the eigenvalue decomposition are equivalent to the left singular vectors in the SVD, and the eigenvalues (λk) are the square of the corresponding singular values (δk) [32]. Therefore, SVD was used for singular value calculation and subsequent filtering. For our application, the threshold δd was empirically set relative to the largest singular value as δd ≈ 0.1δmax.
The SVD filter did not add additional computational complexity to the traditional PAT. For a computer with Intel Core i7 processor, 16 GB RAM, a total of 15 s were needed to apply the SVD-filter with a predefined cutoff on a data volume with 300-by-400-by-500 pixels.
2.7. Experimental animals
Female Wistar rats (Charles River Laboratories: 150–200 g, 6–10 months old) were used for the in vivo studies. The laboratory animal protocol was approved by the Institutional Animal Care & Use Committee of Duke University. During the experiment, the rat’s temperature was kept at 37 °C by a heating lamp. Inhalant isoflurane was used for anesthesia with 5 % v/v for induction and 2 % v/v for maintenance. Compressed air flow rate through the facemask was set to 1000 ml/min, and the breathing rate of rat was around 55–60 times/min. Rat’s fur at the liver region was removed with shaving cream. The rat was placed in prone position on the acoustically and optically transparent imaging window and secured with surgical tape. A dose of 100 μL microbubbles (2 × 107 particles/ml) was injected via the tail vein before each data acquisition session. Each data acquisition session was separated at least 10 min apart to ensure that injected bubbles had been cleared out. Each injection corresponded to approximately 170,000 microbubbles per ml of blood, which was lower than the typical dose in clinical practice.
2.8. Hypoxia challenge
The rats were housed and anesthetized under normoxia (21 % O2). During the hypoxia challenge, isoflurane vaporizer was constantly supplied with a mix of compressed air and pure N2 (volumetric flow rate 1:1) to achieve an oxygen level of 10.5 %. Each cycle started with a bolus injection of microbubbles. Immediately after the injection, 500 PA frames were acquired and saved under normoxia condition, which took around 80 s. The gas supply to the vaporizer was then switched from normoxia condition to hypoxia condition. PA data was acquired 30 s after the hypoxia started, allowing the blood oxygenation level to stabilize under hypoxia condition. Each hypoxia session last 1.5 min, after which the rat was allowed to recover with normoxia condition for 10 min. The hypoxia-normoxia switching was repeated 3 times.
2.9. Image reconstruction based on dual speed of sound
It is critical to correctly reconstructed the scattered PA signals from microbubbles. With the setup of our in vivo imaging system, the delay-and-sum (DAS) reconstruction based on single speed of sound was not accurate. We assumed the sound speed distribution in rat tissues was homogenous, but the difference between the speed of sound in the coupling medium and rat tissue was not negligible. Therefore, dual speed of sound reconstruction was used for our in vivo system (Supplementary Fig. 1). In order to perform dual speed of sound reconstruction, we needed the information of the speed of sounds in the coupling medium and the rat tissue, as well as the location of the imaging window.
We first measured the sound speed in the coupling medium under in vivo experiment condition. Three single hair strands were placed orthogonal to the imaging plane and directly on top of the imaging window. The hair stands were imaged, and the acquired data was reconstructed by sweeping the sound speed from 1250 m/s to 1500 m/s. The best image convergence of three hair targets indicated that the coupling medium had a sound speed of 1330 m/s.
We then determined the imaging window location. As our acoustically-transparent imaging window had negligible optical absorption at 1064 nm but strong absorption at 532 nm, we used 532 nm to image the window. After completion of rat liver imaging, we kept the transducer at the same location and removed the rat. The illumination was switched from 1064 nm to 532 nm and the acquired PA data of the imaging window was reconstructed with the sound speed calibrated from the previous step to provide the actual location of the window. As the temperature of the rat was 37 °C, we assumed the sound speed in rat tissues was 1540 m/s. With the location of the imaging window, the dual speed of sound image reconstruction was performed.
2.10. Motion detection and data stabilization
Due to the limited pulse repetition rate of the laser, the acquired in vivo datasets were susceptible to breathing motion. Due to rat’s breathing, the tissues were periodically moving in and out of the imaging plane. To extract the stable frames, we first picked a reference frame and calculated the normalized 2D cross-correlation between the reference frame and all the other frames in the acquired dataset. The normalized cross-correlation reflects the breathing pattern of the rat, and by setting a threshold, the moving frames can be identified and removed.
2.11. Contrast-to-noise ratio
We define the CNR as [36]:
| (5) |
where µi and µo are the averaged signal and noise level respectively in the region of interest, σi and σo are the standard deviation of the signal and noise level respectively.
2.12. Oxygen saturation of hemoglobin (sO2)
We define the sO2 at location (x, y) as [37]:
| (6) |
where and are molar concentrations of oxygenated (HbO2) and deoxygenated (HbR) hemoglobin respectively. We used the linear spectral unmixing method, which states that P (λi, x, y), the reconstructed PA image at wavelength λi at (x, y) [38],
| (7) |
here Φ(λ) is local optical fluence. and are the known molar extinction coefficients (cm−1 M−1) of HbR and HbO2 at wavelength λi, respectively. We used an optical energy of 15 mJ/pulse for 532 nm and 90 mJ/pulse for 1064 nm. The incident optical fluence was corrected based on the emitted laser pulse energy, and we assumed homogeneous fluence distribution within the region of interest without considering the wavelength-dependent optical attenuation. After correcting for optical fluence, and can be estimated by solving the following linear equations:
| (8) |
where P is the SVD filtered PA images at 532 and 1064 nm, ε is the molar extinction coefficient matrix as
| (9) |
| (10) |
3. Results
3.1. Imaging principle of VPS-PAT
FDA-approved biocompatible microbubbles are usually made of a gas core (e.g., nitrogen or perfluorocarbon gases) encapsulated by a solid shell (e.g., lipid or protein). Microbubbles have been widely used as contrast agents in clinical ultrasound imaging, in which they can enhance the blood vessel signals by strongly scattering the transmitted ultrasound waves [39], [40]. Typically, native microbubbles without being conjugated with other chromophores cannot be used as contrast agents for PAT, because microbubbles have negligible optical absorption compared to hemoglobin (Supplementary Fig. 2). Unlike the highly-absorbing nanoparticles and droplets, microbubbles may serve as negative contrast agents in the bloodstream and break the homogeneity of the optical absorption. However, using numerical simulations, we have demonstrated that, due to the small size (∼ 5 µm) and sparsity of the microbubbles (4 × 106 microbubbles/ml), the zero optical absorption of microbubbles has practically negligible impact on the generated PA signals and thus has little contribution to mitigating the limited view problem (Supplementary Fig. 3) [41].
However, since microbubbles have large acoustic impedance mismatch with the surrounding bloodstream [42], we expect that the strong acoustic scattering of microbubbles can play a much more important role in addressing the limited view problem in PAT. The most common PAT system usually uses a linear array transducer (Fig. 1a). The linear array transducer typically has a central frequency between 2 and 10 MHz, corresponding to an in vivo acoustic wavelength of 150–750 µm. Microbubbles used for clinical applications typically have a diameter between 0.5 and 10 µm, which is much smaller than the PA pressure wavelengths and thus can be considered as point targets [42]. Similar to contrast-enhanced ultrasound imaging, sparsely distributed microbubbles can function as Rayleigh scatterers and redistribute the surrounding PA pressure waves traveling in all directions (Fig. 1b, Supplementary Fig. 4). Because Rayleigh scattering has low anisotropy (or directivity dependence), the redirected PA waves by microbubbles are close to spherical waves, and thus can be readily detected by the linear transducer array positioned at any orientation. By filtering out the static PA signals directly from the blood via single value decomposition (SVD), VPS-PAT detects only the scattered PA signals from the microbubbles, and then reconstructs the images of the microbubbles as virtual point sources (Fig. 1c). By accumulating the microbubble signals from multiple independent frames, VPS-PAT is able to reconstruct the otherwise invisible vessel structures and thus improve the image fidelity. The final concentration of the microbubbles is low (∼ 106 microbubbles/ml), which is similar to the clinically approved concentration for contrast-enhanced ultrasound imaging. Microbubble-induced shadowing and multi-scattering effect of the acoustic waves are not expected and thus not considered in the image reconstruction.
Fig. 1.
Working principle of PAT enhanced by microbubbles as virtual point sources (VPS-PAT). (a) Schematic of traditional photoacoustic (PA) tomography (PAT) with a linear transducer array. Pulsed laser light is delivered with a linear bifurcated fiber attached at the sides of the linear transducer array. (b) Schematics of VPS-PAT with microbubbles. (b.1) The PA waves generated by the vessels (gray dashed lines) generally travel along the vessel orientations, as indicated by the arrows. The linear array transducer (not shown) placed on top of vessels is unable to detect side traveling PA waves. (b.2–3) The spherical PA waves scattered by a flowing microbubble (red dashed circles) at two different timepoints. (b.4) By removing spatiotemporally correlated signals directly from blood, only PA signals redirected by the microbubble is preserved. (c) Scattered PA signals by the microbubbles can be reconstructed as virtual point sources. By accumulating multiple frames at different timepoints, the complete vessel structure can be reconstructed.
3.2. Simulation of VPS-PAT using microbubbles as virtual point sources
To demonstrate the concept of VPS-PAT, we performed 2D k-wave simulation of PA imaging of a vertical blood vessel inside a mouse liver model [30]. The simulation covered a field of view of 12 × 15 mm2 region that included skin, muscle, fat, and liver, with the linear array transducer placed on top of the skin surface. A vertical blood vessel (5 mm length, 0.2 mm diameter) was placed 11 mm from the transducer surface (Fig. 2a). The acoustic properties were heterogeneous across different tissue types in speed of sound, tissue density, and acoustic attenuation coefficient (Supplementary Fig. 5) [43]. We assumed that hemoglobin was the dominating light absorber at 532 nm. We also assumed that optical fluence was homogenous around the blood vessel and thus homogeneous initial pressure in all blood vessel pixels. A time-reversal based method was used to reconstruct PA images from the simulated PA data [44]. The image reconstruction also assumed homogenous tissue density and sound speed. The microbubbles had a diameter of 5 µm, an optical absorption coefficient of zero, and an acoustic impedance of 500 kg/(m2 s).
Fig. 2.
Simulation of microbubbles as virtual point sources in PAT. (a) The 12 × 15 mm2 simulation region included different types of soft tissues. The linear array transducer was placed intact with skin surface, and a 0.2 × 5 mm2 cylinder represented a vertical blood vessel. Three conditions were simulated: (1) no microbubble in the vessel, (2) a single static microbubble in the vessel at one timepoint, and (3) flowing microbubbles at N timepoints. (b–g) Simulation setup with 0, 1, and 5 static microbubbles placed inside the vessel respectively, and the corresponding reconstructed PA images. The microbubbles were clearly reconstructed as virtual point sources. (h) Extracted RF data along the dashed line passing through the middle of the vessel, as indicated in (b), for 0, 1, and 5 static microbubbles. (i) Extracted intensity profile from the reconstructed images along the dashed line passing through the middle of the vessel, as indicated in (c), for 0, 1, and 5 static microbubbles. (j) Comparison of CNR in reconstructed B-mode images with signal and noise regions defined by the dashed boxes in (c), for 0, 1, and 5 microbubbles respectively. (k) B-mode PA image of a single microbubble located at the top, middle, and bottom of the vertical blood vessel (indicated by arrows), reconstructed with homogeneous or heterogeneous speed of sound (s.o.s). The forward simulation was based on the heterogeneous s.o.s.
Without any microbubbles inside the vertical vessel (Fig. 2b), the forward simulation shows that the generated PA pressure waves propagated sideways along the vessel (Supplementary Video 1). Thus, only the top and bottom boundaries of the vessel were visible in the reconstructed PA image, while the middle portion between the two boundaries was missing, demonstrating the classic limited view problem (Fig. 2c). With a single static microbubble inside the vessel (Fig. 2d), the PA signals redirected by the bubble traveled as a spherical wave and was detected by the transducer array (Supplementary Video 2). The reconstructed image clearly shows the microbubble as a point source at the correct position (Fig. 2e). Similarly, with five static microbubbles sparsely distributed inside the vessel (Fig. 2f, Supplementary Video 3), their positions were all correctly reconstructed in the PA image (Fig. 2g), showing partially the vertical vessel lumen. We further analyzed the raw PA signals detected by the transducer in the three different scenarios, and the results show that the scattered signals by the microbubbles were ∼3–4 times weaker than the boundary signals (Fig. 2h). Consequently, in the reconstructed images, the microbubbles as the virtual points sources were also ∼ 3–4 times weaker than the vessel boundaries (Fig. 2i). Nevertheless, the microbubbles enabled better visualization of the vessel lumen with a 9-fold increase in the contrast to noise ratio (CNR) with one microbubble, and a 14-fold increase with five microbubbles (Fig. 2j) [36].
The following is the Supplementary material related to this article Video 1, Video 2, Video 3.
Despite the significant improvement in the CNR, the reconstructed sizes of the individual VPS depended on their locations. One major reason was the decreasing aperture size of the linear transducer array as the depth increases, which is an inherent limitation of the linear detection geometry. The other major reason was the inaccurate sound speed used for image reconstruction. For in vitro and in vivo experiments, it is usually challenging to obtain the accurate sound speed map. Thus, the coupling medium and the image target are often assumed to be homogeneous with a single sound speed, which can lead to the reconstruction inaccuracy. To investigate the impact of sound speed on the reconstruction of VPS, we simulated a realistic setup with heterogeneous sound speed in the forward model and homogeneous sound speed for image reconstruction. In this case, as the microbubble moved away from the transducer surface, the reconstruction inaccuracy accumulated, which lead to a larger VPS size (Fig. 2k). However, when we used the correct sound speed for image reconstruction, the VPS size was generally consistent at different depths with reduced signal intensity, due to tissue attenuation of the acoustic signal and the decreased receiving aperture of the transducer array.
We then simulated VPS-PAT with flowing microbubbles in the bloodstream. The flowing microbubbles were sparsely and randomly distributed in blood vessels. When a blood vessel was imaged over multiple frames with a relatively low frame rate, each frame had a different set of microbubble locations. By accumulating a large number of frames and merging the reconstructed locations of all virtual point sources, we can recover the full vertical vessel structure that is otherwise invisible in traditional PAT. To mimic microbubbles flowing in bloodstream, we simulated and reconstructed 20 different frames. We simulated all frames with a 10 Hz frame rate, a flow rate of > 0.1 ml/s, a vessel diameter of 0.1 mm, and a vessel length of 5 mm. Each frame had five microbubbles defined at random locations within the vertical blood vessel (Fig. 2a), which corresponded to a concentration of 2.2 × 106 particles/ml or ∼ 0.015 % volume concentration. This concentration was comparable with the typical clinical dose in contrast-enhanced ultrasound imaging [41].
As the scattered signals from the virtual point sources were weaker than the non-scattered signals from the vessel boundaries, we investigated different signal processing techniques to suppress the non-scattered signals. We first applied singular value decomposition (SVD) to the reconstructed images and removed high singular values with an empirically optimized cutting threshold (Fig. 3a). The non-scattered signals from the top and bottom boundaries were effectively filtered out due to the high temporal coherence over different frames. Compared to the original B-mode images (Fig. 3c–d), the scattered signals from the VPSs were largely preserved, because of their low temporal coherence from frame to frame (Fig. 3e–f). By merging the SVD-filtered images and accumulating all the reconstructed VPSs as the final image, the visibility of the vertical vessel as well as the CNRs were greatly improved (Fig. 3i–k). We also explored another signal processing method by applying a high-pass filter on the RF data across consecutive frames (Fig. 3b), which highlighted the scattered signals from the VPSs (Fig. 3g). The high-pass-filtered RF data was then reconstructed to form the images of the VPSs, revealing similar CNR improvements as the SVD-filtered image (Fig. 3h–k). However, the high-pass-filter-based image presented slightly more reconstruction artifacts than the SVD-filtered image, likely because the SVD method was more tolerant to random noise by considering the signal’s spatial coherence as well.
Fig. 3.
Data processing schematics of VPS-PAT with improved visibility of vertical structure. (a) Extracting microbubble signals with a singular value decomposition (SVD) filter on the reconstructed images. TR, time reversal. (b) Extracting microbubble signals with a high-pass filter on the received channel data. (c) Single B-mode PA image of the vessel with 5 microbubbles. (d) Averaged B-mode PA image over 20 frames. (e) Single SVD-filtered PA image of the vessel. (f) Averaged SVD-filtered image. (g) Single high-pass-filtered PA image of the vessel. (h) Averaged high-pass-filtered PA image. (i-j) Extracted intensity profile along the dashed line passing through the middle of the vessel, as indicated in (h), for single-frame and averaged B-mode, SVD-filtered, and high-pass-filtered images with 5 flowing microbubbles. (k) Comparison of CNR in single and averaged frames of 5 flowing microbubbles in vessel, processed with the SVD filter or high-pass filter. Signal and noise regions are defined by the dashed boxes in (h).
3.3. VPS-PAT for improving visibility of vertical structures
We validated the concept of VPS-PAT by imaging a U-shaped agar channel with a 640-μm inner diameter. A silicone tube was first fixed to form a U-shaped pattern in 1 % heated agar solution. The tube was then carefully removed after agar was solidified (Fig. 4a). A black hair was also embedded close the tube as a control target. The transducer imaged the U-shaped tunnel from the bottom and was able to cover the left half of the U-shaped tunnel. The 532-nm pulsed laser light (7 mJ/pulse) was delivered through the linear bifurcated light guide fixed on the sides of the transducer. Whole bovine blood was mixed with microbubbles to yield a final concentration of 2 × 106 microbubbles/ml. The blood-microbubble mixture was perfused into the U-shaped tunnel with a flow speed of 20 mm/s, using a syringe pump to mimic blood flow. The US Doppler imaging was performed as a reference. A total of 500 consecutive frames were acquired at a frame rate of 10 Hz. For comparison, bovine blood with and without microbubbles were imaged (Fig. 4b). The same SVD filter was applied to both conditions. The tunnel structure and the hair position were confirmed by the US Doppler image (Fig. 4c).
Fig. 4.
In vitro VPS-PAT of a U-shaped agar tunnel. (a) Schematic of in vitro experimental setup with a 640-μm-diameter U-shaped agar tunnel. Blood only or blood-microbubble mixture was flowed from the left opening at a flow speed of 20 mm/s. (b) B-mode PA image of the agar tunnel with and without microbubbles. A hair was positioned nearby as a reference. (c) Doppler US image of the agar tunnel with microbubbles. (d) Extracted intensity profile along the dashed lines passing across the tunnel, as indicated in (b), from B-mode PA images with and without microbubbles. (e-f) Averaged SVD-filtered images of the agar tunnel with and without microbubbles. (g) Single SVD-filtered image of the agar tunnel with individual microbubbles. (h-i) Extracted intensity profile along the dashed lines across the tunnel, as indicated in (e) and (f), for averaged SVD-filtered PA images with and without microbubbles. (j) CNR comparison of three representative regions of the SVD-filtered images with and without microbubbles. The three signal (white) and noise (green) regions were indicated by the dashed boxes in (e).
As most of the tunnel structure was vertically aligned with the ultrasound transducer, it was an ideal target for demonstrating the effectiveness of VPS-PAT in recovering missing structures due to the limited view problem. In the B-mode PA image, most of the tunnel was poorly visible, regardless of the presence of the microbubbles (Fig. 4b). As expected, without microbubbles, the transducer was unable to receive the PA signals from the vertical structure. However, even with microbubbles, the scattered signals were overshadowed by non-scattered signals. Image intensity profiles at tube positions were extracted from the B-modes image, and the tube was barely visible (Fig. 4d–e). By contrast, the SVD filter was able to suppress the non-scattered signals directly from hemoglobin and recover the correct shape of the tunnel after accumulating 500 frames (Fig. 4e). However, without the microbubbles, the SVD-filtered images were unable to recover the tunnel shape (Fig. 4f). The hair was weakly visible in the SVD-filtered image, mainly due to laser energy fluctuation. By examining post-SVD-filtered images, individual VPS were reconstructed in each individual frame (Fig. 4g). Image intensity profiles were extracted at different locations of the tunnel, showing an average tunnel diameter of 596 µm, which was consistent with the Doppler Ultrasound results (628 µm) (Fig. 4h). Without microbubbles, image intensity profiles remained at the noise level (Fig. 4i). CNR was calculated at three representative regions, and microbubbles greatly improved the CNR by ∼ 4 times (Fig. 4j). This phantom experiment shows that microbubbles as VPSs were able to improve the visibility of the vertical structures while preserving the system resolution, and thus mitigate the limited view problem in PAT with a linear transducer array.
We also imaged a more complicated knot phantom to further validate VPS-PAT. The knot phantom had both horizontal and vertical structure, and thus was used for demonstrating the effectiveness of VPS-PAT in visualizing arbitrary target orientation. The silicone tube knot with a 310-μm inner diameter was embedded in 1 % transparent agar and aligned with the transducer imaging plane (Fig. 5a). The same illumination scheme (7 mJ/pulse at 532 nm) and microbubble concentration (2 × 106 microbubbles/ml, 20 mm/s) were used. A total of 500 consecutive frames were acquired for both bovine blood and blood-microbubble mixture at 10 Hz, and subsequently processed with the same SVD filter (Supplementary Videos 4 and 5). The US B-mode and Doppler imaging were performed as a reference (Fig. 5b–c, Supplementary Video 6). Due to the strong shadowing effect from the horizontal structures, microbubbles did not significantly enhance the visibility of vertical structures in the PA B-mode images, as the scattered signals were much weaker than the non-scattered signals (Fig. 5d–c). With the SVD-filter and similar filter cutoff applied to both flowing blood and blood-microbubble mixture data, signals with high spatiotemporal correlation were removed, and regions with strong fluctuations were kept (Fig. 5f-g). The SVD-filtered PA image with microbubble showed a complete structure of the knot. There were signal intensity variations at different regions in the SVD-filtered image, which was mainly the results of optical fluence inhomogeneity and misalignment of the imaging plane with the knot (Fig. 5f, Supplementary Videos 7 and 8). Image intensity profiles were extracted at three different locations for tube diameter estimation, and the measured FWHM for lines 1, 2, and 3 were 905 µm, 1140 µm, and 750 µm. Unlike the previous experiment using the agar tunnel, the estimated diameters of the silicone tube were larger than the actual tube inner diameter (310 µm), mainly due to the strong acoustic reverberation by the tube wall (Fig. 5f). Nevertheless, similar resolution deterioration was observed on the Doppler US image (Fig. 5c). CNR was calculated at three representative regions (regions 4–6 on Fig. 5f), and microbubbles with SVD-filter greatly improved the CNR (Fig. 5h). The CNR improvement as a function of the number of image frames for VPS accumulation was shown in Fig. 5i. While a larger number of frames did not greatly improve the CNR of horizontal structures (region 4 and 5), 3-fold improvement was observed for the vertical structure (region 6) when the number of frames increased from 50 to 500.
Fig. 5.
In vitro VPS-PAT of a knot tube. (a) Schematic of in vitro imaging setup with a 300-μm-diameter capillary tube knot. Blood only or blood-microbubble mixture was perfused at a flow speed of 20 mm/s. (b–c) US B-mode and Doppler image of the tube with microbubbles. (d–e) Averaged PA B-mode image of the tube with and without the microbubbles. (f–g) Averaged PA SVD-filtered image of the tube with and without microbubbles. Intensity profiles along lines 1–3, as shown on (f), were extracted from both images. (h) CNR comparison of three representative horizontal and vertical segments (regions 4–6) of the SVD-filtered images with and without microbubbles. The three signal (white) and noise (green) regions were indicated by the dashed boxes in (f). (i) CNR of regions 4–6 as a function of increasing number of SVD-filtered frames used for averaging.
The following is the Supplementary material related to this article Video 4, Video 5, Video 6, Video 7, Video 8.
3.4. VPS-PAT for measuring oxygenation of hemoglobin (sO2)
In addition to improving the visibility of vertical structures, the scattered PA signals from the microbubbles preserve the functional information of the surrounding hemoglobin and sO2 can be estimated with multispectral PA imaging, which is fundamentally different from other highly-absorbing exogenous contrast agents. To demonstrate the functional sensitivity of VPS-PAT, we prepared fully oxygenated and deoxygenated bovine blood by adding sodium bicarbonate (37 mg/ml of blood, followed by 5-minute 100 % O2 infusion) and sodium dithionite (2.5 mg/ml of blood, followed by 5-minute 100 % CO2 infusion), respectively (Fig. 6a) [45], [46]. The oxygenated and deoxygenated blood were expected to have nearly 100 % and 0 % sO2 respectively. The oxygenated and deoxygenated blood samples were then mixed with microbubbles and perfused into a capillary tube with a constant flow speed of 20 mm/s (Fig. 6b). The capillary tube was imaged by VPS-PAT with dual-wavelength excitation at 532 and 1064 nm sequentially at 10 Hz (Fig. 6c–f). The sO2 image was calculated from the 500-frame-averaged B-mode and the SVD-filtered images using the linear spectral unmixing method [38]. Here, we did not consider the spectral coloring effect in the transparent agar phantom. The results clearly show that the B-mode PA images were not able to recover the sO2 levels in the vertical segments of the phantom (Fig. 6c and e). By contrast, VPS-PAT was able to accurately quantify the sO2 levels of the blood phantoms (Fig. 6d and f). It is worth noting that the sO2 estimation by VPS-PAT was consistent at all segments along the capillary tube.
Fig. 6.
Multispectral functional VPS-PAT of blood oxygenation. (a) Schematics of preparing oxygenated and deoxygenated blood. (b) Schematic of imaging the blood tube with microbubbles at 532 and 1064 nm. (c–d) PA B-mode (c) and SVD-filtered (d) images of the tube perfused with oxygenated blood at 532 nm and 1064 nm, as well as the computed sO2 image. (e–f) PA B-mode (e) and SVD-filtered (f) images of the tube perfused with deoxygenated blood at 532 nm and 1064 nm, as well as the computed sO2 image.
3.5. VPS-PAT for in vivo rat liver imaging under hypoxia challenge
To validate the in vivo performance of VPS-PAT, we imaged the liver vasculature of a rat under normoxia and hypoxia. We placed the rat in the prone position on the imaging window, with the laser light illumination (1064 nm) and the linear transducer array immersed in coupling medium underneath the imaging window (Fig. 7a). The same tissue plane around the liver region was imaged before and after microbubble injection. A total of 1000 frames were acquired with a frame rate of 50 Hz and a data acquisition time of 20 s. The reconstructed PA images were first stabilized to eliminate the respiration motion artifacts (Supplementary Video 9), and then processed with the SVD filter to extract the scattered signals from the microbubbles. Here, we used a dual speed-of-sound (SOS) image reconstruction method, because of the relatively large difference in SOS between the coupling medium and the rat tissue (Supplementary Fig. 1). The dual SOS image reconstruction was able to better converge the relatively weak PA signals scattered from microbubbles.
Fig. 7.
In vivo VPS-PAT of rat liver. (a) Schematic of in vivo imaging. Rat was placed in prone position on an acoustic-transparent membrane. The linear array transducer and the linear bifurcated fiber were immersed in oil beneath the membrane. Rat skin is around 18 mm from the transducer surface. (b–c) B-mode and averaged SVD-filtered PA images with microbubbles. (d) Doppler ultrasound image of rat liver with microbubble injection. Used as a reference for anatomical structure. (e) A close-up region of the B-mode PA image in (c), shown in full dynamic range. (f) The close-up image in (e) shown in small dynamic range. (g) The SVD-filtered PA image of the same region as (e).
The following is the Supplementary material related to this article Video 9.
The results have clearly demonstrated that VPS-PAT was able to image more blood vessels with improved contrast and reduced artifacts, when compared with the B-mode PA images (Fig. 7b–c). The VPS-PAT image showed similar anatomical structure as the Doppler ultrasound image (Fig. 7d) and revealed clutters of small vessels as well as vertical vessels inside the liver region, with a penetration depth of ∼ 1 cm (Fig. 7e–g). In order to highlight the necessity of microbubbles, we also tested the imaging process on the same animal without the microbubbles. In this case, the flowing blood may still provide some PA signal fluctuations over multiple frames, due to the rearrangement of red blood cells from frame to frame [47]. Without microbubbles, the SVD process had reduced effect on improving the image quality (Supplementary Fig. 6), with weaker CNR and no major vessels beyond 5 mm depth.
To demonstrate the capability of functional imaging with VPS-PAT, we conducted hypoxia challenge on the rat and monitored the hemodynamic response around the liver region. Here, we used a single wavelength at 1064 nm for the relative oxygenation measurement, because deoxy-hemoglobin has a 20 times lower absorption coefficient at 1064 nm than that of oxygen-hemoglobin. The PA signal change at 1064 nm should mostly reflect the relative change in the oxy-hemoglobin concentration. We alternated the normoxia and hypoxia states for three cycles, with 1000 frames acquired for each condition in each cycle (Fig. 8a). The hypoxia challenge induced a systemic decrease in blood oxygenation level, and therefore, we observed a clear decrease in total PA signal and the vessel visibility, when compared to the normoxia conditions (Fig. 8b–c, Supplementary Fig. 7, Supplementary Video 10). We started each acquisition after the rat’s physiological condition was stabilized for the hypoxia or normoxia state, and thus the gradual change in the sO2 was not recorded. Again, the results show that the SVD-filtered images could visualize more vessels at larger depths under both conditions than the B-mode images, highlighting the fact that the SVD filtered signals were redirected from the surrounding hemoglobin by the microbubbles. We further analyzed regional signal intensities for vessel clutters (Fig. 8d) and signal profiles for individual vessels (Fig. 8e). The results showed that hypoxia led to a > 65 % drop in the overall PA signal intensity at 1064 nm, reflecting a decrease in the blood oxygenation level. We also quantified the relative signal changes from normoxia to hypoxia in the B-mode images (Fig. 8f) or SVD-filtered images (Fig. 8g). The different signal changes under hypoxia challenge were indicative of the original blood oxygenation level under normoxia condition.
Fig. 8.
Functional VPS-PAT of rat liver under hypoxia challenge. (a) Normoxia and hypoxia were alternated for 3 cycles, with 21 % and 10 % oxygen level supplied to normoxia and hypoxia respectively. (b) B-mode PA images under normoxia and hypoxia conditions. (c) SVD-filtered PA images under normoxia and hypoxia conditions. (d) Representative regional SVD-filtered signal intensity as a function of time for normoxia and hypoxia sessions. The two regions are identified by the dashed box in (c). (e) Representative vessel signal profiles under normoxia and hypoxia conditions. The two vessels are indicated by the solid lines in (c). (f-g) The relative signal changes from normoxia to hypoxia, extracted from the B-mode images (f) and SVD-filtered images (g).
The following is the Supplementary material related to this article Video 10.
4. Discussion
We have developed a novel imaging technology VPS-PAT that uses acoustically-scattering microbubbles to improve the image fidelity of clinically-translatable PAT with a linear transducer array. Microbubbles are FDA approved contrast agent for clinical ultrasound imaging and are ideal Rayleigh scatterers of the PA pressure waves, due to their subwavelength sizes and large acoustic impedance mismatch from the surrounding blood. Disregarding the vessel orientation or shape, microbubbles can scatter and redirect the local PA signals towards the linear transducer array. The approximately isotropic scattering by the microbubbles effectively creates virtual point sources with spherical signal emission. For vertical vessel structures with PA pressure waves that are otherwise not detected by the linear transducer array, they can now be imaged by reconstructing the scattered PA signals. It is worth emphasizing that the acoustic scattering of the microbubbles is the dominating mechanism in VPS-PAT for the enhanced PA signals. In fact, the clinically-approved microbubbles have no optical absorption. Because of the small size and sparse distribution of the microbubbles in the bloodstream, their optical properties have negligible impact on the PA signal generation and propagation.
VPS-PAT uses microbubbles as virtual point sources, which has clear advantages over other methods using highly-absorbing exogenous contrast agents. Microbubbles are FDA approved for clinical use, which may accelerate the clinical translation of VPS-PAT. Moreover, we have demonstrated that, through both in vitro and in vivo experiments, the scattered signals by microbubbles can preserve the functional information from the surrounding blood, allowing measurement of important physiological parameters such as sO2. Nevertheless, in the reconstructed PA images, the microbubbles as virtual point sources, have 3–4 times weaker signals than the non-scattered signals directly from blood. We applied SVD filtering to remove the strong non-scattering signals to improve the CNR of virtual point sources. The SVD-filtered images show improved structure visibility and reduced limited-view artifacts, both of which are due to the spherical waves scattered by microbubbles as virtual point sources.
One important limitation of the current VPS-PAT system is that multiple frames are needed to accumulate enough scattered signals from microbubbles, which leads to a relatively long data acquisition time and thus respiration-induced motion artifacts for in vivo studies. Increasing microbubble concentration will reduce the number of required frames but can also cause potential biosafety issue to the animals. Thus, we simply used the clinically recommended microbubble concentration. In our current setup, the imaging speed is further limited by the low pulse repetition rate of 10–50 Hz. We have shown that, with as few as 200 stabilized frames and a total acquisition time around 4-6 s, the visibility of major vessels and small vessel clusters were already improved compared to the B-mode images (Supplementary Fig. 8). Incorporating more frames could help improve the SNR of SVD-filtered image with more averaging, but also introduced respiration-induced artifacts that led to blurring of small features. One improvement of VPS-PAT is the incorporation of laser sources with a higher PRF to improve the imaging speed. High imaging speed will also significantly reduce the motion susceptibility, and may even allow tracking VPS to measure the blood flow speed [22]. As our method relies on the relatively weak PA signal scattered by microbubbles, high SNR would help separate the VPS from the background. In deep tissues with low optical fluence and thus low SNR, advanced optical acoustic detection method with improved detection sensitivity may be applied [48], [49].
For image reconstruction, we adapted a dual-SOS based method that was superior over the traditional single-SOS based method (Supplementary Fig. 1). Although the dual-SOS method did not significantly improve the B-mode PA images, it was critical for improving the SVD-filtered VPS images that were sensitive to the signal convergence of point targets. Nevertheless, we still assumed all types of tissues had the same speed of sound, which was not accurate especially for tissues with high fat content and fibers [43]. A more accurate reconstruction method with tissue-dependent speed of sound, such as fast marching method, can help improve the VPS signal convergence and thus further improve the detection sensitivity and SVD-filtered imaging quality. Moreover, instead of global SVD filtering, block-wise SVD filtering with adaptive cutoff values will improve the visibility of small vessels as well as noise suppression [50].
Compared with previous methods using ring-shaped or spherical transducer arrays, our method using microbubbles as virtual point sources has much lower cost and computational burden. Compared to exogenous contrast agent for improving structure visibility, microbubbles have negligible optical absorption. Microbubbles only redirect the signals from the surrounding blood and thus preserve the functional information, which allows estimation of physiological parameters such as sO2 and blood flow speed. Microbubbles act as virtual point sources, which potentially allow super-resolution imaging via high-precision localization. Most importantly, as microbubbles are FDA approved contrast agents for US imaging, our approach is more clinically translatable than other preclinical contrast agents.
In summary, we expect that our new method VPS-PAT can provide high-fidelity hemodynamic information for preclinical and clinical applications such as disease monitoring, drug assessment, and surgical guidance.
CRediT authorship contribution statement
J.Y conceived and directed the project. Y.T. set up the imaging system, performed all experiments, and analyzed the data. S.T., C.H., P.K., N.C., S.C. and Y.J. contributed to the image reconstruction and data analysis. C.M. contributed to the animal monitoring and microbubble injection. Y.T. and J.Y. wrote the manuscript. All authors discussed the results and approved the writing.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgements
We thank Dr. Caroline Connor for editing the manuscript. This work was sponsored by National Institutes of Health (R01 EB028143, R01 NS111039, RF1 NS115581, R01 HL166522, R21 EB027304, R21EB027981, R43 CA243822, R43 CA239830, R44 HL138185); National Science Foundation CAREER Award (2144788); Chan Zuckerberg Initiative Grant on Deep Tissue Imaging 2020-226178 by Silicon Valley Community Foundation. The authors would like to thank Dr. Pengfei Song for the useful discussion and the engineering team at Sonovol for the technical support.
Biographies

Yuqi Tang received her B.S. in Bioengineering from Rice University in 2017. She is currently a Ph.D. candidate in the Department of Biomedical Engineering at Duke University. Her research interests include ultrasound imaging, photoacoustic functional brain imaging, and imaging processing.

Junjie Yao is an assistant professor of Biomedical Engineering at Duke University, and a faculty member of Duke Center for In-Vivo Microscopy, Fitzpatrick Institute for Photonics, and Duke Cancer Institute. He received his B.E. and M.E. degrees at Tsinghua University, and his Ph.D. in Biomedical Engineering at Washington University, St. Louis. His research interest is in photoacoustic tomography technologies in life sciences, especially in functional brain imaging and early cancer detection.
Footnotes
Supplementary data associated with this article can be found in the online version at doi:10.1016/j.pacs.2023.100450.
Contributor Information
Yuqi Tang, Email: yuqi.tang@duke.edu.
Shanshan Tang, Email: tang.shanshan@mayo.edu.
Chengwu Huang, Email: huang.chengwu@mayo.edu.
Paul Klippel, Email: pbk5088@psu.edu.
Chenshuo Ma, Email: chenshuo.ma@duke.edu.
Nathan Caso, Email: nuc468@psu.edu.
Shigao Chen, Email: chen.shigao@mayo.edu.
Yun Jing, Email: jing.yun@psu.edu.
Junjie Yao, Email: junjie.yao@duke.edu.
Appendix A. Supplementary material
Supplementary material
Data Availability
Data will be made available on request.
References
- 1.Mueller J.K., Grigsby E.M., Prevosto V., Petraglia F.W., Rao H., Deng Z.-D., Peterchev A.V., Sommer M.A., Egner T., Platt M.L., Grill W.M. Simultaneous transcranial magnetic stimulation and single-neuron recording in alert non-human primates. Nat. Neurosci. 2014;17(8):1130–1136. doi: 10.1038/nn.3751. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Taruttis A., Timmermans A.C., Wouters P.C., Kacprowicz M., van Dam G.M., Ntziachristos V. Optoacoustic imaging of human vasculature: feasibility by using a handheld probe. Radiology. 2016;281(1):256–263. doi: 10.1148/radiol.2016152160. [DOI] [PubMed] [Google Scholar]
- 3.Manohar S., Dantuma M. Current and future trends in photoacoustic breast imaging. Photoacoustics. 2019;16 doi: 10.1016/j.pacs.2019.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Diot G., Metz S., Noske A., Liapis E., Schroeder B., Ovsepian S.V., Meier R., Rummeny E., Ntziachristos V. Multispectral optoacoustic tomography (MSOT) of human breast cancer. Clin. Cancer Res. 2017;23(22):6912–6922. doi: 10.1158/1078-0432.CCR-16-3200. [DOI] [PubMed] [Google Scholar]
- 5.Liapis E., Karlas A., Klemm U., Ntziachristos V. Chemotherapeutic effects on breast tumor hemodynamics revealed by eigenspectra multispectral optoacoustic tomography (eMSOT) Theranostics. 2021;11(16):7813–7828. doi: 10.7150/thno.56173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Deán-Ben X.L., Razansky D. Optoacoustic imaging of the skin. Exp. Dermatol. 2021;30(11):1598–1609. doi: 10.1111/exd.14386. [DOI] [PubMed] [Google Scholar]
- 7.Chen Z., Rank E., Meiburger K.M., Sinz C., Hodul A., Zhang E., Hoover E., Minneman M., Ensher J., Beard P.C., Kittler H., Leitgeb R.A., Drexler W., Liu M. Non-invasive multimodal optical coherence and photoacoustic tomography for human skin imaging. Sci. Rep. 2017;7(1):17975. doi: 10.1038/s41598-017-18331-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kratkiewicz K., Manwar R., Rajabi-Estarabadi A., Fakhoury J., Meiliute J., Daveluy S., Mehregan D., (Mohammad) Avanaki K. Photoacoustic/ultrasound/optical coherence tomography evaluation of melanoma lesion and healthy skin in a swine model. Sensors. 2019;19(12):2815. doi: 10.3390/s19122815. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Gottschalk S., Degtyaruk O., Larney B.M., Rebling J., Hutter M.A., Deán-Ben X.L., Shoham S., Razansky D. Rapid volumetric optoacoustic imaging of neural dynamics across the mouse brain. Nat. Biomed. Eng. 2019:1. doi: 10.1038/s41551-019-0372-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Razansky D., Klohs J., Ni R. Multi-scale optoacoustic molecular imaging of brain diseases. Eur. J. Nucl. Med. Mol. Imaging. 2021;48(13):4152–4170. doi: 10.1007/s00259-021-05207-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Deán-Ben X.L., Sela G., Lauri A., Kneipp M., Ntziachristos V., Westmeyer G.G., Shoham S., Razansky D. Functional optoacoustic neuro-tomography for scalable whole-brain monitoring of calcium indicators. Light Sci. Appl. 2016;5(12) doi: 10.1038/lsa.2016.201. (e16201–e16201) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Luís Deán-Ben X., Razansky D. Adding fifth dimension to optoacoustic imaging: volumetric time-resolved spectrally enriched tomography. Light Sci. Appl. 2014;3(1) (e137–e137) [Google Scholar]
- 13.Beard P. Biomedical photoacoustic imaging. Interface Focus. 2011 doi: 10.1098/rsfs.2011.0028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Xia J., Yao J., Wang L.V. Photoacoustic tomography: principles and advances. Electromagn. Waves Camb. Mass. 2014;147:1–22. doi: 10.2528/pier14032303. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Deán-Ben X.L., Ding L., Razansky D. Dynamic particle enhancement in limited-view optoacoustic tomography. Opt. Lett. 2017;42(4):827–830. doi: 10.1364/OL.42.000827. [DOI] [PubMed] [Google Scholar]
- 16.Deán-Ben X.L., Razansky D. On the link between the speckle free nature of optoacoustics and visibility of structures in limited-view tomography. Photoacoustics. 2016;4(4):133–140. doi: 10.1016/j.pacs.2016.10.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Paltauf G., Nuster R., Haltmeier M., Burgholzer P. Experimental evaluation of reconstruction algorithms for limited view photoacoustic tomography with line detectors. Inverse Probl. 2007;23(6):S81–S94. [Google Scholar]
- 18.Zhang P., Li L., Lin L., Hu P., Shi J., He Y., Zhu L., Zhou Y., Wang L.V. High-resolution deep functional imaging of the whole mouse brain by photoacoustic computed tomography in vivo. J. Biophotonics. 2018;11(1) doi: 10.1002/jbio.201700024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Brecht H.-P., Su R., Fronheiser M., Ermilov S.A., Conjusteau A., Oraevsky A.A. Whole-body three-dimensional optoacoustic tomography system for small animals. J. Biomed. Opt. 2009;14(6) doi: 10.1117/1.3259361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Zhang Y., Wang L. Video-rate ring-array ultrasound and photoacoustic tomography. IEEE Trans. Med. Imaging. 2020;39(12):4369–4375. doi: 10.1109/TMI.2020.3017815. [DOI] [PubMed] [Google Scholar]
- 21.Nishiyama M., Namita T., Kondo K., Yamakawa M., Shiina T. Ring-array photoacoustic tomography for imaging human finger vasculature. J. Biomed. Opt. 2019;24(9) doi: 10.1117/1.JBO.24.9.096005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Luís Dean-Ben X., Razansky D. Localization optoacoustic tomography. Light Sci. Appl. 2018;7(4) doi: 10.1038/lsa.2018.4. (18004–18004) [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Zhang P., Li L., Lin L., Shi J., Wang L.V. In vivo superresolution photoacoustic computed tomography by localization of single dyed droplets. Light Sci. Appl. 2019;8(1):36. doi: 10.1038/s41377-019-0147-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Davoudi N., Deán-Ben X.L., Razansky D. Deep learning optoacoustic tomography with sparse data. Nat. Mach. Intell. 2019;1(10):453–460. [Google Scholar]
- 25.Gröhl J., Schellenberg M., Dreher K., Maier-Hein L. Deep learning for biomedical photoacoustic imaging: a review. Photoacoustics. 2021;22 doi: 10.1016/j.pacs.2021.100241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Manwar R., Li X., Mahmoodkalayeh S., Asano E., Zhu D., Avanaki K. Deep learning protocol for improved photoacoustic brain imaging. J. Biophotonics. 2020;13(10) doi: 10.1002/jbio.202000212. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.DiSpirito A., Vu T., Pramanik M., Yao J. Sounding out the hidden data: a concise review of deep learning in photoacoustic imaging. Exp. Biol. Med. 2021;246(12):1355–1367. doi: 10.1177/15353702211000310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.P S., Ca C., S T., R I., H W., C H., A M., Jd T., Be K., Kh L., S C., Ia L. Functional ultrasound imaging of spinal cord hemodynamic responses to epidural electrical stimulation: a feasibility study. Front. Neurol. 2019;10 doi: 10.3389/fneur.2019.00279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Song P., Manduca A., Trzasko J.D., Chen S. Ultrasound small vessel imaging with block-wise adaptive local clutter filtering. IEEE Trans. Med. Imaging. 2017;36(1):251–262. doi: 10.1109/TMI.2016.2605819. [DOI] [PubMed] [Google Scholar]
- 30.Treeby B.E., Cox B.T. k-Wave: MATLAB toolbox for the simulation and reconstruction of photoacoustic wave fields. J. Biomed. Opt. 2010;15(2) doi: 10.1117/1.3360308. [DOI] [PubMed] [Google Scholar]
- 31.Emmer M., van Wamel A., Goertz D.E., de Jong N. The onset of microbubble vibration. Ultrasound Med. Biol. 2007;33(6):941–949. doi: 10.1016/j.ultrasmedbio.2006.11.004. [DOI] [PubMed] [Google Scholar]
- 32.Yu A.C.H., Lovstakken L. Eigen-based clutter filter design for ultrasound color flow imaging: a review. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2010;57(5):1096–1111. doi: 10.1109/TUFFC.2010.1521. [DOI] [PubMed] [Google Scholar]
- 33.Ledoux L.A., Brands P.J., Hoeks A.P. Reduction of the clutter component in Doppler ultrasound signals based on singular value decomposition: a simulation study. Ultrason. Imaging. 1997;19(1):1–18. doi: 10.1177/016173469701900101. [DOI] [PubMed] [Google Scholar]
- 34.Bjaerum S., Torp H., Kristoffersen K. Clutter filters adapted to tissue motion in ultrasound color flow imaging. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2002;49(6):693–704. doi: 10.1109/tuffc.2002.1009328. [DOI] [PubMed] [Google Scholar]
- 35.Hill E.R., Xia W., Clarkson M.J., Desjardins A.E. Identification and removal of laser-induced noise in photoacoustic imaging using singular value decomposition. Biomed. Opt. Express. 2016;8(1):68–77. doi: 10.1364/BOE.8.000068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Rodriguez-Molares A., Rindal O.M.H., D’hooge J., Måsøy vein-E., Austeng A., Bell M.A.L., Torp H. The generalized contrast-to-noise ratio: a formal definition for lesion detectability. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2020;67(4):745–759. doi: 10.1109/TUFFC.2019.2956855. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.J L., C E., D D., P B. In vitro measurements of absolute blood oxygen saturation using pulsed near-infrared photoacoustic spectroscopy: accuracy and resolution. Phys. Med. Biol. 2005;50(18) doi: 10.1088/0031-9155/50/18/011. [DOI] [PubMed] [Google Scholar]
- 38.Li M.-L., Oh J.-T., Xie X., Ku G., Wang W., Li C., Lungu G., Stoica G., Wang L.V. Simultaneous molecular and hypoxia imaging of brain tumors in vivo using spectroscopic photoacoustic tomography. Proc. IEEE. 2008;96(3):481–489. [Google Scholar]
- 39.Wilson S.R., Burns P.N. Microbubble-enhanced US in body imaging: what role? Radiology. 2010;257(1):24–39. doi: 10.1148/radiol.10091210. [DOI] [PubMed] [Google Scholar]
- 40.Wei K., Le E., Bin J.-P., Coggins M., Thorpe J., Kaul S. Quantification of renal blood flow with contrast-enhanced ultrasound. J. Am. Coll. Cardiol. 2001;37(4):1135–1140. doi: 10.1016/s0735-1097(00)01210-9. [DOI] [PubMed] [Google Scholar]
- 41.Dietrich C.F., Averkiou M.A., Correas J.-M., Lassau N., Leen E., Piscaglia F. An EFSUMB introduction into dynamic contrast-enhanced ultrasound (DCE-US) for quantification of tumour perfusion. Ultraschall Med. - Eur. J. Ultrasound. 2012;33(04):344–351. doi: 10.1055/s-0032-1313026. [DOI] [PubMed] [Google Scholar]
- 42.Sirsi S., Borden M. Microbubble compositions, properties and biomedical applications. Bubble Sci. Eng. Technol. 2009;1(1–2):3. doi: 10.1179/175889709X446507. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.G. Pinton, Three dimensional full-wave nonlinear acoustic simulations of ultrasound imaging and therapy in the entire human body, in: Proceedings of the 2012 IEEE International Ultrasonics Symposium, 2012, pp. 142–5.
- 44.Treeby B.E., Zhang E.Z., Cox B.T. Photoacoustic tomography in absorbing acoustic media using time reversal. Inverse Probl. 2010;26(11) [Google Scholar]
- 45.Bjørnerud A., Briley-Sæbø K., Johansson L.O., Kellar K.E. Effect of NC100150 injection on the 1H NMR linewidth of human whole blood ex vivo: dependency on blood oxygen tension. Magn. Reson. Med. 2000;44(5):803–807. doi: 10.1002/1522-2594(200011)44:5<803::aid-mrm19>3.0.co;2-k. [DOI] [PubMed] [Google Scholar]
- 46.Seaton B., Lloyd B.B. The effects of pH on the equilibrium constants of various models for the haemoglobin-oxygen equilibrium in vitro. Respir. Physiol. 1974;20(2):209–230. doi: 10.1016/0034-5687(74)90108-x. [DOI] [PubMed] [Google Scholar]
- 47.Chaigne T., Arnal B., Vilov S., Bossy E., Katz O. Super-resolution photoacoustic imaging via flow-induced absorption fluctuations. Optica. 2017;4(11):1397–1404. [Google Scholar]
- 48.Wissmeyer G., Pleitez M.A., Rosenthal A., Ntziachristos V. Looking at sound: optoacoustics with all-optical ultrasound detection. Light Sci. Appl. 2018;7(1):53. doi: 10.1038/s41377-018-0036-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Dong B., Sun C., Zhang H.F. Optical detection of ultrasound in photoacoustic imaging. IEEE Trans. Biomed. Eng. 2017;64(1):4–15. doi: 10.1109/TBME.2016.2605451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Song P., Manduca A., Trzasko J.D., Chen S. Ultrasound small vessel imaging with block-wise adaptive local clutter filtering. IEEE Trans. Med. Imaging. 2017;36(1):251–262. doi: 10.1109/TMI.2016.2605819. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplementary material
Data Availability Statement
Data will be made available on request.








