Abstract
In the last decade, Ultrafast ultrasound localisation microscopy has taken non-invasive deep vascular imaging down to the microscopic level. By imaging diluted suspensions of circulating microbubbles in the blood stream at kHz frame rate and localizing the center of their individual point spread function with a sub-resolution precision, it enabled to break the unvanquished trade-off between depth of imaging and resolution by microscopically mapping the microbubbles flux and velocities deep into tissue. However, ULM also suffers limitations. Many small vessels are not visible in the ULM images due to the noise level in areas dimly explored by the microbubbles. Moreover, as the vast majority of studies are performed using 2D imaging, quantification is limited to in-plane velocity or flux measurements which hinders the accurate velocity determination and quantification. Here we show that the backscattering amplitude of each individual microbubble can also be exploited to produce backscattering images of the vascularization with a higher sensitivity compared to conventional ULM images. By providing valuable information about the relative distance of the microbubble to the 2D imaging plane in the out-of-plane direction, backscattering ULM images introduces a physically relevant 3D rendering perception in the vascular maps. It also retrieves the missing information about the out-of-plane motion of microbubbles and provides a way to improve 3D flow and velocity quantification using 2D ULM. These results pave the way to improved visualization and quantification for 2D and 3D ULM.
Subject terms: Biomedical engineering, Imaging techniques
Introduction
Ultrasound Localization Microscopy (ULM) recently reached unprecedented spatial and temporal resolutions in biomedical vascular imaging. Although this concept was introduced only a decade ago1–5, research works on ULM have been growing exponentially in the last years. The seminal paper6 providing proof of concept of microscopic vascular imaging at the whole organ scale introduced the key concepts used today in the field: use of ultrafast ultrasound imaging and singular value decomposition for an efficient discrimination between microbubbles and the background tissue signal, localization of the microbubbles positions, tracking of the microbubbles trajectories and finally building of in-depth microscopic vascular map based on the counting of microbubbles or quantification of the microbubble velocities. This proof of concept was performed on the rat brain and applied by several research groups on various organs and animal models, such as rat kidney7, rabbit liver8, tumor models8,9, rat spinal cord10,11 and was even demonstrated in humans for the brain12, breast cancer13, liver and pancreatic tumor imaging14. Some groups have shown alternative image processing techniques, such as non-localization approaches15,16. Very recently, the technique was taken to another level with the achievement of functional ultrasound localization microscopy, shining light on the brain neurovascular activity at a microscopic resolution17. To date, the vast majority of these studies have been done using 2D imaging, as both the linear transducer arrays and driving electronics are far more common in clinical settings and less expensive than matrix arrays, raw-column arrays, and thousand-channels or multiplexed electronics required to perform 3D ultrasound localisation microscopy18,19. Of course, the relatively simpler implementation of 2D ultrasound localization has a drawback, as the lack of information in the elevation direction makes velocimetry inaccurate.
In this work, we show that 2D raw ULM data gathers information about the elevation direction and out-of-plane motion. This information is carried by the amplitude of the individual microbubbles backscattered signal, a parameter which was discarded so far. 2D ULM traditionally assumes that the microbubble signature on an ultrasound image resembles a local 2D point spread function (PSF), and that by retrieving the punctual 2D (x, z) center position that generated this local point spread function one can achieve imaging at a resolution below the diffraction limit. Therefore, the local microbubble signature amplitude in the (x, z) plane is used to precisely locate the (x, z) position of that microbubble. This formulation completely conceals what is an ill-posed 3D problem, with a 2D PSF (we obtain 2D images) function of a 3D space (the objects are distributed in a 3D space). This description has been already used in a very different context for ultrafast Doppler Tomography20. Although the microbubbles distribution cannot be considered as monodisperse and thus leads to different backscattering amplitudes for microbubbles of different radius, the mean value of backscattering amplitudes for a population of isolated microbubbles within each voxel is found to follow a reproducible statistical average. In first approximation, the (x,z) position of the microbubble signature on the image is a function of the (x, z) position of the microbubble in the 3D space, and the average amplitude of the local microbubbles population is a function of the (y, z) position of the microbubbles in the 3D space. We show here that by considering the averaged amplitude of the backscattered signals, we can not only obtain a different contrast more sensitive to microvessels than the usual microbubble count, but also by taking this hypothesis into account we can recover a 3D information and make velocimetry accurate.
Results
ULM backscattering imaging reveals a new contrast for 2D ULM and improves sensibility to small vessels
In ULM, images are conventionally obtained by counting the number of microbubbles detected in each pixel, resulting in MB count maps (often called microbubbles density maps in the literature). To image the amplitude of the backscattered signal of microbubbles in 2D ULM, we rather attribute to each pixel the average of the backscattered amplitudes (measured as the maximum of the PSF on the B-Mode image) of all the successive MBs detected in this pixel. The two resulting images are shown in Fig. 1. Two aspects are important here: (i) the working frequency (15 MHz) is relatively high compared to the frequencies at which resonant phenomenon occurs with Sonovue microbubbles21,22 and (ii) the backscattered amplitude measured in the pixel is averaged on numerous bubbles (a few to few hundreds). This enables us to consider that (i) the scattering cross section distribution due to the polydispersity of Sonovue microbubbles will be restricted to a relatively narrow range (compared the situation with a lower working frequency, e.g. 3 MHz); and that (ii) local averaging of the backscattered amplitude will converge rapidly toward a value related to the average size of the microbubbles that explored this pixel. Therefore, we considered that the locally averaged backscattered signal is not influenced by the polydispersity of Sonovue, but is determined mainly by the propagation medium, the transducer diffraction pattern characteristics and the exact position of this microbubble within the transmitted acoustic field.
The first thing to notice in Fig. 1A is the difference in information content between images of MB count and images of backscattering amplitude. A zoom in a thalamic region of interest (blue rectangle) highlights that backscattering imaging enables a better detection and delineation of small blood vessels, as shown by the green arrows in Fig. 1B,C. It is worth noticing that the same detected MBs are used for the two images, it is only the mapped parameter that is different. The microbubble count and backscattering amplitude images are shown in dB with a lower bound set at their respective noise floor. Backscattering amplitude images depict well delineated vessels invisible in MB count mapping (Fig. 1B,C, green arrows).
Backscattering from MB measured during 2D ULM imaging brings 3D information on blood vessels position in the out-of-plane direction
As the backscattered energy from individual microbubbles depends only on the amplitude of the pressure wave that reaches them, the backscattered amplitude is directly linked to the position of each microbubble within the transmit pressure field. Thus, backscattering imaging can be considered as the projection of the pressure field on the blood vessels positions. The pressure field created by the transducer (a linear array with a geometrical focusing in elevation) is represented in Fig. 2A (detailed simulation characterization can be found in Fig. Suppl. 1): the acoustic intensity decreases with depth (Z) because of ultrasonic attenuation along the travel path; along the out-of-plane dimension, the US beam has a certain width which varies across depth (depending on the elevation focalization and the attenuation properties). This depth dependence of the image thickness in elevation explains that more vessels are often detected in the cortical regions (before the elevation focus) compared to deeper regions (around the elevation focus) (Fig. 2A), because the image thickness is larger in the near field compared to thickness at focus. For a fixed (x0, z0) position in the imaging plane, the pressure intensity is maximal in the middle and decreases from either side (Fig. 2A bottom). As a result, for a given pixel (x0, z0) in the 2D ULM image, the energy backscattered by the micro bubbles detected in that pixel (Fig. 2B) depends on their position along Y within the US beam (Fig. 2C).
Illustrations of this physical phenomenon are given in Fig. 3. The backscattering amplitude profile of a MB flowing through a blood vessel crossing the imaging plane (represented by the red line on the backscattering image in Fig. 3A) is given in Fig. 3B: as the MB enters the US beam, the incident acoustic amplitude it receives and therefore backscatters is minimal, then reaches a peak at the centre of the beam and finally decreases back as it leaves the US beam. On the backscattering images, such vessels crossing the imaging plane will appear the brightest where the vessel is in the centre of the field (green arrows), gradually darkening as the blood vessel becomes closer to the US beam edges (blue arrows). In the cortex, when imaging a coronal plane, blood vessels are almost parallel to the imaging plane so the backscattering amplitude does not vary much within the vessel. However, different vessels located at different Y positions (green, red and blue arrows on Fig. 3C) will appear in different shades of grey (whitest for the vessel (green arrow) closest to the middle of the beam, darker for the vessels closer to the beam edges (blue and red arrows). This is confirmed by the histograms of the backscattering amplitudes of the MBs travelling in those 3 vessels (Fig. 3D): MBs running through the green arrow vessel have on average higher backscattering amplitudes (green histogram). A last example is the case of blood vessels which are superimposed on a 2D ULM image, such as in Fig. 3E where a couple of close vessels has been highlighted with a white bar cross section. Those two vessels are slightly apart close to the cortical surface, before being completely superimposed in depth. Gathering the backscattering amplitudes of all the MBs flowing through the white segment (in Fig. 3E) in a histogram reveals an obvious two-component mixture distribution of the MB backscattering amplitude (Fig. 3F), and therefore that two populations of MBs are probably flowing at different Y positions. As the orientation of arterioles and venules is well known in the cortex, it is possible to separate the MB arterial tracks from the MB venous tracks based on their axial velocity, respectively positive (downward, red) and negative (upward, blue) (Fig. 3E), and reveal that our two vessels are an arteriole and a venule. When separating the MBs based on their arteriolar or venous nature, the two underlying backscatter amplitude distributions can be found (Fig. 3G): the venule is located closer to the centre than the artery, as the MBs from the venule display higher backscattering amplitudes.
Backscattering imaging using 2D ULM in different planes enables 3D super-resolved localization
We then hypothesized that localizing the blood vessels in the out-of-plane direction was possible using the backscattering information available in 2D ULM imaging. To test this hypothesis, backscattering amplitude imaging of five parallel coronal planes distant from 100 µm each were used (Fig. 4A). For each (x, z) pixel, a Gaussian function (see “Methods”) is fitted on the backscattering amplitudes measured for the 5 acquisition planes (Fig. 4B). This fit is used to determine the sub-resolution position of the maximum of the backscattering amplitude function, corresponding to the position y0 of the blood vessel. The validity of this gaussian fitting could be confirmed by two aspects. First, the parameter w(x, z) quantifying the width of the gaussian fit can be averaged on pixels at the same depth to give wexp(z), which is found to be in good agreement with the ultrasound beamwidth wsim(z) obtained using ultrasound pressure field simulations23,24 with this exact ultrasound transducer (Fig. 4C). Second, the y0 parameter depicting the out-of-plane position of the vessel varies smoothly in vessels crossing the imaging plane, as shown on thalamic vessels in Fig. 4D. This smoothness can be further increased (i.e. the noise on y0 decreased) by re-estimating the positions y0 of the blood vessels while constraining the width of the gaussian fit to the value found experimentally wexp(z) (Fig. 4E) or by simulation wsim(z) (Fig. 4F), with a good agreement between the two methods.
Backscattering imaging in 2D ULM retrieves 3D speed vector estimations
Another source of bias in 2D ULM is that the blood velocity can only be estimated from the two in-plane components of the speed vector. The missing out-of-plane component of the speed vector is responsible for the underestimation of the true speed, especially for blood vessels crossing the imaging plane. Here, we use the backscattering information of a single plane acquisition to access the out-of-plane component (Fig. 5A–D) using a simplified framework. The in plane 2D component of the flow speed is determined classically using the differential of the successive MB positions in time (Fig. 5A), while the out of plane component is deduced from a modelling of the out-of-plane angle of the vessel: assuming a rectilinear crossing of the US beam by the vessel (as depicted by the maroon line in Fig. 5B), we can estimate the angle between this blood vessel and its projection on the imaging plane from the backscattering profile along this vessel (Fig. 5C) and the knowledge of the beam width. We did it for 4 distinct vessels using a single 2D ULM acquisition corresponding to the central plane of the 5-plane experiment. We obtained a good agreement between the angles found from the single plane ULM acquisition and the angles obtained using the multiplane experiment (Fig. 5D).
The speed vector can then be corrected thanks to the knowledge of this angle. A comparison between the estimation of speed usually done in 2D versus the corrected speed using the backscattering profile based on a single plane acquisition is given in Fig. 5E,F. We also show as a ground truth the speed estimation using the 3D localization thanks to the 5-plane experiment (Fig. 5G). The velocity was largely underestimated when using 2D ULM only (Fig. 5E) compared to when corrected using the backscattering amplitude information in one plane only (Fig. 5f). We found that for the four vessels investigated, the error on the speed was 100 ± 80% using conventional 2D ULM, but reduced to 20 ± 20% after correction using the monoplane speed correction. It has to be noted that in the case of vessels almost perpendicular to the imaging plane, the 1/cos(θ) correction factor will become unreliable as θ ~ 90°. Thus, quantification of the out-of-plane component of the speed vector in the case of a vessel almost perpendicular to the imaging plane is not possible.
Discussion
Backscattering imaging, a contrast overlooked until now, provides a new informative parameter in Ultrasound Localization Microscopy. First, backscattering imaging delineates more small vessels than conventional ULM images (Fig. 1B,C) due to an intrinsic lower spatial noise. But these images also present an interesting 3D rendering effect as the backscattering amplitude intrinsically conveys physical information about the out-of-plane distance. Finally, and even more importantly, this backscattering amplitude can be exploited to recover the missing information about motion in the out-of-plane direction (Fig. 5), even with a single plane 2D ULM acquisition.
The effect of signal to noise ratio (SNR) on the microbubble localization is similar to the conventional ULM approach as the localization process does not change in the backscattering amplitude method. This SNR influence on the localization estimates was extensively studied in former works and linked to the Cramer Rao Lower Bound Theory25.
Regarding the influence of the SNR on the estimates of the backscattering amplitude, the precision of this measurement is strongly linked to the number of detected microbubbles with the pixel of interest. In large vessels, the number of microbubbles detected is very large and the mean value of the backscattering amplitude corresponds to a value weakly dependent on the microbubble size distribution and the depth.
Backscattering ULM imaging is less sensitive to noise and better detects those small vessels compared to conventional MB count ULM. In MB Count maps, the signal is driven by blood flow (the bigger the blood flow, the more MBs are detected during the acquisition time). In backscattering imaging, the signal is mainly driven by the position of the blood vessels within the ultrasound beam independently from hemodynamics. One should notice that although these images are extracted from the same raw data, the noise signal due either to false or missed detections has a lower influence in backscattering imaging than in conventional ULM: respectively they will be averaged out in the estimation of the backscattering amplitude signal, while they will extensively add noise to the value of the MB count. Backscatter imaging could also be more adapted for segmentation algorithms and could provide better insights on the size and order of branching capillaries detected using ULM imaging.
Backscattered amplitude images have a better SNR compared to MB count images. Indeed, using a simple statistical model it can be shown that the ratio between the local SNR in backscattering images and the local SNR in microbubbles count images can be approximated by the ratio between the expected average value of backscattered amplitude and its standard deviation , this ratio being > 1 (see “Methods” section):
Thus, SNR of backscattered amplitude maps is intrinsically superior to the conventional ULM maps for the same underlying dataset.
Some important assumptions were made in this work. We considered that the polydispersity of the Sonovue microbubbles did not influence the locally (pixel-wise) averaged backscattered amplitude measurement, and therefore that the backscattered amplitude measurement was only probing the local acoustic field magnitude. The polydispersity properties of Sonovue are well characterized, and advocate for this consideration: according to the literature 80% of the microbubble contained in a solution of Sonovue are within the 1 µm to 4 µm diameter range (and 90% < 8 µm diameter)21,22. At the working frequency of 15 MHz, largely above resonant phenomena (e.g. for a 3 µm microbubble, resonance occurs at ~ 4.5 MHz), this results in a restricted range of scattering cross section (Sonovue cross section is 20µm2 for Ø = 2.2 µm, 85µm2 for Ø = 5 µm, therefore resulting in a ratio ~ 2 in backscattered amplitude). Averaging over a sufficient number of microbubbles further decreases the influence of polydispersity. The validity of this assumption is further supported by the very low spatial noise level when comparing within vessels the very similar amplitude of neighboring pixels, each one being estimated using independent microbubbles populations. The limited influence of polydispersity of the Sonovue microbubbles might nevertheless be questioned in the smallest vessels. In such very small vessels, we both filter out the largest microbubbles within the diameter distribution and also suffer from a lower microbubble count, resulting in an increased noise when estimating the expected mean value. However, the low level of noise in the backscattering images presented in this article, even in the small vessels, advocates for the validity of this assumption. Similarly to 2D ULM localization, the hypothesis that the individual MBs are completely isolated might not always be valid, particularly for large vessels. It is even more likely along Y elevation direction as the diffraction limit set by the US beam focalization is around 500 µm in the elevation direction in comparison to 100 µm within the imaging plane. This might be the reason why backscattering amplitude rockets in very large vessels (Fig. 1). In those locations, the backscattering amplitude is likely to be driven by the classical speckle amplitude statistics, and on average be function of the square root of the number of microbubbles exploring the pixel (see26 for a detailed calculation). Also, another limitation when displaying the backscattered amplitude maps occurs when considering vessels strictly perpendicular to the imaging plane, as they will span a whole range of Y-position for the same pixel. In that case, considering other statistical information than the average might help to display accurate information. And finally, microbubbles need to present enough either in-plane motion or amplitude changes to be detected through the SVD-filtering process and not be considered as a tissue-like signal.
Of course, 3D ULM imaging can be achieved using either fully populated 2D matrix array technologies19 or Raw Column Arrays (RCA) technologies27–30. However, to date, conventional linear arrays are mainly used for ULM imaging because they are cheaper, simpler and have a much better sensitivity compared to matrix arrays. The backscattering ULM imaging approach proposed here could be used as is for backscattering amplitude contrast mapping, and only requires minimal characterization of the transducer (pressure field measurement) to deliver more accurate speed quantifications for those 2D acquisitions. For multi plane experiments, the localization technique combined with backscatter amplitude imaging provides 3D volumetric images with a sub-wavelength resolution in the out-of-plane direction. Using one single plane acquisition, the symmetry of the problem along the elevation direction did not allow retrieving the exact location of the microbubble in the out-of-plane direction (below or above the imaging plane) but only its absolute distance to the imaging plane. Nevertheless, the 3D correction of the speed vector does not require this knowledge and although it was presented in a very simple situation, with a very simple solution assuming short sections of vessels are rectilinear, it could be further refined to offer reliable speed quantification for 2D-ULM. This manuscript is only a proof of concept and further work will be needed to build robust quantification tools using corrected microbubbles velocities performing in different experimental conditions. For example, the vessels could be split in different segments based on the regularity of the backscattered amplitude, or this speed correction could be done on a “microbubble track basis” instead of on a “vessel basis”. This will be particularly relevant in a clinical context with increased motion of organs. In most situations at ultrafast framerate, the transit time of microbubbles is short compared to the typical time of tissue motion, which will allow for use of the backscattering imaging and speed correction in the presence of moderate motion. For fast moving organs, synchronized acquisitions with the ECG or breathing signal can be envisioned although their efficacy remains limited. As the spatial distribution of pressure amplitudes depends on the probe characteristics, a calibration is also needed if one wants to accurately quantify the out-of-plane component for a given probe. This is not really a limitation, especially for clinical application, as ultrasound transducers are calibrated for various aspects, the first one being safety considerations (acoustic output calibration measurements).
For out-of-plane quantification, an interesting parallel can be drawn between our method based on the averaging the backscattered amplitude function combined with 2D ULM and former research works31 devoted to recover the out-of-plane component of blood velocity using contrast-free ultrasound Doppler imaging and the averaging the correlation function. Even if these two approaches rely on very different assumptions: stationary directionality of the flow during the acquisition (in Rubin et al.31) and preserved spatial directionality along the measured vessel segment (in our study), both methods used the same general two-steps idea. Both measures in plane motion (using Doppler imaging for Rubin et al.31 and using microbubbles localization in our work) combined with another in-plane information (the in-plane temporal loss of correlation of backscattered signals in31 and the spatial variation of averaged backscattered amplitude in our present study). The out-of-plane component of motion is extracted for both methods by fitting the estimates (correlation loss and spatial variation of backscattered amplitude) with calibrated gaussian shapes depending on the physical properties of the transducer.
Finally, we mainly investigated the 3D / US beam influence on the backscattering ULM images. However, other parameters within the vascular network, for instance vessel blood pressure (veinous vs arteries) could also potentially influence the backscattering properties and could be further investigated.
Methods
Animals
All experiments were performed in compliance with the European Community Council Directive of September 22, 2010 (010/63/UE) and were approved by the french Ethics Committee (Comité d’éthique en matière d’expérimentation animale N°59, ‘Paris Centre et Sud’, project #2017-23). All methods are reported in accordance with ARRIVE guidelines. Accordingly, the number of animals in our study was kept to the necessary minimum following the 3Rs (Reduce, Refine, Replace) guidelines. Experiments were performed on N = 3 male (Age 7–9 weeks) Sprague–Dawley rats (Janvier Labs; Le Genest St Isle, France), weighing 200-300 g at the beginning of the experiments. Animals (housed two per cage) arrived in the laboratory 1 week before the beginning of the experiment and were maintained under controlled conditions (22 ± 1 °C, 60 ± 10% relative humidity, 12/12 h light/dark cycle, food and water ad libitum). At the end of the experiments, animals were sacrificed under anaesthesia with a quick cervical dislocation. All animals included in this study were untreated and were used randomly in the various experiments.
Surgical procedure and preparation for imaging
Under deep anaesthesia (intraperitoneal (IP) bolus of medetomidine (Domitor, 0.4 mg.kg) and ketamine (Imalgène, 40 mg.kg–1)), a catheter filled with saline was inserted in the jugular vein of the rat before positioning the animal on the stereotaxic frame. A craniotomy (removal of the skull) was then performed between Bregma and Lambda. During the surgical procedure and the imaging session, the animals’ body temperature was kept at 37 °C using a heating blanket and an intra-rectal probe (Physitemp, USA). Around 45 min after induction (when the craniotomy was completed), the anaesthesia was maintained but reduced, using subcutaneous perfusion of Medetomidine (0.1 mg/kg/h) and ketamine (12.5 mg/kg/h) with a syringe pump. The heart and respiratory frequencies were monitored continuously to ensure stability of the anaesthesia (Labchart, AD Instruments). Each imaging session lasted between 2 and 4 hrs. Two milliliters of saline were gently dropped on to the brain (the dura mater was kept intact), followed by echographic gel (Dexco Medical, France). The ultrasonic probe was then positioned just above the window, using a three-axis motorized system on which the ultrasound probe was fixed.
Ultrasound data acquisition
ULM acquisitions were performed similarly to the methods described by Demené et al.12, but using a continuous injection at a 3.5 mL/h dose of Sonovue (Braco, Italy, reconstructed in 5 mL of saline, as recommended by the manufacturer), using a push syringe (KD Scientific, USA). A magnet was inserted in the syringe in order to mix the microbubbles solution during the acquisition. Continuous injections enabled a stable number of MBs to be secured for more than 20 min with approximately 30 MBs per ultrasound frame after detection and tracking. Raw radiofrequency (RF) data were acquired to achieve a continuous 1000 Hz framerate (each frame is a compound image acquired with angles at − 5°, − 2°, 0°, + 2°, + 5° fired at a 5000 Hz Pulse Repetition Frequency) using a 15 MHz probe (128 elements, 15 MHz, L15-XTech technology, 110 µm pitch, 8 mm elevation focus, Vermon, Tours, France) driven by a research programmable ultrasonic scanner ( Vantage 128 channels, Verasonics, Seattle, USA). The pulse shape corresponds to 2 periods of sinusoids, the transmit voltage is 5 V, the Mechanical index is 0.09 (measured using a calibrated membrane hydrophone in a degassed water tank (ACERTARA, Longmont, Colorado, USA)). The natural ultrasound resolution for the current setup (15 MHz frequency, 110 µm pitch, 2 cycles) and beamforming (f/d = 1) is ~ 100 µm. No specific harmonic pulse sequence was used. A constant Time Gain Compensation (TGC) profile was used to simplify subsequent depth-dependent analysis. The raw radiofrequency (RF) data were beamformed using a constant f/d ratio.
For the multiplane experiments, the probe was moved along the rostro-caudal axis with a 100 µm step between each of the 5 planes. A block of 400 compounded frames (1 kHz framerate, 5 kHz Pulse Repetition Frequency) was acquired for the first block before moving to the second block, and so on, with a 150 ms pause to allow enough time for the motors to move. At the end of the 5th plane the probe was moved back to the first plane. This was repeated so that 525 blocks of 400 ms were acquired for each plane, leading to a 210 s accumulation time for the ULM images.
Ultrasound localization microscopy processing
Data continuously acquired were processed as chunks of 400 compounded frames as described in this paragraph. Beamformed data were filtered using the SVD spatio-temporal clutter filter32,33 to discriminate the ultrasonic signature of individual microbubbles from tissue signals; Indeed, the spatiotemporal clutter filter based on SVD was shown able to extract the microbubbles signature from compounded data without requiring any nonlinear transmit sequence32. The 10 first singular values were discarded. Images were interpolated (Lanczos interpolation kernel) down to (probe spatial pitch/6 × λ/6). A binary mask was built based on the vesselness filtering34,35 of this stack of images (3D implementation available on Mathworks file exchange, ©Dirk-Jan Kroon2009, and ©Tim Jerman, 2017). Microbubbles were detected as the brightest local maxima with high correlation (> 0.5) with a typical point spread function (imaging response of an isolated microbubble, modeled as a Gaussian spot of axial and lateral dimension of lambda). Sub-pixel maxima localization was then performed using a fast local second-order polynomial fit. The resulting coordinates were rounded to the chosen pixel size (here 13.75 × 12.5 µm = initial pixel size/8). Tracking of the maxima positions was performed using a classical particle tracking algorithm (simpletracker.m available on Mathworks ©Jean-Yves Tinevez, wrapping Matlab Munkres algorithm implementation of ©Yi Cao 2009), with no gap filling and maximal linking distance corresponding to a 100 mm/s maximum speed. Only tracks with MB detected in at least 10 successive ultrafast frames were selected. The successive positions gathered in one track were used to compute the interframe bubble velocity vector components (along probe x-axis and depth z-axis) and absolute velocity magnitude. We added a linear spatial interpolation on each track to count one MB detection in every pixel on the MB path. Then this whole processing is repeated for the next chunk of 400 compounded frames, and so on.
Maps of MB Count were here computed by counting all the MBs detected in one pixel during the whole acquisition time (20 min). Nevertheless, similar image quality can already be obtained with reduced acquisition times of 60 s. Velocity maps were computed as their mean velocity. In plane pixel size for image reconstruction is ~ 13 µm (13.75 × 12.5 µm). To take into account unavoidable motion drift occurring on time scales much slower than the cardiac or breathing time scales, we also added an intensity-based spatial registration (translation transformation) based on 10 s ULM MB Count maps (dimension x,z,t) to correct for any drift during the global acquisition time (> 20 min). We used Matlab functions imregconfig (monomodal option) and imregtfrom (translation option).
Backscattering imaging
During the processing to create ULM images, microbubbles were detected as brightest local maxima with a good correlation with the PSF on BMode images. The value of this maxima on the BMode images were extracted and associated with each localized MB detection. This value is referred to as the backscattering amplitude. Then, instead of attributing to each ULM map’s pixel the number of MB detected in this pixel during the whole acquisition, we attribute to each pixel the mean value of the backscattering amplitude of the MBs detected in that particular pixel. The grid chosen is the same as the one chosen for the MB Count and Velocity maps.
MB backscattering time courses and histograms
For the backscattering time courses and histograms, shown in Figs. 3 and 5C, MB tracks from particular blood vessels are isolated by choosing a segment transversal to the blood vessel and selecting one or all the tracks passing through this segment. The backscattering amplitude of those MB are used to create the histograms and time courses.
Multiplane elevation localization
For each of the 5 planes, a backscattering ULM map is created. As the planes are separated from 100 µm and the beam width is over 500 µm, the same blood vessels are present on the different ULM maps. For each pixel, a gaussian fit is performed on the 5 backscattering amplitudes from the 5 planes (Fig. 4B). The position of the blood vessel corresponding to the pixel in the elevation direction (Y) is given by the y position where this fit is maximum: y0. This fit is supposed to correspond to the US amplitude field along Y for each (x, z) position. a1 corresponds to the amplitude and is supposed to decrease along the depth due to ultrasonic attenuation, w corresponds to the width of the beam, which is the largest near the transducer, converges towards the focal depth where it is minimal and then diverges. The resulting localization is displayed Fig. 4D.
We consider that the US intensity field is the same at each depth (which is roughly true, except close from the edges of the plane in the X direction), the beam width wexp is estimated by averaging along each depth all w measured for each pixel. Outliers are first excluded. Figure 4C displays the resulting experimental width in purple (mean ± SEM). A median filter (was first applied along the Z depth direction).
For each pixel, we then perform again a fit on the 5 backscattering amplitudes, but constraining the w by the experimental measurement wexp (Fig. 4E). We also do it by constraining with the w value obtained by the simulation wsim (linked to the Full Width Half Maximum (FWHM) of the simulated ultrasound intensity profile along Y by ), shown in Fig. 4F.
Speed correction in multiple planes acquisitions
Now that we have the 3D localization of the blood vessels, we attribute to each MB detection its y localization depending on the position of the blood vessel it belongs to at the (x, z) position it was detected. We can measure the angle between the vessels and the imaging plane knowing the y positions. We can also run again the speed calculation for every track but this time also using the y component.
Speed correction in single plane acquisitions
We first extract the tracks which belong to the blood vessel we want to correct the speed estimation of, and then obtain the backscattering profile along the vessel’s centerline. We calculate the angle as (see Fig. 4C for the geometric construction). OH is evaluated by the FWHM in curvilinear abscissa of the backscattering profile along the centerline. HM, the beam width, is evaluated by the FWHM of the simulated ultrasound intensity profile. We then compute the corrected speed by , where VXZ is the speed calculated in conventional 2D ULM.
US beam simulation
The spatial ultrasound field transmitted by the ultrasonic probe is simulated using Field II software23,24. The simulation parameters are described in Table 1. An apodization along elevation is modelled as an Hanning window scaled between 0.4 and 1, and along x as a Kaiser window.
Table 1.
Ultrasound probe parameters | Simulation parameters | ||
---|---|---|---|
Frequency | 15.625 MHz | Speed of sound | 1540 m/s |
Nb piezo elements | 128 | Attenuation | 134.24 Np/m (value for brain white matter at 15.625 MHz © 2010–2022 IT’IS foundation) |
Dimension piezo elements | Spatial sampling | ||
X | 108 µm | X | 100 µm |
Y | 1.5 mm | Y | 10 µm |
Z | 100 µm | ||
Inter element distance (kerf) | 2 µm | Sampling frequency | 300 MHz |
Elevation focus | 8 mm | Input waveform | 2 periods of sinusoid |
The 3D (xyz) pressure field is simulated in space and time after emission of a plane wave with the said excitation by the defined transducer array. In each point of space (x, y, z) is therefore recorded a pressure signal p(t). In that simple case, the amplitude of this p(t) can be seen as proportional to an amplitude antenna gain. To account for the antenna gain in both transmission and reception, this pressure is squared, before taking the maximum value in time. Once normalized in space, this quantity defines the simulated backscattering ultrasound intensity that is displayed in Fig. 2 and used to determine the simulated beam width on several occasions throughout the article.
Signal to noise ratio in backscattered amplitude maps and microbubbles count maps
The difference of SNR between the MB count image and the backscattering amplitude image can be comprehended using a simple statistical modeling. Consider the random variable X that represents the (averaged) backscattering image in the neighborhood of an in-plane small vessel (each pixel being an observed value of this random variable) and the random variable Y that represents the microbubble count in the same set of pixels. Let’s assume that the expected number of microbubbles per pixel is N. being an average value per pixel (average of all backscattered amplitudes measured within one pixel), it depends on another random variable that represents the measured values of backscattering amplitude within one pixel, and . The expected value is the average backscattered amplitude value (depending on the out of plane position of the vessel), and the variance explains the dispersion of the backscattering amplitude. Examples of the distribution of can be found experimentally in the manuscript in Fig. 3D and G. It is worth noting that generally speaking (in the data presented in Fig. 3D, ranges from 2.6 to 2.9).
The SNR of the backscattering image can be expressed as:
The development of the denominator being the standard error of the mean, and being the number of measurements (number of microbubbles per pixel).
On the other hand, represent the microbubble count, and is therefore following a Poisson distribution of parameter , with . It follows that the SNR of the microbubble count image can be expressed as:
As a result, we have:
It shows that the SNR of the backscattered amplitude contrast is intrinsically superior to the microbubble count contrast, for the same underlying dataset (same MBs).
Supplementary Information
Author contributions
C.D. and M.T. supervised the work. N.R., S.P. and M.T. designed the experiments. N.I.-R. and S.P. performed the surgeries. N.R. and S.P. performed the experiments and acquired the ultrasound data. N.R., C.D. and M.T. analyzed the data. N.R., C.D. and M.T. wrote the paper.
Funding
The funding was provided by AXA Research Fund, Chair New Hopes in Medical Imaging with Ultrasound and by the European Innovation Council EIC Pathfinder Programme Project MICROVASC n° 101070917.
Data availability
The datasets used and analyzed during the current study available from the corresponding author on reasonable request.
Code availability
Custom codes used for the collection and analysis of the data used in this study are protected by Inserm and can only be shared upon request, with the written agreement of Inserm.
Competing interests
M.T. is a co-founder and shareholder of the Iconeus company, which commercializes ultrasound neuroimaging scanners. M.T. is a co-inventor of the patent WO2012080614A1 filed on 2010-12-16 and licenced to Iconeus company. All other authors declare no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
These authors jointly supervised this work: Charlie Demene and Mickael Tanter.
Supplementary Information
The online version contains supplementary material available at 10.1038/s41598-023-38531-w.
References
- 1.Couture, O., Besson, B., Montaldo, G., Fink, M. & Tanter, M. Microbubble ultrasound super-localization imaging (MUSLI). In 2011 IEEE International Ultrasonics Symposium, 1285–1287 (2011). 10.1109/ULTSYM.2011.6293576.
- 2.Siepmann, M., Schmitz, G., Bzyl, J., Palmowski, M. & Kiessling, F. Imaging tumor vascularity by tracing single microbubbles. In 2011 IEEE International Ultrasonics Symposium, 1906–1909 (2011). 10.1109/ULTSYM.2011.0476.
- 3.Desailly Y, Couture O, Fink M, Tanter M. Sono-activated ultrasound localization microscopy. Appl. Phys. Lett. 2013;103:174107. doi: 10.1063/1.4826597. [DOI] [Google Scholar]
- 4.Viessmann OM, Eckersley RJ, Christensen-Jeffries K, Tang MX, Dunsby C. Acoustic super-resolution with ultrasound and microbubbles. Phys. Med. Biol. 2013;58:6447–6458. doi: 10.1088/0031-9155/58/18/6447. [DOI] [PubMed] [Google Scholar]
- 5.O’Reilly MA, Hynynen K. A super-resolution ultrasound method for brain vascular mapping. Med. Phys. 2013;40:110701. doi: 10.1118/1.4823762. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Errico C, et al. Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging. Nature. 2015;527:499–502. doi: 10.1038/nature16066. [DOI] [PubMed] [Google Scholar]
- 7.Foiret J, et al. Ultrasound localization microscopy to image and assess microvasculature in a rat kidney. Sci. Rep. 2017;7:13662. doi: 10.1038/s41598-017-13676-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Zhang W, et al. Super-resolution ultrasound localization microscopy on a rabbit liver VX2 tumor model: An initial feasibility study. Ultrasound Med. Biol. 2021;47:2416–2429. doi: 10.1016/j.ultrasmedbio.2021.04.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Lowerison MR, Huang C, Lucien F, Chen S, Song P. Ultrasound localization microscopy of renal tumor xenografts in chicken embryo is correlated to hypoxia. Sci. Rep. 2020;10:2478. doi: 10.1038/s41598-020-59338-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.van Sloun RJG, et al. Super-resolution ultrasound localization microscopy through deep learning. IEEE Trans. Med. Imaging. 2021;40:829–839. doi: 10.1109/TMI.2020.3037790. [DOI] [PubMed] [Google Scholar]
- 11.Claron J, et al. Large-scale functional ultrasound imaging of the spinal cord reveals in-depth spatiotemporal responses of spinal nociceptive circuits in both normal and inflammatory states. Pain. 2021;162:1047–1059. doi: 10.1097/j.pain.0000000000002078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Demené C, et al. Transcranial ultrafast ultrasound localization microscopy of brain vasculature in patients. Nat. Biomed. Eng. 2021;5:219–228. doi: 10.1038/s41551-021-00697-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Opacic T, et al. Motion model ultrasound localization microscopy for preclinical and clinical multiparametric tumor characterization. Nat. Commun. 2018 doi: 10.1038/s41467-018-03973-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Huang C, et al. Super-resolution ultrasound localization microscopy based on a high frame-rate clinical ultrasound scanner: An in-human feasibility study. Phys. Med. Biol. 2021;66:08NT01. doi: 10.1088/1361-6560/abef45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Zhang J, et al. Ultrasound microvascular imaging based on super-resolution radial fluctuations. J. Ultrasound Med. 2020;39:1507–1516. doi: 10.1002/jum.15238. [DOI] [PubMed] [Google Scholar]
- 16.Chen X, et al. Localization free super-resolution microbubble velocimetry using a long short-term memory neural network. IEEE Trans. Med. Imaging. 2023 doi: 10.1109/TMI.2023.3251197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Renaudin N, et al. Functional ultrasound localization microscopy reveals brain-wide neurovascular activity on a microscopic scale. Nat. Methods. 2022;19:1004–1012. doi: 10.1038/s41592-022-01549-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Heiles B, et al. Ultrafast 3D ultrasound localization microscopy using a 32 $\times$ 32 Matrix Array. IEEE Trans. Med. Imaging. 2019;38:2005–2015. doi: 10.1109/TMI.2018.2890358. [DOI] [PubMed] [Google Scholar]
- 19.Demeulenaere O, et al. Coronary flow assessment using 3-dimensional ultrafast ultrasound localization microscopy. JACC Cardiovasc. Imaging. 2022;15:1193–1208. doi: 10.1016/j.jcmg.2022.02.008. [DOI] [PubMed] [Google Scholar]
- 20.Demené C, et al. 4D microvascular imaging based on ultrafast Doppler tomography. NeuroImage. 2015 doi: 10.1016/j.neuroimage.2015.11.014. [DOI] [PubMed] [Google Scholar]
- 21.Gorce JM, et al. Influence of bubble size distribution on the echogenicity of ultrasound contrast agents: A study of SonoVue™. Investig. Radiol. 2000;35(11):661–671. doi: 10.1097/00004424-200011000-00003. [DOI] [PubMed] [Google Scholar]
- 22.Schneider M. Characteristics of SonoVue™. Echocardiography. 1999;16:743–746. doi: 10.1111/j.1540-8175.1999.tb00144.x. [DOI] [PubMed] [Google Scholar]
- 23.Jensen J. FIELD: A program for simulating ultrasound systems. Med. Biol. Eng. Comput. 1996;34:351–352. [Google Scholar]
- 24.Jensen JA, Svendsen NB. Calculation of pressure fields from arbitrarily shaped, apodized, and excited ultrasound transducers. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 1992;39:262–267. doi: 10.1109/58.139123. [DOI] [PubMed] [Google Scholar]
- 25.Desailly Y, et al. Resolution limits of ultrafast ultrasound localization microscopy. Phys. Med. Biol. 2015;60(22):8723–8740. doi: 10.1088/0031-9155/60/22/8723. [DOI] [PubMed] [Google Scholar]
- 26.Deffieux T, et al. Functional ultrasound imaging: A new imaging modality for neuroscience. Neuroscience. 2021;474:110–121. doi: 10.1016/j.neuroscience.2021.03.005. [DOI] [PubMed] [Google Scholar]
- 27.Jensen JA, et al. Three-dimensional super-resolution imaging using a row-column array. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2020;67:538–546. doi: 10.1109/TUFFC.2019.2948563. [DOI] [PubMed] [Google Scholar]
- 28.Sauvage J, et al. A large aperture row column addressed probe for in vivo 4D ultrafast doppler ultrasound imaging. Phys. Med. Biol. 2018;63:215012. doi: 10.1088/1361-6560/aae427. [DOI] [PubMed] [Google Scholar]
- 29.Flesch M, et al. 4D in vivo ultrafast ultrasound imaging using a row-column addressed matrix and coherently-compounded orthogonal plane waves. Phys. Med. Biol. 2017;62:4571–4588. doi: 10.1088/1361-6560/aa63d9. [DOI] [PubMed] [Google Scholar]
- 30.Jensen JA, et al. Anatomic and functional imaging using row-column arrays. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2022;69:2722–2738. doi: 10.1109/TUFFC.2022.3191391. [DOI] [PubMed] [Google Scholar]
- 31.Rubin JM, et al. Volume flow measurement using Doppler and grey-scale decorrelation. Ultrasound Med. Biol. 2001;27(1):101–109. doi: 10.1016/S0301-5629(00)00291-X. [DOI] [PubMed] [Google Scholar]
- 32.Desailly Y, Tissier AM, Correas JM, Wintzenrieth F, Tanter M, Couture O. Contrast enhanced ultrasound by real-time spatiotemporal filtering of ultrafast images. Phys. Med. Biol. 2017;62:1. doi: 10.1088/1361-6560/62/1/31. [DOI] [PubMed] [Google Scholar]
- 33.Demené C, et al. Spatiotemporal clutter filtering of ultrafast ultrasound data highly increases Doppler and fUltrasound sensitivity. IEEE Trans. Med. Imaging. 2015;34:2271–2285. doi: 10.1109/TMI.2015.2428634. [DOI] [PubMed] [Google Scholar]
- 34.Jerman T, Pernuš F, Likar B, Špiclin Ž. Enhancement of vascular structures in 3D and 2D angiographic images. IEEE Trans. Med. Imaging. 2016;35:2107–2118. doi: 10.1109/TMI.2016.2550102. [DOI] [PubMed] [Google Scholar]
- 35.Frangi RF, et al. et al. Multiscale vessel enhancement filtering. In: Frangi RF, et al.et al., editors. International Conference on Medical Image Computing and Computer-Assisted Intervention—MICCAI 1998. Springer; 1998. pp. 130–137. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets used and analyzed during the current study available from the corresponding author on reasonable request.
Custom codes used for the collection and analysis of the data used in this study are protected by Inserm and can only be shared upon request, with the written agreement of Inserm.