Abstract
Stroke is a leading cause of mortality and disability. Emergent diagnosis and intervention are critical, and predicated upon initial brain imaging; however, existing clinical imaging modalities are generally costly, immobile, and demand highly specialized operation and interpretation. Low-energy microwaves have been explored as low-cost, small form factor, fast, and safe probes of tissue dielectric properties, with both imaging and diagnostic potential. Nevertheless, challenges inherent to microwave reconstruction have impeded progress, hence microwave imaging (MWI) remains an elusive scientific aim. Herein, we introduce a dedicated experimental framework comprising a robotic navigation system to translate blood-mimicking phantoms within an anatomically realistic human head model. An 8-element ultra-wideband (UWB) array of modified antipodal Vivaldi antennas was developed and driven by a two-port vector network analyzer spanning 0.6–9.0 GHz at an operating power of 1 mw. Complex scattering parameters were measured, and dielectric signatures of hemorrhage were learned using a dedicated deep neural network for prediction of hemorrhage classes and localization. An overall sensitivity and specificity for detection >0.99 was observed, with Rayliegh mean localization error of 1.65 mm. The study establishes the feasibility of a robust experimental model and deep learning solution for UWB microwave stroke detection.
Keywords: Stroke detection, microwave imaging, dielectric properties, hemorrhagic stroke, neuroimaging, deep neural networks, machine learning, deep learning
Introduction
Despite recent progress, stroke remains a leading cause of death and disability, disproportionately affecting low-income countries and the economically disadvantaged1,2. In the US alone, ~795,000 individuals are affected per annum, with 1 in every 4 people suffering a stroke in their lifetime3. It is estimated that ~1.9 million neurons are lost each minute during a stroke4; however, intravenous tissue plasminogen activator—the only thrombolytic therapy approved by the U.S. Food and Drug Administration—is successfully administered in only ~10% of patients due to strict guidelines prohibiting its use beyond 4.5 hours or in patients with hemorrhage. The resulting economic burden of stroke is thus staggering, with 34% of global total healthcare expenditure attributed to stroke, and greater than USD 56 billion in associated costs in the U.S. alone. Urgent diagnosis and intervention are therefore central pillars of contemporary management guidelines, with initial triage of stroke patients hinging first upon exclusion of brain hemorrhage by advanced neuroimaging5–8.
Existing imaging solutions comprise primarily magnetic resonance imaging (MRI)8,9 and computed tomography (CT)10–12 which, while well-established, present numerous drawbacks including: 1) lack of portability for deployment to preclinical settings, engendering critical treatment delays until hospital arrival in most cases13,14; 2) high costs, exceeding millions of dollars for contemporary clinical CT and MR systems, proving prohibitive in many environments and perpetuating immense imbalances in global health15. Specifically, with two-thirds of the global population lacking accessible medical imaging, RAD-AID estimates that 3–4 billion excess deaths could be averted through improved access16; 3) lengthy scan and protocol durations imparting additional delays that further reduce the likelihood of favorable clinical outcomes4,17–19 ;4) requisite levels of specialization necessary for operation and interpretation of such examinations20,21; and, 5) safety concerns relating to ionizing radiation in CT and strong magnetic fields in MRI18. While the recent introduction of CT scanners in specialized mobile stroke ambulance units22 may alleviate some delays, their operational costs have remained untenably high for all but a small number of urban centers worldwide23–25 . The demand for cost-effective, fast, safe, and deployable small-form diagnostic instruments is thus unmet, motivating new directions using novel sensors.
The use of low-energy microwaves as a probe of tissue dielectric properties has been explored and represents an intriguing means of characterizing tissue properties26–29. Several potential advantages over MRI and CT have motivated the development of such microwave imaging (MWI) systems, including: 1. extremely low operational power and lack of ionizing radiation, enabling biologically harmless use unhindered by indwelling implants and ferromagnetic objects; 2. remarkably high acquisition speeds; 3. low production cost; and 4. small form factor30–35.
The characterization of biologic tissues using microwave radiation entails the collection of scattering (S)-parameters, based in transmission and reflection measurements, commonly achieved using vector network analyzers (VNA)36 to drive radiation of a high directivity antenna, or with software defined radio (SDR)37. Most existing MWI systems obtain measurements in the low (e.g. 0.5–2.0) GHz range, owing in part to the relative ease of corresponding antenna design and fabrication28. With early studies casting doubt upon any additional benefits from higher forbidden frequencies27 (due to exponential penetration losses from electromagnetic skin effects) as well as a generalized reduction in dielectric contrast beyond 5 GHz, low frequency MWI has remained the favored strategy38. Nevertheless, rigorous investigation into ultra-wideband (UWB) systems is lacking, and the potential benefits afforded by their greater resolving ability and sensitivity to superficial processes remains unknown39,40. The emergence of contemporary machine learning algorithms for reconstruction has further advanced the potential of microwave systems, such as for classification and localization for stroke26,28,29,41,42; however, it bears emphasis that past approaches to hemorrhage detection have generally been limited to models of intraparenchymal hematomas (IPH), a subclass of well-circumscribed bleeding mostly confined to the parenchymal substrate of the brain; meanwhile, more complex models recapitulating catastrophic, superficial subarachnoid hemorrhage (SAH) and other diffuse extracerebral bleeding has lagged26,28,29,41,42,pointing to vast potential applications for systems leveraging high frequency capabilities.
We have previously shown the potential for such UWB (0.5–6.0 GHz) systems through in silico simulation and using a deep neural network for classification and localization of intracranial hemorrhage, exhibiting excellent classification (AUC 0.996) and localization (sub-millimeter error) accuracy across varied anatomical human head geometries and noise conditions29. However, translation from in silico environments to fully realized, physical UWB systems demands non-trivial hardware and software solutions dedicated to the specific experimental objective. In this study, we describe the conception, design, and development of a system for UWB microwave experimentation, benchtop hypothesis testing, analysis, and hardware prototyping for prediction of brain hemorrhage. A custom UWB system was engineered for operation up to 9.0 GHz and paired with an anatomically realistic human head model to evaluate morphologically variable hemorrhages under remote robotic control. The system was used to train a dedicated artificial neural net, hypothesizing robust and frequency-dependent hemorrhage localization and classification accuracy benefitting from UWB interrogation.
Methods
Antenna design
UWB microwave transmission and reception in the near field was accomplished with custom, circularly-loaded antipodal Vivaldi antennas modified from Siddiqui J, et al, having shown desirable directive properties for this antenna structure43. Initial simulations were conducted using the HFSS simulation environment (Ansys Inc., Canonsburg, PA, USA), where the conductor dimensions were modified to support efficient operation (S11 <−10 dB) at frequencies between 0.75 and 10 GHz. Upon arriving at the desired parameters, the antenna dimensions were 125.3 mm × 85.4 mm × 1.524 mm (length × width × thickness). The antenna was fabricated on a Rogers RO4003C substrate with a dielectric constant of 3.55 and an SMA connector was soldered to the antenna structure. Overall, a total of eight antennas were positioned in a ring, encircling a head phantom in a common XY-plane as illustrated in Figure 1a.
Figure 1.
(a) robotic system used for phantom navigation within the head model. A 65 mm rod was used to connect the robot to the blood phantom (left). A 3D printed head model was used and filled with brain-mimicking dielectric liquid (top-right, with its position in the model shown by paired red arrows) and encircled by an array of custom UWB antipodal-Vivaldi antennas for near-field measurements (bottom-right). (b) 3D printed blood phantoms including spherical hemorrhage models of varying inner diameter, as well as morphologically more complex star- and plus-shaped models.
Phantom design and general setup
An anatomically realistic human brain phantom was designed, and 3D printed, based on the SAM head phantom44. The head model comprised a superficial (radially) outer compartment mimicking muscle and an inner compartment of average brain tissue, with outer dimensions of 258 mm (height) × 175 mm (width) × 122 mm (depth) and an inner compartment with dimensions of 199 mm × 145 mm × 92 mm (see SM Figure 1, Supplemental Results). The phantom was printed using a stereolithography 3D printer, (Phrozen Mega Sonic 8K, Phrozen Tech Co Ltd., Taiwan) leaving a aperture at its crown such that blood phantoms of varying size and morphology could be introduced to the inner compartment and navigated remotely under robotic guidance as detailed below.
Five different hemorrhage models, each simulating the dielectric properties of intracranial hemorrhage, were designed in order to introduce dielectric disturbances within the head, including: i. three distinct spherical models with diameters of 10 mm, 20 mm, and 30 mm (with inner volumes of 0.52 ml, 4.18 ml, and 14.14 ml, respectively); ii. A star-shaped model; (3.7 ml); and iii. a plus-shaped model (9.5 ml), each used to introduce complex dielectric disturbances to the head phantom during dedicated experimentation. The blood phantoms were designed and fabricated using the Formlabs Form 3B (Formlabs Inc., Massachusetts, USA) SLA 3D printer using the transparent biomed clear resin. Further details on the composition of the liquids can be found in the Dielectric Liquid Preparation section within the Supplemental Materials. The head phantom, blood phantom and positioning table are illustrated in Figure 1a and b.
Mechanical and Robotic localization system
To ensure fixation of the antennas relative to the head phantom, a 3D printed positioning table was designed with holders in order to immobilize the antenna array. A system of self-locking tiles was 3D printed and interlocked to meet the specifications of the phantom but readily modifiable to accommodate a wide range of experimental layouts. On the reverse face of each tile, recesses were engineered to house nuts and to provide a robust base for secure bolt fixation. Custom-designed tile holders were produced for the head phantom and antennas, and the overall configuration was designed in order to maximize stability of the phantom and antenna array during experimentation.
To ensure precise navigation, a Niryo Ned (Niryo robotique industrielle, Wambrechies, France) robotic system was used, providing a repeatability of 0.5 mm45. The system was equipped with self-reporting feedback on the spatial coordinates of the hemorrhage model in real time. In order to allow navigation of the phantom within the head model under robotic guidance, a firm linear rod of length 650 mm was 3D printed, articulating the hemorrhage to the robot. In order to mitigate coupling between the robot and the antenna array, the robot was elevated and placed on a grounded copper sheet with an encircling copper mesh around the opening through which the rod entered. Custom software was developed in Python for design of the automation protocol and execution of the trajectory (Figure 1a).
Acquisition procedure
A 2-port vector network analyzer (VNA) system (ZNB-20, Rohde & Schwarz GmbH, Munich, Germany) was used to support UWB measurements and was coupled to a switch matrix (ZN-Z84, Rohde & Schwarz GmbH, Munich, Germany) to expand the number of measurable ports to eight channels. This arrangement allowed computation of a full 8-port S-parameter network, allowing comprehensive characterization of transmission and reflection properties. The range of measurement spanned from 0.6–9.0 GHz, with a total of 8412 frequencies in stepped sweep mode, with 1 MHz steps. While the antenna had a reflection coefficient of −10 dB at 0.75 GHz, a lower minimum frequency of 0.6 GHz was chosen as the lower bound of the measurement sweep in order to assess for potentially valuable information content from the lower frequencies (despite the declining antenna efficiency at those frequencies, where reflection coefficients were <~−3 dB). An n-port Unknown through - Open - Short - Match (UOSM) calibration36,46–48 was performed at the ends of the 8 coaxial cables to improve data quality and measurement accuracy48.
For each acquisition, the robotic navigation system was used to translate the position of the hemorrhage phantom within the inner brain compartment of the phantom. After each translation, S-parameter measurements were conducted using the VNA and switch matrix to toggle through the antenna array before advancing the hemorrhage to its subsequent location. Importantly, when utilizing the robot in conjunction with the rod, boundaries arising from the inner wall of the head impeded the extent of translation in some dimensions, dependent upon the geometry of each hemorrhage phantom; consequently, the trajectory of the phantoms was prescribed specifically such that the peripheral-most station was made uniform and could accommodate every one of the hemorrhage phantoms without perturbing the head. We established a grid with intervals of 10 mm in the X-, Y-, and Z-directions; bounding box dimensions for the largest hemorrhage were 90 mm, 95 mm, and 60 mm, respectively. This resulted in a total of 127 positions within the head phantom, each of which was used in the random navigation trajectory of the robot-rod-phantom assembly. This procedure was repeated for three separate conditions of brain-, air- and water-filled head phantom substrate (see Neural Network Architecture below). Software was developed in Python to interface with the VNA and robot using vendor-provided libraries in order to automate data acquisition. The complex-valued S-parameters were processed using the open-source scikit-rf library49. A front-end interface was developed using PySide6 libraries providing real-time plotting of the scattering measurements, robot movements, and tracking of captured data. A desktop PC was used to interface to the VNA using a USB port and to the robot over Ethernet cable. All acquisitions were performed with the head phantom filled with human brain-mimicking (interior compartment) and muscle-mimicking (exterior compartment) liquids for the five different hemorrhage phantoms. The acquisition time for each point when using a 100 kHz IF bandwidth was 72 seconds, with a 12-second delay (measured empirically) imposed after each translation to mitigate motion-related noise.
Neural network architecture
The neural network architecture proposed in this study was tailored to interpret complex S-parameter data. The architecture was segmented into two cardinal components: the convolutional layers and the terminal fully connected segments (Figure 2). The former is characterized by a Residual ConvBot (Figure 2d) and a series of bottleneck residual blocks50 (Figure 2c), termed “ResidualBlocks”. These ResidualBlocks function as feature extractors, converting intricate, high-dimensional data into lower-dimensional form while retaining important information. The unique arrangement of these ResidualBlocks ensured a balance between model intricacy and operational output. The terminal components of the network were anchored by a series of fully connected layers. A linear layer served as an integration point for the output matrix of the ConvBot (Figure 2c). The layers were designed for discrete predictive functions, including pinpointing the location coordinates of the hemorrhage and classifying the hemorrhage shape. Full details of the network architecture can be found in the Neural Network Architecture section in the Supplemental Materials.
Figure 2.
Network architecture. (a) The RobotNet structure with (b) a tiling layer for preprocessing of data. (c) Seven Residual Blocks were used as building blocks for the Residual ConvBot (d) design. The architecture contains several fully connected layers for the final output prediction. (e) dictionary illustrating the layer structure.
Neural network training and validation
The network included three outputs comprising two classifications (multi-class classification with SoftMax) and a three-dimensional regression. Multi-task learning network training was performed with the Adam optimizer51 using the following loss function:
where p is the ground truth location and is the predicted location. L1, MSE, and dist are the 1-norm, mean squared error, and distance difference between ground truth and predicted locations, respectively. N denotes the batch number, CE denotes the cross-entropy loss, and α ensures that the gradients for localization become zero in those cases for which the hemorrhage did not exist (i.e., no-hemorrhage class), while still allowing training for the classification task. The initialization of the learning rate of the Adam optimizer was set to 0.0001, which was decreased every hundred epochs by a factor of . The network was trained on all media for 500 epochs with batch sizes of 48 over 70% of the data and tested on the remaining 30% of data for the brain-filled head phantom only (i.e., air- and water-filled phantom datapoints were used as an augmentation to reduce potential overfitting). From the training set, 10% was held out for validation during training. The hold-out method was used for data separation.
Evaluation of frequency range and antenna number
An ablation study was conducted to investigate the effects of varying the frequency range and number of antennas on network performance. Consistency in all other hyperparameters was maintained to isolate the impact of the selected variables. For the frequency range evaluation, four distinct spans were chosen: 0.6–1.5 GHz, 0.6–3 GHz, 0.6–6 GHz, and the full range of 0.6–9 GHz. For each span, we adapted the S-parameter matrix to correspond to the chosen frequency band by retaining the pertinent rows and columns and setting others to zero before network training commenced. After zeroing out the undesired frequencies, classification and localization errors were evaluated. For the evaluation of the number of antennas used for network performance, the following combinations of antennas were tested: i. antennas 1 and 3; ii. antennas 1, 3, and 5; iii. antennas 0, 1, 4, and 5; and iv. all 8 antennas in the array. As with the exploration of frequency dependency, the S-parameter matrix was modified for each configuration, with relevant rows and columns preserved and non-pertinent ones nullified before network training.
Statistical analysis
Network performance was summarized with a confusion matrix for multi-class classification using frequency spans of 0.6–1.5 GHz, 0.6–3.0 GHz, 0.6–6.0 GHz, and 0.6–9.0 GHz. The specificity and sensitivity of hemorrhage detection was computed. To assess the fidelity of the localization predictions, the probability distribution function (PDF) of the error in X- and Y-directions, XY-plane, and XYZ-space were computed and plotted for frequency spans of 0.6–1.5 GHz, 0.6–3 GHz, 0.6–6 GHz, and 0.6–9 GHz. Distance error in hemorrhage localization was expressed in a normalized histogram of the distance error, with the single variate (X- and Y-directions) data fitted to a folded normal distribution function52, and the bi-variate (in XY-plane) distance errors fitted to a Rayleigh distribution function53. Notably, because an array of distributed channels did not exist in the z-direction, a declining accuracy was anticipated in z-direction, which was confirmed in preliminary analysis. All statistical analysis was performed using the SciPy54 library in Python.
Results
Excellent performance was demonstrated using the complete antenna array together with the entire range of UWB frequencies. Specifically, sensitivity and specificity of >0.99 were observed for hemorrhage detection, with an overall median localization error of 1.67 mm. Full results for classification and localization tasks are summarized in Figure 3. Specifically, the larger frequency spans, of 0.6–6.0 and 0.6–9.0 GHz, outperformed the narrower ranges in classification, Notably, despite excellent overall performance in the multi-class classification task for the 0.6–6.0 GHz range, there were a small number of instances for which a plus-shaped phantom was misclassified as a 20 mm diameter sphere, while the full frequency range exhibited better performance in discriminating spherical and non-spherical phantoms. Together, the results suggest that the extended UWB frequency ranges generally provide a superior combination of localization (again, demonstrating a median distance error of 1.67 mm in the XY-plane, Table 1) and classification performance (Figure 3).
Figure 3.
(a) Classification confusion matrix for varying blood phantoms as well as the case of no-hemorrhage for network training using different frequency spans. (b) Overall classification performance for hemorrhage (all phantoms combined) versus no hemorrhage, demonstrating overall sensitivity and specificity of >0.99. (c) histogram of the localization error in the XYZ-space and XY-plane.
Table 1.
Median Error for different frequency spans.
Median error (mm) | |||||
---|---|---|---|---|---|
Frequency span (GHz) | X | Y | Z | XY | XYZ |
0.6 – 1.5 | 2.52 | 1.67 | 3.93 | 3.82 | 6.61 |
0.6 – 3 | 1.13 | 1.04 | 4.46 | 1.9 | 5.68 |
0.6 – 6 | 1.03 | 0.99 | 5.66 | 1.69 | 6.79 |
0.6 – 9 | 1.08 | 0.96 | 5.54 | 1.67 | 6.85 |
1.5 – 3 | 1.17 | 1.17 | 5.02 | 1.99 | 6.44 |
3 – 6 | 1.19 | 1.22 | 6.47 | 2.02 | 7.82 |
3 – 9 | 1.35 | 1.32 | 6.17 | 2.37 | 7.33 |
6 – 9 | 2.38 | 2.05 | 8.89 | 3.96 | 10.95 |
Among the individual sub-ranges of frequencies, the 0.6–6.0 GHz span yielded the best overall performance in classification of hemorrhage classes, peaking in its identification of the smallest (10 mm diameter) spherical phantom at a classification accuracy of 98.25% and a misclassification rate of only 1.75%. Overall multi-class classification for this frequency span was 94.88%. The lowest individual performance was 81.87% for the frequency span 0.6–3.0 GHz. Importantly, there was high overall sensitivity to the morphological characteristics of the hemorrhage phantoms; specifically, using the full frequency rage (0.6–9.0 GHz) there were no instances of a spherical phantom of any size being misclassified as a non-spherical phantom, or vice-versa. Further, a strong capacity for discrimination of varying spherical phantom volumes was observed, with no cases of the smallest 10 mm sphere being misclassified as the largest 30 mm sphere, or vice-versa. Only a small percentage (10.53%) of hemorrhages in the 20 mm class were misclassified as either a 10 mm or 30 mm hemorrhage. The single worst performing classification task was observed in prediction of the star-shaped phantom using the 0.6–3.0 GHz sub-range, for which 33.33% of cases were misclassified as plus-shaped phantoms; however, only 6.14% of such cases were misclassified using the frequency sub-range of 0.6–6 GHz (Figure 3a).
For the star-shaped phantom, although the volume was 3.7 ml (volumetrically almost identical to the 3.5 ml of the middle-sized sphere), excellent discrimination (>99.9%) was present between the two, further suggesting sensitivity to morphologic characteristics irrespective of volumes. The largest class-wise false-positive and false-negative rates between the star-shaped phantom and the plus-shaped phantom were 9.65% and 6.14% (star-shaped predictions), respectively, for the best performing network. The histogram of the localization error in XYZ- and XY-space is illustrated in Figure 3c, demonstrating a median error of 5.68 mm and 1.90 mm in the XYZ- and XY-space. As anticipated from our antenna array’s geometry, the histogram for the XY distance error reveals a reduced error compared to the XYZ error distribution, related to the arrangement of the antennas in the XY plane around the head phantom, rather than stacked in the Z-direction.
The error distribution for frequency spans 0.6–1.5 GHz, 0.6–3 GHz, 0.6–6 GHz, and 0.6–9 GHz in the X-direction, Y-direction, and XY-plane are shown in Figure 4. The PDF of the error in the X- and Y-directions and in the XY-plane both revealed squared residuals of less than 0.24. For the narrowest frequency span of 0.6–1.5 GHz, the distribution was the widest, achieving a maximum folded normal mean error of 2.98 mm. Conversely, the narrowest distribution (mean of 1.14 mm was obtained for the widest frequency span of 0.6–9.0 GHz. Figure 4b depicts the error distribution for the Y axis, showing that the best performance was observed for the network trained on the widest range (1.05 mm), while the least favorable performance was observed on the narrowest range (2.01 mm). Figure 4c illustrates the distance error in the XY plane; here, a similar trend was present, with the strongest performance associated with the widest frequency range of 0.6–9.0 GHz (1.65 mm). A detailed summary of the median error across frequency spans can be found in Table 1.
Figure 4.
PDF of the distance error histogram for the X-direction (a), Y-direction (b), and XY-plane (c). The mean fitted Folded Normal distributions for X and Y are shown to decrease as the frequency span increases.
The relationship between the number of antennas utilized and the stroke localization error in the X-direction, Y-direction, and XY-plane is illustrated in Figure 5. Stroke localization error was analyzed for the full frequency span of 0.6–9.0 GHz, demonstrating a reduction of localization error as the number of antenna elements was increased. In the case of two antennas 90-degree apart (antenna 1 and 3), median localization error was 2.62 mm in the XY-direction; however, incrementally, as the number of antenna elements was increased to 8-elements, the error was reduced to 1.67 mm. With regards to the X-, Y-, and XY-directions, an increase in the error in each individual component was observed. A summary of the median error in for different antenna combinations is summarized in Table 2.
Figure 5.
(a) Placements of the antennas relative to the head phantom. (b) Model performance in relation to the number of antennas employed in the experiment, demonstrating the effect of increasing antenna number on localization accuracy.
Table 2.
Median error for different antenna numbers in the array.
Median error (mm) | |||||
---|---|---|---|---|---|
Antennas in array | X | Y | Z | XY | XYZ |
[1, 3] | 1.54 | 1.65 | 7.47 | 2.62 | 9.69 |
[1, 3, 5] | 1.37 | 1.32 | 4.85 | 2.17 | 6.37 |
[0, 1, 4, 5] | 1.20 | 1.20 | 5.62 | 2.10 | 6.96 |
[0 – 7] | 1.08 | 0.96 | 5.54 | 1.67 | 6.85 |
Discussion
The measurement of tissue electrical properties has long been a focus of interest for the biomedical community, motivated by potential applications in a multitude of neurological diseases. While past studies have reported the potential of microwave-based stroke characterization26,28,29,41,42, this represents, to our knowledge, the first study leveraging such operating bandwidths (~8.4 GHz), and the only study to date utilizing a dynamic hemorrhage model (comprising five different shapes and 127 positions).
Our system was constructed in the context of near-field stroke classification and localization, with the goal of utilizing supervised deep learning approaches to learn dielectric signatures. Because supervised learning was used to classify and localize hemorrhage models, the experimentation necessitated a flexible system capable of being navigated throughout the head, such that many data points could be acquired. This system included the fabrication of UWB antennas and creation of a mechanical system to mobilize blood-mimicking phantoms of varying shapes and sizes inside a multi-compartment head model. These were developed to assess and improve UWB antenna arrays, as well as develop methods capable of learning signatures of dielectric changes in tissue. In previous in-silico reports, we have shown the potential advantages of UWB approaches for the detection of dielectric disturbances in head models29, and in this work, a physical realization of such a system was constructed.
A residual convolutional network structure was used as the core for higher dimensional feature extraction, and for classification and localization, a collection of fully connected layers was used. While there exist many potential approaches for learning from the complex-valued S-parameter space, our architecture was conceived as a small working model with only 1.7 million parameters. In examining the classification performance more closely, a sensitivity and specificity of 1.0 was achieved for hemorrhage detection (Figure 3b). Further, when utilizing UWB, none of the spheres, irrespective of their size, were mistakenly predicted as star- or plus-shaped phantoms (Figure 3a, 0.6 – 9.0 GHz), pointing to a remarkable sensitivity for complex morphological characteristics, even in excess of volumes alone, which were nearly identical for the disparately shaped star phantom (3.7 ml) and middle-sized sphere (3.5 ml). Similarly, predictions for the star-shaped phantom were only misclassified in any instance as a plus-shaped phantom but never as a spherical hemorrhage. The data supports that wider frequency ranges in many cases improved geometric discrimination of hemorrhages, with the most accurate classification in the 0.6 – 6.0 GHz sub-range.
The system yielded a median localization error for hemorrhage of 5.68 mm and 1.9 mm in the XYZ-space and XY-plane, respectively. This difference in error between the XYZ-space and XY-plane was not unexpected in view of the limited number of antennas in the Z-direction, thus limiting information in that direction. Where localization errors did occur, the effects are traceable, at least in part, to errors of the robotic system itself. Specifically, the mean XY positioning error of the robot with the attached rod was ~1.5 mm at baseline, which places in more remarkable perspective the localization accuracy of the full model. It should be noted that the best performing frequency span for the localization task was using 0.6–9.0 GHz and perfect performance in discriminating spherical and non-spherical phantoms were achieved. The results suggest that the best choice of UWB frequency ranges is likely dependent on the network architecture and the task in question. Notably, while past studies have suggested the presence of forbidden frequencies between 1.5 and 4 GHz27, our results suggest the presence of valuable information content encoded with these frequencies and unlocked by the neural network in use in our study.
With regards to the phantom liquids used for the brain, muscle, and blood phantoms, recipes for those liquids were chosen such that the dielectric properties match the dielectric properties of their respective biological tissues at 2.45 GHz (supplemental materials, Dielectric liquid preparation section). This single-frequency selection was chosen due to the fact that measurement of dielectric properties of materials is more challenging at high frequencies (> 6 GHz), necessitating specialized measurement equipment. Second, to the best of our knowledge, it is extremely challenging to match the conductivity and permittivity of tissues using liquids at UWB frequencies. Therefore, we matched the dielectric property of tissues55 at a single frequency and within an error margin of 10%. Future investigations, of course, can include more elaborate phantom designs that match a wider range of frequencies using more advanced recipes.
Overall, the performance of our system benefitted from several unique attributes, including the successful development of UWB capabilities spanning 0.6–9.0 GHz. The results document, for the first time, the benefits of localization accuracy enabled through the use of realized UWB hardware alongside deep neural network, as well as hemorrhage classification with dynamic phantoms. The apparent sensitivity to morphologic characteristics, in excess of simple dimensional or volumetric features, points strongly to the benefits of deep learning tools in the exploration of UWB microwave scattering.
Supplementary Material
Acknowledgments
This work was supported in part by NIH grant P41-EB017183.
References
- 1.What we do | World Stroke Organization. https://www.world-stroke.org/what-we-do.
- 2.Addo J. et al. Socioeconomic Status and Stroke. Stroke 43, 1186–1191 (2012). [DOI] [PubMed] [Google Scholar]
- 3.Benjamin E. J. et al. Heart disease and stroke statistics—2019 update: a report from the American Heart Association. Circulation 139, e56–e528 (2019). [DOI] [PubMed] [Google Scholar]
- 4.Saver J. L. Time is brain—quantified. Stroke 37, 263–266 (2006). [DOI] [PubMed] [Google Scholar]
- 5.Wintermark M. et al. Acute stroke imaging research roadmap. Stroke 39, 1621–1628 (2008). [DOI] [PubMed] [Google Scholar]
- 6.Fisher M. Characterizing the target of acute stroke therapy. Stroke 28, 866–872 (1997). [DOI] [PubMed] [Google Scholar]
- 7.Yaghi S., Bianchi N., Amole A. & Hinduja A. ASPECTS is a predictor of favorable CT perfusion in acute ischemic stroke. J Neuroradiol 41, 184–187 (2014). [DOI] [PubMed] [Google Scholar]
- 8.Kane I. et al. Comparison of 10 different magnetic resonance perfusion imaging processing methods in acute ischemic stroke: effect on lesion size, proportion of patients with diffusion/perfusion mismatch, clinical scores, and radiologic outcomes. Stroke 38, 3158–3164 (2007). [DOI] [PubMed] [Google Scholar]
- 9.Heiss W. D. The ischemic penumbra: correlates in imaging and implications for treatment of ischemic stroke. The Johann Jacob Wepfer award 2011. Cerebrovasc Dis 32, 307–320 (2011). [DOI] [PubMed] [Google Scholar]
- 10.Wintermark M. et al. Comparison of CT perfusion and angiography and MRI in selecting stroke patients for acute treatment. Neurology 68, 694–697 (2007). [DOI] [PubMed] [Google Scholar]
- 11.Bao D. Z. et al. 64-Slice spiral CT perfusion combined with vascular imaging of acute ischemic stroke for assessment of infarct core and penumbra. Exp Ther Med 6, 133–139 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Kucinski T. et al. Cerebral perfusion impairment correlates with the decrease of CT density in acute ischaemic stroke. Neuroradiology 46, 716–722 (2004). [DOI] [PubMed] [Google Scholar]
- 13.Walter S. et al. Diagnosis and treatment of patients with stroke in a mobile stroke unit versus in hospital: a randomised controlled trial. Lancet Neurol 11, 397–404 (2012). [DOI] [PubMed] [Google Scholar]
- 14.Greenberg S. M. et al. 2022 Guideline for the Management of Patients With Spontaneous Intracerebral Hemorrhage: A Guideline From the American Heart Association/American Stroke Association. Stroke 53, e282–e361 (2022). [DOI] [PubMed] [Google Scholar]
- 15.Wald L. L., McDaniel P. C., Witzel T., Stockmann J. P. & Cooley C. Z. Low-cost and portable MRI. Journal of Magnetic Resonance Imaging 52, 686–696 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Essential diagnostic imaging. https://web.archive.org/web/20121023154427/http://www.who.int/eht/en/DiagnosticImaging.pdf.
- 17.Dehkharghani S. et al. Performance and Predictive Value of a User-Independent Platform for CT Perfusion Analysis: Threshold-Derived Automated Systems Outperform Examiner-Driven Approaches in Outcome Prediction of Acute Ischemic Stroke. American Journal of Neuroradiology 36, 1419 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Dehkharghani S. & Andre J. Imaging Approaches to Stroke and Neurovascular Disease. Neurosurgery 80, (2017). [DOI] [PubMed] [Google Scholar]
- 19.Fransen P. S. S. et al. Time to Reperfusion and Treatment Effect for Acute Ischemic Stroke: A Randomized Clinical Trial. JAMA Neurol 73, 190–196 (2016). [DOI] [PubMed] [Google Scholar]
- 20.Dehkharghani S. et al. High-Performance Automated Anterior Circulation CT Angiographic Clot Detection in Acute Stroke: A Multireader Comparison. Radiology 298, 665–670 (2021). [DOI] [PubMed] [Google Scholar]
- 21.Heit J. J. et al. Automated Cerebral Hemorrhage Detection Using RAPID. American Journal of Neuroradiology 42, 273 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.John S. et al. Brain Imaging Using Mobile CT: Current Status and Future Prospects. Journal of Neuroimaging 26, 5–15 (2016). [DOI] [PubMed] [Google Scholar]
- 23.Fassbender K. et al. “Mobile stroke unit” for hyperacute stroke treatment. Stroke 34, e44–e44 (2003). [DOI] [PubMed] [Google Scholar]
- 24.Ebinger M. et al. Effect of the use of ambulance-based thrombolysis on time to thrombolysis in acute ischemic stroke: a randomized clinical trial. JAMA 311, 1622–1631 (2014). [DOI] [PubMed] [Google Scholar]
- 25.Walter S. et al. Mobile stroke units-cost-effective or just an expensive hype? Curr Atheroscler Rep 20, 1–6 (2018). [DOI] [PubMed] [Google Scholar]
- 26.Semenov S. Y. et al. Microwave-tomographic imaging of the high dielectric-contrast objects using different image-reconstruction approaches. IEEE Trans Microw Theory Tech 53, 2284–2294 (2005). [Google Scholar]
- 27.Scapaticci R., Donato L. Di, … I. C.-P. I. & 2012, undefined. A feasibility study on microwave imaging for brain stroke monitoring. jpier.orgR Scapaticci, L Di Donato, I Catapano, L CroccoProgress In Electromagnetics Research B, 2012•jpier.org 40, 305–324 (2012). [Google Scholar]
- 28.Guo L., Alqadami A. S. M. & Abbosh A. Stroke Diagnosis Using Microwave Techniques: Review of Systems and Algorithms. IEEE J Electromagn RF Microw Med Biol 7, 122–135 (2023). [Google Scholar]
- 29.Alon L. & Dehkharghani S. A stroke detection and discrimination framework using broadband microwave scattering on stochastic models with deep learning. Scientific Reports 2021 11:1 11, 1–9 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Hagness S. C., Taflove A. & Bridges J. E. Two-dimensional FDTD analysis of a pulsed microwave confocal system for breast cancer detection: Fixed-focus and antenna-array sensors. IEEE Trans Biomed Eng 45, 1470–1479 (1998). [DOI] [PubMed] [Google Scholar]
- 31.Popovic D. et al. Precision open-ended coaxial probes for in vivo and ex vivo dielectric spectroscopy of biological tissues at microwave frequencies. IEEE Trans Microw Theory Tech 53, 1713–1722 (2005). [Google Scholar]
- 32.Lazebnik M. et al. A large-scale study of the ultrawideband microwave dielectric properties of normal, benign and malignant breast tissues obtained from cancer surgeries. Phys Med Biol 52, 6093 (2007). [DOI] [PubMed] [Google Scholar]
- 33.Fear E. C., Li X., Hagness S. C. & Stuchly M. A. Confocal microwave imaging for breast cancer detection: Localization of tumors in three dimensions. IEEE Trans Biomed Eng 49, 812–822 (2002). [DOI] [PubMed] [Google Scholar]
- 34.O’Halloran M., Glavin M. & Jones E. Rotating antenna microwave imaging system for breast cancer detection. Progress In Electromagnetics Research 107, 203–217 (2010). [Google Scholar]
- 35.Xie Y., Guo B., Xu L., Li J. & Stoica P. Multistatic adaptive microwave imaging for early breast cancer detection. IEEE Trans Biomed Eng 53, 1647–1657 (2006). [DOI] [PubMed] [Google Scholar]
- 36.Woods D. Multiport-network analysis by matrix renormalisation employing voltage-wave S-parameters with complex normalisation. Proceedings of the Institution of Electrical Engineers 124, 198–204 (1977). [Google Scholar]
- 37.Meaney P. et al. A 4-channel, vector network analyzer microwave imaging prototype based on software defined radio technology. Review of Scientific Instruments 90, (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Hurt W. D. Radio Frequency Radiation Dosimetry Workshop: Present Status and Recommendations for Future Research. (1996).
- 39.Dority J. S. & Oldham J. S. Subarachnoid Hemorrhage: An Update. Anesthesiol Clin 34, 577–600 (2016). [DOI] [PubMed] [Google Scholar]
- 40.Kostanian V., Choi J. C., Liker M. A., Go J. L. & Zee C. S. Computed tomographic characteristics of chronic subdural hematomas. Neurosurg Clin N Am 11, 479—489 (2000). [PubMed] [Google Scholar]
- 41.Al-Saffar A. et al. Closing the Gap of Simulation to Reality in Electromagnetic Imaging of Brain Strokes via Deep Neural Networks. IEEE Trans Comput Imaging 7, 13–21 (2021). [Google Scholar]
- 42.Candefjord S. et al. Microwave technology for detecting traumatic intracranial bleedings: tests on phantom of subdural hematoma and numerical simulations. Med Biol Eng Comput 55, 1177–1188 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Siddiqui J. Y. et al. Design of an Ultrawideband Antipodal Tapered Slot Antenna Using Elliptical Strip Conductors. IEEE Antennas Wirel Propag Lett 10, 251–254 (2011). [Google Scholar]
- 44.Kainz W. et al. Dosimetric comparison of the specific anthropomorphic mannequin (SAM) to 14 anatomical head models using a novel definition for the mobile phone positioning. Phys Med Biol 50, 3423–3445 (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Ned — Ned User Manual v3.1.1 documentation. https://docs.niryo.com/product/ned/v3.1.1/en/source/introduction.html#robot.
- 46.ANALYZER, I. E. F. N. Two-port network analyzer calibration using an unknown “thru”. IEEE Microwave and guided wave letters 2, 505 (1992). [Google Scholar]
- 47.Williams D. F. & Walker D. K. In-line multiport calibration. 51st ARFTG Conference Digest-Spring: Characterization of Spread Spectrum Telecommunications Components and Systems, ARFTG 1998 88–90 (1998) doi:10.1109/ARFTG.1998.327284. [Google Scholar]
- 48.Martens J., Judge D. & Bigelow J. VNA calibration modifications and hybridizations for simplified high frequency multiport/differential measurements. in ARMMS Conf. Dig (2005). [Google Scholar]
- 49.Arsenovic A. et al. scikit-rf: An Open Source Python Package for Microwave Network Creation, Analysis, and Calibration [Speaker’s Corner]. IEEE Microw Mag 23, 98–105 (2022). [Google Scholar]
- 50.He K., Zhang X., Ren S. & Sun J. Deep Residual Learning for Image Recognition. 770–778 Preprint at http://image-net.org/challenges/LSVRC/2015/ (2016).
- 51.Kingma D. P. & Ba J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). [Google Scholar]
- 52.5.13: The Folded Normal Distribution - Statistics LibreTexts. https://stats.libretexts.org/Bookshelves/Probability_Theory/Probability_Mathematical_Statistics_and_Stochastic_Processes_(Siegrist)/05%3A_Special_Distributions/5.13%3A_The_Folded_Normal_Distribution.
- 53.Beckmann P. Rayleigh distribution and its generalizations. Radio Science Journal of Research NBS/USNC-URSI 68, 927–932 (1964). [Google Scholar]
- 54.Virtanen P. et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat Methods 17, 261–272 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Gabriel C., Gabriel S. & Corthout E. The dielectric properties of biological tissues: I. Literature survey. Phys Med Biol (1996) doi: 10.1088/0031-9155/41/11/001. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.