Abstract
Purpose:
To improve accuracy and speed of quantitative susceptibility mapping plus quantitative blood oxygen level-dependent magnitude (QSM+qBOLD or QQ) -based oxygen extraction fraction (OEF) mapping using a deep neural network (QQ-NET).
Methods:
The 3D multi-echo gradient echo images were acquired in 34 ischemic stroke patients and 4 healthy subjects. Arterial spin labeling and diffusion weighted imaging (DWI) were also performed in the patients. NET was developed to solve the QQ model inversion problem based on Unet. QQ-based OEF maps were reconstructed with previously introduced temporal clustering, tissue composition, and total variation (CCTV) and NET. The results were compared in simulation, ischemic stroke patients, and healthy subjects using a two-sample Kolmogorov-Smirnov test.
Results:
In the simulation, QQ-NET provided more accurate and precise OEF maps than QQ-CCTV with 150 times faster reconstruction speed. In the subacute stroke patients, OEF from QQ-NET had greater contrast-to-noise ratio (CNR) between DWI-defined lesions and their unaffected contralateral normal tissue than with QQ-CCTV: 1.9 ± 1.3 vs 6.6 ± 10.7 (p = 0.03). In healthy subjects, both QQ-CCTV and QQ-NET provided uniform OEF maps.
Conclusion:
QQ-NET improves the accuracy of QQ-based OEF with faster reconstruction.
Keywords: cerebral metabolic rate of oxygen, deep learning, DL, oxygen extraction fraction, qBOLD, QQ, QQ-NET, QSM, QSM+qBOLD, quantitative blood oxygenation level-dependent imaging, quantitative susceptibility mapping, Unet
1 |. INTRODUCTION
Quantitative mapping of oxygen extraction fraction (OEF) and cerebral metabolic rate of oxygen (CMRO2) is critical to evaluate brain tissue viability and function in stroke.1–3 In MRI, quantitative models to investigate the effects of blood deoxyhemoglobin on the signal have fallen into two categories: (1) magnitude signal modeling methods such as T2 based methods,4–7 calibrated fMRI,8–11 and quantitative blood oxygen level dependent magnitude (qBOLD);12–14 and (2) phase signal modeling methods for whole brain OEF values15–18 and voxel-wise quantitative susceptibility mapping (QSM)-based OEF methods.19–21
Recently, an integrated model of QSM and qBOLD (QSM+qBOLD or QQ) has been introduced to consider the OEF effect on both magnitude and phase of a widely available multi-echo gradient echo (mGRE) data.22 QQ makes OEF mapping possible without clinically impractical vascular challenges. However, QQ-based OEF estimation remains challenging, because it is difficult to accurately disentangle the effect of venous oxygenation (Y) and venous blood volume (v) as its inversion is highly sensitive to noise.13,23
The temporal clustering, tissue composition, and total variation (CCTV) algorithm has been proposed to over-come the noise sensitivity of QQ-based OEF by improving the effective signal-to-noise ratio (SNR).24–29 Voxels with similar mGRE signal evolutions are grouped into the same cluster and assumed to have the same model parameter values. Averaging over many voxels in a cluster can substantially increase SNR in a cluster-wise inverse solution. Noise propagation on OEF is further suppressed by integrating tissue-type information into clustering and applying total variation.25 However, inversion using gradient-based iterative solvers still depends on optimization details, e.g., initial guess and parameter scaling, and is time-consuming.
This study introduces a deep neural network (QQ-NET) to alleviate the dependency on optimization details and to improve the reconstruction speed in solving the QQ model. Deep neural networks have been applied as alternatives to the iterative method for solving inversion30–37 as they can approximate any continuous function with a sufficient number of free parameters.38 An established deep convolutional neural network architecture, Unet,39,40 was used for the QQ model inversion (QQ-NET) and com- pared with QQ-CCTV in simulation, ischemic stroke patients, and healthy subjects.
2 |. METHODS
2.1 |. Data acquisition
This study was approved by the local Institutional Review Board. MRI was performed in 34 patients with ischemic stroke in a unilateral cerebral artery territory (6 hours to 42 days between stroke onset and MRI) on a clinical 3T scanner (GE MR Discovery 750) using a 32-channel brain receiver coil. The imaging protocol consisted of 3D ASL (24 cm field of view [FOV], 1.9 × 1.9 × 2.0 mm3 voxel size, 1500 ms labeling period, 1525 ms post-label delay, 976.6 Hz/pixel bandwidth, 68 axial slices, echo time [TE] = 14.6 ms, repetition time [TR] = 4787 ms, and three signal averages), 3D mGRE (0.47 × 0.47 × 2.0 mm3 voxel size, identical FOV to the 3D fast spin echo [FSE] arterial spin labeling [ASL] sequence, eight equally spaced echoes: TE1/ΔTE/TE8 = 4.5/5/39.5 ms, TR = 42.8 ms, band-width = 244.1 Hz/pixel, flip angle 20°, and scan time = 5 minutes 15 seconds), DWI (24 cm FOV, 0.94 × 0.94 × 3.2 mm3 voxel size, 1953.1 Hz/pixel bandwidth, 0, 1000 s/ mm2 b-values, TE = 71 ms, TR = 3000 ms, and four signal averages), and a T1 weighted fluid attenuated inversion recovery sequence (24 cm FOV, 0.5 × 0.5 × 5 mm3 voxel size, TE = 23.4 ms, TR = 1750 ms).
Four healthy subjects (age 31 ± 6 y) were also scanned for QQ-NET performance testing on a 3T GE scanner using 3D mGRE with the same imaging parameters as the stroke patients (voxel size, TEs, bandwidth, flip angle, and scan time), but different resolution (0.86 × 0.86 × 1.2 mm3 voxel size, bandwidth 651.0 Hz/pixel, scan time = 5 min- utes 24 seconds) with all other parameters the same as in the stroke patients. The second scan was acquired after the first scan without delay.
2.2 |. Data processing: QSM and CBF
QSM reconstruction was performed by estimating the total field via a non-linear fit of the mGRE,41 obtaining the local field by the Projection onto Dipole Fields (PDF) method,42 and computing susceptibility with the Morphology Enabled Dipole Inversion with automatic uniform cerebrospinal fluid zero reference (MEDI+0) algorithm.43–46 Cerebral blood flow (CBF) maps (mL/100g/min) were generated from the ASL data using FuncTool (GE Healthcare, Waukesha, WI, USA). All images were co-registered and interpolated to the resolution of the QSM maps using the FSL FLIRT algorithm.47,48
2.3 |. QQ model
The QQ model combines QSM-based OEF method and qBOLD to estimate OEF, 1 − Y ∕Ya with venous oxygenation (Y) and arterial oxygenation (Ya = 0.98).22 The QSM-based model utilizes the mGRE phase and separates the estimated voxel-wise susceptibility into the contribution of deoxy-hemoglobin in venous blood, i.e., OEF effect, and non-blood neural tissue susceptibility.
(1) |
where ppb the fully oxygenated blood susceptibility assuming tissue hematocrit Hct = 0.357,21 α = 0.77 the ratio between the venous blood volume (v) and total blood volume,49 the hemoglobin volume fraction with setting the susceptibility difference between deoxy-and oxyhemoglobin.19,53
The qBOLD models the OEF effect on the mGRE magnitude at TE, t22:
(2) |
where S0 is signal intensity at t = 0, R2 is the transverse relaxation rate, 13 where fs is the signal decay by the presence of the blood vessel network for and for t 14 and δw is the characteristic frequency due to the susceptibility difference between deoxygenated blood and the surrounding tissue22 with γ = 267.51 rad s−1 T−1 the gyromagnetic ratio, and B0 the main magnetic field strength. G(t) is the macroscopic field inhomogeneity contribution to mGRE signal decay estimated by the voxel spread function.22
2.4 |. Deep neural network for QQ inversion (QQ-NET)
The fully convolutional neural network (QQ-NET) processing four-dimentional inputs (3D volumes with multiple channels) was based on an established architecture, U-net,39,40 with three modifications: (1) Using zero-padding so that the output from each convolution layer has the same size as the input; (2) Setting the number of input channels and output channels for the network to nine (eight-echo mGRE magnitude signals and one QSM) and five (model parameters), respectively; (3) Applying tanh function to the network output for setting the minimum (min) and maximum (max) values for the model parameters: [min, max] = [0.8, 2.5] for S0, [2, 190] Hz for R2, [0, 0.98] for Y, [0, 8]% for v, and [−1, 1.6] ppm for. Values were based on physiological expectations for Y (the Y range corresponds to 0~100% OEF) and v (PET and MRI literature v range 0.5~5.5%54), and CCTV results for the other parameters. The network architecture of QQ-NET consisted of an encoding and decoding path (Supporting Information Figure S1, which is available on-line). The encoding path included four repeated groups. Each group consisted of two sets of convolution layers with a 3 × 3 × 3 kernel and ReLU activation and was connected by a max pooling layer (2 × 2 × 2). The decoding path was constructed similarly to the encoding path with four repeated groups. Each group additionally contained a feature map concatenation from the corresponding encoding path and was connected by a deconvolution layer (2 × 2 × 2). The last layer applied a convolution layer with a 1 × 1 × 1 kernel to obtain five channels (five model parameters) and an element-wise scaled tanh activation to set the min and max for each parameter.
For training data generation, (1) QQ-CCTV was performed in real 34 stroke patient cases to obtain model parameters. The parameter average (μ), SD (σ), min, and max were S0(1.09, 0.04, 1.04, 2.38), R2 (20.1, 7.2, 7.3, 189.3 Hz), Y (0.68, 0.10, 0.31, 0.98), v(1.8, 1.1, 0.3, 7.2 %), and. S0 was set such that the first echo magnitude signal was unity for input data normalization as used in a previous artificial neural network for QQ inversion.55 (2) The resultant model parameter maps including OEF from QQ-CCTV were set as ground truth, and the QSM values and mGRE signals were simulated for each brain voxel using Equations 1 and 2, respectively. (3) Gaussian noise was added to the QSM and the mGRE signals to obtain SNR 100 at the first echo with a different noise instance for each training. In this way, the pairs of ground truth (QQ-CCTV results) and simulated measurements (QSM and mGRE signals) were acquired. For training, only the simulated datasets were used, not the real measurements. Among the 34 simulated datasets, 26/2/6 were used for training/validation/test, respectively.
For QQ-NET training, parameters were normalized to improve convergence behavior during network update with using z-score transformation. For R2, , and S0, , and. For Ywhere Yss is the venous oxygenation estimated from the susceptibility average of the straight sinus in each subject24 to consider different global OEF averages in different subjects. For to consider two peaks in vdistribution at 1.2% (white matter) and 3.5% (gray matter). Parameter normalization is a common practice in numerical optimization as it provides an improved convergence behavior with rescaling parameter space.21,56–58 Parameter normalization using z-scores in this study is expected to result in that the different parameters in different scales and units, e.g., R2 in Hz and v in %, have similar scales (zero mean and unit SD), and their changes are weighed similarly in the loss function, analogous to z-score transformation for multiple parameters used in a previous QQ-NET for water/fat separation.59 Due to memory constraints on the Graphic Processing Units (GPU), 4D patch (9 × 200 × 200 × 48) was used as the input, which includes an approximately entire brain. Batch size was chosen as 1 with patch center randomly located within a selected brain and repeated for all the training brains (1 epoch). Validation was then performed in the same way as training. Before each epoch, the order of the training brains was randomly shuffled.
The loss function was the weighted sum of three losses: (1) L1 difference between the normalized truth and the output of QQ-NET, , where and where the subscript “t” and “o” indicate truth and output of network; (2) model loss to consider biophysics model consistency; and (3) L1 difference of Y spatial gradient to prevent blurry OEF by preserving edge, The total loss (E) was set as. where the weights were empirically determined: w1 = 0.1 and w2 = 1.
QQ-NET was implemented using Pytorch 1.4.060 and NVIDIA RTX 2080Ti GPU. Minimization was performed by ADAM61 with a learning rate of 10−4. Training was stopped at 420 epochs (~ 100 hours) as the validation loss became stable.
The trained QQ-NET was tested with three different datasets (Test Data 1, 2, and 3). Test Data 1: two additionally simulated stroke brains constructed in the same way as the training datasets (SNR 100): Case 1. Without OEF abnormality and Case 2. With low lesion OEF (Figure 1). The average of the CCTV and NET results from real stroke patients (18 hours and 7 days post onset for Cases 1 and 2) was used as the ground truth to minimize algorithm-dependent bias. For accuracy and precision measurements, the reconstruction was repeated five times with different instances of Gaussian noise. Additionally, to investigate the consequence of the noise level discrepancy between the training (SNR 100) and test datasets, Case 2 was repeated with SNR 50 and 20 (Supporting Information Figure S2). Test Data 2: 30 ischemic stroke patients, a subset of the 34 patients without hemorrhage transformation and reperfusion, were classified into two groups based on the time interval between stroke onset and MRI scan62: acute (6–24 hours, N = 5) and subacute (1–14 days, N = 25) phase (Figures 2–4). To ensure that there was no overlap between training and test subjects, cross-validation was performed in which six real patient brains were chosen as test data, leaving the other 28 patients’ simulated dataset as training (N = 26) and validation (N = 2) data, resulting in five trained networks (6 test patients × 5 trials = 30 test patients). The network trained with the first 28 patients’ simulated dataset was applied to Test Data 1 and 3. Test Data 3: four healthy subjects acquired with the same imaging parameters including TE as used in training (Figure 5) to check if the network trained with simulated stroke brains can provide uniform OEF maps in healthy brains without severe false positives, e.g., low OEF values as in stroke lesions. Additionally, to check the robustness of the trained network against differences in resolution, a dataset with the same healthy subjects but with different resolution (0.86 × 0.86 × 1.2 mm3 voxel size) was also tested (Supporting Information Figure S3). In network testing, to make sure that the whole brain was fully covered, we used patch sliding with 30% overlap, generated multiple overlapped patches, and combined them into one whole brain after network inference.
For comparison, QQ-CCTV was also performed on the test datasets with the same reconstruction as in Refs. [25,29] using Intel Xeon Gold 6130 CPU. First, temporal clustering was performed on voxel-wise. Second, each cluster was further separated into gray matter/white matter/cerebrospinal fluid sub-clusters using segmentation obtained by FSL FAST algorithm63 on T1-weighted images for stroke patients and echo-combined T2*-weighted images for healthy subjects. Last, cluster-based and voxel-wise optimization were performed sequentially with total variation regularization.64
2.5 |. Statistical analysis
In the simulation (Test Data 1), accuracy and precision were calculated by mean absolute error (MAE) and mean SD where, , i: the voxel index, j: the trial index, Nv: the number of voxels Nt: the number of trials.
In the stroke patients (Test Data 2), lesion ROIs were drawn based on DWI by an experienced neuroradiologist (S.J., 7 y of experience) and corresponding contralateral normal tissue masks were constructed by reflecting the lesion region of interest (ROI) to the other hemisphere and subsequently trimming by the same neuroradiologist. The detectability of lesion OEF abnormality was calculated by the contrast to noise ratio between the lesion and its contralateral normal tissue assuming that OEF variation within the contralateral normal tissue results from noise. CNR was compared between CCTV and NET using a two-sample Kolmogorov-Smirnov test. A p value less than .05 was considered significant.
In the healthy subjects (Test Data 3), OEF maps from CCTV and NET were compared with structural similarity index (SSIM).65
3 |. RESULTS
Figure 1 shows the OEF comparison between CCTV and NET in the two simulated brains (Test Data 1). In both Cases 1 (Without OEF abnormality) and 2 (With low lesion OEF), NET provided higher accuracy (smaller MAE: 4.8 vs. 1.2 % in Case 1 and 3.1 vs. 1.4 % in Case 2) and higher precision (smaller MSD: 1.7 vs. 0.2 % in Case 1 and 1.2 vs. 0.3% in Case 2) than CCTV. The reconstruction speed of NET was 150 times faster than that of CCTV (1.4 ± 0.3 minutes vs. 212.8 ± 62.7 minutes).
Figure 2 shows representative OEF maps from QQ-CCTV and QQ-NET in the ischemic stroke patients (Test Data 2). Compared to QQ-CCTV, QQ-NET showed less noisy OEF maps with improved spatial overlap between low OEF regions and DWI-defined lesions in the subacute phase.
Figure 3 shows box plots of OEF-CNR between the lesion and its contralateral normal tissue (Figure 3A), OEF average in the lesion and the normal tissue (Figure 3B), and OEF SD in the normal tissue in the ischemic stroke patients (Figure 3C) (Test Data 2). Compared to CCTV, NET provided significantly higher CNR in the subacute phase, 1.9 ± 1.3 vs. 6.6 ± 10.7 (p = 0.03), but similar CNR in the acute phase, 0.3 ± 0.2 vs. 0.8 ± 0.9 (p = 0.2). In the subacute phase, both CCTV and NET provided significantly lower lesion OEF average compared to the contralateral normal tissue, 32.3 ± 7.3 vs. 23.9 ± 6.8% (p = 0.01) for CCTV and 31.0 ± 6.2 vs. 23.0 ± 7.2% (p = 0.0004) for NET, whereas both showed similar lesion OEF average as compared to the contralateral normal tissue OEF in the acute phase, 32.3 ± 6.9 vs. 33.1 ± 7.9% (p = 0.7) for CCTV and 33.7 ± 5.3 vs. 32.5 ± 6.3% (p = 0.7) for NET. NET pro-vided lower but not statistically significant OEF SD in the contralateral normal tissue than CCTV, 5.9 ± 4.2 vs. 3.2 ± 2.3% (p = 0.2) for the acute phase and 5.2 ± 2.4 vs. 3.5 ± 2.3% (p = 0.1) for the subacute phase.
Figure 4 shows a comparison of QQ between CCTV and NET in a 7 days post-onset stroke patient. Compared to CCTV, NET showed a less noisy OEF map. In the v map, NET showed low v values in the DWI-defined lesion, whereas the lesion v from CCTV appeared higher than the v on the contralateral normal tissue (pink arrow).
Figure 5 shows the OEF maps with QQ-CCTV and QQ- NET in the four healthy subjects (Test Data 3). QQ-NET provided less noisy but similar OEF maps to QQ-CCTV (SSIM ≥ 0.96).
4 |. DISCUSSION
This study demonstrates the feasibility of a deep neural network, QQ-NET, for solving QSM+qBOLD (QQ) model inversion. Compared to a current inversion method, QQ-CCTV, QQ-NET provides improved accuracy and precision in simulations and better depicts OEF abnormalities in stroke patients. Therefore, the QQ-NET enables robust QQ-based OEF mapping from a conventional mGRE sequence with fast reconstruction.
The QQ model relies on the separation of deoxyheme in cylindrical geometries from other susceptibility sources diffusely distributed in tissue, based on their approximate 10% difference in TE-series signal.14,66 Due to the poorly conditioned non-convex nature of QQ with this small difference, gradient-based iterative solver approaches are sensitive to noise and optimization details, e.g., initial guess and parameter scaling, and have slow reconstruction speeds, e.g., 0.5~3 hours.22,24 Deep learning formulation can mitigate the dependency on optimization details and slow reconstruction speeds.32,34
In the simulation (Figure 1), OEF maps obtained using the proposed QQ-NET show improved accuracy and precision when compared to QQ-CCTV. These findings are consistent with the less noisy OEF maps from QQ-NET (Figure 2) and smaller normal tissue OEF SD (Figure 3C) in the ischemic stroke patients. The suppressed noise propagation into OEF using NET is consistent with effective image denoising using convolutional neural network.67
The network may learn noise specific features as well as the QQ model, e.g., additive Gaussian white noise used in the training,68 as its training was supervised using noisy inputs and noise-free outputs. In this study, the network trained with SNR 100 datasets provided comparable OEF maps even when tested with more noisy data than the training, SNR 50 and 20 (Supporting Information Figure S2). This suggests that the network may learn Gaussian noise features that adapt to different noise levels, but the exact cause remains to be elucidated. Also, in Case 1, QQ-CCTV provided higher global OEF than the ground truth, which was accompanied with lower global v (Supporting Information Figure S4). To obtain the same QSM and qBOLD measurements, the higher OEF may result from the lower v (Equations 1 and 2). This suggests that CCTV could not decouple OEF and v perfectly. The decoupling between OEF and v has been an issue in qBOLD-based OEF methods including QQ in realistic SNR.13 Although CCTV alleviates the decoupling issue by temporal clustering, tissue composition, and total variation,29 it is not still perfect. On the other hand, QQ-NET did not show severe global OEF bias, which suggests that the decoupling may be improved using NET. CNR estimation may not be sensitive to global OEF bias as global OEF bias may affect the difference in OEF average between a lesion and its contralateral normal tissue and the OEF SD in the normal tissue (OEFnormal tissue in a similar manner. For instance, in Case 1, where the OEF from CCTV was overestimated compared to the ground truth, CCTV also provided higher (0.1% vs. 0.08%) and higher (7.1% vs 6.1%) than the ground truth. This led to CNR in CCTV that was similar to that of the ground truth (0.013 vs. 0.014) even with the OEF overestimation. In addition to the de- coupling issue between OEF and v, errors in other parameters that are affected by mGRE differences, e.g., R2, may also contribute to OEF bias, which can be exacerbated by low SNR in the lesion, as QQ simultaneously estimates OEF, v, S0, R2, and.
In the subacute stroke patients (Figure 2), the low OEF regions from QQ-NET coincided substantially with the DWI-defined lesions, whereas QQ-CCTV did not depict the lesions clearly and/or showed noise and artifacts in the OEF maps. This agrees well with the significantly greater OEF CNR from NET than CCTV in the subacute phase, 1.9 ± 1.3 vs. 6.6 ± 10.7 (p = 0.03) (Figure 3A), which suggests improved detection of lesion OEF abnormality. A high OEF CNR in the subacute phase is expected based on the PET literature, e.g., a clear OEF contrast between lesion and its contralateral normal tissue was observed with relatively uniform OEF in normal tissue.69 OEF CNR shows how much lesion OEF abnormality is highlighted compared to normal tissue, so it is expected to depend on the severity of tissue damage in the lesion, not directly on lesion location and/or size. Low OEF values in the subacute phase may indicate ischemic lesions with irreversible damage.70 In the acute phase, lesion OEF values are heterogenous, which may suggest rapid lesion evolution within first few hours of stroke onset.71 In the 24 hours post-onset case, NET provides similar OEF to the contra- lateral normal tissue at the lesion center but low OEF at the boundary. That lesion OEF values are similar to the contralateral normal tissue may suggest salvageable lesion tissue.
Both QQ-CCTV and QQ-NET show uniform OEF maps in the healthy subjects (Figure 5); these findings are consistent with previous PET studies suggesting the presence of equilibrium between metabolic needs and blood flow in healthy tissue.72,73
The low v within DWI-defined lesions from QQ-NET (Figure 4) agrees with a decrease in blood volume in ischemic stroke lesions,74 and may be driven by a reliable Y and v decoupling. The high lesion v from QQ-CCTV may be caused by that lesion was mistakenly classified as gray matter. CCTV incorporates tissue type information into clustering by dividing temporal mGRE signal based clusters into gray matter/white matter/cerebrospinal fluid sub-clusters. For the stroke patients in this study, tissue segmentation was performed on T1-weighted images using a neuroimaging tool, FSL FAST.63 As stroke lesions are sometimes dark on T1-weighted images, they may be mistakenly clustered as gray matter. This may lead to a poor v initialization for the lesion and subsequent problematic lesion v in CCTV (Supporting Information Figure S5), which may provide OEF bias in the lesion.
Despite of its advantage of more robust and faster reconstruction (1.4 vs. 212.8 minutes), the proposed neural network has limitations. First, it is less flexible. For instance, the network has to be re-trained for different TE sets (different qBOLD measurements), which is a critical limitation of the current network training scheme. Also, the network may need to be re-trained for different imaging resolutions or different SNRs. However, in this study, QQ-NET provided comparable OEF maps when tested with a different imaging parameter dataset (healthy subjects with lower resolution and higher band-width) (Supporting Information Figure S3) and with substantially lower SNR 50 and 20 (Supporting Information Figure S2). These results suggest that QQ-NET may not be sensitive to resolution or SNR. Second, for clinical implementation, the proposed QQ-NET should be tested extensively in various clinical scenarios, e.g., multiple sclerosis and brain tumor, to confirm its validity. Third, though the training of QQ-NET covered a wide physiological range for the model parameters, such as the entire possible range of OEF (0~100%) and v value range of 0~8% (which includes PET and MRI literature ranges of 0.5~5.5%54), combinations of the parameter values in the training data may be limited using 26 simulated stroke datasets. Also, in this feasibility study, the four healthy subject datasets were only used to check if the network trained with simulated stroke datasets can produce reasonable uniform OEF maps without severe artifacts. QQ-NET performance can be further improved by training with more various parameter combinations of ground truth including various physiological brain datasets such as healthy subjects and patients with multiple sclerosis. Fourth, QSM values may depend on the dipole inversion algorithms used in reconstruction,75,76 which may worsen QQ-based OEF precision. Using the phase signal of individual TEs instead of a QSM map may help the network provide a more reliable output without a dependency on the intermediate processing steps, e.g., QSM inversion. On the other hand, it may add complexity to the training. For instance, the training may involve learning both QSM (dipole inversion) and QQ processing, compared to the current learning for QQ inversion. Also, a more complex network architecture, e.g., a combined structure of two Unets (one for magnitude and the other for phase inputs), may be needed. The additional complexities may lead to challenges training the network. A comparison between the two different inputs (QSM vs. individual echo phases) should be conducted in a future study. Lastly, a validation study with the reference standard O15 PET remains to be performed.
In conclusion, with enhanced accuracy and fast reconstruction by using a deep neural network, the proposed QQ-NET may be useful to investigate tissue functions in brain pathologies, such as Alzheimer disease,77,78 multiple sclerosis,79 tumor,80 and ischemic stroke.81
Supplementary Material
ACKNOWLEDGMENTS
We thank Kelly McCabe Gillen, PhD, for her assistance in manuscript editing.
Funding information
National Institutes of Health, Grant/ Award Number: K99NS123229, R01NS090464, R01NS095562, R01NS105144, R21AG067466 and S10OD021782
Footnotes
SUPPORTING INFORMATION
Additional supporting information may be found in the online version of the article at the publisher’s website.
DATA AVAILABILITY STATEMENT
The code and data that support the findings of this study are openly available in QQ-NET at https://github.com/jc2852/QQ-NET.
REFERENCES
- 1.Derdeyn CP, Videen TO, Yundt KD, et al. Variability of cerebral blood volume and oxygen extraction: stages of cerebral haemo-dynamic impairment revisited. Brain. 2002;125(Pt 3):595–607. [DOI] [PubMed] [Google Scholar]
- 2.Gupta A, Chazen JL, Hartman M, et al. Cerebrovascular reserve and stroke risk in patients with carotid stenosis or occlusion: a systematic review and meta-analysis. Stroke. 2012;43:2884–2891. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Gupta A, Baradaran H, Schweitzer AD, et al. Oxygen extraction fraction and stroke risk in patients with carotid stenosis or occlusion: a systematic review and meta-analysis. Am J Neuroradiol. 2014;35:250–255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Bolar DS, Rosen BR, Sorensen A, Adalsteinsson E. QUantitative Imaging of eXtraction of oxygen and TIssue consumption (QUIXOTIC) using venular-targeted velocity-selective spin labeling. Magn Reson Med. 2011;66:1550–1562. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Guo J, Wong EC. Venous oxygenation mapping using velocity-selective excitation and arterial nulling. Magn Reson Med. 2012;68:1458–1471. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Jiang D, Deng S, Franklin CG, et al. Validation of T2-based oxygen extraction fraction measurement with 15O positron emission tomography. Magn Reson Med. 2021;85:290–297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Lu H, Ge Y. Quantitative evaluation of oxygenation in venous vessels using T2-relaxation-under-spin-tagging MRI. Magn Reson Med. 2008;60:357–363. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Bulte DP, Kelly M, Germuska M, et al. Quantitative measurement of cerebral physiology using respiratory-calibrated MRI. Neuroimage. 2012;60:582–591. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Gauthier CJ, Hoge RD. Magnetic resonance imaging of resting OEF and CMRO2 using a generalized calibration model for hypercapnia and hyperoxia. Neuroimage. 2012;60:1212–1225. [DOI] [PubMed] [Google Scholar]
- 10.Hoge RD. Calibrated FMRI. Neuroimage. 2012;62:930–937. [DOI] [PubMed] [Google Scholar]
- 11.Wise RG, Harris AD, Stone AJ, Murphy K. Measurement of OEF and absolute CMRO 2: MRI-based methods using interleaved and combined hypercapnia and hyperoxia. Neuroimage. 2013;83:135–147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.He X, Yablonskiy DA. Quantitative BOLD: mapping of human cerebral deoxygenated blood volume and oxygen extraction fraction: default state. Magn Reson Med. 2007;57:115–126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Yablonskiy DA, Sukstanskii AL, He X. BOLD-based techniques for quantifying brain hemodynamic and metabolic properties – theoretical models and experimental approaches. NMR Biomed. 2013;26:963–986. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Ulrich X, Yablonskiy DA. Separation of cellular and BOLD contributions to T2* signal relaxation. Magn Reson Med. 2016;75:606–615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Wehrli FW, Fan AP, Rodgers ZB, Englund EK, Langham MC. Susceptibility-based time-resolved whole-organ and regional tissue oximetry. NMR Biomed. 2017;30:e3495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Fan AP, Benner T, Bolar DS, Rosen BR, Adalsteinsson E. Phase-based regional oxygen metabolism (PROM) using MRI. Magn Reson Med. 2012;67:669–678. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Jain V, Langham MC, Wehrli FW. MRI estimation of global brain oxygen consumption rate. J Cereb Blood Flow Metab. 2010;30:1598–1607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Wehrli FW, Rodgers ZB, Jain V, et al. Time-resolved MRI oximetry for quantifying CMRO(2) and vascular reactivity. Acad Radiol. 2014;21:207–214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Zhang J, Liu T, Gupta A, Spincemaille P, Nguyen TD, Wang Y. Quantitative mapping of cerebral metabolic rate of oxygen (CMRO2) using quantitative susceptibility mapping (QSM). Magn Reson Med. 2015;74:945–952. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Zhang J, Cho J, Zhou D, et al. Quantitative susceptibility mapping-based cerebral metabolic rate of oxygen mapping with minimum local variance. Magn Reson Med. 2018;79:172–179. [DOI] [PubMed] [Google Scholar]
- 21.Zhang J, Zhou D, Nguyen TD, Spincemaille P, Gupta A, Wang Y. Cerebral metabolic rate of oxygen (CMRO2) mapping with hyperventilation challenge using quantitative susceptibility mapping (QSM). Magn Reson Med. 2017;77:1762–1773. [DOI] [PubMed] [Google Scholar]
- 22.Cho J, Kee Y, Spincemaille P, et al. Cerebral metabolic rate of oxygen (CMRO2) mapping by combining quantitative susceptibility mapping (QSM) and quantitative blood oxygenation level-dependent imaging (qBOLD). Magn Reson Med. 2018;80:1595–1604. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Lee H, Englund EK, Wehrli FW. Interleaved quantitative BOLD: combining extravascular R2′ - and intravascular R2-measurements for estimation of deoxygenated blood volume and hemoglobin oxygen saturation. Neuroimage. 2018;174:420–431. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Cho J, Zhang S, Kee Y, et al. Cluster analysis of time evolution (CAT) for quantitative susceptibility mapping (QSM) and quantitative blood oxygen level-dependent magnitude (qBOLD)-based oxygen extraction fraction (OEF) and cerebral metabolic rate of oxygen (CMRO2) mapping. Magn Reson Med. 2020;83:844–857. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Cho J, Spincemaille P, Nguyen TD, Gupta A, Wang Y. Combined cluster analysis of time evolution and tissue type with total variation denoising (CCTV) for QQ-based oxygen extraction fraction mapping. In Proceedings of the International Society of Magnetic Resonance in Medicine, Virtual, 2021. P 1283. [Google Scholar]
- 26.Zhang S, Cho J, Nguyen TD, et al. Initial experience of challenge-free MRI-based oxygen extraction fraction mapping of ischemic stroke at various stages: comparison with perfusion and diffusion mapping. Front Neurosci. 2020;14. Article 535441. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Cho J, Lee J, An H, Goyal MS, Su Y, Wang Y. Cerebral oxygen extraction fraction (OEF): comparison of challenge-free gradient echo QSM+qBOLD (QQ) with 15O PET in healthy adults. J Cereb Blood Flow Metab. 2021;41:1658–1668. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Cho J, Ma Y, Spincemaille P, Pike GB, Wang Y. Cerebral oxygen extraction fraction: comparison of dual-gas challenge calibrated BOLD with CBF and challenge-free gradient echo QSM+qBOLD. Magn Reson Med. 2021;85:953–961. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Cho J, Spincemaille P, Nguyen TD, Gupta A, Wang Y. Temporal clustering, tissue composition, and total variation for mapping oxygen extraction fraction using QSM and quantitative BOLD. Magn Reson Med. 2021;86:2635–2646. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Yoon J, Gong E, Chatnuntawech I, et al. Quantitative susceptibility mapping using deep neural network: QSMnet. Neuroimage. 2018;179:199–206. [DOI] [PubMed] [Google Scholar]
- 31.Bollmann S, Rasmussen KGB, Kristensen M, et al. DeepQSM - using deep learning to solve the dipole inversion for quantitative susceptibility mapping. Neuroimage. 2019;195:373–383. [DOI] [PubMed] [Google Scholar]
- 32.Jin KH, McCann MT, Froustey E, Unser M. Deep convolutional neural network for inverse problems in imaging. IEEE Trans Image Process. 2017;26:4509–4522. [DOI] [PubMed] [Google Scholar]
- 33.Shen D, Wu G, Suk HI. Deep learning in medical image analy- sis. Annu Rev Biomed Eng. 2017;19:221–248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.McCann MT, Jin KH, Unser M. Convolutional neural networks for inverse problems in imaging: a review. IEEE Signal Process Mag. 2017;34:85–95. [DOI] [PubMed] [Google Scholar]
- 35.Zhang J, Liu Z, Zhang S, et al. Fidelity imposed network edit (FINE) for solving ill-posed image reconstruction. Neuroimage. 2020;211:116579. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Zhang J, Zhang H, Sabuncu M, Spincemaille P, Nguyen T, Wang Y. Bayesian Learning of Probabilistic Dipole Inversion for Quantitative Susceptibility Mapping. 2020;arXiv:2004.12573 [eess.IV]. [Google Scholar]
- 37.Zhang J, Zhang H, Sabuncu M, Spincemaille P, Nguyen T, Wang Y. Probabilistic Dipole Inversion for Adaptive Quantitative Susceptibility Mapping. 2021. arXiv:2009.04251 [eess.IV]. [Google Scholar]
- 38.Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Netw. 1991;4:251–257. [Google Scholar]
- 39.Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O. 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation. 2016. arXiv:1606.06650 [cs.CV]. [Google Scholar]
- 40.Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. 2015. arXiv:1505.04597 [cs. CV]. [Google Scholar]
- 41.Liu T, Wisnieff C, Lou M, Chen W, Spincemaille P, Wang Y. Nonlinear formulation of the magnetic field to source relationship for robust quantitative susceptibility mapping. Magn Reson Med. 2013;69:467–476. [DOI] [PubMed] [Google Scholar]
- 42.Liu T, Khalidov I, de Rochefort L, et al. A novel background field removal method for MRI using projection onto dipole fields (PDF). NMR Biomed. 2011;24:1129–1136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.de Rochefort L, Liu T, Kressler B, et al. Quantitative susceptibility map reconstruction from MR phase data using bayesian regularization: validation and application to brain imaging. Magn Reson Med. 2010;63:194–206. [DOI] [PubMed] [Google Scholar]
- 44.Liu J, Liu T, de Rochefort L, et al. Morphology enabled dipole in-version for quantitative susceptibility mapping using structural consistency between the magnitude image and the susceptibility map. Neuroimage. 2012;59:2560–2568. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Wang Y, Liu T. Quantitative susceptibility mapping (QSM): decoding MRI data for a tissue magnetic biomarker. Magn Reson Med. 2015;73:82–101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Liu Z, Spincemaille P, Yao Y, Zhang Y, Wang Y. MEDI+0: morphology enabled dipole inversion with automatic uniform cerebrospinal fluid zero reference for quantitative susceptibility mapping. Magn Reson Med. 2018;79:2795–2803. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Jenkinson M, Smith S. A global optimisation method for robust affine registration of brain images. Med Image Anal. 2001;5:143–156. [DOI] [PubMed] [Google Scholar]
- 48.Jenkinson M, Bannister P, Brady M, Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage. 2002;17:825–841. [DOI] [PubMed] [Google Scholar]
- 49.An H, Lin W. Cerebral venous and arterial blood volumes can be estimated separately in humans using magnetic resonance imaging. Magn Reson Med. 2002;48:583–588. [DOI] [PubMed] [Google Scholar]
- 50.Sakai F, Nakazawa K, Tazaki Y, et al. Regional cerebral blood volume and hematocrit measured in normal human volunteers by single-photon emission computed tomography. J Cereb Blood Flow Metab. 1985;5:207–213. [DOI] [PubMed] [Google Scholar]
- 51.Savicki JP, Lang G, Ikeda-Saito M. Magnetic susceptibility of oxy- and carbonmonoxyhemoglobins. Proc Natl Acad Sci. 1984;81:5417–5419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Hoffman R. Hematology: Basic Principles and Practice. Churchill Livingstone: 2005. [Google Scholar]
- 53.Spees WM, Yablonskiy DA, Oswood MC, Ackerman JJ. Water proton MR properties of human blood at 1.5 Tesla: magnetic susceptibility, T(1), T(2), T*(2), and non-Lorentzian signal behavior. Magn Reson Med. 2001;45:533–542. [DOI] [PubMed] [Google Scholar]
- 54.Hua J, Liu P, Kim T, et al. MRI techniques to measure arterial and venous cerebral blood volume. Neuroimage. 2019;187:17–31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Hubertus S, Thomas S, Cho J, Zhang S, Wang Y, Schad LR. Using an artificial neural network for fast mapping of the oxygen extraction fraction with combined QSM and quantitative BOLD. Magn Reson Med. 2019;82:2199–2211. [DOI] [PubMed] [Google Scholar]
- 56.Liu Z, Kee Y, Zhou D, Wang Y, Spincemaille P. Preconditioned total field inversion (TFI) method for quantitative susceptibility mapping. Magn Reson Med. 2017;78:303–315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Calvetti D, Somersalo E. Priorconditioners for linear systems. Inverse Prob. 2005;21:1397–1418. [Google Scholar]
- 58.Benzi M. Preconditioning techniques for large linear systems: a survey. J Comput Phys. 2002;182:418–477. [Google Scholar]
- 59.Jafari R, Spincemaille P, Zhang J, et al. Deep neural network for water/fat separation: supervised training, unsupervised training, and no training. Magn Reson Med. 2021;85:2263–2277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Paszke A, Gross S, Chintala S, et al. Automatic differentiation in PyTorch. In: NIPS 2017 Workshop on Autodiff. Long Beach, California, USA; 2017. https://www.bibsonomy.org/bibtex/21530 dd0202e55d3eb1ada151e09c499. Accessed October 28, 2017. [Google Scholar]
- 61.Kingma D, Adam BJ. A Method for Stochastic Optimization. ICLR; 2014. arXiv:1412.6980 [cs.LG]. [Google Scholar]
- 62.Fung SH, Roccatagliata L, Gonzalez RG, Schaefer PW. MR diffusion imaging in ischemic stroke. Neuroimaging Clin N Am. 2011;21:345–377, xi. [DOI] [PubMed] [Google Scholar]
- 63.Zhang Y, Brady M, Smith S. Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans Med Imaging. 2001;20:45–57. [DOI] [PubMed] [Google Scholar]
- 64.Rudin LI, Osher S, Fatemi E. Nonlinear total variation based noise removal algorithms. Physica D. 1992;60:259–268. [Google Scholar]
- 65.Zhou W, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process. 2004;13:600–612. [DOI] [PubMed] [Google Scholar]
- 66.Yablonskiy DA, Haacke EM. Theory of NMR signal behavior in magnetically inhomogeneous tissues: the static dephasing regime. (0740–3194 (Print)). [DOI] [PubMed] [Google Scholar]
- 67.Ilesanmi AE, Ilesanmi TO. Methods for image denoising using convolutional neural network: a review. Complex & Intelligent Systems. 2021. 10.1007/s40747-021-00428-4 [DOI] [Google Scholar]
- 68.Xie J, Xu L, Chen E. Image denoising and inpainting with deep neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (NIPS’12). Curran Associates Inc., Red Hook, NY, 2012;341–349. [Google Scholar]
- 69.Baron JC. Mapping the ischaemic penumbra with PET: implications for acute stroke treatment. Cerebrovasc Dis (Basel, Switzerland). 1999;9:193–201. [DOI] [PubMed] [Google Scholar]
- 70.Bonova P, Burda J, Danielisova V, Nemethova M, Gottlieb M. Development of a pattern in biochemical parameters in the core and penumbra during infarct evolution after transient MCAO in rats. Neurochem Int. 2013;62:8–14. [DOI] [PubMed] [Google Scholar]
- 71.Dirnagl U, Iadecola C, Moskowitz MA. Pathobiology of ischaemic stroke: an integrated view. Trends Neurosci. 1999;22: 391–397. [DOI] [PubMed] [Google Scholar]
- 72.Mintun MA, Raichle ME, Martin WR, Herscovitch P. Brain oxygen utilization measured with O-15 radiotracers and positron emission tomography. J Nucl Med. 1984;25:177–187. [PubMed] [Google Scholar]
- 73.Raichle ME, MacLeod AM, Snyder AZ, Powers WJ, Gusnard DA, Shulman GL. A default mode of brain function. Proc Natl Acad Sci. 2001;98:676–682. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Hatazawa J, Shimosegawa E, Toyoshima H, et al. Cerebral blood volume in acute brain infarction: a combined study with dynamic susceptibility contrast MRI and 99mTc-HMPAO-SPECT. (0039–2499 (Print)). [DOI] [PubMed] [Google Scholar]
- 75.Kee Y, Liu Z, Zhou L, et al. Quantitative susceptibility mapping (QSM) algorithms: mathematical rationale and computational implementations. IEEE Trans Biomed Eng. 2017;64:2531–2545. [DOI] [PubMed] [Google Scholar]
- 76.Committee QCO, Bilgic B, Langkammer C, et al. QSM reconstruction challenge 2.0: design and report of results. Magn Reson Med. 2021;86:1241–1255. [DOI] [PubMed] [Google Scholar]
- 77.Sun X, He G, Qing H, et al. Hypoxia facilitates Alzheimer’s disease pathogenesis by up-regulating BACE1 gene expression. Proc Natl Acad Sci USA. 2006;103:18727–18732. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Acosta-Cabronero J, Williams GB, Cardenas-Blanco A, Arnold RJ, Lupson V, Nestor PJ. In vivo quantitative susceptibility mapping (QSM) in Alzheimer’s disease. PLoS One. 2013;8:e81093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Trapp BD, Stys PK. Virtual hypoxia and chronic necrosis of demyelinated axons in multiple sclerosis. Lancet Neurol. 2009;8:280–291. [DOI] [PubMed] [Google Scholar]
- 80.Stadlbauer A, Zimmermann M, Kitzwogerer M, et al. MR Imaging-derived oxygen metabolism and neovascularization characterization for grading and IDH gene mutation detection of gliomas. Radiology. 2017;283:799–809. [DOI] [PubMed] [Google Scholar]
- 81.Kudo K, Liu T, Murakami T, et al. Oxygen extraction fraction measurement using quantitative susceptibility mapping: Comparison with positron emission tomography. J Cereb Blood Flow Metab. 2016;36:1424–1433. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The code and data that support the findings of this study are openly available in QQ-NET at https://github.com/jc2852/QQ-NET.