Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Sep 28;17(9):e0274220. doi: 10.1371/journal.pone.0274220

CVR-MRICloud: An online processing tool for CO2-inhalation and resting-state cerebrovascular reactivity (CVR) MRI data

Peiying Liu 1,2,*, Zachary Baker 2,3, Yue Li 4, Yang Li 2, Jiadi Xu 2,5, Denise C Park 6, Babu G Welch 7,8, Marco Pinho 8, Jay J Pillai 2,9, Argye E Hillis 10, Susumu Mori 2,5, Hanzhang Lu 2,3,5
Editor: Yen-Yu Ian Shih11
PMCID: PMC9518872  PMID: 36170233

Abstract

Cerebrovascular Reactivity (CVR) provides an assessment of the brain’s vascular reserve and has been postulated to be a sensitive marker in cerebrovascular diseases. MRI-based CVR measurement typically employs alterations in arterial carbon dioxide (CO2) level while continuously acquiring Blood-Oxygenation-Level-Dependent (BOLD) images. CO2-inhalation and resting-state methods are two commonly used approaches for CVR MRI. However, processing of CVR MRI data often requires special expertise and may become an obstacle in broad utilization of this promising technique. The aim of this work was to develop CVR-MRICloud, a cloud-based CVR processing pipeline, to enable automated processing of CVR MRI data. The CVR-MRICloud consists of several major steps including extraction of end-tidal CO2 (EtCO2) curve from raw CO2 recording, alignment of EtCO2 curve with BOLD time course, computation of CVR value on a whole-brain, regional, and voxel-wise basis. The pipeline also includes standard BOLD image processing steps such as motion correction, registration between functional and anatomic images, and transformation of the CVR images to canonical space. This paper describes these algorithms and demonstrates the performance of the CVR-MRICloud in lifespan healthy subjects and patients with clinical conditions such as stroke, brain tumor, and Moyamoya disease. CVR-MRICloud has potential to be used as a data processing tool for a variety of basic science and clinical applications.

Introduction

Cerebrovascular reactivity (CVR) is an important index of the brain’s vascular health. It measures the ability of cerebral blood vessels to dilate or constrict in response to vasoactive stimuli, which provides complementary information to steady-state vascular parameters, such as cerebral blood flow (CBF) and cerebral blood volume (CBV). In recent years, the measurement of CVR has been increasingly reported in a range of applications, such as arterial stenosis [15], stroke [6, 7], small vessel disease [8, 9], brain tumors [1012], traumatic brain injury [13, 14], substance abuse [15], normal aging [1618] and dementia [1922]. More recently, CVR as a candidate biomarker of vascular diseases has also been applied in multi-center settings, such as in the MarkVCID study [23] and the INVESTIGATE-SVDs study [24].

Two of the most commonly used methods for MRI-based CVR mapping are CO2-inhalation CVR (CO2-CVR) and resting-state CVR (RS-CVR) [25]. In CO2-CVR, the subject inhales a mild hypercapnic gas mixture (e.g., 5% CO2, 21% O2, and 74% N2) as an explicit stimulus, while Blood-Oxygenation-Level-Dependent (BOLD) MRI images are continuously acquired [25]. Since CO2 is a potent vasodilator, the BOLD signal is expected to increase with CO2 inhalation and, by quantifying the extent of BOLD signal change, a measure of CVR can be obtained. RS-CVR is an emerging CVR method that exploits spontaneous fluctuations in breathing rate and depth, which alters arterial CO2, and determines the corresponding BOLD signal change in the resting-state BOLD time series [26, 27]. While CO2-CVR has the advantage of a well-defined stimulus paradigm and more robust signal, RS-CVR possesses the benefit of not requiring additional apparatus related to CO2 inhalation inside the MRI scanner. Both CVR methods have unique values in different applications.

To date, CVR data processing is considered a niche skill and most studies of CVR have used in-house scripts or software [28], creating challenges for reproducible and repeatable research and for researchers and clinicians with less skills in software programming. Therefore, a processing pipeline that is automatic and provides a wide spectrum of quantitative image and regional outputs is highly valuable and can potentially facilitate broader applications of this promising technique. Cloud-based computation represents a new model of neuroimage processing [29]. Compared to the traditional model of downloadable software package and local computer processing, the cloud-based platform utilizes software, computational, and storage resources on the remote computer for data processing and therefore mitigates the requirements on the user computer [30]. The user inputs are typically provided by uploading raw images to the cloud server as well as entering key acquisition parameters on a web interface. Similarly, the user can access the outputs of the processing by downloading text, table, or image files from the cloud website. Previous work has developed several cloud-based tools for the processing of T1 segmentation, diffusion, and arterial spin labeling (ASL) MRI, demonstrating the feasibility and applicability of cloud computing in the context of medical image processing.

In this work, we developed a cloud-based, publicly accessible tool for the processing of CO2-inhalation and resting-state CVR MRI data, referred to as CVR-MRICloud. Here we describe the framework of the pipeline, processing algorithms, and its outcomes, and demonstrate the performance of the tool on representative data of brain aging and cerebrovascular diseases.

Methods

General descriptions of CVR-MRICloud

An implementation of this pipeline can be found at https://braingps.mricloud.org/cvr.v5, with the computer architecture illustrated in Fig 1. A front-end web server is responsible for providing functionalities to allow interactions with a user, such as file upload, version selection, and entry of image acquisition parameters. The required image file format is ANALYZE (.hdr and.img) which does not contain protected health information (PHI) and thus, is compatible with Health Insurance Portability and Accountability Act (HIPAA) regulations. The input data are processed by a separate computational server, which then transfers outcome parameters to the front-end server for the user to download. The users can only access the outcome parameters from the data they had uploaded. The data and outcome parameters will be automatically deleted after 60 days from the upload if the users choose not to delete them manually.

Fig 1. Illustration of the general architecture of the CVR-MRICloud platform.

Fig 1

The deployment of CVR-MRICloud is conducted in a version-controlled manner. When a new version is released, it will have a specific version number and all older versions are still available on the CVR-MRICloud website.

The CO2-CVR and RS-CVR processing pipelines used an identical computational architecture, but the detailed algorithms have some differences. Below we separately described these algorithms.

Procedure of CO2-CVR data processing

A flowchart of the CO2-CVR processing pipeline is illustrated in Fig 2. The pipeline contains three major components, including automatic analysis of CO2 recording to obtain EtCO2 time course (labeled as module 1 in Fig 2), temporal alignment between BOLD and EtCO2 time courses (module 2), and computation of CVR using BOLD and EtCO2 data (module 3).

Fig 2. Flowchart of the data processing pipeline for CO2-CVR MRI data.

Fig 2

Details of the algorithms in Module 1 through 3 are explained in the main text. CO2 –carbron dioxide; EtCO2 –end-tidal CO2; BOLD–Blood Oxygenation Level Dependent; GLM–general linear model; CVR–cerebrovascular reactivity; BAT–bolus arrival time.

Extraction of end-tidal CO2 (EtCO2) time course from CO2 recording

Fig 3A illustrates an example of CO2 data used in the CVR data processing. The blue, high-frequency curve represents the raw CO2 recording. This recording is typically obtained by placing a small sampling tubing near the mouth or nose of the subject during the experiment, while a CO2 monitor located outside the MRI room samples the air with a pump and analyzes for CO2 content. The sampling frequency is dependent on the specific CO2 monitor used in the experiments, but it generally ranges from 10 to 200 Hz. Each cycle in the curve represents one breathing cycle, with CO2 content of the inhaled air corresponding to the troughs and that of exhaled air corresponding to the peaks. The period of curve is dependent on the breathing rate and typically ranges from 3 to 8 seconds.

Fig 3. Extraction of EtCO2 time course from CO2 recording.

Fig 3

(A) Example of raw CO2 recording (blue curve) and the extracted EtCO2 time course (red curve). (B) Flowchart of the EtCO2 extraction processing.

The red curve in Fig 3A is referred to as end-tidal CO2 (EtCO2) time course. It reflects the amount of CO2 in the lung, which approximates the CO2 content in the arterial blood. EtCO2 is typically obtained from the raw CO2 recording by extracting peaks, i.e. CO2 in the exhaled air, on the curve.

Fig 3B shows a flowchart of methods to extract EtCO2 from the CO2 recording. We first smoothed (using 100ms-moving window) and resampled the CO2 recording into a pre-set frequency of 10Hz. Given that typical breathing frequency is <0.3Hz, this sampling rate is expected to be sufficient for the computation of CO2 peaks in the breathing cycle. An additional benefit of the resampling is that the signal-to-noise ratio (SNR) of the CO2 time course is improved.

Next, two separate algorithms were used to identify the peaks in the CO2 time course. We found that each algorithm has advantages in detecting peaks under certain signal patterns, thus by using both algorithms and selecting the higher value between the two outcomes the robustness of the EtCO2 computation pipeline can be enhanced. Algorithm I, referred to as the Scale-Space algorithm [31], uses a single criterion: v(n) = max[v(n − 1) v(n) v(n + 1)], to detect all local maxima in the CO2 time course. Then, the time course was smoothed and the local maximum detection algorithm was repeated. If a particular local maximum was still identified after smoothing, its “peak likelihood score” was increased. This process is repeated 30 times and a time course of “peak likelihood score” was obtained. A threshold was applied on the “peak likelihood score” time course to obtain a binary vector of CO2 peaks. The corresponding EtCO2 values at these peaks are also obtained.

Algorithm II, referred to as the Smooth-Cross algorithm, first applies a moving-average filter with window size of 10s. The window size of 10s was chosen as a trade-off between the degree of smoothing and the sensitivity during the room air-CO2 transition periods. The intersection points between the moving-averaged and the original traces then allow the dividing of the CO2 trace into breath-by-breath segments. The peak CO2 value within each segment can then be identified and the corresponding time was labeled to form a binary vector, similar to the outcome of Algorithm I.

Next, the peak CO2 vector obtained by each algorithm was subject to a five-point median filtering so that any peaks as a result of partial breath were removed. Since the intervals of breathing cycle are variable and can be different across individuals, we then interpolated the outputs into a time series of 1Hz. These steps were performed on the outcomes of Algorithms I and II separately.

Finally, the higher value from Algorithms I and II at each point in the interpolated time series was selected to form the EtCO2 curve (Fig 3B), as the EtCO2 curve represent the top envelope of the CO2 trace.

Temporal alignment between BOLD and EtCO2 time courses

Before the EtCO2 curve obtained in the previous step can be used for the estimation of CVR, it must be first aligned with the BOLD time course. This is needed because the EtCO2 signal is measured from the lung and the BOLD signal is measured from the brain, and thus a signal shift between them is expected based on physiology. This processing step therefore aims to temporally align the EtCO2 to BOLD time-course. Preprocessing of the BOLD data used SPM12 and included motion correction and spatial smoothing (with 8mm FWHM Gaussian kernel). A whole-brain mask was also obtained by segmenting the mean BOLD image and adding together the gray matter, white matter and CSF masks, which was then applied to the BOLD image series to calculate a whole-brain-averaged BOLD time course.

The alignment of EtCO2 and whole-brain BOLD time courses used the following General Linear Model:

BOLDt=β1EtCO2t,s¯¯+β2l+β0 (1)

where is a linearly ascending term, i.e. [−(N − 1)⁄2, −(N + 1)⁄2, …, (N − 1)⁄2] and N is the total number of time points. The double bar accent indicates a zero-meaned signal. s is the time shift of the EtCO2 time course and is detailed below.

In order to find an appropriate time shift to align these two signals, a two-step process is performed, as illustrated in Fig 4. First, the GLM analysis described in Eq [1] was repeated multiple times, after a step-wise shift (s) of the EtCO2 time course relative to BOLD for all possible values (i.e., from 0 to EtCO2 time course duration–BOLD time course duration). The step size was set to be 1 second, in accordance with the sampling rate of the EtCO2 data. After each shift, the EtCO2 time course was resampled (linear interpolation) to the BOLD intervals (i.e. TR), the regression was performed, and the residual error from the fitting was recorded. The shift with the minimal residual error was identified and used as a preliminary “optimal shift value” (Fig 4A). As a second step, a smaller EtCO2 shift step of 100 ms is used and the searching range is set to be +/-5 seconds. The GLM analysis was repeated at each of these finer shift values. The residuals are then fitted to a second-degree polynomial, and the lowest point on the polynomial is used as the final optimal time shift (Fig 4B), similar to the work by Donahue et al. [32]. This two-step procedure is expected to yield more reliable optimal shift value than using the first step alone. EtCO2 time course shifted by this optimal value was then used as the regressor in computation of CVR (see below).

Fig 4. Example of the two-step processing for the temporal alignment between BOLD and EtCO2 time courses.

Fig 4

(A) Plot of the residual error from the GLM in Eq [1] as a function of time shift in a representative subject. Red dot indicates the time shift that reveals the minimal residual error. (B) Results of the second-step alignment. The plot displays the residual error at each time shift within the 10s range (box in (A)) around the minumal point determined in the first step (red dot). The final optimal time shift (green circle) was determined from the second-degree polynomial fitting of the residuals.

Computation of CVR

Whole-brain CVR is obtained by a GLM between whole-brain averaged BOLD signal and global-shifted EtCO2, using Eq [1] above. The coefficients β1 and β0 from Eq [1] are then used in the following formula to calculate CVR in the units of %/mmHg:

CVR=β1β0-β1*[meanEtCO2-baselineEtCO2]*100 (2)

Where mean(EtCO2) and baseline(EtCO2) are the mean and bottom 25% average of the EtCO2 curve, respectively. Here the average of the bottom 25% EtCO2 time points is considered the baseline EtCO2 value, instead of the minimum, to mitigate the influence of unusual breathing pattern in the experiment (for example, a single deep breath at any time during the experiment can result in very low EtCO2 value).

Regional CVR is also calculated. A T1-segmentation MRICloud was used to parcellate the brain into different numbers of segments, ranging from 52 to 289 depending on the level of parcellation [8]. Once the ROI corresponding to each segment is obtained, the BOLD signal was spatially averaged. The resulting time course was aligned to EtCO2 as described above and subject to GLM analysis in Eq [1]. Regional CVR was then calculated with Eq [1]. Note that the EtCO2 curve was aligned to each specific ROI to account for regional variations in the hemodynamic response time, e.g. white matter may have a delayed BOLD response compared to the gray matter [33].

Voxel-wise CVR map was computed using two different methods. One method used the globally-shifted EtCO2 and performed a GLM with voxel-by-voxel BOLD time course. The other method used a voxel-wise-shifted EtCO2 for the GLM analysis [25]. In the voxel-wise-shifted analysis, the global-shifted EtCO2 is used as a starting point and it is then further shifted within a range of -5 to 30s to identify the best shift for each voxel. This search range is relatively narrow to avoid local minimum due to noise and was decided based on previous reports of inter-voxel variations in CO2 response [33]. Note that the voxel-wise-shift analysis also yields a “temporal shift map”, which may also contain physiologically useful information similar to bolus arrival time (BAT) map in dynamic-susceptibility-contrast (DSC) and arterial-spin-labeling (ASL) MRI. It should be pointed out that both global and voxel-wise shift approaches have their advantages and disadvantages [25]. The global-shifted EtCO2 is the more robust as it is based on the whole-brain averaged BOLD time course and the SNR of the BOLD data is expected to be excellent. On the other hand, voxel-wise-shifted EtCO2 considers regional/inter-voxel heterogeneity; but the signal can be noisy and thus optimal shift obtained may have poor reliability [25].

Additionally, voxel-wise CVR and temporal shift maps were transformed into the individual’s MPRAGE space and the Montreal Neurologic Institute (MNI) standard space. Aside from the absolute value CVR maps, relative CVR maps were also obtained by dividing each voxel by the map’s average value.

To provide an index of the overall quality of the CVR data, partial correlation coefficient (CC) between the whole-brain BOLD time course and the global-shifted EtCO2 after factoring out the linear drift, as described in Eq [1], was computed.

Procedure of RS-CVR data processing

A flowchart of the RS-CVR data is illustrated in Fig 5. Preprocessing of the BOLD data was identical to that described in the CO2-CVR pipeline. However, RS-CVR data did not have associated CO2 recording, thus EtCO2 was not used in the data processing. Instead, the EtCO2 term in Eq [1] was replaced with a surrogate derived from the whole-brain BOLD time course. Specifically, the whole-brain BOLD time course was linearly detrended and a low-pass filter with a cutoff frequency of 0.1164Hz is applied. The temporal filtering frequency of [0, 0.1164 Hz] has been found to yield the highest spatial correlation between RS-CVR maps and CO2-CVR maps [34]. Next, the resulting time course was rescaled as s0=s-means/2s-means/N, where N is the total number of dynamics, and the operator ||K|| indicates 2-norm. The purpose of the rescaling is to ensure that the resulting time course has a zero mean and a 2-norm of sqrt(N)/2. This time course is referred to as the reference signal afterwards. A GLM analysis was then performed on each voxel:

BOLDBOLD=β1referencesignal+β2motion+β3t+β0, (3)

where the voxel-wise BOLD time course is the dependent variable and the reference signal is the independent variable. Six motion vectors (3 displacements and 3 rotations) and a linear trend were also added as covariates. RS-CVR is then obtained as β1β0*100. The voxel-wise RS-CVR value was further divided by the whole-brain average value to yield relative CVR map.

Fig 5. Flowchart of the data processing pipeline for RS-CVR.

Fig 5

The relative CVR map was further transformed into the individual’s MPRAGE space and the MNI standard space. Regional CVR is also calculated by averaging the relative CVR values within each ROI obtained from the T1-segmentation MRICloud pipeline. Similar to that in the CO2-CVR quantification, regional relative CVR values are calculated for different numbers of segments, ranging from 52 to 289 depending on the level of parcellation.

Pipeline testing

CVR-MRICloud was tested using data collected in several different studies reported previously [16, 3537]. For CO2-CVR pipeline testing, 203 datasets from a lifespan cohort (age 50.9±19.8 years, 79 males, 124 females) was used. The CO2-inhalation paradigm used interleaved blocks of 60s room-air breathing and 60s of hypercapnic gas (5% CO2, 21% O2, and 74% N2), for a scan time of 7min. The BOLD MRI sequence used a TR of 2000 ms, a TE of 25 ms, and a voxel size of 3.44×3.44×3.5 mm3, with a duration of 5min performed on a Philips MRI system. In addition, the CVR-MRICloud pipeline was applied to data from a brain tumor patient (58 years old, male) and a patient with Moyamoya disease (55 years old, female). For RS-CVR pipeline testing, resting-state BOLD data from the above-mentioned lifespan cohort, repeated scans from a healthy young subject (28 years old, male), and a patient at 24 weeks after stroke (56 years old, male) were used. These studies have been approved by the institutional review board (IRB) of Johns Hopkins University and University of Texas Southwestern Medical Center. Informed written consent was obtained for each participant.

Results

Extraction of EtCO2 time course from raw CO2 recording

Fig 6 illustrates the processing results of EtCO2 in two representative subjects. In the first subject (Fig 6A), the breathing rhythm of the participant was consistent throughout the experiment. Thus, both algorithms used performed reliably. In the second subject (Fig 6B), on the other hand, the individual’s breathing rate was more variable. Thus both algorithms generated some incorrect peaks (red arrows). The median-filter processing was able to mitigate the errors to some extent (green arrows), but certain degree of under-estimation in the CO2 peak is still present. The use of the higher value between the two algorithms can further reduce the occurrences of under-estimation. Upon visual inspection of all processed CO2 data described in this study (N = 203), we found that the pipeline was successful in finding the CO2 trace’s upper envelope, i.e. EtCO2, in all subjects.

Fig 6. Two examples illustrating the performance of the EtCO2 extraction algorithm.

Fig 6

(A) Results from a subject with consistent breathing intervals. Both the Scale-Space and Smooth-Cross algorithms detected the peaks correctly. (B) Results from a subject with variable breathing intervals. Both the Scale-Space and Smooth-Cross algorithms showed instances of underestimating the true EtCO2 curve (red and green arrows). These underestimations were corrected by the final step, which selects the higher value from the two outputs. Plots from left to right: CO2 trace, initil peaks identified by the Scale-Space and Smooth-Cross algorithms, peaks after median filtering, outputs after interpolation and finding the higher value between two algorithms (i.e. the EtCO2 curve).

Temporal alignment between EtCO2 and BOLD time courses

Fig 7A shows 6 examples of optimally shifted EtCO2 curves together with the corresponding whole-brain BOLD time courses, stratified by ascending cross-correlation coefficients (CC) between EtCO2 and BOLD time course. For the entire cohort of 203 subjects, the CC were 0.937±0.067 and their histogram is shown in Fig 7B. It can be seen that generally the alignment results were excellent. The cases where low CC values were observed were primarily due to noisy BOLD time course, presumably due to subject motion (e.g. red arrows).

Fig 7. Performance of the temperal alignment between EtCO2 and BOLD time courses.

Fig 7

(A) Examples of the optimally shifted EtCO2 curves with the corresponding whole-brain BOLD time courses. Six examples with ascending data quality are shown. Red arrows indicate BOLD signal spikes due to subject motion, which result in lower correlation coefficients (CC) between EtCO2 and whole-brain BOLD time courses. (B) Histogram of the CC in 203 healthy subjects.

CO2-CVR

Examples of CO2-CVR maps produced by CVR-MRICloud are displayed in Fig 8A, showing the same six participants illustrated in Fig 7A. These maps have been transformed to MNI space. As can be seen, the quality of the CVR map is directly related to the CC between EtCO2 and whole-brain BOLD time course. Individuals with a higher CC tend to yield CVR maps of better quality. Fig 8B shows time shift maps obtained by voxel-wise shift analysis between the EtCO2 and BOLD time course.

Fig 8. Examples of CO2-CVR results.

Fig 8

(A) Relatiev CVR maps in MNI space from the same 6 subjects shown in Fig 7. (B) Time-shift maps from the same subjects.

Quantitative values of whole-brain CVR are plotted as a function of age in Fig 9A. The participants were grouped into decades. It can be seen that CVR decreases with age. Fig 9B show decade-by-decade averaged CVR maps.

Fig 9. CO2-CVR results from 203 healthy subejcts.

Fig 9

(A) Decade-by-decade differences in whole-brain CVR values. Mean and standard deviation of each decade are shown in black. Individual CVR value of each subject is shown in gray circle. (B) Decade-by-decade averaged CVR maps. N = 34, 36, 29, 29, 26, 29 and 20, respective, for each decade.

Fig 10 demonstrates the feasibility of CVR-MRICloud in processing CVR data from pathological conditions. Fig 10A presents a patient diagnosed with a glioblastoma in the left hemisphere. The tumor is clearly seen as a T1-hypointense region on the anatomical MPRAGE image and displays prominent regional CVR reduction relative to surrounding normal tissue on the corresponding CVR map. Fig 10B presents a patient diagnosed with unilateral Moyamoya disease. The angiogram shows an occluded left middle cerebral artery in the left hemisphere. Accordingly, the CVR map demonstrates diminished signal in the left hemisphere, notably in the regions perfused by the left middle cerebral artery.

Fig 10. Examples of CO2-CVR maps in patients with brain disorders.

Fig 10

(A) Anatomical image and CVR map from a patient with glioblastoma (58 years of age, male). Blue circles indicate tumor region. BOLD imaging parameters were: TR/TE = 1550/21ms, resolution = 3.2x3.2x3.5mm3, 362 dynamics. (B) Time-of-flight angiogram and CVR map from a patient with Moyamoya disease (55 years of age, female). Blue arrow indicates right MCA stenosis. BOLD imaging parameters were: TR/TE = 1510/21ms, resolution = 3.2x3.2x4.2mm3, 372 dynamics.

RS-CVR maps

Examples of RS-CVR maps produced by CVR-MRICloud are shown in Fig 11. It can be seen in Fig 11A that relative CVR maps can be obtained reliably from resting-state data. Fig 11B demonstrates good reproducibility of RS-CVR maps acquired from consecutive resting-state BOLD scans in the same healthy subject.

Fig 11. Examples of resting-state CVR maps.

Fig 11

(A) CVR map from an healthy subject (28 years of age, male). BOLD imaging parameters were: TR/TE = 2000/25ms, resolution = 3.4x3.4x3.5mm3, 154 dynamics. (B) CVR maps from repeated resting-state runs in a healthy subject (28 years of age, male). BOLD imaging parameters were: TR/TE = 1000/25ms, resolution = 3.4x3.4x5mm3, 300 dynamics.

RS-CVR map from a clinical stroke patient is shown in Fig 12. Prominent cortical and subcortical CVR reduction corresponds to the abnormal T2-hyperintense infarcted region in this stroke patient.

Fig 12. Resting-state CVR map from a patient with stroke (56 year of age, male).

Fig 12

The MRI was performed at 24 weeks after stroke onset. Infarcts were identified at temporal lobe, insular region and frontal operculum/inferior lobe. Arrows indicate stroke lesion region in temporal lobe. BOLD imaging parameters were: TR/TE = 2000/30ms, resolution = 3x3x4mm3, 210 dynamics.

Discussion

In this work we developed CVR-MRICloud, a web-based data processing pipeline for CVR experiments employing either hypercapnic gas inhalation or resting-state MRI. The pipeline encompasses all major steps of CVR processing including CO2 recording analysis, BOLD image pre-processing, temporal alignment between CO2 and BOLD time courses, and computation of whole-brain, regional, and voxel-wise CVR results. These algorithms are fully automated, thus are ideally suited for cloud-based computing. The processing procedure also considers timing differences between different brain regions and tissue types (i.e. gray versus white matter), and provides an estimation of the time shift map, which is thought to be related to bolus arrival time of the brain vasculature and may be physiologically meaningful.

To our knowledge, CVR-MRICloud is the only web-based, fully automated CVR processing tool to date. Many methods of CVR processing, including those from the authors’ group [38], contain certain steps of manual processing, e.g. identification of EtCO2 time course from the raw CO2 recording, and often require custom scripts. Other methods such as those in Functional Software Library (FSL) suites [33, 35, 39] requires the installation of software packages on specific operating systems, e.g. Linux. CVR-MRICloud provides an operating-system independent processing platform and can work with any electronic device that has a web-browser application. Minimal experience is required in order to use this tool. An inter-rater evaluation performed by 4 raters with no previous CVR experience revealed that the ICC of CVR values was >0.9959, suggesting that CVR-MRICloud is user-friendly and the results are not user-dependent [37]. The RS-CVR pipeline has also been utilized by researchers with no previous experience with CVR and yielded multiple publications [4042]. CVR-MRICloud also presents minimal requirements on the device’s CPU, memory, and storage capacity, as all computations are performed on the remote computer provided by the developer. For the CO2-CVR datasets obtained in the lifespan study with the imaging matrix of 64x64x43 and 211 dynamics, the processing time is about 16min for one dataset. The results of the lifespan study revealed age-related CVR decrease, consistent with previous report [16].

CVR-MRICloud aimed to incorporate the latest advances in CVR processing. The extraction of the EtCO2 time course used two state-of-the-art algorithms, the Scale-Space algorithm [31] and the Smooth-Cross algorithm, which can account for various artifacts in the CO2 recording such as those due to partial breath and irregular breath. The alignment of the BOLD and EtCO2 time courses used a two-step processing and employed the polynomial fitting method similar to that used by Donahue et al. [32], which is potentially more robust to noise than the simple minimum-searching method. The model to compute CVR value is based on linear regression between CO2 (as input) and BOLD signal (as output), but also considered linear drift of the MRI time course that is common in fMRI and CVR data. Motion vectors were not included as covariates in CO2-CVR processing because, in our experience, they can show similar time course as the EtCO2 curve (see S1 Fig for examples) and if included in the GLM analysis, may lead to underestimation of CVR. The CVR-MRICloud pipeline also takes into account previous observations that different regions in the brain, in particular between gray and white matter regions, show a relative temporal shift in their time courses. This temporal shift is well-known from other MRI techniques such as arterial spin labeling (about 2 seconds of non-invasively labeled blood) and dynamic susceptibility contrast (DSC) MRI (about 5 seconds of Gadolinium bolus), but appear to be exacerbated in CO2-CVR MRI (1–2 minutes of hypercapnic bolus) [33]. Therefore, the present pipeline also conducted analysis using voxel-wise temporal shift, such that each voxel not only gives a CVR value but also yields a temporal delay index. Some literatures have suggested that the delay index is also of potential diagnostic value in clinical conditions [32, 35].

Resting-state based CVR is a new method for CVR estimation. This method has the obvious advantage that it does not require the CO2-inhalation apparatus. According to the processing pipeline used in the present work, which is based on the work of Liu et al. [26, 34], it does not even require the CO2 recording. Therefore, the RS-CVR method is substantially easier to implement in research and even routine clinical settings. In fact, one can also conduct retrospective processing on the resting-state fMRI data previously collected, including those available in large multi-site studies, such as ADNI [43], ABCD [44], HCP [45], and UK Biobank [46]. The present processing pipeline uses filtered whole-brain BOLD time course as a surrogate of the actual CO2 recording in the regression model. One reason for this approach is that CO2 recording is not available in many resting-state fMRI studies and the requirement of a CO2 monitor and the associated sampling tubing adds to the complexity of the procedure. Another reason is that resting-state CO2 recording measured at the mouth may not accurately reflect the CO2 time course in the brain, due to the relatively small amplitude of CO2 fluctuations during rest in combination with the expected dispersion effect along its path through lung, pulmonary vein, heart, and feeding arteries [47, 48]. Of course, the drawback of not having a CO2 recording is that the estimated CVR is a relative measure, but does not provide an absolute value, e.g. %ΔBOLD signal per mmHg CO2. Thus the RS-CVR method is ideally suited for applications where the pathology is more focal or one can find a (relatively) healthy region, such as a contralateral normal hemisphere, as an internal reference standard. If absolute CVR value is desired in the resting-state method, one can record EtCO2 during the data acquisition. This can mitigate potential issues related to the use of internal reference model. The RS-CVR pipeline has been utilized to identify regional CVR abnormalities in human immunodeficiency virus-infected patients [49] and glaucoma patients [40].

Patient confidentiality, data protection, and security of data transfer are typical challenges associated with cloud-computing of medical imaging analysis. These issues have been extensively discussed in the original report of the MRICloud platform [29]. Briefly, the uploaded imaging data are in ANALYZE format, which includes a raw image matrix and a header file that contains only the matrix dimension information. To ensure the security of the processing pipeline, SSH is used as the core in data transfer and signaling commands on the computational server. However, researchers should consider whether they need to include cloud processing in their consent process and ensure compliance with local data protection regulations before uploading data.

A few limitations of this work should be acknowledged. The CVR-MRICloud, similar to cloud-processing of other MRI modalities, lacks the flexibility of allowing user inputs or graphical user interface. This is by the design of the cloud platform in which the submitted data are not processed in real-time. Instead, the data are placed in a queue and will be processed sequentially by the computation server. Thus, it is not practical to have the user wait in front of the terminal to provide inputs. There are other CVR processing methods available for users with technical expertise, such as “SeeVR” which allows the users to further tune and optimize the regressors used in the GLM analysis [50]. Future version of the CVR-MRICloud will allow the uploading of user-defined ROIs and user-selection of the FWHM Gaussian kernel for spatial smoothing. As an additional limitation related to the CO2 processing algorithm, we observed in 4 cases an unanticipated phenomenon dubbed ‘CO2 Switching’. Usually, the EtCO2 corresponds to the peaks of the CO2 trace representing the CO2 content in the exhaled air. However, when a subject’s lung CO2 content responds too slowly to the hypercapnic gas challenge, the exhaled air temporarily has a CO2 content that is lower than the inhaled air, resulting the trough of the CO2 trace representing the EtCO2. As a result, the automatic CO2 processing algorithm incorrectly labels the subject’s inhaled CO2 partial pressure as their EtCO2 curve. In these cases, manual correction is needed. Two examples of “CO2 Switching” are shown in Fig 13. We found that “CO2 Switching” is rare and only occurs when the subject has an unusually low baseline EtCO2 level (e.g. <25 mmHg). There is no known algorithm to detect the “CO2 switching” automatically. Therefore, users are encouraged to examine the CO2 traces for potential “CO2 switching” when unusually low baseline EtCO2 level is observed.

Fig 13. Two examples of “CO2 Switching”.

Fig 13

Top panels show the EtCO2 time courses obtained from the automatic CO2 processing algorithm. Bottom panels show the manual and correct EtCO2 time courses.

Conclusion

In this work, we presented a cloud-based pipeline for the processing of CO2-inhalation and resting-state CVR data, referred to as CVR-MRICloud. This tool is fully automated, operating-system independent, and has minimal requirements on the user’s computer. CVR-MRICloud provides quantitative CVR and delay time results in regional values and voxel-wise maps. Applications of CVR-MRICloud in lifespan healthy subjects as well as in patients with brain pathologies were demonstrated. CVR-MRICloud has potential to be used as a data processing tool for a variety of basic science and clinical applications.

Supporting information

S1 Fig. EtCO2 curves and motion curves from two healthy subjects with high R2 values.

The motion curve was in foot-head (FH) direction obtained using spm_realign.m function.

(DOCX)

Data Availability

The anonymized data sets necessary to replicate our study findings are shared on Dryad. The data sets can be downloaded at: https://doi.org/10.5061/dryad.wh70rxwqw.

Funding Statement

This work is supported in part by the National Institutes of Health grants R01 NS115771 (P.L.), R01 AG064792 (H.L.), RF1 AG071515 (H.L.), R01 NS106711 (H.L.), R01 NS106702 (H.L.), UF1 NS100588 (H.L.), RF1 AG006265 (D.P.), R01 DC005375 (A.H.), R01 DC015466 (A.H.), R01 NS084957 (S.M.), P41 EB031771 (H.L.), S10 OD021648 (H.L.). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Mandell DM, Han JS, Poublanc J, Crawley AP, Stainsby JA, Fisher JA, et al. Mapping cerebrovascular reactivity using blood oxygen level-dependent MRI in Patients with arterial steno-occlusive disease: comparison with arterial spin labeling MRI. Stroke; a journal of cerebral circulation. 2008;39(7):2021–8. doi: 10.1161/STROKEAHA.107.506709 . [DOI] [PubMed] [Google Scholar]
  • 2.Gupta A, Chazen JL, Hartman M, Delgado D, Anumula N, Shao H, et al. Cerebrovascular reserve and stroke risk in patients with carotid stenosis or occlusion: a systematic review and meta-analysis. Stroke; a journal of cerebral circulation. 2012;43(11):2884–91. doi: 10.1161/STROKEAHA.112.663716 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Mikulis DJ, Krolczyk G, Desal H, Logan W, Deveber G, Dirks P, et al. Preoperative and postoperative mapping of cerebrovascular reactivity in moyamoya disease by using blood oxygen level-dependent magnetic resonance imaging. J Neurosurg. 2005;103(2):347–55. doi: 10.3171/jns.2005.103.2.0347 . [DOI] [PubMed] [Google Scholar]
  • 4.Donahue MJ, Ayad M, Moore R, van Osch M, Singer R, Clemmons P, et al. Relationships between hypercarbic reactivity, cerebral blood flow, and arterial circulation times in patients with moyamoya disease. J Magn Reson Imaging. 2013:; In-press. doi: 10.1002/jmri.24070 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.De Vis JB, Petersen ET, Bhogal A, Hartkamp NS, Klijn CJ, Kappelle LJ, et al. Calibrated MRI to evaluate cerebral hemodynamics in patients with an internal carotid artery occlusion. Journal of cerebral blood flow and metabolism: official journal of the International Society of Cerebral Blood Flow and Metabolism. 2015;35(6):1015–23. doi: 10.1038/jcbfm.2015.14 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Geranmayeh F, Wise RJ, Leech R, Murphy K. Measuring vascular reactivity with breath-holds after stroke: a method to aid interpretation of group-level BOLD signal changes in longitudinal fMRI studies. Human brain mapping. 2015;36(5):1755–71. doi: 10.1002/hbm.22735 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Krainik A, Hund-Georgiadis M, Zysset S, von Cramon DY. Regional impairment of cerebrovascular reactivity and BOLD signal in adults after stroke. Stroke; a journal of cerebral circulation. 2005;36(6):1146–52. doi: 10.1161/01.STR.0000166178.40973.a7 . [DOI] [PubMed] [Google Scholar]
  • 8.Greenberg SM. Small vessels, big problems. The New England journal of medicine. 2006;354(14):1451–3. doi: 10.1056/NEJMp068043 . [DOI] [PubMed] [Google Scholar]
  • 9.Marstrand JR, Garde E, Rostrup E, Ring P, Rosenbaum S, Mortensen EL, et al. Cerebral perfusion and cerebrovascular reactivity are reduced in white matter hyperintensities. Stroke; a journal of cerebral circulation. 2002;33(4):972–6. doi: 10.1161/01.str.0000012808.81667.4b . [DOI] [PubMed] [Google Scholar]
  • 10.Zaca D, Jovicich J, Nadar SR, Voyvodic JT, Pillai JJ. Cerebrovascular reactivity mapping in patients with low grade gliomas undergoing presurgical sensorimotor mapping with BOLD fMRI. J Magn Reson Imaging. 2014;40(2):383–90. doi: 10.1002/jmri.24406 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Pillai JJ, Zaca D. Clinical utility of cerebrovascular reactivity mapping in patients with low grade gliomas. World journal of clinical oncology. 2011;2(12):397–403. doi: 10.5306/wjco.v2.i12.397 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Fierstra J, van Niftrik B, Piccirelli M, Burkhardt JK, Pangalu A, Kocian R, et al. Altered intraoperative cerebrovascular reactivity in brain areas of high-grade glioma recurrence. Magnetic resonance imaging. 2016;34(6):803–8. doi: 10.1016/j.mri.2016.02.003 . [DOI] [PubMed] [Google Scholar]
  • 13.Chan ST, Evans KC, Rosen BR, Song TY, Kwong KK. A case study of magnetic resonance imaging of cerebrovascular reactivity: a powerful imaging marker for mild traumatic brain injury. Brain Inj. 2015;29(3):403–7. doi: 10.3109/02699052.2014.974209 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kenney K, Amyot F, Haber M, Pronger A, Bogoslovsky T, Moore C, et al. Cerebral Vascular Injury in Traumatic Brain Injury. Experimental neurology. 2016;275 Pt 3:353–66. doi: 10.1016/j.expneurol.2015.05.019 . [DOI] [PubMed] [Google Scholar]
  • 15.Han JS, Mandell DM, Poublanc J, Mardimae A, Slessarev M, Jaigobin C, et al. BOLD-MRI cerebrovascular reactivity findings in cocaine-induced cerebral vasculitis. Nature clinical practice Neurology. 2008;4(11):628–32. doi: 10.1038/ncpneuro0918 . [DOI] [PubMed] [Google Scholar]
  • 16.Lu H, Xu F, Rodrigue KM, Kennedy KM, Cheng Y, Flicker B, et al. Alterations in cerebral metabolic rate and blood supply across the adult lifespan. Cerebral cortex. 2011;21(6):1426–34. doi: 10.1093/cercor/bhq224 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Gauthier CJ, Madjar C, Desjardins-Crepeau L, Bellec P, Bherer L, Hoge RD. Age dependence of hemodynamic response characteristics in human functional magnetic resonance imaging. Neurobiology of aging. 2013;34(5):1469–85. doi: 10.1016/j.neurobiolaging.2012.11.002 . [DOI] [PubMed] [Google Scholar]
  • 18.De Vis JB, Hendrikse J, Bhogal A, Adams A, Kappelle LJ, Petersen ET. Age-related changes in brain hemodynamics; A calibrated MRI study. Human brain mapping. 2015;36(10):3973–87. doi: 10.1002/hbm.22891 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Sur S, Lin Z, Li Y, Yasar S, Rosenberg P, Moghekar A, et al. Association of cerebrovascular reactivity and Alzheimer pathologic markers with cognitive performance. Neurology. 2020;95(8):e962–e72. Epub 2020/07/15. doi: 10.1212/WNL.0000000000010133 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Yezhuvath US, Uh J, Cheng Y, Martin-Cook K, Weiner M, Diaz-Arrastia R, et al. Forebrain-dominant deficit in cerebrovascular reactivity in Alzheimer’s disease. Neurobiology of aging. 2012;33(1):75–82. doi: 10.1016/j.neurobiolaging.2010.02.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Silvestrini M, Pasqualetti P, Baruffaldi R, Bartolini M, Handouk Y, Matteis M, et al. Cerebrovascular reactivity and cognitive decline in patients with Alzheimer disease. Stroke; a journal of cerebral circulation. 2006;37(4):1010–5. Epub 2006/02/25. doi: 10.1161/01.STR.0000206439.62025.97 . [DOI] [PubMed] [Google Scholar]
  • 22.Cantin S, Villien M, Moreaud O, Tropres I, Keignart S, Chipon E, et al. Impaired cerebral vasoreactivity to CO2 in Alzheimer’s disease using BOLD fMRI. Neuroimage. 2011;58(2):579–87. Epub 2011/07/13. doi: 10.1016/j.neuroimage.2011.06.070 . [DOI] [PubMed] [Google Scholar]
  • 23.Lu H, Kashani AH, Arfanakis K, Caprihan A, DeCarli C, Gold BT, et al. MarkVCID cerebral small vessel consortium: II. Neuroimaging protocols. Alzheimers Dement. 2021;17(4):716–25. Epub 2021/01/23. doi: 10.1002/alz.12216 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Blair GW, Stringer MS, Thrippleton MJ, Chappell FM, Shuler K, Hamilton I, et al. Imaging neurovascular, endothelial and structural integrity in preparation to treat small vessel diseases. The INVESTIGATE-SVDs study protocol. Part of the SVDs@Target project. Cerebral Circulation—Cognition and Behavior. 2021;2:100020. doi: 10.1016/j.cccb.2021.100020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Liu P, De Vis JB, Lu H. Cerebrovascular reactivity (CVR) MRI with CO2 challenge: A technical review. Neuroimage. 2019;187:104–15. Epub 2018/03/27. doi: 10.1016/j.neuroimage.2018.03.047 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Liu P, Li Y, Pinho M, Park DC, Welch BG, Lu H. Cerebrovascular reactivity mapping without gas challenges. Neuroimage. 2017;146:320–6. doi: 10.1016/j.neuroimage.2016.11.054 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Golestani AM, Wei LL, Chen JJ. Quantitative mapping of cerebrovascular reactivity using resting-state BOLD fMRI: Validation in healthy adults. Neuroimage. 2016;138:147–63. doi: 10.1016/j.neuroimage.2016.05.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Sleight E, Stringer MS, Marshall I, Wardlaw JM, Thrippleton MJ. Cerebrovascular Reactivity Measurement Using Magnetic Resonance Imaging: A Systematic Review. Frontiers in Physiology. 2021;12. doi: 10.3389/fphys.2021.643468 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Mori S, Wu D, Ceritoglu C, Li Y, Kolasny A, Vaillant MA, et al. MRICloud: Delivering High-Throughput MRI Neuroinformatics as Cloud-Based Software as a Service. Computing in Science & Engineering. 2016;18(5):21–35. doi: 10.1109/MCSE.2016.93 [DOI] [Google Scholar]
  • 30.Li Y, Liu P, Li Y, Fan H, Su P, Peng SL, et al. ASL-MRICloud: An online tool for the processing of ASL MRI data. NMR Biomed. 2019;32(2):e4051. Epub 2018/12/28. doi: 10.1002/nbm.4051 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Liutkus A. Scale-Space Peak Picking. Inria Nancy—Grand Est (Villers-lès-Nancy, France), 2015 2015-01-14. Report No.
  • 32.Donahue MJ, Strother MK, Lindsey KP, Hocke LM, Tong Y, Frederick BD. Time delay processing of hypercapnic fMRI allows quantitative parameterization of cerebrovascular reactivity and blood flow delays. Journal of cerebral blood flow and metabolism: official journal of the International Society of Cerebral Blood Flow and Metabolism. 2016;36(10):1767–79. Epub 2015/12/15. doi: 10.1177/0271678X15608643 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Thomas BP, Liu P, Park DC, van Osch MJ, Lu H. Cerebrovascular reactivity in the brain white matter: magnitude, temporal characteristics, and age effects. Journal of cerebral blood flow and metabolism: official journal of the International Society of Cerebral Blood Flow and Metabolism. 2014;34(2):242–7. Epub 2013/11/07. doi: 10.1038/jcbfm.2013.194 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Liu P, Liu G, Pinho MC, Lin Z, Thomas BP, Rundle M, et al. Cerebrovascular Reactivity Mapping Using Resting-State BOLD Functional MRI in Healthy Adults and Patients with Moyamoya Disease. Radiology. 2021;299(2):419–25. doi: 10.1148/radiol.2021203568 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Liu P, Welch BG, Li Y, Gu H, King D, Yang Y, et al. Multiparametric imaging of brain hemodynamics and function using gas-inhalation MRI. Neuroimage. 2017;146:715–23. Epub 2016/10/04. doi: 10.1016/j.neuroimage.2016.09.063 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Li Y, Liu P, Agarwal S, Hou X, Shen S, Pillai J, et al., editors. Integrated vascular (iVas) MRI in brain tumors. Joint Annual Meeting ISMRM-ESMRMB 2018; 2018; Paris, France.
  • 37.Liu P, Jiang D, Albert M, Bauer CE, Caprihan A, Gold BT, et al. Multi-vendor and multisite evaluation of cerebrovascular reactivity mapping using hypercapnia challenge. Neuroimage. 2021;245:118754. Epub 2021/11/27. doi: 10.1016/j.neuroimage.2021.118754 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Lu H, Liu P, Yezhuvath U, Cheng Y, Marshall O, Ge Y. MRI mapping of cerebrovascular reactivity via gas inhalation challenges. J Vis Exp. 2014;(94). doi: 10.3791/52306 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Blockley NP, Driver ID, Francis ST, Fisher JA, Gowland PA. An improved method for acquiring cerebrovascular reactivity maps. Magn Reson Med. 2011;65(5):1278–86. Epub 2011/04/19. doi: 10.1002/mrm.22719 . [DOI] [PubMed] [Google Scholar]
  • 40.Chan RW, Won Bang J, Trivedi V, Murphy MC, Liu P, Wollstein G, et al. Relationships between cerebrovascular reactivity, visual-evoked functional activity, and resting-state functional connectivity in the visual cortex and basal forebrain in glaucoma. Annu Int Conf IEEE Eng Med Biol Soc. 2021;2021:4037–40. Epub 2021/12/12. doi: 10.1109/EMBC46164.2021.9630904 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Xue Y, Chan RW, Wu SY, Tse EL, Faiq MA, Sajitha TA, et al. Characterization of mouse cerebrovascular reactivity using task-free resting-state fMRI. Proceedings of the Joint Annual Meeting ISMRM-ESMRMR 2022 & ISMRT Annual Meeting; London, UK. 2022. p. 2044.
  • 42.Chan RC, Xue Y, Bang JW, Faiq MA, Sajitha TA, Lee RP, et al. Intraocular pressure elevation induces vascular and functional brain changes: A relative cerebrovascular reactivity resting-state fMRI Study. Proceedings of the Joint Annual Meeting ISMRM-ESMRMR 2022 & ISMRT Annual Meeting; London, UK. 2022. p. 4584.
  • 43.Jack CR Jr., Bernstein MA, Fox NC, Thompson P, Alexander G, Harvey D, et al. The Alzheimer’s Disease Neuroimaging Initiative (ADNI): MRI methods. J Magn Reson Imaging. 2008;27(4):685–91. Epub 2008/02/28. doi: 10.1002/jmri.21049 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Casey BJ, Cannonier T, Conley MI, Cohen AO, Barch DM, Heitzeg MM, et al. The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites. Dev Cogn Neurosci. 2018;32:43–54. Epub 2018/03/24. doi: 10.1016/j.dcn.2018.03.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Smith SM, Beckmann CF, Andersson J, Auerbach EJ, Bijsterbosch J, Douaud G, et al. Resting-state fMRI in the Human Connectome Project. Neuroimage. 2013;80:144–68. Epub 2013/05/25. doi: 10.1016/j.neuroimage.2013.05.039 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Miller KL, Alfaro-Almagro F, Bangerter NK, Thomas DL, Yacoub E, Xu J, et al. Multimodal population brain imaging in the UK Biobank prospective epidemiological study. Nat Neurosci. 2016;19(11):1523–36. Epub 2016/10/28. doi: 10.1038/nn.4393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Yang JT, Erickson SL, Killien EY, Mills B, Lele AV, Vavilala MS. Agreement Between Arterial Carbon Dioxide Levels With End-Tidal Carbon Dioxide Levels and Associated Factors in Children Hospitalized With Traumatic Brain Injury. JAMA Netw Open. 2019;2(8):e199448. Epub 2019/08/17. doi: 10.1001/jamanetworkopen.2019.9448 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Takano Y, Sakamoto O, Kiyofuji C, Ito K. A comparison of the end-tidal CO2 measured by portable capnometer and the arterial PCO2 in spontaneously breathing patients. Respir Med. 2003;97(5):476–81. Epub 2003/05/09. doi: 10.1053/rmed.2002.1468 . [DOI] [PubMed] [Google Scholar]
  • 49.Kartchner L, Chang L, Ernst T, Liang H, Shang Y, Liu P. Abnormal cerebrovascular reactivity in human immunodeficiency virus-infected patients with or without smoking: a resting-state fMRI study. Proceedings of the 2021 ISMRM & SMRT Annual Meeting & Exhibition2021. p. 157.
  • 50.Bhogal A. abhogal-lab/seeVR: v1.01. In: Zenodo, editor. v1.01 ed. 10.5281/zenodo.52835952021. [DOI]

Decision Letter 0

Yen-Yu Ian Shih

21 Jun 2022

PONE-D-22-11894CVR-MRICloud: an online processing tool for CO2-inhalation and resting-state cerebrovascular reactivity (CVR) MRI dataPLOS ONE

Dear Dr. Liu,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 05 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Yen-Yu Ian Shih, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, all author-generated code must be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse.

3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. 

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Dear Peiying,

My apology for the delay in making a decision. As you can see, both reviewers are enthusiastic about this work and suggest the manuscript to be suitable for publication pending a minor revision. Please feel free to let me know if there’s anything I can help clarify further.

Best,

Ian

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: In this manuscript Liu et al report their development and publication of a cloud-based tool for processing of CVR MRI data. The authors outline their rationale of expanding availability of CVR processing, both for a hypercapnic based and resting-state MRI paradigms, the implemented methodology and provide some validation in a healthy lifespan cohort of 203 datasets, three patient datasets and a healthy young subject. Liu et al report example outputs from the processing, results of the alignment and quantitative metrics amongst others. I am grateful to the editor and authors for the opportunity to comment on this interesting and useful work.

Major

I agree with the authors that there is considerable scope for broadening availability of CVR for clinical studies. However, there may be a risk of such a resource becoming a ‘black box’ for some prospective users, potentially leading to false inferences, and/or missing key details e.g. the reported ‘CO2 Switching’ phenomena. Further the authors make no mention of any evaluations of the software/user friendliness of the software by individuals with no experience of CVR which from the introduction appear to be the target audience.

The authors describe the benefits of cloud computing, which are significant, but not the challenges. Notably patient confidentiality, data protection and secure transfer/deletion are key. I believe that these should be considered in the Discussion, further detail on the technical setup and upload/download procedures of the server may also be appropriate for the Methods e.g. are uploads deleted after a set time? Do they only exist as long as a console is open?, How are results downloaded?, Who has access to/how secure is uploaded data? etc?

The authors present the toolbox as a way of measuring CO2- and RS-CVR – however no comparison between the two is given despite data being available in the same population. As a validation of the toolbox this would seem a useful validation i.e. to show that both approaches show similar associations, and I would encourage the authors to add such an analysis, along with more detailed discussion of the results in the Discussion.

Minor

The data availability statement is contradicted by the description of where data is to be found which indicates data will only be released case-by-case upon request after funding agency approval. Clearly there can be valid funding or ethics/consent restrictions which may limit how much data can be shared. However, if there is an exceptional reason it is not currently presented which should be corrected before publication.

Line 56 – The authors reference the Mild Stroke Study 3 (Clancy et al), however as a single centre study it does not seem to fit with their phrasing. The authors perhaps meant to refer to Investigate-SVDs 10.1016/j.cccb.2021.100020 which was multi-site and led by the same group?

Lines 68-69 – The authors draw an analogy between task/resting state fMRI and CO2-CVR/RS-CVR, however no citation is provided, I would suggest the authors either remove this sentence or add relevant references.

Lines 70-71 – The authors state most CVR studies have used in-house processing methods but do not supply a relevant reference, one such example would be 10.3389/fphys.2021.643468. The authors may also want to note that despite many CVR studies depending on in-house code few authors have published their code, creating challenges for reproducible and repeatable research.

Line 138 and 147 – What was the reason for choosing a window size of 10? And combining the results based on the higher of Algorithm I and II?

Line 169 – Delays of 0 to EtCO2 time course duration are allowed, and in line 175 a narrower search range of +/- 5 s is used. Are the authors confident this can handle the full range as pathology? Longer/altered delays have been reported in patient e.g. WMH in SVD patients etc.

Line 227 –Given the temporal filtering frequency in ref. 33 seem to come from healthy patients or moyamoya how transferable is the range used e.g. for stroke or MS?

Line 288-9 – Commenting on consistency of values with previous work may be better suited to the discussion than results.

Line 302-3 – Comments on reliability and reproducibility seem to be based on a single healthy subject, evaluations in other groups with larger sample size would be useful to determine how consistent this pattern is.

Line 337-9 – If no published data is available then it may be valuable to other groups to include some in the supplementary information to support this point.

Lines 207-211, Line 363 – Add reference. In general there were several areas with unsupported statements which may benefit from further additions, not least as it makes it more accessible for a wider readership.

Line 367 – internal reference models have significant limitations cf SUV models for PET, the drawbacks should be considered in my opinion. As although superficially the maps may look similar the lack of directly comparable values is a significant impediment.

Line 383 – Is there any error protection against the CO2 switching phenomena i.e. does MRICloud label it/throw an error?

Figure 9 – It would be useful to have the spread of the CVR as points instead of only the mean and CI.

Reviewer #2: In this work, the authors developed and describe a cloud-based cerebrovascular reactivity (CVR) processing pipeline. The authors comprehensively describe all of the processing steps, including extraction of end-tidal CO2 curves and its alignment with BOLD data, the calculation of a variety of CVR metrics from CO2-challenge and resting-state CVR data and a quality control metric. The authors also evaluate the performance of the processing pipeline from a population comprising a variety of ages, appropriate distribution of sex and MRI data from a wide range of imaging parameters. The manuscript is very clearly written and the work is valuable as it has the potential to broaden the uptake of the CVR technique by removing the data processing skill entry barrier, facilitates reproducible research and meticulously describes the logic behind each choice of processing step. Some minor questions and comments are listed below:

1) As the BOLD signal comprises a mixture of a variety of different hemodynamic and metabolic parameters, could the choice of MR imaging parameters affect the alignment of BOLD data to EtCO2, or the quality of CO2 and resting-state CVR maps (e.g. short TR, high flip angle increasing the sensitivity to in-flow effect)?

2) Could the authors clarify whether patient health information is automatically removed from image metadata upon upload to the cloud server or if the user is responsible for removing patient health information?

3) Could the authors describe what MRI image file formats are compatible with CVR-MRICloud?

4) If available, could the authors include a citation to the Smooth-Cross algorithm used for peak detection (algorithm 2, page 7, line 137) for the interested reader?

5) On page 18, line 370 the authors state that the CVR-MRICloud lacks the flexibility of allowing user inputs. Could the authors clarify whether this extends to the ability of the user to upload brain masks and the ability to modify the FWHM of the spatial-smoothing Gaussian kernel?

6) Do the authors plan to update the software, such as addition or modification of processing steps, as the CVR-mapping technique further develops? If so, will older versions still be available to users to ensure continuity of in-progress studies?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Sep 28;17(9):e0274220. doi: 10.1371/journal.pone.0274220.r002

Author response to Decision Letter 0


28 Jul 2022

Response to Reviewer 1:

1. “I agree with the authors that there is considerable scope for broadening availability of CVR for clinical studies. However, there may be a risk of such a resource becoming a ‘black box’ for some prospective users, potentially leading to false inferences, and/or missing key details e.g. the reported ‘CO2 Switching’ phenomena. Further the authors make no mention of any evaluations of the software/user friendliness of the software by individuals with no experience of CVR which from the introduction appear to be the target audience.”

Thank you for this point. In this report, we have provided all details related to the CVR-MRICloud pipeline. The purpose of this report is exactly to de-mystify this tool and to make it not a “black box”. To the best of our knowledge, we have explained all known factors that could lead to false inferences.

Regarding the use of the software by individuals with no experience of CVR, we would like to clarify that a substantial number of novice users have actually used our tool with no problems. We have added the following paragraph in the Discussion regarding the user-friendliness of the CVR-MRICloud:

“Minimal experience is required in order to use this tool. An inter-rater evaluation performed by 4 raters with no previous CVR experience revealed that the ICC of CVR values was >0.9959, suggesting that CVR-MRICloud is user-friendly and the results are not user-dependent [37]. The RS-CVR pipeline has also been utilized by researchers with no previous experience with CVR and yielded multiple publications [39-41].”

2. “The authors describe the benefits of cloud computing, which are significant, but not the challenges. Notably patient confidentiality, data protection and secure transfer/deletion are key. I believe that these should be considered in the Discussion, further detail on the technical setup and upload/download procedures of the server may also be appropriate for the Methods e.g. are uploads deleted after a set time? Do they only exist as long as a console is open?, How are results downloaded?, Who has access to/how secure is uploaded data? etc?”

Thank you. Indeed, patient confidentiality and data protection are important issues associated with human data processing over cloud. These issues have been addressed in the original report of the MRICloud platform (Mori et al, Computing in Science & Engineering. 2016;18(5):21-35). Note that the CVR-MRICloud is a new addition to the MRICloud toolbox and uses the same front-end framework as the other MRICloud tools in terms of data uploading/downloading. Briefly, the uploaded image file format is ANALYZE (.hdr and .img). This file format does not contain protected health information (PHI), thus it is compatible with Health Insurance Portability and Accountability Act (HIPAA) regulations. We have added this information in the revised manuscript:

“The required image file format is ANALYZE (.hdr and .img) which does not contain protected health information (PHI) and thus, is compatible with Health Insurance Portability and Accountability Act (HIPAA) regulations.”

Each submission of data to the server will create a job. The users can only access the results of the jobs their submitted. After downloading users can select to delete the data/result from the server. If the user do not delete the data/results, the data/result of the jobs will be automatically deleted from the server after 60 days. We have added the following sentences in the revised manuscript:

“The users can only access the outcome parameters from the data they had uploaded. The data and outcome parameters will be automatically deleted after 60 days from the upload if the users choose not to delete them manually.”

We have also added the following paragraph in Discussion:

“Patient confidentiality, data protection, and security of data transfer are typical challenges associated with cloud-computing of medical imaging analysis. These issues have been extensively discussed in the original report of the MRICloud platform [29]. Briefly, the uploaded imaging data are in ANALYZE format, which includes a raw image matrix and a header file that contains only the matrix dimension information. To ensure the security of the processing pipeline, SSH is used as the core in data transfer and signaling commands on the computational server.”

3. “The data availability statement is contradicted by the description of where data is to be found which indicates data will only be released case-by-case upon request after funding agency approval. Clearly there can be valid funding or ethics/consent restrictions which may limit how much data can be shared. However, if there is an exceptional reason it is not currently presented which should be corrected before publication.”

We have uploaded the anonymized data set necessary to replicate our study findings to a public repository. If this manuscript is accepted, the data will be available for downloading at https://doi.org/10.5061/dryad.wh70rxwqw.

4. “Line 56 – The authors reference the Mild Stroke Study 3 (Clancy et al), however as a single centre study it does not seem to fit with their phrasing. The authors perhaps meant to refer to Investigate-SVDs 10.1016/j.cccb.2021.100020 which was multi-site and led by the same group?”

We thank the reviewer for pointing this out. We have updated this sentence and reference accordingly:

“CVR as a candidate biomarker of vascular diseases has also been applied in multi-center settings, such as in the MarkVCID study [23] and the INVESTIGATE-SVDs study [24].”

5. “Lines 68-69 – The authors draw an analogy between task/resting state fMRI and CO2-CVR/RS-CVR, however no citation is provided, I would suggest the authors either remove this sentence or add relevant references.”

Per the reviewer’s suggestion, we have removed this analogy.

6. “Lines 70-71 – The authors state most CVR studies have used in-house processing methods but do not supply a relevant reference, one such example would be 10.3389/fphys.2021.643468. The authors may also want to note that despite many CVR studies depending on in-house code few authors have published their code, creating challenges for reproducible and repeatable research.”

We thank the reviewer for this point. We have added the reference and revised this sentence as below:

“CVR data processing is considered a niche skill and most studies of CVR have used in-house scripts or software [28], creating challenges for reproducible and repeatable research and for researchers and clinicians with less skills in software programming.”

7. “Line 138 and 147 – What was the reason for choosing a window size of 10? And combining the results based on the higher of Algorithm I and II?”

If the smoothing window is too small, it may not separate fluctuations during the breathing out period from separate breaths, whereas if the smoothing window is too large, it cannot detect the breathing peaks effectively during the transition periods between room air and CO2 inhalation. A window size of 10s (i.e., 2-3 breathing cycles in majority of subjects) is a good balance between the two issues. The final EtCO2 curve is obtained by selecting the higher value from Algorithms I and II at each point in the interpolated time series. As shown in Figure 6, the wrong values identified in each algorithm are always lower than the real values, because EtCO2 indicates the upper envelope of the CO2 trace. We have added the following sentences in the revised manuscript:

“The window size of 10s was chosen as a trade-off between the degree of smoothing and the sensitivity during the room air-CO2 transition periods.”

“Finally, the higher value from Algorithms I and II at each point in the interpolated time series was selected to form the EtCO2 curve (Fig. 3B), as the EtCO2 curve represent the top envelope of the CO2 trace.”

8. “Line 169 – Delays of 0 to EtCO2 time course duration are allowed, and in line 175 a narrower search range of +/- 5 s is used. Are the authors confident this can handle the full range as pathology? Longer/altered delays have been reported in patient e.g. WMH in SVD patients etc.”

We clarify that the EtCO2 delay was found in two steps. In the first step, we search through a broad range covering all possible shift values (0 to entire EtCO2 time course duration) with a courser step size of 1 second (see Figure 4a for example), and this can identify any physiological and pathological delay roughly. In the second step, based on the delay determined from the step 1, we search a narrow window (+/-5s) around the Step1-determined delay a with a finer step size of 100ms to achieve higher precision of the delay obtained (see Figure 4b for example). Therefore, we can effectively find the longer delays in pathological conditions. We have added the following sentence in the revised manuscript:

“This two-step procedure is expected to yield more reliable optimal shift value than using the first step alone.”

9. “Line 227 –Given the temporal filtering frequency in ref. 33 seem to come from healthy patients or moyamoya how transferable is the range used e.g. for stroke or MS?”

The temporal filtering frequency was determined from healthy subjects across the life span to be more generalized. In Ref.34 (i.e., Ref. 33 in the original submission) we have validated in a clinical cohort of Moyamoya patients. Moyamoya disease is a large artery stenosis in which the CVR abnormality varies in a large range. Therefore, we think the temporal filtering frequency determined in Ref. 34 can be transferable to most clinical applications. Our example image shown in Figure 12 demonstrated the application in stroke.

10. “Line 288-9 – Commenting on consistency of values with previous work may be better suited to the discussion than results.”

Per reviewer’s suggestion, we have moved this sentence to the Discussion section.

11. “Line 302-3 – Comments on reliability and reproducibility seem to be based on a single healthy subject, evaluations in other groups with larger sample size would be useful to determine how consistent this pattern is.”

The reliability and reproducibility of the resting-state CVR mapping technique has been reported with larger sample size in our previous studies (Refs 26 and 34). In this work, we are focusing on the processing tool, and therefore, we think an example of 7 repeated scans from the same subject is enough to demonstrate the reliability and reproducibility of our rs-CVR pipeline in CVR-MRICloud.

12. “Line 337-9 – If no published data is available then it may be valuable to other groups to include some in the supplementary information to support this point.”

Per reviewer’s suggestion, we have added the Supplemental Figure S1 to show the examples of subjects in whom the EtCO2 and motion vector (in foot-head direction) showed significant reverse-correlation:

“Supplemental Figure S1: EtCO2 curves and motion curves from two healthy subjects with high R2 values. The motion curve was in foot-head (FH) direction obtained using spm_realign.m function.”

13. “Lines 207-211, Line 363 – Add reference. In general there were several areas with unsupported statements which may benefit from further additions, not least as it makes it more accessible for a wider readership.”

We have added references accordingly.

14. “Line 367 – internal reference models have significant limitations of SUV models for PET, the drawbacks should be considered in my opinion. As although superficially the maps may look similar the lack of directly comparable values is a significant impediment.”

We agree. We have added the following sentences to discuss this issue and proposed potential solutions:

“If absolute CVR value is desired in the resting-state method, one can record EtCO2 during the data acquisition. This can mitigate potential issues related to the use of internal reference model.”

15. “Line 383 – Is there any error protection against the CO2 switching phenomena i.e. does MRICloud label it/throw an error?”

There is no known algorithm to detect the CO2 switching phenomena automatically. Therefore, we have reported this limitation and specified that the users should examine their CO2 recording and identify the cases where CO2 switching phenomena (as shown in Figure 13) is presented. We also noted that this CO2 switching phenomena is a rare situation. It happens only occasionally in subjects with baseline EtCO2 lower than 25 mmHg, whereas in majority of the subjects the baseline EtCO2 is between 35-45 mmHg. We have added the following sentences in the revised manuscript:

“We found that “CO2 Switching” is rare and only occurs when the subject has an unusually low baseline EtCO2 level (e.g. <25 mmHg). There is no known algorithm to detect the “CO2 switching” automatically. Therefore, users are encouraged to examine the CO2 traces for potential “CO2 switching” when unusually low baseline EtCO2 level is observed.”

16. “Figure 9 – It would be useful to have the spread of the CVR as points instead of only the mean and CI.”

We agree. We have added to the plot the subject-level CVR values to Figure 9.

Response to Reviewer 2:

1. “As the BOLD signal comprises a mixture of a variety of different hemodynamic and metabolic parameters, could the choice of MR imaging parameters affect the alignment of BOLD data to EtCO2, or the quality of CO2 and resting-state CVR maps (e.g. short TR, high flip angle increasing the sensitivity to in-flow effect)?”

Indeed, the underpinning of the CVR obtained may be dependent on the BOLD parameter used. For example, it could vary between oxygenation-weighted and flow-weighted, as the reviewer alluded to. In terms of their impact on the alignment, we feel that it will not be major. This is because the signal change due to CO2 response is a relatively slow response compared to brain activation induced BOLD signal change (where the neural activation takes less than 50 ms to occur). Thus, within the measurement error, the oxygenation-weighted and flow-weighted signal will have a very similar signal time-course.

The optimal imaging parameter should be chosen to balance between SNR and purity of signal contrast, although this topic is beyond the scope of this paper.

2. “Could the authors clarify whether patient health information is automatically removed from image metadata upon upload to the cloud server or if the user is responsible for removing patient health information?”

We have clarified in the revised manuscript that, the required image file format of MRICloud is ANALYZE (.hdr and .img). This is because this file format does not contain protected health information (PHI), thus it is compatible with Health Insurance Portability and Accountability Act (HIPAA) regulations. We provide a DICOM to Analyze conversion tool on the MRICloud website which the users and download and use on their own computer. The users can also use their own software to generate the ANALYZE images of their data. We have added this information in the revised manuscript (please also see our response to R1.2):

“The required image file format is ANALYZE (.hdr and .img) which does not contain protected health information (PHI) and thus, is compatible with Health Insurance Portability and Accountability Act (HIPAA) regulations.”

3. “Could the authors describe what MRI image file formats are compatible with CVR-MRICloud?”

The required file format is ANALYZE. Please see our response to R1.2 and R2.2.

4. “If available, could the authors include a citation to the Smooth-Cross algorithm used for peak detection (algorithm 2, page 7, line 137) for the interested reader?”

The smooth-cross algorithm was developed by us during the course of this project. Thus there is no prior reference.

5. “On page 18, line 370 the authors state that the CVR-MRICloud lacks the flexibility of allowing user inputs. Could the authors clarify whether this extends to the ability of the user to upload brain masks and the ability to modify the FWHM of the spatial-smoothing Gaussian kernel?”

Thank you for this point. The “lack of flexibility” we mentioned was referring to the notion that the cloud tool is not ideal for “interactive” processing. For the pre-selected options such as uploading a brain mask or choosing FWHM, it is actually feasible. However, in the current implementation, we have not included these options. This is because we were trying to limit the number of user inputs to obtain a trade-off between tool flexibility and simplicity to users, especially novice users. We were concerned that, if the user types in a wrong input value by mistake, it will cause issues in the processing of the datasets. But we agree with the reviewer that allowing the user to upload brain masks and modify the smoothing kernel could be beneficial. So in the future we will update our implementation (as a separate version of the tool) to allow the user to upload user-defined brain masks and specify the data space from which the masks are defined, as well as select different FWHM of the smoothing kernel. We have added the following sentences in the revised manuscript:

“Future version of the CVR-MRICloud will allow the uploading of user-defined ROIs and user-selection of the FWHM Gaussian kernel for spatial smoothing.”

6. “Do the authors plan to update the software, such as addition or modification of processing steps, as the CVR-mapping technique further develops? If so, will older versions still be available to users to ensure continuity of in-progress studies?”

We thank the reviewer for pointing this out. We are updating the software with modifications and technical development. We are doing this in a version-controlled manner. We have added the following paragraph in the revised manuscript to clarify this:

“The deployment of CVR-MRICloud is conducted in a version‐controlled manner. When a new version is released, it will have a specific version number and all older versions are still available on the CVR‐MRICloud website.”

Attachment

Submitted filename: ResponseToReview_072822.docx

Decision Letter 1

Yen-Yu Ian Shih

24 Aug 2022

CVR-MRICloud: an online processing tool for CO2-inhalation and resting-state cerebrovascular reactivity (CVR) MRI data

PONE-D-22-11894R1

Dear Peiying,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Yen-Yu Ian Shih, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewer 1 left a note. Please kindly take a look. 

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I am grateful to the authors for their response which has addressed all the main substantive points.

The one caveat I would raise is in relation to point 2. While the authors have clearly considered the issues for their own legislative domain other regions have different standards, I think in particular of the General Data Protection Regulations (GPDR) standards which apply in most European countries. While previously data transfer to the USA was possible under the Privacy Shield this is unfortunately no longer the case: https://gdpr-info.eu/issues/third-countries. My (limited) understanding is at a minimum transfer of even anonymised data to a web server in the USA for processing would ideally be included in the participant consent form and ethics, and many institutions would have their own processes to approve transfer, which may include considering who else could hypothetically access the data e.g. server admins, law enforcement etc and on what basis.

Clearly any detailed discussion of these points is beyond the scope of this paper, and it would be impossible to account for local rules in all jurisdictions. However, the authors may wish to note somewhere that researchers should consider whether they need to include cloud processing in the USA in their consent process and ensure compliance with local data protection regulations before uploading data.

I congratulate the authors again on a valuable piece of work which I am sure will be extremely useful to the community going forward.

Reviewer #2: All questions and comments from the original review have been answered very well. Happy to recommend the manuscript for publication in its current form.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Acceptance letter

Yen-Yu Ian Shih

19 Sep 2022

PONE-D-22-11894R1

CVR-MRICloud: an online processing tool for CO2-inhalation and resting-state cerebrovascular reactivity (CVR) MRI data

Dear Dr. Liu:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Yen-Yu Ian Shih

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. EtCO2 curves and motion curves from two healthy subjects with high R2 values.

    The motion curve was in foot-head (FH) direction obtained using spm_realign.m function.

    (DOCX)

    Attachment

    Submitted filename: ResponseToReview_072822.docx

    Data Availability Statement

    The anonymized data sets necessary to replicate our study findings are shared on Dryad. The data sets can be downloaded at: https://doi.org/10.5061/dryad.wh70rxwqw.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES