Abstract
The data from patients with severe brain injuries show complex brain functions. Due to the difficulties associated with these complex data, computational modeling is an especially useful tool to examine the structure–function relationship in these populations. By using computational modeling for patients with a disorder of consciousness (DoC), not only we can understand the changes of information transfer, but we also can test changes to different states of consciousness by hypothetically changing the anatomical structure. The generalized Ising model (GIM), which specializes in using structural connectivity to simulate functional connectivity, has been proven to effectively capture the relationship between anatomical structures and the spontaneous fluctuations of healthy controls (HCs). In the present study we implemented the GIM in 25 HCs as well as in 13 DoC patients diagnosed at three different states of consciousness. Simulated data were analyzed and the criticality and dimensionality were calculated for both groups; together, those values capture the level of information transfer in the brain. Ratifying previous studies, criticality was observed in simulations of HCs. We were also able to observe criticality for DoC patients, concluding that the GIM is generalizable for DoC patients. Furthermore, dimensionality increased for the DoC group as compared to healthy controls, and could distinguish different diagnostic groups of DoC patients.
Keywords: disorder of consciousness, generalized Ising model, dimensionality of the brain, structural connectome, functional connectivity
1. Introduction
Advances in life-saving medical technology have dramatically increased survival rates for comatose patients after severe brain injury. However, many of these patients will be diagnosed with a prolonged disorder of consciousness (pDoC) [1,2], a state in which they show disruption to their awareness of themselves and/or their environment. The pDoCs fall into three sub-categories: (1) the vegetative state/unresponsive wakefulness syndrome (VS/UWS), in which a patient is wakeful (i.e., the patient may open their eyes) but unaware (i.e., the patient may perform reflexive, non-intentional behaviours, but shows no evidence of brain activity associated with cognitive function); (2) the minimally conscious state minus (MCS−), in which patients show reproducible minimal evidence of awareness, such as visual pursuit or fixation, orientation to noxious stimuli, and vocalizations or contingent motor and affective responses, although their presence is inconsistent; and (3) the MCS plus (MCS+), in which patients show more complex volitional responses (such as command following, intelligible verbalization, or gestural or verbal yes or no responses) [3,4]. Additionally, the patient is classified as emergence from minimally conscious state (EMCS) when he/she is able to communicate or show proper functional object use [4]. In each of these conditions, the clinical assessment of awareness through behavioural tools can be extremely challenging and sometimes inconsistent between assessments, even when a standardized scale such as the Coma Recovery Scale [5] is administered [6]. Even though there are standardized tests to evaluate the state of the patients, the misdiagnosis rates using these scales are relatively high, which leaves room for the development of advanced and robust measures for assessing the state of consciousness of patients [7,8]. One emerging theory, the integrated information theory (IIT), is used to calculate a measure of complexity (consciousness) of a system (brain) and also provides promising results for the development of tools to assess the consciousness of non-responsive patients [9,10,11]. Moreover, determining whether a patient’s condition will improve remains largely subjective because of the lack of reliable prognostic indices [12,13,14]. Additionally, determining the clinical evolution of individuals with DoC has not yet been established, as 40% of them do not survive past the first two weeks due to withdrawal of life support [15,16,17]. In those patients that remain on life support, approximately half go on to recover some degree of awareness [15].
One source of prognostic information may arise from the link between structure and function in the brain. In healthy individuals, brain structure is similar. Although individual differences exist, the various segments of white matter that connect near and distant areas of the brain can easily be identified. This network of white matter is the brain’s structural connectivity. In turn, the function of the brain depends on these connections, which are responsible for transmitting information between regions of the cortex. The interaction of different brain areas can also be studied by way of their functional connectivity: How much do the activity in two areas of the brain correlate or anti-correlate. Several functional brain networks have been identified, such as the default mode network (DMN), which describes the brain at rest, and the executive control network (ECN), which describes the brain during tasks requiring executive function. The functional connectivity can be altered in several pathologies, such as Alzheimer’s disease [18], Parkinson’s disease [19], and depression [20].
Although functional connectivity can be used to identify pathologies in individuals with largely regular brain anatomy [20,21], its usefulness is complicated in the case of patients with severe brain injury. In such patients, brain structure has often been greatly altered, and no longer resembles a normal template. Brain regions also no longer interact normally, and it is difficult to determine what sort of internal cognition is arising from the observed functional connectivity. For these reasons, comparison of functional connectivity to healthy individuals may not be productive, and conclusions about a patient’s awareness, cognitive function, and prognosis are difficult to draw.
Because of the difficulties associated with data from patients with severe brain injury, computational modeling is an especially useful tool when examining the structure–function relationship in these populations. Such models aim to describe information flow amongst the regions of a complex system and can simulate both healthy and injured neural systems [22]. Using computational models, we can test the predictions of different theories of information transfer in the brain and make causal inferences about empirically observed behaviour. Specifically, in patients with a disorder of consciousness (DoC), such simulations can aid in determining what sort of residual cognition remains based on how information is flowing between different regions and how it has been disrupted. It could also lead to the development of treatment schemes to improve the patients’ brain function.
Previous work has shown that the generalized Ising model (GIM) can effectively capture the connection between anatomical structures and spontaneous fluctuations of the brain, as captured by functional magnetic resonance imaging (fMRI) [22,23,24,25]. The GIM, based on the classical Ising model originally used to describe ferromagnetic behaviour, simulates the blood-oxygenation-level-dependent (BOLD) signal measured using fMRI. Each region of the brain is modeled by a spin site within a lattice, with connections between lattice sites weighted according to the empirical structural connectivity between brain regions. Empirical BOLD signals greater than a certain threshold can be represented by up spins, and below the threshold can be represented by down spins. Using this model, information flow throughout the brain has been successfully simulated in a healthy system [22]. To date, the GIM has only been used to model healthy brains. The present study aimed to implement this model in both healthy controls as well as a sample of brain-injured patients with DoC. To do this, we first generated the empirical correlation matrix of the BOLD time series in 84 brain regions. We then used the GIM to generate time series using each subject’s structural connectivity and ran simulations to determine the temperature that led to the highest correlation between the simulated and empirical data.
Finally, we also sought to compare the model parameters between controls and patients with DoC. Recent work has shown that the generalized Ising model at criticality can predict spontaneous brain activity, or functional connectivity, in healthy individuals. In this study, we attempted to determine whether the GIM at criticality can be extended to predict functional connectivity of the brain in patients with DoC, who often have widespread structural brain damage.
Recently, using the structural connectome, the healthy brain was found to be two-dimensional [22]. To define the dimensionality of the brain using the structural connectome and the rate of information transfer, we introduced a space where the distance between two regions of the brain is measured by the strength of the connectome rather than the physically measurable distance. Choice of this definition agrees with the level of information transfer in the brain based on the structural connectome. By introducing the new measure of the distance, we calculated the decay of information transfer with respect to the newly defined distance (the number of fibres between each pair of regions in the brain). Dimensionality represents the rate of decay in information transfer with respect to the distance, in that a higher dimensionality implies a faster rate of decay. Dimensionality is one parameter of the GIM. Its calculation depends on the distance between two regions, measured here by the number of fibres connecting those regions. We then determined the functional correlation between all the regions at the same distance and plotted the results in order to calculate the dimensionality. In healthy participants, the brain was highly correlated, showing strong relationships between many regions [22]. The dimensionality of the brain in patients with DoC, however, has not yet been determined.
Thus, a further goal of this study was to determine if this parameter remains the same in patients with DoC. Additionally, if dimensionality is different in these patients, does it change between clinical categories of DoC or does it remain constant within DoC as a whole? That is, can we distinguish between different levels of consciousness using dimensionality? Based on research in healthy participants and the assertion that brain activity relies on structure and the connections between different areas, we hypothesized that functional connectivity will be tied to brain structure in patients with DoC to the same degree. However, we predicted that dimensionality will increase in patients relative to controls, due to damaged structural connectivity. Specifically, we predicted that a higher distance between regions (i.e., a lower number of fibers connecting them) will lead to a faster decay in functional correlation, potentially functioning as a diagnostic factor in these patients.
2. Experimental Section
2.1. Materials
2.1.1. Participants
We screened a series of individuals with prolonged (i.e., time post injury greater than 28 days) DoC from January 2016 to July 2018 admitted to a dedicated Neurorehabilitation Unit of ICS Maugeri, Telese Terme, Italy. For this study, we enrolled patients fulfilling standardized clinical criteria for VS/UWS or MCS [2]. Patients with the latter diagnosis were further classified as being in MCS+ or MCS− according to recent criteria [3]. We excluded from the study patients with: (i) severe pathologies independent from the brain injury (e.g., premorbid history of psychiatric or neurodegenerative diseases); (ii) mixed etiology (e.g., both traumatic and anoxic brain injury); (iii) non-stabilized and severe general clinical conditions; (iv) contra-indication for magnetic resonance imaging (MRI) (e.g., ferromagnetic aneurysm clips, pacemaker); (v) large brain damage (>50% of total brain volume), as stated by a certified neuroradiologist on computed tomography (CT) or MRI scan performed before the positron emission tomography (PET)/fMRI acquisition (patients with macroscopic traumatic brain damage, such as to distort normal anatomy, were excluded after a careful radiological evaluation); and (vi) motion parameters >3 mm in translation and 3 mm in rotation. Patients were also excluded if their clinical diagnosis had changed in the week preceding the neuroimaging acquisition.
From a sample of 29 severely brain-injured patients with DoC (Figure S1), we considered for PET/fMRI analysis a set of thirteen patients with pDoC (VS/UWS = 6; MCS− = 3; MCS+ = 4) due to severe traumatic (n = 3), vascular (n = 5), or anoxic (n = 5) brain injury, aged between 18 and 73. Detailed descriptions of patients’ clinical features are provided in Table 1.
Table 1.
Pt | Age at Onset |
Sex | Aetiology | Time Post-Onset (Months) |
Clinical Diagnosis | CRS-R Total Score (Subscales) |
Conscious Behaviour |
---|---|---|---|---|---|---|---|
1 | 34 | F | Anoxic | 8 | VS/UWS | 7 (2 + 1 + 0 + 2 + 0 + 2) | NA |
2 | 58 | F | Vascular | 10 | MCS+ | 11 (3 + 1 + 4 + 1 + 0 + 2) | Reproducible command following; object manipulation |
3 | 57 | M | Anoxic | 6 | MCS+ | 12 (3 + 1 + 5 + 1 + 0 + 2) | Reproducible command following; automatic motor response |
4 | 18 | M | Traumatic | 3 | MCS+ | 11 (3 + 3 + 2 + 1 + 0 + 2) | Reproducible command following; visual pursuit |
5 | 53 | M | Anoxic | 7 | VS/UWS | 6 (1 + 0 + 2 + 1 + 0 + 2) | NA |
6 | 70 | M | Vascular | 3 | VS/UWS | 7 (1 + 1 + 2 + 1 + 0 + 2) | NA |
7 | 44 | F | Vascular | 10 | MCS− | 7 (1 + 3 + 0 + 1 + 0 + 2) | Visual pursuit |
8 | 38 | M | Anoxic | 6 | VS/UWS | 4 (2 + 0 + 1 + 0 + 0 + 1) | NA |
9 | 73 | F | Vascular | 5 | VS/UWS | 6 (1 + 1 + 1 + 1 + 0 + 2) | NA |
10 | 48 | M | Traumatic | 3 | MCS− | 10 (2 + 3 + 2 + 1 + 0 + 2) | Visual pursuit |
11 | 37 | M | Vascular | 3 | MCS+ | 21 (4 + 5 + 5 + 3 + 1 + 3) | Consistent command following; object recognition; automatic motor response; intelligible vocalization |
12 | 24 | M | Anoxic | 2 | MCS− | 8 (1 + 2 + 2 + 1 + 0 + 2) | Visual fixation |
13 | 35 | M | Traumatic | 4 | VS/UWS | 7 (1 + 1 + 2 + 1 + 0 + 2) | NA |
Note: F = female; M = male; CRS-R = coma recovery scale-revised; VS/UWS = vegetative state/unresponsive wakefulness syndrome; MCS− = minimally conscious state minus; MCS+ = minimally conscious state plus. NA = not applicable. The conscious behaviours assessed by the coma recovery scale subscales are marked in bold and described in the additional column.
2.1.2. Controls
We also examined a group of twenty-five healthy participants, aged between 20 and 64 (13 female). Controls’ PET/MRI studies were carried out at St. Joseph’s hospital London, Ontario, using the same protocol and a similar PET/MRI instrumentation to the DoC patients’ scans.
2.1.3. Ethics Statement
The study was approved by the local Ethics Committee of IRCCS Pascale (Protocol number: 3/15; 20/05/2015) and performed according to the ethical standards laid down in the 1964 Helsinki Declaration and its later amendments. Written informed consent was obtained from the legal guardian of patients in the ICS Maugeri Neurorehabilitation Unit. The study involving healthy controls was approved by the health science research ethics board of Western University and written informed consent was obtained from the participants before completing the study.
2.1.4. Clinical Assessment of DoC Patients
One week before and one week after neuroimaging recording, all enrolled patients underwent at least five clinical evaluations, using the Italian version of the coma recovery scale-revised (CRS-R) [26], in order to confirm a stabilized clinical diagnosis of VS/UWS, MCS−, or MCS+ and to gather the best CRS-R total score. Patients’ consciousness level (measured by CRS-R total and sub-scores) was also assessed on the neuroimaging day. All behavioral assessments were performed by one skilled psychologist (OM).
2.1.5. MRI Data Acquisition
MR images were acquired using high resolution 3T PET/MRI scans at St. Joseph’s Hospital, London, ON, Canada, for controls and at the IRCCS SDN, Naples, Italy, for the patients. Vacuumed pillows were used to minimize head movements within the scanner. The PET/MRI was acquired in the morning after customary nursing procedures. We also employed strategies to ensure patients’ best vigilance state by: (i) stopping possible sedative drugs (such as benzodiazepines) 15 h before scanning; (ii) administering CRS-R vigilance protocol [5] before PET/MRI acquisition and during the neuroimaging exam at the end of the first resting state of MRI acquisition; and (iii) monitoring eye openings by means of a video camera located in the MRI scanner. In case of appearance of clinical signs of possible drowsiness (i.e., persistence of eye closing), MRI acquisition was stopped, and the CRS-R vigilance protocol was re-administered.
The following MRI sequences were sequentially run:
-
I.
First rs-fMRI acquisition (named “t1”) by a T2 *-weighted single-shot EPI sequence (voxel-size 4 × 4 × 4 mm3, repetition time (TR)/echo time (TE) = 1000/21.4 ms, flip angle = 82°, 480 time points, field of view (FOV) read = 256 mm, multiband factor = 2, distance factor = 0, TA = 8′06″).
-
II.
Three-dimensional T1-weighted magnetization-prepared rapid acquisition gradient-echo sequence (MPRAGE, 240 sagittal planes, 256 × 214 mm field of view, voxel size 0.8 × 0.8 × 0.8 mm3, TR/TE/inversion time (TI) 2400/2.25/1000 ms, flip angle 8°, acquisition time (TA) = 6′18″)
-
III.
Three-dimensional T2-weighted sequence (240 sagittal planes, 256 × 214 mm field of view, voxel size 0.8 × 0.8 × 0.8 mm3, TR/TE 3370/563 ms, TA = 6′46″).
-
IV.
Three-dimensional fluid attenuation inversion recovery (FLAIR, 160 sagittal planes, 192 × 192 mm field of view, voxel size 1 × 1 × 1 mm3, TR/TE/TI 5000/334/1800 ms, TA = 6′42″).
-
V.
Second rs-fMRI acquisition (named “t2”) by a T2 *-weighted single-shot EPI sequence (voxel-size 4 × 4 × 4 mm3, TR/TE = 1000/21.4 ms, flip angle = 82°, 480 time points, FOV read = 256 mm, multiband factor = 2, distance factor = 0, TA = 8′06″). The two rs-fMRI acquisitions (t1 and t2) were separated by a 30 min interval.
-
VI.
Diffusion tractography (TR: 3,851, TE: 84.2 voxel: 2 mm3 isotropic, axial planes; 71 directions; b value max: 1500, matrix: 128 × 128 acquired both with Anterior-Posterior and Posterior-Anterior phase encoding).
Anatomical Data Preprocessing
The T1-weighted (T1w) image was corrected for intensity non-uniformity (INU) with N4BiasFieldCorrection [27], distributed with ANTs 2.2.0 [28], and used as the T1w reference throughout the workflow. The T1w reference was then skull-stripped with a Nipype implementation of the antsBrainExtraction.sh workflow (from ANTs), using OASIS30ANTs as the target template. Brain tissue segmentation of cerebrospinal fluid (CSF), white-matter (WM), and gray-matter (GM) was performed on the brain-extracted T1w using fast FMRIB software library (FSL 5.0.9, [29]). Brain surfaces were reconstructed using recon-all (FreeSurfer 6.0.1, [30]), and the brain mask estimated previously was refined with a custom variation of the method to reconcile ANTs-derived and FreeSurfer-derived segmentations of the cortical gray matter of Mindboggle [31]. Volume-based spatial normalization to one standard space (MNI152NLin2009cAsym) was performed through nonlinear registration with antsRegistration (ANTs 2.2.0), using brain-extracted versions of both the T1w reference and the T1w template. The following template was selected for spatial normalization: ICBM 152 Nonlinear Asymmetrical template version 2009c [32].
Functional Data Preprocessing
Results included in this manuscript come from preprocessing performed using fMRIPrep 1.4.0 ([33], RRID:SCR_016216), which is based on neuroimaging pipeline in python (Nipype 1.2.0) [34,35]. For each of the resting-state fMRI runs, the following preprocessing was performed. First, a reference volume and its skull-stripped version were generated using a custom methodology of fMRIPrep. The BOLD reference was then co-registered to the T1w reference using bbregister (FreeSurfer), which implements boundary-based registration [36]. Co-registration was configured with nine degrees of freedom to account for distortions remaining in the BOLD reference. Head-motion parameters with respect to the BOLD reference (transformation matrices, and six corresponding rotation and translation parameters) were estimated before any spatiotemporal filtering using mcflirt (FSL 5.0.9, [37]). BOLD runs were slice-time corrected using 3dTshift from AFNI 20160207 ([38]). The BOLD time-series (including slice-timing correction) were resampled onto their original, native space by applying a single, composite transform to correct for head motion and susceptibility distortions. The BOLD time-series were resampled into standard space, generating a preprocessed BOLD run in MNI152NLin2009cAsym space. Several confounding time-series were calculated based on the preprocessed BOLD/framewise displacement (FD), the spatial root mean square of the data after temporal differencing (DVARS), and three region-wise global signals. FD and DVARS were calculated for each functional run, both using their implementations in Nipype (following the definitions by [39]). The three global signals were extracted within the CSF, the WM, and the whole-brain masks. Additionally, a set of physiological regressors were extracted to allow for component-based noise correction (CompCor, [40]). Principal components were estimated after high-pass filtering of the preprocessed BOLD time-series (using a discrete cosine filter with 128s cut-off) for the two CompCor variants: temporal (tCompCor) and anatomical (aCompCor). tCompCor components were then calculated from the top 5% variable voxels within a mask covering the subcortical regions. This subcortical mask was obtained by heavily eroding the brain mask, which ensures it does not include cortical GM regions. For aCompCor, components were calculated within the intersection of the aforementioned mask and the union of the CSF and WM masks calculated in T1w space after their projection to the native space of each functional run (using the inverse BOLD-to-T1w transformation). Components were also calculated separately within the WM and CSF masks. For each CompCor decomposition, the k components with the largest singular values wereretained, such that the retained components’ time series were sufficient to explain 50% of variance across the nuisance mask (CSF, WM, combined, or temporal). As a final step, a high pass filter was applied to the fMRI time courses to linearly detrend the signal.
2.1.6. Diffusion MRI
Diffusion weighted images were acquired using high resolution 3T MR scans at the St. Joseph’s Hospital, London, ON, Canada for controls and at the IRCCS SDN for patients. All processing steps for tractography reconstruction and generation of structural connectivity matrices were performed with MRTrix toolbox, version 3.0, considering anatomical information carried out from Desikan-Killiany atlas based Freesurfer parcellation for cortical regions, and estimates from FSLs FIRST tool for subcortical areas. To increase the biological accuracy of the reconstructions, processing steps taking advantage of the anatomically constrained tractography (ACT) framework [41] were performed. Two different streamlined reconstruction approaches, probabilistic and deterministic [42,43], were performed on a multi-shell, multi-tissue constrained spherical deconvolution fiber orientation distribution model [44,45]. Reconstruction constraints were maximum streamline length equal to 25 centimeters, streamline seeds belonging to segmented white matter, and one million reconstructed streamlines per subject. All streamlines were mapped to the parcellated image to produce a structural connectome, considering the number of streamlines as structural connectivity weight. In addition, FA derived from conventional diffusion tensor tractography at b-value 3000, were mapped across probabilistic and deterministic streamlines, providing FA matrices that can be used as a proxy for structural connections integrity.
2.2. Generalized Ising Model Simulations
The GIM was simulated using the normalized structural connectome obtained from controls as well as from patients. Simulations were performed starting with a random spin configuration of size 1xL (L = 84). The spin configuration was placed in contact with a thermal bath of temperature T. Each spin could be in only one of the two spin states (either up (+1) or down (−1)). Both the equilibrium spin configuration and the thermodynamic properties of the system change with respect to the temperature. Energy of this spin configuration can be calculated in the absence of an external magnetic field by Equation (1),
(1) |
where Jij is the coupling (introduced through the structural connectome) between the ith and jth regions, Si and Sj represent the spins of the ith and jth regions, respectively, and n = 84. The GIM simulations were performed for each subject/patient over a range of temperatures starting with a random spin configuration using the metropolis Monte Carlo algorithm [22]. This process was repeated ten times for each structural connectome to ensure that we captured different random spin configurations and the results were averaged over these ten simulations. Each simulation resulted in a time series for each of the spin sites, permitting the calculation of a simulated correlation matrix using Pearson’s correlation. Then, the simulated correlation matrices were compared with the empirical correlation matrices using the Mantel test within the group of controls as well as patients, and the results between the two groups were also compared. Dimensionality of the brain was calculated for all the data via the generalized Ising model simulations as explained in the Supplementary Materials: Dimensionality Calculations. MATLAB code developed in-house (in MATLAB 2018b) was used for all computer simulations.
2.3. Multimodal Connectograms
Structural and functional connectomes were synergistically inspected via a multimodal representation. A modified version of the visualization routine implemented in the open-source multimodal imaging brain connectivity analysis (MIBCA) toolbox ([46], e1078) was adopted to generate multimodal connectograms. In particular, the multimodal connectogram consisted of a circular depiction where the most external ring corresponded to the cortical and subcortical GM regions of the Desikan–Killiany atlas, the internal rings showed the t1, t2, and simulated functional data, from inside to outside, respectively, and lines internal to the circle reflected structural connectivity between each pair of GM regions. For functional data, the connectivity was represented as degree, i.e., the cumulative connections for each brain region. Average connectivity of each population (healthy participants, MCS, and UWS) was graphically depicted with multimodal connectograms.
3. Results
The GIM was simulated using structural connectomes of 25 controls and structural connectomes of 13 patients with DoC. Simulations were repeated using each structural connectome ten times. Averages (over the ten simulations) of the magnetic susceptibility of the GIM were calculated and are plotted as a function of the temperature in Figure 1 and Figure 2 for controls and DoC patients, respectively. Magnetic susceptibility was used to locate the critical temperature of the simulations.
Differences observed in the temperature ranges between controls and patients and even within the patients’ groups are observed as a result of the differences/alteration between the structural connectomes of patients in different stages compared to controls. We further examined the distribution of the critical temperature between these groups, and results are presented in Figure 3A. A Welch two sample t-test between the controls and patients showed that there is a significant difference of the critical temperature between the two groups (t (12.21) = −3.34, p = 0.006; Figure 3A). A one-way ANOVA indicated that there was a main effect of subtype (F (3,25) = 6.54, p = 0.002), with a difference between healthy controls and VS/UWS, however, this did not survive false discovery rate (FDR) correction (t (5.04) = −3.09, p = 0.162; Figure 3B).
The correlation between the simulated and empirical functional connectivity was calculated using the Mantel test and is presented as a function of temperature in Figure 4 and Figure 5 for controls and patients, respectively. Correlations were calculated using empirical functional connectivity obtained from both t1 and t2 scans, which were acquired 30 min apart. These correlation measures were used to obtain T*, the temperature that maximizes the correlation between simulated and empirical functions.
For controls, a pairwise t-test showed that there was no significant difference in T* between the two scans (t (24) = 0.58, p = 0.571). Patients’ T* values for the two scans also did not show a significant difference (t (12) = 0.09, p = 0.932) as shown in Figure 5. T* values are shown in Figure 6A,B for further comparisons. There was also a significant difference between T* values of the controls and patients (t (12.22) = −3.21, p = 0.007). Therefore, the representation of results hereafter includes the results for the average as well as the results for the best scan out of the two (with the highest correlation coefficient) for comparisons.
To further examine the correlations between empirical and simulated functional connectivity matrices, the correlation at Tc was plotted for controls and patients in Figure 7A,B, and a pairwise t-test showed that the correlation between empirical and simulated functional connectivity matrices were significantly different for controls and patients with (t (20) = 2.85, p = 0.009).
Additionally, to illustrate the improvements in the predictability as a result of introducing the generalized Ising model, Figure 8 shows the direct correlations between empirical functional and structural connectivity matrices. By comparing the (A) panes from Figure 7A,B, and Figure 8A,B, it can be observed that the introduction of the GIM to find a relationship between the structure and the function of the brain improves the correlations from approximately 0.2 to 0.4 for controls and from 0.15 to 0.25 for the patients’ population.
Next, to compare the empirical functional and structural connectivity and simulated functional connectivity across brain regions, multimodal connectograms were plotted in Figure 9. The multimodal connectogram representation showed the correlations of both empirical and simulated functional data. In particular, the average connectograms reflected a similar trend of functional connectivity between empirical and simulated data.
Finally, dimensionality was calculated for controls and patients and plotted in Figure 10. A Welch two sample t-test indicated that the dimensionality of controls and patients significantly differed (t (26.47) = −3.26, p = 0.003). A one-way ANOVA showed a significant effect of subtype (F (3,25) = 3.30, p = 0.037), and post-hoc t-tests indicated that MCS− patients had a significantly higher dimensionality than controls (t (15.68) = −5.34, p < 0.001).
4. Discussion
The present study examined whether the GIM can be extended to predict functional connectivity of the brain in patients with DoC, who often have widespread structural brain damage. We measured the empirical correlation between regions of the brain in 25 healthy controls and 13 patients with DoC and also created simulated correlations between regions using the structural connectivity of each participant using the GIM. These simulations were performed at various temperatures (constant T), in order to identify the point at which the system went from ordered to disordered (Tc). We then used this parameter to find the temperature at which the correlation between empirical and simulated data was highest (T *). From this, we calculated the dimensionality of the system for both patients and controls.
Dimensionality was found to be higher in patients than in controls, indicating that information decays faster in the brains of patients with DoC than in healthy brains. That is, with increasing distance between two regions, the correlation between two regions decreases faster in patients than in controls. Because we saw a faster rate of decay in patients across the same distance in each group, it suggests that this difference arises from pathology in something other than the brain’s structural connections. This highlights the importance of taking both structure and function into account within the same model; here, we found that the reduction of functional connectivity goes beyond what can be explained by the reduction of structural connectivity.
Tc is the point at which the system flipped from ordered to disordered. Tc is directly controlled by the structural connectivity of the participant; the significantly lower Tc in controls compared to patients implies a difference at the structural level. It has been previously shown that Tc increases with increasing sparsity in the data [22]. The group differences in Tc thus may reflect greater sparsity in the structural connections of the brain of patients with DoC. When we examined differences by patient sub-group, however, we found no statistically significant differences. The lack of differences could be due to the small sample size for each patient group, leading to large amounts of variance, which can be seen in Figure 3. The fact that patients have different aetiologies likely contributed to the variance as well; although the patients in each group have the same diagnosis, the specific damage is unique to each patient. Numerically, however, each patient group showed higher Tc than controls, and as a group this difference reached significance, suggesting that healthy brains are more connected than those of patients with DoC.
An important implication of these results is whether the GIM is able to successfully model the brain of individuals with DoC. The effectiveness of the GIM can be improved by using the structural connectivity of the brain to weight the model’s connections. If the pathological activity observed through fMRI in patients with DoC was purely the result of damaged connections, then there would be little concern that the model may not generalize to patient groups. However, we know that there are a number of issues that can cause pathological brain function that do not rely on the connections in the brain being damaged, such as metabolic processes through astrocytes or gliosis, neuronal damage, and thalamic damage [47,48]. While we observed differences in the model parameters between healthy controls and patients, the model was successfully able to improve prediction of brain function beyond what structure can offer alone. That we saw improvements in correlation levels between the empirical and simulated data not only in controls but also in patients indicates that the GIM is generalizable to patient populations, including those with highly damaged brain structure.
Another practical implication of the present study relates to multiple resting-state fMRI acquisitions. In efforts to detect consciousness in patients, it is especially important to ensure that the patients, if they are conscious, are awake and aware at the time of testing. Despite there being protocols for ensuring that the patient is maximally conscious (as much as their disorder permits), it is often impossible to confirm that they are indeed awake and aware at the time of the scan. Additionally, patients often move during a scan, lowering the quality of the data. Here, we were able to improve the overall correlation between our empirical and simulated data by acquiring two scans per patient and using that which gave the highest correlation on a subject-wise basis. As can be seen in Figure 7, by using the best by-subject scan, correlation measures improved in all four groups (i.e., VS/UWS, MCS−, MCS+, healthy controls). These results highlight the importance of having good quality data, especially in patient groups, which might require multiple runs. This would be especially important in task-based data, as patients in a minimally conscious state will have fluctuating levels of wakefulness and awareness. These results underscore the importance of not making assumptions or drawing conclusions about a patient’s level of consciousness based on a single scan session. From this, we recommend that DoC patients are scanned at least twice [49], however, more research is needed to determine the gold standard.
We were also able to replicate the results of a previous study [22], confirming that the GIM can be used to simulate data in healthy populations. Although this was not the focus of the present study, these results are important as they show that the model is generalizable and replicable within healthy individuals. Future research will need to replicate the present DoC results in an independent sample of patients to confirm that they are reproducible in such populations. This is likely to be a more difficult task, as each patient has suffered a unique pattern of damage, which leads to a highly variable sample.
Several questions remain. First, could dimensionality, Tc, or T* be used in the future to determine a patient’s level of consciousness? This seems likely; there were several reliable differences in the GIM parameters between healthy controls and patients with DoC. Although DoC subtypes did not show differences, the numerical trend suggests that future research with larger samples may find these parameters to be predictive of the patient’s state of consciousness. While this method shows promise, at the moment, the interpretation of the GIM parameters should be combined with other measures to assess the level of consciousness, such as command-following fMRI tasks [46] and behavioural measures like the CRS and Glasgow coma scale (GCS). Second, can these measures be used to identify patients whose condition is likely to improve? While the present study did not examine this question, future research should apply this methodology to longitudinal data. It is possible that the GIM has predictive power, however, this is an empirical question that must be tested.
5. Conclusions
For the first time, we demonstrate that the GIM is applicable to modelling brain function in patients with DoC. The present study also applied a novel approach to calculate the brains’ dimensionality in DoC patients via the GIM. Indeed, the cross-sectional investigation on 13 patients with DoC demonstrated that dimensionality differed between diagnostic groups (i.e., VS/UWS, MCS−, and MCS+) and could distinguish them from healthy controls. This approach could be useful for determining the level of consciousness We acknowledge that the low number of patients and the heterogeneity in clinical diagnosis and etiology is the principal limitation of this study. However, it is important to underline that this sample size is comparable or higher to those reported in available published neuroimaging studies on DoC patients because of issues in acquiring functional neuroimaging in such non-collaborative and complex patients. Although the sample size of the present study did not allow for any generalization, we hope that our preliminary results can serve as a starting point for devising further multicenter research on larger homogeneous samples in order to standardize this innovative method and to investigate its possible contribution to current procedures and guidelines for diagnosis and prognosis [12,50].
Supplementary Materials
The following are available online at https://www.mdpi.com/2077-0383/9/5/1342/s1, Figure S1: Flow chart of patient selection in each step of the study, Document: Dimensionality Calculation.
Author Contributions
Conceptualization, P.M.A. and A.S.; methodology, P.M.A. and M.A.; software, P.M.A., C.C., and M.A.; validation, P.M.A., E.S.N., and M.A.; formal analysis, P.M.A. and E.S.N.; investigation, P.M.A.; data curation, P.M.A., and M.A.; writing—original draft preparation, E.S.N. and P.M.A.; writing—review and editing, P.M.A., E.S.N., M.A., C.C., A.E., A.M.O., and A.S.; visualization, P.M.A., E.S.N., and P.B.; supervision, A.S.; project administration, A.S. and A.M.O.; funding acquisition, A.S. and A.E.; patient’s enrolment and clinical assessment, A.E., S.F., and O.M. All authors have read and agreed to the published version of the manuscript.
Funding
This work was funded by NSERC, grant number RGPIN/05578-2014 and the Italian Ministry of Health, Ricerca Finalizzata, project code PE-2013-02358145. AMO is supported by CIFAR, the Canada Excellence Research Chairs Program (Grant No. 215063) and the Canadian Institutes of Health Research (CIHR, #408004).
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.
References
- 1.Turner-Stokes L. Prolonged disorders of consciousness: New national clinical guidelines from the Royal College of Physicians, London. Clin. Med. 2014;14:4. doi: 10.7861/clinmedicine.14-1-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Estraneo A., Loreto V., Guarino I., Boemia V., Paone G., Moretta P., Trojano L. Standard EEG in diagnostic process of prolonged disorders of consciousness. Clin. Neurophysiol. 2016;127:2379–2385. doi: 10.1016/j.clinph.2016.03.021. [DOI] [PubMed] [Google Scholar]
- 3.Bruno M.A., Vanhaudenhuyse A., Thibaut A., Moonen G., Laureys S. From unresponsive wakefulness to minimally conscious PLUS and functional locked-in syndromes: Recent advances in our understanding of disorders of consciousness. J. Neurol. 2011;258:1373–1384. doi: 10.1007/s00415-011-6114-x. [DOI] [PubMed] [Google Scholar]
- 4.Giacino J.T., Ashwal S., Childs N., Cranford R., Jennett B., Katz D.I., Kelly J.P., Rosenberg J.H., Whyte J., Zafonte R.D., et al. The minimally conscious state definition and diagnostic criteria. Neurology. 2002;58:349–353. doi: 10.1212/WNL.58.3.349. [DOI] [PubMed] [Google Scholar]
- 5.Cortese M.D., Riganello F., Arcuri F., Pugliese M.E., Lucca L.F., Dolce G., Sannita W.G. Coma recovery scale-r: Variability in the disorder of consciousness. BMC Neurol. 2015;15:186. doi: 10.1186/s12883-015-0455-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Casarotto S., Comanducci A., Rosanova M., Sarasso S., Fecchio M., Napolitani M., Pigorini A., Casali A.G., Trimarchi P.D., Boly M., et al. Stratification of unresponsive patients by an independently validated index of brain complexity. Ann. Neurol. 2016;80:718–729. doi: 10.1002/ana.24779. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Casali A.G., Gosseries O., Rosanova M., Boly M., Sarasso S., Casali K.R., Casarotto S., Bruno M., Laureys S., Tononi G., et al. A theoretically based index of consciousness independent of sensory processing and behavior. Sci. Transl. Med. 2013;5:198ra105. doi: 10.1126/scitranslmed.3006294. [DOI] [PubMed] [Google Scholar]
- 8.Bai Y., Xia X., Kang J., Yin X., Yang Y., He J., Li X. Evaluating the effect of repetitive transcranial magnetic stimulation on disorders of consciousness by using TMS-EEG. Front. Neurosci. 2016;10:473. doi: 10.3389/fnins.2016.00473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Popiel N.J., Khajehabdollahi S., Abeyasinghe P.M., Riganello F., Nichols E., Owen A.M., Soddu A. The Emergence of Integrated Information, Complexity, and ‘Consciousness’ at Criticality. Entropy. 2020;22:339. doi: 10.3390/e22030339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Tononi G., Boly M., Massimini M., Koch C. Integrated information theory: From consciousness to its physical substrate. Nat. Rev. Neurosci. 2016;17:450–461. doi: 10.1038/nrn.2016.44. [DOI] [PubMed] [Google Scholar]
- 11.Estraneo A., Trojano L. Prognosis in Disorders of Consciousness. In: Schnakers C., Laureys S., editors. Coma and Disorders of Consciousness. Springer; Cham, Switzerland: 2018. pp. 17–36. [Google Scholar]
- 12.Kondziella D., Bender A., Diserens K., van Erp W., Estraneo A., Formisano R., Laureys S., Naccache L., Ozturk S., Rohaut B., et al. European Academy of Neurology guideline on the diagnosis of coma and other disorders of consciousness. Eur. J. Neurol. 2020 doi: 10.1111/ene.14151. [DOI] [PubMed] [Google Scholar]
- 13.Laureys S., Boly M., Maquet P. Tracking the recovery of consciousness from coma. J. Clin. Investig. 2006;11:1823–1825. doi: 10.1172/JCI29172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Dragancea I., Wise M.P., Al-Subaie N., Cranshaw J., Friberg H., Glover G., Pellis T., Rylance R., Walden A., Nielsen N., et al. Protocol-driven neurological prognostication and withdrawal of life-sustaining therapy after cardiac arrest and targeted temperature management. Resuscitation. 2017;117:50–57. doi: 10.1016/j.resuscitation.2017.05.014. [DOI] [PubMed] [Google Scholar]
- 15.Elmer J., Torres C., Aufderheide T.P., Austin M.A., Callaway C.W., Golan E. Association of early withdrawal of life-sustaining therapy for perceived neurological prognosis with mortality after cardiac arrest. Resuscitation. 2016;102:127–135. doi: 10.1016/j.resuscitation.2016.01.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Mulder M., Gibbs H.G., Smith S.W., Dhaliwal R., Scott N.L., Sprenkle M.D., Geocadin R.G. Awakening and withdrawal of life-sustaining treatment in cardiac arrest survivors treated with therapeutic hypothermia. Crit. Care Med. 2014;42:2493–2499. doi: 10.1097/CCM.0000000000000540. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Grothe M.J., Teipel S.J. Alzheimer’s Disease Neuroimaging Initiative. Spatial patterns of atrophy, hypometabolism, and amyloid deposition in Alzheimer’s disease correspond to dissociable functional brain networks. Hum. Brain Mapp. 2016;37:35–53. doi: 10.1002/hbm.23018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Jha A., Litvak V., Taulu S., Thevathasan W., Hyam J.A., Foltynie T., Limousin P., Bogdanovic M., Zrinzo L., Green A.L. Functional connectivity of the pedunculopontine nucleus and surrounding region in Parkinson’s disease. Cereb. Cortex. 2017;27:54–67. doi: 10.1093/cercor/bhw340. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Zeng L.L., Shen H., Liu L., Wang L., Li B., Fang P., Zhou Z., Li Y., Hu D. Identifying major depression using whole-brain functional connectivity: A multivariate pattern analysis. Brain. 2012;135:1498–1507. doi: 10.1093/brain/aws059. [DOI] [PubMed] [Google Scholar]
- 20.Laureys S., Owen A.M., Schiff N.D. Brain function in coma, vegetative state, and related disorders. Lancet Neurol. 2004;3:537–546. doi: 10.1016/S1474-4422(04)00852-X. [DOI] [PubMed] [Google Scholar]
- 21.Abeyasinghe P.M., de Paula D.R., Khajehabdollahi S., Valluri S.R., Owen A.M., Soddu A. Role of Dimensionality in Predicting the Spontaneous Behavior of the Brain Using the Classical Ising Model and the Ising Model Implemented on a Structural Connectome. Brain Connect. 2018;8:444–455. doi: 10.1089/brain.2017.0516. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Deco G., Senden M., Jirsa V. How anatomy shapes dynamics: A semi-analytical study of the brain at rest by a simple spin model. Front. Comput. Neurosci. 2012;6:68. doi: 10.3389/fncom.2012.00068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Marinazzo D., Pellicoro M., Wu G.R., Angelini L., Cortes J.M., Stramaglia S. Information transfer of an Ising model on a brain network. BMC Neurosci. 2013;14:P376. doi: 10.1186/1471-2202-14-S1-P376. [DOI] [Google Scholar]
- 24.Stramaglia S., Pellicoro M., Angelini L., Amico E., Aerts H., Cortés J.M., Laureys S., Marinazzo D. Ising model with conserved magnetization on the human connectome: Implications on the relation structure-function in wakefulness and anesthesia. Chaos: Interdiscip. J. Nonlinear Sci. 2017;27:047407. doi: 10.1063/1.4978999. [DOI] [PubMed] [Google Scholar]
- 25.Estraneo A., Moretta P., De A.T., Gatta G., Giacino J.T., Trojano L. An Italian multicentre validation study of the coma recovery scale-revised. Eur. J. Phys. Rehabil. Med. 2015;51:627–634. [PubMed] [Google Scholar]
- 26.Tustison N.J., Avants B.B., Cook P.A., Zheng Y., Egan A., Yushkevich P.A., Gee J.C. N4ITK: Improved N3 bias correction. IEEE Trans. Med. Imaging. 2010;29:1310–1320. doi: 10.1109/TMI.2010.2046908. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Avants B.B., Epstein C.L., Grossman M., Gee J.C. Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 2008;12:26–41. doi: 10.1016/j.media.2007.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Zhang Y., Brady M., Smith S. Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans. Med. Imaging. 2001;20:45–57. doi: 10.1109/42.906424. [DOI] [PubMed] [Google Scholar]
- 29.Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis: I. Segmentation and surface reconstruction. Neuroimage. 1999;9:179–194. doi: 10.1006/nimg.1998.0395. [DOI] [PubMed] [Google Scholar]
- 30.Klein A., Ghosh S.S., Bao F.S., Giard J., Häme Y., Stavsky E., Lee N., Rossa B., Reuter M., Neto E.C., et al. Mindboggling morphometry of human brains. PLoS Comput. Biol. 2017;13:e1005350. doi: 10.1371/journal.pcbi.1005350. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Fonov V.S., Evans A.C., McKinstry R.C., Almli C.R., Collins D.L. Unbiased nonlinear average age-appropriate brain templates from birth to adulthood. NeuroImage. 2009;54:S102. doi: 10.1016/S1053-8119(09)70884-5. [DOI] [Google Scholar]
- 32.Esteban O., Markiewicz C.J., Blair R.W., Moodie C.A., Isik A.I., Erramuzpe A., Oya H. fMRIPrep: A robust preprocessing pipeline for functional MRI. Nat. Methods. 2019;16:111–116. doi: 10.1038/s41592-018-0235-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Gorgolewski K., Burns C.D., Madison C., Clark D., Halchenko Y.O., Waskom M.L., Ghosh S.S. Nipype: A flexible, lightweight and extensible neuroimaging data processing framework in python. Front. Neuroinform. 2011;5:13. doi: 10.3389/fninf.2011.00013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Gorgolewski K.J., Esteban O., Markiewicz C.J., Ziegler E., Ellis D.G., Jarecka D., Ghosh S. nipy/nipype: 1.1. 6. [(accessed on 30 April 2020)];2018 Available online: http://www.nipy.com/?f.
- 35.Greve D.N., Fischl B. Accurate and robust brain image alignment using boundary-based registration. Neuroimage. 2009;48:63–72. doi: 10.1016/j.neuroimage.2009.06.060. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Jenkinson M., Bannister P., Brady M., Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage. 2002;17:825–841. doi: 10.1006/nimg.2002.1132. [DOI] [PubMed] [Google Scholar]
- 37.Cox R.W., Hyde J.S. Software tools for analysis and visualization of fMRI data. NMR Biomed. Int. J. Devoted Dev. Appl. Magn. Reson. Vivo. 1997;10:171–178. doi: 10.1002/(SICI)1099-1492(199706/08)10:4/5<171::AID-NBM453>3.0.CO;2-L. [DOI] [PubMed] [Google Scholar]
- 38.Power J.D., Barnes K.A., Snyder A.Z., Schlaggar B.L., Petersen S.E. Steps toward optimizing motion artifact removal in functional connectivity MRI; a reply to Carp. Neuroimage. 2013;76 doi: 10.1016/j.neuroimage.2012.03.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Behzadi Y., Restom K., Liau J., Liu T.T. A component based noise correction method (CompCor) for BOLD and perfusion based fMRI. Neuroimage. 2007;37:90–101. doi: 10.1016/j.neuroimage.2007.04.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Smith R.E., Tournier J.D., Calamante F., Connelly A. Anatomically-constrained tractography: Improved diffusion MRI streamlines tractography through effective use of anatomical information. Neuroimage. 2012;62:1924–1938. doi: 10.1016/j.neuroimage.2012.06.005. [DOI] [PubMed] [Google Scholar]
- 41.Behrens T.E., Berg H.J., Jbabdi S., Rushworth M.F., Woolrich M.W. Probabilistic diffusion tractography with multiple fibre orientations: What can we gain? Neuroimage. 2007;34:144–155. doi: 10.1016/j.neuroimage.2006.09.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Alexander A.L. Deterministic white matter tractography. Diffus. MRI: Theorymethodsand Appl. 2010:383–395. doi: 10.1093/med/9780195369779.003.0022. [DOI] [Google Scholar]
- 43.Jeurissen B., Tournier J.D., Dhollander T., Connelly A., Sijbers J. Multi-tissue constrained spherical deconvolution for improved analysis of multi-shell diffusion MRI data. NeuroImage. 2014;103:411–426. doi: 10.1016/j.neuroimage.2014.07.061. [DOI] [PubMed] [Google Scholar]
- 44.Ribeiro A.S., Lacerda L.M., Ferreira H.A. Multimodal imaging brain connectivity analysis (MIBCA) toolbox. PeerJ. 2015;3:e1078. doi: 10.7717/peerj.1078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Owen A.M., Coleman M.R., Menon D.K., Johnsrude I.S., Rodd J.M., Davis M.H., Taylor K., Pickard J.D. Residual auditory function in persistent vegetative state: A combined PET and fMRI study. Neuropsychol. Rehabil. 2005;15:290–306. doi: 10.1080/09602010443000579. [DOI] [PubMed] [Google Scholar]
- 46.Mergenthaler P., Lindauer U., Dienel G.A., Meisel A. Sugar for the brain: The role of glucose in physiological and pathological brain function. Trends Neurosci. 2013;36:587–597. doi: 10.1016/j.tins.2013.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Cronenwett W.J., Csernansky J. Behavioral Neurobiology of Schizophrenia and Its Treatment. Springer; Berlin/Heidelberg, Germany: 2010. Thalamic pathology in schizophrenia; pp. 509–528. [DOI] [PubMed] [Google Scholar]
- 48.Cavaliere C., Kandeepan S., Aiello M., Ribeiro de Paula D., Marchitelli R., Fiorenza S., Orsini M., Trojano L., Masotta O., Lawrence K.S., et al. Multimodal neuroimaging approach to variability of functional connectivity in disorders of consciousness: A PET/MRI pilot study. Front. Neurol. 2018;9:861. doi: 10.3389/fneur.2018.00861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Formisano R., Giustini M., Aloisi M., Contrada M., Schnakers C., Zasler N., Estraneo A. An International survey on diagnostic and prognostic protocols in patients with disorder of consciousness. Brain Inj. 2019;33:974–984. doi: 10.1080/02699052.2019.1622785. [DOI] [PubMed] [Google Scholar]
- 50.Giacino J.T., Katz D.I., Schiff N.D., Whyte J., Ashman E.J., Ashwal S., Barbano R., Hammond F.M., Laureys S., Ling G.S.F., et al. Practice guideline update recommendations summary: Disorders of consciousness: Report of the Guideline Development, Dissemination, and Implementation Subcommittee of the American Academy of Neurology; the American Congress of Rehabilitation Medicine; and the National Institute on Disability, Independent Living, and Rehabilitation Research. Neurology. 2018;91:450–460. doi: 10.1212/WNL.0000000000005926. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.